Creating a network integration

A network integration allows Qlik to provision and manage resources in your AWS cloud environment. These resources process the tasks in your Qlik Open Lakehouse pipeline projects.

Prerequisites

Before you create a network integration, ensure you have completed the instructions in Prerequisites in AWS and have the following configuration information available:

• AWS account ID

• VPC ID

• Availability Zones and subnets

  Alternatively, these can be created during the manual integration process

• Symmetric KMS key ARN

• Kinesis stream name

• S3 bucket name

• Management role ARN

• EC2 instance profile ARN

Creating a manual integration

To configure your network integration, do the following:

1. In the Administration activity center, go to Lakehouse clusters, and on the Network integration tab, click Create New.

2. Configure the network:

• Network integration name: Enter a name for your network integration.

• Space: Select an existing space from the list.

3. Configure the AWS account:

• AWS account: Enter the AWS account where you want to deploy Qlik.

• Region: Select the region where your VPC is located.

• VPC ID: Enter the VPC where you want to deploy Qlik. The ID must be in lower case and prefixed with vpc-.

• Provide a list of Availability Zones and Subnets where the Qlik servers should be launched. Subnets must be public or private with a NAT gateway, and prefixed with subnet-.

4. In the integration settings, create a secure link:

• Enter the Symmetric KMS key ARN.

  Provide Qlik with a key to encrypt and decrypt data and resources managed in your cloud environment. Ensure the key is symmetric, not asymmetric, and give permission to Qlik .

  For instructions on creating the necessary permissions, see Symmetric KMS key.

5. Configure the integration resources:

• Kinesis stream for internal Qlik usage: Provide the location for the target Kinesis stream to synchronize the internal states of the lakehouse cluster instances. 

• S3 bucket for internal Qlik files: Enter the name of the S3 bucket for Qlik to store metadata, using the format:

  <bucket-name>

6. Grant Qlik access to your cloud:

• In Management role, enter the ARN role created in AWS, using the format:

  arn:aws:iam::<ACCOUNT_ID>:role/<ROLE_NAME>

  For instructions on creating this role, see Management role.

7. Configure your EC2 instances:

• Security groups: Enter the security IDs for the groups to associate with the Qlik instances, prefixed with sg-.

• EC2 instances profile: Enter the ARN role created in AWS, using the format:

  arn:aws:iam::<ACCOUNT_ID>:role/<ROLE_NAME>

  For more information on creating the required permissions, see Security group and EC2 instance profile.

8. Create a lakehouse cluster:

• Cluster name: Enter the name for the lakehouse cluster.

• Space: Select the space cluster will belong to. The space is not inherited from the network integration.

The lakehouse cluster is created with a single AWS Spot Instance. You can edit and manage the cluster after it has been created. For guidance, see Managing lakehouse clusters.