Create an Apache Iceberg connection
Establish a zero copy connection to Apache Iceberg in Zero Copy Connector Hub.
Before you begin
Role required: df_connection_admin
About this task
Work with your data source admin to create a connection to Apache Iceberg. For additional information about connecting, refer to the Iceberg connector documentation.
Procedure
Navigate to the available primary connectors in Zero Copy Connector Hub in one of the following ways:
- Navigate to All > Workflow Data Fabric Hub > Available connectors > Primary connectors.
- Navigate to Admin > Workflow Data Fabric Hub > Available connectors > Primary connectors.
- Find the Apache Iceberg connector and select Connect.
On the form, fill in the fields.
| Field | Description |
|---|---|
| Name and description | |
| Connection label | Unique name for this connection. This helps in identifying the connection within your system. |
| Connection name | System-generated name based on the Connection label. This field cannot be modified once the connection is established. |
| Short description | Description of the connection explaining what it is about. |
| Object storage authentication | |
| Object storage system | Storage system used. The available options are:- Amazon S3 \(the default\) - Azure Data Lake Storage \(ADLS\) - S3-Compatible |
| Amazon S3 | |
| AWS access key | Access key used to access AWS S3. |
| AWS secret key | Secret key used to access AWS S3. |
| AWS region | AWS region where your AWS S3 bucket is located. |
| S3-Compatible | |
| S3 endpoint URL | Endpoint URL for the S3-compatible object storage system. |
| S3 access key | Access key used to authenticate with your S3-compatible storage service. |
| S3 secret key | Secret key used to authenticate with your S3-compatible storage service. |
| S3 region | Region where your S3-compatible object storage bucket is located. |
| Azure Data Lake Storage \(ADLS\) | |
| Azure Access Key | Access key for ADLS. |
- Configure the object storage system that you want to use with Apache Iceberg.
| Option | Description |
|---|---|
| Amazon S3 | 1. Enter the access key used to access S3. 2. Enter the secret key used to access S3. 3. Enter the AWS region where your S3 bucket is located. 4. Configure the metastore that you want to use with Apache Iceberg. |
| S3-Compatible | 1. Enter the endpoint URL for the S3-compatible object storage system. 2. Enter the access key used to authenticate with your S3-compatible storage service. 3. Enter the secret key used to authenticate with your S3-compatible storage service. 4. Enter the region where your S3-compatible object storage bucket is located. 5. Configure the metastore that you want to use with Apache Iceberg. |
| Azure Data Lake Storage (ADLS) | Enter the ADLS Access Key. |
- Configure the metastore that you want to use with Apache Iceberg.
| Option | Description |
|---|---|
| Hive Thrift |
|
| AWS Glue |
|
| Rest |
|
- Select Connect.
Result
A test connection is made to the external data source, verifying that the connection details are correct and the data source is accessible.
What to do next
If the connection succeeds, configure data steward access on the Access Control tab. See Manage access to an established connection using roles.
If the connection fails, verify the connection details with your data source administrator and try again.