Create an Apache Hudi connection

Establish a zero copy connection to Apache Hudi in Zero Copy Connector Hub.

Before you begin

Role required: df_connection_admin

About this task

Work with your data source admin to create a connection to Apache Hudi. For additional information about connecting, refer to the Hudi connector documentation.

Note: This connector was developed by the open-source community and made available through the ServiceNow AI Platform for general use. Functionality can vary and might not cover all use cases supported by primary connectors.

Procedure

Navigate to the available community connectors in Zero Copy Connector Hub in one of the following ways:
- Navigate to All > Zero Copy Connector Hub > Available connectors > Community connectors.
- Navigate to Admin > Zero Copy Connector Hub > Available connectors > Community connectors.
- Find the Apache Hudi connector and select Connect.
On the form, fill in the fields.

Configure the metastore that you want to use with Apache Hudi.

Field	Description
Name and description
Connection label	Unique name for this connection. This helps in identifying the connection within your system.
Connection name	System-generated name based on the Connection label. This field cannot be modified once the connection is established.
Short description	Description of the connection explaining what it is about.
Object storage authentication
Connection URI	URI to establish the connection. For example:`thrift://:`
Object storage system	Storage system used. Default is Amazon S3.
AWS access key	Access key used to access S3.
AWS secret key	Secret key used to access S3.
AWS region	AWS region where your S3 bucket is located.

Option Description

Hive Thrift

Attach the truststore file using one of the following options:
Upload the truststore file by selecting Attach TrustStore certificate and selecting the file.
Copy and paste the contents of the truststore file.
Enter the metastore URI that you want to connect to using the Thrift protocol. For example:

thrift://<host>:<port>

Enter the truststore password.

AWS Glue 1. Enter the AWS access key to connect to the Glue Catalog. 2. Enter the AWS secret key to use to connect to the Glue Catalog. 3. Enter the AWS region of the Glue Catalog.

Select Connect.

Result

A test connection is made to the external data source, verifying that the connection details are correct and the data source is accessible.

What to do next

If the connection succeeds, configure data steward access on the Access Control tab. See Manage access to an established connection using roles.

If the connection fails, verify the connection details with your data source administrator and try again.