Databricks Integration

Databricks can be used as both a source and destination in Edilitics. It supports full load, incremental, and CDC (destination only) in Replicate pipelines, and source or destination in Transform flows.

---

Before You Begin

• Your Databricks workspace URL, HTTP path, and a personal access token with sufficient privileges.
• The Edilitics IP addresses whitelisted in your Databricks workspace network settings:
  • 34.14.190.234
• Databricks default port: 443.

---

Steps to Connect

Step 1: Generate a Personal Access Token

1. In your Databricks workspace, click your username in the top right and select Settings.
2. Navigate to Developer and click Manage next to Access Tokens.
3. Click Generate new token, add a description, and click Generate.
4. Copy the token — it is only shown once.

Step 2: Find Your HTTP Path

1. In your Databricks workspace, go to SQL Warehouses (or Compute for clusters).
2. Select your SQL warehouse and open the Connection details tab.
3. Copy the HTTP Path value (e.g., /sql/1.0/warehouses/abc123def456).

Step 3: Add the Databricks Integration

1. In Edilitics, go to the Integrate module.
2. Click New Integration.
3. Select Databricks from the integration catalog.

Step 4: Enter Connection Parameters

Step 5: Configure the Integration

• Enter an Integration Name.
• Add an optional description.
• Configure AI Column Insights if required. See AI Column Insights.

Step 6: Test and Save

• Click Test Connection to validate credentials and network access.
• On success, click Preview to confirm table access.
• Click Save.

---

Connection Details

---

Supported Operations

Need help? Email support@edilitics.com with your workspace, job ID, and context. We reply within one business day.