Databricks

Type: Lakehouse

Website: https://www.databricks.com/

General docs: https://docs.databricks.com/en/index.html

API Docs: https://docs.databricks.com/api/azure/workspace/introduction

Authentication

To connect Databricks to Orchestra, you will need:

• a Databricks enterprise account (the API cannot be accessed from the community edition)

Instructions

Generate Access Token

• Head over to Databricks and navigate to User Settings

• Click on 'Developer' in the 'User' section

• Select 'Manage' in the 'Access tokens' section

• Generate a new token (with any lifetime value), copy the value, and store here in 'Access token'

Finding Workspace URL

• The workspace URL is in the format https://<instance-name>.cloud.databricks.com.

• Copy the value of <instance-name>.cloud.databricks.com, and store here in 'Workspace URL'

Jobs

Job name	Description
Databricks run workflow	This job triggers a connector using this endpoint.