Databricks

Type: Lakehouse

Website: https://www.databricks.com/

General docs: https://docs.databricks.com/en/index.html

API Docs: https://docs.databricks.com/api/azure/workspace/introduction

Authentication

To connect Databricks to Orchestra, you will need:

  • a Databricks enterprise account (the API cannot be accessed from the community edition)

Instructions

Generate Access Token

  • Head over to Databricks and navigate to User Settings

  • Click on 'Developer' in the 'User' section

  • Select 'Manage' in the 'Access tokens' section

  • Generate a new token (with any lifetime value), copy the value, and store here in 'Access token'

Finding Workspace URL

  • The workspace URL is in the format https://<instance-name>.cloud.databricks.com.

  • Copy the value of <instance-name>.cloud.databricks.com, and store here in 'Workspace URL'

Jobs

Job nameDescription

Databricks run workflow

This job triggers a connector using this endpoint.

PreviousRun QueryNextRun Workflow

Last updated