Prefect

Python-based workflow orchestration for data and ML engineers.

Type: Workflow orchestration

Website: https://www.prefect.io/opensource

API Docs: https://docs.prefect.io/latest/

Authentication

To connect Prefect to Orchestra, you will need:

• An active Prefect server accessible from the internet

• Admin permissions within that Prefect server

• A user with the required permissions

• A deployed Flow

Prerequisites

To connect Prefect Cloud to Orchestra, you will need:

• a Prefect Cloud account

• an active deployment in Prefect Cloud

Instructions

Create API token

• Head over to Prefect cloud and navigate to API Keys

• Create a new API Key with the required permissions:

  • see_flows (View flows and flow runs)

  • run_flows (Run flows)

  • manage_flows (Create and update flows)

  • run_deployments (Create flow runs from deployments)

• Account ID can be found in the URL when logged in to prefect

• Workspace ID can be found in Settings -> General

Jobs

Job name	Description
Run Flow	triggers a Flow Run using this endpoint