Orchestra Portal
  • Overview
  • Quick-start
  • Core concepts
    • 🎺Integrations
    • ⚡Triggers
      • Webhook - Airflow
    • 🔗Connections
    • 🗞️Pipelines
      • Creating a Pipeline
      • Pipeline runs
    • 🗒️Tasks
      • Creating a task
      • Task Runs
      • Task Groups
      • Self hosted Tasks
    • ✏️Integration Jobs
    • 🕶️Observability
      • Triggers (metadata)
      • Artifact types
      • Integration Jobs Metadata
    • 🔓Security
    • 🌴Branching
    • ⏰Alerting
    • ⛓️Version Control
    • 🏛️Artifacts
  • Integrations
    • 🥞Ingestion / ELT
      • Fivetran
        • Sync All
      • Matillion Data Productivity Cloud (DPC)
        • Execute Pipeline
      • Stitch
        • Sync
      • Airbyte Cloud
        • Sync
      • Airbyte Server
        • Sync
      • Matillion ETL
        • Run job
      • Portable
        • Run Flow
      • Rivery
        • Run River
      • Nimble
        • Nimble Web API
    • 🔧Utility
      • HTTP
        • Request
        • Python SDK
      • Render
        • Run job
      • Boomi
        • Execute process
      • Python SDK
        • Job
      • GitHub Actions
        • Run Workflow
      • Linux SSH
        • Execute command
    • 📈Business Intelligence
      • Tableau Cloud
        • Refresh extract
        • Update subscription
      • Sigma
        • Dataset materialisation
      • Lightdash
        • Refresh Dashboard Charts
      • Hex
        • Project run
      • Power BI
        • Dataset Refresh
    • 🔁Workflow Orchestration
      • Airflow
        • DAG Run
      • Prefect
        • Flow Run
    • 🌊Streaming Platforms
      • GCP - Datastream
        • Datastream check stream status
    • 💢Transformation
      • dbt Cloud
        • Run job
      • Coalesce
        • Run job
    • ↩️Reverse ELT ("rELT")
      • Census
        • Sync
      • Hightouch
        • Sync
    • 🤖Warehouses / Lakehouses
      • AWS - Redshift
        • Execute Statement
      • GCP - BigQuery
        • Run Query
      • Databricks
        • Run Workflow
      • Snowflake
        • Run Query
    • ☁️Cloud Provider Integrations
      • AWS
        • AWS EC2 (Cloud Compute Capacity)
          • EC2 SSM Run Script
        • AWS ECS (Elastic Container Service)
          • ECS Run task
            • Running dbt Core on ECS
        • AWS Glue
          • Run AWS Glue ETL Job
        • AWS Lambda
          • Run AWS Lambda execute async function
        • AWS Sagemaker
          • Run AWS Train Sagemaker Model
      • Azure
        • Azure Data Factory
          • ADF Run Pipeline
        • Azure Synapse Analytics
          • Synapse Run Pipeline
        • Azure VM
          • Run Command
  • Running and Retrying Pipelines
    • Running Pipelines
  • Organisation settings
    • Single Sign-On (SSO)
      • Okta
  • Migration Guides
    • Shipyard
Powered by GitBook
On this page
  1. Integrations

Streaming Platforms

Streaming platforms are also a subset of data movement tools, just like Ingestion tools.

We classify a Streaming platform if it contains the functionality to facilitate the movement of data from one place to another in more or less real-time, that is, without a trigger. In addition, most cloud vendors have some form of managed service for Streaming Platforms too. For example, Datastream in GCP. Streaming platforms are not direct integrations to service-bus type architectural facilities such as Azure Service Bus.

Examples of Third party Streaming platforms

  • Striim

  • RedPanda

  • Upsolver

  • Estuary

  • Streamkap

Examples of Cloud-provided Streaming platforms

  • Datastream (GCP)

PreviousFlow RunNextGCP - Datastream

Last updated 9 months ago

🌊