Independent reference. No vendor sponsorship. British spelling.
datapipelinetool.com

Router

Choose a data pipeline tool in five questions

Most buying mistakes happen before vendor selection: the wrong category produces the wrong finalist list. This router asks five questions about destination shape, sync cadence, source mix, transform location, and self-host appetite, then returns a category and two or three named vendors worth a deeper look.

STEP 01

Where does the data land?

  • ›
    Cloud warehouse (Snowflake, BigQuery, Redshift)ELT is the default. Look at Fivetran, Airbyte, Stitch, Hevo.
  • ›
    Lakehouse (Iceberg, Delta, Hudi)Confirm Iceberg/Delta writers. Airbyte, Estuary, dbt + Spark.
  • ›
    Operational SaaS (Salesforce, HubSpot, Marketo)That is reverse-ETL. Census or Hightouch.
  • ›
    Real-time stream consumerStreaming or CDC. Estuary, Confluent, Debezium.
STEP 02

What is the realistic sync cadence?

  • ›
    Daily or hourly is fineBatch ELT. Fivetran, Stitch, Airbyte Cloud.
  • ›
    Every 15 minutesMicro-batch. Fivetran (premium), Airbyte Cloud, Hevo.
  • ›
    Sub-minute (streaming)Streaming-native: Estuary Flow, Kafka + Flink.
STEP 03

What does the source mix look like?

  • ›
    Mostly SaaS apps (Salesforce, HubSpot, Stripe)Fivetran has the broadest SaaS library; Airbyte close second.
  • ›
    Mostly databases needing CDCEstuary or Debezium-backed Airbyte; Fivetran for log-based premium.
  • ›
    Long-tail niche SaaS sourcesPortable specialises in the long tail.
  • ›
    Files + APIs + custom protocolsMeltano or Airbyte custom connectors.
STEP 04

Where does transformation live?

  • ›
    In the warehouse via dbtPair an ELT tool with dbt Core or dbt Cloud.
  • ›
    In the pipeline (push-down SQL)Matillion, Rivery, or Fivetran transformations.
  • ›
    In orchestrated PythonDagster, Prefect, or Airflow.
STEP 05

Can the team run self-hosted infra?

  • ›
    Yes, we have platform engineersSelf-hosted Airbyte or Meltano cuts subscription cost; budget 0.5 FTE.
  • ›
    Only with managed KubernetesMWAA, Astronomer, Airbyte Enterprise Flex.
  • ›
    No, fully managed onlyStay on Fivetran, Hevo, Estuary, or Airbyte Cloud.

Category landings

ELT

The default category for warehouse-first analytics

Orchestration

DAGs, asset-graphs, schedules

Streaming

Sub-minute pipelines, event-time semantics

CDC

Log-based DB replication

Reverse-ETL

Warehouse → operational SaaS

TCO calculator

Quantify the answer the router gives you

Written by Oliver Wakefield-Smith, Founder of Digital Signet. Independent reference, no vendor sponsorship.

Sources logged at /sources. Pricing-change history at /changelog. Last reviewed 2026-06-21.