Know your tools

A field guide to the data world.

From a database on your laptop to a warehouse in the cloud.
Understand what each tool does, where it fits, and how to use it.

21 technologies Clear filters

Airbyte

Data integration

Connectors and synchronization workflows for moving data between systems.

Pipelines & streaming

Amazon Data Firehose

AWS

A managed service for delivering streaming data to supported destinations.

Pipelines & streaming

Amazon Kinesis Data Streams

AWS

A managed service for capturing and processing ordered streams within shards.

Pipelines & streaming

Amazon MSK

AWS

A managed Apache Kafka service for event-streaming applications.

Pipelines & streaming

Amazon MWAA

AWS

Managed Apache Airflow environments for orchestrating workflows.

Pipelines & streaming

Apache Airflow

Workflow orchestrator

A platform for authoring, scheduling, and monitoring batch-oriented workflows.

Pipelines & streaming

Apache Kafka

Event-streaming platform

A distributed event log for publishing, retaining, and consuming streams of records.

Pipelines & streaming

AWS Database Migration Service

AWS

Data migration and replication between supported sources and targets.

Pipelines & streaming

AWS Glue

AWS

Data discovery, cataloging, and managed integration jobs for analytical pipelines.

Pipelines & streaming

Azure Data Factory

Azure

Managed pipelines for moving and transforming data across supported systems.

Pipelines & streaming

Azure Database Migration Service

Azure

Migration tooling for moving supported databases to Azure destinations.

Pipelines & streaming

Azure Event Hubs

Azure

A managed event ingestion service with partitioned streams and consumer groups.

Pipelines & streaming

Azure Stream Analytics

Azure

Managed stream processing for continuous queries over incoming events.

Pipelines & streaming

Cloud Composer

Google Cloud

Managed Apache Airflow environments for orchestrating data workflows.

Pipelines & streaming

Cloud Data Fusion

Google Cloud

Managed data integration with visual pipeline authoring.

Pipelines & streaming

Database Migration Service

Google Cloud

Managed migration workflows for supported relational database sources and Google Cloud targets.

Pipelines & streaming

Dataflow

Google Cloud

Managed execution of Apache Beam pipelines for batch and streaming data.

Pipelines & streaming

Datastream

Google Cloud

Managed change data capture for moving changes from supported sources to destinations.

Pipelines & streaming
A little learning goes a long way

Make room for a few good minutes.

Join the list for practical guides, thoughtful comparisons,
and ideas worth bringing to your next project.

Find your next answer

Search concepts, tools, and practical guides.