A field guide to the data world.
From a database on your laptop to a warehouse in the cloud.
Understand what each tool does, where it fits, and how to use it.
Apache Airflow
Workflow orchestratorA platform for authoring, scheduling, and monitoring batch-oriented workflows.
Pipelines & streamingApache Cassandra
Wide-column databaseA distributed database built around partition-key access and tunable consistency.
NoSQL databasesApache Iceberg
Table formatAn open table format for managing analytical tables in object storage.
Lakehouses & formatsApache Kafka
Event-streaming platformA distributed event log for publishing, retaining, and consuming streams of records.
Pipelines & streamingApache Parquet
File formatA columnar file format for efficient analytical storage and reading.
Lakehouses & formatsApache Spark
Processing engineA distributed engine for large-scale data processing and SQL analytics.
Lakehouses & formatsApache Superset
BI toolAn open-source data exploration and visualization platform.
Governance & BIAWS Database Migration Service
AWSData migration and replication between supported sources and targets.
Pipelines & streamingAWS Glue
AWSData discovery, cataloging, and managed integration jobs for analytical pipelines.
Pipelines & streamingAWS Lake Formation
AWSCentralized permissions and governance capabilities for AWS data lakes.
Governance & BIAzure AI Search
AzureManaged text, vector, and hybrid search for application retrieval.
Search enginesAzure Cosmos DB
AzureA distributed database platform where API, partitioning, and consistency choices shape the application.
NoSQL databasesAzure Data Factory
AzureManaged pipelines for moving and transforming data across supported systems.
Pipelines & streamingAzure Data Lake Storage
AzureData lake capabilities built on Azure Blob Storage for analytical workloads.
Lakehouses & formatsAzure Database for MySQL
AzureManaged MySQL with Azure networking, backup, and availability options for application workloads.
Relational databasesAzure Database for PostgreSQL
AzureManaged PostgreSQL with Azure networking, backup, and availability options.
Relational databasesAzure Database Migration Service
AzureMigration tooling for moving supported databases to Azure destinations.
Pipelines & streamingAzure Event Hubs
AzureA managed event ingestion service with partitioned streams and consumer groups.
Pipelines & streaming