landscape

Modern Data Stack

This landscape is intended as a map to explore open source data projects.

Infrastructure Automation

• Crossplane
• Pulumi

Identity Management

• Ory
• Casbin
• OPA

Event Streams

• Apache Kafka
• Apache Pulsar
• RabbitMQ
• ZeroMQ
• Apache ActiveMQ
• Apache RocketMQ
• Nats
• Gazette
• DistributedLog

Data Processing

• Apache Flink
• Apache Samza
• Apache Spark
• Apache Storm
• Apache Beam
• Azure Stream Analytics
• Hazelcast Jet
• Kafka Streams
• Onyx
• Siddhi
• StremX

Workflow Management

• DBT
• Dataform
• Dagster
• Airflow

Data Management

• Amundsen
• Databook
• Apache Atlas

Data Governance

• Tokern

Data Integration

• Airbyte
• Rudder Stack
• Steam Pipe

Feature Stores

• Hopsworks
• Feast

Observability

• Opstrace
• Alerta
• Great Expectations
• SigNoz

Misc

• Data Version Control
• https://docs.n8n.io/
• [Nestjs]
• https://kedro.readthedocs.io/en/stable/
• Superset
• Trino
• Prefect