An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer
-
Updated
Nov 25, 2024 - Python
An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer
A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.
An ETL Orchestration using Apache Airflow to extract CSV files from a Google Drive, validate, transform, and load into a PostgreSQL database.
This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.
Reference implementations for orchestration project using Astronomer/Airflow
An example project of how to use local devcontainers with the Astronomer Astro platform
Este projeto tem como objetivo extrair dados da API FIPE utilizando um ambiente Astronomer com Airflow para orquestração das tarefas que facilita o gerenciamento e implantação de fluxos de trabalho.
Sentiment Analysis using DistlBERT Transformer from HuggingFace. Also integrated Airflow for end-to-end pipeline
Airflow DAGs project with DBT hosted by Astronomer.
Chess Data Harmony is an ETL data engineering project using different tools like Python with pandas, AWS S3, Snowflake, all orchestrated by Airflow (Astronomer)
This project demonstrates how to use Terraform to provision data infrastructure on GCP to facilitate ETL pipeline.
This DBT (Data Build Tool) project leverages GCP (Google Cloud Platform) services, specifically Google BigQuery, and Metabase for data transformation, visualization, and Sales Dashboard creation, while also utilizing Soda (Streaming Data Build Tool) for real-time data processing
Setting up the dev environment with the Docker compose , Astro and Airflow
Hello, Astronomer! - The Enterprise Framework for Apache Airflow
astro plugin for asdf version manager
Repo for Datafest Datathon 2024
Add a description, image, and links to the astronomer topic page so that developers can more easily learn about it.
To associate your repository with the astronomer topic, visit your repo's landing page and select "manage topics."