Skip to content
#

data-pipeline-automation

Here are 8 public repositories matching this topic...

Language: All
Filter by language

FabricEngineer is a comprehensive Python package designed specifically for Microsoft Fabric developers to streamline data transformation workflows and automate complex ETL processes. This package provides enterprise-grade solutions for building robust data pipelines with minimal boilerplate code.

  • Updated Aug 27, 2025
  • Jupyter Notebook

End-to-end data pipeline transforming Olist e-commerce data through Azure cloud services. Implements medallion architecture (Bronze-Silver-Gold) with multi-source ingestion, Spark-based processing, and OLTP-to-OLAP optimization for analytics-ready datasets.

  • Updated Oct 7, 2025
  • Jupyter Notebook

Data automation involves automating the extraction, transformation, and loading (ETL) processes to streamline data workflows. GitHub Actions enables automated execution of tasks, such as building, testing, and deploying code, in response to events. This integration simplifies continuous deployment and ensures repeatable data pipeline operations

  • Updated Feb 25, 2025
  • HTML

Improve this page

Add a description, image, and links to the data-pipeline-automation topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the data-pipeline-automation topic, visit your repo's landing page and select "manage topics."

Learn more