This repository is the collection point for all of the projects completed during the Udacity Data Engineering Nano Degree program.

Atividades do curso "Fundamentos de Engenharia de Dados" da DataScienceAcademy.

Ayush @ Data Engineering Portfolio

Building Machine Learning and ETL Pipelines to categorize emergency messages based on the needs communicated by the sender

Two data frames of different kaggle cases of diesease cases and weather in Brazil. The project aims to clean the DFs and build a new one in order to analyse the correlation of dengue (serious disease transmited by mosquito), rain precipitation and temperature.

Analysis of NYC's citibike data. Technologies: Python , Prefect, dbt, Terraform , Looker data studio

IGTI Enhenheiro de Dados - Módulo 5 Desafio Final

Data ingestion solution using spring batch and postgreSQL as data warehouse.

cryptocurrency ticker data pipeline

The Security Reference Architecture (SRA) implements typical security features as Terraform Templates that are deployed by most high-security organizations, and enforces controls for the largest risks that customers ask about most often.

ETL Pipeline for Music Analysis

Pipelines de Airflow - códigos de exemplo

Experimenting with Data Pipelines in Python

Data Engineering Pipeline practice with Amazon Sales Data

An ETL pipeline that extracts, transforms, and loads data from various sources related to electric vehicle (EV) stocks.

A data pipeline that conducts ETL processes to AWS Redshift, utilizing Spark and coordinated by Apache Airflow.

ETL Pipeline for Shopping Data

End-to-end data engineering pipeline with various technologies to ingest real time data.