01
Data Engineering
Designing cloud data platforms and automated extract, transform and load (ETL) or extract, load and transform (ELT) workflows for downstream use.
- ETL / ELT pipelines
- Cloud data lakes
- Workflow orchestration
Tools I use
- Amazon Kinesis
- Amazon S3
- Apache Airflow
- Apache Iceberg
- Apache Spark
- AWS Glue
- dbt
- Docker
- GitHub Actions
- Great Expectations
- PostgreSQL
- Soda
- Terraform