Senior Data Engineer (Ex-Google)
15+ years experience
---
Development:
- ETL: Any framework, Python, Java, Go
- ELT: Any warehouse, dbt, SQLMesh, Dataform
- Streaming: Kafka, Flink, Dataflow/Beam, Spark
- CDC/Replication: Debezium, dlt, Airbyte
- Orchestration: Airflow, Prefect, Dagster
---
Optimization:
- Performance, cost optimization
- Resource utilization, capacity planning
- Execution log, explain plan analysis
- Query rewriting, storage optimization
---
Modernization:
- Code translation: Oracle, Teradata, Hive, Informatica
- Data migration: transfer, reformatting, validation
- Automation: sqlglot, jOOQ, Calcite, OpenRewrite
---
Observability:
- Data quality: Great Expectations, Soda
- Data lineage: RCA, impact analysis
- Telemetry: logging, monitoring, alerting
---
Automation:
- Build automation: Gradle, Maven
- CI/CD: Argo, Dagger, Jenkins
- IaC: Teraform/CDKTF, Helm/CDK8s
---
Engagement model: 2-week sprints @ $15k per-sprint upfront
Free consultation: http://bit.ly/46lF7If | aj@ajwelch.dev | https://ajwelch.dev