Data Lake Pipeline

  • Provisioned entire data lake pipeline as IaC with Terraform
  • Automated CI/CD workflow deploying Lambda functions to AWS with GitHub Actions
  • Decoupled API call function from data extraction function with S3 bucket trigger
  • Configured CloudWatch logs for observability & troubleshooting

Project link: https://medium.com/@james.lazo/day-3-devops-challenge-data-lake-e666aef6361e

Nifty tech tag lists fromĀ Wouter Beeftink