AWS Data Engineer

We are recruiting for a contract AWS-Centric Data Engineer with hands-on experience in Glue-based pipelines and data-quality processes to start ASAP. This role will be 2 days onsite in either Croydon or Manchester. The contract length is 10 weeks. 

Key Skills & Experience:

AWS & ETL:

• Deep experience with AWS Glue (jobs, crawlers, Glue Studio, Glue workflows).
• Understanding complexities of CI/CD with Glue, avoiding AWS CodeCommit/Repo if needed.
• Strong ETL background in AWS (Athena, S3, Lambda, Step Functions, etc.).

Data Pipeline Quality:

• Experience implementing data-quality checks, validation steps, logging, lineage.
• Understanding the differences between code-unit-testing and data-pipeline testing.
• Familiar with traditional ETL operational patterns (e.g., DTS-style stage validation).

General:

• Strong grasp of modern data-engineering patterns (bronze/silver/gold).
• Familiar with transforming data into multiple target formats (XML, graph structures, relational schemas).

Responsibilities:

• Build and enhance Glue-based data pipelines.
• Implement quality layers and validation logic.
• Work with the architect to deliver outputs in multiple ready-to-consume formats.
• Contribute to the design and delivery of the overall channel strategy.
• Support integration of pipeline outputs with backend/API layer.