Save time and effort sourcing top tech talent
hackajob is partnering with Virgin Media O2 X giffgaff to fill this position. Create a profile to be automatically considered for this role—and others that match your experience.
Role: Data Engineer
Skills: Google Cloud Platform, Python, BigQuery, Dataflow, Cloud SQL, Cloud Bigtable, Pub/Sub and Cloud composer.
Job Description:
The Data Engineer works in the Data Engineering team and delivers the data pipelines. The essential duties and responsibilities are as follows,
- Collaborate with different teams to develop data pipelines.
- Design, Build and maintain data processing systems by following the standard development practices.
- Build monitoring tools and dashboards to track application performance.
- Be a team player by being open to knowledge sharing and collaborative working.
Required Skills and Experience:
- Strong experience in Python programming, Data base design and SQL.
- Strong experience in building batch and streaming data pipelines using BigQuery, Dataflow, Pub/Sub.
- Experienced in job automation and orchestration using Cloud composer.
- Experienced in using tools such as Jenkins, Gitlab or equivalent CI/CD tools.
- Experienced in using Cloud Logging and Cloud Monitoring.
- Experienced in GCP ways of Data security and Privacy tools - Identity and access management, Encryption, Key management, Data Catalog and Data Loss Prevention (DLP).
- Knowledge on implementing applications using Kubernetes.
Preferable Certifications:
- Professional Data Engineer
- Professional Cloud Architect
hackajob is partnering with Virgin Media O2 X giffgaff to fill this position. Create a profile to be automatically considered for this role—and others that match your experience.