DataOps Engineer

The Job You’re Considering

The Cloud Data Platforms team is part of the Insights and Data Global Practice and has seen strong growth and continued success across a variety of projects and sectors. Cloud Data Platforms is the home of the Data Engineers, Platform Engineers, Solutions Architects and Business Analysts who are focused on driving our customers digital and data transformation journey using the modern cloud platforms. We specialise on using the latest frameworks, reference architectures and technologies using AWS, Azure and GCP.

Hybrid working: The places that you work from day to day will vary according to your role, your needs, and those of the business; it will be a blend of Company offices, client sites, and your home; noting that you will be unable to work at home 100% of the time.

If you are successfully offered this position, you will go through a series of pre-employment checks, including: identity, nationality (single or dual) or immigration status, employment history going back 3 continuous years, and unspent criminal record check (known as Disclosure and Barring Service)

Your Role

The Data Ops Engineer role focuses on designing, building, automating, and orchestrating data pipelines and applications within containerised environments, primarily Kubernetes. This role bridges the gap between traditional cloud data engineering and DevOps, emphasising automation and continuous delivery of data solutions. Your work will be to:

• Designing, building, automating and orchestrating data pipelines using tools such as Airflow, Prefect, or Dagster.
• Containerising data applications using Docker and deploying them to Container Platforms (EKS, AKS and Kubernetes).
• Implementing and managing CI/CD pipelines for data applications.
• Implementing and managing comprehensive monitoring and observability solutions using tools like Grafana, Prometheus, and other non-native monitoring tools, ensuring data quality across the entire data flow.
• Working with Infrastructure as Code (IaC) tools (e.g., Terraform, Ansible) to provision and manage data infrastructure within pre-existing platforms.
• Optimising data processing for performance and scalability.

You can bring your whole self to work. At Capgemini equity, diversity and inclusion is part of everyday life, and will be part of your working reality. We have built an inclusive and welcoming environment, for everyone.

Your Skills and Experience

• Proficiency in data pipeline orchestration tools (e.g., Airflow, Prefect, Dagster).
• Extensive experience with Docker and Kubernetes.
• Proficiency in CI/CD principles and tools.
• Familiarity with open-source data tools (e.g., Spark, Kafka, PostgreSQL).
• Competency understanding of IaC concepts (e.g., Terraform, Ansible).
• Understanding of data architecture principles.
• Experience with monitoring and observability tools like Grafana and Prometheus.

Your Security Clearance

To be successfully appointed to this role, it is a requirement to obtain Security Check (SC) clearance.
To obtain SC clearance, the successful applicant must have resided continuously within the United Kingdom for the last 5 years, along with other criteria and requirements.
Throughout the recruitment process, you will be asked questions about your security clearance eligibility such as, but not limited to, country of residence and nationality.
Some posts are restricted to sole UK Nationals for security reasons; therefore, you may be asked about your citizenship in the application process.

What does ‘Get The Future You Want' mean for you?

You will be encouraged to have a positive work-life balance. Our hybrid-first way of working means we embed hybrid working in all that we do and make flexible working arrangements the day-to-day reality for our people. All UK employees are eligible to request flexible working arrangements.