← All jobs

Senior Data Engineer

London, UK Full-time Clearance: Currently holds Security Cleared (SC)
Data EngineerFull Stack Python DeveloperData Engineering Manager

Archer is matching candidates to this role at Solirius Reply. Create a free profile and Archer will check you against this role and every other live role, showing you exactly where you match.

The Role:
We are looking for an experienced Senior Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a fantastic team of technology experts.

You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability.

Requirements

Key Responsibilities:

  • Develop Data Engineering solutions for our clients/projects
  • Design and build data models, schemas to support business requirements
  • Develop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc.
  • Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based.
  • Working collaboratively with the client and cross-functional teams to identify and address data-related issues and opportunities.
  • Stay updated with the latest trends and developments in the data engineering field, such as modern data stack, big data technologies, cloud computing, etc
  • Assist with defining the processes needed to achieve operational excellence
  • Ensure data quality across all projects/clients
  • Define and manage SLA’s for data sets and processes throughout production
  • Lead on the design, build and launch of new data models and pipelines

 

Key Skills/Experience:

  • Experience in operating as part of data engineering teams and independently.
  • Line/Team management experience, leadership experience
  • Experience of working with cloud infrastructure (Azure or AWS, GCP is beneficial)
  • SQL and relational databases (e.g. MS SQL/Azure SQL, PostgreSQL)
  • You have framework experience within either Flask, Tornado or Django, Docker
  • Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo
  • Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc.
  • Data acquisition and development of data sets and improving data quality
  • Preparing data for predictive and prescriptive modelling
  • Hands on coding experience, such as Python
  • Reporting tools (e.g. Tableau, PowerBI, Qlik)
  • GDPR and Government Service Standard (desirable)
  • Passionate, motivated and enthusiastic about developing technology solutions.
  • Experience working in an Agile development environment
  • Data architecture experience.
  • Active Security Clearance

Apply knowing you're qualified

One free profile is all it takes. Archer checks you against this role and every other live role we list, and shows you exactly which requirements you meet before you apply.

More roles like this

See all Data Engineer jobs

Not quite the right role?

Archer scans thousands of live roles and surfaces the ones you genuinely match, each with a clear explanation of why. It keeps working after you apply, so you hear about roles you would never have found by searching.

Create your free profile