Save time and effort sourcing top tech talent

Data Engineering Principal

Bristol, UK
Data Architect Data Engineer Data Engineering Manager Principal Engineer
Actively hiring

Data Engineering Principal

BT
Bristol, UK
Data Architect Data Engineer Data Engineering Manager Principal Engineer
BT
Actively hiring

hackajob is partnering with BT to fill this position. Create a profile to be automatically considered for this role—and others that match your experience.

 

Why BT Group?

BT Group was the world’s first telco and our heritage in the sector is unrivalled. As home to several of the UK’s most recognised and cherished brands – BT, EE, Openreach and Plusnet, we have always played a critical role in creating the future, and we have reached an inflection point in the transformation of our business.

Over the next two years, we will complete the UK’s largest and most successful digital infrastructure project – connecting more than 25 million premises to full fibre broadband. Together with our heavy investment in 5G, we play a central role in revolutionising how people connect with each other.

While we are through the most capital-intensive phase of our fibre investment, meaning we can reward our shareholders for their commitment and patience, we are absolutely focused on how we organise ourselves in the best way to serve our customers in the years to come. This includes radical simplification of systems, structures, and processes on a huge scale. Together with our application of AI and technology, we are on a path to creating the UK’s best telco, reimagining the customer experience and relationship with one of this country’s biggest infrastructure companies.

Change on the scale we will all experience in the coming years is unprecedented. BT Group is committed to being the driving force behind improving connectivity for millions and there has never been a more exciting time to join a company and leadership team with the skills, experience, creativity, and passion to take this company into a new era.


 

Why this job matters

The Data Engineering Principal leads the AWS design, building and implementation of processes to capture, manage, store and utilise structured and unstructured data from internal and external sources, turning the most complex business needs into the data that supports the DD Ops and BT group’s data strategies. This role involves both hands-on development and providing technical leadership to teams, ensuring the delivery of high-quality, scalable, and efficient data infrastructure.


 

What you’ll be doing – your accountabilities

  • Lead the design and implementation of robust, scalable, and secure data solutions using AWS services such as S3, Glue, Lambda, Redshift, EMR, Kinesis, and more—covering data pipelines, warehousing, and lakehouse architectures.

  • Drive the migration of legacy data workflows to Lakehouse architectures, leveraging Apache Iceberg to enable unified analytics and scalable data management.

  • Operate as a subject matter expert across multiple data projects, providing strategic guidance on best practices in design, development, and implementation.

  • Build and optimise data pipelines for ingestion, transformation, and loading from diverse sources, ensuring high standards of data quality, reliability, and performance.

  • Own the development of automation and monitoring frameworks that capture operational KPIs and pipeline health metrics, enabling proactive performance management.

  • Identify and resolve performance bottlenecks in data workflows, ensuring optimal resource utilisation and cost-efficiency.

  • Collaborate closely with architects, Product Owners, and development teams to decompose solutions into Epics, leading the design and planning of technical components.

  • Mentor and coach engineering professionals, fostering a culture of continuous learning, innovation, and technical excellence.

  • Champion inclusive and open team culture, leading complex projects autonomously and facilitating high-impact technical discussions.

  • Define and manage service level agreements (SLAs) for data products and production processes, ensuring reliability and accountability.

  • Develop and optimise data science procedures, including storage strategies using distributed structures, databases, and other scalable technologies.

  • Lead the implementation of continuous improvement initiatives, enhancing team processes and delivery capabilities.

  • Serve as a trusted advisor to internal stakeholders, including data science and product teams, translating complex technical concepts into actionable solutions.


 

The skills you’ll need to succeed

  • Possess deep technical expertise in data engineering, with a strong command of modern practices and methodologies.

  • Recognised as an expert in AWS cloud services, particularly in designing and implementing scalable data engineering solutions.

  • Bring extensive experience in software architecture and solution design, ensuring robust and future-proof systems.

  • Hold specialised proficiency in Python and Apache Spark, enabling efficient processing of large-scale data workloads.

  • Demonstrate the ability to set technical direction, uphold high standards for code quality, and optimise performance in data-intensive environments.

  • Adept at using automation tools and CI/CD pipelines to streamline development, testing, and deployment processes.

  • An exceptional communicator, capable of translating complex technical concepts for diverse audiences including engineers, product managers, and senior leadership.

  • Provide thought leadership within engineering teams, fostering a culture of quality, efficiency, and collaboration.

  • Experienced in mentoring engineers, guiding them in advanced coding practices, architectural thinking, and strategic problem-solving to elevate team capabilities.


 

Leadership accountabilities

  • Solution Focused Achiever - This behaviour sits within the connected to customers part of the Connected Leaders Model. Being a Solution-focused Achiever means that you always deliver your ambitious goals, outcomes and timelines. It also means that you cut through complexity and obstacles to get to the right ethical solution at the right time.

  • Change Agent - This behaviour sits within the connected to people part of the Connected Leaders Model. Being a Change Agent means that you identify, create and lead smooth business changes. It also means that you adapt quickly and perform effectively – even when there’s ambiguity.

  • Team Coach - This behaviour sits within the connected to people part of the Connected Leaders Model. Being a Team Coach means that you coach and develop your people.

  • Decision Making - Gathers information, and analyses different scenarios, assesses alternative resolutions and reaches a decision.


 

Experience you’d be expected to have

  • Former Principal Engineer with a proven track record of leading teams in best practices across design, development, and implementation. Known for mentoring engineers and cultivating a culture of continuous learning and innovation.

  • Extensive background in software architecture and solution design, with deep expertise in microservices, distributed systems, and cloud-native architectures.

  • Advanced proficiency in Python and Apache Spark, with a strong focus on ETL data processing and scalable data engineering workflows.

  • In-depth technical knowledge of AWS data services, with hands-on experience implementing data pipelines using tools such as EMR, AWS Glue, AWS Lambda, Step Functions, API Gateway, and Athena.

  • Proven experience in designing and delivering Lakehouse architectures, enabling unified analytics across structured and unstructured data.

hackajob is partnering with BT to fill this position. Create a profile to be automatically considered for this role—and others that match your experience.

 

Upskill

Level up the hackajob way. Verify your skills, learn brand new ones and test your ability with Pathways, our learning and development platform.

Ready to reach your potential?