Data Engineering Principal

Why BT Group?
BT Group was the world’s first telco and our heritage in the sector is unrivalled. As home to several of the UK’s
most recognised and cherished brands – BT, EE, Openreach and Plusnet, we have always played a critical role in
creating the future, and we have reached an inflection point in the transformation of our business.
Over the next two years, we will complete the UK’s largest and most successful digital infrastructure project –
connecting more than 25 million premises to full fibre broadband. Together with our heavy investment in 5G, we
play a central role in revolutionising how people connect with each other.
While we are through the most capital-intensive phase of our fibre investment, meaning we can reward our
shareholders for their commitment and patience, we are absolutely focused on how we organise ourselves in the
best way to serve our customers in the years to come. This includes radical simplification of systems, structures,
and processes on a huge scale. Together with our application of AI and technology, we are on a path to creating the
UK’s best telco, reimagining the customer experience and relationship with one of this country’s biggest
infrastructure companies.
Change on the scale we will all experience in the coming years is unprecedented. BT Group is committed to being
the driving force behind improving connectivity for millions and there has never been a more exciting time to join a
company and leadership team with the skills, experience, creativity, and passion to take this company into a new
era.
Why this job matters
The Data Engineering Principal leads the AWS design, building and implementation of processes to capture,
manage, store and utilise structured and unstructured data from internal and external sources, turning the most
complex business needs into the data that supports the DD Ops and BT group’s data strategies. This role involves
both hands-on development and providing technical leadership to teams, ensuring the delivery of high-quality,
scalable, and efficient data infrastructure.
What you’ll be doing – your accountabilities The skills you’ll need to succeed
 Lead the design and implementation of
robust, scalable, and secure data
solutions using AWS services such as S3,
Glue, Lambda, Redshift, EMR, Kinesis, and
more—covering data pipelines, warehousing,
and lakehouse architectures.
 Drive the migration of legacy data workflows
to Lakehouse architectures,
leveraging Apache Iceberg to enable unified
analytics and scalable data management.

 Possess deep technical expertise in data
engineering, with a strong command of
modern practices and methodologies.
 Recognised as an expert in AWS cloud
services, particularly in designing and
implementing scalable data engineering
solutions.
 Bring extensive experience in software
architecture and solution design,
ensuring robust and future-proof systems.
 Hold specialised proficiency in Python

Last Updated: April 2025

Version 4 (April 2025)
 Operate as a subject matter expert across
multiple data projects, providing strategic
guidance on best practices in design,
development, and implementation.
 Build and optimise data pipelines for ingestion,
transformation, and loading from diverse
sources, ensuring high standards of data
quality, reliability, and performance.
 Own the development of automation and
monitoring frameworks that capture
operational KPIs and pipeline health metrics,
enabling proactive performance management.
 Identify and resolve performance
bottlenecks in data workflows, ensuring
optimal resource utilisation and cost-efficiency.
 Collaborate closely with architects, Product
Owners, and development teams to
decompose solutions into Epics, leading the
design and planning of technical components.
 Mentor and coach engineering professionals,
fostering a culture of continuous learning,
innovation, and technical excellence.
 Champion inclusive and open team culture,
leading complex projects autonomously and
facilitating high-impact technical discussions.
 Define and manage service level agreements
(SLAs) for data products and production
processes, ensuring reliability and
accountability.
 Develop and optimise data science
procedures, including storage strategies using
distributed structures, databases, and other
scalable technologies.
 Lead the implementation of continuous
improvement initiatives, enhancing team
processes and delivery capabilities.
 Serve as a trusted advisor to internal
stakeholders, including data science and
product teams, translating complex technical
concepts into actionable solutions.

and Apache Spark, enabling efficient
processing of large-scale data workloads.
 Demonstrate the ability to set technical
direction, uphold high standards for code
quality, and optimise performance in data-
intensive environments.
 Adept at using automation tools and
CI/CD pipelines to streamline development,
testing, and deployment processes.
 An exceptional communicator, capable of
translating complex technical concepts for
diverse audiences including engineers,
product managers, and senior leadership.
 Provide thought leadership within
engineering teams, fostering a culture of
quality, efficiency, and collaboration.
 Experienced in mentoring engineers,
guiding them in advanced coding practices,
architectural thinking, and strategic problem-
solving to elevate team capabilities.

Leadership accountabilities Experience you’d be expected to have
 Solution Focused Achiever -This behaviour
sits within the connected to customers part of
the Connected Leaders Model. Being a
Solution-focused Achiever means that you
always deliver your ambitious goals, outcomes

 Former Principal Engineer with a proven
track record of leading teams in best
practices across design, development, and
implementation. Known for mentoring
engineers and cultivating a culture of

Last Updated: April 2025

Version 4 (April 2025)
and timelines. It also means that you cut
through complexity and obstacles to get to the
right ethical solution at the right time
 Change Agent - This behaviour sits within the
connected to people part of the Connected
Leaders Model. Being a Change Agent means
that you identify, create and lead smooth
business changes. It also means that you
adapt quickly and perform effectively – even
when there’s ambiguity
 Team Coach - This behaviour sits within the
connected to people part of the Connected
Leaders Model. Being a Team Coach means
that you coach and develop your people.
 Decision Making -Gathers information, and
analyses different scenarios, assesses
alternative resolutions and reaches a decision

continuous learning and innovation.
 Extensive background in software
architecture and solution design, with
deep expertise
in microservices, distributed systems,
and cloud-native architectures.
 Advanced proficiency
in Python and Apache Spark, with a strong
focus on ETL data processing and
scalable data engineering workflows.
 In-depth technical knowledge of AWS data
services, with hands-on experience
implementing data pipelines using tools
such as EMR, AWS Glue, AWS
Lambda, Step Functions, API Gateway,
and Athena.
 Proven experience in designing and
delivering Lakehouse architectures,
enabling unified analytics across structured
and unstructured data.