Senior Data Engineering Lead

Join us as a Senior Data Engineering Lead at Barclays. As a part of banking CRM team, you will be embarking on a journey of onboarding Banking datapoints to the Enterprise Data Platform (EDP) with Databricks which is a significant step forward in enhancing our data management capabilities. You will be responsible for designing, governing, delivering, and maintaining scalable Lakehouse-based data architectures on Databricks integrated with the Enterprise Data Platform (EDP). You will own projects end-to-end, ensuring that every aspect is meticulously managed and executed and are encouraged to bring new tools and technologies in Banking world and run multiple proof-of-concept throughout the year to build most efficient platform for our end users.

To be successful as a Senior Data Engineering Lead, you should have:

• Extensive experience in data engineering and data architecture

• Demonstrated practical experience working with Databricks, including Spark, SQL, and Python

• Deep expertise in AWS data services such as S3, Data Catalog with Glue, Athena, Redshift, and Iceberg

• Experience leading the design and delivery of large‑scale cloud data migration projects

• Ample understanding of data modelling, ETL concepts, and data warehousing principles

Some other highly valued skills may include:

• Experience working with CI/CD and DevOps practices using tools such as GitLab and Jenkins, as well as Claude for data platforms

• Familiarity with Power BI, Tableau, and enterprise reporting migrations

• Databricks Intermediate or Advanced Digital Credentials

• Exposure to AI/ML or NLP workloads within enterprise environments

You may be assessed on the key critical skills relevant for success in this role, such as risk and controls, change and transformation, business acumen, strategic thinking, digital and technology, as well as job-specific technical skills.

This role is located in Whippany, NJ.

Minimum Salary: $170,000

Maximum Salary: $230,000

The minimum and maximum salary/rate information above include only base salary or base hourly rate. It does not include any other type of compensation or benefits that may be available.

Barclays employees are eligible for a suite of competitive and generous employee benefits, including medical, dental and vision coverage, 401(k), life insurance, and other paid leave for qualifying circumstances.

This position is eligible for an incentive award.

Purpose of the role

To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. 

Accountabilities

• Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data.
• Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures.
• Development of processing and analysis algorithms fit for the intended data complexity and volumes.
• Collaboration with data scientist to build and deploy machine learning models.

Vice President Expectations

• To contribute or set strategy, drive requirements and make recommendations for change. Plan resources, budgets, and policies; manage and maintain policies/ processes; deliver continuous improvements and escalate breaches of policies/procedures..
• If managing a team, they define jobs and responsibilities, planning for the department’s future needs and operations, counselling employees on performance and contributing to employee pay decisions/changes. They may also lead a number of specialists to influence the operations of a department, in alignment with strategic as well as tactical priorities, while balancing short and long term goals and ensuring that budgets and schedules meet corporate requirements..
• If the position has leadership responsibilities, People Leaders are expected to demonstrate a clear set of leadership behaviours to create an environment for colleagues to thrive and deliver to a consistently excellent standard. The four LEAD behaviours are: L – Listen and be authentic, E – Energise and inspire, A – Align across the enterprise, D – Develop others..
• OR for an individual contributor, they will be a subject matter expert within own discipline and will guide technical direction. They will lead collaborative, multi-year assignments and guide team members through structured assignments, identify the need for the inclusion of other areas of specialisation to complete assignments. They will train, guide and coach less experienced specialists and provide information affecting long term profits, organisational risks and strategic decisions..
• Advise key stakeholders, including functional leadership teams and senior management on functional and cross functional areas of impact and alignment.
• Manage and mitigate risks through assessment, in support of the control and governance agenda.
• Demonstrate leadership and accountability for managing risk and strengthening controls in relation to the work your team does.
• Demonstrate comprehensive understanding of the organisation functions to contribute to achieving the goals of the business.
• Collaborate with other areas of work, for business aligned support areas to keep up to speed with business activity and the business strategies.
• Create solutions based on sophisticated analytical thought comparing and selecting complex alternatives. In-depth analysis with interpretative thinking will be required to define problems and develop innovative solutions.
• Adopt and include the outcomes of extensive research in problem solving processes.
• Seek out, build and maintain trusting relationships and partnerships with internal and external stakeholders in order to accomplish key business objectives, using influencing and negotiating skills to achieve outcomes.

All colleagues will be expected to demonstrate the Barclays Values of Respect, Integrity, Service, Excellence and Stewardship – our moral compass, helping us do what we believe is right. They will also be expected to demonstrate the Barclays Mindset – to Empower, Challenge and Drive – the operating manual for how we behave.