Save time and effort sourcing top tech talent
hackajob is partnering with Virgin Media O2 X giffgaff to fill this position. Create a profile to be automatically considered for this role—and others that match your experience.
|
Role title: |
Senior Experimentation Manager |
|
Reports to (Manager’s job title): |
Head of Optimisation |
|
Directorate / Division: |
Digital XSUS and Care Product |
|
Department: |
Digital |
|
Location: |
Paddington, London |
|
Level / Grade: |
5 |
|
Role purpose |
|
The Senior Experimentation Manager plays a critical role in scaling a culture of scientific decision-making across Virgin Media O2’s digital and product ecosystem — running experimentation across multiple products, spanning both client-side and server-side tests on web, app and comms for existing customers. This role combines statistical expertise with strategic influence, enabling product, commercial, and wider business teams to make evidence-based decisions that drive growth, customer satisfaction, and measurement integrity. You’ll lead high-impact experimentation programmes end-to-end: from hypothesis generation and test design, through to advanced analysis, insight translation, and decision enablement. You’ll coach Experimentation Managers and Analysts, shape experimentation frameworks, and partner with senior product and marketing stakeholders to embed experimentation into core delivery cycles. You will report to the Head of Experimentation, supporting their mission to enhance customer value. Together, you'll design and execute innovative experiments to derive powerful insights that inform key business decisions. |
|
Key responsibilities & accountabilities |
|
|
· |
Lead a portfolio of experiments across multiple product lines, ensuring alignment to key growth and experience objectives. |
|
· |
Design and execute A/B/n, multivariate and bandit experiments. |
|
· |
Use the OST framework to identify solutions for genuine customer problems, creating experimentation roadmaps that incorporate exclusion groups and holdback groups. |
|
· |
Define and track success metrics for each experiment, ensuring alignment with business goals and key performance indicators. |
|
|
Deliver regular reports on experimentation outcomes, providing stakeholders with clear insights and actionable recommendations. |
|
|
Run QBRs with key stakeholders and squads to review key experimentation programme metrics. |
|
|
Foster collaboration among cross-functional teams, including data analysts, analytics implementation engineers, data scientists, user researchers, designers, product managers, QA, UX/UI designers, product owners and software engineers to deliver best-in-class experiments. |
|
|
Champion a culture of experimentation across the organisation. |
|
|
Communicate complex experimentation results to non-technical stakeholders in a clear, actionable format. |
hackajob is partnering with Virgin Media O2 X giffgaff to fill this position. Create a profile to be automatically considered for this role—and others that match your experience.