A/B Testing & Analytics Manager

London, UK
Automation Tester
Actively hiring

Sign up for the chance to get matched to this role, and similar opportunities.

Successful candidates will be ready to be Customer-focused, collaborative and growth focused.

Purpose of the Role & Team Profile

As an A/B Testing and Analytics Manager, you will play a critical role in optimising our digital presence and customer experience through data-driven insights. You will lead multiple projects to conduct experiments, analyse data, and derive actionable insights aimed at improving user engagement, conversion rates, and overall business performance.

Key interactions

  • Collaborate with cross-functional teams including marketing, product development, design, and engineering to identify testing opportunities and implement data-driven solutions.
  • Engage with stakeholders to communicate findings, provide recommendations, and drive decision-making processes based on empirical evidence.
  • Mentor and guide stakeholders to foster a culture of data-driven decision-making and continuous improvement.

Key Areas of Responsibility/Accountability

  • A/B & MV Testing Strategy: Develop and execute a comprehensive A/B testing roadmap aligned with business objectives and user experience goals.
  • Experimentation Execution: Oversee the end-to-end process of designing, implementing, and analysing A/B tests using appropriate statistical methods and tools.
  • Data Analysis: Lead the analysis of test results and provide actionable insights to stakeholders, leveraging advanced analytics techniques to uncover patterns and trends.
  • Tool Management: Manage A/B testing and analytics platforms, ensuring data accuracy, reliability, and compliance with best practices and regulations.
  • Continuous Improvement: Identify opportunities for optimization and iterate on testing strategies to drive incremental improvements in key performance metrics.

Key Outputs and Outcomes

  • Detailed experiment plans and hypotheses documentation.
  • Clear and concise test results analysis reports with actionable recommendations.
  • Implementation of successful test variations to drive measurable business impact.
  • Continuous refinement of testing processes and methodologies to enhance efficiency and effectiveness.

Measures of Success 

  • Improvement in key performance metrics such as conversion rates, engagement metrics, and revenue.
  • Reduction in decision-making uncertainty through rigorous experimentation and data analysis.
  • Adoption of data-driven decision-making practices across the organisation.
  • Professional development and growth of team members.


What we’re looking for

  • Experience: Minimum of 3 years of experience in A/B / MV testing, analytics, or related fields, preferably in a managerial or leadership role.
  • Analytical Thinker: Ability to think strategically and translate business objectives into actionable testing plans and hypotheses.
  • Communication Skills: Strong verbal and written communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.


Sign up for the chance to get matched to this role, and similar opportunities.


Level up the hackajob way. Verify your skills, learn brand new ones and test your ability with Pathways, our learning and development platform.

Ready to reach your potential?