AI Engineering Director

Join us to shape the next generation of AI solutions and make a lasting impact on the industry. You will lead a talented team, collaborate across business lines, and drive innovation through advanced AI platforms. Your expertise will help us stay ahead in a rapidly evolving field, offering you opportunities for growth and leadership. At JPMorganChase, we value your vision and empower you to push the boundaries of what’s possible.

Job Summary:
As an AI Engineering Director within LLM Suite engineering, AI/ML & Data Platforms team at JPMorganChase, you will lead a group of experts to develop horizontal capabilities through APIs, libraries, and thought leadership. You will collaborate with Line of Business AI teams to address priority use cases, design and build services, and promote best practices in AI. Your role involves mentoring AI engineers and ensuring we remain at the forefront of AI advancements. You will help shape our team culture and drive impactful solutions across the firm.

Job Responsibilities:

• Lead the architecture and implementation of scalable, reliable LLM-based systems and agentic AI platforms for enterprise use cases.
• Design and build production-grade AI systems, including agents, harnesses, skills, memory architectures, guardrails, and tool-use workflows.
• Architect and implement retrieval and context-engineering patterns such as embeddings, semantic search, grounding, summarization, and prompt/version management.
• Engineer cloud-native AI platforms on AWS using ECS, EKS, Lambda, SQS, SNS, containerized workloads, and DynamoDB-backed distributed architectures.
• Optimize AI systems for latency, throughput, scalability, caching, context efficiency, and cost.
• Build APIs, integrations, MCP Servers, and reusable platform capabilities to connect AI systems with enterprise platforms, tools, and workflows.
• Establish evaluation, experimentation, regression, and observability frameworks to continuously improve AI system quality, reliability, and agent behavior.
• Mentor senior engineers and influence engineering direction through code reviews, architecture discussions, technical standards, and cross-organizational leadership.

Required Qualifications, Capabilities, and Skills:

• PhD or deep experience using LLMs and Agents to develop scalable applications, or experience in a top commercial AI research lab.
• Strong understanding of AI fundamentals and practical experience with data analysis and experimental design.
• Recent hands-on experience training and deploying models and pipelines.
• Familiarity with distributed computing patterns for training, serving, and persistence of state.
• Experience building and leading high-performing AI teams.
• Exceptional verbal and written communication skills, with the ability to convey complex technical concepts to diverse audiences.
• Ability to influence key decision makers with compelling technical arguments.

Preferred Qualifications, Capabilities, and Skills:

• Experience with enterprise-scale AI platform development.
• Knowledge of industry-standard AI evaluation and observability frameworks.
• Expertise in cloud-native architectures and container orchestration.
• Proven track record of cross-functional collaboration and leadership.
• Familiarity with MCP protocols and enterprise integration patterns.
• Advanced skills in optimizing AI systems for performance and cost.
• Demonstrated commitment to fostering an inclusive and innovative team culture.

J.P. Morgan is a global leader in financial services, providing strategic advice and products to the world’s most prominent corporations, governments, wealthy individuals and institutional investors. Our first-class business in a first-class way approach to serving clients drives everything we do. We strive to build trusted, long-term partnerships to help our clients achieve their business objectives.

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our

FAQs

for more information about requesting an accommodation.

Our professionals in our Corporate Functions cover a diverse range of areas from finance and risk to human resources and marketing. Our corporate teams are an essential part of our company, ensuring that we’re setting our businesses, clients, customers and employees up for success.