AI Assurance Engineer

MANTECH seeks motivated, career, and customer-oriented AI Assurance Engineer for a new initiative within the National Capital Region. This effort supports the rapid design, deployment, operation, and sustainment of enterprise-scale AI, data, and mission platform capabilities across cloud, edge, and classified operational environment.

This role supports mission analytics, AI-enabled workflows, predictive analytics, and operational intelligence applications. You will translate raw data into actionable insights, focusing on data science solutions for the mission.

Responsibilities include but are not limited to:

·       Support AI testing, evaluation, verification, and validation (TEVV) activities for operational AI systems.

·       Design and conduct adversarial testing, bias analysis, and prompt injection testing.

·       Utilize and develop automated AI evaluation frameworks and continuous validation workflows.

·       Execute regression validation and responsible AI testing to ensure model integrity.

·       Provide operational assurance by ensuring AI systems meet performance, safety, and security requirements.

Minimum Qualifications:

·       7 or more years of experience in AI testing, quality assurance, or model validation. Relevant additional experience will be considered in lieu of degree.

·       Experience in developing or utilizing AI evaluation frameworks and metrics.

·       Understanding of AI safety, bias, and responsible AI principles.

·       Demonstrated ability to implement continuous validation and operational assurance workflows.

·       Proven experience designing, building, securing or monitoring scalable solutions within the Microsoft Azure ecosystem (e.g., Azure OpenAI, Azure Synapse, Databricks, or Azure Security Center).

Preferred Qualifications:

·       Bachelor’s degree in Computer Science, Engineering, or a related field.

·       Experience with AI red teaming and advanced adversarial testing techniques.

·       Prior experience developing automated evaluation pipelines.

·       Master's degree in a relevant technical field.

Clearance Requirements:

·       TS/SCI with ability to obtain and maintain a polygraph 

Physical Requirements:

·       The person in this position must be able to remain in a stationary position 50% of the time.

·       Frequently communicates with co-workers, management, and customers, which may involve delivering presentations.

·       Constantly operates a computer and other office productivity machinery.