Job Description
Job Description
AI Strategy Lead
N2IA is seeking an AI SME to support our customer who has been tasked to direct the strategy, deployment, and management of all efforts related to the development, implementation, and deployment of artificial intelligence and machine learning initiatives within the agency. Artificial Intelligence (AI) Engineer/Policy SME will support a fastpaced, dynamic environment supporting the governance process. In this role, this person will work closely with the customer to create AI governance policy based on experience and real-world considerations, and provide hands-on work dealing with AI models for prototyping, training, inference, and deployment. The customer is seeking a subject matter expert, creating and translating trend analyses, and facilitate stakeholder decision-making, policy, and governance pertaining to current and emerging AI technology.
Responsibilities:
- Develop frameworks to be utilized at project initiation and throughout deployment, ensuring each AI tool deployment clearly demonstrates benefit to the customer, does not negatively impact safety and security, preserves human accountability, incorporates transparency mechanisms, considers sustainability and workforce impacts, and protects privacy and cybersecurity.
- Facilitates cross-functional collaboration between technical teams, business units, ethics review committees, and compliance offices to ensure responsible AI development and deployment aligned with business goals and regulatory requirements
- Develop policy and guidance for the enterprise in data acquisition, data governance, model development, testing and validation, deployment, monitoring, and maintenance activities
- Design and implement evaluation frameworks for agentic workflows, LLMs / NLP, computer vision and multimodal models.
- Develop and execute evaluation plans to measure performance, reliability, and safety across multimodal datasets
Qualifications:
- Bachelor's degree in Computer Science, Software Engineering, Data Science, or a related field required; Master's preferred.
- 8+ years of professional experience in software or AI engineering, including at least 3 years hands-on experience with LLMs, generative AI, and agentic frameworks such as MCP, A2A, the OpenAI Agents SDK.
- Be an expert in the field of AI with an in-depth knowledge of AI architecture and development
- Experience translating highly technical concepts into policy and governance documents
- Ability to communicate complex evaluation results to technical and non-technical stakeholders and influence model improvements.
- Proven experience designing and implementing evaluation methodologies for AI systems, including LLMs and computer vision.
- Strong knowledge of metrics for AI performance, robustness, and fairness, especially in regulated domains.
- Expertise in at least 3 of the following: benchmarking frameworks, statistical validation, synthetic data generation, adversarial testing, explainability techniques.
Security clearance:
- Secret (Required)
Work Location: Hybrid remote in Washington, DC 20006
- Preference given to candidates that can work in person at one of 3 offices in VA or MD (near DC), hybrid schedule
N2IA is committed to fostering a diverse and inclusive work environment. We are an Equal Employment Opportunity Employer and encourage applications from all qualified individuals, regardless of gender, race, ethnicity, sexual orientation, disability, or veteran status.