AI Engineer
Amentum
Location
🇺🇸 Hanover, United States
Type
full_time
Salary
Undisclosed
Posted
5h ago
Job Description
Amentum is hiring an AI Engineer in Hanover, MD responsible for designing, building, and deploying AI capabilities that run inside classified and disconnected customer environments. The work centers on retrieval-augmented generation (RAG), fine-tuning and adapting open-weight language models, and serving those models securely on Government infrastructure. The engineer also helps customers and internal teams understand what technology can deliver and how to adopt it responsibly. Work Schedule: 5 days a week, 8 hours a day Essential
Responsibilities
: Responsible for designing, building, and deploying versatile artificial intelligence systems by integrating machine learning models into production software. They bridge the gap between data science and traditional software engineering, handling everything from data preprocessing and model selection to API development and cloud infrastructure scalability. Work Environment, Physical Demands, and Mental Demands: Hybrid or modern office environment equipped with high-performance computing infrastructure and advanced cloud collaboration tools. Their day-to-day involves cross-functional collaboration, straddling the line between technical development teams and corporate executives to align data strategies with business goals. The environment can be fast-paced and high-pressure, requiring constant adaptation to evolving technologies. Minimum Knowledge • Large language model fundamentals, including transformer architecture, tokenization, embeddings, context windows, inference parameters, and common failure modes such as hallucination and prompt injection. • Retrieval-augmented generation (RAG) design patterns, including chunking strategies, embedding model selection, vector and hybrid search, reranking, and retrieval evaluation. • Model adaptation methods, including supervised fine-tuning, parameter-efficient fine-tuning (LoRA, QLoRA), and distillation, along with when each approach outperforms prompting or RAG alone. • The open-weight model ecosystem (Llama, Mistral, Qwen, Gemma, or similar) and the licensing, provenance, and supply chain considerations for bringing models into Government environments. • Security and compliance frameworks that govern AI in classified environments, including RMF and the ATO process, ICD 503, the NIST AI Risk Management Framework, and handling
requirements
for CUI and classified data. Minimum Skills • Demonstrated experience designing, building, and deploying at least one RAG application for real users, covering document ingestion, chunking, embedding selection, vector store configuration, and retrieval evaluation. • Demonstrated experience fine-tuning or adapting open-weight LLMs (LoRA, QLoRA, or full supervised fine-tuning) and measuring results against a defined benchmark. • Experience hosting and serving models directly on GPU infrastructure (vLLM, TGI, NVIDIA Triton, or similar), including GPU sizing and quantization tradeoffs. • Experience delivering AI capabilities in disconnected or classified environments, including moving models, containers, and dependencies across the air gap and supporting the system through ATO. • Experience building access controls retrieval pipelines so each user retrieves only content that matches their clearance, compartments, and need-to-know. • Experience building evaluation and guardrails for LLM output, including accuracy testing, hallucination measurement, red teaming, and prompt injection defense. • Experience building document ingestion pipelines for large, unstructured collections, including parsing, OCR, metadata tagging, and preserving classification markings. • Proficiency in Python and at least one LLM orchestration framework (LangChain, LlamaIndex, Semantic Kernel, or similar), plus containerization with Docker and Kubernetes. • Ability to explain AI concepts, tradeoffs, and limitations clearly to technical and nontechnical audiences, including Government leadership. Minimum Abilities • Ability to translate mission