AI Engineer (LLM | RAG | Azure AI) at ICONMA in Middletow... | Findjobs
AI Engineer (LLM | RAG | Azure AI)
ICONMA
Location
🇺🇸 Middletown Township, United States
Type
full_time
Salary
$15.92–$47.5
Posted
3d ago
Job Description
ICONMA is an IT Services and Consulting company seeking an AI Engineer (LLM | RAG | Azure AI) to design, build, and deploy generative AI solutions.
The role
involves developing AI-powered applications using large language models, collaborating with cross-functional teams, and implementing responsible AI practices.
Responsibilities
Design, develop, and integrate Gen AI-powered applications using large language models and related AI services
Build solutions involving prompt engineering, retrieval-augmented generation, embeddings, vector search, and AI agents
Develop APIs, services, and application components that connect Gen AI capabilities to business workflows
Work with structured and unstructured data to support knowledge retrieval, summarization, classification, and content generation use cases
Evaluate model performance, response quality, hallucination risk, and reliability across different scenarios
Collaborate with product, data, engineering, and architecture teams to deliver scalable AI solutions
Implement responsible AI practices including security, privacy, monitoring, explainability, and governance considerations
Support deployment and release processes using tools such as Azure DevOps, Git, CI/CD pipelines, and cloud environments
Create documentation, reusable patterns, and technical guidance for Gen AI solution development
Stay current with emerging Gen AI frameworks, model capabilities, and best practices Skills
5–10 years in Software Engineering, Machine Learning, AI Engineering, or Data Engineering
3+ years of hands-on experience building and deploying Generative AI/LLM applications
Experience delivering enterprise-scale AI solutions in production environments
3+ years of software engineering, data engineering, machine learning, or AI application development experience
Hands-on experience building applications with large language models
Experience with prompt engineering, RAG architectures, embeddings, and vector databases
Proficiency in Python and familiarity with APIs, microservices, or backend development
Experience working with cloud-based AI services, preferably on Azure
Understanding of model evaluation, testing, monitoring, and quality improvement techniques
Familiarity with secure development practices and enterprise application integration
Strong problem-solving, communication, and collaboration skills
Experience with Azure Open AI Service, Azure AI Search, Azure Machine Learning, or related Azure AI services
Working knowledge of Azure DevOps, including repositories, boards, pipelines, and release workflows
Experience with Agentic-LLM solutions using Lang Chain, Lang Graph, or similar tools
Experience with vector databases or search platforms such as Azure AI Search
Familiarity with containerization, CI/CD, and deployment automation
Experience supporting enterprise-scale AI solutions, chatbot platforms, knowledge assistants, or intelligent automation use case
Benefits
Health
Benefits
Referral Program
Excellent growth and advancement opportunities Company
Overview
ICONMA: Your Partner in Global Staffing Solutions and Digital Transformation ICONMA is a globally recognized, Woman-Owned staff augmentation and technology consulting firm. It was founded in 2000, and is headquartered in Troy, MI, US, with a workforce of 1001-5000 employees. Its website is http://www.iconma.com. Company H1B Sponsorship
ICONMA has a track record of offering H1B sponsorships, with 4 in 2026, 34 in 2025, 31 in 2024, 26 in 2023, 39 in 2022, 37 in 2021, 69 in 2020. Please note that this does not guarantee sponsorship for this specific role.