Our client is seeking a Senior AI Engineer with strong AI quality experience to build, evaluate, and improve enterprise AI solutions, with a focus on GenAI, RAG, and agent-based workflows in an Azure environment. (remote US only)
Must Have skills
Experience building and supporting GenAI and LLM-based solutions
Strong skills in Python
Experience with Azure AI services, including Azure AI Foundry or related tools
Experience with RAG systems and retrieval-based AI workflows
Familiarity with LangChain, LangGraph, or agent-based orchestration
Experience validating LLM outputs for quality, accuracy, and consistency
Exposure to evaluation frameworks, testing, or quality processes for AI systems
Nice to Have skills
Experience with Azure AI Search
Exposure to AI test automation or monitoring workflows
Familiarity with Responsible AI, governance, or compliance practices
Experience with knowledge graphs, GraphRAG, Pinecone, FAISS, OpenSearch, or similar tools
Experience in enterprise or regulated environments
Experience supporting human-in-the-loop or audit-focused AI processes
Responsibilities
Build and improve enterprise AI solutions across GenAI, RAG, and agent-based systems
Support development of LLM-powered applications in an Azure-based environment
Design and enhance retrieval pipelines and grounded response workflows
Contribute to evaluation and validation of AI outputs for quality, safety, and consistency
Help develop structured approaches for testing and monitoring AI solutions
Work with cross-functional teams to deliver reliable, governed, and production-ready AI systems
Support documentation, quality standards, and Responsible AI practices
Ready to take your career to new heights? Explore our job opportunities in the vibrant Boston, Massachusetts area! Known for its rich history, world-class universities, and thriving tech and healthcare sectors, Boston offers a unique blend of opportunity and charm. Imagine working near iconic landmarks like the Freedom Trail, indulging in delicious clam chowder, catching a show at the Boston Opera House, or cheering on the beloved Red Sox at Fenway Park. With renowned art galleries, theaters, and the stunning Boston Common right at your doorstep, there’s no shortage of ways to enjoy work-life balance in this dynamic city. Discover your next career move in Boston today!
Are you sure you want to apply for this job?
Please take a moment to verify your personal information and resume are up-to-date before you apply.
