Our client is seeking a Senior AI Engineer specializing in Azure-based enterprise AI platforms, responsible for architecting and scaling agentic AI systems, RAG solutions, and governed AI foundations within a secure enterprise environment. (NYC)
Must Have Skills
Python, Poetry
Azure OpenAI / Azure AI Services
Azure AI Foundry
Azure AI Search (Hybrid, Semantic, Vector, Skillsets, Indexers)
LangChain, LangGraph, Agent Orchestration
Azure DevOps (Repos, Pipelines, Wiki)
Nice to Have Skills
ServiceNow Integration Hub experience
Agent observability, evaluation, and trace tooling
Experience operating AI systems at enterprise scale
Azure Bot Service, Microsoft Teams, Microsoft 365 Copilot
Azure Blob Storage, Logic Apps, Functions
Experience with enterprise RAG and AI platform governance
Responsibilities
Own and scale the Azure AI Foundry foundation including model catalog, prompts, tools, orchestration, observability, and governance
Build and manage agentic systems using LangChain and LangGraph, including an Agent Orchestrator with guardrails, retry logic, and policy-driven execution
Deliver enterprise-grade RAG solutions leveraging Azure AI Search (hybrid, semantic, vector search capabilities) and Azure AI Embeddings
Enable multichannel AI experiences across Azure Bot Service, Microsoft Teams, and Microsoft 365 Copilot
Design and implement ingestion pipelines using Azure Blob Storage, Document Intelligence, Logic Apps, and Azure Functions to maintain updated search indices
Integrate enterprise knowledge sources such as SharePoint, Azure DevOps Wiki, and ServiceNow Integration Hub
Implement enterprise security, safety, and Responsible AI controls including PII filtering, prompt governance, RBAC, and Azure Key Vault
Drive CI/CD and DevOps best practices for AI agents, prompts, skillsets, and search indexes
Lead and mentor cross-functional engineering teams while collaborating with architecture, security, and compliance stakeholders
Additional Information
Strong focus on enterprise AI governance and Responsible AI practices
Experience delivering scalable AI platforms in regulated environments
Expertise in modern AI orchestration frameworks and Azure-native AI tooling
Proven ability to implement secure, production-ready AI systems
Experience integrating enterprise systems and knowledge repositories
Discover exciting job opportunities in the vibrant area around New York, New York! With its iconic skyline, diverse cultural scene, and endless career growth prospects, the Big Apple and its surroundings promise an unparalleled work-life experience. Nestled between Broadway theaters, world-class art galleries like The Metropolitan Museum of Art, and globally renowned cuisine spots in Little Italy and Chinatown, finding your dream job in New York is your gateway to thriving in a city that never sleeps. Embrace the energy of Times Square, catch a game with the Yankees at Yankee Stadium, or unwind in the serenity of Central Park. Explore our job listings today and unlock your potential in the heart of opportunity.
Are you sure you want to apply for this job?
Please take a moment to verify your personal information and resume are up-to-date before you apply.