Labs to explore AI Models, MCP servers, and Agents with the AI Gateway powered by Azure API Management and Microsoft Foundry π
# Add to your Claude Code skills
git clone https://github.com/Azure-Samples/AI-GatewayBuilding production-ready AI applications requires more than just calling model APIs. You need security, reliability, observability, and cost controlβwithout slowing down innovation.
AI Gateway powered by Azure API Management provides:
No comments yet. Be the first to share your thoughts!
π Browse all 30+ labs at aka.ms/ai-gateway/labs
Each lab is a hands-on Jupyter notebook with step-by-step instructions, Bicep infrastructure templates, and APIM policies you can deploy to your Azure subscription.
Manage and control access to Large Language Models with enterprise-grade policies.
| Lab | Description | |-----|-------------| | Backend Pool Load Balancing | Distribute requests across multiple model endpoints | | Token Rate Limiting | Control token consumption with rate limiting policies | | Semantic Caching | Cache responses using vector similarity for faster, cheaper completions | | Model Routing | Route requests to different backends based on model and version | | FinOps Framework | Manage AI budgets with automated quota controls |
Enable secure tool access with MCP protocol and function calling capabilities.
| Lab | Description | |-----|-------------| | ...