AI Platform Engineer (m/f/d)
Responsibilities
- Administer and maintain Azure AI Foundry workspaces, environments, model catalogs, compute, and configurations
- Manage lifecycle operations for LLMs, embeddings models, and model deployments within the platform (excluding agent deployment)
- Ensure reliability, scalability, and performance of AI Foundry environments across all stages (dev/test/prod)
- Configure and maintain logging, tracing, telemetry, and usage dashboards
- Monitor performance, cost, quota consumption, and operational health of AI Foundry components
- Implement alerting and diagnostics to ensure platform stability
- Apply and maintain Azure RBAC, workspace governance, and access policies inside the platform
- Ensure consistency in workspace structure, permissions, and operational standards across teams
- Support internal teams in onboarding and safe platform usage
- Produce high quality documentation, runbooks, platform guides, and onboarding materials
- Assist internal teams in using AI Foundry capabilities effectively / Provide hands-on troubleshooting and support for platform adoption.
Profile
- Practical, hands-on experience managing Azure platforms in production environments
- Strong knowledge of Azure AI Foundry, Azure OpenAI, and related Azure AI/ML components
- Familiarity with LLM lifecycle management, platform operations, and governance
- Experience working autonomously within engineering or platform teams
- Strong communication skills and ability to assist internal teams
- Proven ability to produce clear and structured documentation
- Experience with Portkey for model routing, observability, caching, or guardrails
- Knowledge of Azure API Management (APIM)
- Understanding of other AI ecosystem tools such as Promptflow, MLflow, LangChain, or Semantic Kernel
- Exposure to cloud security best practices
Benefits
- Start: April 2026
- Location: Remote
- Language: English
About Hays
IT is and always has been our core business that laid the foundation for Hays' success. We are the biggest privately owned IT recruitment agency in Germany and offer the best jobs for every career level – whether you are interested in vacancies in agile SMEs or international DAX groups. Hays masters the entire IT job spectrum, from support to software architecture or digitalisation – thanks to our broad portfolio, we have something for everyone. In the last decades, we were able to support numerous IT experts with choosing the right path for a successful career, positioning ourselves as their lifelong partner. Our highly specialised consultants can cater to your every wish and expectation and will prepare you for interviews and contract negotiations. Give it a try and learn what the market has to offer – our services are free of charge, non-binding and discreet! We look forward to hearing from you.
Staffing process for freelance specialists
- Analysis of qualifications
- Telephone or personal interview
- Contact with customers
- Contract with Hays
- 1
- 2
- 3
- 4
1. Analysis of qualifications
We carry out a detailed analysis of your technical qualifications on the basis of your CV, your application documents and your profile.
Contact at Hays
+ 49 621 1788-4297© Copyright Hays plc, . The HAYS word, the H devices, 'Hays Working for your tomorrow' and 'Powering the world of work' and associated logos and artwork are trademarks of Hays PLC. The H devices are original designs protected by registration in many countries. All rights are reserved.