Cloud-Native Platform for Enterprise LLM Apps

Track

Cloud & DevOps — reference CD-02.

Location

The PFE Book lists Doha, Paris, Sousse and Delaware as Astrolab locations. The specific location for this project is not indicated.

What you will do

• Design the cloud architecture for an existing LLM and RAG knowledge platform, and provision it with Terraform.
• Containerize the services, deploy them on managed Kubernetes and automate releases with CI/CD pipelines.
• Secure, scale and monitor the platform, including private access to LLM APIs and a cloud cost optimization report.

Profile

Student in cloud computing, DevOps or cloud security, with hands-on experience on Azure or GCP and a basic understanding of LLM and RAG architectures.

Skills and tools

• Policy as code: OPA Gatekeeper, Kyverno
• LLM API load balancing and fallback: LiteLLM
• Managed Kubernetes: EKS, GKE

Duration

Estimated duration: 6 months.