Product engineer - ai infrastructure
IndoreKatonic AI
...Multi-tenant GPU allocation across Kubernetes clustersAuto-scaling: Handle traffic spikes without manual interventionGuardrails: Safety, compliance, and quality enforcement at inference timeYour ResponsibilitiesLearn to deploy and test LLM serving infrastructure (v LLM, SGLang, NIM)Test fine-tuning pipelines - Lo RA, QLo RA, [...]
Category IT & Telecommunications