Overview
AI / ML Platform Engineer Jobs in Toronto, Ontario, Canada at BURGEON IT SERVICES
Title: AI / ML Platform Engineer
Company: BURGEON IT SERVICES
Location: Toronto, Ontario, Canada
Job Title: AI / ML Platform Engineer
Work Location : Canada
Contract duration: 12 months
3.
This team operates the AI layer of the system.
They build and run the infrastructure needed for LLM workloads and inference.
Responsibilities
• deploy vLLM model serving
• configure LiteLLM gateway
• manage GPU node pools
• implement MLflow model registry
• manage model versioning
• optimize inference performance
• monitor model workloads
Skills
• LLM serving frameworks (vLLM, Triton)
• GPU infrastructure
• CUDA / inference optimization
• MLflow
• AI workload scaling
• vector retrieval systems
• model lifecycle management