Machine Learning Engineer (Training Optimization)
As a Machine Learning Engineer specializing in Training Optimization at Canva, you will be an integral part of the CORE team within the Generative AI supergroup. This team is dedicated to developing foundational technologies that drive the future of AI-assisted design, focusing on large-scale models and pioneering research to enhance Canva's creative intelligence engine. Collaborating globally, the team delivers impactful research that translates into features like smart editing and AI video tools, reaching a vast user base.
In this role, your primary responsibilities will include designing, implementing, and optimizing large-scale machine learning systems for training purposes. You will work to enhance performance metrics such as GPU utilization, communication overhead, and memory efficiency. Partnering closely with research and modeling teams, you will ensure that system designs align with algorithmic requirements. Additionally, you will evaluate and apply best practices for distributed training using leading frameworks, delve into low-level optimizations including custom CUDA or Triton kernels, and debug, profile, and fine-tune training workflows to achieve unprecedented scalability.
The ideal candidate will possess a strong background in large language models (LLMs), multimodal AI, or diffusion models. Proficiency in Python is essential, with familiarity in system programming languages like C++ or Rust considered advantageous. Deep knowledge of PyTorch or JAX, along with experience in libraries such as Megatron-LM, NeMo, or DeepSpeed, is required. Familiarity with optimization techniques like FSDP/ZeRO, gradient checkpointing, or low-precision data types is important. Hands-on experience in writing custom GPU kernels using CUDA or Triton is also necessary. Excellent communication and problem-solving skills, with full proficiency in English, are essential for success in this role.
Canva offers a dynamic and collaborative work environment where innovation is encouraged. Employees have the opportunity to work on cutting-edge technologies that impact millions of users worldwide. The company provides competitive compensation packages, including equity options, and supports professional growth through various learning and development programs. Additionally, Canva promotes a healthy work-life balance with flexible leave options and wellness initiatives.