companyHuawei Canada logo

Lead Architect for Hardware-Optimized AI Foundation Model Training

Huawei CanadaMarkham, Ontario, Canada
On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Senior

Qualifications

Ideal Candidate Profile:Demonstrated experience in training and optimizing advanced AI models/applications, particularly at scales exceeding 10B parameters. In-depth knowledge of contemporary AI architectures, including long-sequence models, reinforcement learning, multimodal systems, and agents, along with a profound grasp of AI algorithmic principles. Proficient in the underlying implementation of AI frameworks such as PyTorch, vLLM, and SGLang, alongside mainstream distributed training and inference methods. Familiarity with GPU architecture and performance optimization techniques.

About the job

Join Huawei Canada as a Principal Architect and shape the future of AI.

About Our Team:

At the Computing Data Application Acceleration Lab, we are dedicated to pioneering a global data analytics platform through three specialized teams harnessing cutting-edge programming technologies. Our focus encompasses full-stack innovations, emphasizing software-hardware co-design and optimizing data efficiency across both storage and runtime layers. We are also at the forefront of developing next-gen GPU architectures tailored for gaming, cloud rendering, VR/AR, and Metaverse applications.

Our lab strives to enhance algorithm performance and training efficiency across various sectors, ensuring sustained competitive advantage.

Job Responsibilities:

  • Collaborate with internal and external stakeholders to spearhead the design of foundational model architectures for LLM, Code, and Multimodal subfields through innovations in post-training and continual training methodologies, aiming to develop foundational models that exhibit state-of-the-art performance and hardware efficiency.

  • Define technical specifications for large-scale distributed training and inference infrastructures, including parallelization and operator fusion, while analyzing the computational characteristics of standard architectures to guarantee the precision and advancement of AI hardware and infrastructure evolution.

About Huawei Canada

Huawei Canada: A leading global ICT solutions provider, Huawei is committed to driving innovation to empower digital transformation across industries.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.