companyHuawei Canada logo

Principal Software Engineer - Cloud AI Infrastructure

Huawei CanadaMarkham, Ontario, Canada
On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Mid to Senior

Qualifications

Ideal Candidate:Minimum of 5 years of software development experience, with at least 2 years focused on AI infrastructure R&D for fine-tuning or inference, including AI workload profiling tools, vLLM or SGLang development, and infrastructure-level troubleshooting. Strong proficiency in Golang or Rust, demonstrating the ability to produce clean, efficient, and high-quality code from the ground up. Deep understanding of AI technologies, including familiarity with module interactions during AI model training, inference frameworks, and storage systems. Experience with Kubernetes or Ray, with a solid track record in developing services based on these platforms.

About the job

Join Huawei Canada as a Principal Software Engineer and be a part of our innovative team!

About Us:

Founded in 2014, the Distributed Scheduling and Data Engine Lab serves as Huawei Cloud’s technology innovation hub in Canada. This lab is dedicated to pioneering advanced cloud technologies, facilitating the productization and ongoing refinement of our technological breakthroughs. Our research spans various domains, including cloud-native databases, resource scheduling and prediction, middleware solutions, media engines, and user experience enhancements. We cultivate a dynamic technical environment that encourages collaboration with industry specialists to develop a competitive cloud platform. We are currently seeking a Principal Software Engineer to join our team.

Job Responsibilities:

  • Integrate AI frameworks with cloud infrastructure, optimizing the end-to-end architecture for AI inference and fine-tuning scenarios, with a focus on enhancing observability, reliability, and performance of AI services.

  • Collaborate with team members to design and build concept prototypes, validating optimization strategies to ensure their effectiveness.

  • Work closely with the product team to support prototype development, ensuring alignment with product constraints and requirements.

About Huawei Canada

Huawei Canada is at the forefront of cloud technology innovation, dedicated to creating cutting-edge solutions that enhance performance and reliability across various sectors. Our team is committed to excellence and collaboration, driving industry advancements.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.