Huawei Technologies Canada Co., Ltd. logoHuawei Technologies Canada Co., Ltd. logo

Intern Researcher - Optimizing Architecture for Large Language Models

Huawei Technologies Canada Co., Ltd.Montréal, Quebec, Canada
On-site Internship

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Experience Level

Entry Level

Qualifications

Ideal Candidate Profile:Currently enrolled in a Ph. D. or Master's program in Computer Science, Software Engineering, or a related field. Possess a robust understanding of NLP and foundational concepts of large language models (LLMs) along with comprehensive theoretical knowledge in machine learning. Demonstrated expertise in contemporary LLM architectures, including transformer models (e.g., Llama, Qwen), and familiarity with linear-attention models (e.g., GDN, Mamba, GLA). Proficient programming skills in Python and experience with PyTorch, including training and evaluating LLMs. Understanding of diffusion models is an added advantage.

About the job

Huawei Canada is excited to announce an internship opportunity for a Researcher focused on enhancing the efficiency of large language models (LLMs).

Team Overview:

Established in 2012, the Noah’s Ark Lab has grown into a leading research institution with significant contributions to both academia and industry. Our mission is to propel advancements in artificial intelligence and related domains, benefiting both our organization and broader society. Engaging in transformative, long-range projects, we strive to push the frontiers of research while seamlessly integrating innovations into our products and services, including LLMs, reinforcement learning (RL), natural language processing (NLP), computer vision, AI theory, and autonomous driving.

Position Summary:

  • Contribute to the ideation and investigation of innovative research concepts aimed at boosting the efficiency and scalability of LLMs.

  • Engage in applied research initiatives that target the enablement of long-context LLMs through the development of efficient architectures, data curation, and post-training techniques.

  • Collaborate on comprehensive projects by designing and conducting experiments, analyzing data, and presenting outcomes.

  • Disseminate research findings in high-impact machine learning and NLP conferences.

  • Monitor advancements in the LLM and AI landscape, transforming new insights into actionable strategies for the team.

About Huawei Technologies Canada Co., Ltd.

Huawei Technologies Canada Co., Ltd. is a leading global provider of information and communications technology (ICT) infrastructure and smart devices, dedicated to enabling a fully connected, intelligent world. Our commitment to innovation drives us to invest significantly in research and development, ensuring that we remain at the forefront of technological advancement.

Similar jobs

Browse all companies, explore by city & role, or SEO search pages.

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.