company

Kernel Engineer at magic.dev | San Francisco

magic.devSan Francisco
On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Experience

Qualifications

Proficient in low-level programming targeting AI accelerators such as NVIDIA Blackwell or Google TPUs. Experience in developing and optimizing GPU kernels in frameworks such as NCCL, MSCCLPP, CUTLASS, CuTeDSL, Triton, Quack, and Flash Attention.

About the job

At Magic, our goal is to develop safe AGI that propels humanity forward by addressing some of the most pressing challenges we face. We are committed to harnessing the power of automated research and code generation to enhance models and improve alignment in ways that surpass human capabilities. Our innovative methodology integrates cutting-edge pre-training, domain-specific reinforcement learning, ultra-long context, and advanced inference-time computing.

Role Overview

As a Kernel Engineer, you will be responsible for the design, implementation, and maintenance of high-performance kernels, aiming to optimize throughput and minimize latency during both training and inference processes.

Magic's extended context windows present unique kernel optimization challenges, particularly regarding memory efficiency, data movement, and sustained throughput.

Key Responsibilities

  • Design and develop kernels that facilitate high-performance long-context functionality.

  • Take ownership of kernel design, implementation, deployment, and ensure production reliability.

  • Emphasize robustness, thorough testing, and functional accuracy while striving for optimal performance.

  • Assess the feasibility of porting Magic’s compute kernels to various hardware platforms.

  • Collaborate with the training, inference, and reinforcement learning teams to co-design kernels.

  • Explore our work through the Magic-Attention, presented at GTC 2026.

Qualifications

About magic.dev

Magic.dev is dedicated to creating safe AGI that enhances human progress by addressing the world's most significant challenges. Our innovative approach combines advanced technologies to automate research and code generation, ultimately improving machine learning models and alignment processes.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.