About the job
Pluralis Research is at the forefront of Protocol Learning, pioneering the training of large models in a fully decentralized manner on consumer-grade devices linked through the internet. What was once deemed impractical has been transformed into reality; we have achieved remarkable milestones, including the successful training of an 8B llama model from scratch using devices located in geographically diverse areas. Although many fundamental research challenges have been addressed, Protocol Learning presents a host of new opportunities for innovation. If you are eager to contribute to the evolution of open innovation within the realm of large models, we invite you to join our dynamic team.
Key Responsibilities
Publish in Top-Tier Venues: Engage with complex research challenges central to Protocol Learning. Your solutions could lead to foundational papers—solve these issues and share your findings with the world.
What We're Looking For
Research Excellence: A PhD in Machine Learning complemented by publications in leading conferences (NeurIPS, ICML, ICLR).
Distributed ML Experience: Familiarity with distributed training techniques or federated learning.
Implementation Skills: Proficient in programming with PyTorch, with hands-on experience in training models across multiple devices.
Bonus: Previous experience with large language models, post-training techniques, or reinforcement learning.
Compensation & Benefits
Equity-Heavy Package: We offer substantial equity for key technical contributors alongside a competitive base salary.
Visa Sponsorship: Optional full visa sponsorship and relocation assistance available for positions in the US or Australia.
Remote-First Culture: Enjoy a flexible working environment with team members located globally.
Cutting-Edge Domain: Be part of an innovative intersection between AI and distributed systems, tackling some of the most complex research challenges in the field.
Additional Information
We exclusively hire within Australia and the United States. Visa sponsorship is limited to these regions.
Applicants are required to have a professional level of English proficiency.