Technical Staff Member - ML Infrastructure & Performance

About Us:At Fireworks AI, we are pioneering the future of generative AI infrastructure. Our cutting-edge platform provides unparalleled model quality with the fastest and most scalable inference capabilities in the industry. We have been independently recognized as the leader in LLM inference speed and are at the forefront of innovative projects like our proprietary function calling and multimodal models. As a Series C company valued at $4 billion, we are backed by premier investors including Benchmark, Sequoia, Lightspeed, Index, and Evantic. Our dynamic team of builders includes veterans from Meta PyTorch and Google Vertex AI, and we are driven by ambition and collaboration.The Role: We are seeking a talented Software Engineer specializing in Performance Optimization to enhance the speed and efficiency of our AI infrastructure. This role demands ownership of performance optimization across all system layers, from low-level GPU kernels to large-scale distributed systems. Your primary focus will be on maximizing the efficiency of our most demanding workloads, which encompass large language models (LLMs), vision-language models (VLMs), and next-generation video models.You will collaborate closely with teams in research, infrastructure, and systems to identify performance bottlenecks, implement innovative optimizations, and scale our AI systems to meet the real-world demands of production use cases. Your contributions will significantly influence the speed, scalability, and cost-effectiveness of some of the most advanced generative AI models globally.

Join Roblox, where millions of users engage daily to explore, create, and connect in immersive 3D digital experiences crafted by our dynamic global community of developers and creators.At Roblox, we are dedicated to providing the tools and platform that empower our users to bring their imaginative experiences to life. Our vision is to revolutionize how people connect from anywhere in the world and on any device. We aim to connect a billion individuals with optimism and civility, and we are seeking exceptional talent to help us achieve this goal.A career at Roblox means you will be shaping the future of human interaction, tackling unique technical challenges at scale, and working towards creating safer, more respectful shared experiences for all users.As a Principal Software Engineer in the Performance & Optimization pod within Studio, you will spearhead the architecture, design, and development of simulation, profiling, and debugging tools in Roblox Studio. Your contributions will enable creators to understand their experiences' performance across a diverse range of devices, from high-end PCs to mobile, empowering them to deliver high-quality content rapidly and confidently.You will:Design and implement intricate technical features end-to-end in our game engine and Studio UI that assist creators in comprehending and optimizing their experiences.Collaborate cross-functionally across teams and technology platforms to ensure the delivery of consistent, high-quality tools.Mentor engineers by exemplifying best practices, patterns, and strategies in technology.Enhance product quality through the promotion of automated testing and reliable systems.Contribute to creating the world's leading professional application for massively multiplayer game development.

About the RoleJoin our dynamic team, affectionately known as MBMB (More Big More Better), where you will play a crucial role in optimizing our training and on-robot inference stacks. We are seeking bold innovations that drive substantial improvements rather than incremental changes.Your Responsibilities Will Include:Maximizing GPU performance through innovative strategiesDeploying machine learning, hardware, and software modifications that yield significant advancementsEnhancing both inference and training stacks for optimal performanceIdeal Candidates Will:Possess proficiency in the latest machine learning techniques, particularly for training and inference optimizations within transformer and diffusion-based architecturesHave a relentless pursuit of ML optimizations across various domains, including CUDA kernels, ML architecture, frontend and backend network bottlenecks, CPU inefficiencies, NVLink, and communication protocols, as well as optimizations in libraries such as Torch, NumPy, and Python.

Join Roblox as a Senior Software Engineer specializing in Application Performance, focusing on enhancing our Core UI. In this role, you will be instrumental in optimizing our user interface to deliver a seamless experience for millions of players worldwide. Collaborate with a talented team of engineers to develop innovative solutions that drive performance improvements and enhance user engagement.

Join Moonlake, a pioneering company harnessing AI to develop immersive world simulations.Role OverviewEnhancing Training EfficiencyImplement data loaders, fusion techniques, activation rematerialization, and gradient checkpointing.Optimize training with FSDP/ZeRO/tensor+pipeline parallelism and NCCL tuning.Improving GPU and Kernel PerformanceConduct Nsight profiling, develop Triton/CUDA kernels, and create fused operations.Implement flash-attention style accelerations, sequence packing, and KV-cache optimizations.Optimizing InferenceFocus on low-latency serving, continuous batching, and speculative decoding strategies.Apply quantization methods (GPTQ/AWQ), distillation, and pruning techniques.Infrastructure and ReliabilityManage SLURM/Kubernetes multi-node jobs and ensure checkpoint hygiene.Maintain determinism, environment pinning, and effectively handle GPU failures.Our dedicated team thrives on collaboration in our San Mateo office.

About the RoleAt Generalist, we are at the forefront of training expansive robot foundation models, leveraging cutting-edge GPU hardware, primarily from Nvidia, to execute distributed training tasks and experimental research. Our operations demand exceptional storage solutions and optimized data loading processes, necessitating the full utilization of cloud infrastructure alongside custom-built solutions.In this role, you will take charge of our inference infrastructure. Our robotic systems rely on a dedicated fleet of on-premises GPUs designed for demanding real-time computations and latency-sensitive applications within resource-constrained environments.Your Responsibilities:Manage and optimize our GPU compute fleets.Facilitate user-friendly access to GPUs for researchers, ensuring optimal utilization.Enhance ML data loading, transport, and storage systems in extensively utilized distributed environments.Oversee the orchestration of our robot inference fleets.You May Excel in This Position If You:Have experience managing large GPU fleets for large-scale, distributed training or inference.Possess significant expertise in using Slurm or Kubernetes for ML workload orchestration.Have developed high-scale ML data loaders and preparation systems.Understand the intricacies of ML hardware, storage, and networking systems.Are familiar with the Nvidia GPU ecosystem.

Roblox is a vibrant platform where millions of users come together to explore, create, play, learn, and connect in immersive 3D experiences crafted by a diverse global community of developers.At Roblox, we are dedicated to building innovative tools and a robust platform that empower our community to bring their imaginative experiences to life. Our vision is to transform how people unite, no matter where they are in the world or what device they use. We are on a mission to connect a billion individuals with optimism and civility, and we seek exceptional talent to help us achieve this goal.Joining Roblox means you will be at the forefront of shaping the future of human interaction, tackling unique technical challenges at scale, and creating safer, more respectful shared experiences for all.Our engine's resource management and streaming systems are crucial for providing a seamless, stable, and responsive experience for Roblox users across a vast array of devices and network conditions. These systems collaboratively manage compute, memory, bandwidth, and rendering quality while delivering dynamic world content in real time as players interact with their environments. The challenges we face include highly dynamic environments, unpredictable user behaviors, and opaque signals stemming from device and OS limitations.This position offers a unique chance to lead the integration of machine learning into real-time engine optimization. You will develop the ML framework for predictive resource allocation and content fetching, transitioning from heuristic-based logic to adaptive, data-driven decision-making. Your contributions will directly influence stability, visual quality, responsiveness, and content delivery across billions of global play sessions.

Why Choose PlayStation?At PlayStation, we are more than just the ultimate gaming destination; we are a global leader in entertainment. Our suite of products and services includes the PlayStation®5, PlayStation®4, PlayStation®VR, PlayStation®Plus, and award-winning software titles. We are passionate about providing an exceptional experience for our users.We are committed to fostering an inclusive and diverse workplace that empowers our employees. Whether you have a keen interest in technology, innovation, or gaming, we encourage you to explore our available positions and be part of our dynamic global team.PlayStation is a brand under Sony Interactive Entertainment, a fully-owned subsidiary of Sony Group Corporation.Position Overview: Optimization Manager (Contract)Location: San Mateo, CA (Collab)/RemoteThe Optimization Manager will play a pivotal role within our Services Commercial team, which is focused on enhancing the growth and engagement of PlayStation's subscription services. This group is dedicated to maximizing subscriber acquisition, retention, and ensuring our audience finds value in returning year after year. Our flagship product, PlayStation Plus, holds significant importance in our overarching vision and strategy.The successful candidate will be integrated into the Subscription Optimization team, responsible for executing and optimizing processes, campaigns, and initiatives within the Services Commercial group. You will help shape our engagement strategies for PlayStation Plus subscribers, ensuring that campaigns resonate with players and align with their interests.By leveraging both creative insights and analytical skills, you will support the execution of campaigns across various touchpoints, including messaging related to benefits, upselling strategies, retention initiatives, and significant promotional events.

Skydio stands at the forefront of the drone industry in the United States, pioneering advancements in autonomous flight technology that shape the future of aerial mobility. Our team is driven by a combination of exceptional expertise in artificial intelligence, cutting-edge hardware and software development, operational excellence, and an unwavering commitment to customer satisfaction. We strive to empower a diverse range of drone users, including utility inspectors, first responders, and military personnel, enabling them to tackle challenges more efficiently and safely.About the Role:In this role, you will play a pivotal part in enhancing the reliability and robustness of our wireless communication networks. By integrating advanced autonomy with real-time cloud connectivity, our drones will serve as essential infrastructure, capable of immediate deployment and monitoring to address various challenges more effectively and affordably. We seek a seasoned Wireless Performance Engineer to oversee network performance metrics, optimize communication parameters, and conduct rigorous testing in complex environments.Your Impact:Assess, enhance, and optimize Skydio's wireless solutions to extend range and manage diverse connection topologies.Lead the deployment and performance evaluation of networks to ensure system-level KPIs are met, particularly in highly congested environments.Develop, implement, and validate algorithms to improve system performance metrics.Evaluate and optimize performance across various wireless standards, including WLAN and LTE.Analyze complex network performance involving multiple drones, control stations, and users.Drive the development and enhancement of performance testing infrastructure.What You Bring:Solid understanding of WLAN/3GPP protocols and performance metrics.Extensive background in wireless channel dynamics and their impact on system performance.Preferred experience with wireless PHY and MAC level firmware.Familiarity with Mesh networks, OFDMA, and scheduled-based operations.Proficient in using wireless testing equipment, protocol analyzers, and PHY-level testing tools.Experience in test automation, including designing and implementing automated testing frameworks.

Join Roblox as a Senior Software Engineer - Engine Reliability and be a key player in ensuring the robustness and performance of our gaming engine. In this role, you will collaborate with talented engineers to develop innovative solutions that enhance the reliability of our systems, allowing millions of users to enjoy seamless gaming experiences.

At Roblox, we empower millions of users to explore, create, play, and connect through immersive 3D digital experiences, all crafted by our vibrant community of developers and creators.Our mission is to redefine how people come together from any corner of the globe and on any device. We are committed to fostering a community that connects a billion people with optimism and civility, and we are on the lookout for exceptional talent to join us in this endeavor.A career at Roblox means you will be at the forefront of shaping human interaction, tackling unique technical challenges at scale, and contributing to the creation of safe, civil shared experiences for all.As a Senior Software Engineer on our Systems team, your contributions will directly impact the foundational elements of Roblox. You will develop robust software that supports our extensive community of over 2 million developers, enabling them to push the boundaries of interactive gaming. Your work will encompass various aspects of the engine, including threading, memory management, physics, and scripting. If you possess a passion for C++ and thrive in high-performance, real-time applications, you will find a welcoming environment within our Game Engine team.Your responsibilities will include:Crafting engine code in C++ for critical sub-systems within the Roblox game engine.Developing systems for data synchronization between server and client, implementing game-aware data streaming, and optimizing resource usage to ensure seamless gameplay across diverse devices.Contributing to every application developed by Roblox, from mobile clients to cloud-based servers.Your qualifications include:A minimum of 4 years of experience working on intricate challenges in extensive C++ codebases.Proficiency with system-level pointers, templates, and raw memory blocks.A strong understanding of game engine architecture or a desire to learn.Experience in building reliable, functioning systems.A curiosity and commitment to staying updated with technological advancements.

Why Choose PlayStation?At PlayStation, we pride ourselves on being not just the premier destination for gaming but also the ultimate workplace. Recognized as a worldwide leader in entertainment, we create a diverse array of products and services, including PlayStation®5, PlayStation®4, PlayStation®VR, PlayStation®Plus, and award-winning titles from PlayStation Studios.We are committed to fostering an inclusive atmosphere that empowers our employees and celebrates diversity. We invite all individuals passionate about innovation, technology, and gaming to explore our opportunities and become part of our expanding global family.The PlayStation brand operates under Sony Interactive Entertainment, a wholly-owned subsidiary of Sony Group Corporation.Position Overview:We are thrilled to announce an opening at Sony Interactive Entertainment LLC (PlayStation) for a Senior Software Engineer to join our pioneering Video Codecs team. This innovative group is at the forefront of video encoding and decoding technology, contributing to vital system libraries for both current and next-generation PlayStation products. Your expertise will be instrumental in designing and implementing cutting-edge technology for cloud gaming, remote play, game recording, video streaming, and in-game video playback. The software you develop will serve as the backbone of an SDK for industry-leading game and content developers, transforming the gaming experience worldwide. If you’re ready to make an impact, we want to hear from you!

Join Roblox as a Principal Software Engineer, where you will be at the forefront of the gaming industry, developing innovative software solutions that enhance the user experience. You will collaborate with cross-functional teams to design, implement, and optimize systems that power our platform.

At Roblox, our platform serves millions of users daily, providing a space for exploration, creativity, gameplay, learning, and social connection through immersive 3D experiences crafted by our global community of developers and creators.We are dedicated to constructing innovative tools and platforms that enable our community to manifest their imaginative visions. Our goal is to revolutionize how individuals connect globally, regardless of their geographical location or device. Join us in our mission to unite a billion individuals with positivity and respect, as we seek exceptional talent to help realize this vision.A career at Roblox means influencing the future of human interaction by tackling unique technical challenges on a grand scale and contributing to the creation of safer, more respectful shared experiences for all.Every day, numerous configuration changes are made by service owners across Roblox. This crucial function supports millions of players worldwide as they engage with Roblox for play, learning, work, and socializing. Become a part of the Engineering Efficiency - Configuration team at Roblox and play a vital role in enhancing our development experience. As a Senior Software Engineer, your contributions will significantly transform our development processes and facilitate global expansion through advanced technology.Your ResponsibilitiesUnify and Integrate Systems: Seamlessly merge various high-performance frontends and backends into a cohesive, scalable, and secure next-gen configuration system capable of handling millions of requests per second. Integrate configuration management into the CI/CD pipeline effortlessly.Accelerate Configuration Management with AI: Implement AI Agents to enable smooth configuration upgrades, management, and automation.Ensure Safety and Reliability: Develop robust systems to automate configuration changes, minimizing errors and guaranteeing safe modifications at scale.Enhance and Support: Take ownership of existing configuration systems, provide on-call support as needed, and proactively introduce new features and fixes to improve stability and performance.Improve Runtime Configurations: Create and enforce language-specific libraries and standardized processes to optimize runtime configurations across our platform, promoting consistency and efficiency.

Join Roblox, where millions engage daily in exploring, creating, playing, learning, and connecting through immersive 3D digital experiences crafted by our global community.At Roblox, we provide the tools and platform that empower our community to manifest their imaginative experiences. Our aim is to redefine how people connect from anywhere in the world on any device. We are on a mission to unite a billion individuals with positivity and respect, and we are seeking exceptional talent to help us achieve this goal.A career at Roblox offers you the opportunity to influence the future of human interaction, tackle unique technical challenges at scale, and contribute to creating safer, more respectful shared experiences for everyone.As a Senior Software Engineer on our Systems team, you will play a pivotal role in developing the foundational components of Roblox. The software you create will empower our expansive community of over 2 million developers to innovate within interactive gaming. Your contributions will affect every aspect of our engine, including threading, memory management, physics, and scripting. If you have a passion for C++ software development and high-performance real-time applications, you will thrive within our growing Game Engine team.

Every day, millions of users engage with Roblox to dive into, create, and share immersive 3D digital experiences—all powered by our vibrant community of developers and creators.At Roblox, our mission is to empower creators by providing the tools and platform necessary to bring their imaginative experiences to life. Our vision is to revolutionize global connectivity, enabling people to connect and engage from anywhere, on any device. We strive to connect a billion individuals with positivity and civility, and we are on the lookout for exceptional talent to join us on this journey.Joining Roblox means being at the forefront of shaping the future of human interaction, tackling unique technical challenges at scale, and contributing to safer, more respectful shared experiences for all.As a Senior Software Engineer on the Engine DataModel team, you will play a pivotal role in innovating and maintaining the foundational elements that are essential to the Roblox platform. The DataModel within the Roblox Engine resembles a tree-like structure similar to a scenegraph found in other 3D engines. This position reports to the engineering manager and is based at our headquarters in San Mateo, CA, following a hybrid work model of three days in the office (Tuesday to Thursday).Our team is responsible for:The core structures and systems used to build and interact with the DataModel.The C++ reflection bindings that create the Engine’s Luau API surface, enabling creators to interact with the DataModel. We utilize custom code generation tooling to produce the C++ for these bindings and other related structures.DataModel serialization and much more!You will:Develop high-performance engine code for all user-generated games on the Roblox platform.Build the core systems and data structures utilized in the Roblox engine, collaborating with other teams to devise universal solutions.Take ownership of projects throughout their entire lifecycle.Execute code that operates efficiently across all devices supported by Roblox, from desktop clients to mobile and console clients.You have:Experience in developing robust systems-level C++ programming.H...

Join IXL Learning, a premier innovator in personalized education solutions utilized by millions globally, as a Senior Software Engineer on our Unification Team. This impactful team is dedicated to enhancing technical excellence across IXL and our affiliated brands.In this pivotal role, you will spearhead large-scale, cross-functional engineering projects aimed at unifying our infrastructure, standardizing tools and processes, and developing reusable, scalable, and reliable systems. Your contributions will foster enhanced collaboration, expedite development cycles, and bolster product performance company-wide.We seek engineers who are passionate about tackling intricate technical challenges, excel in collaborative settings, and are driven by the mission to improve systems that empower millions of learners.

Join Roblox as a Principal Software Engineer specializing in Data Engineering! We are looking for an innovative and experienced software engineer to lead data-driven projects that empower our users and enhance their gaming experience. In this pivotal role, you will architect and develop scalable data systems, ensuring high availability and performance. Collaborate with cross-functional teams to create solutions that meet the diverse needs of our community while driving technical excellence.

Join Our Team at LuminaiLuminai is transforming healthcare operations by bridging the gap between human effort and technology. Our innovative solutions automate critical processes that have traditionally relied on manual work, enabling healthcare providers to focus on what truly matters: their patients. Despite the challenges faced by health systems, Luminai's platform organizes complexity, automates workflows, and integrates intelligence across systems to streamline operations and enhance patient care.Backed by leading investors from Silicon Valley—including General Catalyst, Peak XV, and YCombinator—Luminai is on a mission to redefine healthcare efficiency and productivity.About the OpportunityAs a Staff Software Engineer, you will be a key architect in developing our core platform, which is utilized globally for executing and scaling AI automations in essential production settings. Your expertise in software engineering fundamentals will be critical as you lead technical projects and contribute to our ambitious engineering goals. You will play a pivotal role in defining and enhancing the foundational systems that empower our engineering team to deliver an exceptional platform experience.Key ResponsibilitiesDevelop languages and associated tools (DSLs, parsers, compilers) for both internal and external system abstractions.Design and maintain distributed computing environments.Identify and resolve system bottlenecks, proactively re-architecting foundational abstractions to facilitate scalability.Lead technical initiatives that establish high-quality standards in the codebase.Define and enhance experimentation, monitoring, reliability, and observability strategies for production systems.Drive improvements to the core Luminai Integrated Development Environment (IDE) to ensure an outstanding user experience.