Software Engineer - Productivity and Model Performance

ABOUT BASETENAt Baseten, we are at the forefront of AI innovation, providing critical inference solutions for leading AI companies like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. Our platform combines advanced AI research, adaptable infrastructure, and intuitive developer tools, empowering organizations to deploy state-of-the-art models effectively. With rapid growth and a recent $300M Series E funding round backed by top-tier investors including BOND, IVP, Spark Capital, Greylock, and Conviction, we invite you to join our mission in building the platform of choice for engineers delivering AI products.THE ROLE:As a member of Baseten’s Model Performance (MP) team, you will play a pivotal role in ensuring our platform’s model APIs are not only fast and reliable but also cost-effective. Your primary focus will be on developing and optimizing the infrastructure that supports our hosted API endpoints for cutting-edge open-source models. This role involves working with distributed systems, model serving, and enhancing the developer experience. You will collaborate with a small, dynamic team at the intersection of product development, model performance, and infrastructure, defining how developers interact with AI models on a large scale.RESPONSIBILITIES:Design, develop, and maintain the Model APIs surface, focusing on advanced inference features such as structured outputs (JSON mode, grammar-constrained generation), tool/function calling, and multi-modal serving.Profile and optimize TensorRT-LLM kernels, analyze CUDA kernel performance, create custom CUDA operators, and enhance memory allocation patterns for maximum efficiency across multi-GPU setups.Implement performance improvements across various runtimes based on a deep understanding of their internals, including speculative decoding, guided generation for structured outputs, and custom scheduling algorithms for high-performance serving.Develop robust benchmarking frameworks to evaluate real-world performance across diverse model architectures, batch sizes, sequence lengths, and hardware configurations.Enhance performance across runtimes (e.g., TensorRT, TensorRT-LLM) through techniques such as speculative decoding, quantization, batching, and KV-cache reuse.Integrate deep observability mechanisms (metrics, traces, logs) and establish repeatable benchmarks to assess speed, reliability, and quality.

About Our TeamJoin a dynamic group that is dedicated to delivering OpenAI’s cutting-edge technology to developers globally through our robust developer platform, the OpenAI API. As the foremost AI development platform, our API is utilized by millions of developers and leading enterprises worldwide, powering a majority of the AI applications you encounter daily. Our latest innovations include gpt-5, gpt-realtime, Responses API, Agents SDK, and much more.About the PositionWe are seeking a passionate Software Engineer who will take ownership of our API designs. Our API is integral to our product, and we approach its design and development with meticulous care and intent. Every endpoint, field name, and enum value is a crucial part of the product interface that we strive to perfect. We want engineers who not only excel at creating APIs but also appreciate the nuances of exceptional API design. In this pivotal role, you will significantly influence the future development of the OpenAI API through both design and implementation.Key Responsibilities:Design and create innovative products for our API, including extending existing endpoints, adding new ones, or reimagining our entire API suite.Take a lead role in our API Review process, collaborating with various teams to ensure our APIs meet the highest design standards.Work closely with the API team, Developer Experience team, and Go-To-Market (GTM) team to elevate our APIs to global excellence.You Will Excel In This Role If You:Have a keen eye for API design and recognize the difference between well-crafted and poorly constructed APIs.Thrive in a fast-paced environment where you can work independently with ambiguous goals and requirements.Enjoy building tools for fellow developers and value constructive feedback from discerning users.Are fundamentally an engineer but also willing to engage in product decision-making.View APIs as ladders that empower users.About OpenAIOpenAI is at the forefront of AI research and deployment, committed to ensuring that general-purpose artificial intelligence benefits all of humanity. We continuously push the limits of AI capabilities while prioritizing safe and ethical deployment to maximize positive impact.

Join Convex in Revolutionizing Application Development!At Convex, we are on a mission to revolutionize the way developers build applications by enabling them to create fast, reliable, and dynamic apps without the need for a backend team. Our innovative full-stack app platform is meticulously crafted with database, compute, and backend abstractions, allowing developers and LLMs to rapidly innovate while ensuring scalability and simplicity throughout the product lifecycle.Meet Our Team:Our team comprises talented engineers who have built and designed some of the world’s most extensive backends, handling exabytes of data and millions of transactions per second, while also delivering desktop and mobile software across billions of devices. We pride ourselves on our friendly, collaborative, and passionate culture, thriving in our San Francisco office.The Opportunity:As a key player in our backend platform, you will enhance our standout client API and developer experience. We have dedicated significant resources to perfecting our client libraries, development APIs, and sync protocol, ensuring that Convex is a delight for application developers. We are looking to grow our team to advance the next iteration of the Convex API and redefine the modern application stack.If you are an experienced TypeScript developer with a passion for elegant API design and recognize the importance of robust platforms in the age of AI development, we want to hear from you!Your Responsibilities:Design, develop, and maintain Convex’s client libraries, sync protocol, and query APIs.Stay updated with new frameworks and technologies within the app development landscape.Gain insights into effective abstractions that scale and integrate seamlessly within our stack to create libraries that are user-friendly and maintainable.Work autonomously to prioritize impactful projects while collaborating closely with the engineering team and CTO (hi! I'm James).Contribute to establishing best practices and design guidelines as our team and systems expand.Write engaging and innovative client library code.

Join our innovative team at Lambda as a Senior Software Engineer specializing in API development. In this pivotal role, you will leverage your extensive technical expertise to design, implement, and optimize robust APIs that enhance our software solutions. Collaborate with cross-functional teams to deliver high-quality products that meet our customers' needs.

The OpportunityAt Enigma, we are at a pivotal moment of growth, receiving enthusiastic feedback from our clients regarding the substantial value our product provides. This feedback drives our urgent need to effectively present the capabilities of our small business data as we expand our sales and marketing efforts.The RoleWe are seeking a skilled Senior Software Engineer to join our dynamic API and Data Delivery Team. In this position, you will be instrumental in designing, constructing, and maintaining essential systems for processing and delivering vast datasets, collaborating with both teammates and clients to address impactful, real-world challenges.What You’ll DoDevelop scalable, highly available, and high-throughput systems deployed in cloud environments.Tackle challenges involving containers, cloud infrastructure, and infrastructure as code (primarily using Docker, AWS, and Terraform).Exhibit a proactive attitude that embraces challenges, regardless of their size.Take pride in writing clean, well-tested, and maintainable code.Thrill in collaborating as part of a motivated and cohesive team.Identify and address problems that may go unnoticed by others.Be driven to create tangible impacts for our customers.Inspire your colleagues to excel while fostering a collaborative and supportive team culture.Manage responsibilities related to architecture, design decisions, hands-on implementation, team organization, and technical mentorship.What Makes This Role Exciting?Impact: Your technical expertise and decision-making will directly influence our customers and the success of our product, affecting critical choices at multi-billion dollar firms.Technical Challenge: Engage with cutting-edge technologies surrounding databases, information retrieval, distributed systems, microservices, elastic scaling, data pipelines, and more.Ownership: The API & Data Delivery team is addressing some of the world's most complex challenges. The ideal candidate is an engineer eager to expand their responsibilities and collaborate with the team to create significant technical and business impacts.

At Perplexity, we're revolutionizing the way individuals search, reason, and engage with information. Our API team is pivotal to this mission, crafting and managing high-performance interfaces that connect Perplexity’s intelligence with developers, enterprises, and products globally. This team is responsible for the architecture, reliability, and security of the APIs that fuel everything from real-time LLM queries to large-scale enterprise integrations.In the role of Staff Backend Engineer, you will play a crucial part in shaping the technical backbone of Perplexity’s external platform. You will design distributed systems, enhance performance at scale, and establish engineering standards to ensure our APIs are swift, dependable, and enjoyable for developers to work with.

At Scribd, Inc., we are dedicated to enhancing human understanding through our innovative products — Scribd®, Slideshare®, Everand™, and Fable — which empower billions around the world to transform access into knowledge, application, and expertise.Culture at Scribd, Inc.We foster a bold and authentic culture that encourages open debate and commitment, allowing our employees to embrace challenges and prioritize customer satisfaction. We believe that optimal performance arises from a balance of individual flexibility and meaningful community connection.Our Scribd Flex program enables team members to select work styles and locations that enhance their productivity, while also committing to intentional in-person interactions that promote collaboration and a vibrant company culture. All employees, regardless of their location, are required to attend occasional in-person meetings.What do we seek in our new hires? At Scribd, Inc., we value “GRIT.” This concept, reflecting the intersection of passion and perseverance toward long-term goals, forms the core of our expectations for every employee. It also serves as a practical framework for our work: achieving Goals, delivering Results, contributing Innovative ideas and solutions, and strengthening our Team through collaboration and positive attitudes.About the TeamOur Web Platform team is a vital part of the Developer Platform organization, driving our company-wide web modernization initiatives.Our mission is to empower product teams by providing a scalable and well-architected API foundation that supports modern web architectures. We collaborate across teams to minimize dependencies, enhance developer experience, and establish robust integration patterns between frontend and backend systems.With a high degree of autonomy and a long-term vision, the platform we develop will influence how teams design, deploy, and evolve our web products.About the RoleWe are actively seeking a Senior Software Engineer for the Web API Platform to contribute to the establishment of a company-wide API platform that accelerates web modernization at Scribd.

About Our TeamJoin the Inference team at OpenAI, where we leverage cutting-edge research and technology to deliver exceptional AI products to consumers, enterprises, and developers. Our mission is to empower users to harness the full potential of our advanced AI models, enabling unprecedented capabilities. We prioritize efficient and high-performance model inference while accelerating research advancements.About the RoleWe are seeking a passionate Software Engineer to optimize some of the world's largest and most sophisticated AI models for deployment in high-volume, low-latency, and highly available production and research environments.Key ResponsibilitiesCollaborate with machine learning researchers, engineers, and product managers to transition our latest technologies into production.Work closely with researchers to enable advanced research initiatives through innovative engineering solutions.Implement new techniques, tools, and architectures that enhance the performance, latency, throughput, and effectiveness of our model inference stack.Develop tools to identify bottlenecks and instability sources, designing and implementing solutions for priority issues.Optimize our code and Azure VM fleet to maximize every FLOP and GB of GPU RAM available.You Will Excel in This Role If You:Possess a solid understanding of modern machine learning architectures and an intuitive grasp of performance optimization strategies, especially for inference.Take ownership of problems end-to-end, demonstrating a willingness to acquire any necessary knowledge to achieve results.Bring at least 5 years of professional software engineering experience.Have or can quickly develop expertise in PyTorch, NVidia GPUs, and relevant optimization software stacks (such as NCCL, CUDA), along with HPC technologies like InfiniBand, MPI, and NVLink.Have experience in architecting, building, monitoring, and debugging production distributed systems, with bonus points for working on performance-critical systems.Have successfully rebuilt or significantly refactored production systems multiple times to accommodate rapid scaling.Are self-driven, enjoying the challenge of identifying and addressing the most critical problems.

About Scribd:At Scribd Inc. (pronounced “scribbed”), our vision is to ignite human curiosity and foster a world enriched with stories and knowledge. We invite you to join our dynamic team as we democratize the sharing of ideas and information, and empower collective intelligence through our suite of innovative products: Everand, Scribd, Slideshare, and Fable.This job posting highlights an approved, open position within our organization.We cultivate a culture where our employees can express authenticity and embrace boldness. We encourage robust debates and commitment while adapting to the unexpected, ensuring each team member is empowered to take meaningful action focused on our customers.Our workplace structure emphasizes a balance between individual flexibility and community connectivity. Through Scribd Flex, our flexible work benefit, employees can collaboratively choose the work style that best meets their unique needs, in partnership with their manager. A key aspect of Scribd Flex is our emphasis on intentional in-person interactions to enhance collaboration, culture, and camaraderie. Therefore, occasional in-person attendance is essential for all Scribd Inc. employees, regardless of their location.What do we seek in our new team members? We hire for “GRIT.” The essence of GRIT is the convergence of passion and perseverance toward long-term objectives. At Scribd Inc., we believe in the immense potential unlocked by this mindset, and we encourage every employee to embody a GRIT-ty approach in their responsibilities. Specifically, we are looking for someone who can set and achieve Goals, deliver Results, bring forth Innovative ideas and solutions, and positively impact the broader Team through effective collaboration and attitude.The TeamOur Web Platform team is an integral part of the Developer Platform organization, championing our broader Web Modernization initiatives across the company.Our mission is to accelerate product teams by providing a scalable, thoughtfully designed API foundation that supports modern web architectures. We collaborate across the organization to minimize dependencies, enhance developer experience, and establish robust integration patterns between frontend experiences and backend systems.

We are seeking a highly skilled Senior Staff Software Engineer specializing in API development to join our dynamic team at Anthropic. In this role, you will have the opportunity to leverage your expertise to design and implement cutting-edge APIs that will enhance our products and services.As a key member of our engineering team, you will collaborate closely with cross-functional teams to understand customer needs and translate them into scalable and efficient solutions. You will be responsible for ensuring that our APIs are robust, secure, and user-friendly.

At Hover, we empower individuals to design, enhance, and safeguard their cherished properties. Utilizing proprietary AI technology built on over a decade of real property data, we provide answers to pressing questions such as “What will it look like?” and “What will it cost?” Homeowners, contractors, and insurance professionals depend on Hover to receive fully measured, accurate, and interactive 3D models of any property—achieved through a smartphone scan in mere minutes.We are driven by curiosity, purpose, and a collective commitment to our customers, communities, and each other. At Hover, we believe the most innovative ideas stem from diverse perspectives, and we take pride in fostering an inclusive, high-performance culture that encourages growth, accountability, and excellence. Supported by leading investors like Google Ventures and Menlo Ventures, and trusted by industry leaders including Travelers, State Farm, and Nationwide, we are transforming how people perceive and interact with their environments.Why Join Hover?At Hover, 3D models are not just a feature; they are the essence of our product. Each scan and data point we process empowers homeowners, insurers, and contractors to make informed, data-driven decisions. We are seeking a Software Engineer who has a passion for geometry, automation, and making a tangible impact in the real world. In this role, you will design and implement systems that convert customer-captured imagery into meticulously accurate 3D models, enhancing the scalability and precision of Hover’s modeling pipeline. You will work collaboratively with designers and engineers across frontend, backend, computer vision, and DevOps to bring innovative capabilities to fruition, blending technical expertise with strong communication and cross-functional collaboration.The 3D Modeling Pipeline team develops the tools essential for our in-house operations to transform customer-captured scans into highly detailed, accurate 3D models of buildings. This team is also responsible for creating the pipeline and systems that process 3D data through both automated and manual steps, as well as exporting data into customer-facing formats.Your Contributions Will Include:Owning and evolving backend systems that convert raw scan data into exact 3D models, ensuring timely delivery to key ecosystem partners like Xactimate and Cotality.Building and refining internal modeling tools that enable teams to efficiently generate, validate, and optimize high-quality 3D data.Collaborating with machine learning and computer vision engineers to implement new algorithms into production, bridging research with practical applications.Enhancing customer and partner experiences by improving how Hover’s 3D outputs integrate with downstream workflows and external platforms.Promoting innovation and ongoing enhancement across our modeling pipeline.

At Databricks, we are dedicated to empowering data teams to tackle the most challenging problems in the world — from realizing the future of transportation to fast-tracking medical innovations. We accomplish this by developing and operating the premier data and AI infrastructure platform, enabling our customers to harness profound data insights for business enhancement. Our Model Serving product equips organizations with a cohesive, scalable, and governed solution for deploying and managing AI/ML models — ranging from traditional machine learning to intricate proprietary large language models. It ensures real-time, low-latency inference, governance, monitoring, and lineage. As the adoption of AI surges, Model Serving stands as a fundamental component of the Databricks platform, allowing customers to operationalize models at scale with robust SLAs and cost efficiency. In the role of Staff Engineer, you will significantly influence both the product experience and the core infrastructure of Model Serving. Your responsibilities will include designing and constructing systems that facilitate high-throughput, low-latency inference across CPU and GPU workloads, steering architectural strategies, and collaborating extensively with platform, product, infrastructure, and research teams to create an exceptional serving platform.

ABOUT BASETENAt Baseten, we are at the forefront of enabling transformative AI solutions for some of the world's leading companies, including Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. Our innovative platform combines cutting-edge AI research, adaptable infrastructure, and developer-friendly tools to facilitate the production of advanced models. Recently, we celebrated our rapid growth with a successful $300M Series E funding round from notable investors like BOND, IVP, Spark Capital, Greylock, and Conviction. We invite you to join our dynamic team and contribute to the evolution of AI product deployment.THE ROLEAs a Senior Software Engineer specializing in Model Training at Baseten, you will play a pivotal role in constructing the infrastructure essential for the large-scale training and fine-tuning of foundational AI models. Your responsibilities will include designing and implementing distributed training systems, optimizing GPU utilization, and establishing scalable pipelines that empower Baseten and our clientele to adapt models with efficiency and reliability. This role demands a high level of technical expertise and hands-on involvement: you will be responsible for critical components of our training stack, collaborate with product and infrastructure teams to identify customer needs, and drive advancements in scalable training infrastructure.EXAMPLE WORK:Training open-source models that surpass GPT-5 capabilities for a leading digital insurerExploring specialized, continuously learning models as the future of AIOverview of our training documentationResearch initiatives we've undertakenRESPONSIBILITIESDesign, construct, and sustain distributed training infrastructures for large foundation modelsDevelop scalable pipelines for fine-tuning and training across diverse GPU/accelerator clustersEnhance training performance through optimization of algorithms and infrastructureCollaborate closely with cross-functional teams to align technical solutions with business objectivesStay abreast of advancements in the field of machine learning and AI to continually improve our training processes

At Databricks, we are dedicated to empowering data teams to tackle some of the most challenging issues of our time—from realizing the future of transportation to speeding up medical innovations. We achieve this by developing and maintaining the premier data and AI infrastructure platform, allowing our clients to leverage profound data insights to enhance their operations. Our Model Serving product equips organizations with a cohesive, scalable, and governed platform for deploying and overseeing AI/ML models, spanning traditional ML to specialized large language models. It provides real-time, low-latency inference, governance, monitoring, and lineage capabilities. With the rapid rise of AI adoption, Model Serving stands as a fundamental component of the Databricks platform, enabling clients to operationalize models efficiently and cost-effectively at scale. As a Senior Engineer, your role will be pivotal in transforming both the product experience and the underlying infrastructure of Model Serving. You will design and create systems enabling high-throughput, low-latency inference across CPU and GPU workloads, influence architectural strategies, and work closely with platform, product, infrastructure, and research teams to deliver an exceptional serving platform.

At Databricks, we are driven by our commitment to empower data teams in tackling the world's most challenging problems — from transforming transportation solutions to accelerating medical advancements. Our mission revolves around constructing and maintaining the world's premier data and AI infrastructure platform, enabling our clients to harness deep data insights for enhanced business outcomes.Foundation Model Serving represents the API product designed for hosting and serving advanced AI model inference, catering to both open-source models like Llama, Qwen, and GPT OSS, as well as proprietary models such as Claude and OpenAI GPT. We welcome engineers who have experience managing high-scale operational systems, including customer-facing APIs, Edge Gateways, or ML Inference services, even if they do not have a background in ML or AI. A passion for developing LLM APIs and runtimes at scale is essential.As a Staff Engineer, you will play a pivotal role in defining both the product experience and the underlying infrastructure. You will be tasked with designing and building systems that facilitate high-throughput, low-latency inference on GPU workloads with cutting-edge models. Your influence will extend to architectural direction, working closely with platform, product, infrastructure, and research teams to deliver an exceptional foundation model API product.The impact you will have:Design and implement core systems and APIs that drive Databricks Foundation Model Serving, ensuring scalability, reliability, and operational excellence.Collaborate with product and engineering leaders to outline the technical roadmap and long-term architecture for workload serving.Make architectural decisions to enhance performance, throughput, autoscaling, and operational efficiency for GPU serving workloads.Contribute directly to critical components within the serving infrastructure, from systems like vLLM and SGLang to developing token-based rate limiters and optimizers, ensuring seamless and efficient operations at scale.Work cross-functionally with product, platform, and research teams to transform customer requirements into dependable and high-performing systems.Establish best practices for code quality, testing, and operational readiness while mentoring fellow engineers through design reviews and technical support.Represent the team in inter-departmental technical discussions, influencing Databricks’ wider AI platform strategy.

Waymo is a pioneering company in autonomous driving technology, dedicated to becoming the world’s most trusted driver. Originating from the Google Self-Driving Car Project in 2009, Waymo has established the Waymo Driver—The World’s Most Experienced Driver™—with a mission to enhance mobility access and save lives lost in traffic accidents. The Waymo Driver powers our fully autonomous ride-hailing service and can be integrated across various vehicle platforms and applications. Having completed over ten million rider-only trips, our technology has driven more than 100 million miles on public roads and tens of billions in simulations across over 15 U.S. states.The Perception team is responsible for developing systems that learn the spatial-temporal representations and semantic meanings of the environment surrounding our autonomous vehicles (AVs). We collaborate closely with downstream teams to optimize and integrate our work into the Waymo Driver, conduct research to solve real-world challenges, and work alongside research teams at Alphabet. With access to millions of miles of diverse driving data from various sensors, we empower engineers like you to (1) create methods for efficient continuous learning from extensive real-world data, (2) develop scalable models and training methodologies, (3) analyze real-world behaviors to create systems that can navigate complexities, and (4) optimize models for both onboard and offboard hardware.In this hybrid role, you will report to a Technical Lead Manager.

At Hover, we empower individuals to design, enhance, and safeguard the properties they cherish. Utilizing our proprietary AI, developed over a decade of extensive real property data, we adeptly address crucial inquiries such as “What will it look like?” and “What will it cost?” Homeowners, contractors, and insurance professionals depend on Hover for fully measured, precise, and interactive 3D models of any property, all achievable through a smartphone scan in mere minutes.Driven by curiosity, purpose, and a shared dedication to our customers, communities, and one another, we believe that the most innovative ideas stem from diverse viewpoints. We are proud to foster an inclusive, high-performance culture that encourages growth, accountability, and excellence. Supported by prominent investors like Google Ventures and Menlo Ventures, and trusted by industry leaders such as Travelers, State Farm, and Nationwide, we are revolutionizing how people perceive and engage with their spaces.Why Hover is Seeking YouIn our team, 3D models are not just a feature; they are fundamental to our offering. Each scan and data point we process empowers homeowners, insurers, and contractors to make informed, data-driven decisions. We are on the lookout for a Software Engineer who is enthusiastic about geometry, automation, and making a tangible impact in the real world. In this role, you will design and implement systems that convert customer-captured imagery into highly accurate 3D models, enhancing the scalability and accuracy of Hover’s modeling pipeline. You will work closely with designers and engineers across various domains including frontend, backend, computer vision, and DevOps to introduce new capabilities, blending technical expertise with effective communication and cross-functional collaboration.The 3D Modeling Pipeline team creates the essential tools that our internal operations rely on to convert customer-captured scans into precise, detailed 3D models of buildings. The team also develops the pipeline and systems that process 3D data through both automated and manual steps, and export data into formats for our customers.

Benchling creates software tools for scientists and biotech companies, supporting research and development across the globe. The platform serves more than 200,000 scientists, including teams at organizations like Sanofi and Moderna, as well as academic research labs. By connecting experiments, structured data, and AI-powered insights, Benchling works to reduce the time it takes for discoveries to reach real-world applications. Role overview This Software Engineer position focuses on integrating advanced scientific AI models into the Benchling platform. The main responsibility is to build a scalable system for hosting and managing scientific models, while also developing frameworks that allow model creators to bring their solutions into the Benchling environment. What you will do Develop and maintain a platform that supports scientific AI models at scale. Create frameworks that make it easier for model developers to contribute to Benchling. Experiment with new technologies to improve model integration and performance. Work closely with internal teams and external partners to deliver solutions. Help shape how scientists design molecules and apply AI in their research workflows. Location This role is based in San Francisco, CA.

As a Senior Staff Software Engineer specializing in Model LifeCycle at Crusoe, you will play a vital role in shaping the future of software solutions that optimize and enhance our innovative operations. You will lead complex projects, mentor junior engineers, and collaborate with cross-functional teams to deliver high-impact results.