DevOps Engineer at litellm | San Francisco

About CollateCollate is an innovative AI-driven document generation platform tailored for the life sciences sector. Our mission is to streamline paperwork through advanced AI technology, enabling our clients to deliver life-saving innovations to patients significantly faster. Serving as a comprehensive solution, Collate enhances every phase of drug, diagnostic, and medical device development—from initial concept to market readiness.Under the leadership of our CEO Surbhi Sarna, a distinguished former General Partner at Y Combinator, and our CTO Nate Smith, a former Visiting Partner at Y Combinator, our team comprises AI researchers, engineers, and designers with experience from top-tier companies like Google, Nvidia, Meta, and Netflix. Impressively, 40% of our team are former founders themselves.We are a compact, elite team backed by over $30 million in seed funding from renowned investors including Redpoint, First Round Capital, Conviction, and Y Combinator, along with industry leaders in healthcare and AI. This is a unique opportunity to become part of a groundbreaking company poised to make a significant impact, guided by experienced founders with the resources to scale effectively.About the RoleWe are seeking a passionate AI Engineer to assist in developing and operationalizing the models and systems that drive Collate's innovative products. Your role will bridge the realms of machine learning, software engineering, and product development—transforming pioneering research into dependable, user-centric functionalities.This position offers a remarkable chance to influence the application of advanced AI in the life sciences sector, where performance, safety, and trust are as crucial as innovation. As one of the initial AI-focused engineers at Collate, you will help establish standards for evaluating and deploying models that have a direct impact on drug and medical device development.

About CollateAt Collate, we are revolutionizing the life sciences industry with our cutting-edge AI document generation platform. Our mission is to streamline essential paperwork through innovative AI solutions, enabling our clients to deliver life-saving breakthroughs to patients in record time. Our comprehensive platform supports every stage of drug, diagnostic, and medical device development, from initial concept through to market launch.Founded by industry visionaries, our CEO Surbhi Sarna, a former General Partner at Y Combinator, and our CTO Nate Smith, a former Visiting Partner at Y Combinator, have built a team of talented engineers and researchers with experience at top-tier companies such as Google, Nvidia, and Amazon. With over $30M in seed funding from esteemed investors, we are poised for tremendous growth and invite you to join us at this exciting stage.About the RoleWe are seeking a dedicated DevOps / Systems Engineer to take charge of the infrastructure that supports Collate’s innovative products. In this role, you will develop and maintain the systems and tools that ensure our platform remains reliable, secure, and efficient as we scale.Your responsibilities will be diverse, ranging from managing CI/CD pipelines and cloud infrastructure to overseeing light security tasks such as certificate management. You will collaborate closely with backend, AI, and product engineers to create a seamless development experience and ensure safe deployments at scale.At Collate, our focus on infrastructure goes beyond mere uptime; it’s about building trust. Your contributions will be vital in ensuring that our AI solutions for healthcare operate with the utmost reliability and security.

Join our dynamic team at collate as a UI Designer, where your creativity and innovative design skills will help shape intuitive user experiences. Collaborate with cross-functional teams to craft visually stunning interfaces that engage and delight users.

Join Collate as a Frontend Software EngineerAt Collate, we are revolutionizing the life sciences sector with our innovative AI document generation platform. Our mission is to expedite the delivery of life-saving innovations to patients by automating complex paperwork. As a seamless end-to-end solution, we support every stage of drug, diagnostic, and medical device development, from initial concept to market launch.Led by our visionary CEO, Surbhi Sarna, a former General Partner at Y Combinator, and our CTO, Nate Smith, a former Visiting Partner at Y Combinator, we have assembled a team of elite professionals with experience from top-tier companies like Google and Amazon. Our small team has garnered over $30M in seed funding from esteemed investors including Redpoint and First Round Capital, positioning us for rapid growth and impact in the healthcare field.As a Frontend Software Engineer, you will play a pivotal role in shaping the user experience at Collate. Your innovative contributions will translate complex AI technology into intuitive and user-friendly tools for doctors, patients, and researchers. Your work will directly influence the product experiences that are critical for improving patient outcomes.You will be working on a predominantly frontend-focused enterprise workflow application, ensuring the interface is clear, reliable, and trustworthy. This is a unique opportunity to design the intersection where transformative technology meets real-world users.Our Cutting-Edge Tech StackWe utilize modern technologies including TypeScript, React, and Tailwind CSS for our frontend development, creating a dynamic environment for innovation and collaboration.

About CollateCollate is a cutting-edge AI-driven document generation platform specifically designed for the life sciences sector. Our innovative technology automates the paperwork process, enabling our clients to deliver life-saving medical innovations to patients significantly faster. As a comprehensive solution, Collate supports every phase of development for drugs, diagnostics, and medical devices—from initial concept to market launch.Our visionary CEO Surbhi Sarna, a former General Partner at Y Combinator, founded nVision Medical, which pioneered a novel method for detecting ovarian cancer before its acquisition by Boston Scientific. Our CTO Nate Smith, previously a Visiting Partner at Y Combinator and founder of Lever, leads our talented team of AI researchers, engineers, and designers who have backgrounds at industry giants such as Google, Nvidia, Meta, Netflix, Amazon, Airbnb, Hippocratic AI, and Grail. Notably, 40% of our team members are former startup founders themselves.As a compact yet highly skilled team, we have secured over $30M in seed funding from top-tier investors including Redpoint, First Round Capital, Conviction, and Y Combinator, as well as healthcare and AI leaders. This is a unique opportunity to join a company at the forefront of transformative change, guided by experienced founders with the resources to scale effectively.About the RoleWe are seeking a talented Backend Engineer who will play a crucial role in designing and scaling the systems that underpin Collate’s offerings. You will be responsible for developing APIs, services, and the infrastructure that form the backbone of our platform, ensuring they are efficient, dependable, and secure as we transition from prototypes to large-scale implementation.This position is perfect for individuals who thrive on tackling complex system challenges, flourish in an early-stage setting, and wish to see their contributions directly impact advancements in the life sciences field.Modern Tech StackCollate employs a contemporary tech stack aimed at delivering a highly reliable and available platform. Our backend services are built using Go, while we utilize Postgres as our primary database. Frontend development is powered by TypeScript and React, and Python is utilized for AI and machine learning services. Our infrastructure is hosted on AWS, employing Kubernetes for orchestration along with Terraform and Argo CD for configuration management.

About CollateCollate is a cutting-edge AI-driven document generation platform specifically designed for the life sciences sector. Our mission is to streamline documentation processes through automation, enabling our clients to accelerate the delivery of life-saving innovations to patients significantly faster. As a comprehensive solution, Collate supports every phase of drug, diagnostic, and medical device development, from initial concept to market launch.Founded by CEO Surbhi Sarna, a former General Partner at Y Combinator, Collate benefits from her extensive experience, including the founding of nVision Medical which pioneered a novel ovarian cancer detection method that was later acquired by Boston Scientific. Our CTO Nate Smith, previously a Visiting Partner at Y Combinator, is also the founder of Lever. Our talented team of AI researchers, engineers, and designers hail from prestigious companies such as Google, Nvidia, Meta, Netflix, Amazon, AirBnB, Hippocratic AI, and Grail, with 40% of our members being former startup founders.As a compact yet highly skilled team, we have secured over $30 million in seed funding from premier investors including Redpoint, First Round Capital, Conviction, and Y Combinator, as well as leaders in the healthcare and AI sectors. This represents a unique opportunity to join a pioneering company with the potential for transformative impact, led by experienced founders equipped with the resources necessary for large-scale execution.About the RoleWe are seeking a Full-Stack Software Engineer (Backend-Leaning) to architect and develop the systems and user-focused features that drive Collate's success. Your primary responsibilities will revolve around backend challenges—such as APIs, services, and infrastructure—while also engaging in the delivery of complete end-to-end features.This role offers a chance to help shape our technical framework, work closely with design and product teams, and influence the user experience of Collate from the very beginning.Modern Tech StackCollate employs a modern technology stack to ensure a highly reliable and available platform. We utilize Go for scalable backend services, TypeScript and React for frontend development, and Python for AI and ML services. Our infrastructure leverages AWS with Kubernetes for orchestration and Terraform alongside Argo CD for configuration management. Key systems in our architecture include S3, PostgreSQL, Kafka, OpenSearch, LLMs, and various AI models.

Join collate as a Quality Engineer specializing in Diagnostics, where you will play a pivotal role in ensuring the highest standards of product quality. In this full-time position, you will collaborate with cross-functional teams to develop and implement quality assurance processes that enhance our diagnostic products.As a member of our team, you will be responsible for designing test plans, conducting rigorous testing, and analyzing results to drive improvements. Your expertise will contribute to the development of innovative solutions that positively impact our customers and the healthcare industry.

Join our innovative team at Collate as a Quality Engineer focusing on medical devices. In this full-time position, you will be responsible for ensuring that our products meet the highest quality standards. You will collaborate with cross-functional teams to develop, implement, and maintain quality assurance protocols that comply with industry regulations and best practices.Your role will involve conducting quality audits, analyzing product performance data, and identifying areas for improvement. We are looking for a detail-oriented individual who is passionate about enhancing product quality and safety in the medical device sector.

About CodeRabbitCodeRabbit is a pioneering research and development firm that specializes in crafting highly efficient human-machine collaboration systems. Our mission is to develop the next wave of AI-driven code review solutions—a collaborative synergy between human creativity and advanced algorithms that surpasses the capabilities of individual engineers. By integrating state-of-the-art language models with human insight, we aim to redefine the standards of software development efficiency and quality.Role OverviewAs a DevOps Engineer at CodeRabbit, you will be instrumental in scaling, securing, and fortifying the infrastructure that supports our AI-powered developer tools. Collaborating with our platform engineers, backend team, and applied AI specialists, you will ensure our systems are robust, observable, high-performing, and easy to deploy.This position is hands-on and tailored for an individual who excels in a dynamic environment, takes initiative in managing critical infrastructure, and is eager to develop tools that empower an ambitious engineering team.ResponsibilitiesDesign, implement, and manage scalable CI/CD pipelines.Develop and oversee infrastructure as code (e.g., Terraform, Pulumi).Enhance system reliability through effective monitoring, alerting, logging, and failover strategies.Collaborate with platform and backend teams to identify and mitigate performance bottlenecks.Contribute to deployment workflows, environment automation, and developer tooling enhancements.Ensure that infrastructure security and compliance measures are rigorously enforced.

Join CodeRabbit as a Senior DevOps Engineer!At CodeRabbit, we are at the forefront of research and development, crafting cutting-edge systems for human-machine collaboration. Our mission is to revolutionize software development by creating the next generation of AI-driven code review tools. These advancements represent a powerful synergy between human creativity and advanced algorithms, allowing us to maximize productivity and elevate code quality to unprecedented heights.As a Senior DevOps Engineer, you will be instrumental in scaling, securing, and optimizing the infrastructure that fuels our AI-powered developer tools. Collaborating closely with our platform engineers, backend developers, and applied AI teams, you will ensure our systems are robust, efficient, and easy to deploy, all while maintaining high standards of observability and resilience.This position is ideal for a proactive individual who thrives in dynamic environments, takes initiative with critical infrastructure, and is passionate about developing tools that empower an ambitious engineering team.

Join Lever, a pioneering force in the recruitment technology sector, as a DevOps Engineer. This position is crucial in enhancing our platform that powers the hiring processes for top-tier companies like Netflix, Shopify, and Spotify. You will play a vital role in our mission to innovate and streamline talent acquisition.Lever, founded a decade ago, is committed to redefining how organizations attract and hire the best talent. We are proud to be recognized as the #1 workplace in San Francisco and a top company to work for across the United States. Our culture is centered around our team members, whom we refer to as “Leveroos,” and we continuously invest in their growth and success.

Why Choose Flux?At Flux, we are transforming the hardware landscape by creating the world's first AI Hardware Engineer. Our mission is to democratize access to cutting-edge hardware development and revolutionize global electronics design and manufacturing.About the OpportunityAs a DevOps Engineer at Flux, you will be integral in ensuring the smooth operation of our innovative platform. Your work will encompass a wide range of full-stack systems, impacting various aspects of our service, including billing, authentication, onboarding, and seamless integrations.Your contributions will directly influence user experience, and your role will be crucial in maintaining operational efficiency as Flux continues to scale.Key ResponsibilitiesEnhance the reliability, availability, and operational health of our production systems.Establish observability standards across services, including metrics, logs, and error tracking.Define Service Level Objectives (SLOs) and Service Level Indicators (SLIs) while implementing effective alerting strategies.Collaborate with engineering teams to design robust systems and proactively mitigate operational risks.Develop internal tools to enhance system safety, debugging capabilities, and developer productivity.Manage infrastructure using Pulumi across GCP, AWS, and Firebase.

Why Join Flux?At Flux, we are pioneering the future of technology by creating the world's first AI Hardware Engineer. Our mission is to make cutting-edge hardware accessible to everyone, transforming the landscape of electronics design and development globally.About the OpportunityAs a Senior DevOps Engineer at Flux, you will be crucial in ensuring the seamless operation of our innovative platform. Your focus will extend beyond the code editor to vital systems such as billing, authentication, user onboarding, and integrations.You will have the opportunity to deliver production features that impact all users, maintain operational stability, and enable Flux's growth trajectory.

About ArtisanAt Artisan, we're pioneering the development of AI employees – not mere chatbots or copilots, but fully autonomous digital workers capable of performing real jobs.Our flagship product, Ava, is an AI Business Development Representative (BDR) already utilized by hundreds of companies. Ava autonomously researches leads, crafts and sends emails in a customer's voice, executes complex outbound sequences, manages her own deliverability infrastructure, optimizes her performance over time, and effectively handles objections and meeting scheduling. Rather than being just a tool, Ava acts as a vital teammate.As a Y Combinator W24 company, we've successfully raised over $35 million from esteemed investors and have reached over $8 million in Annual Recurring Revenue (ARR). Currently, we are ambitiously developing Ava 2.0, which represents a significant leap in the capabilities of AI employees. The engineering challenges we face are complex and the scope of our work is vast.Your RoleAs a Staff DevOps Engineer at Artisan, you'll be responsible for our platform that manages hundreds of millions of leads, orchestrates autonomous AI agents in real-time, and facilitates massive-scale email distribution across thousands of customer mailboxes. You will play a key role in delivering a product suite that effectively replaces an entire sales stack, including CRM, inbox, dialer, lead database, and campaign engine. The infrastructure that underpins this functionality is critical to our success.In this staff-level position, you will take ownership of the entire DevOps and infrastructure layer at Artisan, setting the groundwork, defining best practices, and developing the systems that all other functions rely on.Your key responsibilities will include:Kubernetes and Container Orchestration: You will manage our AWS-based Kubernetes infrastructure, overseeing cluster management, scaling policies, resource optimization, and the compute layer that supports AI workloads, data pipelines, and customer-facing product infrastructure.CI/CD and Deployment Pipelines: We implement continuous shipping practices. You will design and maintain the deployment infrastructure that allows engineers to deploy with confidence multiple times a day, including automated testing, staging environments, rollback strategies, and feature flags.Observability and Reliability: You will build a comprehensive observability layer from the ground up, ensuring effective monitoring, alerting, logging, and tracing. Quick detection and understanding of failures, such as an AI agent failing to send an email or a stalled pipeline, will be a priority.Email Deliverability Infrastructure: Ava’s ability to send emails at scale across thousands of domains and mailboxes relies on intricate sender reputation management, domain warming, DNS configuration, and IP management.Security and Compliance: Managing customer data and email credentials requires strict adherence to security standards and compliance regulations.

About Plaud Inc.Plaud is pioneering the development of a highly trusted AI work companion tailored for professionals, enhancing productivity and performance through innovative note-taking solutions that have garnered the affection of over 1,500,000 users globally since its inception in 2023. Our mission is to amplify human intelligence by constructing next-generation infrastructure and interfaces capable of capturing, extracting, and utilizing verbal, auditory, visual, and cognitive information.Headquartered in San Francisco and incorporated in Delaware, Plaud Inc. is at the forefront of merging human and AI intelligence through an integrated hardware and software approach. We adhere to the highest standards of data security and privacy protection, with compliance certifications including ISO 27001, ISO 27701, GDPR, SOC 2, HIPAA, and EN 18031.Discover more about us at https://www.plaud.ai and connect with us on Instagram, X, Facebook, LinkedIn, and YouTube.Why You Should Join UsBe part of a bootstrapped, rapidly growing, and profitable company that has achieved an impressive $250 million revenue run rate within just three years.Help define the future of human-AI interaction.Engage with cutting-edge AI tools and contribute directly to our international growth.Collaborate with enthusiastic colleagues who prioritize innovation, teamwork, and customer success.Advance your career in a culture that promotes continuous learning and development.

Join our dynamic team at Collate as a Sales Representative in the vibrant city of San Francisco. We are seeking a motivated individual passionate about driving sales and building lasting relationships with clients. In this full-time role, you will engage with potential customers, understand their needs, and present tailored solutions that align with our product offerings. Your contributions will be vital in helping us achieve our business goals and expand our market presence.

About AKASAAt AKASA, we are dedicated to revolutionizing healthcare through artificial intelligence. As the foremost provider of generative AI solutions for the healthcare revenue cycle, we enable health systems to effectively capture and convey the entire patient clinical journey. Our innovative approach allows healthcare providers to enhance operational efficiency, allowing them to prioritize what truly matters: delivering outstanding patient care. We have successfully secured over $205 million in funding from top-tier investors, including Andreessen Horowitz, BOND, and Costanoa Ventures.This is an exhilarating time to join AKASA. Since the launch of our AI-native product suite in 2024, revenue bookings have skyrocketed over 20 times. During this period, we have shattered our record for the largest deal in our company’s history three times in a row. This remarkable growth is a testament to the significant advancements we are facilitating for our clients in clinical quality and documentation accuracy—two critical focus areas for healthcare leaders.Our deployments have garnered national recognition as one of the most extensive real-world applications of GenAI in healthcare finance to date (link). Our clientele represents over $120 billion in net patient revenue, comprising some of the most forward-thinking health systems in the nation, including Cleveland Clinic, Duke, Stanford, and Johns Hopkins.We have recently earned accolades such as being named the #1 most promising healthcare RCM startup of 2025 by Black Book Market Research and one of the fastest-growing GenAI startups to monitor by AIM Research. Our CEO has been recognized among the “Top 50 Healthcare Technology CEOs” by the Healthcare Technology Report, and we have proudly maintained our status as a “Great Place to Work” for the past five consecutive years.We are leveraging this momentum to redefine the possibilities within the healthcare industry. We are in search of exceptional talent to help us accelerate this vision.About the RoleAs a Senior Software Engineer specializing in DevOps at AKASA, you will collaborate closely with our Infrastructure and Platform teams to manage, enhance, and scale the systems that fuel our products. Your primary focus will be to ensure that our infrastructure is reliable, observable, and straightforward to operate, with a strong emphasis on automation, operational excellence, and cross-functional teamwork.

About CollateCollate is an innovative AI document generation platform tailored for the life sciences sector. Our mission is to streamline the paperwork process with cutting-edge AI technology, enabling our clients to deliver life-changing innovations to patients significantly faster. We provide a comprehensive solution that supports every phase of drug, diagnostic, and medical device development, from initial concept to market launch.Founded by industry leaders, including our CEO Surbhi Sarna, a former General Partner at Y Combinator, and our CTO Nate Smith, a former Visiting Partner at Y Combinator, our team comprises AI researchers, engineers, and designers with experience from top firms such as Google, Nvidia, Meta, and more. Notably, 40% of our team members are former startup founders.As a small, elite team, we have secured over $30M in seed funding from prestigious investors including Redpoint, First Round Capital, Conviction, and Y Combinator, along with healthcare and AI industry leaders. This presents a unique opportunity to join a company poised for impactful growth, backed by experienced founders and the necessary resources to scale effectively.About the RoleWe are searching for an AI Research Scientist who is eager to push the frontiers of AI applications in healthcare. In this role, you will investigate novel modeling techniques, create innovative architectures, and prototype groundbreaking capabilities that have not yet been realized, all while focusing on how these advancements can translate into safe, reliable, and impactful products.This position goes beyond traditional research; at Collate, our research initiatives are closely linked with real-world applications. You will collaborate with engineers, product managers, and life science experts to ensure that our laboratory breakthroughs become practical solutions in the healthcare space.

Are you a passionate and experienced DevOps engineer looking to elevate your career? Join us at 360 IT Professionals, where we pride ourselves on innovation and excellence in IT solutions. As a Senior DevOps Engineer, you will play a pivotal role in enhancing our deployment processes, ensuring the reliability and scalability of our infrastructure, and collaborating with cross-functional teams to drive project success.Your expertise will help us optimize our cloud environments and implement best practices in CI/CD pipelines. If you thrive in a dynamic environment and are eager to tackle challenging problems, we want to hear from you!