Senior Machine Learning Engineer at Databricks | San Francisco

Job OverviewJoin Eragon as a Machine Learning Engineer and lead the charge in transforming innovative AI models into scalable, production-grade systems. This position is pivotal in bridging research and real-world applications by designing and optimizing systems that enhance vital workflows throughout the enterprise.In collaboration with our research, product, and engineering teams, you will convert cutting-edge capabilities into dependable, high-performance systems ready for production.Key ResponsibilitiesModel Development & Deployment: Craft, refine, and deploy machine learning models within production settings.Systems Engineering: Architect scalable pipelines for training, inference, evaluation, and comprehensive monitoring.Performance Optimization: Enhance the latency, throughput, cost-efficiency, and reliability of ML systems.Data & Infrastructure: Manipulate large datasets and ensure seamless integration of models with internal systems and APIs.Cross-Functional Collaboration: Collaborate with product and engineering teams to provide end-to-end AI functionalities.Evaluation & Monitoring: Develop robust evaluation frameworks and feedback loops to ensure system effectiveness.

Job DescriptionEmbrace the future of competitive advantage with Eragon, where we create bespoke AI systems that are meticulously tailored to understand your unique business landscape.At Eragon, we focus on developing AI models that leverage proprietary data, deployed directly within customer environments and continuously refined through real-world interactions. Our models not only respond but evolve, improving with each user engagement.We utilize a cutting-edge reinforcement learning framework known as RLQF (Reinforcement Learning from Query Feedback) that transforms user interactions into valuable training signals, establishing a cycle of ongoing enhancement that surpasses traditional fine-tuning methods.The RoleAs an Applied Research Engineer, you will be responsible for designing, training, and deploying advanced models that drive real business operations.This position is not about theoretical research; you will engage directly with customer data, constraints, and feedback, crafting solutions that excel in production settings. You will manage the entire lifecycle of the project, from defining the problem and designing data structures to training, evaluating, and iterating based on live performance.What You’ll DoTrain and adapt models: Fine-tune and post-train models on customer-specific data utilizing RLQF among other techniques.Close the loop: Convert real user interactions, corrections, and workflows into actionable training signals.Own end-to-end systems: Oversee the process from data ingestion and curation through to training, evaluation, and deployment.Evaluate in production: Create evaluation frameworks that accurately reflect real-world performance, rather than relying solely on benchmarks.Work with customers: Collaborate closely with users to comprehend their workflows and translate these into model functionalities.Ship and iterate: Focus on the continuous improvement of models based on live feedback and measurable outcomes.What We’re Looking ForExtensive hands-on experience in training, fine-tuning, or post-training machine learning models.Proficiency in handling messy, real-world data as opposed to only clean benchmarks.Familiarity with reinforcement learning techniques, feedback-driven training such as RLHF or RLAIF, and evaluation systems.Adeptness at quickly transitioning from problem identification to data management, model development, and iterative improvement.Strong engineering instincts with a comfort level in managing systems end-to-end.A proactive approach to shipping and enhancing systems, rather than solely focusing on research.

About Taskrabbit:Taskrabbit is an innovative marketplace platform that seamlessly connects individuals with Taskers to manage everyday home tasks, including furniture assembly, handyman services, moving assistance, and much more.At Taskrabbit, we aim to transform lives one task at a time. We celebrate innovation, inclusion, and hard work, fostering a collaborative, pragmatic, and fast-paced culture. We seek talented, entrepreneurially minded, data-driven individuals who possess a passion for empowering others to pursue their passions. In partnership with IKEA, we are creating more opportunities for individuals to earn a consistent, meaningful income on their terms by establishing enduring relationships with clients in communities globally.Taskrabbit operates as a hybrid company, with team members located across the US and EU, and has been recognized as a Built In — Best Places to Work for 2022, 2023, and 2024, receiving accolades across various national and regional categories. Join us at Taskrabbit, where your contributions will be significant, your ideas appreciated, and your potential maximized!This position operates on a hybrid schedule, requiring two days of in-office collaboration per week. It can be based in our San Francisco office or our new New York City office (opening March 2026).About the RoleMachine Learning is a foundational element at Taskrabbit, and we are in search of an experienced Senior Machine Learning Engineer to join our team and help mold the future of ML/AI at Taskrabbit. This distinct, full-stack role is designed for someone who is enthusiastic about the entire machine learning lifecycle—from initial research and model development to constructing the robust infrastructure necessary for deploying and scaling your innovations.As a Senior Machine Learning Engineer, you will engage with exciting challenges that directly influence how users discover and interact with home services on the Taskrabbit platform. You will play a vital role in enhancing our capabilities in areas such as search ranking, content discovery, and recommendation systems. Collaborating closely with data scientists and fellow engineers, you will design and implement cutting-edge algorithms, ensuring the scalability, reliability, and optimization of our models in production alongside software engineers.

About VSCO At VSCO, we empower photographers with an innovative platform that provides essential tools, a vibrant community, and the visibility needed for creative and professional growth. We cultivate an authentic creative environment that welcomes photographers of all skill levels, offering a space that inspires opportunity, collaboration, and connection. Our mission is to support photographers in their journeys, enabling them to thrive and connect with fellow creatives and businesses through our comprehensive suite of tools, available on both mobile and desktop. We seek individuals who are passionate and proactive in advancing our mission. Our team members have the opportunity to make a significant impact, and we believe that collaborative efforts yield stronger results. Our core values are essential to our team culture and guide our hiring process. Learn more about what you can expect when joining VSCO on our Careers Page. About The Role As a Senior Machine Learning Engineer, you will harness the power of AI and machine learning to create innovative, reliable user-facing product features. You will leverage your extensive technical background and hands-on experience in deploying machine learning models to deliver impactful solutions based on real-world feedback. Your focus on measurable outcomes and customer satisfaction drives your work, blending innovation with practical implementation. You will be highly skilled in Python and adept across the data and machine learning stack, enabling you to develop and launch models efficiently while ensuring scalability and maintainability. Whether working with traditional algorithms or cutting-edge deep learning and generative AI, you will expertly navigate the complexity of each problem, managing every phase from defining the challenge to deployment and iterative improvement. Your dedication to software engineering excellence will inform your thoughtful approach to system design for machine learning, encompassing data quality, pipeline design, feature workflows, model serving, and ongoing monitoring and enhancement. By integrating machine learning deeply within our cohesive product experiences, you will collaborate effectively with cross-functional teams, aligning on objectives, defining success metrics, and driving meaningful outcomes. You will stay informed about the rapidly evolving AI landscape, maintaining a discerning perspective that allows your team to focus on significant advancements while avoiding distractions. The Day to Day Design and implement ML-powered features for search, discovery, personalization, and more.

At Sciforium, we are pioneering the future of AI infrastructure by creating cutting-edge multimodal AI models and a proprietary, high-efficiency serving platform. With substantial financial backing and direct support from AMD engineers, our team is rapidly expanding as we develop the comprehensive stack that drives advanced AI models and real-time applications.About the RoleIn the capacity of a Machine Learning Engineer, you will engage with the entire foundation-model stack, encompassing pretraining and scaling, post-training and Reinforcement Learning, sandbox environments for evaluation and agentic learning, and deployment + inference optimization. You’ll have the opportunity to rapidly iterate on research ideas, contribute to production-grade infrastructure, and help deliver models capable of addressing real-world challenges at scale.Your ResponsibilitiesThis position offers diverse tracks - candidates can specialize or contribute across multiple areas. Key responsibilities include:Pretraining & ScalingTrain expansive byte-native foundation models utilizing vast, heterogeneous data sources.Formulate stable training methodologies and scaling laws tailored for innovative architectures.Enhance throughput, memory efficiency, and resource utilization across extensive GPU clusters.Establish and maintain distributed training infrastructures alongside fault-tolerant pipelines.Post-training & Reinforcement LearningBuild out post-training frameworks (SFT, preference optimization, RLHF/RLAIF, RL).Curate and produce specialized datasets aimed at enhancing specific model capabilities.Develop reward models and evaluation systems to facilitate ongoing improvements.Investigate inference-time learning and computational strategies to boost performance.Sandbox Environments & EvaluationCreate scalable sandbox environments for agent assessment and learning.Generate realistic, high-signal automated evaluations for reasoning, tool usage, and safety.Design both offline and online environments that support RL-style training at scale.Implement instrumentation for observability, reproducibility, and rapid iteration.Deployment & Inference OptimizationOptimize deployment strategies to ensure models are efficient and effective in real-world applications.

Join Strava, a leader in the sports technology sector, as a Machine Learning Engineer. In this exciting role, you will apply your expertise in machine learning and data science to develop innovative solutions that enhance the experience of millions of athletes worldwide. Collaborate with cross-functional teams to create algorithms that analyze vast datasets and provide actionable insights to our users.

Join Reducto as a Machine Learning EngineerAt Reducto, we empower AI teams to harness real-world enterprise data with unparalleled precision.Much of the enterprise data—ranging from financial documents to healthcare records—remains trapped in unstructured formats such as PDFs and spreadsheets. Our vision models are designed to interpret these documents in a human-like manner, enabling the development of innovative products, training of machine learning models, and automation of processes on a large scale.Our rapid growth is a testament to our success, having achieved a staggering 7x year-over-year revenue increase, collaborating with numerous companies from prominent AI teams like Harvey, Vanta, and Scale to major enterprises including FAANG and leading trading firms.With over $100 million raised from esteemed investors such as A16z, Benchmark, and First Round Capital, we are on the lookout for a talented Machine Learning Engineer to assist in training and deploying models crucial for our core product's success.

About LightfieldLightfield is an innovative, AI-powered CRM that seamlessly integrates with your email, calendar, and meetings. It captures every interaction and transforms it into organized context, including accounts, tasks, follow-ups, and valuable insights, ensuring that nothing is overlooked.We are fundamentally reimagining CRM by focusing on the actual workflows of teams rather than imposing rigid systems. Lightfield learns from real-world usage, automating processes and surfacing insights that drive business growth. We’re creating the CRM platform we’ve always envisioned: fast, intelligent, and genuinely supportive.Supported by notable investors such as Greylock, Lightspeed, and Coatue, our team has a rich background, having previously developed Tome, a generative AI presentation tool utilized by over 25 million users. Many of us have experience with leading companies such as Llama, Instagram, Facebook Messenger, Pinterest, Google, and Salesforce.About the RoleAs a key member of Lightfield's AI/ML team, you will play a vital role in crafting the core experiences of our product, developing cutting-edge applications that delight our customers.Currently, our focus is on building a powerful, domain-specific AI that surpasses generic LLMs.We thrive on the challenge of creating groundbreaking AI products for professionals engaged in serious work, and we are eager to expand our AI/ML team to meet these ambitious goals.What You'll DoDevelop and deliver exceptional, unique AI experiences that sales teams will be excited to use.Collaborate with founders and executives to shape Lightfield's AI/ML strategy.Identify user needs suitable for AI/ML solutions, articulate challenges, and work closely with product leaders to devise solutions.Prototype innovative, LLM-powered experiences and guide their development into reliable product features.Contribute to building a world-class AI/ML engineering team through recruitment and mentorship.Who You ArePossess a BS or MS degree in Computer Science, Artificial Intelligence, or Applied Mathematics.Have over 5 years of experience in developing AI/ML products, particularly in Natural Language Processing (NLP).Demonstrate a solid understanding of deep learning AI/ML frameworks and cloud services.Bring hands-on experience in ML Operations (ML Ops).Bonus PointsExperience leading AI/ML product initiatives...

Machine Learning EngineerJoin our client, a pioneering company dedicated to developing state-of-the-art non-invasive technology for brain interfacing. They are at the forefront of creating an innovative ultrasound-based platform that not only stimulates but also images brain activity with unmatched precision and depth, paving the way for groundbreaking advancements in neurological treatments and health research.This integrated approach combines cutting-edge hardware, sophisticated real-time software systems, and applied neuroscience to produce scalable solutions that can enhance lives on a global scale.We are looking for a skilled Machine Learning Engineer to play a crucial role in designing and implementing the essential algorithms that will facilitate precise imaging and targeting of brain activity through ultrasound systems.

About the RoleJoin Onyx, an esteemed open-source project that has captivated hundreds of thousands of users. With over 10,000 stars and a vibrant community of over 3,000 members on platforms like Slack and Discord, your contributions could impact millions in the future. Your ImpactAs a Machine Learning Engineer at Onyx, you will play a pivotal role in enhancing our knowledge layer on top of Large Language Models (LLMs). You will tackle complex challenges such as multi-hop question answering, needle-in-haystack retrieval, and advanced Retrieval-Augmented Generation (RAG) techniques. Key ResponsibilitiesDesign and implement knowledge graphs based on LLMs, exploring advanced RAG methods and cutting-edge information retrieval algorithms.Enhance user experience through innovative features like feedback learning, personalized search, and Subject Matter Expert (SME) suggestions.Develop a semantic understanding of organizational priorities to improve Onyx's answering capabilities.Manage projects from initial conception through validation to production deployment.Collaborate closely with our Founders and Head of AI to shape product direction and contribute to our AI/ML strategy. Success Criteria3+ years of experience in AI/ML engineering, focusing on real-world applications.In-depth expertise with PyTorch/TensorFlow, natural language processing (NLP) models, and standard machine learning algorithms.Stay current with advancements in open-source and proprietary LLMs, RAG, and agent frameworks.Strong software engineering skills, capable of building backend features using web frameworks, ORMs, and relational databases.Excellent communication skills, with the ability to collaborate effectively across teams.⭐ Bonus SkillsFamiliarity with full-stack technologies, including TypeScript, React, Next.js, Python, and PostgreSQL.Passion for writing technical blogs to position Onyx as a leader in the field.

About ApiphanyApiphany is an innovative AI company dedicated to advancing physical product development. We empower global leaders in industries such as automotive, aerospace, medtech, and energy to convert vast amounts of unstructured technical data into immediate, actionable insights. Supported by elite investors including Markforged, Databricks, GM, and Character, our mission is to transform engineering decision-making, simplifying complexity for the world's premier manufacturers.Our models are meticulously crafted to address the unique challenges of engineering and manufacturing. They are designed to comprehend principles of physics, design specifications, and program constraints. Our team is a select group of experts from prestigious institutions like Stanford, Berkeley, MIT, UW, and CMU, alongside veterans from GM, Ford, and Genesis Therapeutics. We are committed to redefining hard-tech and constructing a category-defining enterprise together.About the RoleAs a Machine Learning Engineer at Apiphany, you will architect and deploy cutting-edge machine learning models to address some of the most intricate challenges within the physical domain. You will create systems capable of reasoning with complex engineering data, developing AI that grasps physics, design limitations, and real-world performance trade-offs.This role is tailored for innovators eager to expand the horizons of AI applications in the tangible world.

Join Our Team as a Machine Learning Engineer for AssessmentsAt Speak, we're on a mission to transform the language learning experience.Learning a new language has the power to enrich lives, facilitating connections with diverse cultures, career opportunities, and communities. With two billion people worldwide engaged in language studies, the traditional one-on-one tutoring approach remains challenging to scale and has seen little innovation over the years. Speak is revolutionizing this space by offering an AI-powered, human-like tutoring experience that prioritizes conversation. Our platform allows learners to practice speaking, receive instant feedback, and progress through expertly crafted lessons, ensuring a seamless journey from beginner to confident speaker in multiple languages.Since our inception in South Korea in 2019, Speak has rapidly ascended to become the leading language learning app, serving learners across various markets with 15+ languages. Backed by over $150 million in venture funding from prominent investors such as OpenAI, Accel, and Khosla Ventures, our distributed team spans San Francisco, Seoul, Tokyo, Taipei, and Ljubljana.About the RoleWe are seeking a talented Machine Learning Engineer for Assessments to spearhead the development of top-tier assessment systems across our diverse product lines, including Speak for Business and B2C offerings. You will collaborate closely with our Assessment Design Lead, along with teams in Machine Learning, Product, and Engineering, to translate assessment frameworks and rubrics into robust, scalable scoring and feedback systems.This role will encompass the implementation, deployment, and continual enhancement of our assessment algorithms and ML systems. While immediate focus will be on refining and expanding current assessments, the work will also contribute to a foundational capability that can be leveraged across our platform.Your ResponsibilitiesLead the development of assessment ML systems end-to-endDesign, deploy, and maintain scoring models and pipelines (feature extraction, model training, inference, feedback generation).Oversee monitoring, regression tests, and iterative improvements to ensure accuracy standards are met.Establish and implement evaluation frameworksCreate validation and evaluation structures for assessments, incorporating metrics, test sets, and both offline and online analyses.Convert assessment needs into quantifiable acceptance criteria and safeguards.

About MercorMercor operates at the dynamic intersection of labor markets and artificial intelligence research. By collaborating with top-tier AI laboratories and enterprises, we provide the vital human intelligence needed for AI development.Our extensive network of over 30,000 experts trains cutting-edge AI models in a manner akin to educators nurturing students: through the exchange of knowledge, experience, and contextual insights that cannot be encoded. Collectively, our experts generate over $2 million in earnings each day.At Mercor, we're pioneering a new category of work where expertise fuels AI progression. This ambitious endeavor requires a fast-paced, dedicated team. You’ll collaborate with leading researchers, operators, and AI companies at the forefront of systems that are transforming society.As a profitable Series C company valued at $10 billion, we operate in-person five days a week at our state-of-the-art headquarters in San Francisco.

About KreaAt Krea, we are at the forefront of developing cutting-edge AI creative tools that enhance the capabilities of artists and creators. Our commitment is to ensure that these AI technologies are not just accessible but also intuitive, empowering creativity rather than overshadowing it.We envision AI as a transformative medium, facilitating self-expression across diverse formats including text, images, video, sound, and even 3D. Our goal is to innovate smarter, more controllable tools that effectively utilize this medium.The RoleWe are seeking a dedicated Machine Learning Engineer to spearhead large-scale training experiments focused on image and video models.Your Responsibilities:Train foundational diffusion models for advanced image and video generation.Develop and enhance controllability modules such as IPAdapters or ControlNets.Innovate research methodologies and transition them into production.Execute large-scale experiments on high-performance computing clusters, optimizing data pipelines for extensive image datasets.Preferred Experience and Skills:Demonstrated success in working with image or video models at scale, with publications or open-source contributions being advantageous.A robust background in deep learning frameworks and distributed training methodologies.Capacity to rapidly iterate and propose innovative research avenues.More About UsHaving raised over $83 million, we are supported by esteemed Silicon Valley investors, including Andreessen Horowitz and co-founders of the Meta AI Research laboratory, as well as founding members of OpenAI.

Join our innovative team at Osaro as a Machine Learning Engineer, where you will contribute to advancing the intelligence and capabilities of our robotic systems. Our cutting-edge products integrate advanced perception algorithms with adaptive decision-making and meticulous control strategies, empowering industrial robots to operate autonomously and efficiently across diverse applications.In this role, you will collaborate closely with our robotics, deployment, and sales teams to identify client requirements and design tailored machine learning solutions. You'll be responsible for monitoring, training, and validating the performance of our deep learning models, ensuring they meet our quality standards.We seek individuals who are not only passionate about their work but also take ownership of their projects and enjoy tackling new challenges. The ideal candidate is one who values teamwork and embodies integrity and directness in their communication.

About CasapCasap is an innovative Series A startup headquartered in San Francisco, having secured over $30 million in funding from prominent investors like Emergence, Lightspeed, and Primary Ventures. Founded by industry experts from Robinhood and Chime, our mission is to revolutionize banking operations through automation and combatting friendly fraud. Our solutions are appreciated by a diverse range of users, from everyday customers to leading financial institutions.We are currently seeking a passionate and skilled Machine Learning Engineer to join our dynamic team in San Francisco. This is an exciting opportunity to enhance banking operations with cutting-edge automation and Artificial Intelligence technologies.

Join Our Mission to Empower Communities! At GoFundMe, we are the leading global platform dedicated to helping people support each other. Since our inception in 2010, we've facilitated over $40 billion in fundraising, uniting individuals and nonprofits in a safe and engaging environment. We are seeking a passionate and experienced Senior Manager, Machine Learning Engineering to join our Applied Science team. In this pivotal role, you will spearhead a dynamic team tasked with creating impactful machine learning solutions that enhance user experiences and drive business growth. Your responsibilities will include designing, developing, and deploying cutting-edge services and applications utilizing advanced machine learning and AI methodologies, such as generative AI, personalized recommendations, search systems, and classification techniques. This position requires exemplary leadership capabilities to ensure both strategic vision and tactical execution, backed by your extensive knowledge of machine learning, AI, and secure software practices. This role is based in the vibrant San Francisco Bay Area, with an expectation of being in the office three times a week.

The Applied AI team at Databricks is at the forefront of pioneering GenAI-powered products. In recent years, we have successfully launched the Databricks Assistant, AI/BI Genie, and Agent Bricks, collaborating with product teams to significantly enhance LLM quality for these offerings. These innovations are utilized by hundreds of thousands of Databricks users daily. We are dedicated to solving complex challenges such as code suggestion, error detection and correction, text-to-SQL generation, automatic pipeline generation, and knowledge QA.As we continue to evolve our GenAI products, we are looking for multiple GenAI Engineers at various experience levels to lead the next phase of our development. Our goals for 2025 include improving LLM quality, broadening GenAI capabilities across Databricks products, and reinforcing our platform architecture to facilitate seamless AI interactions on a large scale.

Join LangChain as an Education Engineer!At LangChain, we are dedicated to making intelligent agents a fundamental aspect of everyday technology. Our mission is to empower developers by creating a robust foundation for agent engineering, enabling them to transition from initial concepts to production-ready AI agents that can be relied upon by teams across various industries.Initially launched as popular open-source tools, we have now expanded to provide a comprehensive platform for building, assessing, launching, and managing AI agents on a large scale. Our suite of tools, including LangChain, LangGraph, LangSmith, and Agent Builder, are trusted by developers at leading companies such as Replit, Clay, Coinbase, Workday, Lyft, Cloudflare, Harvey, Rippling, Vanta, and 35% of the Fortune 500.Having successfully secured $125M in Series B funding from top investors including IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures, we are in an exciting phase of product development and growth. Every team member has a meaningful role in shaping our technology and collaborative culture.About the Role: We are seeking an Education Engineer to facilitate the learning process for developers and agent builders in mastering the construction, evaluation, and refinement of agents utilizing LangSmith. You will transform advanced AI methodologies into engaging educational resources across various formats, ranging from online courses to interactive workshops and meetups.In collaboration with our Applied AI and engineering teams, you will create high-quality learning experiences that elucidate fundamental principles of agentic AI evaluation, monitoring, and iterative enhancement. By guiding developers through practical case studies and sharing best practices, you will contribute to the success of our community with LangChain tools. This hybrid role combines technical machine learning proficiency with a passion for education, community engagement, and effective communication.LangChain stands at the forefront of the industry with the leading platform for Agent Tracing, Evaluation, and Monitoring, complemented by a dynamic developer community. Your role will be pivotal in helping others understand and leverage these advantages in their projects.