Senior Machine Learning Engineer at Databricks | San Francisco

Join Databricks as a Senior Technical Marketing Engineer, where you will play a pivotal role in empowering developers and data teams to create data-native applications utilizing Lakebase and Databricks Apps. Lakebase offers a managed Postgres transactional layer for application state and operational workloads, while Databricks Apps enables the secure building and deployment of applications that operate close to governed data and models.In this impactful role, you will be responsible for guiding teams through the end-to-end project lifecycle, translating platform capabilities into actionable insights via demos, reference architectures, and technical content. You will collaborate closely with product, engineering, and field teams to ensure the successful application of Lakebase and Databricks Apps in real-world scenarios.

At Databricks, our Lakebase and Databricks Apps empower teams to create data-native applications where transactional data, analytics, and artificial intelligence coexist seamlessly. Lakebase offers a managed Postgres transactional layer for operational workloads, while Databricks Apps facilitate the development and deployment of secure applications that function close to governed data and models.This position reports directly to the Senior Director of Product Marketing and collaborates closely with product, engineering, and field teams. As the Senior Product Marketing Manager for Lakebase, you will lead product marketing initiatives targeting application developers and database owners, with an emphasis on Postgres-backed transactional workflows and data-native applications that integrate operational data, analytics, and AI. This pivotal role positions you as the subject matter expert in database marketing, guiding messaging, and overseeing go-to-market (GTM) strategies across various teams, including sales, partners, and marketing, to enhance the awareness and adoption of the Databricks Data Intelligence Platform.

P-1398 Note: This is a hybrid role requiring approximately 3 days in the office in Plano, TX. Mission: As a Staff Data & AI Technical Solutions Engineer, you will take the lead in developing and guiding others in crafting innovative Data & AI technical solutions for various customer issues. This includes an in-depth exploration of production data pipelines, AI workflows, streaming data ingestion, and more. You possess extensive expertise in Data & AI architectures, having encountered a diverse array of use cases while successfully managing intricate production environments in compliance with Service Level Agreements (SLAs). You will work collaboratively with product engineering and customer account teams to deliver exceptional results for customers, especially in critical production downtime scenarios. Your role is to empower customers with the knowledge and skills necessary to create efficient architectures and dependable services, leveraging Databricks’ platform to achieve their strategic goals. Reporting to a Technical Support Engineering manager, you are recognized as a technical authority within a leading global support engineering organization, celebrated for your leadership, technical knowledge, and ability to resolve even the most challenging customer situations. The impact you will have: Lead and direct technical solutions for a wide range of complex challenges reported by Databricks customers, including escalated and critical cases. Conduct comprehensive code-level analysis and systems architecture assessments of customer workloads to resolve issues related to Databricks products, including Spark core internals, Spark SQL, Delta, DLT, and Model Serving. Act as a customer support advisor, adept at diffusing escalations during incidents directly with customer stakeholders, swiftly identifying mitigations and solutions for advanced use cases, and strategically helping to avert future customer issues. Contribute to simplifying Databricks products and enhancing customer production environments' stability by influencing Engineering and Backline Support teams to identify areas for product improvements. Establish yourself as a deep technical expert and leader in the Databricks platform and production systems, mentoring others to share your expertise. What we look for: A minimum of 8 years of experience in designing, building, testing, and maintaining data pipelines, with relevant past experience in Spark being mandatory. Proficiency in SQL databases or data warehouses, among other technical skills.

Join Databricks as a Senior Backend Software Engineer and contribute to solving some of the world's most challenging problems. We empower data teams through our state-of-the-art data and AI infrastructure platform, enabling businesses to leverage deep data insights for transformative growth. At Databricks, founded by engineers and driven by a customer-first philosophy, we tackle technical challenges with enthusiasm — from designing next-gen UI/UX for data interfacing to scaling our services across millions of virtual machines.In this role, you will collaborate closely with your team to develop scalable infrastructure and innovative products for the Databricks platform.

As the Global GTM Enablement Leader at Databricks, you will spearhead the strategic vision to elevate our marketing capabilities across the globe. This pivotal role requires a deep understanding of adult learning principles, competency mapping, and performance measurement against vital business KPIs.Your mission is to construct an exceptional enablement framework that empowers every member of the Databricks Marketing team—from Field Marketing to Demand Generation—to achieve outstanding results. Moving beyond basic training sessions, you will collaborate with the business to foster a sustainable ecosystem of continuous learning, certification, and performance enhancement that sets the benchmark for GTM organizations.

At Databricks, we are committed to empowering organizations to unlock the full potential of data and artificial intelligence. Our goal is to create the premier platform for the development, deployment, and management of AI applications at scale, enabling our customers to leverage intelligent solutions to revolutionize their businesses.About Our Team:The Databricks AI team is pioneering how businesses utilize artificial intelligence. Our mission involves creating foundational capabilities that allow customers to build agents and models, manage intricate workflows, and integrate AI seamlessly into their data and applications. As the AI landscape evolves rapidly, our approach requires innovative thinking and the adaptability to navigate these changes. We are not merely creating features; we are fundamentally reshaping how the world interacts with AI.Your Impact:Shape the future of enterprise AI: Define and advance the vision of how Databricks empowers customers to harness generative AI, agents, and groundbreaking workloads.Transform breakthroughs into products: Collaborate with top-tier engineering and research teams to convert state-of-the-art AI innovations into reliable tools for millions.Expand possibilities for customers: Work closely with data and AI leaders to identify novel use cases and design products that make the previously unfeasible achievable and replicable.Be the voice of vision and execution: Inspire the roadmap from concept to launch, steering engineering efforts and articulating how Databricks AI transforms customer capabilities.Build for scale and longevity: Establish the strategies and principles that will guide Databricks AI for years to come, even as the industry undergoes rapid changes.

About UsAt Databricks, we are pioneering the future of GenAI observability and quality. Our innovative product empowers organizations with sophisticated monitoring and insights for GenAI systems, offering real-time visibility into performance and a comprehensive toolkit for enhancing system quality. Featuring cutting-edge functionalities such as real-time alerts, detailed logging, and anomaly detection, we enable our clients to swiftly identify and remedy issues impacting their GenAI systems. Join us to leverage next-generation tools for ongoing monitoring, testing, and feedback, while utilizing advanced technologies like AutoML/AutoRag, LLM fine-tuning, and Prompt Optimization to elevate the performance and quality of GenAI systems.We are seeking a motivated and skilled Senior Full-Stack Software Engineer to become an integral part of our vibrant team. This position offers the chance to engage in both front-end and back-end development, allowing you to manifest your strong product sense and UI/UX design skills. The ideal candidate will possess a proven history in full-stack development, with expertise in creating intuitive and engaging user interfaces, as well as architecting scalable and efficient backend systems.

Join the dynamic Industry and Solutions Marketing team at Databricks as a Senior Industry Marketing Manager specializing in the Energy sector. Our mission is to effectively connect innovative technology with essential business needs through impactful industry messaging and tailored solutions. This strategic role demands a collaborative approach, working closely with various departments to drive demand within key industries.In this pivotal position, you will spearhead the development of messaging, content, and go-to-market strategies specifically for the Energy vertical. Collaborating with sales teams and our clientele, you'll design awareness and demand generation initiatives that align with our pipeline objectives. Your contributions will also include creating thought leadership content such as editorials, blogs, white papers, and participating in industry and partner events. This role reports directly to the head of industry solutions marketing.We seek candidates with a solid track record in the Energy sector, paired with a deep understanding of technology and relevant use cases. Ideal applicants will demonstrate broad industry knowledge and possess a strong perspective shaped by interactions with customers and partners about future trends. Additionally, experience in developing strategies to engage a range of energy personas, from practitioners to decision-makers, is essential.

Join Databricks as a Senior Industry Marketing Manager in our Financial Services marketing team, focusing on pivotal subverticals including retail banking, capital markets, and insurance. Our mission is to seamlessly connect technology with business needs through impactful industry messaging and solutions. This role requires a strategic mindset and a collaborative approach, working alongside various functions to deepen our presence in one of our largest markets. As the Senior Industry Marketing Manager, you will spearhead messaging, content creation, and go-to-market strategies within the Financial Services segment. Collaborating with sales teams, fellow marketers, and clients, you will drive awareness, generate demand, and create sales enablement programs that meet pipeline objectives. Your role will also involve producing thought leadership materials such as editorials, blogs, white papers, and participating in industry events and partnerships. The ideal candidate will possess a proven track record within the Financial Services sector, a solid understanding of technology, and deep expertise in relevant use cases and solutions. You should have a comprehensive grasp of the industry landscape and insights gained from working closely with clients and partners. Additionally, experience in crafting strategies that engage a variety of financial services personas—from practitioners to decision-makers—is crucial.

Join Databricks as a Director of Engineering GovernanceAt Databricks, we are the Lakehouse company, empowering over 7,000 organizations globally—including industry leaders like Comcast, Condé Nast, and H&M—to harness the power of data, analytics, and AI through our innovative Lakehouse Platform. Our headquarters is located in San Francisco, with a dynamic presence around the world.Founded by the original creators of Apache Spark™, Delta Lake, and MLflow, our mission is clear: to assist data teams in tackling the world's most challenging problems. Learn more about us on Twitter, LinkedIn, and Facebook.To discover more, visit www.databricks.com.About the TeamWe are on the lookout for a highly skilled and influential Director of Engineering Governance to lead our efforts in integrating security, privacy, and responsible data practices into the core of Databricks’ products and infrastructure. This role goes beyond merely managing programs; it involves architecting and scaling robust engineering platforms and operating models that foster secure and compliant product development across a rapidly evolving, multi-cloud ecosystem.In this strategic, hands-on leadership position, you will guide a talented team of senior security engineers, collaborate with product and infrastructure leaders, and establish foundational governance systems that empower Databricks to innovate swiftly while maintaining top-tier security and customer trust.

At Databricks, we are driven by a commitment to empower data teams in overcoming the world's most complex challenges, from realizing the next generation of transportation to expediting groundbreaking medical innovations. Our mission is fulfilled through the development and operation of the premier data and AI infrastructure platform, enabling our clients to harness profound data insights to enhance their enterprises. Founded by engineers with a customer-centric mindset, we eagerly embrace every chance to confront technical challenges – whether it's crafting next-gen UI/UX for data interaction or scaling our services and infrastructure across a multitude of virtual machines. About Our Team: Delivering a stellar platform necessitates an outstanding developer experience. The Databricks Repos team lays the groundwork for source control and workflow, facilitating how data engineers, machine learning experts, and analysts manage code, collaborate with peers, and deploy data and AI applications into production. Our team enhances the version control experience within Databricks, delineating user interactions with Git providers, code change management, lineage tracking, pull request evaluation, and code promotion into jobs, pipelines, and deployments. We are dedicated to crafting a seamless, reliable, AI-native workflow that merges the best practices of Git-style development with the specific requirements of data and AI teams. Our goal is to offer an effortless journey from authoring to production across notebooks, SQL, Python, and Lakeflow, all within a unified platform. In this role, you will spearhead the vision and roadmap for Databricks Repos, determining how developers create, test, review, and deploy code within our ecosystem. Collaborating with the Workflows, Notebooks, Lakeflow, Data Management, and broader Developer Experience teams, you will deliver an integrated and user-friendly path to production. Your Impact: Design the comprehensive production experience for data and AI teams, encompassing authoring, Git integration, and CI/CD processes. Define integration strategies for Repos with GitHub, GitLab, and Azure DevOps, promoting seamless branching, pull requests, reviews, conflict resolution, and deployment workflows. Collaborate with engineers to develop AI-assisted code management features, including automated code suggestions, recommended diffs, merge assistance, and deployment validation. Act as the voice of the customer, translating user feedback into workflow enhancements that simplify source control and release management. Boost developer productivity and reliability by aligning Repos with Databricks Workflows, Lakeflow, and deployment mechanisms. Facilitate the growth of Databricks adoption.

At Databricks, we are driven by our mission to empower data teams to tackle the world's most challenging problems—whether it's realizing the next mode of transportation or accelerating medical advancements. Our dedication is to build and operate the premier Data and AI infrastructure platform, enabling our clients to harness deep insights from data to enhance their operations. We are on the lookout for a Senior Engineering Manager to join our Photon team, playing a pivotal role in defining the next generation of ultra-fast, scalable data processing solutions. In this role, you will lead a team of exceptional engineers working on Photon—the innovative query engine that powers Databricks' groundbreaking Lakehouse Platform. This is a unique opportunity to drive innovation on a grand scale, optimize data systems for tangible results, and collaborate with top experts in query optimization, execution, storage, and large-scale analytics. If you are passionate about empowering teams, architecting groundbreaking technologies, and accelerating analytics for millions of users, we invite you to join our team.

P-1125 At Databricks, we are passionate about empowering data teams to tackle the world’s most challenging problems, ranging from security threat detection to advancing cancer drug development. Our mission is to build and operate the leading data and AI infrastructure platform, allowing our customers to concentrate on the critical challenges central to their missions. Our engineering teams are dedicated to creating highly sophisticated products that address vital needs in the world. We relentlessly push the boundaries of data and AI technology while ensuring resilience, security, and scalability that are essential for our customers' success on our platform. Customers place their utmost trust in Databricks with their most valuable data, and our Trust & Safety team is committed to developing the most reliable data analytics and machine learning platform globally. The customer journey on our platform begins with Authentication, and we are seeking senior leaders like you to shape the vision and define the strategy for this critical area. Your Impact: Establish and implement a long-term vision for Authentication that harmonizes robust security with a seamless user experience. Attract and mentor elite engineering talent to enhance our security infrastructure. Serve as the advocate for Security Engineering across the organization, influencing data-driven decisions at the executive level. Showcase Databricks’ security innovations at prominent academic and industry conferences. What We Seek: 10+ years of experience in Data Security or related fields, with expertise in two or more areas such as Authentication, Network Security, Kubernetes Security, Web Security, Governance, Privacy, Trust, Safety, Identity Management, Access Control, Key Management, Inter-Service Authentication, Secure Application Frameworks, and Detection & Response. Experience in building systems for large-scale internet enterprises is a significant advantage. 15+ years of experience in developing large-scale distributed systems with high availability. Proven leadership skills to guide efforts across functional and organizational boundaries. Exceptional communication abilities to articulate and advocate for Data Security to senior leadership throughout the organization. A proactive mindset with a strong commitment to delivering high-quality solutions. Master’s or Ph.D. in Computer Science or a related discipline. This position is open to remote candidates.

P-150 At Databricks, we are dedicated to empowering data teams to tackle some of the world's most challenging problems, ranging from security threat detection to the development of cancer treatments. We achieve this by creating and managing the leading data and AI infrastructure platform, allowing our clients to concentrate on the high-value challenges central to their missions. Founded in 2013 by the original creators of Apache Spark™, Databricks has evolved from a modest office in Berkeley, California, to a global enterprise with over 1000 employees. Our platform is trusted by thousands of organizations, from startups to Fortune 100 companies, establishing us as one of the fastest-growing SaaS firms worldwide. Our engineering teams design and develop highly technical products that meet significant real-world needs. We continually push the limits of data and AI technology while maintaining the resilience, security, and scalability essential for our customers' success on our platform. We operate one of the largest-scale software platforms, comprising millions of virtual machines that generate terabytes of logs and process exabytes of data daily. Given our scale, we frequently encounter cloud hardware, network, and operating system faults, and our software must effectively shield our customers from any disruptions. As a Software Engineer focused on backend development, you will collaborate closely with your team and product management to prioritize, design, implement, test, and operate microservices for the Databricks platform and products. This role includes writing software in Scala/Java, building data pipelines using Apache Spark™ and Apache Kafka, integrating with third-party applications, and interacting with cloud APIs such as AWS, Azure, CloudFormation, and Terraform. Below are examples of teams you can join: Data Science and Machine Learning Infrastructure: Develop services and infrastructure that bridge the gap between machine learning and distributed systems. Our technology supports flagship collaborative workspaces, notebooks, IDE integrations, and project management tools. We also facilitate large-scale machine learning through environment management, distributed training, and lifecycle management via MLflow. Compute Fabric: Construct the resource management infrastructure that supports all big data and machine learning workloads on the Databricks platform in a robust, flexible, secure, and cloud-agnostic manner. This software oversees millions of virtual machines.

Are you a dedicated Developer Advocate with a passion for bridging the gap between technology and the developer community? If you thrive on connecting with others, hosting engaging events, and diving into the nuances of application development and developer experience, we want to hear from you!As a Senior Developer Advocate at Databricks on the Neon DevRel team, you'll play a pivotal role in linking our engineering teams with an expanding community of application and agent developers utilizing Postgres and Neon. Your technical acumen will be essential in maintaining and enhancing our SDKs, educating users, and shaping the future of Agent and Developer Experience (AX & DX) for Neon.Developer experience will be central to your responsibilities. You will help enhance our TypeScript SDK and CLI, manage Neon’s MCP server, and develop other developer-oriented tools, all while keeping ahead of the evolving AI landscape. Your expertise in DevTools and AX will be shared through presentations, meetups, blog articles, videos, and community interactions, empowering developers to build more effectively with Neon and demonstrating our commitment to exceptional Developer Experience (DX) and Agent Experience (AX).Collaboration will be key as you work closely with the neon.com community, product teams, and engineering staff, ensuring that developer feedback directly influences product direction. You'll also partner with fellow advocates, program managers, and the broader Databricks DevRel organization to create a cohesive and impactful strategy for agent experiences.The ideal candidate will embody the core values of our DevRel team: a profound enthusiasm for application development, strong empathy for developer needs, and the ability to convey complex concepts with clarity and effectiveness.In this role, you’ll foster and expand the Neon community through top-notch technical content and hands-on experiences, continuously feeding insights back into the product to further enhance the developer experience.

Join our dynamic team at Databricks as a Senior Financial Analyst, where you'll play a pivotal role in shaping our financial strategy and enhancing our decision-making processes. This is an exciting opportunity for finance professionals who are passionate about leveraging data to drive business success.

P-1011 Job Location: San Francisco Bay Area, CA As a Senior Staff Technical Solutions Engineer and a recognized technical expert, you will collaborate closely with our Field and Engineering teams to provide exceptional, specialized support and customized technical solutions for Databricks' most significant and strategic clients in the Digital Native Business (DNB) segment. In this client-facing position, you will apply your technical knowledge of Apache Spark™ and other data technologies to diagnose and resolve intricate product issues and help remove obstacles for our customers' most pressing technical challenges. The Impact You Will Have Conduct advanced troubleshooting and root cause analysis to resolve performance and reliability issues in Spark, SQL, Delta, Streaming, and Databricks runtime features using tools like Spark UI metrics, Mosaic AI Model Service, Directed Acyclic Graphs (DAGs), and event logs. Identify requirements for continuous monitoring to proactively detect performance issues while collaborating with R&D and NOC teams to optimize customer environments within the DNB segment. Create rapid Proof of Concepts (POCs), test, deploy, and monitor solutions developed by Databricks Engineering to tackle customer challenges and demonstrate advanced Spark/ML/AI runtime capabilities in alignment with their business objectives. Compile extensive playbooks and maintain a knowledge base of common issues and solutions regarding Spark, ML, and AI workflows. Educate customer engineering and business teams on best practices in performance tuning, debugging, and effectively utilizing Databricks Features. Pilot and advocate for new best practices, champion process enhancements, and collaborate with cross-functional teams to improve the overall customer experience. Act as an advocate for customers during business review meetings and maintain close relationships as a trusted advisor and primary technical point of contact. Work onsite with Field Engineering, Sales, and Product teams during customer interactions and technical presentations to deliver swift resolutions to production-impacting issues, showcasing deep technical expertise and fostering strong customer trust.

The Applied AI team at Databricks is at the forefront of pioneering GenAI-powered products. In recent years, we have successfully launched the Databricks Assistant, AI/BI Genie, and Agent Bricks, collaborating with product teams to significantly enhance LLM quality for these offerings. These innovations are utilized by hundreds of thousands of Databricks users daily. We are dedicated to solving complex challenges such as code suggestion, error detection and correction, text-to-SQL generation, automatic pipeline generation, and knowledge QA.As we continue to evolve our GenAI products, we are looking for multiple GenAI Engineers at various experience levels to lead the next phase of our development. Our goals for 2025 include improving LLM quality, broadening GenAI capabilities across Databricks products, and reinforcing our platform architecture to facilitate seamless AI interactions on a large scale.

Location: San Francisco, Bellevue, AmsterdamRole Overview: Are you a well-respected technical authority in Generative AI and MLOps, eager to shape the future of production AI Agentic Systems? This Senior Developer Advocate position offers a unique opportunity to take strategic ownership over developer engagement and technical discussions surrounding Agent Bricks on the Databricks Data Intelligence Platform.As a vital link between our engineering teams and the global developer community, you will enhance the careers of data scientists and AI engineers by integrating advanced research, customer insights, and best practices into scalable, production-ready reference implementations, presentations, and demos. You will play a key role in fostering a global community for AI Agentic workflows and LLMOps, with a particular focus on MLflow and Agentic System governance.More About The DevRel TeamAt Databricks, we are dedicated to empowering data and AI teams to tackle the world's toughest challenges. Our mission in Developer Relations (DevRel) is to support data practitioners, data scientists, and the wider developer ecosystem by building vibrant communities, creating exceptional content, and nurturing a truly reciprocal relationship with our users. Our primary goal is to drive awareness and adoption of the Databricks Data Intelligence Platform.The Impact You Will HaveYou will utilize your technical expertise, community-building capabilities, and market insights to drive awareness and adoption, establishing Databricks as the premier technical leader in enterprise AI governance and Agentic Systems.Strategic Roadmap Ownership: Develop and implement the global technical advocacy strategy and roadmap for a critical aspect of Databricks AI Agentic Systems (e.g., RAG Architectures, AI Agent Evaluation, or LLM Governance), ensuring alignment with product objectives and measurable metrics.Evangelism: Collaborate with field AI engineers to design and deploy production-grade reference implementations and create impactful live demonstrations that address real-world enterprise GenAI challenges, highlighting best practices in performance, evaluation, and security. You will advocate for Agent Bricks as the definitive solution to 'Take your AI to your Data.'Technical Content Scaling: Produce high-quality, actionable educational resources, including comprehensive course materials and documentation.