Senior Backend Software Engineer at Databricks | San Francisco

P-1398 Note: This is a hybrid role requiring approximately 3 days in the office in Plano, TX. Mission: As a Staff Data & AI Technical Solutions Engineer, you will take the lead in developing and guiding others in crafting innovative Data & AI technical solutions for various customer issues. This includes an in-depth exploration of production data pipelines, AI workflows, streaming data ingestion, and more. You possess extensive expertise in Data & AI architectures, having encountered a diverse array of use cases while successfully managing intricate production environments in compliance with Service Level Agreements (SLAs). You will work collaboratively with product engineering and customer account teams to deliver exceptional results for customers, especially in critical production downtime scenarios. Your role is to empower customers with the knowledge and skills necessary to create efficient architectures and dependable services, leveraging Databricks’ platform to achieve their strategic goals. Reporting to a Technical Support Engineering manager, you are recognized as a technical authority within a leading global support engineering organization, celebrated for your leadership, technical knowledge, and ability to resolve even the most challenging customer situations. The impact you will have: Lead and direct technical solutions for a wide range of complex challenges reported by Databricks customers, including escalated and critical cases. Conduct comprehensive code-level analysis and systems architecture assessments of customer workloads to resolve issues related to Databricks products, including Spark core internals, Spark SQL, Delta, DLT, and Model Serving. Act as a customer support advisor, adept at diffusing escalations during incidents directly with customer stakeholders, swiftly identifying mitigations and solutions for advanced use cases, and strategically helping to avert future customer issues. Contribute to simplifying Databricks products and enhancing customer production environments' stability by influencing Engineering and Backline Support teams to identify areas for product improvements. Establish yourself as a deep technical expert and leader in the Databricks platform and production systems, mentoring others to share your expertise. What we look for: A minimum of 8 years of experience in designing, building, testing, and maintaining data pipelines, with relevant past experience in Spark being mandatory. Proficiency in SQL databases or data warehouses, among other technical skills.

At Databricks, our passion lies in empowering data teams to tackle some of the most challenging problems globally, from detecting security threats to advancing cancer drug development. We achieve this by creating and operating the world's premier Data Intelligence Platform, enabling our customers to concentrate on high-value challenges central to their missions. Founded in 2013 by the original creators of Apache Spark, Databricks has evolved from a small office in Berkeley, California, into a global powerhouse with over 1000 employees. We are trusted by thousands of organizations—from small startups to Fortune 100 companies—with their mission-critical workloads, establishing us as one of the fastest-growing SaaS companies worldwide. Our engineering teams are dedicated to developing highly technical products that address real-world needs. We continuously push the limits of data and AI technology while maintaining the resilience, security, and scalability crucial for our customers' success on our platform. Operating one of the largest-scale software platforms, our infrastructure comprises millions of virtual machines that generate terabytes of logs and process exabytes of data daily. At this scale, we routinely encounter cloud hardware, network, and operating system faults, and our software is designed to shield our customers from such issues effectively. As a Data Scientist on the Data Team, you will play a pivotal role in fostering a data-driven culture within Databricks by addressing product and business challenges. The Data Team serves as an internal, production 'customer' that utilizes Databricks and influences the future trajectory of our products. Your Impact: Steer the direction of key data science initiatives including segmentation, recommendation systems, forecasting, product analytics, churn prediction, and insights. Collaborate closely with Engineering, Product Management, Sales, and Customer Success to discern product usage patterns and trends, facilitating data-driven decisions, recommendations, and forecasts. Manage stakeholder expectations in your focus area—gather evolving requirements, define project OKRs and milestones, and effectively communicate progress and results to non-technical audiences. Mentor and support junior data scientists within the team, assisting with project planning, technical decisions, and conducting code and documentation reviews. Advocate for the data science discipline across the organization, amplifying our commitment to becoming more data-driven. Develop self-service internal data products to simplify data access within the company. Represent Databricks at academic and industry conferences and events.

P-150 At Databricks, we are dedicated to empowering data teams to tackle some of the world's most challenging problems, ranging from security threat detection to the development of cancer treatments. We achieve this by creating and managing the leading data and AI infrastructure platform, allowing our clients to concentrate on the high-value challenges central to their missions. Founded in 2013 by the original creators of Apache Spark™, Databricks has evolved from a modest office in Berkeley, California, to a global enterprise with over 1000 employees. Our platform is trusted by thousands of organizations, from startups to Fortune 100 companies, establishing us as one of the fastest-growing SaaS firms worldwide. Our engineering teams design and develop highly technical products that meet significant real-world needs. We continually push the limits of data and AI technology while maintaining the resilience, security, and scalability essential for our customers' success on our platform. We operate one of the largest-scale software platforms, comprising millions of virtual machines that generate terabytes of logs and process exabytes of data daily. Given our scale, we frequently encounter cloud hardware, network, and operating system faults, and our software must effectively shield our customers from any disruptions. As a Software Engineer focused on backend development, you will collaborate closely with your team and product management to prioritize, design, implement, test, and operate microservices for the Databricks platform and products. This role includes writing software in Scala/Java, building data pipelines using Apache Spark™ and Apache Kafka, integrating with third-party applications, and interacting with cloud APIs such as AWS, Azure, CloudFormation, and Terraform. Below are examples of teams you can join: Data Science and Machine Learning Infrastructure: Develop services and infrastructure that bridge the gap between machine learning and distributed systems. Our technology supports flagship collaborative workspaces, notebooks, IDE integrations, and project management tools. We also facilitate large-scale machine learning through environment management, distributed training, and lifecycle management via MLflow. Compute Fabric: Construct the resource management infrastructure that supports all big data and machine learning workloads on the Databricks platform in a robust, flexible, secure, and cloud-agnostic manner. This software oversees millions of virtual machines.

Location: San Francisco Bay Area, California REQ ID FEQ127R103 Mission Join our team as a Solutions Architect, where you will play a pivotal role in empowering large enterprises to harness the full potential of their data. Collaborating closely with the Enterprise Account Executive (AE), you will define and implement the technical strategy for our most significant accounts, driving deeper and wider adoption of machine learning (ML) and artificial intelligence (AI) solutions. Your expertise in value-based selling, technical account management, and leadership will be key in maximizing client success. You will work alongside a dedicated team that builds proofs of concept and showcases Databricks' innovative products. A strong technical understanding of ML and AI applications across various use cases relevant to the High Tech and Manufacturing sectors is essential. Outcomes Act as the primary technical voice for Databricks across multiple clients. Guide customers through a transformational journey, facilitating their evaluation and adoption of Databricks solutions. Implement tailored technical strategies within accounts based on a deep understanding of their needs. Foster a network of technical champions within client organizations. Align technical strategies with Databricks solutions effectively. Provide structured mentorship to enhance the skills of team members. Earn respect from peers through your experience, insights, and contributions. Competencies: Expertise in establishing and leading virtual teams to achieve success within client accounts. Experience managing large global accounts with an annual recurring revenue (ARR) exceeding $1 million. Ability to build relationships with executives and key influencers. Skill in presenting persuasive viewpoints to decision-makers, steering them toward successful outcomes. Strong technical background in big data, data science, and cloud technologies. Proven ability to drive data-driven business transformation. Programming experience in Python, R, Scala, or Java. Preferred: Databricks Certification.

The Applied AI team at Databricks is at the forefront of pioneering GenAI-powered products. In recent years, we have successfully launched the Databricks Assistant, AI/BI Genie, and Agent Bricks, collaborating with product teams to significantly enhance LLM quality for these offerings. These innovations are utilized by hundreds of thousands of Databricks users daily. We are dedicated to solving complex challenges such as code suggestion, error detection and correction, text-to-SQL generation, automatic pipeline generation, and knowledge QA.As we continue to evolve our GenAI products, we are looking for multiple GenAI Engineers at various experience levels to lead the next phase of our development. Our goals for 2025 include improving LLM quality, broadening GenAI capabilities across Databricks products, and reinforcing our platform architecture to facilitate seamless AI interactions on a large scale.

The Applied AI team at Databricks is dedicated to pioneering advancements in GenAI-driven products. In recent years, we have successfully launched notable innovations such as the Databricks Assistant, AI/BI Genie, and Agent Bricks. These products are utilized by hundreds of thousands of Databricks users daily. We are addressing complex challenges such as code suggestions, error detection and correction, text-to-SQL generation, automatic pipeline creation, and knowledge QA. As our GenAI products continue to advance, we are on the lookout for multiple GenAI Engineers, ranging from junior to senior levels, to spearhead the next phase of development. In 2025, our focus will be on enhancing the quality of LLMs, broadening GenAI functionalities across Databricks products, and fortifying our platform architecture to facilitate seamless AI interactions at scale.

Join Databricks as a Senior Product Manager for Unity Catalog, where we are dedicated to empowering data teams to tackle the world's most pressing challenges. Our innovative data and AI infrastructure platform is designed to help customers harness deep insights to enhance their business operations. Founded by engineers and driven by customer feedback, we eagerly take on technical challenges, from crafting next-gen UI/UX for data interaction to scaling our services across millions of virtual machines.In this role, you will oversee all product activities for Unity Catalog, the foundational metadata and governance layer for the Lakehouse. This includes implementing fine-grained security, governance capabilities, and productivity features like data lineage, search, discovery, auditing, and compliance for our customers' data and AI assets.Your responsibilities will involve coordinating product vision to implementation, engaging with large enterprise clients to ascertain their needs, developing strategic product roadmaps, collaborating with engineering to bring products to life, and liaising with various internal stakeholders to ensure successful product outcomes.Your Impact:Design and implement new governance and security features as part of Unity Catalog.Define and develop platform services that empower Databricks’ data & AI product teams, including ML/AI, Data Science & Engineering, and Data Warehousing, to seamlessly integrate workload-specific governance enhancements.Drive the lifecycle of new features from ideation through customer engagement to launch, including marketing strategies and ensuring broad customer adoption across all segments.Provide insights on the data governance landscape, customer needs, and market trends to engineering and leadership teams through close collaboration with customers and partners.

Join Databricks as a Staff Backline Engineer specializing in Data & AI. In this pivotal role, you will be responsible for providing comprehensive support to our clients on data and AI platforms, ensuring they leverage our technology to its fullest potential. You will collaborate with cross-functional teams to troubleshoot issues, optimize performance, and contribute to the overall success of our clients’ projects. If you are passionate about data engineering and artificial intelligence, and you thrive in a dynamic environment, we want to hear from you!

At Databricks, we are driven by our mission to empower data teams to tackle the world's most challenging problems—whether it's realizing the next mode of transportation or accelerating medical advancements. Our dedication is to build and operate the premier Data and AI infrastructure platform, enabling our clients to harness deep insights from data to enhance their operations. We are on the lookout for a Senior Engineering Manager to join our Photon team, playing a pivotal role in defining the next generation of ultra-fast, scalable data processing solutions. In this role, you will lead a team of exceptional engineers working on Photon—the innovative query engine that powers Databricks' groundbreaking Lakehouse Platform. This is a unique opportunity to drive innovation on a grand scale, optimize data systems for tangible results, and collaborate with top experts in query optimization, execution, storage, and large-scale analytics. If you are passionate about empowering teams, architecting groundbreaking technologies, and accelerating analytics for millions of users, we invite you to join our team.

About This Role Join Databricks as a Software Engineer focused on GenAI inference, where you will play a pivotal role in designing, developing, and enhancing the inference engine that drives our Foundation Model API. Collaborating at the intersection of research and production, you will ensure our large language model (LLM) serving systems are optimized for speed, scalability, and efficiency. Your contributions will span the entire GenAI inference stack, from kernels and runtimes to orchestration and memory management. What You Will Do Participate in the design and implementation of the inference engine, collaborating on a model-serving stack tailored for large-scale LLM inference. Work closely with researchers to integrate new model architectures or features such as sparsity, activation compression, and mixture-of-experts into the engine. Optimize latency, throughput, memory efficiency, and hardware utilization across GPUs and other accelerators. Build and maintain tools for instrumentation, profiling, and tracing to identify bottlenecks and inform optimization efforts. Develop scalable routing, batching, scheduling, memory management, and dynamic loading mechanisms for inference workloads. Ensure reliability, reproducibility, and fault tolerance in inference pipelines, including A/B launches, rollback, and model versioning. Integrate with federated and distributed inference infrastructure, orchestrating across nodes, balancing load, and managing communication overhead. Engage in cross-functional collaboration with platform engineers, cloud infrastructure, and security/compliance teams. Document and share insights, contributing to internal best practices and open-source initiatives as appropriate.

Join David AI as a Staff Product EngineerAt David AI, we are pioneering the field of audio data research, applying a rigorous R&D methodology to create robust datasets that empower AI models. Our vision is to integrate AI seamlessly into daily life, with audio serving as the key medium. As the demand for high-quality training data grows, we position ourselves as the solution.Founded in 2024 by a team of seasoned engineers from Scale AI, we quickly garnered the trust of leading FAANG companies and AI labs. Our recent $50M Series B funding round was led by prestigious investors including Meritech and NVIDIA, underscoring our potential in the audio AI landscape.We pride ourselves on our dynamic, collaborative, and ambitious team, and we are on the lookout for exceptional talent in research, engineering, product, and operations to help us redefine audio AI.About Our Engineering TeamOur engineering team is at the forefront of innovation, building the infrastructure, platforms, and models that convert raw audio into valuable data for top-tier AI labs and enterprises. We are a close-knit group of product engineers, infrastructure experts, and machine learning specialists who are dedicated to establishing the first-ever audio data research organization.We operate with agility, taking ownership of our projects from inception to deployment, delivering production-ready solutions on a daily basis. Our engineers design real-time pipelines that manage vast amounts of speech data while deploying advanced generative audio models.Your RoleAs a Staff Product Engineer, you will spearhead our Product Engineering team, developing state-of-the-art products that enable our clients to harness audio data effectively for model training. You will collaborate with researchers to continually refine our data collection methodologies.Your ResponsibilitiesLead the development of full-stack features, rapidly iterating to deliver daily innovations to our users.Construct scalable systems that process terabytes of audio data and extract actionable insights.Deploy and assess LLM- and DSP-based solutions to enhance customer understanding of their data.Facilitate research iterations and deployment interfaces for data collection in collaboration with researchers and operations.

About RoxRox is pioneering an AI-native revenue operating system designed specifically for modern go-to-market teams. Supported by notable investors such as Sequoia, GV, and General Catalyst, we are collaborating with ambitious enterprise teams to transform fragmented CRM workflows into intelligent, autonomous systems. Rox seamlessly integrates data across the GTM stack, deploys AI agents for tangible tasks, and equips revenue leaders with a clear, unified view of the key drivers of success.As a nimble Series A startup, we are challenging one of the most established categories in software—achieving victory through a blend of deep technical expertise and an unwavering focus on utility.About the Solutions Engineering TeamAt Rox, the Solutions Engineering team is not merely a support function; it plays a crucial role in shaping products and defining deals. This team operates at the intersection of Sales, Product, and Engineering, tasked with translating Rox’s technical capabilities into compelling customer value.You will join the foundational team in San Francisco, reporting directly to our Solutions Engineering leader. Working alongside three current Solutions Engineers, you will help establish how this function scales in SF. The practices you develop—such as how we demo, scope, integrate, and sell—will serve as the blueprint for the future of the company.About the RoleThis is a founding-level Solutions Engineer role for individuals who are technical, customer-focused, and passionate about redefining the sales engineering landscape.Your responsibilities will involve engaging directly with live deals: conducting technical discovery, crafting integrations, and leading demonstrations that clearly illustrate how Rox fits within customers’ data and GTM environments. This role transcends mere execution; you will identify inefficiencies in the sales process and implement improvements—enhancing demo experiences, refining technical narratives, and setting higher standards for those who follow.If you thrive on being the go-to person who can delve deeply into technical aspects while simplifying complexity for others, this role is tailored for you.What You’ll DoQuickly become a product expert, gaining deep insights into Rox’s architecture, use cases, and customer workflows.Collaborate closely with Sales to deliver impactful technical demos and support deals from initial contact to closure.Design and articulate integrations across data warehouses, CRMs, AI agents, and contemporary GTM tools.Facilitate technical discovery discussions that uncover genuine customer challenges rather than just stated requirements.Translate complex technical information into easily digestible insights for stakeholders.

About Us At Databricks, we are dedicated to empowering data teams to tackle some of the most significant challenges faced in the world today—from transforming transportation to fast-tracking medical innovations. Our mission is realized through the creation and management of the most advanced data and AI infrastructure platform, enabling our clients to harness profound data insights to enhance their operations. Founded by engineers with a relentless focus on customer success, we eagerly embrace every opportunity to solve complex technical challenges, whether it’s designing cutting-edge UI/UX for data interaction or scaling our services across millions of virtual machines. Our journey has only just begun. Our AI-driven Assistant is the first point of contact for customers seeking guidance on effectively utilizing our platform. The goal of the Customer Engagement and Docs platform team is to expedite problem resolution for our customers using AI and Large Language Models (LLMs). We aim to provide clients with accurate and comprehensive solutions to their inquiries or create experiences that facilitate a smooth transition to a support agent when necessary. As a Staff Engineer, you will work at the crossroads of Product Development and Machine Learning. Your responsibilities will include deeply understanding user behavior, identifying root causes of issues, and leveraging Product, Machine Learning (ML), and LLMs to analyze complex technical scenarios within a secure enterprise environment, ultimately paving the way to their resolution.

Role Overview The Business Intelligence Manager at Databricks shapes how business users interact with data and AI on the Databricks platform. This role focuses on building secure, interactive applications that help teams turn raw data into practical insights. The position is based in New York or San Francisco. What You Will Do Build: Design and develop frontend interfaces and API backends. This includes setting up FastAPI to route user queries to model-serving endpoints, and delivering solutions from data dashboards to enterprise chat tools using the Mosaic AI Agent Framework. Architect: Create secure, scalable application architectures that support custom SaaS offerings and meet go-to-market needs. Scale: Develop applications that connect to Databricks SQL through the Statement Execution API or Databricks SDK. Set up CI/CD pipelines with Declarative Automation Bundles (DABs) to automate deployments across development, staging, and production. Key Technologies Streamlit React FastAPI Databricks Apps serverless infrastructure Locations New York San Francisco, California

About SpotOnAt SpotOn, we are revolutionizing the restaurant industry by providing independent restaurants with cutting-edge technology to thrive in a competitive market. From our award-winning point-of-sale systems to advanced AI-driven profit enhancement tools, every solution we offer empowers operators to increase profitability, optimize operations, and retain top talent. Our commitment to our clients is backed by a dedicated team that genuinely cares about their success.Ranked #1 Restaurant POS by G2 (Fall 2025), based on user feedbackRecognized as the top-rated point-of-sale (POS) for restaurants, bars, retail, and small businesses by Capterra usersHonored as a Great Place to Work and recipient of Built In’s Best Workplaces awards for consecutive yearsWe prioritize agility, empathy, and advocacy for independent restaurant operators, allowing them to focus on their passion. If you aspire to make a meaningful impact with dedication and drive, SpotOn is your ideal workplace.About the Accelerate TeamThe Accelerate team, consisting of five skilled engineers, is dedicated to redefining software development within the fintech realm through AI-native engineering practices. With direct support from senior leadership and defined project goals, we are committed to setting new industry standards in software building.We are seeking a Staff/Principal Individual Contributor (IC) with proven experience in AI-assisted engineering at scale. This is not a role for the AI-curious; you are someone who integrates AI into coding daily. You have developed agents that deliver tangible results. Your insights on model selection, agent limitations, and effective guardrails are backed by real-world experience. You are eager to apply what you’ve learned on a larger scale.As the most senior technical AI expert on the team, you will be the go-to person for architectural guidance, tackling complex challenges, and establishing technical benchmarks.The Role: Technical Lead, Not ManagerThis position is not about merely setting up CI/CD pipelines or integrating Copilot. You are the architect behind the systems that transform how SpotOn engineers develop software. You will:Establish yourself as the technical authority in AI engineering. You will define the standards for AI utilization in code generation, review, testing, and task automation. Your focus will be on designing systems, workflows, and guardrails that ensure AI-aided development is safe, measurable, and scalable in a PCI-compliant environment.

About Liquid AIFounded as a spin-off from MIT CSAIL, Liquid AI specializes in the development of versatile artificial intelligence systems optimized for performance across various deployment environments, ranging from data center accelerators to on-device hardware. Our focus on low latency, minimal memory consumption, privacy, and reliability allows us to partner effectively with enterprises in sectors such as consumer electronics, automotive, life sciences, and financial services. As we experience rapid growth, we are eager to welcome talented individuals who can contribute to our mission.The OpportunityThis unique position places you at the forefront of advanced foundation models and their practical applications. You will oversee post-training projects from start to finish for some of the world’s leading enterprises, while also playing a vital role in the ongoing development of Liquid’s core models.In this role, you will not have to choose between impactful customer work and foundational development; instead, you will enjoy deep involvement in both. You will have significant influence over how models are adapted, assessed, and deployed, directly contributing to the enhancement of Liquid’s post-training capabilities.If you are passionate about data integrity, evaluation processes, and ensuring that models perform effectively in real-world scenarios, this is your chance to redefine the standards of applied AI at a foundation-model company.What We're Looking ForWe seek an individual who:Takes ownership: You will lead post-training initiatives from customer requirements to delivery and evaluation.Thinks end-to-end: You will connect the dots across data generation, training, alignment, and evaluation as a cohesive system.Is pragmatic: You prioritize model quality and customer satisfaction over theoretical publications.Communicates clearly: You can interpret customer needs and effectively communicate with internal technical teams, providing constructive feedback when necessary.The WorkServe as the technical lead for post-training engagements with enterprise clients.Translate client requirements into actionable post-training specifications and workflows.Design and implement data generation, filtering, and quality assessment methodologies.Conduct supervised fine-tuning, preference alignment, and reinforcement learning processes.Create task-specific evaluations, analyze outcomes, and integrate insights back into core post-training workflows.

Technical Staff MemberAt humans&, we are dedicated to pioneering a human-centric approach to artificial intelligence. Our mission is to redefine AI by placing individuals and their interpersonal connections at the heart of our innovations.We invite talented researchers and engineers who have made significant contributions to the cutting-edge of AI to join our dynamic team. If you excel in your field and are driven to innovate, we want to hear from you!

About Liquid AIOriginating from MIT CSAIL, Liquid AI specializes in creating versatile AI systems that operate efficiently across various platforms, from data center accelerators to on-device hardware, focusing on low latency, minimal memory consumption, privacy, and dependability. Our collaborations extend across industries including consumer electronics, automotive, life sciences, and financial services. As we undergo rapid expansion, we are on the lookout for outstanding individuals to join our journey.The OpportunityThe Vision-Language Models (VLM) team is dedicated to developing cutting-edge vision-language models that function seamlessly on devices, adhering to stringent latency and memory requirements without compromising quality. Having already launched four premier models, we are excited about what lies ahead.This team is responsible for the complete VLM pipeline, encompassing research on novel architectures, training algorithms, data curation, evaluation, and deployment. You will be part of a dedicated, hands-on team that directly engages with models and works closely with our pretraining, post-training, and infrastructure teams. Your success will be gauged by the performance of the models we deliver.

About Arize AIIn a world rapidly evolving through artificial intelligence, the need for robust systems to monitor, troubleshoot, and optimize AI technologies has never been greater. At Arize AI, we lead the charge as the premier observability and evaluation platform for AI and Agent Engineering, equipping AI engineers to deploy high-performing, reliable agents and applications. From initial prototypes to full-scale production, our Arize AX platform consolidates build, test, and run into one seamless workspace, enabling teams to deliver solutions with speed and assurance.As a Series C company, we are supported by esteemed investors, having raised over $135M in funding and boasting a rapidly expanding clientele of 150+ prominent enterprises and Fortune 500 companies. Esteemed clients such as Booking.com, Uber, Siemens, and PepsiCo depend on Arize to create AI systems that deliver tangible results.Join Our TeamOur engineering team is dedicated to constructing systems that engage with some of the most intricate software ever deployed in live environments. Comprising seasoned industry professionals, our team has experience in developing deep learning infrastructures, autonomous drones, ridesharing services, ad technology, and much more.We are on the lookout for a client-centric AI Solutions Engineer who possesses a strong entrepreneurial spirit to join our Solutions Engineering organization. You will serve as a trusted technical advisor to our clients, driving business value, providing expert guidance, and nurturing account growth. Your role will involve leading clients to effective solutions, often by educating new users on our product or consulting on best practices. You should be prepared for technical discussions with data scientists and engineers while also conveying the value of Arize in business conversations with directors and executives. Your aim will be to empower our clients to become successful advocates of Arize.