Staff Software Engineer - Search Quality at Databricks | Bengaluru

CSQ326R35 Mission The AI Forward Deployed Engineering (AI FDE) team at Databricks is a premier, customer-centric AI team dedicated to revolutionizing AI application development. We engage in professional service projects that empower our clients to create and deploy groundbreaking AI solutions. By collaborating across various functions—including engineering, product development, and developer relations—we help shape strategic initiatives that drive innovation. We are looking for dynamic individuals with distinct skill sets to enhance our team's capabilities. If you have a passion for collaborating with clients and colleagues while staying updated on the latest advancements in Generative AI, LLMOps, and Machine Learning, this role is perfect for you. This position is fully remote. Your Impact: Design and implement innovative Generative AI solutions using our Mosaic AI research to address complex client challenges. Take ownership of rolling out GenAI applications for both consumer and internal stakeholders. Act as a trusted technical consultant to clients across diverse sectors. Represent Databricks at industry events, including the Data + AI Summit, establishing yourself as a thought leader. Work collaboratively with product and engineering teams to influence development priorities and guide the product roadmap. What We Seek: Proven experience in creating Generative AI applications, including RAG, multi-agent systems, Text2SQL, and fine-tuning, utilizing tools like HuggingFace, LangChain, and DSPy. At least 5 years of relevant experience as a Data Scientist, ideally in a consulting capacity. Strong expertise in deploying production-level Generative AI applications, with a focus on evaluation and optimizations. Hands-on experience in data science, utilizing popular ML tools such as pandas, scikit-learn, and PyTorch. Experience with production-grade machine learning deployments on platforms such as AWS, Azure, or GCP. Graduate degree in a quantitative field (e.g., Computer Science, Engineering, Statistics, Operations Research) or equivalent practical experience. Ability to communicate technical concepts to both technical and non-technical audiences effectively. A passion for teamwork, continuous learning, and leveraging AI to create business value. [Preferred] Familiarity with the Databricks Intelligence Platform and Apache Spark™ for processing large-scale datasets.

Role OverviewJoin us as a Forward Deployed Engineer (FDE) at Galileo Technologies, where your expertise will directly influence the success of our top-tier clients through customized technical solutions harnessing generative AI. This dynamic, customer-facing role emphasizes advanced backend engineering, innovative problem-solving, and strategic product development. Collaborate closely with our Head of Field Engineering, AI engineers, and customer project managers to optimize workflows, create tailored integrations, and drive swift advancements towards deploying production-ready solutions.Key ResponsibilitiesEngage with clients to identify their business challenges and architect scalable AI-driven solutions.Develop bespoke features, integrations, and workflows utilizing state-of-the-art AI technologies (e.g., OpenAI Agents SDK, LangGraph, CrewAI).Work alongside client engineering and project management teams to implement solutions and guarantee ongoing success.Regularly monitor, communicate, and synchronize workstreams with internal and external stakeholders.Travel to client sites to foster a deep understanding of their operational needs.

Join Our Innovative Team ‍‍Hello, I'm Rishabh, co-founder and COO at Flent. I oversee our tech, platform, and financial aspects.If you've ever rented in a major Indian city, you're familiar with the hassle. You juggle multiple tabs, engage in countless WhatsApp conversations, and make several calls to brokers, all while feeling uncertain about your decision. You can’t always trust the pictures, prices, or the landlord's demeanor.The real issue isn’t just finding a rental; it’s building trust in the process. At Flent, we are transforming every element of the rental decision-making process, making it as reliable as any modern consumer experience.Trust can also erode post-move-in due to delays, miscommunications, and repetitive escalations from systems lacking memory. Each instance of “let me check and get back to you” represents a systemic failure disguised as a human error.This role is crucial in solving these challenges through software innovation.We are not developing software traditionally; we are redefining our tech stack with AI at its core—not merely as an added feature, but as the foundation of our infrastructure. Engineers here will achieve deployment speeds that were unimaginable just two years ago. I’m looking for passionate individuals eager to explore this frontier with me.Role OverviewYou will be immersed in the operations, customer experience, supply chain, and execution on the ground. You will identify initial failure points, recurring issues, and elements that undermine trust. Your task will be to create tools, automations, and platform solutions that thoroughly resolve these issues.While most engineers prefer to work with clear inputs and defined problems, this position requires navigating through complex realities—such as WhatsApp communications, vendor inconsistencies, payment discrepancies, and manually tracked SLAs—and transforming that chaos into effective software solutions. If you need a product specification to get started, this role may not be the right fit for you.Your Responsibilities:Identifying and Addressing Issues: Observe where confidence falters in practice—through operational queues, customer experience transcripts, and vendor SLA failures—and translate those observations into precise problem definitions, developing concrete solutions that are deployed directly into our product and platform.Creating Internal Tools: Develop tools and automations that minimize manual tasks, reduce errors, and streamline processes. If a team member is manually compiling data across multiple tabs, that’s your opportunity to innovate.Enhancing Business Insight: Establish unified views that integrate billing, operations, and customer interactions to foster seamless experiences.

At HackerRank, we empower leading companies such as NVIDIA, Amazon, and Microsoft to hire and nurture the next generation of developers by prioritizing skills over traditional qualifications. Our platform is trusted by over 2,500 of the world's most innovative organizations to develop robust engineering teams prepared for future challenges.As we venture into a new era where humans and AI collaborate seamlessly, the landscape of technical talent is evolving. We provide businesses with enhanced methods to discover and invest in emerging skills.Our team is dedicated to making a significant impact through our work, focusing on even the smallest details to ensure our clients achieve outstanding success with products they genuinely appreciate. We operate with a sense of urgency and uphold high standards for exceptional results.About the RoleWe are seeking a Forward Deployed Engineer (FDE) to engage directly with our clients, acting as the primary technical liaison during customer interactions, leading pilot programs, demonstrations, and facilitating successful product adoption. This position combines substantial customer engagement with technical expertise.What You’ll DoLead customer-facing initiatives, including discovery sessions, pilot projects, and product demonstrations, serving as the primary technical advocate for both prospects and clients.Collaborate closely with customers, engineers, recruiters, and business leaders to identify developer requirements, listen attentively, and craft practical, goal-oriented solutions.Ensure customer projects remain on schedule through disciplined execution and proactive communication.Utilize appropriate tools, including AI when beneficial, to deliver quicker and more reliable outcomes that enhance the HackerRank customer experience.Partner with Product, Engineering, and Go-To-Market teams to amplify the customer voice.Who You AreA customer-focused technical leader with sufficient full-stack expertise to configure, debug, and clarify web applications, integrations, and generate API scripts as necessary (Ruby or Python).Confident in leading onsite discussions with prospects and enterprise clients while gathering requirements, shaping technical strategies, and delivering impactful results.An effective communicator who can engage deeply with engineers or simplify complex concepts for non-technical audiences.A proficient operator who plans, executes, and maintains organizational structure throughout projects.You demonstrate empathy, enthusiasm, and possess a problem-solving mindset.

(P-1384) About the Team At Databricks, we are dedicated to empowering data teams to tackle some of the world's most challenging issues — from pioneering innovative transportation solutions to expediting medical advancements. Our mission is realized through the development and operation of the premier data and AI infrastructure platform, enabling our clients to harness profound data insights to enhance their business outcomes. Founded by engineers and driven by an unwavering customer focus, we embrace every opportunity to confront technical hurdles, whether it involves designing next-generation UI/UX for data interaction or scaling our services and infrastructure across millions of virtual machines. And we are just getting started. In this pivotal role, you will collaborate closely with leaders across the organization, including engineering, product management, field engineering, recruiting, and HR. You will spearhead essential initiatives that boost developer productivity and foster innovation within the developer platform domain. Your leadership will be instrumental in integrating AI tools into the developer workflow, shaping the future of AI-assisted development. Your Impact: Address significant business needs at scale through your software engineering expertise. Ensure consistent milestone delivery while maintaining strong alignment with field teams, working collaboratively with product leadership. Adapt the organizational structure to meet long-term objectives, fostering strong “5 ingredient” teams with effective communication architecture. Manage technical debt by making long-term architectural decisions and balancing the product roadmap. Lead and participate in technical, product, and design discussions. Build, manage, and operate highly scalable cloud services. Develop leaders within the team by providing coaching, mentorship, and growth opportunities. Collaborate with fellow engineering and product leaders on planning, prioritization, and staffing. Foster a culture of excellence and lead with empathy within the team. What We Seek: 15+ years of industry experience in building and supporting large-scale distributed systems. Proven track record in building, growing, and managing high-performance teams. Ability to attract and hire engineers who align with Databricks' hiring principles. Experience in building and operating cloud platforms, or a demonstrated ability to quickly learn new concepts in the SaaS space. Exceptional leadership and communication skills. Mentorship capabilities to nurture talent and promote professional development.

P-1394 At Databricks, we are dedicated to empowering data teams to tackle some of the world's most significant challenges—from revolutionizing transportation to accelerating medical advancements. Our mission is fulfilled by creating and managing the industry's leading data and AI infrastructure platform, enabling our customers to harness deep data insights to enhance their operations. Founded by engineers with a customer-centric mindset, we eagerly embrace every challenge, whether it's creating cutting-edge UI/UX for data interaction or scaling our infrastructure across millions of virtual machines. Our engineering teams design technical products that address real, critical needs in today's world. We continuously push the limits of data and AI technology while ensuring the security and scalability essential for our customers' success on our platform. We operate one of the largest software platforms globally, comprising millions of virtual machines that generate terabytes of logs and process exabytes of data daily. At this scale, we monitor cloud hardware, network, and operating system faults, and our software is designed to shield our customers from these issues seamlessly. As a Senior Software Engineer on the Observability team, you will develop observability solutions that provide critical insights into the health and performance of our products and infrastructure.

Join Databricks as a Staff Software Engineer and be part of our mission to empower data teams to tackle some of the world's most challenging problems. From revolutionizing transportation to speeding up medical innovations, we create and manage the leading data and AI infrastructure platform that allows our customers to harness deep data insights and enhance their businesses. Founded by engineers with a customer-first mindset, we eagerly tackle every technical challenge, whether it's designing next-gen UI/UX for data interaction or expanding our services and infrastructure to millions of virtual machines.Databricks Mosaic AI introduces a pioneering, data-centric methodology for developing enterprise-grade Machine Learning and Generative AI solutions. This approach enables organizations to securely and cost-effectively manage and deploy ML and AI models utilizing their proprietary data. We're excited to expand our presence in Bengaluru, India, as we establish 10 new teams from the ground up!As a Staff Software Engineer at Databricks, you will have the opportunity to work in the following areas:Backend DevelopmentDistributed Data Systems (DDS)Full Stack EngineeringYour Impact:1. Engage with our Backend teams across diverse domains, addressing challenges such as:Developing solutions that integrate product and infrastructure aspects, including distributed systems, scalable service architecture, monitoring, workflow orchestration, and enhancing developer experience.Delivering reliable, high-performance services and client libraries for managing vast amounts of data on cloud storage platforms like AWS S3 and Azure Blob Store.Creating robust, scalable services using technologies such as Scala and Kubernetes, as well as data pipelines with Apache Spark™, to support pricing infrastructure serving millions of cluster-hours daily, and developing features that enable customers to effortlessly monitor and control platform usage.2. Collaborate with our DDS team, which focuses on:Apache Spark™Data Plane StorageDelta LakeDelta PipelinesPerformance Engineering3. As a Full Stack Engineer, work alongside team members and product management to create delightful user experiences.

The Applied AI team at Databricks is at the leading edge of developing innovative AI and machine learning-powered products. Our customers continuously create vast numbers of assets—such as tables, notebooks, dashboards, data rooms, pipelines, SQL queries, and ML models—on our platform, some totaling hundreds of millions of assets. Navigating and locating these assets is vital for our users to efficiently complete their tasks.As our Search product continues to grow and advance, we are looking for multiple ML Engineers at various seniority levels to enhance our Search Quality. In 2026, our focus will be on improving search ranking, enhancing query understanding, building robust evaluations, and expanding asset coverage to facilitate seamless search capabilities at scale.

P-1386 At Databricks, we are dedicated to empowering data teams to address the most challenging problems globally — whether it's realizing the next mode of transportation or fast-tracking medical advancements. Our mission is fulfilled by constructing and managing the world's premier data and AI infrastructure platform, enabling our clients to leverage deep data insights for business enhancement. Established by engineers with a customer-centric philosophy, we eagerly embrace every opportunity to confront technical obstacles, from designing next-gen UI/UX for data interaction to scaling our services and infrastructure across millions of virtual machines. And this is just the beginning. As a Senior Backline Technical Solutions Engineer, you will play a crucial role in ensuring customer success with the Databricks platform by addressing significant technical escalations and collaborating closely with the frontline support team. You will act as the technical liaison between support and engineering, serving as the first line of defense for engineering challenges. Your expertise will vet all issues before they escalate to the engineering team. You will report directly to the Manager of the Backline Engineering Team. Your Impact: Troubleshoot and resolve complex customer issues related to the Databricks Platform by analyzing core component metrics and logs. Provide best practice recommendations for performance enhancements in customer-specific environments and offer feedback for product improvements. Assist the support team with detailed troubleshooting guides and operational runbooks. Contribute to automation and tooling initiatives to streamline daily troubleshooting processes. Collaborate with engineering teams to disseminate knowledge about upcoming features and releases. Identify and contribute to supportability features that can be integrated back into the product. Exhibit ownership and coordinate with engineering and escalation teams to ensure resolution of customer issues and requests. Engage in weekend and weekday on-call rotation.

The Applied AI team at Databricks is at the cutting edge of AI and ML-driven products. Our customers constantly create a variety of assets (such as tables, notebooks, dashboards, and ML models) on our platform, making the search for these assets a vital aspect of their experience.As our Search product continues to grow, we are looking for multiple Machine Learning Engineers at various experience levels to enhance our Search Quality. In 2026, our primary focus will be on improving search ranking, query comprehension, developing robust evaluations, and expanding asset coverage to facilitate seamless searching at scale.

Our MissionAt Fiddler, we acknowledge the profound influence of AI on people's lives. Our mission is to instill trust in AI technologies. With the emergence of Generative AI and Agents, the scope of risk has expanded, complicating the assurance of effective AI applications. Fiddler empowers organizations to proactively address these challenges by deploying transparent and trustworthy AI solutions.We collaborate with AI-focused organizations to establish a sustainable framework for responsible AI practices, fostering trust with their users. AI Engineers, Data Scientists, and business teams utilize Fiddler AI to monitor, assess, secure, analyze, and enhance their AI solutions, ultimately driving superior outcomes. Our platform enables both engineering teams and business stakeholders to grasp the "what", "why", and "how" of AI outcomes.Meet Our FoundersFiddler AI was founded by Krishna Gade, an engineering leader with experience at Facebook, Pinterest, Twitter, and Microsoft, and Amit Paka, a product leader with a background at Microsoft, Samsung, PayPal, and multiple startups. We are supported by Insight Partners, Lightspeed Venture Partners, and Lux Capital.Why Become a Part of Our Team?Our team is dedicated to fostering trust in AI, enabling society to leverage its potential responsibly. Joining us means making a meaningful impact by ensuring operational transparency and security for AI applications at production scale across various industries. As an early-stage startup, we have a quickly expanding team of intelligent and empathetic individuals—doers, thinkers, creators, builders, and everyone in between. The pace of innovation in the AI and ML industry presents monumental learning opportunities. This is your chance to be a pioneer in the field.Fiddler has been recognized as a leader in AI Observability, earning multiple accolades, including being listed in the 2022 a16z Data50, 2021 CB Insights AI 100, 2020 WEF Technology Pioneer, 2020 Forbes AI 50 most promising startups, and being named a 2019 Gartner Cool Vendor in Enterprise AI Governance and Ethical Response. By joining our talented team, you will contribute to advancing the AI Observability landscape.‍ Your Role:As a Forward Deployed Engineer, you will bring trustworthy AI to life for our clients by deploying, customizing, and optimizing complex, high-impact AI observability and agentic solutions in the field. You will be a hands-on builder and strategic partner, translating customer needs into actionable solutions.

P-1348 At Databricks, we are dedicated to empowering data teams to tackle some of the most challenging problems in the world, ranging from security threat detection to the development of cancer drugs. Our mission is to create and manage the leading data and AI infrastructure platform, allowing our customers to concentrate on the critical challenges central to their missions. Our engineering teams are committed to developing innovative technical products that meet real and significant needs globally. We continuously push the limits of data and AI technology while ensuring resilience, security, and scalability to enhance our customers' success on our platform. We are responsible for the operation of one of the largest scale software platforms, comprising millions of virtual machines that generate terabytes of logs and process exabytes of data on a daily basis. At this scale, we encounter cloud hardware, network, and operating system issues, and our software must effectively shield our customers from these challenges. As a Senior Software Engineer on the Data Platform team, you will contribute to building the Data Intelligence Platform for Databricks, which aims to automate decision-making across the organization. You will collaborate closely with Databricks Product Teams, Data Science, Applied AI, and more. Your role will involve developing a range of tools for logging, orchestration, data transformation, metric storage, governance platforms, and data consumption layers. You will leverage the latest and most advanced Databricks products and other tools in the data ecosystem. Our team also serves as a substantial in-house customer, using Databricks to inform the future direction of our product. Your Impact: Design and manage the Databricks metrics store, enabling all business units and engineering teams to consolidate and share detailed metrics on a common platform with high quality, introspection capabilities, and query performance. Lead the development of the cross-company Data Intelligence Platform, which encapsulates all business and product metrics essential for running Databricks. You will play a pivotal role in balancing data protection with ease of shareability as we transition to a public company. Create tools and infrastructure to efficiently manage and operate Databricks on Databricks at scale across multiple clouds, geographies, and deployment types. This includes CI/CD processes, testing frameworks for pipelines and data quality, and infrastructure-as-code tooling. Establish the foundational ETL framework utilized by all pipelines developed within the company. Collaborate with our engineering teams to provide...

P-1408 Join the Applied AI team at Databricks to be a key player in pioneering AI/ML-driven products. Our customers are consistently generating a wealth of assets—such as tables, notebooks, dashboards, datarooms, pipelines, SQL queries, and ML models—on our platform, with some managing hundreds of millions of these assets. Efficiently locating these assets is a critical journey for our users, enabling them to complete their tasks effectively. As our Search product evolves, we are on the lookout for a Staff Engineer to spearhead improvements in our Search Quality. In 2025, our primary goals include enhancing search ranking, refining query understanding, developing robust evaluations, and broadening asset coverage to facilitate seamless search capabilities at scale.

P-995 At Databricks, we are dedicated to empowering data teams to tackle some of the world's most challenging issues — from bringing innovative transportation solutions to life to accelerating groundbreaking medical discoveries. We achieve this by developing and operating the leading data and AI infrastructure platform, enabling our clients to leverage deep data insights for enhanced business performance. Established by engineers with a customer-centric approach, we seize every chance to address technical challenges, from designing next-generation UI/UX for data interaction to scaling our services and infrastructure across millions of virtual machines. Our journey has only just begun. As one of the initial Engineering Managers within the Software Engineering team at Databricks India, you will lead your team in creating infrastructure and products for the Databricks platform at scale. We have multiple teams focusing on various domains. Resource management infrastructure that supports big data and machine learning workloads on the Databricks platform in a secure, scalable, and cloud-agnostic manner. Development of reliable, scalable services and client libraries capable of handling vast amounts of data across multiple cloud providers and geographic regions. Creation of tools that enable Databricks engineers to manage their services across diverse clouds and environments. Development of services, products, and infrastructure at the nexus of machine learning and distributed systems. Your Impact: Recruit top-notch engineers to assemble an exceptional team. Establish high technical standards through the implementation of processes (architecture reviews, testing) and fostering a culture of engineering excellence. Collaborate with engineering and product leadership to craft a long-term roadmap. Facilitate execution and teamwork across various teams to overcome cross-functional project hurdles.

Join Databricks, where our mission is to empower data teams to tackle some of the most challenging problems in the world—from revolutionizing transportation to advancing medical innovations. We achieve this by developing and managing a top-tier data and AI infrastructure platform that allows our customers to harness deep data insights for better business outcomes. Founded by engineers and driven by our commitment to customer satisfaction, we embrace every challenge—whether it's creating next-generation UI/UX for data interfacing or scaling our infrastructure across millions of virtual machines. At Databricks Mosaic AI, we take a unique data-centric approach to crafting enterprise-quality Machine Learning and Generative AI solutions, enabling organizations to securely and cost-effectively manage and host their ML and AI models, enriched with their enterprise data. We're just getting started in Bengaluru, India, where we're launching 10 new teams from the ground up!As a Staff Software Engineer at Databricks India, you will have the opportunity to work across:Backend developmentDistributed Data Systems (DDS)Full Stack solutionsYour Impact:Backend: Engage with diverse domains within our essential service platforms, tackling challenges that span product and infrastructure, including distributed systems, service architecture, workflow orchestration, and enhancing developer experience. You'll be responsible for delivering high-performance services and client libraries for managing vast amounts of data on cloud storage backends such as AWS S3 and Azure Blob Store, as well as developing scalable services using technologies like Scala, Kubernetes, and Apache Spark™.Distributed Data Systems (DDS): Collaborate on projects involving Apache Spark™, Data Plane Storage, Delta Lake, Delta Pipelines, and Performance Engineering.Full Stack: Partner closely with product management to create exceptional user experiences.

Join Databricks as a Staff Software Engineer and contribute to our innovative infrastructure that empowers data teams to excel with confidence and scalability. Our unified schema migration platform is the backbone of automated, observable, and developer-friendly workflows, ensuring that Databricks can swiftly evolve across thousands of databases and over 60 critical services.Key Responsibilities:Schema Migration Platform: Design and maintain an automated infrastructure for schema changes in MySQL and TiDB, focusing on versioning, rollback, validation, and auditing to ensure swift, safe migrations.Scale, Reliability & Test Harness: Guarantee the platform’s operation across a vast array of global databases without downtime, while enhancing resilience, observability, and recovery measures, along with developing a test harness for migration and deployment validation.Developer Experience & CI/CD Integration: Create user-friendly tools and APIs for efficient schema and data change management, integrating migration workflows into CI/CD pipelines to boost speed and reduce friction.Schema & Data Management: Construct infrastructure for secure, large-scale schema and data operations, ensuring that backfill processes are monitored, retryable, minimally disruptive, and automated to maintain data integrity in line with schema evolution.Your Impact:Enhance the scalability and reliability of schema and data operations across Databricks’ global presence.Facilitate predictable deployments by architecting robust test harnesses and automation tools.Improve the developer experience by delivering accessible and resilient tools that simplify complex migrations.Ensure the integrity of schema and data through safe and efficient backfill strategies.

P-1385 In today's landscape, businesses are channeling substantial investments into the development and implementation of AI technologies and the data platforms that support them. However, do they truly understand the intricacies of their operations? At Databricks, we are dedicated to empowering data teams to tackle some of the most challenging global issues, from revolutionizing transportation to expediting medical innovations. We achieve this by constructing and maintaining the world's premier data and AI infrastructure platform, enabling our clients to leverage deep data insights to enhance their operations. Founded by engineers who prioritize customer satisfaction, we eagerly embrace every opportunity to confront technical challenges, including designing next-generation UI/UX for data interaction and optimizing our services across millions of virtual machines. And this is just the beginning. As a Senior Software Engineer on the Customer Foresight Team, you will spearhead the development of tools that empower customers to gain insights into their AI and data workloads, optimize performance, and reduce costs. You will craft data infrastructure capable of processing billions of entries daily, deploy across over 65 cloud regions globally, and support some of the world's most prominent companies in executing their DevOps, FinOps, SecOps, and AIOps operations. This role involves directing technical development throughout product milestones, from requirement refinement to execution, operation, and collaboration with the broader product development and partner teams to guarantee product success.

Mission At Databricks, we empower data teams to tackle the world's most challenging problems. As the frontrunner in Unified Data Analytics, we enable organizations to prepare their data for analytics, promote data-driven decisions company-wide, and swiftly implement machine learning to maintain a competitive edge. Founded by the original creators of renowned open-source projects like Apache Spark™, Delta Lake, and MLflow, Databricks is backed by prominent venture capital. In the role of Staff Backline Engineer, you will play a pivotal role in ensuring our customers are successful with the Databricks Data Intelligence platform. You will address critical technical escalations and serve as the technical liaison between the support and engineering teams, acting as the first line of defense for engineering. Your expertise will ensure that all issues are thoroughly vetted before they escalate to the engineering team. You will report directly to the Senior Backline Manager of the Backline Escalations Team. Outcomes Troubleshoot and resolve complex customer issues related to Apache Spark™ core internals, Spark SQL, Structured Streaming, and Databricks Delta through deep code-level analysis. Provide best practices guidance regarding Spark runtime performance and the use of Spark core libraries and APIs for custom solutions created by Databricks customers. Assist the support team with comprehensive troubleshooting guides and runbooks. Contribute to automation and tooling initiatives to enhance daily troubleshooting efficiency. Collaborate with the Spark Engineering Team to raise awareness of new features and releases. Identify Spark bugs and propose effective workarounds. Exhibit ownership and coordinate with engineering and escalation teams to resolve customer issues and requests. Participate in both weekend and weekday on-call rotations.

At Databricks, we are dedicated to empowering data teams to tackle some of the world's most challenging issues—from transforming the future of transportation to accelerating medical innovations. Our commitment is to create and maintain the leading data and AI infrastructure platform, enabling our clients to harness deep data insights for business improvement. As a strategic focus, data ingestion into the Lakehouse is a vital area of investment at Databricks, crucial for enhancing Data and AI workflows. Our Lakeflow Connect initiative aims to address this need by offering user-friendly, point-and-click connectors to a diverse range of data sources, including enterprise applications such as Salesforce, Workday, ServiceNow, and SharePoint, as well as databases like SQL Server, cloud storage solutions, message queues, and local files. In this role, you will play an instrumental part in Lakeflow and Data Engineering. Connect serves as a pivotal platform capability, with ingestion functionalities required across all Databricks surfaces (Dashboards, Notebooks, SQL, AI). The successful candidate will collaborate closely with other products to integrate Connect seamlessly into these interfaces. We seek engineers with a robust background in core database internals to join our Lakeflow Connect team. A critical aspect of Connect involves extracting data from OLTP systems while minimizing the load on production environments. To achieve this, we are developing systems that utilize techniques such as incremental data capture and log parsing. We are searching for hands-on engineers eager to make a significant impact on a crucial challenge for the organization.