About the job
P-1403
At Databricks, we are dedicated to empowering data teams to tackle some of the most formidable challenges in the world—from turning the next generation of transportation into reality to hastening the discovery of medical innovations. We achieve this by constructing and managing the premier data and AI infrastructure platform, enabling our clients to leverage profound data insights to drive business improvements.
Data ingestion into the Lakehouse is a critical investment area for Databricks and serves as a vital facilitator for Data and AI workflows. The Lakeflow Connect initiative aims to address this need by offering intuitive, point-and-click connectors for a diverse range of sources, including enterprise applications (such as Salesforce, Workday, ServiceNow, SharePoint), databases (like SQL Server), cloud storage, message queues, and local files.
As an integral component of Lakeflow and Data Engineering, Connect is also a fundamental platform capability. Every interface within Databricks (Dashboards, Notebooks, SQL, AI) requires ingestion functionalities, and the lead for this role will collaborate closely with other products to seamlessly integrate Connect into these interfaces.
We seek engineers with a strong background in core database internals to join our Lakeflow Connect team. A crucial aspect of Connect involves extracting data from OLTP systems while minimizing the impact on production systems. To accomplish this efficiently, we are developing systems that utilize techniques like incremental data capture and log parsing. We are looking for hands-on engineers eager to make a significant impact on a critical challenge for the company.

