companyDatabricks logo

Staff Software Engineer - Ingestion

DatabricksBengaluru, India
On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Mid to Senior

Qualifications

Proven experience in software engineering, with a focus on data ingestion and database internals. Strong problem-solving skills and the ability to break down complex issues into manageable solutions. Experience with large-scale data processing systems and performance optimization. Excellent communication skills for cross-team collaboration. A background in leading technical projects and mentoring junior engineers is a plus.

About the job

P-1403

At Databricks, we are dedicated to empowering data teams to tackle some of the most formidable challenges in the world—from turning the next generation of transportation into reality to hastening the discovery of medical innovations. We achieve this by constructing and managing the premier data and AI infrastructure platform, enabling our clients to leverage profound data insights to drive business improvements.

Data ingestion into the Lakehouse is a critical investment area for Databricks and serves as a vital facilitator for Data and AI workflows. The Lakeflow Connect initiative aims to address this need by offering intuitive, point-and-click connectors for a diverse range of sources, including enterprise applications (such as Salesforce, Workday, ServiceNow, SharePoint), databases (like SQL Server), cloud storage, message queues, and local files.

As an integral component of Lakeflow and Data Engineering, Connect is also a fundamental platform capability. Every interface within Databricks (Dashboards, Notebooks, SQL, AI) requires ingestion functionalities, and the lead for this role will collaborate closely with other products to seamlessly integrate Connect into these interfaces.

We seek engineers with a strong background in core database internals to join our Lakeflow Connect team. A crucial aspect of Connect involves extracting data from OLTP systems while minimizing the impact on production systems. To accomplish this efficiently, we are developing systems that utilize techniques like incremental data capture and log parsing. We are looking for hands-on engineers eager to make a significant impact on a critical challenge for the company.

About Databricks

Databricks is at the forefront of enabling data teams to address some of the most pressing challenges globally. By developing the leading data and AI infrastructure platform, we empower our clients to harness deep data insights for tangible business enhancements.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.