companyDatabricks logo

Staff Software Engineer - Ingestion at Databricks | Bengaluru, India

DatabricksBengaluru, India
On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Mid to Senior

Qualifications

Proven experience in software engineering with a focus on database internals. Hands-on expertise in developing scalable data ingestion solutions. Strong debugging, performance measurement, and optimization skills in large production clusters. Ability to architect design, influence product roadmaps, and take ownership of new projects. Deep knowledge for preventing and resolving production issues. Experience planning and leading complex technical projects across multiple teams. Strong leadership skills, capable of driving organizational initiatives. Proficient in breaking down complex problems efficiently and proposing viable solutions.

About the job

At Databricks, we are dedicated to empowering data teams to tackle some of the world's most challenging issues—from transforming the future of transportation to accelerating medical innovations. Our commitment is to create and maintain the leading data and AI infrastructure platform, enabling our clients to harness deep data insights for business improvement.

As a strategic focus, data ingestion into the Lakehouse is a vital area of investment at Databricks, crucial for enhancing Data and AI workflows. Our Lakeflow Connect initiative aims to address this need by offering user-friendly, point-and-click connectors to a diverse range of data sources, including enterprise applications such as Salesforce, Workday, ServiceNow, and SharePoint, as well as databases like SQL Server, cloud storage solutions, message queues, and local files.

In this role, you will play an instrumental part in Lakeflow and Data Engineering. Connect serves as a pivotal platform capability, with ingestion functionalities required across all Databricks surfaces (Dashboards, Notebooks, SQL, AI). The successful candidate will collaborate closely with other products to integrate Connect seamlessly into these interfaces.

We seek engineers with a robust background in core database internals to join our Lakeflow Connect team. A critical aspect of Connect involves extracting data from OLTP systems while minimizing the load on production environments. To achieve this, we are developing systems that utilize techniques such as incremental data capture and log parsing. We are searching for hands-on engineers eager to make a significant impact on a crucial challenge for the organization.

About Databricks

Databricks is at the forefront of data and AI innovation, providing an unparalleled platform that enables organizations to derive impactful insights from their data. Our mission is to help teams across various industries solve their toughest challenges, paving the way for advancements in technology and science.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.