companyDatabricks logo

Staff Software Engineer - Data Platform at Databricks | Bengaluru, India

DatabricksBengaluru, India
On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Mid to Senior

Qualifications

The ideal candidate will possess a strong background in software engineering, particularly with a focus on data platforms. Proficiency in developing scalable systems and familiarity with cloud infrastructure is essential. Experience with modern programming languages and tools used in the data ecosystem is highly desirable.

About the job

P-1348

Join Databricks, where our mission is to empower data teams to tackle the world's most challenging problems, from detecting security threats to advancing cancer drug development. We build and maintain the premier data and AI infrastructure platform, enabling our customers to focus on their critical missions. Our engineering teams are dedicated to creating innovative technical products that address significant needs while pushing the limits of data and AI technology. We operate with the resilience, security, and scalability necessary to ensure our customers succeed on our platform.

Our platform operates at an unparalleled scale, comprising millions of virtual machines and generating terabytes of logs, processing exabytes of data daily. We encounter various cloud hardware, network, and operating system faults, and our software must adeptly protect our customers from these challenges.

As a Staff Software Engineer on the Data Platform team, you will contribute to the development of the Data Intelligence Platform at Databricks, automating decision-making processes across the organization. Collaborating with Product Teams, Data Science, Applied AI, and more, you will create tools for logging, orchestration, data transformation, metric storage, governance platforms, and data consumption layers. Leveraging cutting-edge Databricks products and tools within the data ecosystem, your team will serve as a significant in-house customer, providing insights that shape our product's future.

Your Impact:

  • Design and manage the Databricks metrics store, facilitating shared access to detailed metrics across business units and engineering teams with high quality and performance.
  • Develop the cross-company Data Intelligence Platform, encompassing all business and product metrics necessary for running Databricks, balancing data protection with ease of sharing as we transition to a public entity.
  • Create tools and infrastructure for efficiently managing Databricks operations at scale across multiple clouds and geographies, including CI/CD processes, testing frameworks for pipelines and data quality, and infrastructure-as-code tools.
  • Establish the foundational ETL framework utilized by all company-developed pipelines.
  • Collaborate with engineering teams to enhance...

About Databricks

Databricks is a leading company in the field of data and AI infrastructure, dedicated to helping organizations solve complex problems through innovative technology. Our passionate teams are committed to pushing the boundaries of data science and engineering, ensuring our customers have the tools needed to succeed.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.