companyDatabricks logo

Director of Engineering - Data Infrastructure

DatabricksBengaluru, India
On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Senior Level Manager

Qualifications

The successful candidate should demonstrate: Extensive experience in building and leading infrastructure organizations Deep technical understanding of data architecture and infrastructure engineering Proven track record of managing large-scale systems with high reliability Exceptional strategic vision for platform development Strong leadership skills to attract and retain top engineering talent A belief in the transformative power of robust data infrastructure

About the job

(P-1490)

At Databricks, we process vast amounts of data, managing petabytes and billions of transaction events each day. Our infrastructure is critical; every cluster launch, query executed, and dollar billed must function flawlessly. With stringent accuracy requirements of 99.999% for billing transactions and the ability to ingest terabytes of data per second across over 100 regions, the stakes are high. A mere five-minute outage can lead to significant revenue loss and erode customer trust. Therefore, our infrastructure is not just important—it is essential for our survival.

As we scale, the next phase of our growth demands that we establish disaster recovery systems that ensure reliability, not just hope for it. We need testing frameworks that can identify production-scale issues before they affect our users, correctness guarantees that eliminate billing errors, and automation that scales operations efficiently alongside growth.

In this pivotal leadership role, you will spearhead the development of the data infrastructure organization that underpins Databricks' ongoing expansion. You will lay the groundwork for teams in Bengaluru, responsible for the foundational systems that assure billing accuracy, operational resilience, and zero-downtime recovery across our monetization stack. This encompasses multi-region data ingestion, developer platforms, and deployment automation that streamline operations at petabyte scale. Your mission transcends mere maintenance; it involves architecting the infrastructure that allows Databricks to grow while alleviating operational burdens. You will define the standards for world-class infrastructure that will serve data platforms for the next decade.

In your role as a founding technical leader in our rapidly growing engineering hub, you will collaborate closely with global infrastructure leaders. Beyond building exceptional teams, you will influence architectural decisions that resonate throughout the organization and advocate for an infrastructure-as-product mindset that transforms infrastructure into a global force multiplier. You will thrive in an engineering culture rooted in Apache Spark and open source, where technical expertise is highly valued and infrastructure engineers are regarded as skilled artisans.

The ideal candidate has previously built infrastructure organizations in environments where achieving five nines was not merely a goal but a reality, where petabyte-scale operations were a daily expectation, and where the technical strength of the infrastructure team determined business scalability. You possess the technical expertise to engage in discussions about data architecture, the strategic insight to shape multi-year platform roadmaps, and the leadership ability to create teams that attract top-tier engineers. Most importantly, you believe that effective data infrastructure not only supports the business but also defines its potential.

About Databricks

Databricks is a leader in cloud data and AI, empowering organizations to unify data science and data engineering with a collaborative platform. Our mission is to help enterprises harness the full power of their data through innovative solutions and unmatched scalability.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.