Qualifications
The impact you will have:Design and manage the cross-company Data Intelligence Platform that encompasses every business and product metric essential for Databricks operations. You will significantly influence the delicate balance between data protection and shareability as we transition into a public company. Develop tools and infrastructure to efficiently operate Databricks across multiple clouds, geographies, and deployment types on a large scale. This includes CI/CD processes, testing frameworks for pipelines and data quality, and infrastructure-as-code tooling. Collaborate with our engineering teams to provide leadership in formulating the long-term vision and requirements for the Databricks product. Construct reliable data pipelines and resolve data challenges using Databricks, our partner’s products, and various open-source tools. You will provide early feedback on the design and functionality of these products. Represent Databricks at academic and industry conferences and events.
About the job
At Databricks, we are dedicated to empowering data teams to address some of the most challenging problems globally—from bringing innovative transportation solutions to life to accelerating groundbreaking medical advancements. Our mission is realized through the development and operation of the world's premier data and AI infrastructure platform, enabling our customers to harness profound data insights to elevate their businesses. Founded by engineers with a relentless focus on customer success, we eagerly embrace each opportunity to tackle technical challenges, whether it’s designing next-generation UI/UX for data interactions or scaling our services across millions of virtual machines. Our journey has just begun.
As a Staff Software Engineer on the Data Platform team, you will harness state-of-the-art AI developer tools and techniques to construct Databricks' Data Intelligence Platform, which will facilitate automated decision-making throughout the organization. This role involves close collaboration with Databricks Product Teams, Data Science, and other stakeholders. You will shape the future of various tools, including logging, orchestration, data transformation, metric stores, governance platforms, and data consumption layers.
About Databricks
Databricks is at the forefront of data and AI infrastructure, passionate about enabling teams worldwide to solve pressing challenges. Our innovative platform is designed to foster deep insights from data, driving business improvement and technological advancement.