companyDatabricks logo

Senior Backline Engineer (Apache Spark™)

DatabricksBengaluru, India
On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Senior

Qualifications

Key ResponsibilitiesTroubleshoot and resolve complex customer issues related to Apache Spark™ core internals, Spark SQL, Structured Streaming, and Databricks Delta by performing deep code-level analysis. Guide best practices on Spark runtime performance and usage of Spark core libraries and APIs for custom solutions developed by Databricks customers. Assist the support team with comprehensive troubleshooting guides and runbooks. Contribute to automation and tooling initiatives to enhance daily troubleshooting efficiency. Collaborate with the Spark Engineering Team to disseminate information on upcoming features and releases. Identify Spark bugs and propose possible workarounds. Exhibit ownership and coordinate with engineering and escalation teams to ensure timely resolution of customer issues. Participate in on-call rotations during weekends and weekdays. QualificationsOver 8 years of experience in developing, testing, and maintaining applications using Python, Java, or Scala. Proficient in compiling, building, and navigating the Apache Spark source code. Skilled in identifying and applying patches or bug fixes to the Apache Spark source code. Experience with Big Data ecosystems including Hadoop, Spark, Kafka, and Elasticsearch data pipelines. Hands-on experience with SQL-based database systems. Familiarity with JVM, GC, and thread dump analysis.

About the job

Mission

At Databricks, we empower data teams to tackle some of the most challenging problems in the world. As pioneers in Unified Data Analytics, we enable organizations to prepare their data for analytics, drive data-informed decisions, and swiftly implement machine learning to stay ahead of the competition. Founded by the original creators of renowned open-source projects like Apache Spark™, Delta Lake, and MLflow, Databricks is a venture-backed leader in the industry.

In the role of Senior Backline Engineer, you will play a crucial part in ensuring our customers achieve success with the Databricks Data Intelligence platform. You will address significant technical customer escalations and act as a vital technical link between our support and engineering teams. Your expertise will be essential in vetting all issues before they escalate to engineering, reporting directly to the Senior Backline Manager of the Backline Escalations Team.

About Databricks

Databricks leads the way in Unified Data Analytics, offering innovative solutions that help organizations harness the full potential of their data. By integrating data science and engineering, we empower teams to work collaboratively and efficiently, enabling data-driven decision-making across the board. Our commitment to open-source technology continues to drive our mission forward.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.