companyDatabricks logo

Senior Software Engineer - Database Engine Internals

DatabricksBelgrade, Serbia
On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Senior

Qualifications

What We Are Looking For: A deep passion for database systems, storage technologies, distributed systems, language design, or performance optimization Ability to work towards a long-term vision with incremental deliverables Customer-oriented mindset with a focus on impactful outcomes 5+ years of experience in a related system Optional: PhD in databases or distributed systems

About the job

 

P-1415

At Databricks, our mission is to transform the data lifecycle by simplifying processes from data ingestion to ETL, BI, and extending to ML/AI through a unified platform. We envision a future where traditional data warehouse architectures are superseded by an innovative pattern known as the Lakehouse (CIDR 2021 paper), which merges data warehousing with advanced analytics. This paradigm shift addresses critical challenges like data staleness, reliability, total cost of ownership, data lock-in, and the limitation of use-case support.

To realize this vision, we are developing a cutting-edge query engine and structured storage system designed to exceed the performance of specialized data warehouses in relational queries. We aim to preserve the expressiveness and robustness of general-purpose systems like Apache Spark™ to accommodate various workloads, including ETL and data science. Join us on this multi-year journey.

As a member of our team, you will be involved in designing next-generation systems set to redefine industry standards in several key areas:

  • Query compilation and optimization
  • Distributed query execution and scheduling
  • Vectorized execution engine
  • Data security
  • Resource management
  • Transaction coordination
  • Efficient storage structures (encodings, indexes)
  • Automatic physical data optimization

Your Responsibilities:

  • Clarify requirements and drive design decisions for ambiguous problems
  • Create technical design documents and project plans
  • Develop new features
  • Mentor junior engineers
  • Test, deploy to production, and monitor outcomes.

About Databricks

Databricks is a pioneering company in data and AI, collaborating with over 10,000 organizations globally to simplify data processes and enhance analytical capabilities.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.