companyDatabricks logo

Lead Staff Software Engineer - Machine Learning (Search) at Databricks | Bengaluru, India

DatabricksBengaluru, India
On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Senior

Qualifications

Key Responsibilities Lead the development and deployment of ML-based search and discovery relevance models, integrating them with Databricks' offerings. Architect and implement automated ML and NLP pipelines for data preprocessing, query understanding and rewriting, ranking and retrieval, and model evaluation, fostering rapid experimentation and iteration. Partner with product managers and cross-functional teams to champion technology-first initiatives that propel innovative business strategies and product roadmaps for the search and discovery experience. Contribute to constructing a robust framework for assessing search ranking enhancements—both offline and online. What We’re Looking For BS+ (M. S. or PhD preferred) in Computer Science or a related field. 10+ years of experience in developing search relevance systems at scale, either in production or impactful research settings. Proficiency in applying LLM to search relevance. Expertise in one or more of the following areas: Query understanding NLP Text mining Recommendations Personalization Discovery Conversational AI Strong grasp of computer science fundamentals. Contributions to widely utilized open-source projects.

About the job

P-1408

Join the Applied AI team at Databricks to be a key player in pioneering AI/ML-driven products. Our customers are consistently generating a wealth of assets—such as tables, notebooks, dashboards, datarooms, pipelines, SQL queries, and ML models—on our platform, with some managing hundreds of millions of these assets. Efficiently locating these assets is a critical journey for our users, enabling them to complete their tasks effectively.

As our Search product evolves, we are on the lookout for a Staff Engineer to spearhead improvements in our Search Quality. In 2025, our primary goals include enhancing search ranking, refining query understanding, developing robust evaluations, and broadening asset coverage to facilitate seamless search capabilities at scale.

About Databricks

At Databricks, we're at the forefront of building cutting-edge AI solutions that transform user interaction with data and our suite of products. You'll have the opportunity to be part of a thriving team that is shaping the future of data-driven technology.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.