Qualifications
Key Responsibilities:Define the roadmap for our applied AI initiatives and intelligence features within our products. Spearhead the development and deployment of cutting-edge AI models and systems that enhance the capabilities and performance of Databricks' offerings. Create innovative data collection, fine-tuning, and LLM technologies to optimize performance across specific tasks and domains. Design and implement ML pipelines for data preprocessing, feature engineering, model training, hyperparameter tuning, and model evaluation, facilitating rapid experimentation and iteration. Collaborate closely with cross-functional teams, including AI researchers, ML engineers, and product teams, to deliver impactful AI solutions that boost user productivity and satisfaction. Develop scalable, reusable backend systems to support GenAI products throughout the organization, including robust logging, telemetry, and evaluation frameworks to ensure dependable model performance.
About the job
The Applied AI team at Databricks is at the forefront of pioneering GenAI-powered products. In recent years, we have successfully launched the Databricks Assistant, AI/BI Genie, and Agent Bricks, collaborating with product teams to significantly enhance LLM quality for these offerings. These innovations are utilized by hundreds of thousands of Databricks users daily. We are dedicated to solving complex challenges such as code suggestion, error detection and correction, text-to-SQL generation, automatic pipeline generation, and knowledge QA.
As we continue to evolve our GenAI products, we are looking for multiple GenAI Engineers at various experience levels to lead the next phase of our development. Our goals for 2025 include improving LLM quality, broadening GenAI capabilities across Databricks products, and reinforcing our platform architecture to facilitate seamless AI interactions on a large scale.
About Databricks
Databricks is a leader in AI and data analytics, committed to empowering organizations to innovate and scale through its advanced technology solutions. With a focus on collaborative and intelligent data-driven decision-making, Databricks continues to redefine the landscape of data science and machine learning.