companyLila Sciences logo

Machine Learning Scientist I/II - Multi-Modal Scientific Reasoning

Lila SciencesCambridge, MA USA
On-site Full-time $176K/yr - $304K/yr

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Mid to Senior

Qualifications

Advanced degree in a relevant field (Computer Science/AI, Applied Math/Stats, Electrical Engineering) or a physical sciences discipline (Materials, Chemistry, Physics) with a strong ML focus; or equivalent research/industry experience. Demonstrated success in multi-modal machine learning or VLMs through deployed systems, publications, or open-source contributions. Solid understanding of scientific QA/benchmarks and custom evaluation design. Experience with multi-modal fine-tuning, document parsing, dataset curation, and benchmarking. Proficient engineering skills centered on modern machine learning frameworks (e.g., PyTorch, Hugging Face). Excellent communication and collaboration skills in cross-functional teams.

About the job

Your Impact at Lila

Join our team as a Machine Learning Scientist focused on pioneering multi-modal reasoning through vision-language models (VLMs) leveraging real-world scientific data, including figures, plots, and microscopy data from various sources. Your innovative designs will contribute to the advancement of Scientific Superintelligence.

What You Will Be Building

  • Lead cutting-edge research on multi-modal reasoning systems that analyze scientific data (images, plots, text, etc.) using advanced and custom VLMs.
  • Design and implement training, adaptation, and test-time strategies (e.g., instruction tuning, supervised learning, RLHF, RAG) tailored for scientific comprehension tasks.
  • Create datasets and benchmarks from authentic scientific artifacts (e.g., microscopy images, spectra, protocols) to evaluate model performance.
  • Develop perception modules (e.g., OCR, table/structure recognition, plot parsing) for handling multi-modal data types.
  • Collaborate with domain scientists and engineers to transition research into production-ready systems for enhancing scientific superintelligence.

What You’ll Need to Succeed

  • A graduate degree in a relevant discipline (Computer Science/AI, Applied Mathematics/Statistics, Electrical Engineering) or a physical sciences field (Materials, Chemistry, Physics) with a strong focus on machine learning; or equivalent research/industry experience.
  • A proven track record in multi-modal machine learning or VLMs, evidenced by deployed systems, publications, or contributions to open-source projects.
  • In-depth understanding of scientific QA/benchmarks and custom evaluation design.
  • Experience with multi-modal fine-tuning, document parsing, dataset curation, and benchmarking.
  • Robust engineering skills utilizing modern machine learning frameworks (e.g., PyTorch, Hugging Face).
  • Strong communication and collaboration skills in cross-functional environments.

Bonus Points For

  • Experience with scientific data modalities in laboratory settings, such as microscopy images.
  • Publications in leading ML/CV/NLP conferences or demonstrable impact in applied industrial research.
  • Contributions to open-source multi-modal tools, evaluation suites, or datasets.

About Lila

Lila Sciences stands at the forefront of scientific superintelligence, operating as the world’s first platform and autonomous laboratory dedicated to life sciences, chemistry, and materials science. We are committed to revolutionizing discovery by harnessing AI to enhance every aspect of the scientific method.

About Lila Sciences

Lila Sciences is leading the charge in scientific superintelligence, offering the world's first autonomous platform for life sciences, chemistry, and materials science. Our mission is to unlock limitless discovery by employing AI across all facets of the scientific method.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.