Research Scientist in Measurement and Evaluation

Who We AreAt Percepta, our mission is to revolutionize essential sectors through applied AI. We are dedicated to ensuring that key industries, such as healthcare, manufacturing, and energy, leverage cutting-edge technology. By collaborating with industry leaders, we facilitate AI transformation.Expertise in engineering, product development, and research.Mosaic, our proprietary toolkit for swift deployment of agentic workflows.Strategic alliances with companies such as Anthropic, McKinsey, AWS, and others in the General Catalyst portfolio.Our team is rapidly expanding, consisting of Applied AI Engineers, Embedded Product Managers, and Researchers who are passionate about integrating AI advancements into our daily lives. Percepta is a direct partnership with General Catalyst, a global leader in transformation and investment.About the RoleAs a Research Engineer/Scientist (Optimization) at Percepta, you will play a crucial role at the convergence of AI research and impactful real-world applications. You will push the boundaries of decision-making in vital industries by integrating state-of-the-art machine learning with robust optimization research. Collaborate closely with our Embedded Product Managers (EPMs) and engineers to ensure that our advanced decision systems are both innovative and practically beneficial for transforming organizational operations.ResponsibilitiesEstablish and lead ambitious research initiatives that broaden the horizons of data-driven decision-making.Develop innovative optimization and machine learning methodologies for significant challenges such as planning, scheduling, routing, pricing, and inventory management.Create high-fidelity simulators and comprehensive benchmarks that accurately reflect real-world constraints, uncertainties, and multi-objective trade-offs.Translate research into practical applications by partnering with engineers to swiftly prototype solutions and effectively implement research insights.You May Be a Great Fit If YouHold a degree in Computer Science, Operations Research, Industrial Engineering, or Applied Mathematics (MS/PhD preferred) or possess equivalent research or industry experience.Have demonstrated experience in optimization and machine learning.Exhibit a strong ability to collaborate and communicate effectively across multidisciplinary teams.

Join our dynamic team at Anthropic as a Research Engineer or Research Scientist specializing in Tokens. In this role, you will engage in groundbreaking research and development, contributing to the advancement of our token systems and enhancing their capabilities. Your work will be pivotal in shaping the future of our technology and driving innovation in our projects.

About UsAt Percepta, we are on a mission to revolutionize pivotal industries through applied AI. Our focus is on ensuring that the sectors that drive our world, including healthcare, manufacturing, and energy, harness the power of cutting-edge technology. To achieve this, we closely collaborate with top-tier clients to facilitate AI transformation. We unite:Expertise in engineering, product, and research that is deployed at the forefront of innovation.Mosaic, our proprietary toolkit designed for the rapid implementation of intelligent workflows.Strategic alliances with leading firms such as Anthropic, McKinsey, AWS, and others within the General Catalyst portfolio.Our team consists of a dynamic group of Applied AI Engineers, Embedded Product Managers, and Researchers who are passionate about integrating AI to enhance everyday experiences. Percepta is a proud partner of General Catalyst, a global leader in transformation and investment.Role OverviewAs a Research Engineer/Scientist specializing in LLM Modeling at Percepta, you will be at the forefront of developing and deploying large-scale language models. You will engage in pre-training, post-training (including instruction tuning, alignment, and distillation), reinforcement learning, and the crafting of specialized architectures to enhance reasoning, decision-making, and adaptability across critical sectors.Collaboration is key as you will work closely with Embedded Product Managers and engineers to create innovative yet practical decision systems that significantly transform business operations.Identify significant challenges and formulate research strategies encompassing pre-training, post-training, RL, and specialized model development.Prototype and scale training pipelines for large language models, experimenting with architectures, optimization methods, and post-training tactics.Contribute to the infrastructure necessary for high-performance distributed training.Conduct extensive real-world evaluations that yield millions in value.Collaborate with applied AI engineers to transition successful research findings into actionable features within our Mosaic platform.Effectively communicate research outcomes to both technical and non-technical stakeholders, ensuring clarity on the implications of research and its applications.

About Comity Comity builds financial frameworks for the next generation of energy systems. The team focuses on making energy more reliable, transparent, and efficient, with the long-term goal of fully renewable, autonomous, and resilient systems. Statistical learning and convex optimization are core to the approach. Founded by Stanford alumni and professionals with backgrounds in complex systems, machine learning, and structured finance, Comity’s leadership brings experience from Apple, Bluevine, Affirm, Square, and Google. The company is supported by investors such as Maverick Ventures and Caffeinated Capital. Offices are in Chicago, New York City, and San Francisco. Role Overview: Quantitative Researcher, Portfolio Optimization This Quantitative Researcher will focus on portfolio optimization for Comity’s power trading strategies. The position is based in New York. Early team members shape portfolio design, research direction, technology choices, and company culture. What You Will Do Develop information systems to monitor and guide Comity’s multi-strategy, market-specific autonomous trading systems. Set acceptance criteria for new trading strategies. Work with risk management on risk assessments and quantitative risk modeling. Collaborate with software engineers, quantitative researchers, and finance to bring new assets to market and achieve business goals. What We Look For Experience managing P&L as a quantitative portfolio manager. Strong background in applied mathematics, probability, statistics, and numerical algorithms. Understanding of optimization techniques relevant to finance. Proficiency in coding, especially Python. Graduate degree in mathematics, statistics, machine learning, computer science, physics, or a related quantitative field. Excellent communication and collaboration skills.

The City of New York seeks a City Research Scientist to assist with research projects that inform public policy and improve city services. This position plays a part in supporting data-driven work across several municipal departments. Role overview This role focuses on conducting research and analysis that helps guide decisions within city agencies. The work directly impacts how policies are developed and how services are delivered to residents. Key responsibilities Support research projects for city departments Contribute to data analysis that shapes public policy Help strengthen city services through evidence-based recommendations Location This position is based in New York City.

About Mirage Mirage builds an AI-powered video platform that brings production and editing together through natural language. The team focuses on models with strong contextual understanding, aiming to match the creative decisions of skilled editors. This approach boosts productivity for experienced teams and makes advanced video creation accessible to a wider audience. Learn More Product: Captions by Mirage Research: Seeing Voices (technical white paper) Updates: Mirage on X / Twitter Press: TechCrunch, Forbes AI 50, Fast Company Investors Mirage is backed by leading investors and entrepreneurs, including Index Ventures, Kleiner Perkins, Sequoia Capital, Andreessen Horowitz, and General Catalyst. Role Overview: Research Scientist, Video Generation This position is based at Mirage’s headquarters in Union Square, New York City. In-person attendance is required. Mirage seeks a Research Scientist with a focus on video generation. As an early member of the team, this person will help address foundational challenges in generative media. The role involves developing new modeling techniques, designing training methods, and scaling large video models for real-world use. Work in this area shapes systems used by millions of creators. What You Will Do Advance the quality, controllability, and realism of video generation models Focus on areas such as facial expression synthesis and scene understanding Develop and refine modeling and training strategies for large-scale video systems Collaborate with an interdisciplinary team to solve technical and creative challenges in generative media

Welcome to Oscar, where we're redefining health insurance. We're on the lookout for a Senior Data Scientist to become a vital part of our Engineering team. Founded in 2012, Oscar is the first health insurance provider designed around a comprehensive technology platform, prioritizing our members' needs. Our mission is to create a health insurance experience that feels like having a trusted family doctor. About the Role At Oscar, we harness the power of high member engagement and innovative technology—like virtual care and superagent services—to make a significant impact on health outcomes. As a Senior Data Scientist, you'll craft personalized, multi-channel marketing campaigns aimed at influencing key health behaviors among Oscar members. Your responsibilities will include ideating and scoping business cases, designing targeted data pipelines using predictive models, launching campaigns, and monitoring and optimizing them in real-time to determine the most effective marketing strategies. You'll leverage both traditional statistical methods and advanced machine learning techniques to achieve these goals. This position requires close collaboration with our marketing and clinical teams, all focused on a shared objective: reducing medical costs. You will be accountable for each campaign's success and will report directly to the Senior Director of Data Science. Work Location: This is a hybrid role based in our New York City office, Los Angeles office, or Tempe office. It requires a hybrid work schedule of three days in-office each week, with an option for remote work if you reside in Boston or the San Francisco Bay Area. Thursdays are mandatory in-office days for team meetings and events, while the other two office days can be flexible. Pay Transparency: The base salary for this position ranges from $158,400 to $207,900 annually. You will also enjoy a comprehensive benefits package, participation in Oscar's unlimited vacation program, stock equity grants, and annual performance bonuses.

Hello! I'm Brian, Co-Founder of Egra. We are thrilled to announce that we have successfully raised $5.5 million to develop foundational models for interpreting brain signals, and we are eager to welcome our inaugural research scientist to our innovative team.In this role, you will be empowered to take complete ownership of your projects from the outset. Say goodbye to prolonged onboarding processes, the need for excessive approvals, and bureaucratic hurdles. You will collaborate directly with the founders, tackling complex technical challenges and utilizing the resources available to drive solutions. You will have the unique opportunity to shape the research vision, make key architectural choices, and lay the groundwork for our core technology. If you're someone who thrives in an environment that offers high autonomy and desires to make a significant impact on the direction of a pioneering company, this role is perfect for you.Key ResponsibilitiesEEG (electroencephalography) is one of the most challenging real-world signal modalities in machine learning due to its low signal-to-noise ratio, vast subject variability, and inconsistencies across devices. Many shy away from this domain for these reasons.As our founding research scientist, you will collaborate closely with us to discover effective methodologies. Here’s a glimpse into the projects you will spearhead:Developing self-supervised pretraining objectives that enhance generalization across various subjects, devices, and recording conditions.Critically evaluating existing methods (including recent EEG foundation model studies) to identify their limitations across datasets and conditions, particularly under distribution shifts.Creating robust evaluation protocols that effectively differentiate genuine progress from noise, ensuring we maintain rigorous benchmarks.Documenting internal research findings through comprehensive memos that contribute to the lab's collective knowledge — addressing questions like "why model X fails on dataset Y" and "what Z dataset misleads us about".This position is about cultivating a thorough understanding of a modality that remains largely unexplored with modern machine learning approaches and transforming this insight into impactful advancements.Vision for the FutureWe are striving towards a future where thought serves as a direct interface.Imagine composing a message silently as it types itself or navigating an AR environment without any physical interaction. Software that adapts to your cognitive state in real-time. We are developing a universal interface connecting human cognition with digital actions.Our product development encompasses three pivotal layers:A Neural Encoder: a foundational model designed to translate raw EEG data into resilient, reusable embeddings that function seamlessly across diverse devices and recording environments.

Job DescriptionJoin Fauna Robotics as a Lead Research Scientist and spearhead the advancement of innovative manipulation and autonomy systems tailored for humanoid robots navigating intricate, real-world environments. This position is ideal for a distinguished technical leader with a robust research background and a fervent desire to transform pioneering concepts into functional robotic solutions.In this pivotal role, you will be instrumental in shaping the technical strategy of our manipulation and autonomy framework, encompassing problem identification, algorithm development, system integration, and real-world implementation. While this position requires a hands-on, technical approach, it is also envisioned to evolve into a role focused on technical leadership and team development.We are flexible regarding titles for the right candidate, considering Staff, Principal, or VP-level positions, with responsibilities aligned with your experience and potential impact.

Mirage builds an AI-native platform for video production and editing, centered in Union Square, New York City. The platform uses natural language to guide intelligent orchestration, allowing advanced models to understand context and mimic the creative decisions of experienced editors. This approach aims to boost productivity for professional teams and open up video creation to a wider audience. About the Team The team at Mirage brings together people from a range of backgrounds, blending technical and artistic skills to solve tough challenges in generative media. The work goes beyond routine model development, focusing on problems that remain unsolved across the industry. Role Overview: Research Scientist, Large Language Models This early team role offers the chance to shape the core technology behind Mirage. The position involves tackling foundational questions in generative AI and creative tooling, with the potential to influence how people create and edit video for years to come.

Position OverviewArtificial Intelligence stands as one of humanity’s most transformative inventions. At Google DeepMind, our interdisciplinary team of scientists, engineers, and machine learning specialists is dedicated to pushing the boundaries of AI technology. We harness our innovations for widespread societal benefits and scientific advancements, collaborating with partners to tackle critical challenges while prioritizing safety and ethical considerations.About Our TeamWe are on the lookout for talented Research Scientists to join our Robotics division, where our mission is to responsibly develop embodied AI that positively impacts the physical world. This position focuses on ensuring the safe operation of humanoid robots through agentic reasoning, human-robot interaction (HRI) scenarios, and physical safety using VLA models.Role ResponsibilitiesAs a Research Scientist, you will engage in a dynamic variety of projects, including the creation of innovative algorithms and prototype applications, as well as real-world testing with robots both in laboratory settings and practical environments. You will collaborate with large teams to achieve groundbreaking advancements in Robotics AI. We believe that large foundational models, like our Gemini Robotics models, will revolutionize general-purpose robotics. Your work will be integral to shaping the future of robotics technology.Key Responsibilities Include:Designing, implementing, training, and evaluating large-scale models and algorithms for humanoid robotics.Making significant advancements in humanoid safety capabilities with a focus on:Development of algorithms and models to enhance a robot's self-awareness and VLA capabilities.Creating learned policies for effective interactions with humans and handling atypical scenarios, such as actuator malfunctions; Human-Robot Interaction.Writing software to implement and refine research concepts swiftly.Utilizing your expertise across various research domains, including simulation learning, reinforcement learning, vision-language-action models, and humanoid robot control.Collaborating effectively within a large team to meet ambitious research objectives in a fast-paced environment.Generating innovative ideas, designing experiments, and articulating research findings clearly for both internal and external audiences.

Join the City of New York as an Associate Engineer in Building Optimization, where you will play a crucial role in enhancing the efficiency of various municipal buildings. This position offers an exciting opportunity to apply engineering principles and contribute to sustainable practices within the city.

About EliseAIEliseAI is dedicated to transforming the critical sectors of housing and healthcare. We recognize that securing a home and accessing quality healthcare are essential yet often challenging tasks. By seamlessly integrating AI agents into existing workflows, we enhance efficiency, reduce costs, and significantly improve user experiences.Housing: Our platform simplifies the processes for renters—making apartment tours, lease signings, maintenance requests, and communication with property teams effortlessly manageable, all from a centralized hub.Healthcare: We streamline appointment scheduling, intake forms, and patient-provider communication, allowing all parties to prioritize health over administrative burdens.At EliseAI, organizations can decrease manual workloads, enhance accessibility, and create a seamless experience across vital services. Recently, we secured a $250 million Series E funding led by Andreessen Horowitz to further advance our mission.About The RoleWe are in search of exceptional Machine Learning experts to join our dynamic research team. Ideal candidates will possess strong mathematical and quantitative backgrounds, advanced programming skills, and impressive academic credentials, including but not limited to mathematicians, theoretical physicists, and computer scientists, all with a passion for applying their expertise to tackle real-world problems.As a Senior Research Scientist, you will explore cutting-edge challenges in machine learning and large language models, develop predictive algorithms to enhance our AI capabilities, and conduct systematic analyses of extensive datasets. You will lead comprehensive research initiatives aimed at advancing EliseAI's core models and play a pivotal role in shaping our research agenda. If you are eager to leverage your academic experience in a fast-paced startup setting, we invite you to apply.Key ResponsibilitiesIdentify pressing questions in tenant engagement, conversational AI, and LLM safety; convert them into structured projects.Design and execute experiments, develop prototypes, and manage large-scale data analysis.

The New York City Department of Environmental Protection (DEP) is dedicated to safeguarding public health and the environment through the provision of clean drinking water, efficient wastewater treatment, and the reduction of pollution from air, noise, and hazardous materials. As the largest combined municipal water and wastewater utility in the nation, employing nearly 6,000 professionals, DEP is committed to delivering 1.1 billion gallons of high-quality drinking water daily to over 8.3 million residents in New York City and more than 1 million in Upstate New York. Additionally, we manage the collection and treatment of approximately 1.3 billion gallons of wastewater each day.DEP collaborates with various City agencies to implement distributed stormwater management practices, known as “green infrastructure,” throughout the City’s public streets and sidewalks. These innovative practices, including rain gardens, infiltration basins, and porous pavements, are designed to enhance stormwater storage and facilitate the natural infiltration of stormwater into surrounding soils. The in-house Green Infrastructure Maintenance Unit, part of the Bureau of Environmental Planning & Analysis, oversees the operations and maintenance of these facilities, currently managing over 10,000 green infrastructure installations across the boroughs of Queens, Brooklyn, and the Bronx. More details about the NYC Green Infrastructure Program and its various practices can be found online: NYC Green Infrastructure Program.We are seeking a City Research Scientist to join our team and contribute to research on green infrastructure maintenance, data analysis, operational planning, Geographic Information Systems (GIS) mapping, program evaluations, and other related initiatives.Key Responsibilities Include:- Supporting GIS mapping and data management for DEP’s green infrastructure maintenance program.- Generating reports, charts, and graphs for leadership evaluation.- Assisting senior managers with special projects, including in-depth operational data studies and project management for major departmental initiatives.- Utilizing big data, statistical, and visualization tools to analyze complex datasets from various sources, and presenting findings through written reports and presentations.- Timely reviewing and responding to data requests, and assisting with mandated compliance reporting.- Participating in research and development studies regarding green infrastructure maintenance best practices.- Implementing data research projects to address inquiries from senior management concerning green infrastructure maintenance operations.- Making operational recommendations based on existing and projected green infrastructure asset data and locations.Job ID: CITY RESEARCH SCIENTIST - 21744

About EliseAIAt EliseAI, we are dedicated to transforming essential industries such as housing and healthcare. We understand that finding a home and receiving quality healthcare are fundamental needs, yet they can often be challenging to secure. By integrating advanced AI agents into existing workflows, we enhance efficiency, lower costs, and elevate the overall experience for everyone involved.Housing: Our platform streamlines the process for renters to tour apartments, sign leases, submit maintenance requests, and stay connected with property management—all in one convenient location.Healthcare: We simplify scheduling appointments, completing intake forms, and facilitate communication between patients and providers, allowing everyone to focus on health rather than paperwork.With EliseAI, organizations can minimize manual tasks, enhance accessibility, and provide a seamless experience across vital services. Recently, we secured a $250 million Series E funding led by Andreessen Horowitz to propel our mission forward.About the RoleWe are seeking exceptional professionals in Machine Learning and related fields to join our innovative team at EliseAI. This role is ideal for individuals with a strong foundation in mathematics and quantitative analysis—such as mathematicians, theoretical physicists, and computer scientists—who are eager to tackle real-world challenges. As a Junior Research Scientist, you will collaborate with a dynamic team of leading researchers on pioneering projects involving machine learning and large language models, developing predictive models to enhance our AI capabilities and much more. If you thrive in a fast-paced startup environment and are enthusiastic about applying your academic expertise in transformative applications, we would love to hear from you.Note: This position includes a 1-month trial period before transitioning to full-time employment.Key ResponsibilitiesDesign and optimize machine learning architectures to enhance conversational flow.Conduct thorough analyses to inform decision-making and boost the effectiveness of our AI solutions.Collaborate with cross-functional teams to integrate machine learning solutions into our products.

Join abridge as a Senior Research Data Scientist and play a key role in shaping the future of healthcare technology. You will leverage advanced data analytics and machine learning techniques to extract insights from complex datasets, driving innovation in our products and services.Your work will directly impact patient care and improve health outcomes through data-driven decision-making. Collaborate with cross-functional teams to design and implement research projects that contribute to our mission of transforming healthcare.

Join the City of New York as a Senior Engineer in our Building Optimization Team (BOT). In this pivotal role, you will leverage your engineering expertise to optimize energy efficiency in city buildings, contributing to our commitment to sustainability and innovation. You will collaborate with a diverse team of professionals to implement advanced technologies and solutions, ensuring our buildings operate at peak efficiency.

Role overview Decagon seeks a Staff Research Engineer based in New York City. This position helps guide research efforts and supports the development of technical solutions that serve a range of industries. The Staff Research Engineer works alongside a skilled team, taking projects from early ideas through to working implementations. What you will do Advance research initiatives at Decagon through direct engineering contributions Collaborate with team members to design and build new technical solutions Apply technical expertise to projects that impact several sectors Requirements Solid background in both research and engineering Interest in tackling complex technical problems Strong collaborator who values team-based problem solving

Team overview The Server Query team at MongoDB develops and maintains a distributed query engine that powers the MongoDB Query Language. This group manages every phase of query processing, including parsing, optimization, plan selection, and execution. Their work also extends to geospatial search and update systems, directly influencing how users interact with and extract insights from their data. Location and work flexibility This Software Engineer III - Query Optimization position is open to candidates based in New York City, Atlanta, Boston, or remotely from the East Coast. MongoDB supports flexible hours to enable collaboration across time zones. The company’s presence spans North America and Europe, with offices in cities such as Dublin, Berlin, Paris, Amsterdam, London, Sofia, Madrid, and Milan. What you will do Design and build core components for a distributed, flexible-schema document database Tackle complex problems in query optimization and execution Enhance data processing efficiency and user experience for transactional, time-series, and analytical workloads Contribute to all stages of query handling, from parsing through execution Why this role This role offers the opportunity to address challenging technical problems that shape how organizations use and analyze data. Collaborate with engineers who value performance and usability, and help define the future of MongoDB’s distributed query capabilities.