Engineering Manager I - AI Platform - Annotation & Evaluation

The AI platform at Datadog plays a pivotal role in managing all AI infrastructure within the company. Our objective is to deliver cutting-edge tools and platforms that empower data scientists and engineers to effortlessly conduct extensive training and inference tasks. We support various innovative products, including Bits AI, LLMObs, and all our AI research initiatives. As a Manager of the Evaluation & Annotation team, you will be part of a dynamic and rapidly expanding organization. Your role will involve building and scaling the team, defining our technical vision, and shaping the strategic roadmap. Your team will tackle several essential technical challenges, including offline and online evaluation of AI models, designing tools and processes for human annotation, and establishing standards for synthetic and AI-generated datasets. Collaboration is key; you will work closely with other teams within the AI platform organization to ensure a seamless AI development cycle, as well as partner with the Applied AI organization and Datadog's infrastructure and tooling teams to build robust systems from the ground up. At Datadog, we cherish our office culture, which fosters relationships, creativity, and collaboration. We embrace a hybrid work model, allowing our employees to achieve their desired work-life balance.

The Content Platform team at Spotify focuses on connecting listeners with audio they enjoy, while supporting creators and distributors through a reliable and extensive catalog. Within this group, the Annotation Platform Ops team plays a key role in building interconnected datasets that drive Spotify’s machine learning systems for music, podcasts, and audiobooks. By combining human expertise with AI, the team aims to deepen content understanding and enhance the user experience across the platform. What you will do Oversee the collection and management of labeled datasets that support the Content Platform teams. Collaborate closely with Product and Engineering partners in the Content Platform R&D studio. Contribute to the development of datasets used for training, evaluating, and improving models and systems. Support the integration of human input with AI to improve content discovery and personalization. Requirements Interest in machine learning and AI-driven product development. Experience with data annotation, dataset management, or similar operational roles. Comfort working with cross-functional teams, especially in product and engineering. Ability to manage detail-oriented tasks while keeping broader project objectives in mind. Location This position is based in New York, NY.

Toloka Annotators seeks a Freelance Data Annotator to assist with AI training projects. This contract role is remote and open to those located in New York, United States. The work centers on labeling and annotating data to support the improvement of machine learning models and AI algorithms. Key Responsibilities Review data sets and apply labels following detailed project instructions Annotate information to help develop AI systems Support the accuracy and performance of machine learning models used in various applications Location This position is fully remote but requires residency in New York, United States.

Please submit your resume in English and include your English proficiency level. Toloka Annotators brings together people from around the world to contribute to freelance online tasks that help improve artificial intelligence. The platform connects skilled individuals with generative AI projects from leading technology companies, aiming to advance AI by including diverse perspectives and experiences. Role overview As a Freelance AI Trainer – English Annotator, you will support AI systems by helping them better understand and interpret information. Projects can include rating AI-generated content, checking for factual accuracy, or comparing different responses. The type and frequency of tasks depend on current project availability. Main responsibilities Review and analyze datasets, which may include text, images, or videos. Label or categorize content according to detailed project guidelines. Identify and report content that is factually incorrect, sensitive, inappropriate, or unclear. Project details This freelance position is project-based. Tasks are available only when projects are active, and invitations to participate depend on your profile and current project needs. Compensation Pay rates depend on project scope and required expertise. AI trainers can earn up to $23 per hour.

About DaydreamDaydream is an innovative chat-based shopping assistant exclusively tailored for fashion. Our aim is to revolutionize the way individuals discover and explore fashion by delivering a personalized, conversational experience powered by cutting-edge AI and natural language understanding.Supported by leading investors such as Forerunner Ventures, Index Ventures, Google Ventures, and True Ventures, our dedicated team is passionate about redefining the future of shopping.About the RoleAs the Engineering Lead for Platform & AI, you will take ownership of several backend systems at Daydream. This includes managing the catalog data pipeline that drives our product index, overseeing the AI content pipeline that generates landing pages for ad campaigns, and developing the B2B integration layer that allows our search functionality on partner retail websites. Your work will primarily involve Python and Go, focusing heavily on LLM integration, with your contributions directly impacting our product.Key Responsibilities:Catalog Pipeline:Oversee the augmentation pipeline—a multi-step Polars system that executes ML models (image analysis, hero selection, swatches via Vertex AI), standardizes sizes, appends affiliate links, and writes to Delta Lake / GCS.Enhance catalog quality through OOS accuracy, hero image selection, and sizing coverage.Develop and maintain scrapers and mappers for over 100 fashion merchants across various platforms including Shopify and custom sites.Eventually, take charge of the enrichment layer, focusing on attribute extraction, taxonomy, and Elasticsearch indexing.Content Generation Pipeline:Lead the AI content pipeline—a multi-step system utilizing LLM for topic generation, product matching, quality scoring, and landing page assembly.Enhance prompt quality and evaluate LLM output.Advance towards personalized content for logged-in users, email content, and broadened ad formats.B2B Merchant Integration:Create and manage services that expose core Daydream capabilities to merchant partners.Deploy on Kubernetes utilizing Helm and ArgoCD.In All Areas:Collaborate across teams to ensure seamless integration and functionality of systems.

Role overview As Engineering Manager for Applied AI & Platform at norm-ai in New York City, this position leads a team dedicated to bringing artificial intelligence into the company’s platform products. The manager sets direction for projects, supports the technical development of engineers, and plays a key role in shaping the vision for how AI will influence future product offerings. What you will do Guide engineers as they develop and integrate AI technologies into core platforms Oversee project planning and execution to ensure initiatives match company objectives Provide technical leadership and mentorship to help the team achieve strong results Work with stakeholders to define the technology roadmap and platform strategy

Role Overview Ridgeline is looking for a Senior Staff AI Research Engineer to join the AI Platform team in New York, NY. This group focuses on advancing AI research and building practical solutions for complex, real-world problems. The position centers on evaluating machine learning models and large language models (LLMs) to improve their performance and impact. What You Will Do Design and build frameworks, tools, and systems that use advanced AI technologies. Architect and implement end-to-end AI systems that address challenging business needs. Prototype multi-stage processing structures as part of the research-to-production workflow. Develop evaluation frameworks and benchmarks for model accuracy, consistency, and cost-effectiveness. Work closely with business teams to validate and refine AI-powered tools. Create reusable AI capabilities that can be applied across different business areas, with a focus on investment management operations. About the Team The AI Platform team at Ridgeline drives the adoption of state-of-the-art AI across the company. The group values innovative thinking and practical application, aiming to deliver solutions that shape the future of investment management.

About AlphaSense: AlphaSense is the go-to platform for the world's leading companies, enabling them to eliminate uncertainty in their decision-making processes. With a robust AI-driven market intelligence and search system, AlphaSense provides invaluable insights from trustworthy content. Our extensive repository includes equity research, company filings, event transcripts, expert calls, news articles, trade journals, and proprietary client research.With the acquisition of Tegus in 2024, we are furthering our mission to empower professionals to make informed decisions through AI-enhanced market intelligence. This collaboration will drive growth, foster innovation, and expand our content offerings, combining our respective strengths to deliver even deeper insights from a vast array of content collections. Trusted by over 6,000 enterprise clients, including many Fortune 500 companies, AlphaSense was founded in 2011 and is headquartered in New York City, boasting over 2,000 global employees across numerous locations including the U.S., U.K., Finland, India, Singapore, Canada, and Ireland. We invite you to join our team!About the Team:Our diverse Product & Engineering team thrives on innovation, collaboration, and continuous enhancement of our platform. We provide a vibrant work environment where team members can develop their skills and contribute to pioneering technology that is shaping the future of AI and information retrieval.At AlphaSense, we recognize that diverse experiences and perspectives are vital to our success. We are dedicated to fostering an inclusive workplace where all employees feel appreciated and empowered to express their true selves.About the RoleWe are on the lookout for an experienced engineering leader to revolutionize the construction and operation of our AI-powered systems at scale. You will join a talented group of engineers who have developed advanced AI applications, and your goal will be to implement world-class engineering practices that ensure these innovations operate reliably for our enterprise clientele.This is a distinct opportunity for a skilled engineer who excels at building resilient platforms, mentoring high-performing teams, and establishing engineering excellence. You will have considerable autonomy to influence our technical architecture while collaborating with cutting-edge AI models and systems that drive market intelligence for some of the world's foremost companies.

The AI platform at Datadog is pivotal in managing our comprehensive AI infrastructure. Our core mission centers around providing advanced tools and platforms that empower engineers and data scientists to perform large-scale training and inference seamlessly. We are the driving force behind innovative products such as Bits AI, LLMObs, and various AI research initiatives. You will be joining a rapidly growing and dynamic team that plays a crucial role in shaping the future of Datadog. As a leader, you will have the opportunity to help build and expand the team, establish our technical vision, and contribute to the development of our strategic roadmap. Your role will include managing other managers and influencing the organizational structure by participating in the recruitment of future leaders and individual contributors. You will collaborate closely with partner teams within the AI platform organization to ensure a cohesive AI development cycle. Additionally, you will work hand-in-hand with the Applied AI organization, product engineering teams, and Datadog's infrastructure and tooling teams to develop systems from the ground up. At Datadog, we prioritize our office culture—the relationships it fosters, the creativity it inspires, and the collaboration that arises from working together. We embrace a hybrid work model to allow our employees to achieve a work-life balance that suits their individual needs.

Spotify Technology S.A. is looking for an Annotation QA Analyst to join the Content Platform team in New York, NY. This role focuses on supporting the creation of labeled datasets that train, evaluate, and enhance the models and systems behind Spotify’s music, podcast, and audiobook features. The work influences how millions of listeners discover and interact with content on mobile devices, desktop, smart speakers, TVs, and vehicles. Team focus The Annotation Platform Operations group collaborates with Product and Engineering teams within Spotify’s Content Platform R&D studio. Their goal is to build interconnected datasets that combine machine learning with human insight, driving better recommendations and new features for users worldwide. What you will do Assist in creating and ensuring the quality of labeled datasets for the Content Platform. Work with cross-functional teams to maintain data accuracy and consistency for machine learning and AI projects. Help improve the models and systems that shape music, podcast, and audiobook experiences. Who you are Curious about how data, technology, and user experience intersect. Collaborative, and able to work with both technical and non-technical colleagues. Motivated to help create seamless and intuitive experiences for Spotify’s global audience. This position is based in New York, NY.

Join our innovative team at Harvey as a Software Engineer specializing in AI Platform development. In this role, you will contribute to the design and implementation of cutting-edge AI solutions, collaborating with cross-functional teams to enhance our platform's capabilities. Your expertise will drive improvements in functionality and performance, ensuring our products remain at the forefront of technology.

AKQA is seeking an AI Platforms Enablement Manager based in New York. The focus of this position is on integrating advanced AI technologies to enhance the company’s product offerings. Collaboration is central, as this role works with teams from various disciplines to deliver AI solutions that fit client needs. Key responsibilities Coordinate with teams across different functions to implement AI technologies. Support efforts to integrate AI into both existing and new products. Help ensure that AI solutions meet client requirements and support business objectives.

Who We AreAddepar is a leading global data and AI platform that empowers investment professionals to transform complex financial data into actionable insights. By unifying portfolio, market, and client data, Addepar delivers AI-driven insights seamlessly integrated within investment and client workflows. Serving over 1,400 firms across nearly 60 countries, we manage and advise on assets totaling almost $9 trillion. Our open platform collaborates with approximately 650 software, data, and consulting partners to enhance investment operations for organizations of all sizes and complexities. With a presence in New York City, Salt Lake City, London, Edinburgh, Pune, Dubai, Geneva, and São Paulo, Addepar is committed to supporting clients worldwide.The RoleWe are on the lookout for a Senior AI Engineer to become a pivotal member of our rapidly expanding AI Platform team. This team is dedicated to creating innovative and transformative solutions leveraging AI technology across our product suite.In this high-impact role, you will architect, lead, and execute the core AI capabilities that power our platform. Ideal candidates will thrive at the cutting edge of applied AI, showcasing a constant drive for delivering results. You will manage the complete lifecycle of AI-native products, ensuring the integration of advanced AI systems into robust, scalable, and high-performing production environments.

What We DoAt Rillet, we empower accounting and finance teams with cutting-edge solutions. Our clients are the financial masterminds of their organizations, and we are dedicated to providing them with unprecedented speed, precision, and insights for their financial operations.Rillet is an AI-driven ERP designed to achieve a zero-day close. Our unique unified source-of-truth data model, extensive native integrations (such as Stripe, Ramp, Salesforce, etc.), and automated and auditable workflows set us apart. With capabilities for multi-entity consolidation and a rapidly growing array of specialized AI agents (including accrual, audit, P&L flux, and board decks), we consistently achieve a perfect customer satisfaction score. High-growth AI companies like Mercor and Function Health appreciate our agility, as their financial infrastructure must scale in tandem with their growth.This expansive market is ripe for disruption. We have secured $100M in funding from top-tier investors including Sequoia, a16z, Iconiq, Oak HC/FT, and First Round to enable everyone to harness the power of AI in their financial operations.Who We AreThe pace at Rillet is not for the faint-hearted. Intelligence is merely the starting point. To thrive here, one must exhibit exceptional speed, agency, and adaptability.Successful Rilleteers take initiative; they internalize our mission, craft innovative strategies, and deliver superior results that exceed expectations.Our focus is on our customers. The most successful Rilleteers are driven by the desire to deliver crucial outcomes, even if they deviate from the original plan.You don’t need to be an accountant for this role, but an appreciation for the value our customers can create with the right financial tools is essential. Rilleteers find joy in powering the financial systems of the world’s fastest-growing companies.Who We NeedWe are seeking an Engineering Manager, Platform, who embodies both technical leadership and team development. This individual will shape the foundational infrastructure upon which Rillet scales and nurture the team that makes this possible.What You'll DoDefine the future. Collaborate on Rillet's long-term platform vision and infrastructure roadmap as we expand.Build strategically. Work alongside product and engineering leaders to drive investment in the foundational elements that enable all our initiatives.Facilitate impactful solutions that resonate with our mission and vision.

Role overview Harvey seeks a Staff Software Engineer to take a lead role in shaping its AI Platform. Based in New York, this position focuses on designing, developing, and launching software solutions that use artificial intelligence technologies. What you will do Lead the architecture and implementation of projects that rely on AI technologies Collaborate with engineering, product, and other teams to enhance and grow the platform Maintain high software quality and ensure solutions align with user needs throughout development Location This role is located in New York.

We are seeking a talented Senior Platform Engineer to join our dynamic team at Blackbird Labs Inc. in New York. In this pivotal role, you will leverage your expertise in infrastructure and artificial intelligence to build and enhance our platforms, ensuring they are robust, scalable, and efficient.You will work closely with cross-functional teams to architect solutions that drive innovation and enhance performance. This is an excellent opportunity for an experienced engineer looking to make a significant impact in a fast-paced environment.

DiligenceSquared is in search of a pioneering Backend Engineer to join our team as we revolutionize the landscape of market due diligence through cutting-edge AI technology. In this foundational role, you will be instrumental in designing the architecture for our AI-driven engine, which coordinates autonomous research agents and voice AI systems to produce innovative market reports tailored for investment professionals, including those in Private Equity, Hedge Funds, Private Credit, and Corporate M&A.About DiligenceSquaredAt DiligenceSquared, we are transforming commercial due diligence for Private Equity funds. Backed by Y Combinator and having successfully raised a substantial Seed round, we are proud to serve some of the globe's largest PE funds. The market opportunity exceeds $10 billion annually, with PE firms spending up to $1 million per report from consulting giants such as McKinsey, BCG, and Bain. Our AI agents streamline this process, delivering faster, cost-effective, and fully auditable results, linking every claim to its source.Our founding team comprises seasoned professionals from Blackstone and BCG, bringing invaluable insights into the market's needs, which we are now automating.Your Responsibilities:Develop comprehensive product features and experiences from start to finish, including database models, API endpoints, and their integration with UI components for our web and AI Voice Agent application.Design and implement new AI-driven modules from the ground up (e.g., market sizing, competitive analysis) that will become core functionalities of our research platform.Build and maintain product foundations that include AI agent orchestration, voice AI pipelines, application and API performance, and intelligent automations.Architect scalable backend services featuring complex asynchronous processing and background task orchestration.Continuously improve the product by applying insights gained from each project, ensuring we progress by 1% every day (the Law of Compounding is real, especially for a team founded by investment professionals).Qualifications:Minimum of 3 years of professional experience in Python backend development.Proven expertise in building production-ready APIs using frameworks like FastAPI, Django, or equivalent.Experience in developing agentic systems leveraging large language model platforms (e.g., Anthropic, OpenAI).Hands-on experience with LLMs in a production environment, focusing on building reliable agentic systems rather than just API calls.Knowledge of PostgreSQL and SQL database design.Strong problem-solving and analytical skills with a passion for innovative technology.

Databricks builds the data and AI infrastructure that helps organizations solve complex problems, from modernizing transportation to accelerating medical research. The platform supports teams in uncovering insights and improving operations through advanced data and AI tools. Role Overview This Senior Software Engineer position sits within the New York City Engineering office. The team focuses on creating new products from the ground up, using Databricks’ strengths in data and AI to build specialized AI applications for both technical and business audiences. The environment combines the energy of a startup with the backing of Databricks’ established resources. What You Will Do Design and build advanced interfaces for Generative AI agents that handle complex workflows, ensuring transparency and human oversight. Work closely with product managers, designers, and engineers to deliver intuitive, scalable solutions that drive user and business growth. Contribute hands-on as a full-stack developer, delivering user-centered experiences. Develop features that support product-led growth, including seamless onboarding and sharing tools. Help define the direction of agent-based applications at Databricks, collaborating with cross-functional teams. Lead the design, development, and maintenance of end-to-end AI systems that are reliable, scalable, and efficient.

The Electrical Maintenance Supervisor plays a pivotal role in supporting the Plant Engineer by effectively leading both salaried and hourly personnel across various aspects of plant engineering, including General Maintenance, Cold End Mechanization, and Batch and Furnace departments. This position is responsible for the installation, repair, and maintenance of all plant systems, equipment, grounds, and facilities, while ensuring compliance with local, state, and federal regulations related to environmental affairs, OSHA, NFPA, and other governing bodies.Key Responsibilities:Assist in the direction and implementation of preventive maintenance programs.Conduct regular inspections of all plant systems, equipment, facilities, and grounds, implementing corrective actions as necessary and overseeing upgrades.Ensure the quality of work performed by maintenance and production staff in the Electrical / Electronic Technician group.Coordinate and supervise all construction and service work executed by external contractors as required.Oversee health and safety initiatives addressing ergonomic factors.Supervise the training of personnel to ensure electricians and electronic technicians are proficient in their roles, maintaining efficiency and high standards.Communicate and enforce adherence to prescribed safety and environmental regulations.Ensure the proper use of safety equipment and compliance with company safety policies.May oversee aspects of the plant apprenticeship program.Qualifications:A strong background in maintenance as an Electrician or Electronic Technician within an industrial setting.Comprehensive knowledge of Plant Electrical Systems, Control Systems, PLCs, AC Motor Drives, Robots, and Quality Inspection Systems, including Hot End Electronics.Experience with Lean Six Sigma principles, fostering a culture of continuous improvement among all relevant personnel.Familiarity with maintenance management software (preferably SAP).Excellent communication skills to effectively engage with all organizational levels.Reporting Structure: This position reports directly to the Plant Engineer.

The mission of The New York Times is to seek the truth and help people understand the world. Independent journalism is at the core of our operations, driving us to report from nearly 160 countries and deliver journalism that is engaging and worth paying for.About the RoleThe New York Times is looking for a talented Software Engineer to join our New AI Products & Platforms team. This innovative group is dedicated to creating cutting-edge AI experiences for our readers.We are in search of a rapid prototyper who is passionate about building real products that provide exceptional user experiences. You will operate at the crossroads of applied AI and consumer products, transforming emerging technologies—such as language models, content embeddings, and semantic search—into features that enable Times readers to discover, understand, and engage with our content more deeply. You'll be part of a team that values strong editorial judgment and independence.To succeed in this role, you should have a proven history of delivering software solutions, a strong grasp of the modern web stack, and hands-on experience with large language models (LLMs) in production.This is a hybrid position based at our headquarters in New York City, reporting directly to the VP of Engineering for New AI Products and Platforms. You can expect to be in the office at least 2 days a week.Responsibilities:Prototype, iterate, and launch LLM- and embedding-powered reader experiences from initial concepts to production alongside other engineers and cross-functional teams.Develop across the full stack: from Node.js/TypeScript backends to React frontends, integrating AI capabilities seamlessly.