Manager II, Engineering - AI Platform Training, Serving and Storage

The AI platform at Datadog is pivotal in managing our comprehensive AI infrastructure. Our core mission centers around providing advanced tools and platforms that empower engineers and data scientists to perform large-scale training and inference seamlessly. We are the driving force behind innovative products such as Bits AI, LLMObs, and various AI research initiatives. You will be joining a rapidly growing and dynamic team that plays a crucial role in shaping the future of Datadog. As a leader, you will have the opportunity to help build and expand the team, establish our technical vision, and contribute to the development of our strategic roadmap. Your role will include managing other managers and influencing the organizational structure by participating in the recruitment of future leaders and individual contributors. You will collaborate closely with partner teams within the AI platform organization to ensure a cohesive AI development cycle. Additionally, you will work hand-in-hand with the Applied AI organization, product engineering teams, and Datadog's infrastructure and tooling teams to develop systems from the ground up. At Datadog, we prioritize our office culture—the relationships it fosters, the creativity it inspires, and the collaboration that arises from working together. We embrace a hybrid work model to allow our employees to achieve a work-life balance that suits their individual needs.

About DaydreamDaydream is an innovative chat-based shopping assistant exclusively tailored for fashion. Our aim is to revolutionize the way individuals discover and explore fashion by delivering a personalized, conversational experience powered by cutting-edge AI and natural language understanding.Supported by leading investors such as Forerunner Ventures, Index Ventures, Google Ventures, and True Ventures, our dedicated team is passionate about redefining the future of shopping.About the RoleAs the Engineering Lead for Platform & AI, you will take ownership of several backend systems at Daydream. This includes managing the catalog data pipeline that drives our product index, overseeing the AI content pipeline that generates landing pages for ad campaigns, and developing the B2B integration layer that allows our search functionality on partner retail websites. Your work will primarily involve Python and Go, focusing heavily on LLM integration, with your contributions directly impacting our product.Key Responsibilities:Catalog Pipeline:Oversee the augmentation pipeline—a multi-step Polars system that executes ML models (image analysis, hero selection, swatches via Vertex AI), standardizes sizes, appends affiliate links, and writes to Delta Lake / GCS.Enhance catalog quality through OOS accuracy, hero image selection, and sizing coverage.Develop and maintain scrapers and mappers for over 100 fashion merchants across various platforms including Shopify and custom sites.Eventually, take charge of the enrichment layer, focusing on attribute extraction, taxonomy, and Elasticsearch indexing.Content Generation Pipeline:Lead the AI content pipeline—a multi-step system utilizing LLM for topic generation, product matching, quality scoring, and landing page assembly.Enhance prompt quality and evaluate LLM output.Advance towards personalized content for logged-in users, email content, and broadened ad formats.B2B Merchant Integration:Create and manage services that expose core Daydream capabilities to merchant partners.Deploy on Kubernetes utilizing Helm and ArgoCD.In All Areas:Collaborate across teams to ensure seamless integration and functionality of systems.

Collaborative Efforts Enhance Streaming Success. Roku is revolutionizing the television viewing experienceAs the leading TV streaming platform in the U.S., Canada, and Mexico, Roku is on a mission to power every television worldwide. We pioneered the concept of streaming to the TV, and our goal is to be the platform that unites the entire TV ecosystem. We connect viewers with the content they cherish, allow content creators to build and monetize expansive audiences, and provide advertisers with innovative tools to engage consumers effectively.From your first day at Roku, you'll make impactful contributions. We are a rapidly growing public company where every team member plays a crucial role. Join us to bring joy to millions of TV streamers globally while gaining valuable experience across diverse areas. About the RoleA robust, reliable, and scalable advertising platform is essential for supporting and expanding Roku’s rapidly growing advertising business. The Ad Engineering team is tasked with building this platform. The Ad Serving team designs, develops, deploys, and manages Roku’s Supply-Side, Ad Mediation, and Demand-Side platforms, which are central to Roku’s ad monetization strategy. We are seeking a visionary leader to steer the Ad Mediation division—creating significant strategic, architectural, and cross-functional influence across Roku’s advertising platform. For New York Only - The anticipated annual salary for this role ranges from $360,000 to $440,000. Compensation packages are tailored based on individual factors, including skills, certifications, and geographical location. This position includes benefits such as health insurance, equity awards, life insurance, disability coverage, parental leave, wellness programs, and paid time off.What You’ll Be DoingDefine and drive a multi-year technical strategy, influencing architecture across various teams.Establish the long-term technical vision and take complete responsibility for the scalability, stability, and performance of Roku’s ad serving mediation platforms—systems operating at a large scale with significant revenue implications.Influence product direction by gaining a deep understanding of Roku’s advertising business, marketplace dynamics, and long-term monetization strategies.Lead and nurture a high-performing engineering team.

Role overview As Engineering Manager for Applied AI & Platform at norm-ai in New York City, this position leads a team dedicated to bringing artificial intelligence into the company’s platform products. The manager sets direction for projects, supports the technical development of engineers, and plays a key role in shaping the vision for how AI will influence future product offerings. What you will do Guide engineers as they develop and integrate AI technologies into core platforms Oversee project planning and execution to ensure initiatives match company objectives Provide technical leadership and mentorship to help the team achieve strong results Work with stakeholders to define the technology roadmap and platform strategy

About CoreWeave CoreWeave is The Essential Cloud for AI™. The company provides a platform of technology, tools, and teams that support innovators building and scaling AI solutions. CoreWeave's infrastructure is trusted by leading AI labs, startups, and enterprises for its performance and reliability. CoreWeave is publicly traded on Nasdaq (CRWV) as of March 2025. Learn more at www.coreweave.com. Role Overview: Senior Storage Engineer As part of the Storage Engine Team, the Senior Storage Engineer designs and develops managed storage products that meet the needs of demanding AI workloads. This role involves close collaboration with engineering teams across infrastructure, compute, and platform to ensure storage services are reliable, scalable, and high-performing. What You Will Do Design and build distributed storage solutions that support scaling for data-intensive AI workloads. Develop exabyte-scale, S3-compatible object storage and integrate dedicated storage clusters for a variety of customer environments. Apply technologies such as RDMA, GPU Direct Storage, and distributed filesystem protocols (NFS, FUSE) to improve storage performance and efficiency. Lead projects to strengthen the reliability, durability, security, and observability of the storage stack. Work with operations teams to monitor, troubleshoot, and refine storage systems in production settings. Create metrics and dashboards that track storage performance and health. Analyze telemetry and system data to identify ways to improve throughput, latency, and resilience. Collaborate with platform, product, and infrastructure teams to deliver seamless storage capabilities across the stack. Mentor other engineers and share knowledge on building distributed, high-performance storage systems. Locations Livingston, NJ / New York, NY / Sunnyvale, CA / Bellevue, WA

Submit your CV in English and include your English proficiency level in the application. This freelance, project-based role with Mindrift connects electrical engineers and Python specialists to AI training projects for leading technology companies. Assignments focus on evaluating, testing, and improving AI systems through the creation and validation of challenging engineering problems. Role overview Freelance Electrical Engineers & Python Specialists work on projects that require designing computational problems reflecting real-world engineering workflows. Tasks often include: Developing engineering problems that simulate practical scenarios Creating problems that involve Python programming for calculations and simulations Ensuring problems use numerical methods or iterative solutions and are computationally demanding Designing scenarios related to system design, optimization, or analysis Basing tasks on actual research challenges or applied engineering cases Validating solutions in Python using standard engineering libraries Documenting clear problem statements and verified solutions Requirements Degree in Electrical Engineering or a closely related field Strong Python skills for numerical validation; familiarity with MATLAB, R, C, SQL, Numpy, Pandas, SciPy, or similar libraries is valued Minimum of 2 years of experience in applied engineering, research, or teaching Understanding of practical engineering constraints and approximations Excellent written English (C1 level or higher) Professional certifications (such as CMME, SAS Certifications, CAP) and international or applied project experience are a plus Project commitment During active project periods, the expected commitment is approximately 10–20 hours per week. Actual hours may shift based on project needs. Compensation Contributors can earn up to $69 per hour, depending on expertise and project pace. Compensation varies by project scope, complexity, and required skills. Other projects on the platform may offer different rates. Application process Apply Pass qualification(s) Join a project Complete assigned tasks Receive compensation Location: Remote , New York, United States

Role Overview Ridgeline is looking for a Senior Staff AI Research Engineer to join the AI Platform team in New York, NY. This group focuses on advancing AI research and building practical solutions for complex, real-world problems. The position centers on evaluating machine learning models and large language models (LLMs) to improve their performance and impact. What You Will Do Design and build frameworks, tools, and systems that use advanced AI technologies. Architect and implement end-to-end AI systems that address challenging business needs. Prototype multi-stage processing structures as part of the research-to-production workflow. Develop evaluation frameworks and benchmarks for model accuracy, consistency, and cost-effectiveness. Work closely with business teams to validate and refine AI-powered tools. Create reusable AI capabilities that can be applied across different business areas, with a focus on investment management operations. About the Team The AI Platform team at Ridgeline drives the adoption of state-of-the-art AI across the company. The group values innovative thinking and practical application, aiming to deliver solutions that shape the future of investment management.

About AlphaSense: AlphaSense is the go-to platform for the world's leading companies, enabling them to eliminate uncertainty in their decision-making processes. With a robust AI-driven market intelligence and search system, AlphaSense provides invaluable insights from trustworthy content. Our extensive repository includes equity research, company filings, event transcripts, expert calls, news articles, trade journals, and proprietary client research.With the acquisition of Tegus in 2024, we are furthering our mission to empower professionals to make informed decisions through AI-enhanced market intelligence. This collaboration will drive growth, foster innovation, and expand our content offerings, combining our respective strengths to deliver even deeper insights from a vast array of content collections. Trusted by over 6,000 enterprise clients, including many Fortune 500 companies, AlphaSense was founded in 2011 and is headquartered in New York City, boasting over 2,000 global employees across numerous locations including the U.S., U.K., Finland, India, Singapore, Canada, and Ireland. We invite you to join our team!About the Team:Our diverse Product & Engineering team thrives on innovation, collaboration, and continuous enhancement of our platform. We provide a vibrant work environment where team members can develop their skills and contribute to pioneering technology that is shaping the future of AI and information retrieval.At AlphaSense, we recognize that diverse experiences and perspectives are vital to our success. We are dedicated to fostering an inclusive workplace where all employees feel appreciated and empowered to express their true selves.About the RoleWe are on the lookout for an experienced engineering leader to revolutionize the construction and operation of our AI-powered systems at scale. You will join a talented group of engineers who have developed advanced AI applications, and your goal will be to implement world-class engineering practices that ensure these innovations operate reliably for our enterprise clientele.This is a distinct opportunity for a skilled engineer who excels at building resilient platforms, mentoring high-performing teams, and establishing engineering excellence. You will have considerable autonomy to influence our technical architecture while collaborating with cutting-edge AI models and systems that drive market intelligence for some of the world's foremost companies.

The AI platform at Datadog plays a pivotal role in managing all AI infrastructure within the company. Our objective is to deliver cutting-edge tools and platforms that empower data scientists and engineers to effortlessly conduct extensive training and inference tasks. We support various innovative products, including Bits AI, LLMObs, and all our AI research initiatives. As a Manager of the Evaluation & Annotation team, you will be part of a dynamic and rapidly expanding organization. Your role will involve building and scaling the team, defining our technical vision, and shaping the strategic roadmap. Your team will tackle several essential technical challenges, including offline and online evaluation of AI models, designing tools and processes for human annotation, and establishing standards for synthetic and AI-generated datasets. Collaboration is key; you will work closely with other teams within the AI platform organization to ensure a seamless AI development cycle, as well as partner with the Applied AI organization and Datadog's infrastructure and tooling teams to build robust systems from the ground up. At Datadog, we cherish our office culture, which fosters relationships, creativity, and collaboration. We embrace a hybrid work model, allowing our employees to achieve their desired work-life balance.

Join our innovative team at Harvey as a Software Engineer specializing in AI Platform development. In this role, you will contribute to the design and implementation of cutting-edge AI solutions, collaborating with cross-functional teams to enhance our platform's capabilities. Your expertise will drive improvements in functionality and performance, ensuring our products remain at the forefront of technology.

AKQA is seeking an AI Platforms Enablement Manager based in New York. The focus of this position is on integrating advanced AI technologies to enhance the company’s product offerings. Collaboration is central, as this role works with teams from various disciplines to deliver AI solutions that fit client needs. Key responsibilities Coordinate with teams across different functions to implement AI technologies. Support efforts to integrate AI into both existing and new products. Help ensure that AI solutions meet client requirements and support business objectives.

Who We AreAddepar is a leading global data and AI platform that empowers investment professionals to transform complex financial data into actionable insights. By unifying portfolio, market, and client data, Addepar delivers AI-driven insights seamlessly integrated within investment and client workflows. Serving over 1,400 firms across nearly 60 countries, we manage and advise on assets totaling almost $9 trillion. Our open platform collaborates with approximately 650 software, data, and consulting partners to enhance investment operations for organizations of all sizes and complexities. With a presence in New York City, Salt Lake City, London, Edinburgh, Pune, Dubai, Geneva, and São Paulo, Addepar is committed to supporting clients worldwide.The RoleWe are on the lookout for a Senior AI Engineer to become a pivotal member of our rapidly expanding AI Platform team. This team is dedicated to creating innovative and transformative solutions leveraging AI technology across our product suite.In this high-impact role, you will architect, lead, and execute the core AI capabilities that power our platform. Ideal candidates will thrive at the cutting edge of applied AI, showcasing a constant drive for delivering results. You will manage the complete lifecycle of AI-native products, ensuring the integration of advanced AI systems into robust, scalable, and high-performing production environments.

What We DoAt Rillet, we empower accounting and finance teams with cutting-edge solutions. Our clients are the financial masterminds of their organizations, and we are dedicated to providing them with unprecedented speed, precision, and insights for their financial operations.Rillet is an AI-driven ERP designed to achieve a zero-day close. Our unique unified source-of-truth data model, extensive native integrations (such as Stripe, Ramp, Salesforce, etc.), and automated and auditable workflows set us apart. With capabilities for multi-entity consolidation and a rapidly growing array of specialized AI agents (including accrual, audit, P&L flux, and board decks), we consistently achieve a perfect customer satisfaction score. High-growth AI companies like Mercor and Function Health appreciate our agility, as their financial infrastructure must scale in tandem with their growth.This expansive market is ripe for disruption. We have secured $100M in funding from top-tier investors including Sequoia, a16z, Iconiq, Oak HC/FT, and First Round to enable everyone to harness the power of AI in their financial operations.Who We AreThe pace at Rillet is not for the faint-hearted. Intelligence is merely the starting point. To thrive here, one must exhibit exceptional speed, agency, and adaptability.Successful Rilleteers take initiative; they internalize our mission, craft innovative strategies, and deliver superior results that exceed expectations.Our focus is on our customers. The most successful Rilleteers are driven by the desire to deliver crucial outcomes, even if they deviate from the original plan.You don’t need to be an accountant for this role, but an appreciation for the value our customers can create with the right financial tools is essential. Rilleteers find joy in powering the financial systems of the world’s fastest-growing companies.Who We NeedWe are seeking an Engineering Manager, Platform, who embodies both technical leadership and team development. This individual will shape the foundational infrastructure upon which Rillet scales and nurture the team that makes this possible.What You'll DoDefine the future. Collaborate on Rillet's long-term platform vision and infrastructure roadmap as we expand.Build strategically. Work alongside product and engineering leaders to drive investment in the foundational elements that enable all our initiatives.Facilitate impactful solutions that resonate with our mission and vision.

Role overview Harvey seeks a Staff Software Engineer to take a lead role in shaping its AI Platform. Based in New York, this position focuses on designing, developing, and launching software solutions that use artificial intelligence technologies. What you will do Lead the architecture and implementation of projects that rely on AI technologies Collaborate with engineering, product, and other teams to enhance and grow the platform Maintain high software quality and ensure solutions align with user needs throughout development Location This role is located in New York.

We are seeking a talented Senior Platform Engineer to join our dynamic team at Blackbird Labs Inc. in New York. In this pivotal role, you will leverage your expertise in infrastructure and artificial intelligence to build and enhance our platforms, ensuring they are robust, scalable, and efficient.You will work closely with cross-functional teams to architect solutions that drive innovation and enhance performance. This is an excellent opportunity for an experienced engineer looking to make a significant impact in a fast-paced environment.

Scale AI is seeking a Senior AI Infrastructure Engineer to help build and refine the company’s Training Platform. This position centers on designing, implementing, and improving infrastructure that supports machine learning teams as they train and deploy models. Role overview This engineer will work closely with colleagues across different functions to create solutions that make AI systems more efficient. The focus is on enabling faster, more reliable model training and deployment. Key responsibilities Design and build infrastructure for AI model training Implement and optimize systems to support machine learning workflows Collaborate with teams throughout the company to improve platform capabilities Locations This role is based in San Francisco, Seattle, or New York.

DiligenceSquared is in search of a pioneering Backend Engineer to join our team as we revolutionize the landscape of market due diligence through cutting-edge AI technology. In this foundational role, you will be instrumental in designing the architecture for our AI-driven engine, which coordinates autonomous research agents and voice AI systems to produce innovative market reports tailored for investment professionals, including those in Private Equity, Hedge Funds, Private Credit, and Corporate M&A.About DiligenceSquaredAt DiligenceSquared, we are transforming commercial due diligence for Private Equity funds. Backed by Y Combinator and having successfully raised a substantial Seed round, we are proud to serve some of the globe's largest PE funds. The market opportunity exceeds $10 billion annually, with PE firms spending up to $1 million per report from consulting giants such as McKinsey, BCG, and Bain. Our AI agents streamline this process, delivering faster, cost-effective, and fully auditable results, linking every claim to its source.Our founding team comprises seasoned professionals from Blackstone and BCG, bringing invaluable insights into the market's needs, which we are now automating.Your Responsibilities:Develop comprehensive product features and experiences from start to finish, including database models, API endpoints, and their integration with UI components for our web and AI Voice Agent application.Design and implement new AI-driven modules from the ground up (e.g., market sizing, competitive analysis) that will become core functionalities of our research platform.Build and maintain product foundations that include AI agent orchestration, voice AI pipelines, application and API performance, and intelligent automations.Architect scalable backend services featuring complex asynchronous processing and background task orchestration.Continuously improve the product by applying insights gained from each project, ensuring we progress by 1% every day (the Law of Compounding is real, especially for a team founded by investment professionals).Qualifications:Minimum of 3 years of professional experience in Python backend development.Proven expertise in building production-ready APIs using frameworks like FastAPI, Django, or equivalent.Experience in developing agentic systems leveraging large language model platforms (e.g., Anthropic, OpenAI).Hands-on experience with LLMs in a production environment, focusing on building reliable agentic systems rather than just API calls.Knowledge of PostgreSQL and SQL database design.Strong problem-solving and analytical skills with a passion for innovative technology.

Databricks builds the data and AI infrastructure that helps organizations solve complex problems, from modernizing transportation to accelerating medical research. The platform supports teams in uncovering insights and improving operations through advanced data and AI tools. Role Overview This Senior Software Engineer position sits within the New York City Engineering office. The team focuses on creating new products from the ground up, using Databricks’ strengths in data and AI to build specialized AI applications for both technical and business audiences. The environment combines the energy of a startup with the backing of Databricks’ established resources. What You Will Do Design and build advanced interfaces for Generative AI agents that handle complex workflows, ensuring transparency and human oversight. Work closely with product managers, designers, and engineers to deliver intuitive, scalable solutions that drive user and business growth. Contribute hands-on as a full-stack developer, delivering user-centered experiences. Develop features that support product-led growth, including seamless onboarding and sharing tools. Help define the direction of agent-based applications at Databricks, collaborating with cross-functional teams. Lead the design, development, and maintenance of end-to-end AI systems that are reliable, scalable, and efficient.

The mission of The New York Times is to seek the truth and help people understand the world. Independent journalism is at the core of our operations, driving us to report from nearly 160 countries and deliver journalism that is engaging and worth paying for.About the RoleThe New York Times is looking for a talented Software Engineer to join our New AI Products & Platforms team. This innovative group is dedicated to creating cutting-edge AI experiences for our readers.We are in search of a rapid prototyper who is passionate about building real products that provide exceptional user experiences. You will operate at the crossroads of applied AI and consumer products, transforming emerging technologies—such as language models, content embeddings, and semantic search—into features that enable Times readers to discover, understand, and engage with our content more deeply. You'll be part of a team that values strong editorial judgment and independence.To succeed in this role, you should have a proven history of delivering software solutions, a strong grasp of the modern web stack, and hands-on experience with large language models (LLMs) in production.This is a hybrid position based at our headquarters in New York City, reporting directly to the VP of Engineering for New AI Products and Platforms. You can expect to be in the office at least 2 days a week.Responsibilities:Prototype, iterate, and launch LLM- and embedding-powered reader experiences from initial concepts to production alongside other engineers and cross-functional teams.Develop across the full stack: from Node.js/TypeScript backends to React frontends, integrating AI capabilities seamlessly.

Databricks builds data and AI infrastructure that helps organizations solve real-world problems, from improving transportation to driving medical breakthroughs. The company was founded by engineers who care deeply about customers and technical challenges. Teams work on everything from advanced UI/UX for data tools to scaling services across millions of virtual machines. This Senior Staff Software Engineer role is based in New York City. As one of the first engineers in the NYC office, you will join a small, agile group focused on launching new products from scratch. The team’s mission: use Databricks’ strengths in data and AI to create vertical AI applications for both technical and business users. The environment combines the energy of a startup with the backing of a major technology company. Your Impact Design advanced interfaces for GenAI agents that support complex workflows, with a focus on transparency and human oversight. Work closely with product management, design, and other engineering teams to build scalable, intuitive, and extensible solutions that support user and business growth. Lead by example through hands-on, full-stack software development to deliver dynamic, user-centered experiences. Create mechanisms that drive product-led growth, including improved onboarding and sharing features. Help shape the future of agentic applications at Databricks by collaborating with a diverse team of engineers, product managers, and designers. Define and execute strategy for broad AI feature development by designing, building, and maintaining systems that are scalable, reliable, and high-performing.