Staff Engineer, AI Evaluations

Join Our TeamAt Sema4.ai, we are revolutionizing the way knowledge work is performed through our cutting-edge Enterprise AI Agent platform. Our mission is to foster collaboration between humans and AI agents in a manner that is both reliable and effective.As a Staff Engineer, AI Evaluations, you will play a crucial role in creating and managing the evaluation systems that will assess the performance and reliability of our AI agents. Your work will be instrumental in ensuring our models are not only accurate but also continuously improving.This position offers a unique opportunity for high impact in an early-stage role. You will define metrics for success in AI agents deployed in production, navigating the complexities and uncertainties of real-world applications. We seek an engineer who possesses a strong analytical mindset and a clear vision of what defines excellence in AI performance.

The OpportunityAt Sema4.ai, we are pioneering an Enterprise AI Agent platform that revolutionizes the way knowledge work is accomplished by fostering seamless collaboration between people and AI agents.As a Staff Engineer on the AI team, you will be responsible for the design, development, and enhancement of Sema4.ai's cognitive architectures, which serve as the foundation of our agents. Your role will integrate cutting-edge AI research with production-quality standards to enable high-leverage capabilities for our clients' daily operations.This position offers a unique opportunity for significant impact. You will be constructing essential infrastructure in a dynamic environment where your decisions hold substantial weight, and trade-offs are a critical aspect of the process. We seek engineers who thrive in ambiguity, yet demonstrate rigor, aesthetic sensibility, and strong technical judgment in their creations.Who You AreGenAI SpecialistYou possess the expertise to implement LLMs and agents effectively within production systems. You are aware of the intricacies involved: prompt fragility, context limitations, tool failures, cost and latency constraints, provider peculiarities, and enterprise reliability standards. Your fluency in contemporary AI system development approaches allows you to apply them judiciously.Technology AficionadoYou remain well-informed about research and industry trends without becoming distracted by every new development. You anticipate the trajectory of the field and design systems that can adapt as models and techniques change. You evaluate trends with a critical eye, integrating what is effective while avoiding unnecessary complexity. Your considerations include abstraction boundaries, potential failure modes, and long-term maintainability.Quality-Oriented BuilderYou prioritize correctness, clarity, and operational excellence. While you are adept at quick iterations, you understand the limitations of your systems and know when to address them appropriately. You navigate the balance between the “not invented here” mentality and the assumption that all problems have been previously solved.What You’ll DoDevelop and Maintain Core SystemsYour primary focus will be on the development and evolution of core agent framework components, orchestration logic, and LLM integration layers. These systems are essential and will serve as the backbone for our customers' operations.

Join Us at the Forefront of AI DevelopmentAt Sema4.ai, we are pioneering an Enterprise AI Agent platform that transforms how knowledge work is performed, fostering collaboration between humans and AI agents in trustworthy and sustainable ways.We are seeking a Staff Backend Engineer for our Agent Platform. In this pivotal role, you will partner with our AI team to construct the systems that bring their cognitive architectures to life, ensuring the delivery of robust, customer-facing features and functionalities.This position promises significant impact, as you will work at the intersection of platform and product, influencing how agents are configured, executed, monitored, and scaled within real enterprise settings. Your efforts will determine whether our agents are not only intelligent but also practical, reliable, and scalable.

Join Us in Shaping the Future of Human-AI Collaboration!At Sema4.ai, we empower enterprises to create, operate, and manage intelligent AI agents that revolutionize workflows. As Generative AI transforms industries, organizations are eager to unlock substantial productivity improvements, drive efficiency for significant bottom-line impacts, enhance innovation cycles, and penetrate new markets.What We Offer:Achieve remarkable productivity advancementsDeliver efficiencies that considerably affect profitabilityAccelerate your career by collaborating with advanced technologies, pioneering clients, and exceptional peersRecognized by Business Insider as one of the most promising startups of 2024, Sema4.ai is backed by top-tier venture capital firms that have supported renowned brands like Uber, Snapchat, Instagram, and Zendesk. Our founders are trailblazers in open-source technologies, big data, and automation-as-code, having previously led the Enterprise Hadoop initiatives at Hortonworks and Cloudera—successfully managing a quarter of the world’s data across 90+ countries.The RoleWe are developing an Enterprise AI Agent platform that redefines knowledge work—enabling seamless collaboration between humans and AI agents for enhanced productivity. As a Forward Deployed Engineer, you will play a pivotal role in constructing the core of our product: the Agent.You will take on the role of a Technical Lead with a strong technical foundation, architecting innovative AI systems while being actively involved in implementation. Your guidance will shape the technical trajectory of our platform, while you mentor senior engineers and foster engineering excellence throughout the team.Your ProfileWe are looking for an enthusiastic Forward Deployed Engineer who excels in dynamic customer environments and possesses extensive technical proficiency in AI agents. You will collaborate directly with enterprise clients to design, develop, and implement tailored AI agent solutions, acting as the crucial technical link between clients and our engineering team. Your drive and commitment will ensure client success as you are the first to arrive and the last to leave, fully dedicated to making a difference.

Location: US or CanadaType: US Applicants - Full-Time; Canadian Applicants - Independent ContractorAbout Human AgencyHuman Agency is rapidly expanding and on the lookout for outstanding talent across various disciplines to support our growing pipeline of opportunities. Our mission is to engage individuals, from creative producers to technical experts to entrepreneurial leaders, who can help us navigate this exciting phase of growth.We are a dynamic team of doers. Our leaders are hands-on, our teams operate collaboratively, and every member plays a crucial role in the success of our projects. We embrace constructive feedback and prioritize continuous learning, always striving to elevate our standards. Here, the best ideas prevail, regardless of their origin, as our clients rely on us for exceptional outcomes consistently.We hold our clients' missions, products, and financial goals in the highest regard. Our approach is to immerse ourselves in their environments, becoming dedicated stewards of their objectives and partners in solving significant challenges. Every product, strategy, or asset we create is designed to be both aesthetically pleasing and practical, ensuring real-world impact.Our team is our greatest asset, and we grow by hiring individuals who drive us forward. Across strategy, engineering, design, data, and operations, we seek teammates who elevate our collective performance. We believe in hiring talent that pushes us to new heights.We collaborate with organizations of all sizes to explore, design, and implement AI strategies that are secure, scalable, and human-centered. Our conviction is that AI should enhance human potential, not substitute it, and we embody this belief in every engagement. From advisory services to implementation and education, we meet clients at their level and assist them in integrating AI in alignment with their missions and values. Our aim is to empower teams to work smarter, accelerate their progress, and unlock new possibilities through thoughtful, responsible innovation.Throughout our journey, we lead with purpose, passion, and a spirit of adventure. We engage in meaningful work with people we care about, ensuring that the journey is worthwhile. At Human Agency, our identity and our work are closely intertwined.The OpportunityWe are in search of an exceptional Chief of Staff to support our Managing Director of AI. This role demands a unique blend of strategic vision in AI, hands-on execution, and technological expertise. You will act as a force multiplier and transformation architect, designing AI-driven processes, creating autonomous automated systems, leading organizational rollouts, and ensuring precise execution across our AI solutions practice.

Anduril Industries is at the forefront of defense technology, committed to revolutionizing military capabilities for the U.S. and its allies through innovative technology. By integrating the expertise and business models of the most advanced companies of the 21st century into the defense sector, Anduril is reshaping the design, construction, and sale of military systems. Our advanced systems operate on Lattice OS, an AI-driven platform that transforms vast data streams into a real-time, immersive 3D command and control hub. As global strategic competition intensifies, we are dedicated to delivering cutting-edge solutions in autonomy, AI, computer vision, sensor fusion, and network technology to the military quickly and efficiently.The RoleThe Test and Evaluation team is pivotal to our mission, ensuring that our products consistently meet stringent performance and reliability standards. We are seeking a passionate Test and Evaluation Engineering Manager to lead our Altius UAS platform team. In this role, you will assess both hardware and software capabilities in controlled lab and flight test scenarios while guiding a team of test engineers.Key ResponsibilitiesLead and mentor a team of test engineers, promoting their professional development and ensuring adherence to best practices.Manage the planning and execution of sophisticated testing projects, including task distribution and resource management for team members.Work closely with software engineers and cross-functional teams to validate new software, ensuring comprehensive end-to-end functionality and addressing any bugs.Conduct rigorous testing of Software and Surrogate platforms, including validation and regression tests, to confirm that new features meet system capabilities and mission goals.Analyze test data to confirm system performance and pinpoint areas for enhancement, iterating quickly to improve hardware implementation and software functionalities.Establish testing processes for system functionalities utilizing HITL and COTS UAS platforms.Advance Anduril's testing methodologies, particularly for Group 2 UAS, to ensure reliable performance in complex operational environments.Contribute to the strategic vision of the T&E team, identifying opportunities for innovation and improvement.

Join Nagarro as a Senior Staff Engineer specializing in Delivery, where you'll play a pivotal role in shaping the future of our engineering projects. Your expertise will drive innovation and ensure the successful implementation of cutting-edge solutions.

Join our dynamic team at Nagarro as a Senior Staff Engineer, Delivery. In this pivotal role, you will drive innovative solutions and lead engineering projects that impact our clients and their industries. You will collaborate with cross-functional teams to ensure timely and efficient delivery of high-quality software solutions.

At Anduril Industries, we are at the forefront of defense technology, dedicated to revolutionizing military capabilities for the U.S. and its allies through cutting-edge advancements. By integrating the expertise, technology, and innovative business models of the 21st century into the defense sector, we are reshaping the design, construction, and sale of military systems. Our suite of products is driven by Lattice OS, an AI-powered operating system that transforms vast data streams into a real-time, 3D command and control center. In a world marked by strategic competition, we are committed to delivering pioneering solutions in autonomy, AI, computer vision, sensor fusion, and network technology to the military in record time.The Tactical Recon and Strike (TRS) team at Anduril specializes in the development of small aerial drones (Groups 1-3) and the associated equipment necessary for testing, deployment, and operation. Our team is instrumental in transforming concepts like Ghost, Anvil, Bolt, and Altius from initial sketches to fully operational systems. We collaborate closely with specialized teams to tackle some of the most challenging issues faced by our clients. We are seeking talented software engineers, hardware engineers, roboticists, and mobile developers who are passionate about building a robust robotics platform that can be monitored and controlled in real-time across diverse interfaces.As a Senior Software Engineer - Security, you will take charge of enhancing the security strategy for TRS products and software services, collaborating closely with engineering teams to develop solutions that not only meet but surpass industry-standard security benchmarks. You will work with various teams to identify and resolve vulnerabilities in designs, implementations, integrations, and processes, while also designing and developing security software for embedded systems. The ideal candidate will have a solid background in software engineering with a strong emphasis on platform security, enabling them to conduct in-depth security architecture reviews, research and mitigate vulnerabilities in both hardware and software, and implement essential features in partnership with engineering teams to create resilient products.*This position will be based in our Costa Mesa CA, Seattle WA, or Atlanta GA offices. We offer comprehensive relocation assistance if needed.

The PositionWe are seeking a skilled and experienced Senior Full Stack Engineer with a strong emphasis on frontend development to create sophisticated, user-centric web applications. In this role, you will primarily take charge of GUI engineering, focusing on architecture, components, performance, and user experience, while also engaging in some backend tasks like API endpoint creation, integration logic, and troubleshooting across the entire stack.Your keen eye for user experience will be essential; you will be passionate about interaction details, consistency, usability, and accessibility, transforming rough requirements into a seamless experience.Your Daily ResponsibilitiesLead the development of UI features from inception to completion: strategize, design component structures, implement navigation flows, and deliver polished interactions.Enhance UX quality: suggest UX improvements, identify inconsistencies, elevate the standard of micro-interactions, and ensure a unified experience across the product.Create reusable components and patterns that are scalable, contributing to the design system and ensuring a consistent user experience.Integrate with APIs (REST + RPC/typed APIs such as tRPC): manage loading states, error handling, caching, retries, pagination, and optimistic updates when necessary.Develop a robust client-side state strategy, considering local vs. server state, derived state, and performance implications.Guarantee quality and reliability through automated testing, code reviews, and strong typing.Oversee UI performance and accessibility, ensuring responsive design, adhering to accessibility best practices, optimizing rendering performance, and maintaining styling.Contributions to the Full Stack:Extend or implement API routes/procedures and validate inputs.Work with authentication/session frameworks and ensure an authorization-aware UX.Debug issues that span from frontend to backend to network.Impact at a Senior Level:Mentor fellow engineers, establish best practices, and enhance team efficiency through insightful reviews and thorough documentation.Identify and enact refactors that enhance maintainability while ensuring timely delivery.Collaborate with design, product management, and engineering teams to clarify requirements and deliver iteratively.

Join Visa Inc. as a Staff Software Engineer, where you will play a pivotal role in driving technology innovation and solutions. In this position, you will collaborate with cross-functional teams to develop robust software applications that enhance our operations and customer experience. Your expertise will be instrumental in designing, coding, testing, and maintaining software solutions that meet the highest quality standards.

THE POSITIONJoin our dynamic team at FanDuel, where we are seeking a talented Staff Software Engineer to take the lead on enhancing our test automation processes for Sportsbook Emerging Experiences, including Social and Advanced Search, across iOS, Android, and Web platforms. This is a hands-on technical leadership role aimed at building robust functional and performance automation that boosts release confidence. In this role, you will collaborate closely with engineers, product managers, and QA teams to integrate quality earlier in the development cycle, establish repeatable patterns within our Nx monorepo and CI, and elevate our standards for what constitutes a “release ready” product, particularly for user-critical journeys. In addition to the responsibilities mentioned, you may be required to undertake other duties as assigned, ensuring operational flexibility to meet the evolving needs of the business. THE GAME PLANEvery team member plays a crucial role in our success. Your responsibilities will include designing and implementing end-to-end automation for core Social and Search journeys using Cypress (web) and Detox (iOS/Android), in alignment with our Nx monorepo structure. You will own and enhance the automation foundations of our team, including test architecture, folder structure, screen-object patterns, shared utilities, and local-first run toolchains, enabling teams to add coverage efficiently and consistently. Integrating automation into CI (Buildkite and/or GitHub Actions) will be essential, including affected execution, parallelization, clear pass/fail reporting, and actionable quality gates, while ensuring that suites remain easy to run locally for rapid iteration. You will focus on driving stability by tracking flakiness, improving test determinism, and reducing time-to-signal through enhanced synchronization, test data control, and failure triage patterns. Establishing a test data and environment strategy is key, utilizing mocks/fixtures for acceptance, production-like data for end-to-end tests, and lightweight API/contract tests (Pact or equivalent) where they provide value. Building performance coverage for critical journeys (feed load, interactions, search latency/rendering) using Detox performance tools and/or Flashlight + Maestro, while defining baselines and regression thresholds, will be part of your mission. You will also own load/performance testing for key end-to-end user journeys (from BFF/edge APIs through platform and backend services) using Locust (Python) or equivalent, handling realistic traffic modeling, scenario design, assertions on p95/p99 latency, throughput, error rates, and comprehensive reporting. For Advanced Search (including LLM-powered experiences), you will define automated evaluations that include schema/structure checks, relevance/quality regression against baselines, and edge-case/safety checks.

Role overview FanDuel seeks a Staff Machine Learning Engineer based in Atlanta to lead projects that use advanced artificial intelligence and machine learning methods. This role centers on designing and developing scalable ML solutions that enhance FanDuel’s products and services. What you will do Design and implement machine learning systems that support product and user experience objectives Set technical direction for major projects and initiatives Mentor engineers, sharing knowledge and encouraging professional growth Deliver solutions that directly affect FanDuel’s growth and user satisfaction Who succeeds in this role Engineers with deep experience in machine learning and artificial intelligence Leaders who value mentoring and shaping technical strategy Individuals motivated by seeing their work influence product direction and company outcomes

The OpportunityJoin Sema4.ai, where we are pioneering an Enterprise AI Agent platform that transforms the landscape of knowledge work—enhancing collaboration between humans and AI agents to achieve superior efficiency and outcomes. As the hands-on Technical Lead, you will be instrumental in developing our core product: the Agent framework.We are seeking a Technical Lead with the expertise to architect state-of-the-art AI systems while actively engaging in implementation. You will steer the technical roadmap of our agent framework, mentor senior engineers, and foster engineering excellence throughout the team.

Join Nagarro as a Senior Staff Engineer specializing in Big Data technologies. In this role, you will leverage your extensive technical expertise to design and implement robust data solutions that drive business decisions. Collaborate with cross-functional teams to innovate and optimize our data architecture and analytics capabilities.

Nagarro is seeking a talented Associate Staff Engineer with a strong focus on mainframe technologies to join our dynamic engineering team. In this role, you will contribute to the development and maintenance of high-performing mainframe applications, collaborating with cross-functional teams to deliver innovative solutions. If you are passionate about technology and eager to grow your skills, we encourage you to apply!

Join our innovative team as a Senior Staff Engineer specializing in Java Development at Nagarro in Atlanta. We are looking for a passionate engineer who thrives in a collaborative environment and seeks to make a significant impact through technology. You will be responsible for designing, developing, and maintaining high-performance applications that meet our clients' needs.

JOIN OUR TEAMWe have an exciting opportunity for you!As a Staff Engineer specializing in Endpoint Platform, you will play a key role in designing, implementing, and overseeing mobile device management solutions within a large-scale enterprise environment. Your expertise will ensure the secure and efficient handling of mobile devices, applications, and data across diverse platforms such as macOS, iOS, Android, and Windows. You will collaborate with cross-functional teams to optimize mobile operations while upholding security policies, compliance standards, and performance metrics.Your adaptability is essential, as additional responsibilities may arise based on the Company's evolving needs.YOUR ROLE IN THE GAME PLANEvery team member contributes to our success.Engineering ArchitectureEstablish endpoint engineering principles, reference architectures, and reusable configuration patterns.Define secure-by-default device baselines for all platforms.Platform & AutomationImplement GitOps-driven endpoint configuration management.Develop CI/CD validation pipelines for endpoint policies and configurations.Create API-based integrations across identity, asset management, security tooling, and compliance systems.Modern Workplace EnablementArchitect zero-touch, globally scalable device provisioning.Design self-service application delivery models.Enhance the device onboarding experience with measurable SLOs.Measurement & Continuous ImprovementEstablish KPIs for provisioning speed, compliance drift, patch latency, and device trust posture.Leverage telemetry and automation for continuous improvements in endpoint experience and security.

Join our innovative team at Greenlight as a Staff Product Security Engineer. In this pivotal role, you will be responsible for ensuring the security of our products throughout their lifecycle. You will collaborate with cross-functional teams to identify vulnerabilities, implement security measures, and enhance our overall security posture.

Join Valorem Reply, an award-winning digital transformation firm, dedicated to revolutionizing the way businesses operate through data-driven strategies. Our focus on enterprise IT modernization, enhanced customer experiences, product transformation, and the digital workplace empowers our clients to achieve their business goals with agility and security. Leveraging Microsoft technologies, we deliver scalable and unique digital business services, innovative business models, and design-led user experiences that transform businesses.As a Senior AI Engineer, you will play a crucial role in understanding how AI can be harnessed to achieve our clients' objectives. This hands-on position involves consulting, leading, and coding to deliver sophisticated AI solutions. You will work alongside a talented team to drive projects ranging from interactive workshops to large-scale enterprise deployments.