Senior Manager, Engineering - AI Gateway (LLM Inference)

Join Databricks as a Senior Manager in Engineering for our AI Gateway (LLM Inference) team, where you will lead initiatives to innovate and enhance our AI technologies. You will be at the forefront of developing scalable AI solutions that drive impactful business results.

At Bubble, we are on a mission to democratize software development, enabling anyone with an idea to bring it to life. Our innovative AI-powered visual development platform allows users—from first-time entrepreneurs to seasoned enterprise teams—to transform concepts into fully functional applications across web, iOS, and Android, all without the need for coding. With over 5 million users spanning more than 100 countries, Bubble is the premier cross-device no-code platform, dismantling barriers to entrepreneurship and innovation worldwide.Our Achievements:We take pride in our thriving product ecosystem, with numerous VC-backed companies having been built entirely on Bubble. Following eight years of bootstrapping and finding product-market fit, we successfully raised a $100 million Series A, positioning us as one of the fastest-growing companies in the New York tech landscape. Bubble not only facilitates product launches but empowers individuals to transform their ideas into successful businesses. For instance, Mailead turned a $10k investment into a $2M valuation, while Faceless.video achieved over $1M in ARR in under a year, among numerous other success stories.About Our Team:We are excited to expand our AI Engineering Team to forge the next generation of AI-enhanced development workflows. Our vision is to facilitate AI-assisted full-stack development, empowering users to articulate their applications in natural language and enabling AI to generate, modify, and enhance their applications seamlessly.As a Senior Software Engineer specializing in AI/LLM, you will be instrumental in shaping the future of AI-driven development at Bubble. You will work on feature development driven by large language models (LLMs), design agentic workflows, and develop proprietary models using Bubble’s unique datasets. Close collaboration with Product, Infrastructure, and Research teams will be key to pushing the boundaries of AI-infused development.In this role, you will:Enhance LLM reasoning and retrieval techniques to elevate Bubble’s AI-driven development tools.Design and implement innovative workflows that leverage AI for seamless software development.

Job Description:We are on the lookout for a highly skilled AI Developer specializing in Generative AI and LLM-based application development. The ideal candidate will take the lead in crafting intelligent agents and AI-driven components that demonstrate advanced reasoning, planning, and execution capabilities. This position requires close collaboration with prompt engineers and diverse teams to deliver robust and scalable AI solutions.Location: New York, NY (Onsite/Hybrid)Visa: USC / Green Card OnlyWork Experience: 5 to 8 yearsKey Responsibilities:Design and develop AI agents/components that can reason, plan, and act autonomouslyBuild and implement LLM-based applications using modern frameworksDevelop and manage memory systems and tool-use capabilities for AI agentsWork closely with prompt engineers to optimize prompts and outputsImplement RAG (Retrieval-Augmented Generation) pipelinesIntegrate embeddings and vector databases for semantic search and retrievalCollaborate with cloud teams to deploy solutions on Azure cloud stackEnsure scalability, performance, and reliability of AI systems

Position Overview:We are in search of a skilled AI Developer with extensive experience in Generative AI and Large Language Models (LLMs). The successful candidate will take on the challenge of creating intelligent agents and AI-driven components that exhibit reasoning, planning, and task execution capabilities. This role requires close collaboration with prompt engineers and cross-functional teams to deliver robust and scalable AI solutions.Work Location: New York, NY (Onsite/Hybrid)Visa Requirements: USC / Green Card OnlyKey Responsibilities:Design and create AI agents/components capable of autonomous reasoning, planning, and actionDevelop and implement LLM-based applications utilizing modern frameworksCreate and manage memory systems and tool-use functionalities for AI agentsCollaborate with prompt engineers to refine prompts and outputsImplement Retrieval-Augmented Generation (RAG) pipelinesIntegrate embeddings and vector databases for semantic search and retrievalWork with cloud teams to deploy solutions on the Azure cloud platformEnsure the scalability, performance, and reliability of AI systems

The mission of The New York Times is to seek the truth and help people understand the world. Our commitment to independent journalism drives everything we do, enabling us to deliver compelling stories from nearly 160 countries. We prioritize how our readers engage with our journalism across various platforms, and our business strategy is focused on providing unparalleled journalistic quality that our audience values.Department Overview:The Research & Development team at The New York Times investigates the intersection of technology and journalism. We work collaboratively with designers, developers, reporters, photographers, and editors to innovate new storytelling methods, from initial concepts to live publishing.At The Times, technology is integral to our operations, influencing our insights into technological trends, driving our digital transformation, and enhancing our readers' experiences. Our R&D team identifies opportunities that emerging technologies can present in alignment with our strategic objectives.We are seeking a Senior Software Engineer with expertise in applied AI to create applications leveraging Large Language Models (LLMs) that align with The Times' mission and journalistic standards. The ideal candidate should possess the capability to work independently while also collaborating effectively within a team. A blend of curiosity and skepticism towards emerging technologies is essential, as is a commitment to solving meaningful user challenges. You take pride in your work and recognize the value of documenting patterns to aid future development. Please note that this is a temporary position.

About BasisBasis is a nonprofit organization dedicated to advancing applied artificial intelligence through innovative research. Our mission encompasses two vital objectives.The first goal is to foster a deep understanding of intelligence. This involves uncovering the mathematical principles behind reasoning, learning, decision-making, and comprehension, while also developing software that encapsulates these principles.The second goal is to enhance society's capability to tackle complex challenges. We aim to broaden the range and complexity of problems we can address now and significantly improve our future problem-solving capacity.To realize these objectives, we are establishing an innovative technological foundation that draws inspiration from human reasoning and creating a collaborative organization that places human values at the forefront.About the RoleWe are on the lookout for talented Software Engineers who will develop scalable systems that seamlessly integrate large language models (LLMs) into our daily operational workflows. This role will focus on designing and implementing automated pipelines for various tasks, including recruitment, finance, and project management, often utilizing platforms like GPT, Claude, and other similar LLMs. We offer flexible arrangements, and we welcome contractors, part-time, or full-time team members.Core ResponsibilitiesDesign and maintain automation pipelines that integrate internal tools with GPT, Claude, and other LLMs.Consolidate data from third-party APIs (such as ATS platforms, Slack, Google) into cohesive, automated workflows.Utilize structured generation techniques (e.g., JSON schemas, function calling) to ensure accurate and reliable outputs from LLMs.Collaborate with Operations and R&D teams to pinpoint high-impact automation prospects.Craft production-quality code with a focus on modularity, reliability, and robust error handling.Deploy, scale, and optimize your solutions within a secure, cloud-based environment.Document solutions clearly for both technical and non-technical stakeholders to facilitate updates and maintenance.Qualifications and AttributesWe are seeking candidates who possess:3+ years of experience in programming with Julia and/or Python at a production level.A solid understanding of integrating LLMs using structured prompts and frameworks akin to LangChain.

At GPTZero, we are committed to fostering trust and transparency across the internet. As a premier AI detection platform, we equip educators, students, journalists, marketers, and writers with the tools they need to navigate the rapidly changing world of AI-generated content. With a user base numbering in the millions, we are pioneering a category-defining company at the confluence of AI and information integrity.Our team is comprised of individuals from high-performance engineering backgrounds, including industry leaders like Meta, Perplexity, AWS, Affirm, and renowned AI research institutions such as Princeton, Caltech, and the Vector Institute.About this role:In this pivotal role, you will be instrumental in developing the next generation of AI tools designed to enhance and preserve critical thinking for humanity. The ideal candidate will be skilled in creating dependable AI agents and prompt engineering, possess a strong product sense, and demonstrate exceptional software engineering abilities. You will collaborate with a dynamic team of passionate innovators to create software that sets industry standards and has garnered millions of global users.

Senior AI EngineerAbout Fonzi AIFonzi AI is a dynamic startup with robust funding, reshaping the hiring landscape through innovative AI solutions. Launched recently, we have quickly garnered thousands of talented engineers to our platform. Our mission is to create an AI-driven recruiting marketplace that connects millions of job seekers with employers, where intelligent AI recruiters learn about individual preferences and seamlessly match candidates with ideal opportunities.The RoleWe are on the lookout for a Senior AI Engineer who will spearhead the development of groundbreaking AI experiences that will shape the future of recruitment. In this role, you will work closely with our engineering team, collaborating with full-stack engineers to integrate AI capabilities into our platform. Your AI features will be integral to the overall functionality of our application.You will engage in AI experimentation, implementation, and teamwork to deliver cohesive products. If you have experienced that transformative moment when AI revolutionizes how we work and are eager to create products that embody that potential for users, this position is tailored for you.What You'll DoDevelop AI agents capable of engaging in meaningful conversations with candidates and recruitersDesign and implement AI-driven features from the ground up, including voice interfaces, coaching systems, and intelligent matching algorithmsExperiment with cutting-edge models and techniques, making informed decisions regarding cost, quality, and speedProduce high-quality production TypeScript code that transforms AI concepts into reliable user experiencesRapidly prototype new AI functionalities and scale successful innovations to serve thousands of usersCollaborate closely with the engineering team to ensure seamless integration of AI features across the entire platformWork alongside full-stack engineers to pinpoint opportunities where AI can enhance the recruitment experienceStay abreast of developments in the AI field while maintaining focus on delivering tangible productsRequired ExperienceProven AI development experience: You have successfully built and deployed AI/LLM features in production for over a yearFull-stack engineering skills: Strong expertise in TypeScript, React, and Next.js, able to contribute to all aspects of development

Join our innovative team at General Intelligence Company as an Applied AI Engineer, where you'll be at the forefront of enhancing our Cofounder agent technology. You'll take charge of critical backend systems and engage in applied large language model (LLM) projects, focusing on improving agent reliability and autonomy. Your role will encompass building evaluation pipelines and implementing techniques that significantly boost agent performance. This is a hands-on position that demands high ownership from research to production: prototyping, evaluating, and deploying enhancements that have a direct impact on user experience.Your ResponsibilitiesArchitect and execute comprehensive agent enhancements: including prompting strategies, tool selection, action planning, memory optimization, safety measures, and recovery solutions.Develop robust evaluation frameworks for the agent: offline evaluations (golden tasks, regression tests, behavior assessments), online metrics (latency, success rates, failure modes, cost efficiency), and experimentation methods (A/B testing, canaries, guardrail thresholds).Implement applied LLM methodologies: orchestrating function/tool calls, self-reflection, retrieval-augmented generation (RAG), multi-agent transitions, caching and embedding strategies, and reducing hallucinations.Enhance core backend systems: ensuring reliable job orchestration, implementing retries/backoff strategies, supporting idempotency and auditability; managing scalable memory and context routing; optimizing data pipelines across platforms such as Gmail, Slack, Notion, Linear, Google Workspace, etc.; and improving observability and tracing for agent actions and outcomes.Collaborate with product and infrastructure teams to define success metrics and deliver rapid, safe iterations.Produce clean, thoroughly tested code; document design choices and operational guidelines.QualificationsA minimum of 4 years of backend engineering experience, ideally with Python (we prioritize impact over tenure).Hands-on experience with LLMs: including prompt engineering, function calling, retrieval techniques, embeddings, and evaluation frameworks; demonstrated experience in deploying LLM features into production.Proven track record in developing evaluation harnesses and leveraging them to drive enhancements (regression suites, task success metrics, cost/runtime trade-offs).Strong understanding of distributed systems principles: concurrency, reliability, performance optimization, data modeling, and lifecycle management.Practical approach to experimentation: from hypothesis formulation to prototyping, measuring improvements, and rollout.Exceptional debugging and instrumentation skills; a passion for identifying and resolving edge cases in real-world scenarios.Preferred QualificationsExperience in working with other programming languages and technologies.

About the Role qloo is looking for a Machine Learning Engineer focused on Large Language Models (LLMs) and personalization. This position is based in New York City. What You Will Do Design and build machine learning models to improve user experience and increase engagement. Work closely with teams across the company to implement advanced algorithms. Support data-driven decisions by contributing expertise in LLMs and personalization techniques. Collaboration This role involves frequent collaboration with cross-functional groups, including product and data teams.

Join Edra's Innovative TeamAt Edra, we tackle one of the most challenging issues in enterprise AI: the gap between generic AI models and specific company processes. Our mission is to create AI agents that not only understand how processes function but also execute them effectively.As a Series A startup, backed by Sequoia and other prominent VC firms, we're rapidly expanding our presence in New York and London. Our team comprises highly skilled engineers, AI researchers, and strategists who are united by a commitment to excellence and a belief that remarkable talent is the cornerstone of our innovative solutions.Your Role in Our MissionYou will be instrumental in developing a learning system that educates AI agents about the intricacies of enterprise operations. This system will leverage knowledge bases, conversations, tickets, and logs to generate actionable instructions for agents, including confidence scoring to determine when to automate and when human intervention is necessary.We seek AI Engineers with experience in constructing sophisticated, production-level LLM-based systems. Whether you have experience scaling LLM workflows for millions of requests, developing multi-agent systems, or designing evaluation frameworks for enterprise applications, we want individuals who are passionate and self-motivated. You will work on our core learning library, deliver features to actual enterprise customers, and contribute to the overall platform development. Your work will encompass continuous learning systems, agentic features, human-in-the-loop feedback mechanisms, and agent orchestration.Key ResponsibilitiesDevelop and enhance our core context learning library by implementing customer-specific learning capabilities and generalizing them across the platform.Design and implement LLM-driven systems and workflows from inception to deployment.Collaborate with enterprise clients to identify novel challenges, prototype solutions, and bring them to production.Create agentic features for knowledge management, enabling agents to autonomously edit, update, and maintain extensive knowledge bases.Establish reliability and confidence systems, including evaluation frameworks and logic for determining when to automate versus when to escalate to a human.Architect asynchronous, scalable systems capable of managing complex AI orchestration.Influence the direction of our AI strategy and product capabilities.

At Extend, we are revolutionizing document processing with cutting-edge Large Language Models (LLMs). Our mission is to reshape how organizations interact with unstructured data, making it more efficient and effective.As an Applied AI/ML Engineer, you will play a pivotal role in developing advanced document processing infrastructure and innovative AI-driven product features. Your contributions will directly influence the experience of our customer base as we process millions of documents each month.We seek engineers who are not only innovative problem solvers but also stay current with the latest AI advancements. If you are passionate about making tangible impacts in the real world and eager to assist businesses in overcoming significant challenges through AI, we want to hear from you!

Role overview As Engineering Manager for Applied AI & Platform at norm-ai in New York City, this position leads a team dedicated to bringing artificial intelligence into the company’s platform products. The manager sets direction for projects, supports the technical development of engineers, and plays a key role in shaping the vision for how AI will influence future product offerings. What you will do Guide engineers as they develop and integrate AI technologies into core platforms Oversee project planning and execution to ensure initiatives match company objectives Provide technical leadership and mentorship to help the team achieve strong results Work with stakeholders to define the technology roadmap and platform strategy

Why Join Moonshot AI?Imagine a world where websites automatically optimize themselves to enhance sales, improve conversion rates, and accelerate growth. At Moonshot AI, we are transforming this vision into reality by integrating generative AI, extensive data processing pipelines, and systematic experimentation into a self-evolving digital ecosystem.As a well-funded startup in its early stages, we have a bold vision. Joining us means becoming more than just an employee; you will play a crucial role in shaping our technical and cultural foundation. If you desire the freedom of a founder, combined with the support of top-tier investors, this is the opportunity for you.Your ContributionsIn your role as our Senior Fullstack Engineer, you will be actively engaged across the technology stack. You will design, develop, and scale systems that power our AI-driven platform, enjoying significant autonomy, rapid execution, and substantial ownership of your work.Build and architect scalable systems — from backend APIs to frontend dashboards — capable of processing millions of web events daily.Create large-scale data infrastructure that elucidates website construction, performance metrics, and optimization strategies.Train and integrate LLMs into production environments to autonomously hypothesize, generate, and validate website variants.Influence engineering culture and practices — your impact will be evident throughout our tech stack, architecture, and team processes.Engage in experimentation, prototyping, and iteration — combining research, product development, AI, and scalability in a single role.This is not about maintaining another SaaS application; it’s about constructing an AI engine that revolutionizes digital product creation.Candidate ProfileA software artisan — you produce clean, scalable code and are adept at delivering results swiftly.5+ years of full-stack development experience (Python, JavaScript, AWS preferred, but not mandatory).Proven experience in leading teams or managing significant projects.Educational background in Computer Science, Electrical Engineering, Mathematics, or equivalent practical expertise.An AI enthusiast eager to work with LLMs and influence their real-world applications.Bonus Qualifications:Experience in a startup environment (thriving in dynamic, fast-paced settings).

Lab49 is seeking innovative Agentic Developers—engineers who leverage AI tools to create software rather than merely utilizing them.This role transcends the typical 'adding AI features' or 'building AI platforms' narrative. We are searching for developers who can produce production-quality enterprise code, using large language models as their primary interface, especially in the modernization or extension of complex, legacy systems within highly regulated environments.As a vibe coder, you will combine profound engineering intuition, strong system design capabilities, and a fluent command of large language models to accelerate development processes without compromising on rigor, compliance, or reliability.

Expeditors International of Washington, Inc. is looking for an Air Export Gateway Agent to join the team in Farmingdale, NY. This entry-level position provides practical experience in logistics and transportation, giving exposure to the day-to-day operations of air export shipping. Role overview The Air Export Gateway Agent coordinates air export shipments from beginning to end. The position involves making sure each step meets industry regulations and company standards. Supporting clients with reliable and prompt service is a key part of this role. What you will do Manage the full process of air export shipments Follow all relevant regulations and compliance requirements Provide consistent, timely support to clients Requirements Keen attention to detail Organizational skills for handling multiple shipments at once Comfort working in a busy setting

Senior AI Product EngineerAbout Fonzi AIAt Fonzi AI, we are a pioneering Series A startup, backed by Lightspeed, dedicated to transforming the hiring landscape through the power of AI. Established by seasoned entrepreneurs from Kumospace, we launched our innovative AI-driven recruiting marketplace in June 2025 and have quickly become revenue-positive, partnering with nearly 100 employers—over 75% of whom are AI-native companies. Our platform is home to thousands of engineers, and we proudly host Match Days every two weeks, where pre-screened candidates receive competitive offers from leading employers.Our vision is to create an infrastructure where AI comprehensively understands the roles of engineers, their aspirations, and seamlessly matches them with suitable opportunities. We are committed to moving beyond surface-level AI applications and are building toward a future where intelligent systems manage the entire recruiting workflow. We seek engineers who share our passion for this vision and are eager to help shape the future with us.The RoleAs a Senior AI Product Engineer, you will embrace a multifaceted role in this new era of software development. The distinction between "full-stack engineer" and "AI engineer" is rapidly diminishing, and at Fonzi, we have embraced this convergence.You will take ownership of features from inception to deployment: designing database schemas, developing React components, and creating the AI agents that infuse intelligence into our platform. Some weeks, you’ll focus on building robust backend systems; other weeks, you'll experiment with cutting-edge models to develop features that feel transformative. Most weeks, you’ll engage in both aspects.We are in search of engineers who have experienced the "aha moment"—those who recognize that AI fundamentally alters the software development landscape and wish to work at a company where this principle is embedded in every product decision.What You'll BuildAI Agents that facilitate intelligent conversations with candidates, including voice interfaces for onboarding engineers, coaching systems for interview preparation, and adaptive matching algorithms that evolve with each interaction.The Platform powering a two-sided marketplace, utilizing TypeScript/Node.js for backends, React/Next.js for frontends, and PostgreSQL for the data layer, all designed for speed and rapid iteration.AI-Powered Features from conception to production—rapidly prototype using the latest models, strategically balancing cost, quality, and speed, then scale successful features to thousands of users.The Intelligence Layer that enhances our marketplace with each candidate interaction, creating a data flywheel that will establish our competitive edge.

Join Thread AI as an Applied AI EngineerAt Thread AI, we are pioneering the development of an AI-native workflow orchestration engine. We seek passionate individuals to be part of our dynamic team, dedicated to simplifying infrastructure for enterprises and public sector agencies eager to harness the full potential of AI.Based in New York, our thriving team comprises specialists in AI, product development, and engineering, all with proven experience in managing intricate workflows and infrastructure.Our Engineering CultureWe pride ourselves on maintaining a tight-knit technical team that integrates engineering, research, design, product, and operational excellence. Our philosophy emphasizes a flat organizational structure and collaborative environment, enabling us to innovate rapidly and create superior products compared to larger, hierarchical organizations.Your RoleAs an Applied AI Engineer, you will be instrumental in architecting and implementing robust AI workflows. Daily, you will design end-to-end customer workflows, oversee their transition to production, and address real-world challenges. Your responsibilities will include crafting innovative, scalable, and high-performance software solutions that align with both customer needs and our strategic goals. You will collaborate closely with our sales and marketing teams to develop forward-thinking prototypes that will guide the future product and infrastructure direction of Thread AI and our clients.

Join Brellium as a Senior AI Engineer and be at the forefront of innovation in artificial intelligence. In this role, you will leverage cutting-edge technologies to develop advanced AI solutions that will transform industries. You will collaborate with a talented team of engineers and data scientists to design, implement, and optimize AI models and algorithms.

Senior Full Stack EngineerAbout Fonzi AIFonzi AI is a dynamic startup fueled by substantial funding, dedicated to transforming the hiring landscape through advanced AI technologies. Having recently launched, we have already garnered the attention of thousands of exceptional engineers on our platform. Our mission is to create an AI-powered recruitment marketplace designed to seamlessly connect millions of candidates with companies, where our AI recruiters intuitively comprehend your expertise and interests to match you with ideal opportunities automatically.The RoleWe are on the lookout for a Senior Full Stack Engineer who will take ownership of projects from inception to deployment, delivering results swiftly without compromising on code excellence. This role leans towards backend development but encompasses full-stack responsibilities, as you'll contribute to building the foundational platform that drives our AI-enabled marketplace. Collaborating closely with our technical lead, you'll architect and implement features that have a tangible impact on how candidates and companies interact.This position transcends typical engineering responsibilities; you will act as a product engineer, fully aware that each line of code affects real users. You'll engage with our recruiting and marketing teams, converting business requirements into technical solutions while striking a balance between rapid delivery and scalable architecture, a hallmark of successful startups.What You'll DoLead comprehensive feature development from design through to production deploymentConstruct robust backend systems using TypeScript and Node.js, alongside creating engaging frontend experiences utilizing React and Next.jsIncorporate AI functionalities into applicationsCollaborate with AI models to expedite development while ensuring high code qualityBalance swift delivery with long-term architectural considerationsWork directly with recruiting and marketing teams to identify and address their technical challengesDeliver code rapidly while remaining mindful of long-term architectural ramificationsInfluence product direction during the formative stages of requirements—help define the 'what', not just the 'how'Articulate technical concepts effectively to non-technical stakeholdersRequired ExperienceProficient in TypeScript: This is our primary programming language, and you'll be using it dailyFull-stack development experience: Proven track record in both frontend and backend development