Senior Manager, Engineering - AI Gateway (LLM Inference)

About BasisBasis is a nonprofit organization dedicated to advancing applied artificial intelligence through innovative research. Our mission encompasses two vital objectives.The first goal is to foster a deep understanding of intelligence. This involves uncovering the mathematical principles behind reasoning, learning, decision-making, and comprehension, while also developing software that encapsulates these principles.The second goal is to enhance society's capability to tackle complex challenges. We aim to broaden the range and complexity of problems we can address now and significantly improve our future problem-solving capacity.To realize these objectives, we are establishing an innovative technological foundation that draws inspiration from human reasoning and creating a collaborative organization that places human values at the forefront.About the RoleWe are on the lookout for talented Software Engineers who will develop scalable systems that seamlessly integrate large language models (LLMs) into our daily operational workflows. This role will focus on designing and implementing automated pipelines for various tasks, including recruitment, finance, and project management, often utilizing platforms like GPT, Claude, and other similar LLMs. We offer flexible arrangements, and we welcome contractors, part-time, or full-time team members.Core ResponsibilitiesDesign and maintain automation pipelines that integrate internal tools with GPT, Claude, and other LLMs.Consolidate data from third-party APIs (such as ATS platforms, Slack, Google) into cohesive, automated workflows.Utilize structured generation techniques (e.g., JSON schemas, function calling) to ensure accurate and reliable outputs from LLMs.Collaborate with Operations and R&D teams to pinpoint high-impact automation prospects.Craft production-quality code with a focus on modularity, reliability, and robust error handling.Deploy, scale, and optimize your solutions within a secure, cloud-based environment.Document solutions clearly for both technical and non-technical stakeholders to facilitate updates and maintenance.Qualifications and AttributesWe are seeking candidates who possess:3+ years of experience in programming with Julia and/or Python at a production level.A solid understanding of integrating LLMs using structured prompts and frameworks akin to LangChain.

At Bubble, we are on a mission to democratize software development, enabling anyone with an idea to bring it to life. Our innovative AI-powered visual development platform allows users—from first-time entrepreneurs to seasoned enterprise teams—to transform concepts into fully functional applications across web, iOS, and Android, all without the need for coding. With over 5 million users spanning more than 100 countries, Bubble is the premier cross-device no-code platform, dismantling barriers to entrepreneurship and innovation worldwide.Our Achievements:We take pride in our thriving product ecosystem, with numerous VC-backed companies having been built entirely on Bubble. Following eight years of bootstrapping and finding product-market fit, we successfully raised a $100 million Series A, positioning us as one of the fastest-growing companies in the New York tech landscape. Bubble not only facilitates product launches but empowers individuals to transform their ideas into successful businesses. For instance, Mailead turned a $10k investment into a $2M valuation, while Faceless.video achieved over $1M in ARR in under a year, among numerous other success stories.About Our Team:We are excited to expand our AI Engineering Team to forge the next generation of AI-enhanced development workflows. Our vision is to facilitate AI-assisted full-stack development, empowering users to articulate their applications in natural language and enabling AI to generate, modify, and enhance their applications seamlessly.As a Senior Software Engineer specializing in AI/LLM, you will be instrumental in shaping the future of AI-driven development at Bubble. You will work on feature development driven by large language models (LLMs), design agentic workflows, and develop proprietary models using Bubble’s unique datasets. Close collaboration with Product, Infrastructure, and Research teams will be key to pushing the boundaries of AI-infused development.In this role, you will:Enhance LLM reasoning and retrieval techniques to elevate Bubble’s AI-driven development tools.Design and implement innovative workflows that leverage AI for seamless software development.

Podium Automation is a pioneering startup dedicated to transforming the industrial control panel manufacturing landscape through innovative software-driven design and automated fabrication. Our mission is to revolutionize the industrial supply chain, dramatically reducing lead times for essential electrical equipment from several months to mere days. With robust backing from a16z’s American Dynamism fund, SV Angel, and Banter Capital, we are rapidly expanding in New York City.We are on the lookout for a Staff Software Engineer who is passionate about creating cutting-edge technology in the built environment. You will take ownership of our component intelligence platform, which serves as the foundation for instantaneous and precise panel design.The Challenges You Will TackleIndustrial control panels are composed of numerous components including contactors, terminal blocks, PLCs, switches, and more, each with intricate, structured data like terminal semantics, electrical ratings, spatial information, and certifications. Unfortunately, much of this vital data is not readily accessible in machine-readable formats; instead, it's hidden within complex and inconsistent sources such as PDFs, user manuals, datasheets, STEP files, and diagrams. Manual data structuring is not scalable, and that's where you come in.Your mission will be to address this issue from the ground up by designing and developing systems that efficiently extract, validate, and deliver reliable information from these multifaceted data sources.Your ResponsibilitiesTechnical Leadership: Take charge of the technical roadmap and enhance our proprietary data model for industrial devices.Data Extraction Pipeline: Design and implement extraction pipelines that derive structured data from PDFs, datasheets, user manuals, STEP files, images, and manufacturer APIs. Your solutions may incorporate specialized parsers and validators, established tools such as OCR libraries, machine learning techniques, or a combination of these — you'll have the autonomy to choose the most effective approach.Ongoing Optimization: Extraction is merely the beginning. We continuously iterate and refine component data, gradually building trust in it over time. You will implement confidence scoring, human-in-the-loop review processes, and rollout strategies, presenting device data with varying levels of accuracy, completeness, and usability.Collaborative Engagement: Work closely with electrical and process engineers to ascertain data requirements and ...

Have you ever felt the thrill of deploying an Apache Cassandra cluster using Chef or Puppet for the first time? Did you realize that this pivotal moment marked a shift in your approach to deployment forever? When AWS experiences a regional outage of DynamoDB, do you instinctively consider strategies for resilience and replication lag? Do you grasp how your services react to such incidents? How excited were you when you first utilized Claude Code or Cursor to create a pull request? Did you come to appreciate the necessity of rapid feedback and iterative capabilities in your development process?At ConductorOne, we recognize that the landscape of technology is evolving, and we are committed to staying at the forefront. Our team is dedicated to building AI tools and leveraging AI technologies in our development processes every day. We maintain a fast-paced shipping cycle, constantly tackling complex challenges. While the problems we face remain tough, our ability to address them has been revolutionized.We seek outstanding Staff and Principal Engineers to join our Automations team in New York. As one of the first engineers at our new office, you will play a crucial role in shaping our culture, setting high hiring standards, and influencing our technical direction from the very start. We are looking for proactive engineers who are eager to develop an AI-native product with cutting-edge AI tools. These senior technical leadership roles are vital for steering our technical strategy, mentoring teams, and executing complex, high-impact projects. If you thrive on action and have a passion for delivering results, we would love to connect with you.Explore our approach to solving challenging problems through the following blog posts:Incremental Sync: How ConductorOne Keeps Identity Data Fresh in Real TimeBuilding Trust Through Connector ReliabilityAbout ConductorOneConductorOne is the pioneer of AI-native identity security platforms, safeguarding every type of identity—human, non-human, and AI. Our innovative solutions empower enterprises to transcend the confines of traditional identity governance, effectively reducing their attack surface while enhancing user experiences.Renowned companies such as DigitalOcean, Instacart, Ramp, and Zscaler trust ConductorOne to secure their identities. We are supported by leading investors and are experiencing rapid growth, yet we remain small enough for every engineer to have a significant impact on both product development and company culture.

About the Role qloo is looking for a Machine Learning Engineer focused on Large Language Models (LLMs) and personalization. This position is based in New York City. What You Will Do Design and build machine learning models to improve user experience and increase engagement. Work closely with teams across the company to implement advanced algorithms. Support data-driven decisions by contributing expertise in LLMs and personalization techniques. Collaboration This role involves frequent collaboration with cross-functional groups, including product and data teams.

Extend is pioneering a state-of-the-art document processing platform, leveraging the power of LLMs. Our mission is to revolutionize the way organizations interact with unstructured data.As a Senior Software Engineer at Extend, you will play a pivotal role in developing our core platform, which empowers businesses to configure, test, and deploy document processing solutions. We seek outstanding engineers who are passionate about delivering seamless product experiences, pay meticulous attention to detail, and thrive in a high-agency environment.

Lab49 is seeking innovative Agentic Developers—engineers who leverage AI tools to create software rather than merely utilizing them.This role transcends the typical 'adding AI features' or 'building AI platforms' narrative. We are searching for developers who can produce production-quality enterprise code, using large language models as their primary interface, especially in the modernization or extension of complex, legacy systems within highly regulated environments.As a vibe coder, you will combine profound engineering intuition, strong system design capabilities, and a fluent command of large language models to accelerate development processes without compromising on rigor, compliance, or reliability.

The mission of The New York Times is to seek the truth and help people understand the world. Our commitment to independent journalism drives everything we do, enabling us to deliver compelling stories from nearly 160 countries. We prioritize how our readers engage with our journalism across various platforms, and our business strategy is focused on providing unparalleled journalistic quality that our audience values.Department Overview:The Research & Development team at The New York Times investigates the intersection of technology and journalism. We work collaboratively with designers, developers, reporters, photographers, and editors to innovate new storytelling methods, from initial concepts to live publishing.At The Times, technology is integral to our operations, influencing our insights into technological trends, driving our digital transformation, and enhancing our readers' experiences. Our R&D team identifies opportunities that emerging technologies can present in alignment with our strategic objectives.We are seeking a Senior Software Engineer with expertise in applied AI to create applications leveraging Large Language Models (LLMs) that align with The Times' mission and journalistic standards. The ideal candidate should possess the capability to work independently while also collaborating effectively within a team. A blend of curiosity and skepticism towards emerging technologies is essential, as is a commitment to solving meaningful user challenges. You take pride in your work and recognize the value of documenting patterns to aid future development. Please note that this is a temporary position.

At GPTZero, we are committed to fostering trust and transparency across the internet. As a premier AI detection platform, we equip educators, students, journalists, marketers, and writers with the tools they need to navigate the rapidly changing world of AI-generated content. With a user base numbering in the millions, we are pioneering a category-defining company at the confluence of AI and information integrity.Our team is comprised of individuals from high-performance engineering backgrounds, including industry leaders like Meta, Perplexity, AWS, Affirm, and renowned AI research institutions such as Princeton, Caltech, and the Vector Institute.About this role:In this pivotal role, you will be instrumental in developing the next generation of AI tools designed to enhance and preserve critical thinking for humanity. The ideal candidate will be skilled in creating dependable AI agents and prompt engineering, possess a strong product sense, and demonstrate exceptional software engineering abilities. You will collaborate with a dynamic team of passionate innovators to create software that sets industry standards and has garnered millions of global users.

Extend is pioneering a cutting-edge cloud-based document processing platform, dedicated to revolutionizing the handling of unstructured data. As a Senior Software Engineer, you will play a pivotal role in developing our core platform that empowers companies to efficiently deploy document processing solutions. We seek outstanding engineers who are passionate about creating seamless product experiences, demonstrating meticulous attention to detail, and exhibiting a proactive approach in their work.

Join Kustomer, a leading customer service platform, as a Senior Software Engineer specializing in AI Automations. In this role, you will leverage artificial intelligence to enhance our automation processes, creating innovative solutions that improve customer experiences. You will collaborate with a talented team to design and implement cutting-edge technology, ensuring our platform remains at the forefront of the industry.

Join Centari - A Leader in Deal IntelligenceAt Centari, we are revolutionizing high-stakes dealmaking by unlocking the potential of private deal data. As we develop the future's deal intelligence platform for law and finance, we go beyond mere automation, embracing a data-driven approach to empower negotiation teams globally with strategic insights. Our proprietary Deal Reasoning Engine transforms complex documents into invaluable knowledge, ensuring our clients have the upper hand in negotiations.Our dynamic team consists of attorneys, financial experts, and engineers who thrive in a hybrid, cross-cultural environment. We are proud to be supported by leading enterprise AI investors, including GTMfund, former DoorDash board member Jeremy Kranz, Seamless co-founder Andy Appelbaum, Jack Altman, South Park Commons, and Recall Capital.We embrace complexity, as it is the breeding ground for innovation. If you are a builder who excels in ambiguity and embodies radical ownership, we want to connect with you.For further details, visit centari.com or follow us on LinkedIn.Role OverviewWe are seeking a Senior Backend Software Engineer to join our innovative product team. You will play a pivotal role in designing and developing Centari's core AI technology. Collaborating with fellow engineers who share a passion for action, you will write code, influence product direction, engage with clients, and drive projects from concept through to implementation.Our technology stack includes Go and React/TypeScript, utilizing state-of-the-art LLM technologies across our infrastructure, search, and persistence layers. If you have a passion for building impactful LLM applications and enjoy tackling complex challenges, we want to hear from you.

Join our dynamic team at 360 IT Professionals as a Lead Test Automation Engineer, where you will spearhead the development and implementation of automated testing frameworks. Your expertise will drive the quality assurance process, ensuring that our software solutions meet the highest standards of performance and reliability.As a key player in our organization, you will collaborate with cross-functional teams to enhance existing testing processes and mentor junior staff members. This is an excellent opportunity for individuals looking to make a significant impact in a fast-paced environment.

Qodeworld is looking for a Lead QA Automation Engineer to join the team in New York, NY. This role centers on designing, building, and maintaining automated test scripts for both web and mobile platforms. The position takes responsibility for end-to-end testing, automating regression suites, and producing clear, actionable test reports. Key Responsibilities Develop and maintain automation test scripts using Selenium with Java, TestNG, and the Page Object Model pattern. Plan, build, and execute comprehensive test scripts for new and existing features. Work with relational databases, especially Microsoft SQL Server, to validate data and test scenarios. Oversee the creation, upkeep, and execution of test scripts, with experience integrating Azure/TFS considered a plus. Create detailed and accurate test reports to support release decisions. Track and manage defects using JIRA or similar tools. Maintain and enhance the Automation Testing Framework. Collaborate in an Agile environment, working with developers, business analysts, and product owners to support early testing (shift-left approach). Prioritize tasks and adapt to changing project needs. Develop test plans, test suites, and both manual and automated test cases for assigned changes. Communicate clearly with team members, project managers, and clients as needed. Essential Skills Strong object-oriented programming skills with significant experience in Java. Expertise in Selenium for automation testing. Hands-on experience with TestNG and the Page Object Model (POM). Familiarity with Playwright and SpecFlow. Solid SQL knowledge. Proven ability in automation testing and framework maintenance. Excellent verbal and written communication skills. Preferred Skills Experience with API testing. Background in manual testing. Exposure to mobile application testing. Qualifications Minimum 10 years of experience in systems or application development. B.Tech, B.E, M.Tech, or MCA degree from a recognized university, ideally in Computer Science.

Join Kira Systems as a Senior Quality & Automation Engineer and play a pivotal role in enhancing our software quality and automation processes. You will work closely with cross-functional teams to design, implement, and maintain automated test frameworks, ensuring the delivery of high-quality software solutions.

About JuniorAt Junior, we are pioneering advanced LLM-powered tools designed to revolutionize the investment research process for private market investors. Our clientele includes some of the top 10 private equity and consulting firms worldwide, managing investments worth billions annually. As a profitable and bootstrapped company, we have a vibrant team of 24 based in London and New York City.Discover more about our mission and values here. Role DescriptionAs one of our inaugural engineering interns, you will have the unique chance to:Rapidly deploy solutionsDesign and develop innovative methods for interacting with technologyEngage in pioneering projects that utilize LLMsCollaborate intimately with external partners to drive our expansionInfluence product strategy, direction, and prioritizationHelp cultivate our engineering culture Project HighlightsDevelop new innovative products at Junior to incorporate a wider array of research inputsCreate a voice-to-voice survey tool with ultra-low latency capable of autonomously performing large-scale research tasksConstruct a mobile application from the ground up in just 3 weeksBuild segmented knowledge graphs to transform unstructured data into structured formatsDevelop an AI-native CRM system linked deeply to the aforementioned knowledge graph About YouWe seek product-oriented full-stack engineers who:Reside in NYCAre motivated to participate in product decisionsPossess excellent communication skills and an interest in client-facing rolesAre skilled in our tech stack: Next.js, TypeScript, PostgreSQLBonus points for experience in designing and building AI-powered products!Have a strong desire to accelerate development processes

Cloaked is an innovative privacy startup committed to restoring consumer trust regarding personal data usage. Our mission is to develop an internet that prioritizes user needs, with individual privacy and opt-in at its foundation. Our flagship product is a virtual 'cloak' that users can employ while browsing any website—be it Facebook, Amazon, or others—allowing them to selectively share all, some, or none of their private information based on personal preferences.

Podium Automation is an innovative startup transforming the industrial control panel manufacturing sector with cutting-edge software design and automated production techniques. Our mission is to revolutionize the industrial supply chain, significantly reducing lead times for essential electrical equipment from months to mere days. With over $5M raised to date, we are proudly supported by a16z’s American Dynamism fund, SV Angel, and Banter Capital.We are on the lookout for an Assembly Technician I to become a crucial part of our dynamic team in our Brooklyn factory, where you will be involved in the assembly and testing of industrial control panels. This role offers exposure to a variety of operations, including enclosure modification, wiring, and final testing. As we embrace new technologies, you will collaborate closely with our engineering team to operate and evaluate innovative methods and machinery, providing valuable feedback aimed at enhancing our production processes.

Join eproinc as a ZOS Automation Engineer and take your career to the next level. In this pivotal role, you will be responsible for designing, implementing, and optimizing automated solutions within our ZOS environments. You will work closely with cross-functional teams to enhance efficiencies and drive innovation through automation.