Infrastructure Software Engineer

About Us:At Fireworks AI, we are at the forefront of creating next-generation generative AI infrastructure. Our cutting-edge platform is recognized for delivering the highest-quality models with unparalleled speed and scalability in inference. Independently benchmarked as a leader in LLM inference speed, we drive significant advancements through innovative projects, including our proprietary function calling and multimodal models. As a Series C company valued at $4 billion and backed by leading investors such as Benchmark, Sequoia, Lightspeed, Index, and Evantic, we are a dynamic team of builders, comprised of veterans from Meta PyTorch and Google Vertex AI.The Role:We are seeking a talented Software Engineer to join our AI Infrastructure team. In this pivotal role, you will contribute to designing and developing the foundational systems that power Fireworks AI’s generative AI platform. Your focus will be on building robust infrastructure and tools that guarantee the reliability, performance, quality, and availability of our AI systems.Our mission is to establish Fireworks AI as the most dependable and user-friendly generative AI platform globally. You will collaborate closely with our cloud infrastructure, product, and performance teams to create infrastructure solutions that connect our customers with the high-performance proprietary Fireworks inference engine.Key Responsibilities:Design and develop scalable backend infrastructure supporting distributed training, inference, and data pipelines.Build and maintain essential backend services, including LLM CI/CD pipelines, control planes, and model serving systems.Enhance performance optimization, cost efficiency, and reliability across compute, storage, and networking layers.Create frameworks and safeguards to ensure Fireworks AI maintains the highest model quality in the industry.Work alongside performance, training, and product teams to translate research and product requirements into effective infrastructure solutions.Engage in code reviews, technical discussions, and continuous integration and deployment processes.

Join Thread AI as an Infrastructure Software EngineerAt Thread AI, we are pioneering the development of an AI-native workflow orchestration engine. We are in search of passionate and skilled professionals eager to be a part of our expanding team. Our mission is to simplify infrastructure for enterprises and public sector organizations aiming to harness the full potential of artificial intelligence.Located in the heart of New York, our diverse team comprises seasoned experts in AI, product management, and engineering, all dedicated to crafting and implementing intricate workflows and infrastructure solutions.Our Engineering CultureWe pride ourselves on having a compact yet highly committed technical team that encompasses engineering, research, design, product, and operations. We believe that a small, empowered team with a flat organizational structure fosters rapid innovation and superior product development compared to larger, hierarchical entities.Role OverviewWe are looking for a talented software engineer with a robust background in infrastructure to contribute significantly to the scalability and reliability of our platform. The ideal candidate will support complex network topologies and should possess a deep curiosity and creativity, excelling in problem-solving within a fast-paced, ownership-driven environment.

At Scale AI, we are revolutionizing the foundation of enterprise AI. We seek a skilled Staff Infrastructure Software Engineer who will serve as the principal technical leader in developing our 'paved road' for knowledge retrieval and inference engines. In this role, you will not only oversee resources but also establish deployment standards for scalable Agentic workflows. Your goal is to connect intricate AI orchestration with top-notch infrastructure, ensuring our platform is the most dependable choice for enterprise agents.The ideal candidate will excel in a dynamic environment, demonstrate a passion for deep technical engagement and mentorship, and possess the ability to define long-term technical strategies for a crucial domain while maintaining a hands-on focus on delivery. You will design and implement solutions across multiple cloud platforms (GCP, Azure, AWS) for clients in highly regulated sectors such as healthcare, telecommunications, finance, and retail.

Join Fluidstack: Pioneering the Future of IntelligenceAt Fluidstack, we're transforming the landscape of artificial intelligence infrastructure. Collaborating with leading AI research labs, government entities, and major corporations—including Mistral, Poolside, Black Forest Labs, and Meta—we are dedicated to delivering computing solutions at unprecedented speeds. Our mission is to expedite the realization of Artificial General Intelligence (AGI), and we are seeking passionate individuals who thrive on purpose and excellence.We take immense pride in the systems we develop and the trust we build with our clients. If you are ready to roll up your sleeves and contribute to shaping the future of intelligence, we invite you to join our innovative team.Position OverviewFluidstack, a prominent player in the cloud services arena, is on the lookout for a Software Engineer specializing in Infrastructure Platform Development. In this role, you will be instrumental in constructing the foundational platforms that support our global infrastructure and data center operations. Your focus will be on developing robust internal tools across various domains, including Configuration Management Database (CMDB), asset management, Data Center Infrastructure Management (DCIM), monitoring, observability, security, and operational automation. Collaborating with cross-functional teams, you will craft scalable and user-friendly solutions that enhance our ability to provide top-tier infrastructure services.Key ResponsibilitiesInfrastructure Platform DevelopmentDesign and implement a next-generation CMDB system to serve as the definitive source of truth for infrastructure assets, network architecture, and configuration data.Develop DCIM platforms for managing rack operations, server/GPU deployments, operating system installations, quality assurance, and white-screen activities.Create comprehensive asset lifecycle management systems encompassing receiving, racking, inventory, break-fix, and decommissioning workflows.Build monitoring and observability platforms that integrate telemetry from Building Management Systems (BMS), Environmental Power Monitoring Systems (EPMS), and IT devices, featuring intelligent alerting and incident management capabilities.Develop self-service portals and automation tools for new region initialization, post-deployment operations, and fleet-scale management.Operational Excellence & AutomationMinimize manual tasks through workflow automation and self-service tools that empower our operations and engineering teams.Create workflow orchestration systems to streamline complex multi-step processes that encompass incident, problem, and change management.

CVector is dedicated to revolutionizing economic optimization and AI-driven predictions across energy and manufacturing sectors.Our technology seamlessly integrates critical decision-making factors that impact cost, reliability, and profit margins, providing a unified decision layer that forecasts future scenarios, simulates potential outcomes, and optimizes operational strategies. This allows industrial plants to operate closer to their maximum economic potential daily.This position requires in-office attendance at our New York City headquarters four days a week. CVector serves clients nationwide and operates in challenging industrial environments.Role OverviewAs a Senior Software Engineer specializing in Backend and AI Infrastructure, you will be instrumental in advancing CVector’s backend platform. Your focus will be on developing time-series data systems, AI-enhanced analytics, cloud infrastructure, and data ingestion pipelines that underpin our client-facing applications and internal modeling tools.This role is ideal for engineers who thrive on working closely with data and infrastructure, possess excellent architectural judgment, and are eager to engage with AI systems, databases, and distributed backend services. You will take ownership of complex systems, lead significant technical migrations, and influence the integration of intelligence into industrial energy workflows.You will work in close collaboration with product, modeling, and frontend engineers, significantly impacting the platform's direction, reliability, and scalability for the long term.Key ResponsibilitiesAs a Senior Software Engineer, your contributions will span various interconnected domains:Intelligent SystemsTranslate customer domains and operational workflows into effective prompts and AI system interfaces.Design, implement, and refine evaluations for AI outputs.Incorporate customer feedback and reinforcement signals to enhance system performance.Optimize context selection, retrieval, and trace collection to elevate output quality.Fine-tune smaller models using collected traces to enhance speed while maintaining performance standards.Evaluate and assimilate new AI platforms and models as they emerge.Support the training and deployment of large, time-series-specific models.Backend Platform and Data InfrastructureOversee migrations and enhancements of our time-series data schemas and storage systems.Update and manage PostgreSQL and associated database infrastructure.Develop and sustain data connectors for industrial and external systems.Lead improvements to MQTT-based data ingestion pipelines.Transition PostgREST to a GraphQL-based framework and evolve our API architecture.

Join our innovative team at NBCUniversal as a Staff Software Engineer specializing in AI Infrastructure and Python development. This role involves designing, building, and maintaining scalable AI systems. We seek a passionate engineer who thrives in a collaborative environment and is eager to contribute to cutting-edge projects that impact millions of users.

About UsAt Percepta, we are dedicated to revolutionizing vital sectors through the power of applied AI. Our goal is to ensure that key industries such as healthcare, manufacturing, and energy harness the benefits of cutting-edge technology.We partner with leading organizations to facilitate AI transformation, providing:Expertise in engineering, product development, and researchMosaic, our proprietary toolkit designed for the swift deployment of intelligent architecturesStrategic alliances with notable entities like Anthropic, McKinsey, AWS, and the General Catalyst portfolioOur team is a dynamic collective of Applied AI Engineers, Embedded Product Managers, and Researchers driven by the mission to integrate advanced AI into the systems that shape our world.Percepta is a proud partner of General Catalyst.Role OverviewWe are on the lookout for an AI Infrastructure Engineer who will be responsible for the infrastructure, deployment, and operational reliability that underpin Percepta's AI systems, including the autonomous agents driving our innovations.Your role will involve enhancing existing systems: refining our Terraform configurations, fortifying deployment pipelines, and implementing more robust management of infrastructure across various regions and providers. You will also be tasked with constructing missing components and exploring uncharted territories, defining what Site Reliability Engineering (SRE) means in the context of autonomous decision-making systems.The infrastructure paradigms for future autonomous systems are yet to be established, and you will play a crucial role in shaping them.What Sets This Role ApartYou will be working with autonomous systems, where the infrastructure dynamics shift significantly when workloads have agency.Observability entails understanding the rationale behind an agent's decisions, not merely checking the health of a pod.There is a tangible gap between research and production in our environment. Our teams transition optimization algorithms and AI systems from research settings to production, and you will be integral to this process. While MLOps experience is not mandatory, you will be closer to this boundary than most infrastructure roles.Join a small team with significant ownership. You will make foundational decisions rather than inherit pre-existing ones.Your ResponsibilitiesDesign infrastructure patterns for multi-agent systems that are observable, controllable, and recoverable in innovative ways.

About UsAt Credal, we are committed to leveraging cutting-edge AI technologies to empower those who are dedicated to shaping a brighter future.Our platform accelerates the complex operations of leading institutions while embedding robust security and governance at every level of our offerings. Our esteemed clientele includes the U.S. Department of Health and Human Services, MongoDB, Comcast NBC Universal, Lattice, Wise (formerly TransferWise), Checkr, and incident.io, among others.With over $10 million in funding secured, we have ample runway to support our ambitious goals. Join a team of Thoughtful Doers™ hailing from top-tier companies such as Palantir, Cruise, Meta, Uber, and Google. Credal operates in-person from our spacious NYC office, complete with meals provided.

About DecagonDecagon stands at the forefront of the conversational AI revolution, enabling brands to provide exceptional concierge-level customer experiences. Our cutting-edge technology empowers renowned enterprises such as Avis Budget Group, Block’s Cash App and Square, Chime, Oura Health, and Hunter Douglas to implement AI-driven agents. These agents facilitate personalized interactions across all communication channels including voice, chat, email, and SMS.Our vision is to transform the landscape of customer interactions, moving beyond traditional support tickets and hold music toward expedited resolutions, enriched conversations, and stronger relationships. We are proudly supported by prestigious investors such as a16z, Accel, Bain Capital Ventures, Coatue, and Index Ventures, all of whom share our ambitious vision.As an in-office company, we thrive on a collective commitment to excellence and speed. Our core values—Just Get It Done, Invent What Customers Want, Winner’s Mindset, and The Polymath Principle—guide our collaborative efforts and professional growth.About the TeamThe Infrastructure team is responsible for designing and maintaining the essential frameworks that drive Decagon’s operations, including networking, data management, machine learning serving, developer platforms, and real-time voice communication. We collaborate closely with product, data, and machine learning teams to create high-scale, low-latency systems that meet stringent service level objectives and offer exceptional developer experience.Our team focuses on five critical areas:Core Infrastructure: Our foundational cloud architecture encompasses networking, computing, storage, security, and infrastructure-as-code, ensuring reliability, scalability, and cost-effectiveness.Data Infrastructure: We develop streaming and batch data platforms that drive analytics and business intelligence while enabling customer-facing telemetry for both customer-managed and on-premises environments.Machine Learning Infrastructure: Our platforms support GPU and model serving for large language model inference, featuring multi-provider routing and capabilities for on-premises or air-gapped deployments.Developer Experience Platform: We focus on continuous integration and deployment (CI/CD), streamlined processes, and essential services that facilitate fast, safe, and consistent shipping across teams.Voice Infrastructure: Our telephony and WebRTC stack ensures ultra-low-latency, high-quality voice communication, supported by comprehensive observability.Our mission is to deliver extraordinary support experiences where AI agents collaborate with human operators to resolve challenges swiftly and accurately.About the RoleWe are seeking a Senior Infrastructure Engineer who will play a pivotal role in shaping our infrastructure landscape and enhancing the efficiency and performance of our systems.

Harvey develops AI-driven solutions for legal and professional services, serving over 1,000 organizations in more than 60 countries. The company is growing rapidly and has strong support from leading investors. Harvey’s team values ownership, quick decision-making, and close collaboration. Engineers work side by side with leadership and customers to address practical challenges. The company operates in person in New York City and provides relocation support for new hires. Role overview The Staff Software Engineer - Core Infrastructure joins a team responsible for designing, building, and scaling Harvey’s core infrastructure. This platform handles billions of prompt tokens and millions of daily requests, forming the backbone of Harvey’s global legal AI services. The work involves both creating new systems and maintaining high operational standards. Reliability, scalability, and security are central as Harvey continues to expand its reach among top law firms and professional service providers. This is a full-time, in-person position based in New York City. Relocation assistance is available. What you will do Design and build scalable, fault-tolerant infrastructure systems that support Harvey’s AI platform across multiple cloud regions. Take ownership of and improve multi-cloud infrastructure (Azure, GCP), focusing on Kubernetes orchestration, networking, and container management. Lead technical projects in areas such as observability, incident response, and performance optimization.

At Genius Sports, we combine cutting-edge technology with premier live data to revolutionize the sports experience for fans around the globe. Our mission is to create more immersive, interactive, and personalized experiences than ever before. Discover more about us at geniussports.com.The Role - Staff Engineer - Infrastructure Platform We are on the lookout for an exceptional Staff Engineer to spearhead critical projects within our core infrastructure platform. Genius Sports is currently integrating its diverse tech teams and acquisitions under a cohesive technical strategy, and our infrastructure platform is the foundation of this transformation. Our primary objective is to empower engineering teams to efficiently build, deploy, and manage Genius Sports’ extensive product catalog in a consistent manner. In this role, you will collaborate with fellow InfraPlat leaders to define and execute the technical vision and implementation across an array of projects. These initiatives encompass multi-account and region Kubernetes clusters, MLOps, standardized deployment processes, and a centralized authentication platform. You will also engage with stakeholders from product engineering teams to assess requests, identify common challenges, and prioritize initiatives.

About Amperos HealthAmperos Health stands at the forefront of revolutionizing revenue cycle management (RCM) for healthcare clinics, enabling them to optimize revenue collection efficiently and swiftly. Established in 2023 and supported by notable investors such as Uncork, Neo, Nebular.vc, and strategic angels from industry leaders like OpenAI, Stripe, and Twilio, our mission is to transform the relationship between healthcare providers and payers. We envision an AI-driven workforce that alleviates administrative workload and accelerates the financial return for healthcare professionals.About the RoleAs our inaugural Infrastructure Engineer, you will spearhead the development of our infrastructure at Amperos. You will manage DevOps, enhance developer experience, ensure compliance, and oversee observability and monitoring within our AWS environment. This role presents exciting challenges associated with AI infrastructure, and you will have the chance to mold and lead your team as we expand.Key ResponsibilitiesEstablish and maintain the infrastructure to support Amperos' growth trajectory.Enhance and optimize AWS infrastructure, boosting development efficiency and creating modular engineering frameworks.Develop systems that expedite the deployment of AI features and enhance observability of large language models (LLMs).Minimize AWS expenditures while improving visibility into infrastructure costs.Lead initiatives related to security and technical compliance, including VPNs, firewalls, and network configurations.Candidate ProfileA minimum of 5 years of experience in leading infrastructure teams within top-tier organizations.Ability to identify key ROI infrastructure challenges from the outset and develop a strategic roadmap for enhancements.Proficient in leading engineering discussions and articulating the impact of infrastructure projects.Adaptable and willing to take on diverse roles as needed; no task is too small.Demonstrates high agency, with the capability to produce results with minimal guidance.Excellent verbal and written communication skills; proactively shares vital information with the team.Passionate about leveraging technology to address challenges in an underserved industry.

Join a Transformative Force in TechnologyAt Palantir, we create groundbreaking software that revolutionizes data-driven decision-making and operational efficiency. Our platforms enable partners to combat critical challenges—from developing life-saving medical treatments to predicting supply chain disruptions and locating missing persons.Position OverviewAs a Backend Software Engineer at Palantir, you will play an essential role in shaping how organizations leverage data. You will be engaged in all stages of the product lifecycle, from ideation and design to prototyping and final deployment. Collaborating with both technical and non-technical team members, you will gain insights into customer challenges and develop innovative solutions. We promote cross-team collaboration, allowing you to expand your knowledge across various technologies and product facets. You will work autonomously and make impactful decisions within a supportive community that fosters your growth into a technical leader.Our Product Development teams are composed of small, focused groups of Software Engineers, each dedicated to distinct aspects of our offerings. The infrastructure teams are tasked with fortifying the foundational layers of our software stack, emphasizing database technologies, distributed systems, large-scale data architectures, security, and application infrastructure. In this role, you will write robust code that supports Palantir Foundry and Gotham, ensuring high performance, security, and scalability for products utilized by key public and private sector institutions. You will be instrumental in building the core capabilities that empower research scientists, aerospace engineers, intelligence analysts, and economic forecasters worldwide.We seek engineers who are driven by a passion for solving real-world challenges, enabling both developers and end-users to maximize their productivity. If you are eager to create reliable, high-performing, and scalable systems, and to design resilient APIs, this opportunity allows you to make a substantial impact on our products and the communities we serve.

About KiddomKiddom is an innovative educational platform dedicated to enhancing student equity and growth. By combining high-quality instructional resources with interactive digital learning, Kiddom enables schools and districts to take control of their curriculum. This results in personalized learning experiences that cater to the distinct needs and aspirations of local communities. The platform is enriched with insightful data for teachers and leaders, fostering continuous improvement in instructional strategies, school programming, and professional development.As a member of the InfraOps team, you will play a crucial role in supporting Kiddom's engineering efforts by developing a scalable and sustainable infrastructure that aligns with our company objectives. This is a unique chance to join a small, skilled team during a pivotal moment as we transition from Series C to D funding. You will have the autonomy to influence your work significantly, embracing a variety of tasks that reflect your expertise and enthusiasm.Key Responsibilities:Promote and cultivate a robust DevOps culture at Kiddom by collaborating with teams to establish best practices and guide both new and existing services.Implement Infrastructure as Code (IaC) to ensure confidence in automated, repeatable processes.

Why Join Moonshot AI?Envision a web that autonomously transforms itself to enhance sales, improve conversions, and accelerate growth.At Moonshot AI, we’re pioneering this future by integrating generative AI, extensive data processing, and innovative experimentation into a self-adaptive online ecosystem.As a well-capitalized, early-stage startup with grand ambitions, your role here transcends that of a typical employee — you’ll actively contribute to shaping the company’s technical and cultural foundation. If you've ever aspired to have the freedom of a founder while being supported by elite investors, this opportunity is for you.What You'll Create & LeadIn the position of Staff Software Engineer, you will serve as the technical cornerstone of Moonshot's evolution engine, responsible for designing scalable systems, steering engineering strategy, and mentoring your colleagues.Your work will blend hands-on expertise with high-level architectural insight, transforming visionary ideas into technical realities.You will:Innovate at the forefront of generative AI - develop systems that empower AI to autonomously reason, experiment, and implement tangible changes to the web.Architect the next generation of our experimental engine - ensuring it is scalable, observable, fault-tolerant, and capable of handling millions of daily events.Design and advance our backend infrastructure utilizing Python (Flask-RestX), serverless AWS, and various data pipelines (ClickHouse, Postgres, Kinesis, Firehose, S3).Lead technical strategy - establish our engineering principles and evolve the architecture across microservices, data ingestion, and LLM-driven systems.Mentor and uplift - enhance the skills of senior and mid-level engineers through code reviews, collaborative programming, and detailed design documentation.Collaborate across teams - partner with AI, product management, and data science to translate business objectives into robust systems.Prototype and expand boundaries - rapidly bring concepts to production while balancing experimentation with thoroughness.Enhance performance, security, and reliability as we scale towards SOC 2 certification and enterprise clientele.This role emphasizes technical leadership without the responsibilities of people management: pure design, significant leverage, and complete ownership.

Astronomer develops Astro, a unified DataOps platform powered by Apache Airflow®. Over 800 enterprises rely on Astronomer to help their teams apply software, analytics, and AI to real-world challenges. More details are available at www.astronomer.io. Role overview The Airflow Infrastructure team at Astronomer scales Apache Airflow for organizations with complex data pipelines. This group works within Research and Development, focusing on cloud-native infrastructure and open-source integration. As a Software Engineer on this team, the main responsibility is building the infrastructure layer that connects open-source Airflow with scalable, enterprise-grade cloud systems. The work directly impacts how companies orchestrate and manage data pipelines, emphasizing speed, reliability, and ease of use. This position is based in New York City and follows a hybrid work schedule. What you will do Write and maintain backend services using clean, well-tested code. Collaborate with engineers, product managers, support, and leadership to align technical direction with business goals. Participate in code reviews and provide constructive feedback to peers. Enhance the performance, reliability, and scalability of backend systems. Prototype and suggest new ideas to improve user experience. Document systems and processes in a clear, accessible manner. Join on-call rotations to troubleshoot and resolve incidents as they occur. Requirements 3-5 years of experience with Python, Golang, and Kubernetes. Strong understanding of distributed systems and microservices architecture. Experience working with cloud platforms and CI/CD pipelines. Demonstrated problem-solving skills and a collaborative mindset.

Join Palantir Technologies as a Senior Backend Software Engineer specializing in Infrastructure. In this pivotal role, you will work at the intersection of software engineering and infrastructure systems, contributing to the design and implementation of scalable backend solutions that empower organizations to make data-driven decisions.

Join the Thread AI Team!At Thread AI, we are pioneering the development of an innovative AI-native workflow orchestration engine. We invite passionate and skilled professionals to be part of our expanding team. Our mission is to simplify infrastructure for enterprises and public sector organizations aiming to maximize the potential of AI.Based in New York, our dynamic team comprises experts in AI, product development, and engineering, all with a proven history of designing and executing intricate workflows and infrastructure.Our Engineering CultureWe pride ourselves on being a compact, dedicated technical team that encompasses engineering, research, design, product, and operations. We believe that a small, committed team with a flat structure and a collaborative ethos can achieve more and innovate faster than larger, hierarchical organizations.Role OverviewWe are seeking a talented software engineer to take charge of implementing and overseeing the security of our internal information systems’ infrastructure and processes. You will collaborate closely with senior engineers to develop robust security capabilities, enforce security policies, and vigilantly monitor internal systems for potential security threats.

Join the Revolution at CheckAt Check, we transform the way people get paid, simplifying payment processes for payroll businesses. As pioneers of embedded payroll, we collaborate with our partners to redefine payroll systems, enabling businesses to launch, grow, and flourish. Discover our journey | Listen in.Check is more than just an API infrastructure; we serve as a launchpad for payroll businesses.Our TeamPayroll systems are in need of innovation. Join a passionate team dedicated to solving these challenges! At Check, your problem-solving skills, critical thinking, and determination will drive impactful changes across our projects. We view challenges as opportunities and encourage collaboration that leverages the unique strengths of every team member.If you are ready to dive in and reshape payroll, let’s work together to simplify complexities and create a brighter future for businesses of all sizes.The RoleEngineering is the backbone of Check. We envision payroll as part of modern financial software, which necessitates robust systems that our operators and partners can rely on. Every solution we develop is built on reliable, scalable, and secure systems that ensure timely payments.We are in search of a Staff Software Engineer who possesses strong software design expertise coupled with hands-on infrastructure experience. In this position, you will enhance the core systems that enable payroll operations, focusing on scalability, production efficiency, and empowering engineers with reliable tools for software deployment.You'll collaborate across product and platform teams to advance our cloud infrastructure, enhance system deployment and monitoring, and simplify the architecture underpinning embedded payroll. Your challenges will often bridge the domains of infrastructure, product, and operations.This role is perfect for individuals who have managed complex systems in dynamic environments and take pride in creating resilient, understandable infrastructure that is essential for business operations.