Data Infrastructure Engineer for Real-Time Systems

Join Deeter Analytics as a Data Infrastructure Engineer specializing in Real-Time Systems. In this role, you will play a pivotal part in designing and implementing robust data infrastructures that support real-time analytics and decision-making processes. You will collaborate with cross-functional teams to optimize data flows, ensuring high availability and performance while maintaining data integrity.

Join Deepgram as a Network Engineer specializing in Real-Time Infrastructure. In this pivotal role, you will be responsible for designing, implementing, and maintaining our cutting-edge network systems that support real-time data processing and high-performance applications. Your expertise will help ensure the reliability, scalability, and security of our infrastructure, enabling us to deliver innovative solutions to our clients.

Peregrine Technologies, backed by top-tier Silicon Valley investors, empowers public safety organizations, government entities at all levels, and private institutions to effectively tackle societal challenges with unmatched speed and precision. Our innovative AI-driven platform transforms fragmented data into actionable insights, enabling rapid and informed decision-making that enhances outcomes across the board. Currently, we serve hundreds of clients in over 30 states and two countries, impacting more than 125 million lives as we broaden our reach into enterprise solutions and international markets.Our Engineering TeamWe are a team that prioritizes empathy in our engineering solutions. Understanding how our users interact with our products is essential to our process. Engineers will have the chance to collaborate closely onsite, gaining insights into the diverse use cases our platform addresses.We cherish both ownership and teamwork—you will take full accountability for significant features while working alongside fellow engineers to see them through to completion. We believe humility and empathy are crucial for crafting effective solutions, and you will engage directly with our deployment team and users to iterate and resolve their challenges. Creativity and determination are vital as we pursue our ambitious goals.Your RoleWe are seeking a Staff Data Infrastructure Engineer to join our dynamic team, where you will have substantial ownership over the data ecosystem that supports all of Peregrine's operations. You will design and develop systems that manage, store, and deliver vast amounts of real-time operational data, enabling our customers to make crucial decisions quickly and confidently.This position is ideal for a seasoned individual contributor who excels at solving complex technical challenges and possesses the expertise to influence foundational infrastructure strategies. You will engage with a variety of intricate issues, including:Creating and managing a high-throughput, real-time data integration platform across varied customer environments.Developing a scalable open table format layer for dependable data storage at a petabyte scale.Building and fine-tuning distributed data processing pipelines utilizing Apache Spark and related streaming technologies.Enhancing performance, reliability, and cost-effectiveness throughout the entire data infrastructure stack.Collaborating with platform and product engineering teams to establish data contracts, schemas, and integration pathways.

At Judgment Labs, we specialize in developing cutting-edge infrastructure for Agent Behavior Monitoring (ABM). Unlike conventional observability tools that merely track exceptions and latency, our ABM technology identifies behavioral anomalies, such as instruction drifts and context retrieval losses, in large-scale production settings.Our solutions are trusted by numerous teams working on autonomous agents to gain insights into system behavior post-deployment. Rather than simply reacting to incidents, our clients analyze patterns across conversations and workflows, correlate regressions with specific interaction types, and identify critical points of reliability failure. Recently, we secured over $30 million across two funding rounds from notable investors like Lightspeed, SV Angel, and Valor Equity Partners.The Role:We are seeking a Senior Data Infrastructure Engineer to architect and enhance the real-time data pipelines essential for robust agent behavior analysis at scale. This position plays a vital role in processing hundreds of thousands of traces per second, executing LLM-based scoring and clustering in near-real-time, and ensuring low-latency query performance, which allows teams to monitor agent behavior as it unfolds. Ideal candidates will have experience designing petabyte-scale data systems, optimizing OLAP database performance, and managing the full data lifecycle from ingestion to analytics.What You'll Do:Design and automate large-scale, high-performance streaming and batch data processing systems to support Judgment's behavioral analysis products.Collaborate closely with infrastructure and backend teams to enhance scalability, data governance, and operational efficiency.Promote best practices in software engineering for data infrastructure at scale.Uphold high standards for data quality and engineering: ensuring reliability, efficiency, documentation, testability, and maintainability.Craft data models for optimal storage and access, ensuring efficient data flows to meet critical product requirements.Enhance OLAP database performance through careful schema design, partitioning strategies, storage optimization, and access pattern analysis.

Join Us at NuroNuro is a pioneering self-driving technology firm dedicated to making autonomy accessible for everyone. Since our inception in 2016, we have been developing the world's most scalable autonomous vehicle system, integrating advanced AI with high-quality automotive hardware. Our flagship product, the Nuro Driver™, is licensed for a variety of applications, including robotaxis, commercial fleets, and private vehicles. With years of successful self-driving deployments, we provide automakers and mobility platforms with a clear pathway to commercial-scale autonomous vehicles, fostering a safer, more connected future.Your RoleAs a Software Engineer specializing in Networking, you will be crucial to our remote vehicle monitoring and assistance strategy. You will collaborate with a talented team of engineers to enhance our Teleoperations platform, focusing on the essential communication systems and cloud infrastructure that link vehicles to operators. This role requires a comprehensive understanding of networking algorithms, bandwidth estimation, rate control, computer networking, and real-time communication systems. Your work will help deliver robust solutions that can be licensed for third-party teleoperation applications.Your ResponsibilitiesDevelop a network interface bonding framework to optimize bandwidth and LTE network usage.Create an offline network simulation and emulation framework to predict online performance.Conduct real-world testing, gather feedback, and drive innovative solutions.Collaborate with cross-functional teams to collect on-road network metrics.Your QualificationsA PhD in Computer Science or a related field, or a BS/MS in Computer Science or a related discipline with at least 2 years of relevant industry experience.Proficient in C/C++ and/or Go programming languages.Familiarity with networking protocols, including ICMP, TCP/IP, HTTP, socket programming, FEC, and congestion control.Experience with network simulation frameworks, such as ns-3.Strong communication skills are essential.Bonus QualificationsExperience with video streaming frameworks, such as WebRTC.Understanding of video codecs, including VP8, VP9, H264/265.

Join us at Tradeify.co, a cutting-edge fintech company dedicated to developing advanced infrastructure for real-time data analysis and decision-making. This role goes beyond traditional web application development; it involves designing and implementing mission-critical, multi-service systems that drive complex, large-scale data processing.We seek a pragmatic engineer who is adept at integrating into collaborative teams, adhering to sprint ceremonies, and delivering high-quality code efficiently, even under pressure. We prioritize teamwork, process adherence, and accountability over solo coding endeavors.A competitive compensation package awaits the successful candidate.

About Nuro Nuro is a pioneering self-driving technology company dedicated to making autonomy available for everyone. Since our inception in 2016, we have been working towards creating the world’s most scalable autonomous driver, merging advanced artificial intelligence with high-quality automotive hardware. Our flagship technology, the Nuro Driver™, is licensed for various applications including robotaxis, commercial fleets, and personal vehicles. With numerous successful self-driving deployments, Nuro offers automakers and mobility platforms a reliable pathway to achieve commercial-scale autonomous vehicles, fostering a safer, more interconnected future. Role Overview As a Senior Software Engineer specializing in Networking and Real-Time Systems, you will play a crucial role in managing remote vehicle operations over cellular networks. Your primary responsibility will be to guarantee our system's constant vigilance on the road, tackling complex networking challenges. From bonding multiple LTE carriers to innovatively designing custom Forward Error Correction (FEC) algorithms, your work will push the boundaries of standard protocols. Key Responsibilities Engineered Connectivity: Design a network bonding framework to unify bandwidth across various cellular providers (Verizon, AT&T, T-Mobile) to ensure uninterrupted connectivity. Performance Modeling: Create sophisticated ns-3-like simulations to rigorously test our stack against edge cases, such as entering tunnels, navigating rural dead zones, and managing network congestion. Optimization: Develop and implement custom congestion control algorithms tailored for high-bitrate, low-latency video streaming. Cross-Functional Leadership: Collaborate with Hardware and Embedded teams to enhance the network stack directly on our vehicle's gateway. Technologies We Utilize: Programming Languages: C++20, Go Protocols: WebRTC, Websocket, QUIC, SRT, gRPC Tools: Wireshark Ideal Candidate Profile Systems Thinker: You possess a profound understanding of the Linux networking stack, socket programming, and data flow from the physical layer to the application layer. C++ Specialist: You are adept at writing high-performance, thread-safe code with a solid grasp of real-time systems nuances. Protocol Savvy: Beyond using TCP/UDP, you comprehend their limitations in high-mobility scenarios and how to implement FEC or ARQ effectively.

About ZaimlerIn a world where AI agents struggle to reason over fragmented data, Zaimler emerges as the solution. Our mission is to unify disparate enterprise data across countless systems, providing a shared context, meaning, and structure. This transformation is essential as we transition from traditional copilots to fully autonomous agents, necessitating a new infrastructure layer that we are dedicated to building.At Zaimler, we are pioneering context infrastructure for the agentic era—a platform that autonomously discovers domain knowledge, maps intricate relationships, and equips AI agents with the semantic understanding required for precise and scalable operations. Envision knowledge graphs that facilitate real-time inference, tailored for systems that need to reason rather than merely retrieve data.Founded by industry veterans Biswajit Das (former VP Engineering at Truera and Chief Architect at Visa) and Sofus Macskassy (ex-Director of Engineering at LinkedIn), who notably built one of the largest knowledge graphs in production, Zaimler is a small, senior team at the seed stage, collaborating with major enterprises in sectors like insurance, travel, and technology. If you are passionate about creating the infrastructure that will support the next decade of AI advancements, we are eager to connect with you.The RoleWe are in search of a talented Data Infrastructure Engineer to establish the foundational distributed data layer that will power our semantic platform. In this role, you will be responsible for designing, building, and scaling systems that enable high-throughput data ingestion, transformation, and real-time processing.

Contract Role: 3 to 6 month contract-to-hireLocation: Onsite in the Bay AreaCompensation: $50-100 per hour, commensurate with experienceAre you a talented network engineer with a passion for data science? Do you aspire to work at the forefront of infrastructure and intelligence? If so, Meter is looking for you!At Meter, we are pioneering vertically integrated networking systems. We leverage the data generated by these systems to drive the next generation of autonomous infrastructure. As part of our team, you will play a critical role in labeling, annotating, and structuring the data flowing through our systems.This hands-on position merges your networking expertise with an evolving understanding of data pipelines utilized in AI systems.Your Responsibilities Include:Analyzing real-world data from deployed networks, including logs, configurations, telemetry, and event streamsLabeling and classifying key behaviors, issues, and anomaliesAssisting in defining schemas and structures for large-scale data pipelinesIdeal Candidate Attributes:Proven experience as a network engineer, particularly with enterprise networks (switches, access points, firewalls, etc.) - RequiredAbility to interpret logs, events, and time-series metrics with confidenceA curiosity about transforming raw infrastructure data into machine learning inputsA desire to contribute to the evolution of autonomous networking systemsYour contributions will directly influence the data pipelines that empower Meter's AI models, shaping how intelligent systems interpret networks in real-world scenarios.

Join bet365 as an Infrastructure Systems Engineer in Denver, where you'll play a crucial role in managing and optimizing IT infrastructure systems. You will be responsible for designing, implementing, and maintaining scalable and reliable systems that support our global operations. This position offers an exciting opportunity to work with cutting-edge technologies and to collaborate with a team of skilled professionals dedicated to innovation.

Join our dynamic team at xAI, where we are on a mission to revolutionize AI systems to better understand our universe and support humanity's quest for knowledge. As a Software Engineer specializing in Real-Time Storage, you'll play a critical role in shaping our advanced AI infrastructure, which serves approximately 600 million users monthly. You'll design, build, and optimize storage solutions that power training, inference, recommendations, and real-time data extraction, all within a collaborative and innovative environment.

This Infrastructure Engineer - Systems role is based in Colorado Springs, CO, and supports programs that require U.S. citizenship. All work must be performed within the continental United States. Raft is a defense technology company that partners with U.S. military and government agencies. The team focuses on AI/ML, autonomous data fusion, distributed data systems, and scalable digital platforms. Their projects aim to deliver digital solutions with real impact for federal and public sector clients. Role overview This position provides Systems Engineering and Technical Assistance (SETA) to the United States Space Force, specifically for the Defensive Cyber Operations – Space (DCO-S) program. The work centers on developing software and supporting agile, rapid development of defensive cyber solutions within the Space Systems Command Cyber Operations Branch. The mission is to protect both ground and space assets from cyber threats. What you will do Design and assess complex system topologies and end-to-end architectures, integrating defensive cyber capabilities across terrestrial and space systems. Lead infrastructure planning by preparing detailed Bills of Materials and rack diagrams, ensuring all hardware and software components align with mission requirements. Requirements U.S. citizenship is required for all supported programs. Work must be performed within the continental United States.

Stage is looking for an Infrastructure Data Engineer to join the team in Boston, MA. This position centers on building and maintaining the systems that move and organize data, making analytics and business intelligence possible across the company. Role overview The Infrastructure Data Engineer will design, implement, and support scalable data infrastructure. The work ensures that business needs are met as the company grows, and that analytics teams have reliable data to inform decisions. What you will do Design and implement data infrastructure to meet evolving business requirements Build and maintain data pipelines used for analytics and reporting Support business intelligence by ensuring data systems are reliable and accessible Requirements Stage is seeking candidates who have a strong interest in data engineering and are motivated to make a real impact on team and company goals.

Role Overview Aetos Systems, Inc. is seeking a Senior Communication Systems Engineer focused on Data Transmission Systems. This position is based in Merritt Island, Florida. What You Will Do Design, develop, and implement communication systems that support advanced data transmission. Apply technical expertise to projects that drive improvements in communication technology. Contribute to initiatives that impact the future of data transmission capabilities. Location Merritt Island, Florida, United States

At Sift, we are revolutionizing the way modern machines are constructed, tested, and operated. Our platform empowers engineers with real-time observability over high-frequency telemetry, eliminating bottlenecks and facilitating faster, more dependable development.Sift emerged from our collaborative efforts at SpaceX on projects such as Dragon, Falcon, Starlink, and Starship—where scaling telemetry, debugging flight systems, and ensuring mission reliability necessitated innovative infrastructure. Founded by a team with backgrounds at SpaceX, Google, and Palantir, Sift is engineered for mission-critical systems where precision and scalability are imperative.As an early engineer focused on our data infrastructure, you will play a pivotal role in defining core architecture while helping to scale a real-time telemetry platform from its inception. You will engage in developing complex backend systems aimed at ingesting, storing, and serving millions of high-frequency data points per second, thus enabling rapid iteration cycles for some of the world's leading engineering teams.

As a Real-Time Business & Systems Analyst, you will play a vital role in defining, developing, and documenting business requirements for Real-Time Systems and core utility systems. You will collaborate closely with business operations, technology teams, and software vendors to facilitate the design, implementation, and testing phases of Real-Time system projects, which may include EMS, SCADA, DMS/ADMS, DA, OMS, TOA, PI Historian, and GIS.Key Responsibilities:• Support the integration of existing real-time systems to consolidate SCADA systems.• Develop a comprehensive stack of IT services to enhance new SCADA systems.• Provide assistance with server infrastructure management.

Join our innovative team at alljoined as a Data Infrastructure Engineer where you will play a pivotal role in shaping our data architecture and ensuring the reliability and efficiency of our data systems. You will collaborate with cross-functional teams to design and implement scalable data solutions that empower data-driven decision-making.

About RoxAt Rox, we are pioneering the development of an AI-native revenue operating system that transforms how enterprises interact with technology. Unlike traditional software designed for human dashboard operators, Rox is engineered for agents managing complex systems.We eliminate static workflows, enabling continuous decision-making processes powered by real-time insights from across the enterprise landscape. Our agents are equipped to analyze signals, reason through them, and autonomously execute actions.To support this innovation, we are constructing a robust infrastructure that integrates:Distributed data platformsReal-time decision-making systemsAgent execution frameworksLow-latency context retrievalBacked by prominent investors like Sequoia, GV, and General Catalyst, we are assembling a talented team of engineers eager to tackle deep technical challenges that have a tangible impact on the world.About the Foundations TeamThe Foundations team is responsible for developing the core infrastructure that powers Rox agents.Our work focuses on:Real-time context ingestionAgent execution and orchestrationEnsuring reliability for long-term AI tasksLow-latency decision-making across distributed systemsIf you have experience with:Streaming compute platformsDistributed query enginesReal-time OLAP systemsMatching enginesLarge-scale data infrastructureMany challenges you encounter here will resonate with your past work but will be applied to a novel category of software. At Rox, agents continuously:Retrieve contextMake decisionsTrigger actionsUpdate stateThe Foundations team builds the infrastructure that ensures these feedback loops are reliable, swift, and observable.The RoleWe are on the lookout for a Foundations Engineer (Deep Infrastructure) to design and oversee the systems that power Rox's agent runtime.

Join our client in Portland as they embark on an exciting multi-year initiative to modernize critical infrastructure and business systems. We are currently seeking a skilled Infrastructure Middleware Engineer to join our dynamic team of Middleware Engineers and other technical experts. Your role will be pivotal in driving the Middleware infrastructure forward, collaborating closely with Enterprise Architects and the Developer community.In this position, you will participate in large-scale upgrade and migration projects, transitioning from IBM WebSphere Application Server versions 6.x-8.x to JBOSS and MicroServices platforms. You'll also work with messaging platforms such as WebSphere MQ and Message Broker, and ETL technologies like InfoSphere DataStage. This role offers the opportunity to mentor and provide technical support to Middleware operations teams, maintain system documentation, enhance identity management solutions, and promote automation within our infrastructure.

P-186 At Databricks, we are passionate about empowering data teams to tackle some of the world's most challenging problems, from detecting security threats to advancing cancer drug development. Our mission is to build and operate the premier data and AI infrastructure platform, allowing our customers to concentrate on the high-value challenges central to their missions. Since our inception in 2013 by the original creators of Apache Spark™, Databricks has transformed from a small office in Berkeley, California, into a global powerhouse with over 1,000 employees. Today, thousands of organizations—from startups to Fortune 100 companies—trust Databricks with their mission-critical workloads, solidifying our status as one of the fastest-growing SaaS companies worldwide. Our engineering teams are dedicated to developing highly technical products that address real-world needs. We continuously push the limits of data and AI technology while ensuring the resilience, security, and scale essential for our customers' success on our platform. We manage one of the largest-scale software platforms, comprising millions of virtual machines that generate terabytes of logs and process exabytes of data daily. At this scale, we routinely encounter cloud hardware, network, and operating system faults, and our software must adeptly shield our customers from these challenges. In modern data analysis, sophisticated techniques such as machine learning extend far beyond the traditional SQL query engine's roll-up and drill-down capabilities. As a software engineer on the Runtime team at Databricks, you will contribute to building next-generation distributed data storage and processing systems that not only surpass specialized SQL query engines in relational query performance but also offer the expressiveness and programming abstractions necessary to support varied workloads, ranging from ETL to data science. Here are some example projects you might work on: Apache Spark™: Develop the de facto open-source standard framework for big data. Data Plane Storage: Provide reliable and high-performance services and client libraries for storing and accessing massive amounts of data on cloud storage backends like AWS S3 and Azure Blob Store. Delta Lake: A storage management system that merges the scale and cost-efficiency of data lakes with the performance and reliability of data warehouses, along with the low latency of streaming. Its higher-level abstractions, including ACID transactions and time travel, significantly simplify real-world data engineering architecture. Delta Pipelines: Managing a single data engineering pipeline can be challenging. The objective of the Delta Pipelines project is to streamline this process.