Software Engineer, Data Acquisition

Senior Software Engineer - Data AcquisitionOverview:Join the dynamic Data Acquisition team at OpenAI, where we spearhead the data collection efforts essential for powering our advanced model training operations. Our team plays a pivotal role in managing web crawling and GPTBot services, collaborating closely with Data Processing, Architecture, and Scaling teams. We are seeking a talented Senior Software Engineer to enhance our Data Acquisition initiatives.Key Responsibilities:Lead engineering projects focused on data acquisition, including web crawling, data ingestion, and search optimization.Collaborate effectively with cross-functional teams to maintain seamless data flow and system performance.Engage with the legal team to navigate compliance and data privacy regulations.Design and implement robust distributed systems capable of processing petabytes of data.Develop algorithms for efficient data indexing and search functionalities.Build and sustain backend services for data storage, including experience with key-value databases and data synchronization.Deploy solutions in a Kubernetes Infrastructure-as-Code environment while conducting regular system audits.Conduct experiments on data to derive insights that drive system enhancements.Qualifications:Bachelor's, Master's, or PhD in Computer Science or a related discipline.A minimum of 6 years of professional experience in software development.Prior experience with large-scale web crawlers is a significant advantage.In-depth knowledge of large stateful distributed systems and data processing techniques.Expertise in Kubernetes and familiarity with Infrastructure-as-Code practices.A proactive approach to exploring new technologies and methodologies.Strong ability to juggle multiple tasks and adapt to changing priorities.Excellent communication skills, both written and verbal.About OpenAI:OpenAI is at the forefront of artificial intelligence research and deployment, dedicated to ensuring that the benefits of general-purpose AI are shared by all of humanity. We strive to push the boundaries of innovation while adhering to ethical standards.

Join SoFi as a Senior Software Engineer in our Data Foundations team, where you will play a pivotal role in shaping our data architecture and enhancing our data-driven capabilities. You will work closely with cross-functional teams to develop robust data solutions that empower our business decisions and improve customer experiences.As a Senior Software Engineer, you will leverage your expertise in data engineering, software development, and cloud technologies to build scalable data pipelines and maintain high-quality data infrastructure. Your contributions will directly impact our ability to deliver innovative financial solutions.

About Probably GeneticProbably Genetic is revolutionizing the lives of patients with severe and complex diseases. Our advanced data platform empowers drug developers and patient advocacy organizations to create and launch innovative treatments. By leveraging cutting-edge technology, we identify undiagnosed patients online, analyze their conditions using machine learning and home testing, and facilitate compliant communication with them. Our mission is to ensure that patients gain access to diagnoses, clinical trials, and treatments at the earliest opportunity.We are a dedicated team of passionate problem solvers, driven by a purpose that transcends individual interests. By prioritizing patient welfare, we are developing groundbreaking solutions in healthcare, with a roadmap full of innovations in bioinformatics, AI, and drug development. We invite you to join our lean, talented team and contribute to our vision.Probably Genetic has secured multiple funding rounds from top-tier Silicon Valley investors, including Threshold, Khosla, and Y Combinator. We offer competitive salaries, comprehensive benefits, and meaningful equity opportunities for early-stage team members.About the RoleWe are seeking a founding Data Engineer who is enthusiastic about shaping the future of data utilization to enhance patient outcomes. In this pivotal role, you will establish our data engineering architecture and construct the pipelines that drive internal insights and commercial data products. Your contributions will be instrumental in fostering clarity, impact, and growth throughout our organization.What You Will DoCollaborate closely with the Head of Engineering and Head of Product to transform complex data challenges into elegant, scalable solutions.Build reliable, maintainable infrastructure on AWS using Terraform to accommodate our expanding data requirements.Design data tables and pipelines tailored to the specific needs of our customers and internal teams.Implement state-of-the-art data pipelines with built-in observability from day one.Analyze and visualize data using BI tools to facilitate informed business decisions and provide customized insights to clients.Communicate your work and its impact across teams — presenting findings, receiving feedback, and continuously enhancing processes.Who You AreWe are eager to connect with candidates from diverse backgrounds who are committed to learning, growth, and making a meaningful impact. Here are a few attributes that will enable you to thrive in this role:Proficiency in data engineering principles and practices.Experience with cloud platforms, particularly AWS.Strong analytical skills and familiarity with data visualization tools.Ability to collaborate effectively in a team environment.

At Plaid, we believe in the power of data-driven decision-making. Our data culture demands robust and scalable data systems that ensure accuracy and completeness. As a Senior Software Engineer focusing on Data Infrastructure, you will play a pivotal role in empowering teams across engineering, product, and business sectors to swiftly and securely extract valuable data insights. Your work will directly enhance our ability to serve customers effectively. You will be responsible for building and optimizing our data and machine learning infrastructure, allowing Plaid engineers to innovate and iterate on products built on consumer-permissioned financial data. Our Data Infrastructure engineers are experts in Data Warehousing, Data Lakehouse architecture, Spark, Workflow Orchestration, and Streaming technologies. You will enhance our existing data pipelines for performance and cost efficiency while creating intuitive abstractions that simplify the development process for other engineers at Plaid.

Join our team as a Senior Software Engineer focused on our Data Platform at Gusto. In this role, you will leverage your expertise in designing and building scalable data systems that drive business decisions and enhance our platform's capabilities. Your contributions will directly impact our ability to deliver exceptional services to our customers.You will collaborate with cross-functional teams, ensuring that our data architecture is robust, efficient, and aligned with our business goals. If you are passionate about data engineering and are looking for a place to innovate and grow, we want to hear from you!

At Ripple, we are on a mission to transform the way value is exchanged globally, making it as seamless as information transfer. Our innovative crypto solutions empower financial institutions, businesses, governments, and developers, promoting a more equitable financial system while creating opportunities for individuals across the globe. Joining us means being part of an impactful journey where you can hone your skills and collaborate with a supportive team.If you are eager to make a significant impact and explore exciting career advancement opportunities, we invite you to join us in building real-world value.THE WORK: WHAT YOU’LL DO: WHAT YOU'LL BRING: Other common names for this role:

At Fastly, we empower individuals to connect more effectively with the things they cherish. Our cutting-edge edge cloud platform enables customers to swiftly, securely, and reliably craft exceptional digital experiences by processing, serving, and safeguarding their applications as close to their end-users as possible — right at the edge of the Internet. Tailored for modern internet demands, our platform is programmable and supports agile software development. We proudly serve many of the world's leading companies, including GitHub, Yelp, Paramount, and JetBlue.Join us in our mission to build a more trustworthy Internet.Posting Open Date: Feb. 25, 2026Anticipated Posting Close Date*: March 25, 2026*Please note that this job posting may close early depending on the volume of applications.Role Overview:The Data Reliability team is seeking an experienced Senior Software Engineer to contribute to the development and support of next-generation data storage solutions at Fastly. The ideal candidate will possess expertise in backend and data services within cloud environments, proficiency with configuration and orchestration tools such as Terraform and Kubernetes, and the ability to create internal administration tools using Go and related technologies. Our team plays a vital role in ensuring the infrastructure, orchestration, and reliability of Fastly's most data-intensive applications, utilizing technologies like Terraform, Elasticsearch, ClickHouse, Prometheus, MySQL, and Redis across both cloud and hardware platforms. Your contributions will directly enhance our customers' success by providing product teams with a robust platform for efficient and consistent delivery of high-quality, high-throughput, globally distributed data systems and products. We embrace a distributed work model and value both collaborative and asynchronous communication styles.Key Responsibilities:Deploy, support, and maintain various critical data storage systems, scaling from gigabytes to petabytes.Develop statistics and dashboards to track service-level objectives for these systems.Create and manage tools for configuration, backup, and authenticated access to data systems employing peer review, CI/CD, and both daemon- and container-based deployment strategies.Write high-performance, maintainable, and concise code, actively participating in code reviews to enhance the codebase.

At Databricks, we are driven by a passion for empowering data teams to tackle the world’s most challenging problems — from transforming transportation to accelerating medical innovations. We achieve this by creating and maintaining the leading data and AI infrastructure platform, enabling our clients to leverage profound data insights for business enhancement. Founded by engineers with a customer-first mentality, we eagerly embrace every opportunity to tackle complex technical challenges, ranging from the design of next-generation UI/UX for data interactions to scaling our services across millions of virtual machines. Our journey has just begun.As a member of the Runtime team at Databricks, you will be instrumental in developing the next generation of distributed data storage and processing systems. These systems will surpass specialized SQL query engines in relational query performance while offering the programming abstractions necessary to support a variety of workloads, from ETL to data science.Example projects include:Apache Spark™: Contribute to the de facto open-source standard framework for big data.Data Plane Storage: Develop reliable and high-performance services and client libraries for managing vast amounts of data within cloud storage backends like AWS S3 and Azure Blob Store.Delta Lake: Design a storage management system that merges the scalability and cost-effectiveness of data lakes with the performance and reliability of data warehouses, providing features like ACID transactions and time travel.Delta Pipelines: Simplify the orchestration and operation of numerous data pipelines, enabling clients to deploy, test, and upgrade pipelines effortlessly.Performance Engineering: Create the next-generation query optimizer and execution engine that is fast, scalable, and robust.

About CondorAt Condor, we are transforming the financial infrastructure of clinical development. While substantial investments are made annually to discover and develop new therapies, the processes behind these advancements often remain outdated and disconnected. Our mission is to bridge this gap, creating a cohesive system that integrates clinical operations, vendor activities, and financial data into a real-time intelligence layer. This empowers R&D and finance teams with the insights they need to make informed decisions.Our AI-driven, pharma-native infrastructure is designed to scale industry standards that we have helped shape alongside major partners. We facilitate prediction, control, and execution in some of the most complex R&D environments globally.As we continue to gain the trust of enterprise teams, we are now focused on the critical task of scaling our operations in a high-stakes environment.Condor is a rapidly growing company, backed by leading institutional investors such as Felicis and 645 Ventures, collaborating with top 200 biopharma companies. This is a unique opportunity to contribute to the infrastructure that influences how new therapies reach patients.The RoleWe are seeking a Senior Backend and Data Platform Engineer to play a key role in developing the foundational data infrastructure for Condor’s financial intelligence platform. This position is pivotal in turning complex clinical and financial data into actionable intelligence that enterprise biopharma teams can rely on.In this role, you will be responsible for designing and managing the core data foundations that underpin Condor’s financial engine and AI capabilities. Your work will involve modeling intricate, high-stakes data, constructing reliable data pipelines and services, and ensuring that product features and intelligence workflows function with precision, consistency, and scalability. The systems you develop will directly support critical finance and operational applications.This hands-on, senior engineering position provides you with significant ownership. You will engage with backend services, data pipelines, and APIs, bringing features from concept to production. You will define necessary data schemas, transformations, and architectural patterns that become essential as our platform evolves. Although your primary focus will be on backend and data engineering, you will also be encouraged to work across the stack to ensure seamless integration of data and intelligence.

The OpportunityAt Enigma, we are at a pivotal moment of growth, receiving enthusiastic feedback from our clients regarding the substantial value our product provides. This feedback drives our urgent need to effectively present the capabilities of our small business data as we expand our sales and marketing efforts.The RoleWe are seeking a skilled Senior Software Engineer to join our dynamic API and Data Delivery Team. In this position, you will be instrumental in designing, constructing, and maintaining essential systems for processing and delivering vast datasets, collaborating with both teammates and clients to address impactful, real-world challenges.What You’ll DoDevelop scalable, highly available, and high-throughput systems deployed in cloud environments.Tackle challenges involving containers, cloud infrastructure, and infrastructure as code (primarily using Docker, AWS, and Terraform).Exhibit a proactive attitude that embraces challenges, regardless of their size.Take pride in writing clean, well-tested, and maintainable code.Thrill in collaborating as part of a motivated and cohesive team.Identify and address problems that may go unnoticed by others.Be driven to create tangible impacts for our customers.Inspire your colleagues to excel while fostering a collaborative and supportive team culture.Manage responsibilities related to architecture, design decisions, hands-on implementation, team organization, and technical mentorship.What Makes This Role Exciting?Impact: Your technical expertise and decision-making will directly influence our customers and the success of our product, affecting critical choices at multi-billion dollar firms.Technical Challenge: Engage with cutting-edge technologies surrounding databases, information retrieval, distributed systems, microservices, elastic scaling, data pipelines, and more.Ownership: The API & Data Delivery team is addressing some of the world's most complex challenges. The ideal candidate is an engineer eager to expand their responsibilities and collaborate with the team to create significant technical and business impacts.

Overview:Join the innovative Data Acquisition team at OpenAI, where we drive the future of AI through advanced data collection techniques. Our mission is to support model training operations by managing web crawling and the GPTBot services. Collaborating with Data Processing, Architecture, and Scaling teams, we are on the lookout for a talented Full-Stack Engineer to enhance our data infrastructure. In this role, you will create and optimize the tools and interfaces that are crucial for our data operations.Responsibilities:Design, develop, and maintain full-stack applications tailored for data acquisition, including internal tools and comprehensive dashboards.Work collaboratively with cross-functional teams, such as Data Processing, Architecture, and Scaling, to facilitate efficient data ingestion and workflow management.Craft and implement APIs that streamline data interactions between internal systems and external data sources.Enhance user experience by creating intuitive web-based interfaces for effective management and monitoring of data pipelines.Optimize backend services focusing on performance, scalability, and security within a distributed computing framework.Collaborate with legal and compliance teams to ensure our data acquisition practices meet privacy regulations and adhere to industry best practices.Deploy and maintain infrastructure leveraging Kubernetes and Infrastructure-as-Code (IaC) methodologies.Analyze system performance, conduct thorough experiments, and refine data workflows to drive operational efficiency.Qualifications:Bachelor's, Master's, or PhD in Computer Science or a related discipline.4+ years of professional experience in full-stack development.Expertise in frontend frameworks (e.g., React, Vue) as well as backend technologies like Python, Node.js, or Go.Strong command of RESTful APIs, GraphQL, and database design (both SQL and NoSQL).Experience in developing data-intensive applications capable of managing large-scale datasets.Familiarity with cloud platforms (AWS, GCP, Azure) and container orchestration technologies (Kubernetes, Docker).Previous experience in web crawling and large-scale data processing is advantageous.Exceptional problem-solving abilities and adeptness at juggling multiple tasks in a dynamic environment.Outstanding communication and collaboration skills.

Peregrine Technologies builds AI-powered tools for public safety, government, and private organizations. Our platform connects fragmented data, giving clients immediate access to information that supports better decisions and outcomes. Today, we serve hundreds of clients across more than 30 states and two countries, reaching over 125 million people. Backed by leading Silicon Valley investors, we are expanding into enterprise and international markets. About the Engineering Team Peregrine’s engineers focus on building solutions with empathy for users. Understanding real-world product use is central to our approach, and engineers work closely with onsite colleagues to learn about the varied needs our clients face. Collaboration and hands-on problem solving are core to how we work. Role Overview: Senior Software Engineer, Data Governance This role sits within our core engineering group. The team tackles projects such as enabling real-time collaboration on complex maps and building backend systems that handle billions of data points at scale. The Data Governance team designs and builds services, systems, and product features that help clients manage their data assets from start to finish within Peregrine. The team’s work centers on secure, precise data access and strong audit controls. Location San Francisco, CA

Role overview Chime seeks a Senior Software Engineer for the Data Platform team based in San Francisco, CA. This position centers on building and enhancing the systems behind Chime’s data infrastructure. The work directly supports Chime’s goal of helping members achieve financial peace of mind. What you will do Design, build, and maintain scalable data pipelines that form the backbone of Chime’s data operations Collaborate with colleagues across engineering, product, and analytics to deliver reliable data solutions Help ensure data integrity and strong system performance as Chime’s user base and data needs expand

About Us:At Parafin, our mission is to empower small businesses, the backbone of our economy. Traditional banks often overlook their needs, but we provide technology that simplifies access to essential financial tools directly through the platforms they already use for sales. We collaborate with industry leaders such as DoorDash, Amazon, Worldpay, and Mindbody to deliver fast and flexible funding, spend management, and savings tools seamlessly integrated into their services. By handling the complexities of capital markets, underwriting, servicing, compliance, and customer support for our partners, we enable small businesses to thrive.Our team is composed of innovators from top companies including Stripe, Square, Plaid, Coinbase, and Robinhood. Together, we share a passion for developing tools that drive success for small businesses. Backed by notable venture capitalists like GIC, Notable Capital, Redpoint Ventures, Ribbit Capital, and Thrive Capital, Parafin is a Series C company that has successfully raised over $194 million in equity and $340 million in debt facilities.Join us in creating a future where every small business has access to the financial resources they need to succeed.About the Position:We are seeking an experienced software engineer to join Parafin’s Infrastructure team and take the lead in developing our next-generation Data Platform. This pivotal role ensures that our data infrastructure remains reliable, scalable, and user-friendly, as we continue enhancing financial services for small businesses.As a Senior Software Engineer, your responsibilities will include designing, building, and maintaining systems for data ingestion, transformation, and delivery across the organization. You will closely collaborate with Data Science, Platform Engineering, and Product Engineering teams to facilitate data-driven product development and informed decision-making.What You’ll Do:Design and construct robust, highly scalable data pipelines and lakehouse infrastructure using PySpark, Databricks, and Airflow on AWS.Enhance the data platform development experience for Engineering, Data Science, and Product teams by creating intuitive abstractions, self-service tools, and comprehensive documentation.Manage and uphold core data pipelines and models that support internal dashboards, machine learning models, and customer-facing products.Oversee the Data & ML platform infrastructure via Terraform, including full administration of Databricks workspaces: manage user access, monitor performance, optimize configurations (e.g., clusters, lakehouse settings), and ensure high reliability.

Join the Fluidstack TeamAt Fluidstack, we are revolutionizing the infrastructure that empowers artificial intelligence. Our collaborations with leading AI labs, government entities, and major enterprises like Mistral, Poolside, Black Forest Labs, and Meta enable us to deliver computational power at unprecedented speeds.Our mission is to turn artificial general intelligence (AGI) into reality. We pride ourselves on our commitment to excellence and our focus on creating a world-class infrastructure. Our dedication to our customers’ success drives us to build exceptional systems that foster trust and efficiency. If you are passionate about making a difference, striving for excellence, and ready to work diligently to shape the future of intelligence, we invite you to join our innovative team.Your RoleWe are seeking a Software Engineer to play a pivotal role in developing the technological backbone of Fluidstack's talent acquisition and human resource operations. This position focuses on the complete talent lifecycle, where you'll be responsible for designing, developing, and implementing internal tools and integrations that enhance the efficiency of our recruiters, empower hiring managers with data-driven insights, and accelerate the onboarding process for new hires. You'll work closely with ATS and HRIS platforms, as well as the broader HR tech ecosystem, and leverage AI tools to create tailored solutions when existing tools fall short. Given the rapid pace and scale of our hiring, this role is crucial for fostering our growth.Key ResponsibilitiesLead the talent tooling roadmap: Collaborate with Recruitment and People Operations to define scope, design, implement, and deploy solutions.Develop and sustain integrations: Connect with tools like Ashby and Rippling, streamline data access, and minimize manual tasks.Create internal recruiting workflows: Design candidate pipeline dashboards, interview scheduling automation, offer letter generation, headcount planning views, and onboarding checklists.Enhance talent funnel analytics: Build dashboards to provide real-time insights into key metrics such as time-to-fill, offer acceptance rates, funnel conversion, and retention indicators.Automate HR processes: Simplify onboarding, e-signature routing, and data synchronization across ATS, HRIS, and IT systems.Implement AI-driven recruiting features: Develop intelligent candidate matching, automated scorecard summaries, job description drafting tools, and sourcing enhancement pipelines.

Join Amplitude as a Senior Software Engineer, specializing in Data Management. In this pivotal role, you will lead the development and optimization of our data management systems, ensuring scalability, efficiency, and reliability. Your expertise will help shape the future of data-driven decision-making within our organization.

About GranicaGranica is an innovative AI research and infrastructure firm dedicated to creating reliable and steerable representations of enterprise data.We build trust through our product Crunch, a policy-driven health layer that ensures large tabular datasets remain efficient, reliable, and reversible. On this solid foundation, we are developing Large Tabular Models—systems designed to learn cross-column and relational structures in order to provide trustworthy answers and automation with inherent provenance and governance.Our MissionAI is currently hampered not only by the design of models but also by the inefficiencies of the data that supports them. Every redundant byte, poorly organized dataset, and inefficient data pathway contributes to significant costs, latency, and energy waste as we scale.Granica aims to eliminate these inefficiencies. We merge cutting-edge research in information theory, probabilistic modeling, and distributed systems to craft self-optimizing data infrastructures: systems that consistently enhance the representation and utilization of information by AI.Our engineering team collaborates closely with the Granica Research group led by Prof. Andrea Montanari of Stanford University, bridging advancements in information theory and learning efficiency with large-scale distributed systems. Together, we firmly believe that the next major advancement in AI will stem from breakthroughs in efficient systems rather than merely larger models.Your ContributionsGlobal Metadata Substrate: Design a transactional and metadata substrate that facilitates time-travel, schema evolution, and atomic consistency across massive petabyte-scale tabular datasets.Adaptive Engines: Develop systems that autonomously reorganize data, learning from access patterns and workloads to maintain peak efficiency without the need for manual tuning.Intelligent Data Layouts: Optimize bit-level organization (including encoding, compression, and layout) to maximize signal extraction per byte read.Autonomous Compute Pipelines: Create distributed compute systems that scale predictably, adapt to dynamic loads, and ensure reliability under failure conditions.Research to Production: Apply new algorithms in compression, representation, and optimization that emerge from ongoing research. We encourage opportunities to publish and open-source your work.Latency as Intelligence: Design systems that inherently minimize latency as a measure of intelligence.

At Superhuman, we embrace a dynamic hybrid working model, allowing our team members to enjoy focused work time alongside in-person collaboration. This flexible approach fosters trust, innovation, and a vibrant team culture.We are seeking talented individuals based in San Francisco or Seattle for this role.About UsSuperhuman, an innovative AI productivity platform, aims to unlock the superhuman potential within everyone. We integrate AI seamlessly into the workflows of over 40 million people and 50,000 organizations worldwide, offering tools like Grammarly’s writing assistant, Coda’s collaborative workspaces, and our proactive AI assistant Go. Founded in 2009, we are committed to eliminating busywork, enabling our users to focus on what truly matters. Discover more at superhuman.com and learn about our core values here.Join Our TeamWe are on the lookout for a Senior Software Engineer to enhance our Data Enablement team and develop a world-class data platform. Your expertise will be crucial as we manage over 70 billion daily events, driving product enhancements through our systems. This role offers a unique opportunity to engage in every facet of complex software system development, from strategy formulation to architecture design and production deployment.Our engineers and researchers are encouraged to innovate and contribute to significant breakthroughs, shaping the trajectory of our product suite. As we scale our operations, we face increasingly complex technical challenges, providing fertile ground for growth and development. To gain further insights into our work, check out our technical blog.

Superhuman embraces a vibrant hybrid work model, offering team members a blend of focused work and collaborative in-person interactions that cultivate trust, innovation, and a robust company culture. Team members in this role should be located in San Francisco or New York City. About SuperhumanSuperhuman, home to Grammarly, is an innovative AI productivity platform dedicated to unlocking the extraordinary potential in everyone. Our suite of applications seamlessly integrates with over one million tools and websites, featuring Grammarly’s writing assistance, Coda’s collaborative workspaces, Mail’s inbox management, and Go, the proactive AI assistant that delivers contextual help automatically. Founded in 2009, Superhuman empowers over 40 million individuals, 50,000 organizations, and 3,000 educational institutions globally, helping them eliminate busywork and focus on what truly matters. Discover more at superhuman.com and learn about our values here.The OpportunityWe are on the lookout for a Senior Engineer to join our Data Platform team, tasked with constructing an exceptional data platform. Superhuman’s success hinges on our capacity to efficiently process 60 to 70 billion daily events, utilizing our systems to enhance our product. This role offers a unique chance to engage in all facets of developing complex software systems, including shaping strategy, defining architecture, and executing deployments to production.Our engineers and researchers enjoy the freedom to innovate and make impactful contributions to our product roadmap. As we scale our interfaces, algorithms, and infrastructure, the complexity of our technical challenges is rapidly increasing. Dive deeper into our team's insights on our technical blog.OverviewAs a Software Engineer on the Data Platform team, you will be instrumental in defining the architecture and technical strategy for our data platform, ensuring scalability, security, and efficiency across our data engineering systems. You will design and spearhead the implementation of robust, scalable, and dependable systems that manage high volumes of data, facilitating both product features and data-driven decision making across the organization. Your responsibilities will encompass areas such as real-time data processing and ETL (Extract, Transform, Load).