Senior Data Engineer

About WorkWhileAt WorkWhile, we're driven by a mission to empower hourly workers to achieve a more stable and fulfilling life. With over 80 million Americans engaged in hourly employment, many face unpredictable schedules, minimal wages, and limited benefits, resulting in financial uncertainty.Our innovative approach aims to transform frontline work by fostering a flexible and efficient labor market. Leveraging AI technology, the WorkWhile platform connects businesses with exceptional talent swiftly, while providing workers with same-day pay, complimentary telehealth services, skill development opportunities, and the flexibility to select shifts that suit their expertise and availability.We aspire to align incentives and tackle inefficiencies within the labor market, aiming to disrupt the $650 billion staffing and recruiting industry. Supported by Khosla Ventures and recognized by the Inc. 5000 for remarkable growth, WorkWhile is at the forefront of reshaping the future of work.Role OverviewWe are looking for a talented Senior Data Engineer to join our Engineering team and spearhead the development and maintenance of our robust data platform, which drives analytics, machine learning models, and operational intelligence throughout the WorkWhile staffing marketplace. In this pivotal role, you will design, build, and maintain data pipelines and infrastructure on the Google Cloud Platform, empowering our Data Science team to efficiently train and deploy models at scale, including demand forecasting, worker reliability prediction, dynamic pricing, and retention modeling.You will take ownership of our Dagster-based orchestration platform, manage our BigQuery data warehouse, and oversee the integrations connecting our PostgreSQL production database with our analytical framework. Collaborating closely with Data Science, Product Engineering, and Operations teams, you will ensure that reliable, well-structured, high-quality data is accessible when and where it’s needed. Your work will significantly enhance how WorkWhile matches workers with opportunities, anticipates marketplace dynamics, and improves overall experiences for both workers and businesses.Join us in a dynamic, collaborative environment where your contributions are crucial to our mission of making hourly work more accessible, dependable, and rewarding for everyone.

Front Careers seeks a Senior Data Engineer based in San Francisco, CA. This position centers on building and maintaining data systems that power analytics and reporting throughout the organization. Key responsibilities Design and maintain data architecture to meet analytics and reporting requirements Develop, optimize, and support data pipelines for reliability and scalability Collaborate with teams across the company to improve data quality, accessibility, and security Enhance and maintain the data infrastructure supporting company operations Role overview This role focuses on ensuring that data flows efficiently and securely, enabling teams to access the information they need for business decisions. The Senior Data Engineer will play a central part in shaping how data is managed and used at Front Careers.

About AlembicAlembic is at the forefront of transforming marketing strategies, demonstrating the actual ROI of marketing initiatives. Our cutting-edge Alembic Marketing Intelligence Platform employs advanced algorithms and AI models to address this longstanding challenge effectively. By joining our team, you'll contribute to the development of tools that deliver unparalleled insights into how marketing influences revenue, empowering a growing roster of Fortune 500 companies to make data-driven decisions with confidence.About the RoleIn your role as a Senior Data Engineer at Alembic, you will play a crucial role in our data platform. You will be responsible for creating scalable and dependable data pipelines, optimizing storage solutions, and facilitating both real-time and batch analytics. Collaborating closely with data scientists, software engineers, and product leaders, you will design and implement robust data architectures that propel our mission forward.Key ResponsibilitiesDesign, develop, and maintain scalable ETL pipelines that efficiently ingest, process, and transform extensive volumes of structured and unstructured data.Optimize data storage solutions utilizing modern data lakehouse architectures and industry best practices to enhance cost-effectiveness, performance, and reliability.Collaborate with data scientists and engineers to seamlessly integrate machine learning models and analytical workloads into production environments.Ensure the integrity, quality, and security of data by implementing monitoring, alerting, and governance best practices.Work with cloud-based data warehouses and distributed data processing frameworks to support our data initiatives.Continuously assess and implement innovative technologies to enhance data infrastructure and operational efficiency.What We’re Looking For10+ years of experience in data engineering, software engineering, or a related field.Strong proficiency in SQL and Python for data processing.Experience with contemporary data warehousing and lakehouse solutions (e.g., Iceberg or similar).Expertise in distributed systems and big data technologies (Apache Spark, Hadoop, Kafka, Flink).Hands-on experience with cloud platforms (AWS, GCP, Azure) and related data services.Deep understanding of data management and governance practices.

At Plaid, we envision a future where financial interactions are seamless and intuitive. We are committed to driving this evolution by crafting innovative tools and experiences that empower thousands of developers to build their own applications. Our platform supports millions of users in achieving healthier financial lives by connecting their financial accounts with the apps and services they love. Collaborating with industry leaders like Venmo, SoFi, numerous Fortune 500 companies, and major banks, Plaid's extensive network encompasses over 12,000 financial institutions across the United States, Canada, the UK, and Europe. Established in 2013 and headquartered in San Francisco, we also have offices in New York, Washington D.C., London, and Amsterdam. #LI-HybridAs a Senior Data Engineer, you will play a pivotal role in our Data Engineering team, which is focused on developing robust golden datasets to enhance our insights-driven product offerings. Data-driven decision-making is at the heart of Plaid's culture, and your expertise will help us scale our data systems while ensuring data accuracy and integrity. You will provide essential tooling and guidance to various teams across engineering, product, and business, enabling them to access and utilize data effectively. Our engineers rely heavily on SQL and Python to create data workflows, employing tools such as DBT, Airflow, Redshift, ElasticSearch, Atlanta, and Retool for orchestrating data pipelines and defining workflows. Collaborating closely with engineers, product managers, business intelligence, and data analysts, you will contribute to shaping Plaid's data strategy and fostering a data-first mindset. We thrive on an engineering culture that values individual contributions, encouraging bottom-up ideation and empowering our talented team. We seek engineers passionate about making a meaningful impact for our users and customers while growing together as a cohesive team, delivering MVPs, and continuously improving our processes.In this high-impact position, you will empower business leaders to make faster, more informed decisions based on the datasets you create. You will have the opportunity to define the ownership and scope of internal datasets and visualizations across Plaid, an area we aim to develop further by establishing SLAs. This role presents a unique chance to enhance your technical skills and learn best practices from our strong Data Engineering team and the broader Data Platform team. You will collaborate extensively across all teams at Plaid, from Engineering to Product to Marketing and Finance, forging strong cross-functional partnerships.

About tvScientific tvScientific is the pioneering CTV advertising platform specifically designed for performance marketers. We harness extensive data and advanced technologies to automate and enhance TV advertising, ultimately driving measurable business results. Our platform seamlessly integrates media buying, optimization, measurement, and attribution into a single, efficient solution. Developed by industry veterans with deep expertise in programmatic advertising, digital media, and ad verification, our CTV performance platform offers advertisers a reliable avenue to expand their business. As a Senior Data Engineer at tvScientific, you will play a crucial role in establishing the robust data infrastructure that supports our data-intensive operations. You will work in collaboration with cross-functional teams to refine our core data pipelines, ensuring efficient scaling as we grow, and optimizing data storage solutions. This individual contributor role requires you to define and execute a strategic vision for data engineering within the company. Key Responsibilities: Develop and implement a robust data infrastructure in AWS, utilizing Spark with Scala. Enhance our core data pipelines to efficiently accommodate our significant growth. Optimize data storage solutions in appropriate engines and formats. Collaborate with cross-functional teams to design data solutions that align with business objectives. Construct fault-tolerant batch and streaming data pipelines. Leverage and optimize AWS resources while scaling design. Work closely with Data Science and Product teams to achieve collective goals. Success Metrics: Successful establishment of scalable and efficient data infrastructure. Timely delivery and optimization of data assets and APIs. High attention to detail in the implementation of automated data quality checks. Effective collaboration with cross-functional teams. What We’re Looking For: Proven experience in production data engineering. Expertise in Spark and Scala, with a track record of building data infrastructure using these technologies. Familiarity with data lakes, cloud warehouses, and various storage formats. Strong proficiency in AWS services. Advanced SQL skills for data manipulation and extraction. Exceptional written and verbal communication abilities. Bachelor's degree in Computer Science or a related discipline. Nice to have: Experience with additional data processing frameworks.

About Formation BioFormation Bio is a cutting-edge pharmaceutical company harnessing the power of technology and AI to transform drug development. As advancements in AI and drug discovery generate more candidate drugs than the industry can efficiently progress through clinical trials, Formation Bio, originally founded as TrialSpark Inc. in 2016, has developed innovative technology platforms and processes to streamline every aspect of drug development and clinical trials. Our mission is to alleviate the bottleneck in drug development to ensure that new medicines reach patients more swiftly. We collaborate, acquire, or in-license drugs from pharmaceutical companies, biotechs, and research organizations to advance programs beyond clinical proof of concept, ultimately delivering new therapies to patients. Our esteemed investors include a16z, Sequoia, Sanofi, Thrive Capital, Sam Altman, John Doerr, Spark Capital, SV Angel Growth, and many others. Explore more about us through the following links:Our Vision for AI in PharmaOur Current Drug PortfolioOur Technology & PlatformAt Formation Bio, our core values empower our mission to revolutionize the pharmaceutical landscape. Every member of our team embodies these values and contributes significantly to our goal of expediting access to new treatments for patients. About the PositionWe are seeking a Senior Data Engineer to become a vital part of our Scientific Data Intelligence (SDI) team at Formation Bio. Your primary responsibility will be to enhance and scale the data infrastructure that supports our drug development platform. This role will require you to collaborate closely with the Data Science team, developing coherent, well-structured data models, feature engineering pipelines, and evidence layers that are foundational to their scientific endeavors. In addition, you will be tasked with ingesting data from diverse sources—APIs, files, databases, and licensed third-party datasets—and transforming it into clean, analytics-ready assets utilizing modern data tools.This position is ideal for an individual who takes pride in building robust systems: reliable data pipelines, well-organized data models, and frameworks that colleagues can confidently rely upon. You will work in conjunction with Data Scientists and other engineering experts to propel our mission forward.

Join Unify as a Senior Data Engineer, EnrichmentAt Unify, we are pioneering the first AI-driven action system for revenue teams, enabling organizations to transform their outbound efforts into a powerful growth engine. Our technology makes go-to-market strategies observable, repeatable, and scalable. Established in 2023 by visionaries from Ramp and Scale AI, our team boasts experience from industry giants such as Airbnb, Meta, Waymo, and Perplexity.In 2024, we achieved an impressive 8x revenue increase and cater to esteemed clients like Perplexity, Cursor, SoFi, and Justworks. We are a dynamic and high-energy team that has successfully raised $58M from prominent investors including Thrive, Emergence, and OpenAI. Help us shape the future of go-to-market strategies - come aboard!Role OverviewAs a Senior Data Engineer focusing on Enrichment, you will take ownership of the systems that create and uphold the most extensive and high-quality first-party contact dataset available. Your responsibilities will include designing data pipelines that assimilate information from various vendors, developing intelligence to evaluate data source reliability, and establishing a quality framework that secures Unify's data as a competitive advantage.

Join HockeyStack, where we are revolutionizing B2B sales and marketing through advanced AI systems.We seamlessly integrate with a multitude of tools across the go-to-market stack, merging first and third-party data to create the industry's most comprehensive event-level data foundation. Our capabilities include:Analyzing every deal won and lost to uncover revenue-driving patterns, enabling real-time guidance for sales representatives.Identifying key factors influencing the sales pipeline, providing immediate insights without the need for extensive manual analysis.Learning from every outcome and interaction, continuously improving our system's performance and accuracy.Unlike others, our structured reasoning layer ensures deterministic and self-improving agent execution. As a Y Combinator alum with a $26M Series A led by Bessemer Venture Partners, we are experiencing rapid growth with an 8-figure ARR and over 60 TB of GTM data processed. We are looking for dynamic individuals ready to succeed. This position can be based in our San Francisco HQ or be fully remote. Your MissionAs the Backend Tech Lead for the Data API team, you will design and scale our core API infrastructure, which is critical for Marketing, Sales, and Customer Success operations. You will oversee the engineering of services that manage over 60 TB of GTM data, ensuring the delivery of low-latency, high-availability APIs that provide valuable buyer insights to our internal applications and customer-facing dashboards.This is an exceptional opportunity for an engineer eager to take ownership of large-scale data and API infrastructure while fostering engineering excellence and rapid deployment in a fast-paced environment. What You’ll DoLead the design and development of APIs to share GTM data with both internal and external users.Oversee the architecture for large-scale data access patterns, focusing on performance, cost-effectiveness, and reliability.Work closely with AI, data, and frontend teams to ensure smooth integrations and clear API contracts.Address complex challenges including versioning, rate-limiting, authentication, query complexity, and cache invalidation in a rapidly evolving product landscape.

At Point, we're redefining the banking landscape by transforming the everyday debit card into a gateway for rewards and benefits. Join our innovative team as we embark on this exciting journey!We are seeking a skilled Data Engineer to lead our data initiatives at Point. In this role, you will be responsible for designing and implementing robust data pipelines and systems that will support the development of cutting-edge algorithms and models. You will have full ownership of our data infrastructure while establishing the groundwork for data engineering practices at Point. Collaborating closely with both the engineering and data science teams, you will play a pivotal role in driving product initiatives and achieving our business objectives. This position reports directly to the CTO.Discover more about Point's vibrant culture and dedicated team here.

Okta is an independent identity provider focused on building secure, trusted infrastructure for both AI and human users. The Technology, Data, and Intelligence (TDI) team supports Okta’s global workforce by providing the technology and systems employees need to succeed. Role overview The Senior Director of Data Platform and Engineering leads a global group of data and analytics engineers. This leader maximizes the value of Okta’s data assets and reports to the VP of Data and Insights. The position requires a balance of deep technical expertise and the ability to engage in strategic business discussions. As a player-coach, the Senior Director builds and mentors the team, guides key initiatives, and maintains a strong data foundation. This role is central to Okta’s AI strategy. As AI becomes more integrated into Okta’s products and operations, the quality and governance of data are increasingly important. The Senior Director ensures that clean, trusted, and well-managed data supports all AI projects, shaping the platform for Okta’s ongoing growth. What you will do Lead and develop a high-performing team: Mentor, grow, and support a diverse group of data and analytics engineers. Foster a culture of excellence, collaboration, and continuous learning. Advance AI enablement: Work closely with AI Engineering teams to ensure data infrastructure and practices are ready for AI development and deployment. Define data governance standards, build quality training datasets, and develop scalable data pipelines for AI and machine learning models. Location Bellevue, Washington; Chicago, Illinois; San Francisco, California; Washington, DC

Join our dynamic Engineering team as a Senior Data Engineer and play a pivotal role in shaping Tendo’s innovative data engineering solutions. You will be responsible for ingesting, transforming, and warehousing critical healthcare-related data from diverse sources.In this collaborative environment, you will work closely with our Data Scientists, Product Managers, and Machine Learning Engineers to create robust data flows and transformations that facilitate advanced analytics and the development of AI/ML models.Your expertise will be instrumental in designing and implementing tools and solutions that streamline data integration, data warehousing, and data modeling. This role enables Data Engineers and Data Scientists to experiment and train machine learning models, leading to valuable insights for Tendo’s clients.The ideal candidate will possess a robust background in software engineering, data modeling, data warehousing, ETL pipelines, and database design. A keen interest or experience in AI/ML applications, along with a forward-thinking approach to healthcare innovation, is highly desirable.

About Probably GeneticProbably Genetic is revolutionizing the lives of patients with severe and complex diseases. Our advanced data platform empowers drug developers and patient advocacy organizations to create and launch innovative treatments. By leveraging cutting-edge technology, we identify undiagnosed patients online, analyze their conditions using machine learning and home testing, and facilitate compliant communication with them. Our mission is to ensure that patients gain access to diagnoses, clinical trials, and treatments at the earliest opportunity.We are a dedicated team of passionate problem solvers, driven by a purpose that transcends individual interests. By prioritizing patient welfare, we are developing groundbreaking solutions in healthcare, with a roadmap full of innovations in bioinformatics, AI, and drug development. We invite you to join our lean, talented team and contribute to our vision.Probably Genetic has secured multiple funding rounds from top-tier Silicon Valley investors, including Threshold, Khosla, and Y Combinator. We offer competitive salaries, comprehensive benefits, and meaningful equity opportunities for early-stage team members.About the RoleWe are seeking a founding Data Engineer who is enthusiastic about shaping the future of data utilization to enhance patient outcomes. In this pivotal role, you will establish our data engineering architecture and construct the pipelines that drive internal insights and commercial data products. Your contributions will be instrumental in fostering clarity, impact, and growth throughout our organization.What You Will DoCollaborate closely with the Head of Engineering and Head of Product to transform complex data challenges into elegant, scalable solutions.Build reliable, maintainable infrastructure on AWS using Terraform to accommodate our expanding data requirements.Design data tables and pipelines tailored to the specific needs of our customers and internal teams.Implement state-of-the-art data pipelines with built-in observability from day one.Analyze and visualize data using BI tools to facilitate informed business decisions and provide customized insights to clients.Communicate your work and its impact across teams — presenting findings, receiving feedback, and continuously enhancing processes.Who You AreWe are eager to connect with candidates from diverse backgrounds who are committed to learning, growth, and making a meaningful impact. Here are a few attributes that will enable you to thrive in this role:Proficiency in data engineering principles and practices.Experience with cloud platforms, particularly AWS.Strong analytical skills and familiarity with data visualization tools.Ability to collaborate effectively in a team environment.

At Judgment Labs, we specialize in developing cutting-edge infrastructure for Agent Behavior Monitoring (ABM). Unlike conventional observability tools that merely track exceptions and latency, our ABM technology identifies behavioral anomalies, such as instruction drifts and context retrieval losses, in large-scale production settings.Our solutions are trusted by numerous teams working on autonomous agents to gain insights into system behavior post-deployment. Rather than simply reacting to incidents, our clients analyze patterns across conversations and workflows, correlate regressions with specific interaction types, and identify critical points of reliability failure. Recently, we secured over $30 million across two funding rounds from notable investors like Lightspeed, SV Angel, and Valor Equity Partners.The Role:We are seeking a Senior Data Infrastructure Engineer to architect and enhance the real-time data pipelines essential for robust agent behavior analysis at scale. This position plays a vital role in processing hundreds of thousands of traces per second, executing LLM-based scoring and clustering in near-real-time, and ensuring low-latency query performance, which allows teams to monitor agent behavior as it unfolds. Ideal candidates will have experience designing petabyte-scale data systems, optimizing OLAP database performance, and managing the full data lifecycle from ingestion to analytics.What You'll Do:Design and automate large-scale, high-performance streaming and batch data processing systems to support Judgment's behavioral analysis products.Collaborate closely with infrastructure and backend teams to enhance scalability, data governance, and operational efficiency.Promote best practices in software engineering for data infrastructure at scale.Uphold high standards for data quality and engineering: ensuring reliability, efficiency, documentation, testability, and maintainability.Craft data models for optimal storage and access, ensuring efficient data flows to meet critical product requirements.Enhance OLAP database performance through careful schema design, partitioning strategies, storage optimization, and access pattern analysis.

Are you ready to challenge your limits and push the boundaries of your capabilities? Join us at Coinbase, where we strive to enhance economic freedom globally. As we progress in building the future of the on-chain platform and the global financial ecosystem, we need the brightest minds to help us achieve this monumental goal.We're looking for a dedicated Senior Data Protection Engineer who shares our passion for transforming the financial landscape through blockchain technology. If you are motivated to make a significant impact, thrive under pressure, and value continuous feedback to grow, you will find your place among our talented team at Coinbase.Our work culture is both demanding and rewarding, designed for those who are eager to excel alongside high-performing colleagues. Although many of our roles are remote-first, we do emphasize the importance of in-person collaboration throughout the year, with team and company-wide events held multiple times annually to strengthen our connections and alignment.As a Senior Data Protection Engineer, you will spearhead the enhancement of our data protection capabilities, ensuring that the Coinbase ecosystem is shielded from sophisticated security threats. Your primary responsibility will be executing a comprehensive strategy that harmonizes strong security measures with the agility required in a decentralized tech environment. You will adopt an automation-first approach, utilizing advanced technologies such as LLMs and agentic AI to create scalable Data Loss Prevention operations. Collaborating across various teams will be essential to mitigate risks and ensure compliance with global regulations.

At Plaid, we believe in the power of data-driven decision-making. Our data culture demands robust and scalable data systems that ensure accuracy and completeness. As a Senior Software Engineer focusing on Data Infrastructure, you will play a pivotal role in empowering teams across engineering, product, and business sectors to swiftly and securely extract valuable data insights. Your work will directly enhance our ability to serve customers effectively. You will be responsible for building and optimizing our data and machine learning infrastructure, allowing Plaid engineers to innovate and iterate on products built on consumer-permissioned financial data. Our Data Infrastructure engineers are experts in Data Warehousing, Data Lakehouse architecture, Spark, Workflow Orchestration, and Streaming technologies. You will enhance our existing data pipelines for performance and cost efficiency while creating intuitive abstractions that simplify the development process for other engineers at Plaid.

Join DoorDash, a leader in the on-demand delivery industry, as we harness the power of data to drive transformative business and product decisions. Our Core Data Platform team is at the forefront of building an operationally efficient analytical data stack that supports our rapid growth.About Our TeamAt DoorDash, we pride ourselves on being a data-centric organization. The Core Data Platform team is responsible for developing the infrastructure that enables us to leverage timely and accurate data for critical insights. We design and operate scalable compute and ingestion frameworks powered by cutting-edge technologies like Spark, Flink, Kafka, Airflow, and innovative lakehouse solutions.About the RoleThis role offers a unique opportunity to contribute to a high-impact team that shapes the future of data at DoorDash. As a Software Engineer, you'll help design and implement frameworks that facilitate data mobility, ingestion, and governance. You'll also play a vital role in setting and maintaining data quality and compliance standards, ensuring that our analytics remain trustworthy and effective. If you're passionate about building systems that drive real-time insights and personalization, we want to hear from you!Your Excitement for This OpportunityLead the vision and strategy for developing scalable frameworks to meet the demands of our growing business.Enhance our analytical platform to handle increasing data volumes and diverse use cases.Utilize your expertise in building and operating high-scale systems with a focus on reliability, scalability, and cost efficiency.Collaborate with stakeholders to create innovative solutions on top of our platform.Contribute to a positive and inclusive work culture, mentoring and uplifting your peers.Your QualificationsB.S., M.S., or PhD in Computer Science or a related field.2+ years of experience at the I4 level, or 5+ years at the I5 level in software engineering.Proven experience in big data technologies (streaming, batch processing, data lakes, OLAP) and promoting real-time data insights.

Join the Founding Team as a Data Engineer!Location: San Francisco Bay AreaType: Full-TimeCompensation: Competitive salary + early-stage equityAt fabrion, supported by 8VC, we are on a mission to assemble an elite team dedicated to solving one of the most significant challenges in the industry’s infrastructure.We are creating a cutting-edge, AI-native platform that transforms enterprise data into actionable insights through semantic enrichment, intelligent agents, and regulated interoperability. Central to our architecture is the Data Fabric—an intelligent, governed layer that integrates fragmented and siloed data into a cohesive ontology, primed for model training, vector search, and insight-to-action workflows.We seek engineers who thrive on tackling complex data challenges at scale, including messy unstructured data, schema evolution, multi-source integrations, security frameworks, and AI-ready semantic enrichment. You will be instrumental in developing backend systems, data pipelines, connector frameworks, and graph-based knowledge models that drive agentic applications.If your experience includes working on streaming unstructured data pipelines, integrating with challenging legacy systems, or scaling knowledge graphs, this opportunity is tailor-made for you!

Join SoFi as a Senior Software Engineer in our Data Foundations team, where you will play a pivotal role in shaping our data architecture and enhancing our data-driven capabilities. You will work closely with cross-functional teams to develop robust data solutions that empower our business decisions and improve customer experiences.As a Senior Software Engineer, you will leverage your expertise in data engineering, software development, and cloud technologies to build scalable data pipelines and maintain high-quality data infrastructure. Your contributions will directly impact our ability to deliver innovative financial solutions.

Join our innovative team at DigitalOcean as a Senior Data Center Engineer II. In this pivotal role, you will be responsible for designing, implementing, and maintaining our cutting-edge data center infrastructure. Your expertise will drive improvements in efficiency and reliability while leading initiatives to optimize operations.The ideal candidate will possess strong technical skills, a passion for problem-solving, and a commitment to excellence in a fast-paced environment. You will collaborate with cross-functional teams to ensure our systems meet the highest standards of performance and security.