Senior Data Engineer - Data Foundations

Komodo Health is looking for a Senior Data Engineer to strengthen its data foundations. This fully remote role in the United States centers on building and maintaining the systems that support data-driven work across the company. Role overview This position focuses on designing, developing, and maintaining data pipelines and infrastructure. The goal is to make sure data remains accurate and accessible for teams throughout the organization. Collaboration Senior Data Engineers at Komodo Health work closely with colleagues from different departments. Cross-functional teamwork is essential to understand data needs and to deliver solutions that support business decisions. Key responsibilities Design and develop data pipelines and systems Maintain and improve data infrastructure Support data accuracy and accessibility Collaborate with teams across the organization

As a note for all engineering positions: in light of the increase in fraudulent applications and AI-driven candidate impersonation, we have instituted rigorous measures throughout the hiring process to ensure the authenticity of candidates.About UsAt People Data Labs (PDL), we pride ourselves on being the premier provider of people and company data. Our mission is to handle the complexities of data collection and standardization, enabling our clients to concentrate on developing and scaling innovative, compliant data solutions. Our primary focus is to deliver the highest quality data available by integrating thousands of responsibly sourced datasets into a single, developer-friendly source of truth. Leading organizations worldwide rely on PDL’s workforce data to enhance recruiting platforms, power AI models, create targeted audiences, and much more.We seek team members who embody a strong sense of ownership while embracing a collaborative spirit. Our clients face intricate challenges, and we can only help them succeed as a united team. Our Data Engineering Team is the driving force behind our success, and we are on the lookout for top-tier talent.If you aspire to be part of a team exploring the next frontier of data-as-a-service (DaaS) with significant autonomy and opportunities for impactful contributions, this role may be perfect for you. We value engineers who are thoughtful, innovative, and willing to boldly experiment. At PDL, we embrace failure as long as it leads to learning and growth.Key ResponsibilitiesDevelop infrastructure for the ingestion, transformation, and loading of an ever-increasing volume of data from diverse sources utilizing Spark, SQL, AWS, and Databricks.Create an organic entity resolution framework capable of accurately merging hundreds of billions of individual entities into clean, usable datasets.Design and implement CI/CD pipelines and anomaly detection systems aimed at continuously enhancing the quality of data we deliver to production.Innovate solutions for complex, often ill-defined data engineering and data science challenges.Required Technical Skills5-7+ years of relevant experience with demonstrable examples of strategic technical problem-solving and implementation.Solid grounding in software development principles.Proficiency in Python.Expertise in Apache Spark (Java, Scala, and/or Python-based).Familiarity with AWS services and data engineering best practices.

Join SoFi as a Senior Software Engineer in our Data Foundations team, where you will play a pivotal role in shaping our data architecture and enhancing our data-driven capabilities. You will work closely with cross-functional teams to develop robust data solutions that empower our business decisions and improve customer experiences.As a Senior Software Engineer, you will leverage your expertise in data engineering, software development, and cloud technologies to build scalable data pipelines and maintain high-quality data infrastructure. Your contributions will directly impact our ability to deliver innovative financial solutions.

About RoxAt Rox, we are pioneering the development of an AI-native revenue operating system that transforms how enterprises interact with technology. Unlike traditional software designed for human dashboard operators, Rox is engineered for agents managing complex systems.We eliminate static workflows, enabling continuous decision-making processes powered by real-time insights from across the enterprise landscape. Our agents are equipped to analyze signals, reason through them, and autonomously execute actions.To support this innovation, we are constructing a robust infrastructure that integrates:Distributed data platformsReal-time decision-making systemsAgent execution frameworksLow-latency context retrievalBacked by prominent investors like Sequoia, GV, and General Catalyst, we are assembling a talented team of engineers eager to tackle deep technical challenges that have a tangible impact on the world.About the Foundations TeamThe Foundations team is responsible for developing the core infrastructure that powers Rox agents.Our work focuses on:Real-time context ingestionAgent execution and orchestrationEnsuring reliability for long-term AI tasksLow-latency decision-making across distributed systemsIf you have experience with:Streaming compute platformsDistributed query enginesReal-time OLAP systemsMatching enginesLarge-scale data infrastructureMany challenges you encounter here will resonate with your past work but will be applied to a novel category of software. At Rox, agents continuously:Retrieve contextMake decisionsTrigger actionsUpdate stateThe Foundations team builds the infrastructure that ensures these feedback loops are reliable, swift, and observable.The RoleWe are on the lookout for a Foundations Engineer (Deep Infrastructure) to design and oversee the systems that power Rox's agent runtime.

About Glean:Established in 2019, Glean is a pioneering AI-driven knowledge management platform that empowers organizations to swiftly locate, organize, and disseminate information throughout their teams. By seamlessly integrating with tools such as Google Drive, Slack, and Microsoft Teams, Glean ensures that employees have timely access to essential knowledge, thereby enhancing productivity and collaboration. Our state-of-the-art AI technology streamlines knowledge discovery, facilitating a more efficient utilization of collective intelligence across teams.Glean originated from Founder & CEO Arvind Jain’s profound insight into the challenges that employees encounter while seeking and comprehending information at work. Witnessing firsthand how fragmented knowledge and a multitude of SaaS tools hindered productivity, he aimed to create an enhanced solution – an AI-powered enterprise search platform that enables rapid and intuitive access to necessary information. Since its inception, Glean has transformed into a leading Work AI platform, merging enterprise-grade search, an AI assistant, and robust application and agent-building capabilities to fundamentally reshape the modern workplace.About the RoleWe are in search of a Software Engineer to become a vital member of Glean’s Data Foundations team—the unit responsible for the comprehensive data ingestion and management layer that powers Glean’s Search, AI Assistant, and Agent offerings across a multitude of enterprise applications and vast quantities of documents.Your contributions will directly influence the quality, timeliness, and reliability of the knowledge that each Glean user engages with daily.Your Responsibilities Include:Ingestion & ConnectivityDevelop and enhance connectors for a diverse array of SaaS and on-premise systems (including Google Workspace, Microsoft 365, Slack, Salesforce, Jira, ServiceNow, GitHub, etc.).Ensure the seamless integration and continuous improvement of data flows to maintain system performance and reliability.

Join LinkedIn as a Tech Lead in our Data Foundations team, where you will play a pivotal role in driving data strategy and enhancing our data infrastructure. Your leadership will guide a team of talented engineers as we build scalable data solutions that empower data-driven decision-making across the company.

About Plaid Plaid builds tools that help developers create new financial products and experiences. Since 2013, Plaid has connected millions of users to over 12,000 financial institutions across the US, Canada, the UK, and Europe. The company partners with organizations like Venmo, SoFi, Fortune 500 firms, and major banks to make linking financial accounts to apps and services easier. Headquarters are in San Francisco, with offices in New York, Washington D.C., London, and Amsterdam. Team: Data Foundation & AI The Data Foundation and AI team designs and maintains the machine learning and AI infrastructure that supports Plaid’s products. This group transforms Plaid’s financial network data into flexible formats used by teams across the company. Responsibilities span the entire system lifecycle: data curation for pretraining, model development, deployment, serving, and monitoring in production. Role Overview: Senior Machine Learning Engineer (Research Scientist) This position focuses on applied research for Plaid’s foundation model. The Senior Research Scientist leads efforts to design model architectures, set pretraining objectives, and implement fine-tuning strategies that work across a range of product needs. The role also involves building and maintaining production machine learning systems, including training pipelines, model serving, feature engineering, and performance monitoring. Key Responsibilities Design model architectures and define pretraining objectives for Plaid’s foundation model Develop and apply fine-tuning methods for diverse product use cases Build and maintain end-to-end machine learning systems, from data pipelines to model serving Engineer features and monitor system performance in production Create evaluation frameworks to measure model quality across multiple tasks and metrics Location This role is based in San Francisco.

Join Storable as a Senior Data Engineer and be a part of our mission to revolutionize the storage industry. Our advanced platform is designed to empower businesses in managing, tracking, and expanding their self-storage operations. We are seeking a skilled Senior Data Engineer to enhance our data-driven team. At Storable, we harness the latest technologies to boost data efficiency, accessibility, and insights, enabling our teams to make informed decisions and foster significant growth. In this role, you will contribute to the development and maintenance of scalable data systems that underpin analytics, reporting, and product innovation. You will collaborate closely with senior engineers and cross-functional teams to ensure our data remains reliable, accessible, and actionable throughout the organization.

Join Us in Revolutionizing Grocery ShoppingAt Instacart, we believe in bringing people together through food, ensuring that everyone has access to their favorite groceries while enjoying quality time with loved ones. Where others see a simple grocery delivery service, we see a complex and exciting opportunity to meet the diverse needs of our community. We are dedicated to providing an essential service that customers trust for their grocery and household needs, while also offering flexible earning opportunities for our Instacart Personal Shoppers.Instacart is a lifeline for millions, and we’re expanding our team to continue pushing the boundaries of grocery shopping. If you're ready to make a significant impact and do the best work of your career, we invite you to join us.Embrace Flexibility with InstacartAt Instacart, we understand that there isn’t a one-size-fits-all approach to productivity. Our team members enjoy the flexibility to choose where they work best—be it from home, an office, or your favorite café—while fostering connections and community through regular in-person gatherings. Discover more about our flexible work philosophy.About Our TeamThe Data Governance & Foundations team at Instacart is responsible for developing and maintaining the foundational systems that drive our comprehensive data ecosystem. This includes managing a modern data lakehouse at scale, encompassing data ingestion, stream processing, analytical computing, and self-service tools. As a part of a collaborative group of 6-7 engineers, you will ensure the reliability of our production platform while architecting the future infrastructure that will sustain our operations for the next 3-5 years.This role offers high ownership and autonomy. You will be tasked with making architectural decisions that have both technical and financial implications, requiring you to lead initiatives rather than just execute them. Collaboration with engineering leaders and cross-functional teams in Data Science, ML Platform, Ads Infrastructure, Finance Engineering, and senior stakeholders will be key to your success.

Join the Amity Foundation, a renowned Teaching and Therapeutic Community dedicated to fostering transformative change. We are currently seeking passionate and driven individuals to step into the role of Data Clerk within our innovative in-prison facilities. This unique position offers a rewarding opportunity to contribute to our prison programs, positively impacting the lives of the inmate population while simultaneously enhancing your professional development in the field of data management. About Amity Foundation: At the Amity Foundation, we provide a nurturing environment where individuals can embrace change, cultivate new values, and build lasting relationships. Our commitment lies in the inclusion and habilitation of people affected by various social issues, including addiction, homelessness, trauma, and injustice. We prioritize research and the dissemination of knowledge focused on community building and empowerment. Remembrance, Resolution, Reconciliation, Restoration, Renewal Role Overview:As a Data Clerk, you will play a crucial role in managing data entries into the Automated Reentry Management System (ARMS), integral to the Integrated Substance Use Disorder Treatment Program (ISUDTP). Your responsibilities will include ensuring accurate data tracking and adherence to relevant policies and procedures.

Join 1upHealth as a Senior Data Engineer and play a pivotal role in enhancing our Core Data Platform. We are looking for innovative thinkers who are passionate about data and technology. Your expertise will help us drive the development of cutting-edge data solutions that empower healthcare providers and improve patient outcomes. In this fully remote position, you will collaborate with cross-functional teams to create scalable data architectures and solutions, ensuring data integrity and accessibility.

Join Leap as a Senior Data Engineer and be a key player in shaping the future of data-driven decision-making. In this role, you will design and implement data solutions that drive analytics and business intelligence initiatives. You will collaborate with cross-functional teams to gather requirements and translate them into scalable data architectures.

Join ICON as a Senior Data Engineer in our Data Intelligence & Systems Architecture (DISA) team, where you will be instrumental in designing, developing, and expanding our enterprise data platform using Palantir Foundry. In this pivotal role, you will oversee the ingestion, modeling, and activation of data that drives reporting, strategic decision-making, and intelligent automation throughout the organization. Rather than merely constructing data pipelines, you will be architecting a Digital Twin for an industrial robotics and construction company. Your collaboration will span across departments including Supply Chain & Manufacturing, Logistics, Engineering Support Services, Software, Field Operations, and Technology R&D. Together, you will centralize high-value data sources, create scalable assets, and facilitate critical business applications, from real-time analytics to AI/ML-enhanced workflows and decision-making processes. This highly technical and cross-functional position is perfect for someone with robust data engineering expertise, a profound curiosity about the business, and a proactive mindset. This role is based at ICON’s headquarters in Austin, Texas, and reports directly to the Senior Director of Operations.

The OpportunityJoin Enigma at a pivotal moment as we prepare to unveil our next generation of small business intelligence products, informed by years of industry experience. We are in search of a seasoned Senior Data Engineer who will play a crucial role in shaping the future of these innovative products. Your contributions will significantly enhance the accuracy, scalability, and predictive analytics of our data platform, directly impacting our clients' key business strategies.The RoleAs a Senior Data Engineer, your primary responsibility will be to design, construct, and manage our foundational small business data product. You'll work closely with cross-functional teams to develop new product functionalities, starting from raw data sources, through scalable data pipelines and models, to the customer interface. Our culture emphasizes customer focus and complete ownership, measuring your success by the value delivered and the technical excellence of our product.What You’ll DoIdentify and address the unmet needs of our customers through thorough data exploration, prototyping, and evaluation, culminating in the development of robust and maintainable data pipelines.Construct scalable and maintainable data systems that narrate the stories of millions of U.S. small businesses, utilizing tools like Databricks SQL, PySpark, and MLFlow.Leverage our pioneering data infrastructure designed for iterative development and experimentation, utilizing Dagster for orchestration and LakeFS for data version control.Employ a data-driven, first-principles approach to problem-solving, favoring straightforward and elegant solutions while being capable of deploying advanced models and techniques when necessary.Motivate your colleagues to excel while nurturing a collaborative and supportive team environment.What Makes This Role Exciting?Ownership and Impact: Collaborate directly with customers and internal teams to develop product features in a high-trust environment.Technical Challenge: Solve complex data and engineering challenges, balancing innovation speed with scalability and reliability.Learning: Engage with unique, impactful data challenges that demand creative solutions and cutting-edge methodologies.

Join Hinge: The Dating App Designed for Lasting ConnectionsIn an age where meaningful relationships are increasingly elusive, Hinge is dedicated to fostering intimate connections that combat loneliness. Our team is passionate about analyzing user behavior to enhance the dating experience, with our ultimate success measured by the number of successful dates we facilitate. With a global user base in the millions, Hinge has become the premier app for those seeking meaningful relationships.Role Overview: As a Senior Data Engineer at Hinge, you will play a vital role in developing key data processes and contributing to a cutting-edge data pipeline that supports our strategic decision-making. Your contributions will not only solve complex challenges but also empower our analytical teams, directly impacting the love lives of countless individuals. You will enhance core functionalities and implement essential data pipelines that serve both the Data Engineering team and the broader organization, all while tackling real-world problems within a big data architecture.

Join Aya Healthcare, a proud recipient of multiple Top Workplace awards! We are in search of a seasoned Senior Data Engineer to become an integral part of our Data Operations team. In this hands-on senior role, you will be responsible for designing, developing, and optimizing high-volume, high-performance data infrastructures and pipelines essential for client integrations. Your expertise will be pivotal in shaping our data architecture, spearheading complex initiatives, and guiding junior team members.This is a unique opportunity to join a dynamic team in a fast-paced environment, where your leadership and strategic insights will have a direct impact on our business outcomes.

About AlembicAlembic is at the forefront of transforming marketing strategies, demonstrating the actual ROI of marketing initiatives. Our cutting-edge Alembic Marketing Intelligence Platform employs advanced algorithms and AI models to address this longstanding challenge effectively. By joining our team, you'll contribute to the development of tools that deliver unparalleled insights into how marketing influences revenue, empowering a growing roster of Fortune 500 companies to make data-driven decisions with confidence.About the RoleIn your role as a Senior Data Engineer at Alembic, you will play a crucial role in our data platform. You will be responsible for creating scalable and dependable data pipelines, optimizing storage solutions, and facilitating both real-time and batch analytics. Collaborating closely with data scientists, software engineers, and product leaders, you will design and implement robust data architectures that propel our mission forward.Key ResponsibilitiesDesign, develop, and maintain scalable ETL pipelines that efficiently ingest, process, and transform extensive volumes of structured and unstructured data.Optimize data storage solutions utilizing modern data lakehouse architectures and industry best practices to enhance cost-effectiveness, performance, and reliability.Collaborate with data scientists and engineers to seamlessly integrate machine learning models and analytical workloads into production environments.Ensure the integrity, quality, and security of data by implementing monitoring, alerting, and governance best practices.Work with cloud-based data warehouses and distributed data processing frameworks to support our data initiatives.Continuously assess and implement innovative technologies to enhance data infrastructure and operational efficiency.What We’re Looking For10+ years of experience in data engineering, software engineering, or a related field.Strong proficiency in SQL and Python for data processing.Experience with contemporary data warehousing and lakehouse solutions (e.g., Iceberg or similar).Expertise in distributed systems and big data technologies (Apache Spark, Hadoop, Kafka, Flink).Hands-on experience with cloud platforms (AWS, GCP, Azure) and related data services.Deep understanding of data management and governance practices.

SteerBridge Strategies is a forward-thinking technology firm dedicated to providing innovative, mission-driven solutions for both the U.S. Government and private sector. Our team leverages extensive experience in federal acquisition, digital transformation, and emerging technologies to offer agile, commercial-grade capabilities that enhance operational effectiveness and drive measurable mission success.At SteerBridge, our greatest asset is our people—especially the veterans whose leadership, innovative problem-solving abilities, and unwavering commitment to excellence elevate every project we undertake. We don't just recruit top-tier talent; we nurture it, creating meaningful career pathways for veterans, military spouses, and professionals who share our enthusiasm for advancing technology and enhancing the missions we support.We are currently seeking a Senior Data Engineer to join our team in supporting the Department of Veterans Affairs (VA) in its efforts to modernize disability claims processing systems. This initiative aims to enhance the accuracy, efficiency, and timeliness of services delivered to veterans.As a Senior Data Engineer, you will play a pivotal role in designing, developing, and optimizing scalable ETL pipelines, data lakes, and data retrieval systems. Collaborating with cross-functional teams, you will ensure data integrity, develop automated workflows, and support compliance reporting and analytics capabilities.

At PitchBook, a subsidiary of Morningstar, we are committed to looking ahead. We continually innovate, evolve, and invest in our team to unlock the potential in everyone. Our collaborative spirit and vibrant culture make our workplace both energetic and enjoyable.Our comprehensive learning programs and mentorship initiatives foster a culture of curiosity, encouraging us to seek new solutions and improved methods. In a fast-paced industry with high aspirations, we embrace challenges and ambiguity, thriving when we push our limits. We are open to taking risks, learning quickly from our failures, and striving for excellence.If you bring a positive attitude and a willingness to roll up your sleeves to get things done, PitchBook is the perfect place for you.About the Role:As a pivotal member of our Product and Engineering team, you will collaborate with a group of innovative thinkers and problem solvers who are dedicated to enhancing the positive impact we have on our customers and our organization daily. We prioritize curiosity and the pursuit of better practices, with a strong emphasis on customer empathy in our product innovations.We believe that greatness comes from collaboration and diverse perspectives; hence, we work closely with partners globally. As a team, we assume positive intent, value constructive dialogue, and cultivate a respectful workplace grounded in integrity and growth. We invest significantly in our employees who are eager to learn and evolve. Join us and grow with PitchBook!

Join Ethenalabs as a Senior Data Engineer, where you will play a pivotal role in transforming data into actionable insights. As part of our globally remote team, you will work on cutting-edge data engineering projects that drive innovation and efficiency across various domains.