Senior Software Engineer - Data Engineering

About UsAt Perchwell, we are redefining the landscape of real estate listings. Our innovative platform empowers agents to conduct intelligent searches, enhance collaboration, and expedite transactions. We are dedicated to establishing a state-of-the-art infrastructure for residential real estate listings, seamlessly merging market research with client collaboration.Our cutting-edge architecture supports ongoing innovation that outpaces legacy systems, featuring AI-driven functionalities and mobile-first designs tailored for real-world applications by agents. As technology and consumer expectations evolve, our commitment remains steadfast: to provide real estate professionals with the most sophisticated, data-centric, and interconnected platform available.Supported by premier venture capital firms like Lux Capital and Founders Fund, along with strategic alliances with leading Multiple Listing Services (MLSs), Perchwell stands as the foremost new entrant into the listings technology market in decades. This unique blend of institutional backing and industry integration offers the resources and credibility necessary to revolutionize the multi-trillion dollar residential real estate sector.Position OverviewAs a Senior Software Engineer, Data, you will be integral to Perchwell's mission of developing a cohesive Multiple Listing System (MLS). You will work collaboratively with cross-functional teams, including Data Analysts, Product Managers, Designers, and Engineers, to construct robust data solutions. Your responsibilities will encompass establishing a data lake and warehouse solution, enhancing our existing data framework, and creating a premier system that accelerates the accurate onboarding of client data. As a key contributor to this initiative, you will have the chance to influence the standards, culture, and values of the data engineering team.We invite candidates to work from our SoHo NYC office three days a week.Your ContributionsDevelop and scale efficient data pipelines that integrate millions of property listings and market insights from diverse real estate data sources and APIs.Promote data excellence by designing automated governance systems that ensure high data quality and comprehensive observability across our platform.Drive the advancement of our data infrastructure to facilitate swift MLS onboarding, crafting solutions that benefit real estate professionals across the nation.Collaborate with our Data Analytics team to convert raw property data into actionable insights that enhance decision-making processes.

Role Overview adonis is hiring a Senior Software Engineer focused on the Data Platform in New York City. This role centers on building and refining data solutions that help the company serve clients better. The position calls for hands-on leadership in developing and optimizing data systems. What You Will Do Lead the design and improvement of data architectures for the platform Collaborate with teams across the company to deliver reliable data solutions Implement analytics tools and processes that support business insights and decision-making Collaboration This role works closely with colleagues from engineering, analytics, and other departments to create and maintain data systems that meet business needs.

At Genius Sports, we are pioneering a new era in sports engagement by combining advanced technology with the highest quality live data. Our goal is to create immersive, interactive, and personalized experiences for sports fans around the globe. Learn more about us here. geniussports.com.Position Overview - Senior Software Engineer, Data PlatformWe are seeking a Senior Data Platform Engineer to architect and scale the core systems that underpin our data ecosystem. In this pivotal role, you will lead the design and modernization of our data infrastructure, empowering teams throughout the organization to swiftly, reliably, and securely access and utilize data. You will spearhead significant platform initiatives from inception to production, carefully navigate architectural decisions, and closely collaborate with product teams and cross-functional stakeholders to drive engineering strategy.This role is perfect for a technically adept leader with extensive experience in distributed systems, modern data lakehouse and streaming architectures, and large-scale data operations. A strong passion for mentorship, technical excellence, and creating systems that yield substantial business impact is essential.Key ResponsibilitiesDesign, construct, and oversee the foundational systems and features of the Data Platform, facilitating internal teams' ability to access and utilize data efficiently and securely.Lead the modernization of our data infrastructure while managing technical complexities and making informed architectural decisions to enhance our foundation and boost organizational productivity.Act as a technical leader for extensive Data Platform initiatives, influencing architectural choices and engineering direction in collaboration with product and cross-functional teams.Mentor junior and mid-level engineers, enhancing their skills and preparing them for greater responsibilities.Stay informed on emerging technologies and industry advancements in data systems and platform development.

At Authentic Insurance, we empower insurance brokers to develop exceptional insurance products tailored to the needs of their clients. Our innovative technology platform and comprehensive support enable brokers to create custom insurance solutions for specific industries and customer segments. Essentially, we serve as the backbone of these specialized insurance offerings, allowing brokers to provide unique products that set them apart from competitors. This not only enhances their revenue potential but also minimizes the time spent on administrative tasks and paperwork. We take on the complexities of technology, compliance, and partnerships with top-rated insurance carriers, enabling brokers to concentrate on delivering unparalleled service to their clients and expanding their businesses.Key ResponsibilitiesLead the design and execution of data pipelines and infrastructure that fuel underwriting models, claims processing, and operational reporting, overseeing the process from initial problem identification to final delivery.Manage the data warehouse architecture, making informed decisions that optimize analytical performance, meet operational demands, and ensure long-term scalability.Establish technical standards and best practices for data modeling, pipeline development, and data quality across the engineering team.Identify and resolve bottlenecks in the data stack, developing solutions that enhance reliability, reduce latency, and support business growth.Collaborate with engineering, product, and operations teams to understand data requirements and translate them into effectively designed systems.Create monitoring, alerting, and data quality frameworks to proactively identify issues before they affect downstream users.Promote data governance practices, including documentation, lineage tracking, and access controls to meet regulatory and compliance standards.Mentor and guide team members, fostering their technical growth and encouraging a sense of ownership.

Vendelux is revolutionizing the way organizations discover, evaluate, and leverage the power of events.Event marketers play a crucial role in driving pipeline growth and brand visibility, yet events often remain one of the least optimized and most opaque marketing channels. Vendelux aims to change this dynamic. We offer a comprehensive system of record for event marketing, empowering teams with the data and insights necessary to make informed, strategic decisions.Our AI-driven platform provides exclusive insights across over 250,000 events, enabling high-growth companies to pinpoint where their ideal customers will be, optimize ROI, and transform events into scalable growth channels. Customers frequently describe Vendelux as an essential tool for event marketers. A significant aspect of this success is our expanding network of partnerships with event organizers, who share first-party attendee and sponsorship data in exchange for valuable market insights.Additionally, Vendelux Meetings empowers customers to translate event insights into actionable strategies, leveraging AI to identify high-value attendees and automatically schedule one-on-one meetings with the right prospects at conferences. This process enhances pipeline generation and ensures that every event has a substantial impact.Founded in 2021, Vendelux is a Series A SaaS company backed by prominent investors, including FirstMark, with a recent funding round of $14 million. Our team comprises professionals with experience from notable companies such as Bain, ZoomInfo, Shutterstock, Compass, Forter, Airbnb, and more.We seek a Senior Software Engineer, Data & AI who thrives at the intersection of software engineering, data engineering, and applied AI to construct production-grade systems. You will be responsible for developing, deploying, and scaling features that are integral to our product. This position is ideal for someone who prioritizes impact over method, enjoys tackling data challenges using diverse approaches, and is eager to see their work shape the user experience.Key ResponsibilitiesDesign & Build AI-Powered Features: Architect, implement, and deliver data-driven product features, with a primary focus on addressing customer problems. From prototyping to production, you will apply the appropriate level of technology, whether straightforward heuristics or advanced AI, to create impactful solutions.Build for Production: Create maintainable and scalable systems, including writing clean, testable code, integrating with new and existing data pipelines, and deploying solutions and services within cloud environments.

Pearlyplan is an innovative B2B SaaS and payments provider, boasting a strong product-market fit and a cutting-edge technology stack. With over 2,500 dental offices utilizing our platform, we are on an exciting growth trajectory, consistently delivering features that benefit millions of users.In this pivotal Senior Engineer role, you will take full ownership of Pearlyplan's data platform encompassing architecture, infrastructure, and code development, utilizing production-grade TypeScript and SQL. Your contributions will extend across our broader codebase, including payments, workflows, and CI/CD, where you will act as a reliable mentor and reviewer for the team. From day one, you will be empowered to harness AI tools, adapting with the technology as we transition toward an AI-centric software development lifecycle.If you are a dedicated builder who values ownership and sets a high standard through your work, eager to help shape our strategies in this dynamic landscape of large language models, this is the opportunity for you.Our Development ApproachWe adhere to strict standards of TypeScript, leverage Cloud PostgreSQL, employ Serverless Functions, Terraform, React, GraphQL, Docker, and GitHub Actions, ensuring robust test coverage across unit, integration, and end-to-end tests.Every engineer is encouraged to explore cutting-edge AI tools, such as Claude Code, Cursor, MCP, and Bugbot, as we maintain a realistic perspective on the capabilities of large language models, continuously delivering value. Our specifications are driven by human insight, collaboratively authored with AI, and reviewed meticulously before deployment.Your ResponsibilitiesData Platform OwnershipOversee Pearlyplan's data systems comprehensively, including Postgres warehouse and OLTP infrastructure, ETL pipelines (both bulk and real-time), as well as data products and APIs.Lead the design of overall data architecture, ensuring harmonization across the platform by creating systems, abstractions, and algorithms that consolidate data from various EHRs, payment processors, and external vendors into a scalable and coherent structure.Make informed data modeling decisions with a strong emphasis on performance, observability, and operational excellence.Manage vendor SDK integrations and maintain technical relationships with vendors.Code Quality and Broader Platform ContributionsContribute across the entire application stack (frontend/backend/db) in various domains, including payments, outreach automation, reporting, and internal tooling.Lead by example, guiding both human engineers and AI agents toward excellence through mentorship, thorough documentation, and rigorous code reviews. You will serve as a trusted final reviewer across all areas of the codebase.

Join Our Growth Team!Seize the opportunity to be part of Enigmaio's dynamic Growth Team as we innovate sales and marketing solutions tailored for small businesses. We are in search of a seasoned Software Engineer to craft and enhance data products and systems that have a direct influence on our clients, driving both their success and ours. Your contributions will shape decisions for organizations employing a significant portion of the U.S. workforce, delivering immense value.Your RoleAs a vital member of our Growth Team, you will:Design and implement data products that address key customer challenges while creating scalable, high-quality systems for engaging with our data.Collaborate with software engineers, data scientists, and product managers to create a seamless customer journey from discovery to purchasing.Analyze extensive datasets to extract insights and build robust, maintainable data solutions.Develop scalable systems deployed in cloud environments.Take ownership of architectural and design decisions, ensuring compelling customer experiences with minimized operational costs.Your ResponsibilitiesAct with decisiveness, delivering value in the short, medium, and long term.Engage actively with product teams to resolve customer issues in a systematic way.Utilize a principled, metrics-driven approach to tackle complex data challenges, showcasing excellence in analytics and engineering.Foster a transparent, collaborative environment, embracing constructive feedback and diverse perspectives.Exhibit a proactive attitude and thrive in a collaborative, cross-functional team essential to our company’s success.Eagerly assume responsibility for architectural and design decisions while actively participating in implementation.Why This Role Excites YouImpact: Build innovative data-driven solutions that effectively resolve high-value customer issues.Technical Challenge: Confront intricate data and engineering challenges, balancing customer impact with reliability, scalability, and data quality.Multifaceted Role: Engage in diverse projects that contribute significantly to our growth and success.

Join our dynamic team at Camber as a Senior Software Engineer specializing in Data. In this pivotal role, you will be responsible for designing, developing, and optimizing data-driven applications that enhance our core services and drive innovation. You will work on cutting-edge technologies and collaborate closely with cross-functional teams to deliver impactful solutions that meet our client’s needs.

About Us:At Parabola, we empower teams to transform and streamline complex data workflows with ease. Our innovative workflow builder allows users to automate tasks that were previously manual, including data from PDFs, emails, and spreadsheets. Forward-thinking companies such as Brooklinen, On Running, and Flexport leverage Parabola to enhance their productivity and tackle ambitious projects. Our platform enables teams to automate processes, saving valuable time and resources, all without requiring extensive engineering support.Supported by prominent investors like OpenView Partners, Matrix Partners, and Thrive Capital, we are committed to continuous innovation and growth.About the Role:As a Senior Site Reliability Engineer, you will be integral to our dynamic team, focusing on measuring and enhancing the performance of our software systems. Your role will encompass critical aspects such as performance optimization, security compliance, and foundational architecture. With our compact team structure, your contributions will significantly impact our operations and customer satisfaction.What You Will Do:Oversee the monitoring of our core software systems, both during on-call scenarios and in routine operations, to establish and refine service-level objectives (SLOs) and agreements (SLAs).Enhance and monitor our infrastructure stack, ensuring it meets the demands of our business-critical services.Maintain a comprehensive mental and documented model of our systems to effectively assess risks, plan projects, and troubleshoot issues.Engage with the engineering team and leadership, providing insights from your expertise in site reliability and advocating for best practices.Contribute to the development of our core orchestration logic, which supports the efficient execution of thousands of workflows concurrently, utilizing our new orchestration built on Temporal.Support multiple backend engineering projects during planning and execution phases, joining as needed for hands-on development.Focus on optimizing service scalability, stability, and observability.

At Authentic Insurance, we empower insurance brokers to develop superior insurance products tailored for their clients. Leveraging our cutting-edge technology platform and comprehensive support, brokers can craft customized insurance solutions aimed at specific industries or customer segments. We act as the operational backbone for these specialized insurance offerings, enabling brokers to provide unique products that set them apart from their competitors. This results in increased earnings and reduced administrative burdens, allowing brokers to focus on customer service and business growth. Our expertise encompasses intricate areas such as technology integration, compliance, and partnerships with top-rated insurance carriers.Key ResponsibilitiesDesign and implement robust data pipelines and infrastructure that support underwriting models, claims processing, and operational reporting.Take ownership of data models from inception through transformation to delivery, ensuring high standards of data quality, freshness, and accessibility for internal teams, product features, and external partners.Identify and resolve bottlenecks in existing data workflows, implementing solutions that enhance reliability, reduce latency, and scale with business growth.Develop and maintain data warehouse architecture optimized for both analytical and operational use cases.Collaborate with engineering, product, and operations teams to assess data requirements and translate them into effectively designed pipelines and models.Establish monitoring, alerting, and data quality checks to proactively identify issues before they affect downstream users.Contribute to data governance initiatives, including documentation, lineage tracking, and access management to meet regulatory and compliance standards.

At Genius Sports, we harness next-gen technology and the most accurate live data to usher in a new age of sports for fans globally, providing them with more immersive, interactive, and personalized experiences than ever before. Discover more at geniussports.com About the RoleWe are seeking talented Software Engineers eager to embrace continuous learning and take full ownership of their tools and products, adhering to best practices in Agile Software Development. We believe that a proficient engineer can transition between projects and acquire new skills effortlessly if driven by passion. Don’t let your current programming language or framework deter you from applying!Your technical expertise and pragmatic approach to problem-solving will be essential as you collaborate with a team prioritizing Agile delivery and ongoing improvement. You will adopt a data-driven mindset, comfortable with continuous experimentation and validation.Key ResponsibilitiesDesign, develop, and maintain data processing applications and services utilizing Spark, Java, and Kotlin.Construct and manage ETL pipelines and Data Processing architectures.Implement and oversee relational databases, ensuring data integrity and optimal performance.Enhance applications for peak speed and scalability.Produce clean, maintainable, and efficient code.Diagnose and rectify application issues.Keep abreast of emerging technologies and industry trends.QualificationsDemonstrated experience as a Software Engineer.Proficiency in at least one distributed columnar data store (e.g., Spark, Hive, Redshift, Presto, Snowflake).Proficiency in a compiled language (Java, Scala, Kotlin, Python).Strong comprehension of relational databases (MySQL, PostgreSQL).Familiarity with version control systems (e.g., Git).Excellent analytical skills and attention to detail.Able to work independently as well as part of a team.Exceptional communication skills.

Join Hinge: The Dating App Designed for Lasting ConnectionsIn an age where meaningful relationships are increasingly elusive, Hinge is dedicated to fostering intimate connections that combat loneliness. Our team is passionate about analyzing user behavior to enhance the dating experience, with our ultimate success measured by the number of successful dates we facilitate. With a global user base in the millions, Hinge has become the premier app for those seeking meaningful relationships.Role Overview: As a Senior Data Engineer at Hinge, you will play a vital role in developing key data processes and contributing to a cutting-edge data pipeline that supports our strategic decision-making. Your contributions will not only solve complex challenges but also empower our analytical teams, directly impacting the love lives of countless individuals. You will enhance core functionalities and implement essential data pipelines that serve both the Data Engineering team and the broader organization, all while tackling real-world problems within a big data architecture.

In the United States, the healthcare system is a leading cause of personal bankruptcy, impacting over 50 million Americans annually. With the rise of high deductible health plans, the financial burden associated with healthcare is becoming increasingly severe.At Cedar, our mission is to harness the power of data science, innovative product design, and personalization to enhance the affordability and accessibility of healthcare. We strive to move beyond the traditional ‘one-size-fits-all’ approach, utilizing consumer best practices to elevate the healthcare experience for all.The RoleWe are on the lookout for an experienced Software Engineer III to become a vital member of our Data Integration and Platforms team. In this position, you will play a key role in addressing the challenges of scalability, data quality, and insightful analysis as we expand our market presence and product offerings. Your responsibilities will include developing robust systems and technologies that empower our client-facing engineers to integrate with electronic health record systems, facilitate product engineers in leveraging partner data for analysis, and support data scientists in generating business insights to enhance product development and patient experiences. This team comprises engineers from various organizational sectors, and your mission will be to contribute towards a unified vision for our data, AI, and ML platform while adapting to the dynamic business landscape.Your Contributions Will Include:Advancing our integration data pipelines from custom ETL scripts to a modern, scalable data architecture utilizing tools such as dbt, Airflow, and Snowflake.Engineering solutions for scalability, enhancing the performance of our data pipelines to efficiently process millions of records daily while ensuring high quality and robust observability.Developing our data platform to support our most popular products, establishing a solid foundation for seamless data onboarding and experimentation.Collaborating closely with delivery engineering teams to enhance the quality, speed, and scalability of data integration with healthcare providers.Implementing rigorous software engineering practices in the data domain, including version control, automated testing (unit/integration), CI/CD, and structured logging/observability.

Join CGS as a Senior Data Engineer Employment Type: Full-Time, Mid-levelDepartment: Business Intelligence CGS Federal is actively looking for a dedicated and innovative Senior Data Engineer to enhance our expanding Data Analytics and Business Intelligence platform. Our focus is on providing impactful solutions that enable our federal clients to transform data into actionable insights. The ideal candidate will be a proactive problem solver and lifelong learner, eager to explore diverse technologies while tackling some of the most challenging issues faced by our clients.At CGS, we unite driven, highly skilled, and inventive individuals to address the government's most pressing challenges through state-of-the-art technology. We seek candidates who are enthusiastic about contributing to governmental innovation, value teamwork, and can anticipate the needs of others. Our work environment fosters support and encourages professional development through various learning opportunities. Key Responsibilities:- Develop comprehensive data pipelines to efficiently manage and provision data to stakeholders.- Collaborate actively within an Agile/Scrum team, adhering to best practices.- Write robust code to ensure optimal performance and reliability in data processing and extraction.- Drive automation processes for seamless data ingestion.- Uphold technical excellence by following lean-agile engineering principles, including API-first design and automated testing.- Engage with program management and technical teams to document evolving requirements.- Foster a culture of exceptional customer service, innovation, collaboration, and teamwork.- Work in a cross-functional team including UX researchers, designers, product managers, engineers, and specialists.Qualifications:- Must be a U.S. Citizen.- Ability to obtain a Public Trust Clearance is required.- At least 7 years of IT experience, particularly in the design and management of substantial data sets and models.- Proven experience in developing data pipelines from a variety of structured and unstructured data sources.- Proficient in ETL processes, including testing and validation steps.- Strong skills in data manipulation using Python, R, SQL, or SAS.- In-depth knowledge of big data analysis and storage solutions.

Join the City of New York as a Senior Data Engineer, where your expertise in data engineering will drive impactful decisions and enhance city services. You will collaborate with cross-functional teams to design, build, and maintain robust data pipelines, ensuring data integrity and accessibility for analytics.

At Peregrine Technologies, we are backed by prominent Silicon Valley investors and are committed to aiding public safety organizations, state and local governments, federal agencies, and private-sector institutions in meeting society's challenges with remarkable speed and precision. Our cutting-edge AI-enabled platform converts fragmented and isolated data into actionable operational intelligence, providing immediate access to crucial information that empowers swift and informed decision-making, enhancing outcomes across all interactions. Presently, Peregrine serves hundreds of clients across over 30 states and two countries, benefiting more than 125 million people, and we are on a mission to expand our impact globally.TeamWe believe that empathy is essential in crafting superior solutions. Understanding how users interact with our products is a priority, allowing us to arrive at the best answers effectively. Engineers will closely collaborate with our onsite team to comprehend the diverse use cases that Peregrine addresses.We are actively seeking a Data Governance Engineer to join our dynamic engineering teams, tackling a variety of challenges, from facilitating real-time user collaboration on intricate maps to constructing high-scale backend architectures capable of processing billions of data points.The Data Governance team is responsible for developing services, systems, and product features that enable our customers to manage their data assets throughout their lifecycle within the Peregrine platform. We ensure robust, secure data access and comprehensive audit capabilities.RoleAs a Software Engineer on our expanding team, you will enjoy significant ownership over our technology stack. You will play an integral role in designing and constructing the next iteration of our core access control and governance systems, which manage access to over 7 billion data points within Peregrine's multi-tenant data platform. Your work will involve implementing fine-grained permissions, audit functionality, policy enforcement, metadata management, data labeling, and compliance across the platform.You will collaborate closely with Product Managers to guide projects from conceptualization to design and execution. Your design and development of data governance features will involve making thoughtful trade-offs to achieve an optimal balance between security and user experience.Our technology stack is continually evolving, built on a robust backend foundation comprising Python, Django, Celery, Airflow, and Kafka, with a frontend developed using React, Redux, and Mapbox. We utilize data stores including PostgreSQL and Elasticsearch, and host machine learning models on Bedrock and Sagemaker, while leveraging AWS, Pulumi, Terraform, and Kubernetes as our foundational infrastructure.

About Clear Street:At Clear Street, our mission is to empower sophisticated investors with access to every asset across all markets through a seamless and unified platform designed for speed, transparency, and scalability.We provide our clients with cutting-edge technology, innovative tools, and exceptional service that were once exclusive to the largest financial institutions, all constructed on a modern infrastructure. Our comprehensive, cloud-native, end-to-end capital markets platform fuels investor growth today while revolutionizing their market interactions for tomorrow.For further details, please visit https://clearstreet.io. The Team:The FACT team is at the forefront of developing key data products that enable Clear Street’s systems and personnel to function with precision and efficiency. These products encompass security and pricing masters, corporate actions, and streaming market data, along with various essential reference datasets. The FACT team meticulously gathers inputs from a multitude of sources, including vendors, public channels, and internal units, curating them into comprehensive data products that serve as the definitive source of reference data within the organization. FACT Team Stack: C++, Rust, Go, Java, Python, gRPC, PostgreSQL, Snowflake, Kafka, Kubernetes The Role:We are seeking a talented and experienced Software Engineer to join our dynamic team, focused on constructing high-performance, real-time data pipelines to process financial market data, including security prices across various asset classes such as equities, options, futures, and more. In this pivotal role, you will be instrumental in designing, developing, and optimizing data pipelines capable of handling substantial volumes of data with minimal latency and maximum throughput, ensuring our systems can efficiently process and deliver market data in real-time.

At Angi®, our mission for the past 30 years has been simple: to ensure that jobs are done right. We connect homeowners with trustworthy professionals who possess the necessary skills, while simultaneously linking these pros with homeowners seeking the jobs they desire.Angi at a glance:Homeowners have relied on Angi for over 300 million projects.We cover more than 1,000 home service tasks.Our team consists of 2,800 dedicated employees worldwide.Why join Angi:Angi® is on a mission to redefine the home services industry, fostering an environment where homeowners, professionals, and employees all benefit from a greater number of jobs completed successfully.For homeowners, our platform offers a dependable way to locate skilled professionals. For professionals, we act as a trustworthy business partner, helping them discover the work they want when they want it. For our employees, we provide an exceptional workplace that they can proudly call home. We look forward to welcoming you!About the team:We are currently searching for a Senior Data Engineer to join our Data Infrastructure team. This individual will play a pivotal role in constructing and managing the foundational platforms that facilitate data processing, storage, and analytics throughout our organization. The focus of this role will be on advancing our lakehouse architecture, data replication systems, and orchestration frameworks, all while ensuring scalable, reliable, and efficient data workflows.Please note, although this role is remote, we are a global company seeking candidates located in the Eastern Time Zone to align with our team's working hours.

At Justworks, we foster a collaborative and laid-back work environment where innovation thrives. As a Senior Software Engineer, you will take ownership of significant projects, work alongside talented teams, and contribute to solutions that enhance customer experiences. Your role will focus on building and maintaining robust applications while ensuring the security and efficiency of our systems.