Lead Data Engineer at mark43 | Remote, New York City

Mark43 is authorized to hire in Canada, the UK, and 36 U.S. states, including Alabama, Arizona, California (excluding San Francisco), Colorado, Connecticut, Washington D.C., Florida, Georgia, Iowa, Idaho, Illinois, Indiana, Kansas, Massachusetts, Maryland, Maine, Michigan, Minnesota, Missouri, North Carolina, Nebraska, New Hampshire, New Jersey, New Mexico, New York, Ohio, Oklahoma, Oregon, Pennsylvania, South Carolina, Tennessee, Texas, Utah, Virginia, Vermont, Washington, Wisconsin, and West Virginia. Before applying to a remote role, please ensure that you are able to perform the position in one of the states listed above. State locations and specifics are subject to change as our hiring requirements shift. Applicants must be authorized to work for any employer in the country in which the role is being hired. We are unable to sponsor or take over sponsorship of an employment visa at this time.At Mark43, our mission is to empower communities and their governments with innovative technologies that enhance safety and quality of life for all. We create robust, scalable, and elegant software that sets a new benchmark for the tools relied upon by first responders. Our user base is diverse, and we are committed to fostering diversity of thought and experience within our team.We are seeking a Lead Data Engineer to become part of our dynamic team. This pivotal role requires a blend of technical leadership and hands-on execution. You will significantly influence the evolution of our data infrastructure while mentoring team members and collaborating cross-functionally to drive analytical innovation across the organization.

The City of New York is hiring a Data Engineer to support essential data projects that inform city decisions and strengthen public services. This full-time role is based in New York City and centers on using data analytics to address challenges across city operations. Role overview As a Data Engineer, you will play a key part in initiatives that shape how the city uses information to make choices and deliver services. The work involves collaborating with a team focused on improving processes and outcomes for residents. What you will do Contribute to projects that gather, organize, and analyze data for city departments Help translate complex data into practical insights for decision-makers Work with colleagues to find solutions that enhance city operations and public services Location This position is based in New York City and requires full-time availability.

Join the dynamic team at the City of New York as a Data Analyst. In this pivotal role, you will leverage data analytics to drive decision-making processes and optimize services for the citizens of New York. Your expertise will contribute to various projects aimed at enhancing operational efficiency and delivering impactful insights.

At Profound, we are dedicated to empowering organizations to effectively navigate and manage their AI presence. We are currently seeking a skilled Data Engineer to lead the development and enhancement of our data platform. In this role, you will be responsible for maintaining and optimizing our data pipelines, crafting innovative data ingestion processes, and addressing the data requirements of our product, data science, and go-to-market teams.This position is an excellent opportunity for individuals who thrive in working with cutting-edge data tools, enhancing system performance and reliability, and laying the groundwork for machine learning-driven functionalities.

Kontakt.io is at the forefront of revolutionizing care operations through our advanced platform. We are dedicated to minimizing waste, reducing costs, and enhancing revenue by optimizing asset utilization and boosting staff productivity. Our innovative platform leverages AI, Real-Time Location Systems (RTLS), and Electronic Health Record (EHR) data to power self-learning agents capable of automating workflows, adapting in real-time, and coordinating all aspects of care delivery operations. With seamless deployment and scalability, our solution provides unparalleled visibility into spaces, equipment, and personnel, thereby eliminating inefficiencies and elevating the patient experience. With a demonstrable 10X ROI and over 20 unique use cases, Kontakt.io is the preferred choice for enhanced and expedited care delivery operations.As the Data Platform Lead, you will be instrumental in architecting, constructing, and sustaining a robust, scalable data infrastructure. Your expertise in cutting-edge cloud and data technologies will facilitate real-time analytics, data ingestion, and machine learning applications. Your contributions will drive AI-enhanced automation, empowering healthcare facilities to increase efficiency, lower costs, and provide superior, timely care.If you are enthusiastic about developing scalable data systems, pioneering AI-driven automation, and transforming care delivery operations, we invite you to join Kontakt.io and be a part of reshaping the future of healthcare!

About QlooAt Qloo, we leverage extensive behavioral and catalog data to drive insightful recommendations across various sectors including entertainment, dining, travel, and retail. Our cutting-edge platform is constructed on a robust AWS data architecture, facilitating advanced analytics, APIs, and machine-learning models utilized by prominent brands. We are in search of a skilled Data Engineer to contribute to the enhancement and scaling of this innovative platform.Position SummaryAs a Data Engineer at Qloo, you will be instrumental in designing, constructing, and managing the data pipelines that aggregate information from external vendors, internal systems, and public sources into our S3-based data lake and related services. You will engage with AWS Glue, EMR (Spark), Athena/Hive, and Airflow (MWAA) to ensure that our data is precise, well-structured, and readily accessible for analytics, indexing, and machine-learning initiatives.You should feel confident managing end-to-end data workflows, encompassing ingestion, transformation, quality assurance, monitoring, and performance optimization.Key Responsibilities- Design, develop, and maintain batch data pipelines utilizing Python, Spark (EMR), and AWS Glue, transferring data from S3, RDS, and external sources into Hive/Athena tables.- Structure datasets in our S3/Hive data lake to facilitate analytics (Hex), API functionalities, Elasticsearch indexing, and machine learning models.- Create and manage workflows in Airflow (MWAA), handling dependency management, scheduling, retries, and alert notifications via Slack.- Establish robust data quality and validation mechanisms (schema validation, freshness/volume checks, anomaly detection) to ensure prompt issue identification through monitoring and alerts.- Enhance job performance for cost and efficiency (partitioning, file formats, join strategies, appropriate utilization of EMR/Glue resources).- Collaborate closely with data scientists, ML engineers, and application developers to comprehend data needs and design schemas and pipelines that address diverse use cases.- Contribute to internal tools and shared libraries to streamline, secure, and standardize interactions with our data platform.- Document pipelines, datasets, and best practices to ensure clear understanding and accessibility for the wider team.Required Qualifications- Bachelor's degree in Computer Science, Software Engineering, or a related discipline, or equivalent hands-on experience.- Proficient in Python and distributed data processing using Spark (PySpark) in EMR or a comparable environment.- Practical experience with key AWS data services, particularly: - S3 (data lake, partitioning, lifecycle management) - AWS Glue (jobs, crawlers, catalogs) - EMR or other managed Spark environments.

The City of New York seeks a PASSPort Data Analyst to support public service improvements through careful data analysis. This position centers on gathering, interpreting, and presenting data that informs city operations. Role overview The PASSPort Data Analyst examines complex datasets related to city services. The work involves identifying trends, generating reports, and helping teams understand how data can guide better decisions for New York City’s public programs. Community impact Analysis from this role directly influences decisions that affect residents and city operations. Projects handled by the PASSPort Data Analyst contribute to more efficient, effective services for New Yorkers.

Join Our Team as a Data Engineer! Are you ready to take your career to the next level? At FanDuel, we are seeking a passionate and skilled Data Engineer to join our dynamic data platform team. In this pivotal role, you will have the opportunity to design, build, and scale robust data infrastructure that drives analytics, machine learning, and critical business decisions across our organization. Your responsibilities will include taking full ownership of the design and delivery of secure, reliable, and cost-effective data platforms. Your work will empower data engineers, analysts, and data scientists to excel in their roles. As a key player in our team, you will collaborate closely with engineering, analytics, and security teams to enhance platform reliability, performance, and the overall developer experience for impactful data workflows at scale. Your strong engineering judgment will guide you in addressing ambiguous technical challenges, making architectural decisions, and contributing to the technical growth of the team. The ideal candidate is a seasoned engineer who thrives in a fast-paced, collaborative environment and is adept at managing complex systems end-to-end. If you are excited about building resilient data platforms and making a significant impact at a forward-thinking company, we want to hear from you!

At Endex, we are at the forefront of transforming financial services by integrating advanced AI technologies. Our goal is to develop the most sophisticated digital coworker for financial institutions, enabling teams of AI analysts to work seamlessly alongside expert analysts. We are seeking innovative minds to join us in this mission, collaborating closely with leading research labs.As a Data Engineer, you will play a critical role in establishing the data infrastructure that empowers our autonomous financial analysts. Your responsibilities will include designing and maintaining data pipelines that convert raw financial data into valuable insights for investment firms. You could be an ideal candidate if you...have experience building resilient data infrastructure capable of managing complex, time-sensitive data.are skilled in designing ETL pipelines and data models that facilitate intensive analytical workflows.value data integrity, testing, and monitoring highly.are passionate about the intersection of finance and data.Join us in revolutionizing financial analysis tools that will reshape the operational landscape for investment firms.

The City of New York is seeking a Data Scientist to help improve city services through data-driven insights. This role centers on analyzing large and complex datasets, building predictive models, and supporting city departments with clear, actionable findings. Role overview As a Data Scientist, the work involves examining diverse data sources, identifying trends, and translating raw information into practical recommendations. The position supports multiple city initiatives, providing analysis that informs policy and operational decisions. What you will do Analyze complex datasets from various city departments Develop predictive models to forecast trends and outcomes Deliver insights that help guide city programs and services Location This position is based in New York City.

Join Our Team as a Senior Data Engineer!Are you ready to take your career to the next level? FanDuel is seeking a Senior Data Engineer who will be instrumental in designing and building scalable, reliable, and high-performance data solutions that fuel analytics, machine learning, and business operations. As a hands-on contributor, you will play a significant role in establishing the core technical foundation of our data ecosystem.You will collaborate with a diverse team of engineers, analysts, product managers, and data scientists to create data pipelines and platforms that lead to impactful business results. The ideal candidate possesses excellent problem-solving abilities, is a strong team player, and brings both technical expertise and a collaborative spirit to every challenge.If you're excited about the prospect of working in a dynamic environment and tackling innovative challenges, we want to hear from you!Key Responsibilities:Build & Maintain Data Infrastructure: Design, develop, and maintain scalable ETL/ELT pipelines to support various data products and operational systems. Work with large-scale, complex datasets ensuring data cleanliness, proper modeling, and accessibility across the organization.Deliver High-Quality, Reusable Solutions: Create modular, reusable data models and assets utilizing tools like Spark, dbt, or similar frameworks. Collaborate with stakeholders to transform business needs into reliable, production-ready data solutions while ensuring data quality and consistency.Contribute to Engineering Excellence: Advocate for software engineering best practices, including testing, version control, documentation, and code reviews. Engage in technical design discussions and architecture reviews, helping to evolve our data platform for improved performance and scalability.Collaborate & Communicate: Partner closely with data scientists, analysts, and product managers to ensure alignment and drive solutions that meet business objectives.

The City of New York seeks an Assistant Mechanical Engineer to join the Division of Property Management. This position plays a key part in maintaining and upgrading city building infrastructure. Role overview Work includes supporting the planning, design, and supervision of mechanical engineering projects. The focus is on improving systems and services across city properties. Key responsibilities Assist in developing plans and technical designs for mechanical systems in city buildings Support project oversight to ensure work meets standards and timelines Contribute to efforts that enhance building infrastructure and services Location This role is based in New York City.

Tabs stands at the forefront of innovation as an AI-native revenue platform tailored for contemporary finance and accounting teams. Our advanced solutions streamline the entire contract-to-cash lifecycle, encompassing billing, collections, revenue recognition, and reporting, thereby empowering teams to eliminate manual processes and expedite cash flow.Our esteemed clients, including Cursor and Statsig, trust Tabs to seamlessly generate invoices directly from contracts, facilitate real-time payment reconciliation, and ensure compliance with ASC 606.Founded in 2023, Tabs has successfully secured over $91 million in funding from renowned investors such as Lightspeed Venture Partners, General Catalyst, and Primary. Headquartered in New York, our team is composed of experts with deep knowledge in finance and AI.About the RoleAs our inaugural Data Engineer, you will be instrumental in constructing the foundational data infrastructure that fuels our internal KPIs, drives customer insights, and enhances our AI systems. Your primary objective will be to design and implement a robust data platform that supports our core metrics and prepares us for long-term analytical scalability.This position is ideally suited for an engineer with a proven track record of developing end-to-end data platforms and who seeks ownership over the complete data stack. You thrive in ambiguous settings and are committed to delivering tangible business outcomes.Key ResponsibilitiesArchitect and implement our inaugural scalable data warehouse/lakehouse to bolster KPIs.Develop and manage dependable data pipelines (batch and/or streaming) from application databases and third-party tools.Collaborate with leadership to convert business metrics into actionable data models and schemas.Establish and maintain data modeling standards and best practices.Implement monitoring, data quality checks, and observability for pipelines and core tables.Empower BI and data analysts with well-structured models and self-service friendly datasets.Document the data platform (lineage, definitions, contracts) and assist in creating a unified source of truth for metrics.

The City of New York is seeking a dedicated Surveyor to join our dynamic team. As a Surveyor, you will play a crucial role in land surveying, ensuring accuracy and compliance with city regulations. This position offers a unique opportunity to contribute to various city projects, enhancing the infrastructure and development of New York City.

Join Copia as a Lead Security Engineer, where you will play a pivotal role in safeguarding our digital assets and infrastructure. You will lead a team of talented engineers, implementing cutting-edge security measures and developing innovative solutions to protect our organization from cyber threats.In this role, you will be responsible for conducting security assessments, developing security protocols, and ensuring compliance with industry regulations. Your expertise will be crucial in identifying vulnerabilities and enhancing our security posture to mitigate risks effectively.

Join the dynamic team at the City of New York as a Scheduler, where you will play a vital role in organizing schedules and ensuring the efficient operation of city services. As a key player, you will collaborate with various departments to coordinate appointments, manage resources, and facilitate communication across teams.Your organizational skills will be paramount in maintaining streamlined operations, and your attention to detail will help to ensure that all scheduling needs are met effectively.

Join the vibrant legal team at the City of New York as a Paralegal. In this crucial role, you will support attorneys in various legal matters, conduct research, and prepare documents to ensure the smooth functioning of legal processes.

Join Our Team as a Data Platform EngineerFauna Robotics is seeking a talented Data Platform Engineer to help us construct the essential data systems that drive our robotics and machine learning initiatives. In this pivotal role, you will architect and implement the infrastructure necessary for the collection, storage, processing, and transformation of extensive data generated by our robots—including sensor telemetry, video streams, operational logs, and performance metrics.Collaboration is key, as you will work alongside our machine learning teams to ensure data is not only accessible but also well-structured and primed for training. Your contributions will empower research teams to innovate rapidly and allow operations teams to effectively monitor fleet performance as we scale.Key ResponsibilitiesDesign and develop scalable data pipelines for the ingestion and processing of robotics data (including sensor streams, video, telemetry, and logs).Maintain data storage solutions that are optimized for various data types and access patterns.Create tools and APIs that enable researchers and engineers to efficiently query and analyze large datasets.Develop real-time data processing systems for monitoring robot fleet performance.Construct and sustain data transformation pipelines that prepare robotics data for machine learning training.Work collaboratively with machine learning and robotics teams to ensure our data platforms evolve to meet their needs.Required Skills & QualificationsEducation: Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field, or equivalent practical experience.Work Experience: 3+ years in data engineering or data platform roles.Technical Expertise:Strong programming skills in Python and SQL.Experience with data processing frameworks (e.g., Spark, Flink, Kafka).Proficiency with data storage technologies (e.g., PostgreSQL, object storage).Experience with cloud data platforms (AWS, GCP).Strong understanding of distributed systems and data architecture principles.Preferred SkillsExperience with robotics or IoT data, including time-series, video, and point clouds.Familiarity with streaming architectures and real-time analytics.Knowledge of data governance best practices.

At Profound, we are dedicated to empowering organizations to comprehend and manage their AI landscape effectively. We are seeking a talented Software Engineer for our Data Platform team to architect, develop, and enhance the infrastructure that drives data initiatives across our organization.In this role, you will design scalable platforms and create tools and frameworks that support data scientists, analytics engineers, and machine learning engineers. You'll be instrumental in laying the groundwork for analytics, experimentation, and machine learning-driven features. This is an exciting opportunity for individuals who thrive on constructing resilient systems, tackling intricate technical challenges, and enabling teams through superior platform design.Key ResponsibilitiesDesign and develop platform infrastructure that caters to the needs of machine learning, analytics, and software engineers, along with data scientists throughout the organization.Create tools and frameworks for data ingestion, transformation, quality assurance, and observability.Architect robust and scalable systems utilizing technologies such as Snowflake, Clickhouse, AWS, dbt, and Dagster.Implement governance, access control, and data quality systems that grow alongside the organization.Facilitate MLOps by establishing infrastructure to support model development and deployment.Lead technical discussions regarding platform architecture, tool selection, and data management practices.Collaborate effectively with product, engineering, and data teams to identify needs and deliver impactful solutions.

About RebarRebar is revolutionizing the commercial HVAC, Electrical, and Plumbing supply industry by developing a cutting-edge operating system. Our AI-driven quoting engine is expanding across leading suppliers in North America, making measurement and evaluation crucial to our infrastructure.As a Data Analytics Engineer, your mission will be to construct systems that provide insights into our AI's performance in real-world scenarios—analyzing successes and failures, and assessing their influence on business outcomes. You will establish essential product metrics, create monitoring frameworks, and deliver both internal and customer-facing data products that convert raw model outputs into reliable intelligence.This role sits at the crossroads of AI evaluation, product analytics, and data-driven product development. You will not only develop innovative data products that enhance customer value but also track the real-world performance dynamics of our AI systems, informing internal teams and stakeholders for better decision-making. If you are passionate about building analytic infrastructures and measurement systems as well as addressing significant business questions, this position is tailored for you.Required QualificationsBachelor’s or Master’s degree in Computer Science, Data Science, or a related field.Proficient in Python, skilled in SQL, and experienced with Data Warehousing.Demonstrated experience handling large, real-world datasets and navigating ambiguous problem definitions.Proficient in writing modular, testable analytics code and familiar with version control environments.Ability to design meaningful metrics and evaluation frameworks for complex systems from the ground up.Experience in building data visualizations and dashboards.1–3 years of experience in analytics engineering, data science, or product analytics roles working with production data systems.Excellent communication skills for conveying quantitative insights to both technical and non-technical audiences.ResponsibilitiesDesign and develop data-driven product features utilizing Rebar’s historical datasets.Define, implement, and productionize metrics to monitor AI system performance over time, including automated tracking and monitoring of regressions and drift.Analyze model failure modes across documents, projects, customers, and time, communicating findings effectively...