Senior Data Engineer - Informatica & PySpark Expertise

We are in search of a highly skilled and innovative Data Engineer to join our dynamic team. As a pivotal technical leader, you will:Be the go-to expert in your team, guiding projects with your technical acumen.Conquer complex challenges that others find daunting.Deliver intricate features at an unparalleled pace.Produce exceptionally clean and maintainable code.Enhance the quality of our entire codebase.If you're an exceptional developer with a proven track record, we want to hear from you! This role requires a unique blend of skills and experience, designed for the best in the field.Responsibilities:Develop, optimize, and scale data pipelines and infrastructure utilizing technologies such as Python, TypeScript, Apache Airflow, PySpark, AWS Glue, and Snowflake.Design, operationalize, and oversee ingestion and transformation workflows, including DAGs, alerting, retries, SLAs, lineage, and cost controls.Partner with platform and AI/ML teams to automate ingestion, validation, and real-time compute workflows, contributing towards a feature store.Integrate pipeline health and metrics into engineering dashboards for enhanced visibility and observability.Model data and execute efficient, scalable transformations using Snowflake and PostgreSQL.Create reusable frameworks and connectors to standardize internal data publishing and consumption.

We are on the lookout for an exceptional Data Engineer, a technical leader who thrives on challenges and excels in coding. If you are the person who:Acts as the definitive technical authority within your teamSolves complex technical problems with easeDelivers intricate features at a remarkable speedWrites code that exemplifies best practices and clarityIs dedicated to enhancing the overall quality of the codebaseThen we want to hear from you!We are not looking for just anyone; we want developers who are confident in their skills and have proven their excellence.What you will be responsible for:Designing, optimizing, and expanding data pipelines and infrastructure leveraging Python, TypeScript, Apache Airflow, PySpark, AWS Glue, and Snowflake.Creating, operationalizing, and monitoring data ingestion and transformation workflows including DAGs, alerting mechanisms, retries, SLAs, lineage, and cost management.Partnering with platform and AI/ML teams to streamline ingestion, validation, and real-time compute workflows; contributing towards the development of a feature store.Incorporating pipeline health metrics into engineering dashboards to ensure complete visibility and observability.Modeling data and executing efficient, scalable transformations within Snowflake and PostgreSQL.Establishing reusable frameworks and connectors to standardize internal data publishing and consumption.

We are seeking a top-tier Data Engineer to join our team at wizdaa. If you are a developer who excels in:Leading your team with technical expertiseResolving complex challenges that others find difficultDelivering intricate features at an accelerated paceCreating exceptionally clean and maintainable codeEnhancing our codebase with pride and diligenceYour skills and experience will help us drive efficiency and innovation in data processing.Key Responsibilities:Develop, enhance, and scale data pipelines and infrastructure utilizing Python, TypeScript, Apache Airflow, PySpark, AWS Glue, and Snowflake.Design, implement, and monitor data ingestion and transformation workflows, ensuring optimal performance and reliability.Work collaboratively with platform and AI/ML teams to automate data workflows and develop a comprehensive feature store.Integrate health metrics into engineering dashboards for enhanced visibility and operational insight.Model data and execute scalable transformations in Snowflake and PostgreSQL.Create reusable frameworks and connectors to streamline internal data processes.

Are you an exceptional Data Engineer with a flair for problem-solving and a passion for optimizing data processes? At pridelogic, we are on the lookout for a technical powerhouse to join our innovative team. If you pride yourself on being the technical leader who consistently delivers complex features ahead of schedule, and you write code that stands as an example for others, we want to hear from you!This position is designed for those who know they are extraordinary in their field. We seek developers with a proven track record of success in data engineering.Your Responsibilities:Develop, optimize, and scale data pipelines and infrastructure utilizing technologies such as Python, TypeScript, Apache Airflow, PySpark, AWS Glue, and Snowflake.Design, implement, and monitor data ingestion and transformation workflows including DAGs, alerting systems, retries, SLAs, lineage, and cost management.Collaborate with platform and AI/ML teams to automate ingestion, validation, and real-time compute workflows, aiming towards a feature store.Enhance engineering dashboards with pipeline health metrics and observability features for comprehensive insight.Model data and execute efficient, scalable transformations in Snowflake and PostgreSQL.Create reusable frameworks and connectors to standardize internal data publishing and consumption processes.

About the Role qodeworld is hiring a Senior Data Engineer with deep experience in Informatica and PySpark. This position focuses on building and optimizing data solutions for large-scale analytics. The role is based in either Cleveland, OH or Pittsburgh, PA and requires onsite work three days per week. Main Responsibilities 8–10 years of experience in data engineering and data analysis. Hands-on expertise with Informatica PowerCenter and Informatica Data Quality (IDQ) for ETL design, development, and optimization. Advanced proficiency with PySpark for processing, transforming, and analyzing large datasets. Strong knowledge of Hadoop technologies, including HDFS, Hive, Sqoop, and MapReduce. Solid programming skills in Python and Kafka to build both streaming and batch data pipelines. Thorough understanding of database concepts, data modeling, data design, and ETL workflows. Experience across all phases of the ETL lifecycle: data extraction, ingestion, quality checks, normalization, and loading. Comfort working in Agile environments, using tools such as Jira to support project delivery. Proven background in client-facing roles, with strong communication and leadership skills to manage the software development lifecycle. Preferred Skills Familiarity with AWS data components and analytics. Understanding of machine learning models and AI concepts. Experience with data modeling tools like Erwin. Qualifications Bachelor’s or Master’s degree in Computer Science or a related discipline. Strong problem-solving skills and a collaborative approach to cross-functional teamwork.

Capstone Integrated Solutions is hiring a Senior Data Engineer with a focus on AWS. This position is fully remote. Role overview This role centers on designing and building data pipelines using AWS tools and services. The Senior Data Engineer will work with teams across the company to make sure data remains accurate, reliable, and accessible. In addition, the position involves contributing to data architecture decisions and promoting engineering best practices. Collaboration and team approach The team values practical solutions and close collaboration. Colleagues from different functions work together to deliver data systems that help the company meet its goals. What you will do Design and build data pipelines with AWS services Partner with teams to ensure data quality and accessibility Influence data architecture and engineering standards

We are seeking a highly skilled Manager of Data Engineering to lead our data engineering projects at dev2. This is a unique opportunity to work in a hybrid environment where you can collaborate with a talented team while having the flexibility to work remotely. You will be responsible for designing, building, and maintaining our data architecture using technologies such as Python, AWS, Airflow, and Snowflake. Your leadership will guide the successful execution of data strategies and ensure the availability of high-quality data for analysis and decision making.

dev2 is seeking an experienced and innovative Data Engineering Manager to lead our data engineering team in a hybrid work environment. In this role, you will be responsible for overseeing the design, development, and implementation of scalable data pipelines and architecture using technologies such as Python, AWS, Airflow, and Snowflake. Your leadership will drive the data strategy and empower the team to enhance data availability and quality.

Join dev2 as a Manager of Data Engineering, where you will lead a talented team in designing and implementing data solutions using cutting-edge technologies such as Python, AWS, Airflow, and Snowflake. This hybrid role allows you to enjoy a flexible work environment while collaborating closely with stakeholders to drive data initiatives that enhance business operations.Your expertise will help shape data strategies that promote efficiency and innovation within our organization. If you're passionate about data engineering and leadership, we want to hear from you!

Mactores has established itself as a frontrunner in delivering innovative data platform solutions since 2008. We empower businesses to unlock their potential through automated, agile, and secure End-to-End Data Solutions. Collaborating closely with our clients, we strategize and guide them on their digital transformation journey, whether through assessments, migrations, or modernization efforts.Mactores is on the lookout for a Senior AWS Data Engineer to enhance our dynamic team. The ideal candidate will possess a profound expertise in PySpark and SQL, coupled with hands-on experience in managing data pipelines utilizing Amazon EMR or Amazon Glue. Proficiency in data modeling and end-user querying via Amazon Redshift or Snowflake, along with familiarity with Amazon Athena, Presto, and orchestration tools such as Airflow, is essential for this role.

Our Mission:Join us as a Full Stack Product Engineer at AthenaHQ, where we empower global brands through our cutting-edge AI Search platform.We seek an engineer who thrives on product ownership.Work with state-of-the-art technologies, engage directly with customers, and play a key role in shaping our technical architecture and tooling choices.Your day will involve iterating based on customer feedback, scoping new product features, and proactively addressing customer challenges.Technical Stack:Frontend: Next.js App Router, React 19, Motion, Tailwind CSS, and Radix PrimitivesBackend: Node.js, Temporal, Kubernetes, PostgreSQL, OLAPKey Outcomes:Deliver full-stack product features utilizing Next.js and TypeScriptCraft clean and effective database schemas and queriesEstablish durable Temporal workflows for intricate business logicCreate responsive and accessible UI componentsPrioritize performance and user experienceInfluence architectural and technology decisionsCore Competencies:Proficient in Next.js and TypeScriptExperience in building and shipping production applicationsFamiliar with contemporary CSS/UI frameworksUnderstanding of distributed systemsDemonstrates humility while taking pride in workBonus Qualifications:Experience with TemporalFamiliarity with marketing technology and content management systems (CMS)

Join dev2 as a Data Engineering Manager, where you will lead a dynamic team in harnessing the power of data to drive strategic decisions and innovations. In this hybrid role, you will be responsible for overseeing data engineering projects, ensuring the implementation of best practices in data management and cloud solutions using technologies such as Python, AWS, Airflow, and Snowflake.Your leadership will guide the team in developing scalable data pipelines, optimizing data architecture, and enhancing data quality. Collaborate with cross-functional teams to align data solutions with business objectives, while mentoring junior engineers and fostering a culture of continuous learning.

We are seeking a talented and experienced Data Engineering Manager to lead our data engineering team at dev2. In this hybrid role, you will be responsible for overseeing the development and implementation of robust data pipelines and architectures using Python, AWS, Airflow, and Snowflake. Your expertise will help drive data-driven decision-making across the organization.

Join dev2 as a Manager of Data Engineering where you will lead a talented team in designing and implementing data solutions leveraging Python, AWS, Airflow, and Snowflake. This hybrid role offers the flexibility of working remotely while collaborating with your team on-site.In this dynamic position, you will be responsible for guiding the data engineering team through complex data challenges, ensuring optimal performance, and driving innovation in our data architecture. Your leadership will be crucial in fostering a collaborative environment that encourages creativity and efficiency.

About Us:At Parafin, our mission is to empower small businesses, the backbone of our economy. Traditional banks often overlook their needs, but we provide technology that simplifies access to essential financial tools directly through the platforms they already use for sales. We collaborate with industry leaders such as DoorDash, Amazon, Worldpay, and Mindbody to deliver fast and flexible funding, spend management, and savings tools seamlessly integrated into their services. By handling the complexities of capital markets, underwriting, servicing, compliance, and customer support for our partners, we enable small businesses to thrive.Our team is composed of innovators from top companies including Stripe, Square, Plaid, Coinbase, and Robinhood. Together, we share a passion for developing tools that drive success for small businesses. Backed by notable venture capitalists like GIC, Notable Capital, Redpoint Ventures, Ribbit Capital, and Thrive Capital, Parafin is a Series C company that has successfully raised over $194 million in equity and $340 million in debt facilities.Join us in creating a future where every small business has access to the financial resources they need to succeed.About the Position:We are seeking an experienced software engineer to join Parafin’s Infrastructure team and take the lead in developing our next-generation Data Platform. This pivotal role ensures that our data infrastructure remains reliable, scalable, and user-friendly, as we continue enhancing financial services for small businesses.As a Senior Software Engineer, your responsibilities will include designing, building, and maintaining systems for data ingestion, transformation, and delivery across the organization. You will closely collaborate with Data Science, Platform Engineering, and Product Engineering teams to facilitate data-driven product development and informed decision-making.What You’ll Do:Design and construct robust, highly scalable data pipelines and lakehouse infrastructure using PySpark, Databricks, and Airflow on AWS.Enhance the data platform development experience for Engineering, Data Science, and Product teams by creating intuitive abstractions, self-service tools, and comprehensive documentation.Manage and uphold core data pipelines and models that support internal dashboards, machine learning models, and customer-facing products.Oversee the Data & ML platform infrastructure via Terraform, including full administration of Databricks workspaces: manage user access, monitor performance, optimize configurations (e.g., clusters, lakehouse settings), and ensure high reliability.

Job OverviewJoin our dynamic team at qodeworld as an AWS Data Engineer. In this pivotal role, you will architect, develop, and sustain scalable data pipelines utilizing AWS technologies. Collaborate with technical analysts, client stakeholders, data scientists, and various team members to ensure the accuracy and integrity of data while optimizing storage solutions for both performance and cost-effectiveness. Your expertise with AWS native technologies and Databricks will be essential for efficient data transformations and processing.Key Responsibilities• Lead and support projects aimed at modernizing our data platform.• Design and implement robust, scalable data pipelines leveraging AWS native services.• Optimize ETL workflows to enhance data transformation efficiency.• Transition workflows from on-premise systems to AWS cloud, maintaining data quality and consistency.• Create automations and integrations to address data inconsistencies and quality concerns.• Conduct system testing and validation to ensure seamless integration and functionality.• Establish security and compliance measures within the cloud environment.• Validate data quality before and after migration, addressing issues related to completeness, consistency, and accuracy.• Collaborate with data architects and lead developers to document manual data movement and design automation strategies.Qualifications• A minimum of 10 years of experience in data engineering with a strong focus on AWS native technologies (AWS Glue, Python, Snowflake, S3, Redshift).• Proven ability to design and implement data pipelines and ETL processes.• Strong analytical skills and attention to detail for data quality assurance.• Experience in cloud migration strategies and automation of data workflows.• Excellent collaboration skills to work with cross-functional teams and stakeholders.

Join our innovative team at dev2 as a Data Engineering Manager where you'll lead initiatives in data architecture and engineering. In this hybrid role, you will harness your expertise in Python, AWS, Airflow, and Snowflake to drive strategic projects and enhance our data infrastructure. Your leadership will guide a talented team as we tackle complex data challenges and deliver high-quality solutions that empower our business decisions.

At CapTech, our Data Engineering consultants empower clients to construct and sustain sophisticated data systems that integrate data from diverse sources to facilitate informed decision-making. We specialize in developing pipelines and preparing data for utilization by data scientists, analysts, and other data systems. Our passion lies in problem-solving and delivering innovative solutions tailored to our clients' needs. As Cloud Data Engineers, we leverage the cloud infrastructure of our clients to provide immediate value and ensure scalability for future growth. We thrive in a collaborative environment, offering numerous opportunities to learn from and share insights with fellow developers, architects, and clients.Your Impact and Responsibilities:Serve as a trusted advisor to customers, offering best practices, methodologies, and technologies for implementing robust data engineering solutions.Design, implement, and maintain modern data pipelines that deliver optimal solutions using appropriate cloud technologies.Collaborate with product owners and business subject matter experts (SMEs) to analyze customer requirements and deliver sustainable engineered solutions.Provide technical leadership and collaborate across teams to ensure alignment of technical solutions with customer needs.Stay abreast of the latest cloud technologies, patterns, and methodologies; effectively communicate results and ideas to key stakeholders.

Build something to be proud of.Captivation Software has established a strong reputation for delivering timely, tailored solutions to our clients. Our dedicated team of engineers takes pride in their work, continuously innovating to provide the best possible outcomes. We are seeking talented software developers who are passionate about making a difference in our mission to protect our country. Position OverviewAs a Cloud Platform Engineer at Captivation Software, you will leverage your expertise in cloud technology (AWS), Python programming, and Linux systems to develop custom software components and integrate open-source solutions. Your work will focus on tackling complex time series analysis challenges using cutting-edge Big Data and Cloud technologies. The ideal candidate will work independently to identify and resolve issues while aligning with the strategic goals set by our architectural team. This position offers a hybrid work environment, collaborating with a dynamic team.