Big Data Engineer - Hadoop & Cloud Analytics

Please note: This position ideally operates on a hybrid schedule in Charlotte, NC (Tuesday-Thursday in-office). Preference will be given to candidates currently residing in Charlotte, NC, or those willing to relocate.About the RoleLendingTree is excited to welcome a Snowflake & Data Platform Operations Engineer to our dynamic Platform Operations team. In this hands-on role, you will play a critical part in automating, scaling, and supporting our cloud-based data ecosystem utilizing Snowflake, as well as AWS and Azure services. Your focus will be on reducing operational overhead through Continuous Integration/Continuous Deployment (CI/CD), implementing robust monitoring solutions, and employing an automation-first engineering approach.Key ResponsibilitiesSnowflake Administration: Oversee environments, manage security policies (RBAC), and conduct performance tuning to optimize costs and query efficiency.Platform Automation: Design and maintain CI/CD pipelines for database deployments using GitLab along with tools such as Liquibase or Red Gate.Cloud Integration: Facilitate integrations between Snowflake and AWS/Azure services, including object storage, messaging, and serverless functions (Lambda/Azure Functions).Pipeline & Streaming Operations: Sustain batch and streaming architectures (Confluent Kafka), troubleshoot ETL/ELT failures, and ensure data observability.Security & Reliability: Implement logging, auditing, and IAM controls; engage in incident response and root cause analysis (RCA).Collaboration: Work closely with Data Engineering and stakeholders to translate business requirements into scalable technical solutions.

About Dataiku Dataiku provides a platform for building, deploying, and managing AI and analytics at scale. The company helps organizations design and operate analytics, machine learning, and AI agents with transparency and control. Dataiku connects the enterprise AI stack, supporting centralized governance and multi-vendor environments. Learn more on the Dataiku blog, LinkedIn, X, and YouTube. Role Overview Dataiku is hiring a Data Engineer II for the Enterprise Data and Analytics (EDA) team. This role focuses on delivering reliable data to drive analytics, AI, and insights for teams across the company. The Data Engineer II will play a central part in supporting the Data Platform, which serves centralized analytics, Generative AI engineering, embedded analytics teams, and self-service users. What You Will Do Contribute technical expertise to the Data Platform, working with Snowflake, Dataiku, and GitHub. Develop solutions using Python and SQL, with DataOps processes integrated into GitHub Actions and Dataiku. Collaborate with engineers from other teams to deliver solutions across various technical domains. Promote engineering best practices within the EDA team and the broader Analytics Community. Support analytics and AI initiatives for a wide range of stakeholders. What We Look For Experience with Snowflake, Dataiku, GitHub, Python, and SQL. Understanding of the software development lifecycle and DataOps methodologies. Strong collaboration skills and the ability to work across teams. Clear verbal and written communication. Analytical mindset and curiosity. Locations This position is open to candidates in the Netherlands (remote), Spain (remote), United Kingdom (remote), and the following US cities: Atlanta, Boston, Charlotte, Chicago, Cincinnati, Miami, Milwaukee, Minneapolis, Philadelphia, Raleigh, St. Louis, and Tampa.

Join our dynamic team at Prosidian Consulting as a Data Operations Coordinator. In this critical role, you will be responsible for managing and optimizing our data operations to ensure efficient data management practices. You will collaborate with cross-functional teams to streamline data processes and enhance data quality.

*This position is available for remote or hybrid candidates (preference for those on the East Coast), with hybrid options based in our New York, NY or Charlotte area offices. Candidates must be available to work during Eastern Standard Time hours. Bankrate is seeking a talented Senior Platform Engineer to join our dynamic team. In this pivotal role, you will be responsible for developing internal platforms, tools, and standards that empower our product engineering teams to deliver software reliably, consistently, and at scale. Our Platform Engineering team collaborates closely with product teams to define shared patterns, automate processes, and establish guardrails, enabling teams to take ownership of their deployments and services while leveraging a robust, secure, and well-supported platform foundation. This position lies at the intersection of software engineering, cloud infrastructure, and developer experience. You will concentrate on building systems that enhance reliability and productivity across the organization, rather than managing day-to-day deployments for individual teams.

Company OverviewAt Palmetto, we are a pioneering clean technology firm dedicated to expediting the shift towards a sustainable energy future. We believe in empowering consumers to have it all through innovative, scalable solutions that simplify the adoption of renewable energy. Our award-winning technology platform supports homeowners, businesses, and entrepreneurs in making environmentally responsible choices without sacrificing value. Operating in both B2B and D2C spaces, we provide comprehensive software, financial products, and services that drive significant environmental impact. Our holistic approach to home electrification places clean energy within everyone's reach.Our employees are our greatest asset. We nurture a culture of internal promotion that emphasizes talent development, career advancement, and work that is driven by purpose. Our extensive benefits package includes unlimited PTO, medical, dental, and vision coverage, paid parental leave, retirement plans, and much more—ensuring you can have it all both personally and professionally. At Palmetto, we prioritize people, planet, and profit, all backed by a culture that values collaboration, impact, and balance. Join us in our mission to create a brighter, cleaner world.Position LocationThis internship will be conducted in Charlotte, NC.Reporting StructureThe intern will report directly to the Customer Experience Manager.Internship OverviewPalmetto is looking for a driven, analytical, and inquisitive student to join our Customer Experience team for a summer internship. This role offers hands-on experience in analyzing customer and operational data to identify trends, uncover opportunities, and recommend enhancements that elevate the overall customer experience.The intern will collaborate closely with Customer Experience and Operations leaders to assess critical metrics such as CSAT, call volume, contact drivers, and operational performance. This role provides valuable exposure to business operations, data-driven decision-making, and process improvement in a dynamic, mission-oriented environment.This internship is structured to ensure practical development while delivering measurable business value through actionable insights and recommendations.Key ResponsibilitiesThe intern will support the Customer Experience team through project-based tasks and ongoing initiatives. Responsibilities may include:Analyzing CSAT data to identify trends, root causes of customer dissatisfaction, and improvement opportunities.

*Must be able to work Eastern Standard Time hours. This position does not offer visa sponsorship or transfer, including for individuals on OPT and STEM-EXT OPT, nor is it available for corp-to-corp arrangements. Join the team at Bankrate.com as a Staff Data Engineer, where you will play a pivotal role in shaping our data platform to empower millions in their financial decision-making processes. As a Staff Data Engineer, you will architect and scale the data systems that seamlessly integrate with our products, analytics, and business units. You will lead architectural initiatives, mentor fellow engineers, and collaborate across various teams to deliver robust, high-performance data solutions that create a measurable impact. We leverage Databricks and AWS with Terraform, and prior experience with these technologies will be highly beneficial. You'll thrive in a modern, cloud-native data environment that emphasizes accessibility, performance, and continuous improvement.

Join Sonsoft Inc. as a Big Data/Hadoop Engineer, where you will be at the forefront of data innovation. In this role, you will harness the power of big data technologies to design and implement advanced data processing solutions. Work collaboratively with cross-functional teams to drive data-driven decision-making and enhance our product offerings.

Role Overview Corporate Careers is hiring a Commercial Operations Engineer. This position can be based in Charlotte or performed remotely. The role focuses on optimizing commercial operations and improving process efficiency across the organization. What You Will Do Analyze operational data to identify trends and areas for improvement Develop and implement process enhancements that support business objectives Work closely with teams from multiple departments to improve operational performance Support cross-functional projects aimed at achieving organizational goals Recommend and help execute solutions that drive operational excellence Who We’re Looking For Detail-oriented and skilled in process analysis Comfortable collaborating with a variety of teams Experience identifying and implementing operational improvements

This position involves a hybrid work schedule based at our South Charlotte, NC Headquarters from Tuesday to Thursday, with the flexibility to work remotely on Mondays and Fridays. Join the Red Ventures Home and Utility group as our next Data Engineering Manager! In this role, you will lead a team dedicated to designing, developing, testing, and maintaining robust big data pipelines, providing essential support for our business analytics and machine learning initiatives. Your leadership will empower our users to make informed decisions about the best services and products available.

Palmetto is a clean technology company working to make sustainable energy more accessible. The team creates software, financial products, and services that support homeowners, businesses, and entrepreneurs in adopting renewable energy. Palmetto’s mission includes whole-home electrification and balancing environmental impact with value. The Senior Product Manager - Intelligence Platform, Applied AI, joins the Platform Product team in a technical, data-driven capacity. This role centers on developing a new product line, leading a team focused on building data products and an AI-first platform. The position offers hands-on involvement with Palmetto’s core business operations and direct collaboration with energy data experts and stakeholders in clean energy. Location This position may be based in Charlotte (1616 Camden Rd, Charlotte, NC 28203), Boston, or New York City. Reporting The Senior Product Manager reports to the Principal Product Manager. What you will do Lead the iteration and scaling of early-stage platform products, including data schema and architecture. Create user-friendly tools for exploring and interpreting energy data, with a focus on supporting effective Human-in-the-Loop (HITL) workflows. Synthesize fragmented consumer energy data, maintaining strong attention to detail. Role requirements Strong data skills and experience designing enterprise-grade APIs. Technical vision for scaling an AI-first platform, including defining evaluation criteria and establishing HITL processes. Ability to drive product growth, reach new customers, and identify new use cases. Comfort collaborating with technical and business stakeholders in the clean energy sector.

Join CapTech as a Lead Machine Learning Engineer, where you will spearhead the design and implementation of innovative, data-driven solutions tailored to our clients' needs. Your expertise will be crucial in building and deploying robust machine learning systems within enterprise environments. At CapTech, we foster a collaborative culture that encourages knowledge sharing among analysts, architects, and our clients, creating opportunities for professional growth.Key Responsibilities:Collaborate with clients, data scientists, engineers, and cross-functional teams to devise and implement comprehensive machine learning solutions that align with business objectives.Provide technical guidance and leadership, ensuring that the overall technical strategy meets client expectations.Translate client requirements into actionable, data-driven processes and analytical models.Analyze and manipulate large datasets from various enterprise-level platforms, such as AWS, Azure, and GCP.Design, develop, and deploy sophisticated analytical solutions utilizing client data, including recommender systems and natural language processing.Optimize and productionize machine learning systems to ensure scalability and performance in line with client demands.Enhance CapTech's Machine Learning and Data Science practices through client presentations, proposal writing, participation in business development events, and mentoring junior team members.

Company OverviewAt Olsson, we strive to engineer and design solutions that enhance the world around us. We are committed to being responsive, transparent, and results-oriented—prioritizing our people, our clients, and our company.As a people-centric organization, our greatest asset is our team. This commitment fosters an environment that encourages creativity and growth, cultivating a unique culture at Olsson that allows us to develop our employees alongside our business, making a lasting impact on the communities we serve.Job OverviewAs a Senior Electrical Engineer, you will collaborate with some of the largest technology firms and mission-critical clients. Your role will involve performing electrical engineering tasks on various projects, conducting design calculations, drafting technical reports, and preparing project documentation. Experience within the Data Center sector is highly desirable. You will also coordinate closely with other Olsson teams, technical staff, and clients to ensure project success.

cagents is seeking a Mechanical Commissioning Engineer for its Data Center Services team in Charlotte, North Carolina. This position ensures that mechanical systems within data centers are properly commissioned and function according to design specifications. Role overview This role focuses on verifying the installation and operation of mechanical equipment in data centers. The work plays a key part in delivering reliable and efficient service to clients by confirming that systems meet required standards before going live. Key responsibilities Oversee the commissioning process for mechanical systems in data centers Confirm that installations align with project requirements Support ongoing system reliability and efficiency for clients Location This position is based in Charlotte, North Carolina.

At Scout Motors, we are proud to revive the legacy of one of America's most iconic vehicles, dating back to 1960. Our mission is to pave the way for future generations of rugged SUVs and trucks while honoring our heritage.Scout Motors is more than just a brand; it's a commitment to exploration, responsibility, and hard work. We respect the past and embrace the future by electrifying and digitizing a classic American brand, infused with innovation. We value our communities by building a company that prioritizes its people and customers. We also respect the balance of work and leisure, creating vehicles that excel at job sites, campgrounds, and daily commutes. Our commitment to our customers is evident through our two unique powertrains: an all-electric option and the Harvester™ range extender with an estimated 500 miles of combined range.We empower our diverse and talented teams to innovate and drive change. A Scout employee is a visionary leader, eager to share insights and collaborate to build a better future. If you are passionate about making a difference, we want you on our team!Join Scout Motors and help us shape the future of transportation. Ready to make history? Apply today!About the TeamThe Data Platform Team at Scout is committed to unlocking the power of data by creating a secure, scalable, and distributed platform that provides real-time insights and fosters innovation throughout our organization. Our goal is to equip teams with actionable intelligence by streamlining data sharing, ensuring compliance, maintaining data integrity, and optimizing costs.This role focuses on establishing the foundation for deploying AI-driven use cases across the company.Your ResponsibilitiesBecome an integral part of a transformative brand within the electric pick-up truck and rugged SUV markets by:Contributing to the design, implementation, and maintenance of our cloud infrastructure data platform using modern Infrastructure as Code (IaC) practices.Collaborating closely with software development and systems teams to build efficient Data Integration solutions.Designing and developing Data models with tools such as Lucid, Talend, Erwin, and MySQL Workbench.Defining and enhancing enterprise data architecture.

As a Machine Learning Engineer at CapTech, you will be at the forefront of designing and executing innovative data-driven solutions tailored for our diverse clientele. Your primary focus will be on constructing and deploying robust machine learning systems within enterprise environments. Enjoy collaboration in a dynamic atmosphere that fosters knowledge sharing among analysts, architects, and clients.Key Responsibilities:Collaborate with clients, data scientists, engineers, and cross-functional teams to develop comprehensive machine learning solutions while discovering novel data science methodologies to fulfill business objectives.Translate client requirements into data-centric processes, models, and analytical metrics.Examine and process extensive datasets across various enterprise-level data platforms, including AWS, Azure, and GCP.Design and implement sophisticated analytical solutions utilizing client data, such as recommender systems, natural language processing, and risk assessment models.Optimize and scale machine learning systems to meet client specifications effectively.Enhance CapTech’s Machine Learning and Data Science practices through client presentations, proposal writing, participation in business development activities, and mentoring junior data scientists and engineers.

Job Summary -The Operations Command Center Engineer II (Eng II) is an integral part of our Operations team, providing vital 24/7/365 support through on-premise and specific on-call coverage schedules, with rotating shifts of 8 or 10 hours, including two weekends each month. This role is essential for troubleshooting and addressing critical incidents faced by our team in a dynamic environment. The Engineer will communicate effectively with the business and key stakeholders regarding any outages impacting operations. This position entails level 3 support for all custom and third-party applications, as well as network, IPT, and infrastructure issues. Additionally, the Engineer will standardize, create, and maintain support documentation within our Knowledge Management system for the Operations Command Center.Essential Functions -• Core Responsibilities include:- Critical Incident Management (effective communication with the business)- Incident Management- Tier 3 support for all network infrastructure and applications- Knowledge Management• Act as the coordinator for Critical Incidents, ensuring timely resolutions.• Communicate pertinent information to the business during critical production-impacting events as outlined by support processes.• Liaise with technical teams regarding all non-production-impacting critical events as specified in the support process.• Maintain logs for outage notifications and adhere to documented escalation procedures as necessary.• Serve as an Incident Coordinator, monitoring aging tickets in accordance with the defined Incident Management Processes.• Ensure all tickets follow the necessary escalation paths and are resolved promptly.• Facilitate root cause analysis to identify and recommend operational changes to the management team.• Provide support for third-level troubleshooting across all Sonic applications, network infrastructure, and escalate to vendors or operations for advanced resolutions.• Assist in documenting all aspects of technology, including vendor documentation, circuit data, dealership playbooks, and knowledge base articles to ensure successful support operations.• Maintain the Sonic Standard Monitoring Platform.• Troubleshoot Windows server, O365, and Exchange issues.• Handle Exchange and O365 mail tasks.• Comply with Change Management controls and guidelines.

At CapTech Consulting, our Data Engineering team empowers clients to create and sustain sophisticated data systems that integrate diverse data sources, fostering informed decision-making. We specialize in constructing data pipelines and preparing datasets for utilization by data scientists, analysts, and various data systems. Our passion lies in problem-solving and delivering innovative solutions for our clients. Cloud Data Engineers utilize clients' cloud infrastructure to provide immediate value while ensuring scalability for future growth. We thrive in a collaborative atmosphere, filled with opportunities to learn from fellow developers, architects, and our clients.Your Role and Contributions:Serve as a trusted advisor to clients, sharing best practices, methodologies, and technologies to implement effective data engineering solutions.Design, implement, and maintain cutting-edge data pipelines to deliver optimal solutions leveraging the most suitable cloud technologies.Collaborate with product owners and subject matter experts to analyze client requirements and develop sustainable engineered solutions.Provide technical leadership and work collaboratively within and across teams to ensure that technical solutions align with customer needs.Remain updated with the latest advancements in cloud technologies, patterns, and methodologies, sharing insights and results with key stakeholders.

Speechify’s mission is to remove reading barriers and expand access to learning for everyone. More than 50 million people use Speechify’s text-to-speech tools to convert PDFs, books, Google Docs, news articles, and websites into audio, helping users read faster and remember more. Our product suite includes iOS, Android, Mac, Chrome extension, and web apps, and has earned honors such as Google’s Chrome Extension of the Year and Apple’s 2025 Design Award for Inclusivity. Speechify operates as a fully distributed team with nearly 200 professionals. Team members bring experience from Amazon, Microsoft, Google, Stanford, Stripe, Vercel, and other leading organizations. Our group includes frontend and backend engineers, AI research scientists, and talent from top academic programs and startups. Role Overview Speechify is looking for a Software Engineer focused on data infrastructure and acquisition to join the AI team. This engineer will oversee the collection of data used for model training, helping to build and maintain high-quality datasets at petabyte scale. The role bridges infrastructure, engineering, and research to ensure efficient data operations. Key Responsibilities Identify new sources of audio data and connect them to the ingestion pipeline. Manage and improve the cloud infrastructure supporting data ingestion, currently running on Google Cloud Platform (GCP) and managed with Terraform. Work with scientists to optimize cost, throughput, and data quality, enabling larger datasets at lower costs for next-generation models. Collaborate with the AI team and company leadership to shape the dataset roadmap for upcoming consumer and enterprise products. Qualifications BS, MS, or PhD in Computer Science or a related field. Minimum 5 years of professional software development experience. Strong skills in bash and Python scripting in Linux environments. Deep understanding of Docker and Infrastructure-as-Code, with hands-on experience in at least one major cloud platform (GCP preferred). Background with web crawlers and large-scale data processing is a plus. Comfort managing multiple priorities and responding to changing needs. Excellent written and spoken communication skills. Location This position is open to candidates in Charlotte, NC, USA.

At CapTech, our Data Engineering professionals empower clients to construct and sustain sophisticated data systems that integrate information from diverse sources, facilitating informed decision-making. We specialize in building data pipelines and preparing data for utilization by data scientists, analysts, and various data systems. Our passion lies in problem-solving and delivering innovative solutions tailored to our clients' needs. Our Cloud Data Engineers harness the capabilities of cloud infrastructure to provide immediate value and ensure scalability for the future. We thrive in a collaborative environment with numerous opportunities to learn from and exchange insights with fellow developers, architects, and clients.Key responsibilities for the Cloud Data Engineer role include:Designing and implementing data pipelines and other data solutions using Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP).Consulting with clients on optimal technologies and methodologies to effectively ingest and process data in a timely manner.Applying engineering best practices to tackle complex data challenges.Working closely with end users, development teams, and business analysts to ensure that proposed data architecture maximizes data value across the organization.Communicating architectural differences among solution approaches and outlining their respective advantages and disadvantages.