Hadoop Developer - Transform Data into Insights

Join our dynamic team at Sonsoft Inc. as a Hadoop Developer, where you'll leverage your skills to transform vast amounts of data into actionable insights. This role presents an exciting opportunity to work with cutting-edge technologies in a fast-paced environment.

Join our dynamic team at Sonsoft Inc. as a Hadoop Developer! In this role, you will be responsible for designing and implementing scalable data processing systems using Hadoop technologies. You will collaborate with data scientists and analysts to optimize data workflows and ensure the integrity and availability of large datasets.

Join our dynamic team at Sonsoft Inc. as a Hadoop Developer! We are looking for an enthusiastic and skilled individual to help us leverage big data technologies to drive our business forward. You will be responsible for designing, developing, and maintaining scalable data processing solutions using Hadoop and its ecosystem tools.

Join our dynamic team at Sonsoft Inc. as a Hadoop Developer! In this exciting role, you will be responsible for designing and implementing robust data processing solutions using Hadoop ecosystem technologies. This is a fantastic opportunity for those looking to advance their careers in big data and analytics.

Hello from Cygnus Professionals,We hope this message finds you well!We are currently seeking a talented Big Data Engineer specializing in Spark to join our dynamic team. If you possess the necessary skills and are interested, please send us your updated resume along with your contact information and desired rate.Position: Big Data Engineer with SparkLocation: Palo Alto, CADuration: Potential Contract to HireInterview Mode: Skype following a phone interviewImportant Note: We are looking for Green Card holders, U.S. Citizens, or EAD GC candidates only.Position Overview:As a Big Data Engineer, you will utilize your expertise in Java, Spark, and Hadoop to design and implement scalable data solutions. You will work with distributed systems, and your responsibilities will include:Developing data pipelines and implementing distributed system designs.Applying machine learning algorithms to enhance data processes.Building large-scale applications utilizing various software design patterns and object-oriented design principles.Engaging in research and analysis to convert raw data into structured datasets for product development.Managing data warehousing and parallel processing of large datasets using technologies such as Hadoop and cloud solutions.Participating in Agile, Scrum, and SDLC methodologies.Thriving in a fast-paced, research-oriented environment while demonstrating strong communication and collaboration skills.

Qualified Health is building new ways to use Generative AI in healthcare. The Director of AI Transformation will play a central part in this mission, working with top health systems and helping to guide the safe and effective use of AI across the organization. Role overview This hybrid position requires travel and offers flexibility to work from Palo Alto, Houston, St. Louis, or remotely within the US. The Director will help shape how AI is applied to healthcare, focusing on both immediate improvements and long-term impact on patient care. What you will do Collaborate with healthcare partners to identify opportunities for AI-driven transformation Oversee the development and deployment of healthcare-specific AI agents Ensure safe AI governance and real-time monitoring of algorithms Address complex challenges that come with integrating AI into healthcare systems Who thrives here People who are driven and creative Those comfortable taking on challenges in a changing environment Individuals eager to make a meaningful difference in patient care This role offers the chance to help shape the future of healthcare through AI, working alongside a team committed to making a real impact.

Join Qualified Health as an AI Transformation Leader, where you will spearhead innovative AI initiatives to revolutionize healthcare delivery. In this dynamic role, you will collaborate with cross-functional teams to identify opportunities for AI integration, driving impactful changes that enhance patient care and operational efficiency.

Rivian and Volkswagen Group Technologies brings together two major automotive innovators focused on advancing mobility. The partnership works on a range of technology solutions, including operating systems, zonal controllers, and cloud connectivity. The goal is to address the unique challenges of electric vehicles and set new standards for software-defined vehicles worldwide. With expertise in connectivity, artificial intelligence, and security, the team aims to create smarter, more connected, and sustainable mobility solutions. Role overview The Vehicle Data Services team seeks a Lead Staff Software Engineer to help drive the Cloud Data Platform. This position centers on building scalable and reliable Data Services that move data between backend systems and vehicles. The work involves supporting high-throughput telemetry, managing both streaming and batch data, maintaining a data model registry, and coordinating fleet-wide push updates. What you will do Design, develop, and maintain high-performance, low-latency distributed systems for vehicle data services Support telemetry systems that handle streaming and batch data Oversee the data model registry and manage fleet push updates Shape the interaction between Cloud and Mobile services with vehicles and other cloud systems Collaborate with cross-functional teams to solve complex technical challenges Contribute to the architecture and software for next-generation Software Defined Vehicles (SDVs) Requirements Experience designing and developing distributed systems Ability to work on high-throughput data platforms and telemetry systems Strong collaboration skills for working with cross-functional teams Background in supporting cloud and mobile service integration with vehicles

Senior Manager, Product DesignLocation: Palo Alto, USAbout RubrikBecome a part of the dynamic organization leading the charge in securing the future of AI.Rubrik is embarking on an exciting journey following our groundbreaking IPO, achieving over $1.3 Billion in ARR. We combine the stability of an established entity with the innovative spirit of a startup. After successfully mastering Data Security, our focus is now on our boldest mission yet: Securing and Accelerating the World's AI Transformation.As a Senior Manager, Product Design at Rubrik, you will be at the forefront of crafting the next generation of user experiences for enterprises. Our technology stack, featuring AI, air-gapped immutable backups, and ransomware defense, exemplifies what it means to be cyber resilient. Recognized as a Gartner Magic Quadrant Leader and recipient of the prestigious Red Dot & iF Design Awards, we believe in making security powerful yet user-friendly. Join us in creating the safety net for the AI era.About Team & Role:Our design team is robust and diverse, comprising around 60 talented individuals from various backgrounds across the globe. As our company and product lines expand, scaling the experience of both our product and design teams is essential. Every new team member plays a crucial role!We are looking for a Senior Manager, Product Design for our Palo Alto office. This key leadership position will involve overseeing a skilled team of designers and acting as a strategic partner to engineering and product leadership, setting the standard for enterprise design at Rubrik.What You'll Do:

About 1XAt 1X, we are pioneering the development of humanoid robots designed to enhance human productivity and address labor shortages across various industries.Your RoleAs the Supervisor of Data Collection at 1X, you will be at the helm of a dedicated team of Operators, ensuring optimal workflows, adherence to data collection standards, and exceptional operational performance throughout your shift. This dynamic position necessitates proactive problem-solving, real-time coordination, and robust leadership, all aimed at supporting the seamless operation of our innovative robotic systems. Your contributions will be instrumental as we evolve from research and development to large-scale manufacturing.

Join pebl as the Vice President of Data Engineering, a pivotal role where you will lead our data engineering team in building robust data infrastructures that drive our innovative solutions. You will be responsible for overseeing the development and optimization of data pipelines, ensuring data integrity, and enabling our organization to leverage data for decision-making and strategic initiatives.As a key member of the executive team, you will collaborate closely with other departments to align data strategies with business objectives. Your expertise in data architecture and engineering will help shape our products and services, fostering a data-driven culture across the organization.

Rivian and Volkswagen Group Technologies brings together two leaders in the automotive sector to develop new technology for electric vehicles. The partnership focuses on solutions ranging from advanced operating systems and zonal controllers to secure cloud connectivity. By combining expertise in connectivity, artificial intelligence, and security, the team works to shape a more connected and sustainable future in mobility. Role overview The Senior Data Engineer joins the Core Data team, which builds and scales the data platform supporting analytics and decision-making. Within this team, the Operational Insights group handles data from production environments, turning complex operational and quality data into dependable data products and performance metrics that drive business results. What you will do Design and maintain scalable data ingestion pipelines for analytics initiatives across multiple programs and locations Create well-structured datasets to support analytics and AI-driven insights Ensure data integrity and reliability across key operational systems Bridge operational systems, data platform engineering, and analytics to convert raw data into governed, high-value datasets Who thrives in this role This role suits those who enjoy building data infrastructure that connects operational systems and analytics, and who take pride in transforming raw data into reliable, actionable insights for a broad range of business needs.

Location: San Francisco Bay Area (Palo Alto or San Francisco preferred) or Seattle, WA.Working Model: Hybrid (in-office presence required).About the RoleWe are on the lookout for a Senior Staff Enterprise Architect, Data to spearhead the strategy, design, and modernization of our enterprise data landscape. This pivotal role sits at the crossroads of data architecture, engineering, and AI enablement, crafting solutions to seamlessly integrate our Data Lake and Data Warehouse across multi-cloud platforms.In the next 12-18 months, you will empower business users with self-service data access and natural language query capabilities. Your responsibilities will also include architecting Master Data Management and data lineage frameworks, ensuring that AI models function on high-quality, governed data. Additionally, you will assess and implement AI-driven tools to automate data quality monitoring and bolster data security.Key ResponsibilitiesData Strategy & RoadmapDesign a semantic layer architecture that standardizes business metrics across the enterprise, while defining governance guardrails to ensure that natural language queries access validated master data sources.Develop a Master Data strategy for Customer and Product domains (phases 1-2), with Finance and People to follow. Establish golden record requirements, stewardship models, and a system-of-record hierarchy. Collaborate with business stakeholders on master data governance.Define a cross-cloud data integration strategy and reference architecture, specifying patterns (federation, replication, abstraction layer) that balance performance, cost, and data freshness. Document trade-offs and recommend implementations for both batch and near-real-time use cases.Create 12-24 month data architecture roadmaps for Finance, Sales, Product, and People, identifying capability gaps and recommending technology investments along with business value and effort estimates.Systems Design & Solution LeadershipEvaluate AI-powered data observability platforms for quality monitoring, pipeline failure prediction, and data classification. Define requirements, lead vendor POCs, and establish integration patterns.Define data ingestion architecture that reduces availability from weeks to 3-5 days (batch) and under 15 minutes (real-time), specifying ELT patterns using CDC where feasible. Document source system constraints and collaborate with engineering on phased implementation.Establish build vs. buy frameworks for Data Platform, ETL, Data Quality, and Master Data tooling. Define POC criteria and scoring models. Oversee POC execution and present recommendations with TCO analysis to the architecture team.

Join mindrobotics as a Data Engineer, where you will play a pivotal role in developing the data systems that drive large-scale AI training for robots. This position is centered around transforming extensive data into well-organized, high-quality datasets. You will take ownership of data pipelines, labeling workflows, storage, and cloud infrastructure from start to finish. If you thrive in scaling environments, enjoy creating bespoke tools when existing solutions are inadequate, and aim to enhance data reliability for rapid iteration, you'll find a welcoming home here. Collaborate closely with researchers and engineers to ensure that our data propels swift and impactful advancements in robot training and evaluation.

Join Grindr as a Senior Staff Data Scientist in a hybrid capacity at our Palo Alto office, where you will work in-office on Tuesdays and Thursdays.Why This Role is ExcitingGrindr (NYSE: GRND) is the largest LGBTQ+ social networking platform globally, boasting over 14 million active users monthly across nearly every country. As an integral part of the LGBTQ+ community, we are a cornerstone of gay culture.In your role, you will collaborate across teams including product managers, designers, and engineers to develop actionable metrics, spearhead innovative experiments, and provide data-driven insights that will inform strategic decisions. Your contributions will directly enhance the experience of millions of users through production-level models and analyses. Furthermore, you will serve as an ambassador for the Data Science team, sharing knowledge about effective data utilization with diverse teams across the organization.Being a part of Grindr's data organization means engaging with a dynamic team of data scientists, data engineers, and ML/AI engineers, all working together to push the boundaries of data science.Key ResponsibilitiesDerive actionable insights from complex, open-ended inquiries.Define strategies for designing and assessing experiments to evaluate product changes.Effectively communicate results to executives and cross-functional teams to influence product and organizational strategies.Analyze product data to identify the root causes of metric fluctuations.Collaborate with stakeholders to communicate findings that guide product decisions.Develop and oversee tools that automate analyses, enhancing productivity across the organization.Mentor team members and recommend best practices.Employ an engineering mindset to streamline complexity while maximizing utility and maintainability.Shape the future of our data products by developing machine learning solutions that enhance user recommendations, identify spam, and improve user engagement.What We Value in You

Mudflap is revolutionizing the $800 billion trucking industry, a crucial component of the U.S. economy. Our innovative payment solutions empower truckers to save significantly on fuel, their largest operational cost, while simultaneously offering our fuel stop partners access to a new and hard-to-reach clientele. As a rapidly expanding marketplace, we are seeking a passionate and customer-focused individual to join our dynamic team on this exciting journey.About the RoleAt Mudflap, we are developing a robust data-driven engine that will inform decisions across all facets of our organization. We are in search of experienced Senior and Staff Data Scientists to join our small yet highly impactful analytics and machine learning team. In this role, you will collaborate closely with product, engineering, operations, and cross-functional partners to create data products, develop machine learning models, conduct experiments, and provide insights that will directly drive our growth and product strategy.Work Location: This position is based in Palo Alto, CA and offers a hybrid work model, blending in-office teamwork with remote flexibility.To support our team, we provide:Commuter benefits to facilitate your travelLunches and snacks to keep you energizedA collaborative, high-growth environment where you will work alongside talented colleagues from various departmentsWe are hiring for three primary domains—Product, Risk, and Growth—allowing you to apply your expertise where your passion lies:What You’ll DoProduct:Influence strategic product decisions through advanced analytics and experimentation. Design and conduct A/B tests, create predictive models, and derive data-driven insights that will significantly impact product roadmaps and business outcomes. Collaborate closely with product managers, engineers, and leadership to uncover opportunities, assess feature success, and enhance user experiences.Risk:Assess, model, and mitigate credit and fraud risks within our platform. Enhance our credit risk underwriting capabilities, and develop predictive models aimed at minimizing fraud losses. Work alongside Product, engineering, and operations teams to implement scalable risk management strategies.Growth:Generate strategic growth insights through sophisticated data architecture and advanced analytics. Lead the design and implementation of growth-focused initiatives that drive business expansion.

Our MissionAt Whop, we are dedicated to providing everyone with a sustainable income. Currently, we empower millions across the globe, exemplifying the transformative nature of today's workforce, especially for the youth.About the RoleWe are in search of talented Data Scientists to play a pivotal role in shaping our decision-making framework. You will be responsible for managing the data infrastructure that informs our understanding of growth, product efficiency, marketplace trends, and overall financial and operational health. Collaborating closely with teams in product, growth, finance, and leadership, you will address critical questions that guide our strategic investments, identify successes and challenges, and accelerate our scaling efforts.Key ResponsibilitiesTransform complex product, marketplace, and financial data into actionable insights.Develop dashboards and metrics that are integral to leadership and team decision-making.Identify key growth drivers, retention trends, funnel obstacles, marketplace quality indicators, and monetization prospects.Collaborate with product and engineering teams to establish metrics, enhance data collection processes, and assess product launches.Prepare performance reports suitable for board and executive review.Proactively identify anomalies, risks, and opportunities before they are raised by other teams.Required QualificationsProven experience in a data science, analytics, or strategic data role within a fast-paced technology company.Ability to convert ambiguous business inquiries into structured analyses, metrics, and actionable recommendations.Expertise in handling disorganized, incomplete, or rapidly evolving data.Strong judgment regarding product and business strategies; capable of distinguishing between intriguing and practical analyses.Excellent communication skills that bridge technical and non-technical teams.A proactive mindset: you take initiative to address significant challenges without waiting for explicit direction.Comfortable collaborating closely with founders, leadership, product, engineering, growth, and finance teams.Preferred QualificationsExperience in marketplace dynamics and financial modeling.

At Rhoda AI, we are pioneering the development of a comprehensive technology stack for the future of humanoid robotics. Our focus ranges from high-performance, software-defined hardware to cutting-edge foundational models and video world models that govern these systems. Our robots are engineered as versatile generalists, adept at navigating complex, real-world scenarios that extend beyond conventional training environments. Collaborating at the forefront of large-scale learning, robotics, and systems, our research team comprises distinguished experts from renowned institutions such as Stanford, Berkeley, and Harvard. With an impressive funding of over $400 million, we are committed to substantial investments in research and development, hardware innovation, and the scaling of manufacturing processes to bring our vision to life.Position OverviewWe are currently seeking a Senior ML & Data Infrastructure Engineer to take ownership of and enhance our data model training pipeline. This role encompasses the entire lifecycle, from raw data ingestion and storage to sophisticated indexing, retrieval, and throughput optimization at an unprecedented scale.Key ResponsibilitiesDesign, develop, and scale a robust data infrastructure capable of processing and managing billions of video clips while ensuring reliability, low latency, and cost-effectiveness.Create and optimize large-scale storage solutions, including cloud object storage and databases, tailored for multimodal datasets.Develop high-performance indexing and retrieval systems to facilitate rapid dataset querying, filtering, and iteration for both research and production applications.Establish observability frameworks for data pipelines that encompass monitoring, alerting, failure recovery, and performance enhancements.Implement intelligent workload distribution and throughput enhancements across distributed compute and storage infrastructures.Oversee data artifacts, versioning, and lineage to guarantee reproducibility and traceability throughout training cycles.Create user-friendly internal interfaces and lightweight tools that empower researchers and engineers to explore, query, and analyze extensive datasets efficiently.Facilitate the integration and scalable deployment of vision-language models (VLMs) within data pipelines for purposes such as screening, enrichment, or metadata generation.QualificationsA minimum of 5 years of experience in data infrastructure, distributed systems, machine learning infrastructure, or a closely related field.Proven expertise in developing and managing large-scale data pipelines and storage solutions.Strong programming skills in languages such as Python, Java, or Scala, and proficiency with data processing frameworks.Experience with cloud-based storage solutions and databases, as well as knowledge of multimodal data management.Ability to work collaboratively in a fast-paced, innovative environment.

Join xai as a Senior Data Analyst specializing in Fraud and Anti-Money Laundering (AML). In this pivotal role, you will leverage data-driven insights to combat financial crimes, utilizing advanced analytical techniques to identify suspicious activities. Your expertise will contribute to the development of sophisticated models and systems that enhance our fraud detection capabilities.

Join Grindr, the world's preeminent LGBTQ+ social app, as a Senior Data Scientist. This hybrid role is based in our Bay Area or Chicago offices, requiring in-office attendance on Tuesdays and Thursdays.As a Senior Data Scientist, you will collaborate with product managers, designers, and engineers to establish meaningful metrics, design and evaluate experiments, and derive insights that will guide product development. You will play a critical role in shaping data products and experimentation, focusing on enhancing user experience.You will be a key member of Grindr’s centralized Data organization, which fosters collaboration among data scientists, data engineers, and ML/AI engineers. This position offers an exciting opportunity to amplify your impact while learning from experts across various disciplines.