Senior Software Engineer - Big Data Processing

Join Accion Labs as a Big Data Engineer, where you'll harness the power of data to drive business insights and innovation. We are seeking a highly skilled individual who thrives in a dynamic environment and is passionate about big data technologies.Your role will involve designing and implementing scalable data solutions, collaborating with cross-functional teams, and leveraging cutting-edge tools to analyze large datasets. If you have a knack for problem-solving and a keen eye for detail, we want to hear from you!

Join CSIT, where we are committed to advancing Singapore's national security through innovative technology. We are seeking experienced senior data engineers to spearhead the development of critical products aimed at identifying, analyzing, and investigating threats. Your expertise will play a pivotal role in our diverse applications ranging from counter-terrorism initiatives to robust computer network defense strategies.

About AvePoint:AvePoint is a global pioneer in data management and governance, trusted by over 21,000 customers worldwide to enhance their digital workplace across Microsoft, Google, Salesforce, and other collaborative environments. Our extensive global channel partner program includes more than 3,500 managed service providers, value-added resellers, and systems integrators, with our solutions available in over 100 cloud marketplaces. To discover more, please visit www.avepoint.com.At AvePoint, we prioritize investing in our people. Our culture thrives on agility, passion, and teamwork, empowering you to develop your career, make a significant impact, and shape your future. Unleash your potential with us!About the Role:We are on the lookout for a highly skilled and experienced Big Data Engineer to become part of our dynamic team. The ideal candidate should possess a minimum of 4 years of experience managing data engineering tasks in a big data environment, such as Cloudera Data Platform, with an overall experience range of 4 to 10 years. We prefer candidates with a background as a Consultant or Senior Consultant. The successful candidate will be tasked with designing, developing, and maintaining data ingestion and processing jobs in line with business requirements, as well as integrating data sets for seamless access by users.

Join Accion Labs as a Big Data Specialist and become a key player in our innovative team! In this role, you will leverage your expertise in Big Data technologies to drive impactful solutions and optimize data management processes. Collaborate with cross-functional teams to design and implement scalable data architectures that support our business objectives.

Job OverviewJoin Cygnify as a Data Platform Engineer, where you will manage expansive big data platforms within hybrid environments, ensuring seamless analytics and data-driven insights. Collaborate with data engineers, scientists, infrastructure, security, and business teams to uphold data integrity, platform reliability, and operational excellence. This position emphasizes the development, management, and optimization of production-grade data platforms and pipelines with a strong focus on infrastructure, automation, and reliability.Core ResponsibilitiesDesign and manage scalable data platform infrastructure and pipelines across both on-premises and cloud setups.Oversee the complete lifecycle of the platform including architecture, deployment, operations, performance tuning, and reliability engineering.Support data platform clusters and nodes (compute, storage, networking) to ensure high availability and optimal performance levels.Provision and manage cloud data services such as AWS S3 and Redshift.Monitor platform performance, health, and capacity; establish observability, alerting, and operational runbooks to maintain system reliability.Enhance and support ETL/ELT pipelines, ensuring consistent data ingestion, transformation, and delivery.Operate and maintain both on-premises and cloud data storage platforms to ensure durability and scalability.Implement security best practices including IAM, VPC configurations, encryption, backup strategies, and disaster recovery.Ensure adherence to data governance and regulatory mandates (e.g., PDPA) in collaboration with infrastructure and security teams.Work closely with cross-functional teams to align platform capabilities with business and analytical requirements.Create and maintain comprehensive technical documentation covering system architecture, data flows, configurations, and operational procedures.

Join CSIT, a pioneering company dedicated to enhancing Singapore's national security through innovative technology solutions. We are seeking skilled Senior Data Engineers who are passionate about developing mission-critical products that effectively identify, analyze, and investigate potential threats. In this role, you will lead significant projects in an exciting and impactful environment focusing on counter-terrorism and computer network defense. Your expertise will help shape the future of security in Singapore.

Join our dynamic team at OKX as a Big Data Platform Engineer specializing in AI agent platforms. In this pivotal role, you will be responsible for designing, developing, and maintaining cutting-edge big data solutions that empower our AI capabilities. Your expertise will contribute to enhancing our data processing frameworks and support various data-driven initiatives.

Join CSIT, a leader in developing innovative solutions to bolster the national security of Singapore. Our cutting-edge products are utilized across various domains, including Counter-terrorism and Computer Network Defence. We are seeking skilled software engineers to spearhead the creation of vital applications that effectively identify, analyze, and mitigate potential threats. Step into a role where your expertise will directly contribute to the safety and security of the nation.

Join Accion Labs as a Senior Big Data Engineer and play a pivotal role in shaping our data infrastructure and analytics capabilities. You will collaborate with cross-functional teams to design, develop, and implement robust data solutions that drive business insights and strategic decision-making.Your expertise in big data technologies will enable you to handle large datasets efficiently while ensuring data quality and integrity. If you are passionate about leveraging data to create impactful solutions, we would love to hear from you!

Join us as a Data Engineer at fuku, a dynamic and rapidly growing global consumer internet platform based in Singapore. This exciting role is focused on enhancing our data engineering capabilities to support millions of users across diverse ecosystems including content, community, e-commerce, and advertising.As we expand our international footprint, data has become a pivotal element for our decision-making and growth strategies. You will play a vital role in architecting a cutting-edge global data platform, crucial for driving user growth and optimizing commercial activities. Your expertise will be essential in designing and scaling robust data warehouse architectures and governance systems, empowering business teams worldwide to leverage data effectively.Key ResponsibilitiesFoundational Data Platform & Common Data Layer: Design, develop, and sustain the foundational data platform and shared data structures. Enhance the performance and stability of data operations across core business domains including community, e-commerce, and advertising.Domain Data Warehousing & Data Products: Collaborate with business units to lead the creation of domain-specific data warehouses. Construct data products and analytical models, providing accurate datasets and services that facilitate strategic decision-making.Data Governance Framework: Establish a comprehensive data governance framework that integrates business needs, metadata management, and technical implementation while consistently optimizing data quality, security, and efficiency.

Activate Interactive Pte Ltd is seeking a Data Engineer based in Singapore. This role centers on building and maintaining data architecture and analytics solutions that help drive business decisions. The work plays a direct part in how clients use data to enhance their operations. Key responsibilities Design and implement data architecture that fits specific business needs Create analytics solutions to uncover insights from complex datasets Assist teams in applying data to address operational challenges Requirements Background in data engineering, data architecture, or analytics Ability to solve problems using data-driven methods Interest in supporting clients to improve through effective data use This position offers the chance to influence how organizations make informed decisions through data.

Cloudera Data EngineerAs a Cloudera Data Engineer, you will play a pivotal role in designing, developing, and maintaining robust data pipelines and platforms, with a primary focus on the Cloudera Hadoop ecosystem. You will collaborate closely with data analysts, scientists, and business stakeholders to guarantee data accessibility, integrity, and security.Your Responsibilities:Design, build, and manage the Cloudera Hadoop Distribution (CDH/CDP) environment.Develop and maintain ETL pipelines using tools such as Apache NiFi, Hive, Spark, and Impala.Optimize and manage HDFS, YARN, Kafka, HBase, and Oozie workflows.Monitor and troubleshoot cluster performance, utilizing strong problem-solving and debugging skills.Work in collaboration with DevOps and Data Science teams to integrate data platforms into applications and analytics workflows.Ensure data governance, security, and compliance by leveraging tools such as Apache Ranger, Atlas, and Kerberos.Mentor and provide guidance to a team of data engineers to deliver comprehensive data solutions.

Join our innovative team as a Data Engineer at nascompany, where your expertise will help drive data solutions that empower our business decisions. You will play a critical role in designing, constructing, and maintaining scalable data pipelines and architectures. Collaborate with cross-functional teams to enhance data accessibility and ensure data quality.

Join Hytech, a premier technology company at the forefront of artificial intelligence and data analytics. We specialize in delivering innovative solutions that empower businesses to thrive in the digital age. Our talented team is dedicated to driving digital transformation and ensuring our clients achieve sustainable growth through cutting-edge technology and exceptional service.As an AI Data Engineer, you will play a crucial role in designing, developing, and maintaining robust data pipelines and systems for AI applications. You'll work closely with data scientists and software engineers to seamlessly integrate AI models into production environments. Your expertise will ensure data quality through effective collection, cleansing, and preprocessing techniques. Additionally, you will optimize data storage and retrieval processes to enhance system performance and troubleshoot any data pipeline issues that arise.Staying ahead of industry trends and technologies is essential, and you will contribute to the development of best practices and standards in data engineering.

Join Hudson River Trading (HRT) as a Data Production Engineer within our dynamic Data team. At HRT, data is the backbone of our operations, enabling us to extract profound insights from diverse data sources, which is key to our sustained success in an ever-evolving market.This is a unique opportunity to collaborate closely with our live trading teams, supporting one of the largest automated trading systems globally. In this role, you will engage in writing automation scripts, exploring datasets, and collaborating with our research and trading teams. You will also interact with various external partners, including data providers, brokers, and exchanges. As a vital part of the trading process, you will have the chance to acquire, analyze, and prepare data for quantitative research.

About Soleil CollectiveSupported by Gauge Capital, Soleil Collective is on a mission to curate a dynamic portfolio of top-tier, high-growth brands in the sunless tanning, suncare, and bodycare sectors. By leveraging our expertise in sales, marketing, operations, and strategic management, we accelerate growth and enhance profitability. To date, we have successfully acquired two brands: Loving Tan and Coco & Eve.Loving Tan, recognized as the leader in luxury tanning, is celebrated for its professional quality products that deliver a naturally radiant tan, crafted on Australia’s stunning Gold Coast. Beloved by celebrities and beauty enthusiasts alike, it offers a flawless application with a natural olive tone.Coco & Eve draws inspiration from Bali, delivering sun-kissed skin and effective haircare through products made with exquisite tropical ingredients, designed to transport users to a paradise experience.The RoleWe are seeking a Contract Business Data Engineer to enhance Soleil Collective’s data capabilities across our global beauty brand portfolio. This position bridges the domains of business analysis, data engineering, and systems integration, collaborating closely with Product, Operations, and Finance teams to convert business needs into scalable data and systems solutions.In this role, you will design and optimize data pipelines, facilitate system integrations, and ensure that business requirements are effectively translated into structured technical solutions. You will engage with stakeholders to gain insights into operational workflows, analyze data, and build a reliable data infrastructure that empowers informed decision-making across the organization.In addition to technical development, you will play a vital role in gathering requirements, documentation, testing coordination, and system optimization, ensuring that new solutions are practical, scalable, and aligned with our business objectives.The ideal candidate will be adept at navigating both technical and business environments, capable of analyzing data, comprehending operational processes, and collaborating with engineering teams to deliver impactful system and data solutions.

Are you passionate about sports and data? Ready to make a significant impact? Join us at Decathlon where our mission is to "Move People through the Wonders of Sport." We are more than just a retailer; we foster a global community driven by a love for sports and innovation. In Singapore and throughout APAC, we are transforming the landscape of sport experiences by harnessing data to enhance decision-making processes daily.We are looking for an outstanding Data Engineer / Analytics Engineer to join our team in Singapore and help us solve real-world data challenges. In this pivotal role, you will serve as the link between raw data and business outcomes. Your expertise will not only help us manage data but also design the systems that drive decisions across our stores, e-commerce, and logistics operations throughout Singapore and APAC, ensuring our data solutions are scalable, efficient, and reliable.Your ResponsibilitiesDesign, develop, and optimize large-scale DBT projects, acting as the primary point of contact for DBT initiatives across the region.Create and enhance production-ready data pipelines and solutions to extract valuable insights from web scrapers, store operations, and ecosystem partners.Establish and improve CI/CD workflows to boost developer productivity, enhance cloud performance, and manage AWS & GCP infrastructure.Work closely with business teams to identify data-driven solutions, clarify requirements, and improve existing tools while fostering a data-driven culture among teammates.Champion automation, effective data use, and data-driven decision-making.Contribute actively to the data and analytics engineering community.

Thoughtworks Singapore is currently seeking applicants who possess the right to work in Singapore, specifically Singapore citizens or Singapore Permanent Residents (PR), due to the nature of our business.As a Lead Data Engineer at Thoughtworks, you will be at the forefront of developing innovative data architecture strategies that align with crucial business objectives, delivering comprehensive end-to-end data solutions. You may engage with new clients for in-depth technical assessments or comprehensive organizational evaluations, guiding them to uncover the transformative potential of data in addressing their most significant challenges. Your role will involve spearheading the design of technical solutions, possibly overseeing program inception to create new products. In addition to hands-on coding, you will lead a team to implement these solutions effectively.

About the RoleJane Street is seeking a skilled Data Centre Engineer to join our team in Singapore. In this pivotal role, you will ensure the security and accessibility of our data around the clock. Your responsibilities will encompass hands-on work in our data and colocation centres, as well as strategic process thinking and project management.Your primary focus will be on designing, building, scaling, and maintaining our regional data and colocation centres. You will collaborate with a diverse group of talented professionals across various disciplines at Jane Street to enhance our data environments and proactively mitigate potential issues.As part of an interdisciplinary team that includes our Network, Server, Facilities Engineering, Market Data, and Trading teams, as well as external data centre operators and service providers, you will:Develop deployment plans for new equipment, adhering to data centre best practices.Manage logistical activities across locations, including procurement, shipping, equipment inventory, cabling, and parts management.Install and configure server operating systems in a PXE environment (fundamental Linux knowledge is essential for deploying our network equipment).Install, cable, configure, and troubleshoot various types of network and server equipment.Ensure all data centres maintain the highest standards of security, organization, documentation, safety, cleanliness, and supply management.This role is critical to our daily operations in Singapore and directly influences our remote locations throughout Asia.