Staff Data Platform Engineer - Real-time Data Platform

Job OverviewJoin Cygnify as a Data Platform Engineer, where you will manage expansive big data platforms within hybrid environments, ensuring seamless analytics and data-driven insights. Collaborate with data engineers, scientists, infrastructure, security, and business teams to uphold data integrity, platform reliability, and operational excellence. This position emphasizes the development, management, and optimization of production-grade data platforms and pipelines with a strong focus on infrastructure, automation, and reliability.Core ResponsibilitiesDesign and manage scalable data platform infrastructure and pipelines across both on-premises and cloud setups.Oversee the complete lifecycle of the platform including architecture, deployment, operations, performance tuning, and reliability engineering.Support data platform clusters and nodes (compute, storage, networking) to ensure high availability and optimal performance levels.Provision and manage cloud data services such as AWS S3 and Redshift.Monitor platform performance, health, and capacity; establish observability, alerting, and operational runbooks to maintain system reliability.Enhance and support ETL/ELT pipelines, ensuring consistent data ingestion, transformation, and delivery.Operate and maintain both on-premises and cloud data storage platforms to ensure durability and scalability.Implement security best practices including IAM, VPC configurations, encryption, backup strategies, and disaster recovery.Ensure adherence to data governance and regulatory mandates (e.g., PDPA) in collaboration with infrastructure and security teams.Work closely with cross-functional teams to align platform capabilities with business and analytical requirements.Create and maintain comprehensive technical documentation covering system architecture, data flows, configurations, and operational procedures.

Join our dynamic team at OKX as a Big Data Platform Engineer specializing in AI agent platforms. In this pivotal role, you will be responsible for designing, developing, and maintaining cutting-edge big data solutions that empower our AI capabilities. Your expertise will contribute to enhancing our data processing frameworks and support various data-driven initiatives.

Join Accion Labs as a Big Data Engineer, where you'll harness the power of data to drive business insights and innovation. We are seeking a highly skilled individual who thrives in a dynamic environment and is passionate about big data technologies.Your role will involve designing and implementing scalable data solutions, collaborating with cross-functional teams, and leveraging cutting-edge tools to analyze large datasets. If you have a knack for problem-solving and a keen eye for detail, we want to hear from you!

Join CSIT, where we are committed to advancing Singapore's national security through innovative technology. We are seeking experienced senior data engineers to spearhead the development of critical products aimed at identifying, analyzing, and investigating threats. Your expertise will play a pivotal role in our diverse applications ranging from counter-terrorism initiatives to robust computer network defense strategies.

Join Accion Labs as a Big Data Specialist and become a key player in our innovative team! In this role, you will leverage your expertise in Big Data technologies to drive impactful solutions and optimize data management processes. Collaborate with cross-functional teams to design and implement scalable data architectures that support our business objectives.

Join CSIT, a pioneering company dedicated to enhancing Singapore's national security through innovative technology solutions. We are seeking skilled Senior Data Engineers who are passionate about developing mission-critical products that effectively identify, analyze, and investigate potential threats. In this role, you will lead significant projects in an exciting and impactful environment focusing on counter-terrorism and computer network defense. Your expertise will help shape the future of security in Singapore.

About AvePoint:AvePoint is a global pioneer in data management and governance, trusted by over 21,000 customers worldwide to enhance their digital workplace across Microsoft, Google, Salesforce, and other collaborative environments. Our extensive global channel partner program includes more than 3,500 managed service providers, value-added resellers, and systems integrators, with our solutions available in over 100 cloud marketplaces. To discover more, please visit www.avepoint.com.At AvePoint, we prioritize investing in our people. Our culture thrives on agility, passion, and teamwork, empowering you to develop your career, make a significant impact, and shape your future. Unleash your potential with us!About the Role:We are on the lookout for a highly skilled and experienced Big Data Engineer to become part of our dynamic team. The ideal candidate should possess a minimum of 4 years of experience managing data engineering tasks in a big data environment, such as Cloudera Data Platform, with an overall experience range of 4 to 10 years. We prefer candidates with a background as a Consultant or Senior Consultant. The successful candidate will be tasked with designing, developing, and maintaining data ingestion and processing jobs in line with business requirements, as well as integrating data sets for seamless access by users.

About AirwallexAirwallex stands as the premier unified payments and financial platform dedicated to empowering global businesses. Leveraging our proprietary infrastructure and state-of-the-art software, we support over 200,000 businesses worldwide—including industry leaders like Brex, Rippling, Navan, Qantas, and SHEIN—with fully integrated solutions designed for comprehensive management of business accounts, payments, spend management, treasury, and embedded finance on a global scale.Founded in Melbourne, we proudly boast a diverse team of over 2,000 innovative tech professionals across 26 offices globally. With a valuation of US$8 billion, our company is backed by top-tier investors such as T. Rowe Price, Visa, Mastercard, Robinhood Ventures, Sequoia, Salesforce Ventures, DST Global, and Lone Pine Capital. Join us in shaping the future of global payments and finance by taking on the most ambitious work of your career.Attributes We ValueWe seek talented builders who possess a founder-like mentality and are driven by the desire for meaningful impact, accelerated learning, and genuine ownership. You bring a wealth of role-related expertise and sharp analytical skills, and you resonate with our mission and operating principles. You thrive in fast-paced environments, exercise sound judgment, and approach challenges with curiosity, making decisions based on first principles while balancing speed and thoroughness.A humble and collaborative team player, you excel at transforming innovative ideas into tangible products and ensure projects are executed successfully from start to finish. You leverage AI to enhance productivity and expedite problem-solving. Here, you'll confront complex, high-visibility challenges alongside exceptional colleagues and advance your career as we redefine global banking.(Senior) Data Platform Engineer, Growth Data PlatformHiring Location: Singapore (Or, Shanghai, China)Preliminary Note - Basic Information About This Role: As a Senior Data Platform Engineer in the Knowledge Platform Team, you will engage directly with the Growth Team's business scenarios.Who We Are? Team Introductions:The Knowledge Platform team is integral to our company's data and AI strategy. We are constructing the foundational infrastructure that enables the entire organization to utilize data, AI, and ML for significant business outcomes. Our mission is to create platforms that empower...

Join our dynamic team at plaud as a Data Engineer specializing in building and optimizing our cutting-edge data platform. You will play a pivotal role in developing scalable data pipelines, ensuring data integrity, and providing actionable insights to drive strategic decisions.If you are passionate about data and want to work in a fast-paced environment, this is the perfect opportunity for you!

Join us as a Data Engineer at fuku, a dynamic and rapidly growing global consumer internet platform based in Singapore. This exciting role is focused on enhancing our data engineering capabilities to support millions of users across diverse ecosystems including content, community, e-commerce, and advertising.As we expand our international footprint, data has become a pivotal element for our decision-making and growth strategies. You will play a vital role in architecting a cutting-edge global data platform, crucial for driving user growth and optimizing commercial activities. Your expertise will be essential in designing and scaling robust data warehouse architectures and governance systems, empowering business teams worldwide to leverage data effectively.Key ResponsibilitiesFoundational Data Platform & Common Data Layer: Design, develop, and sustain the foundational data platform and shared data structures. Enhance the performance and stability of data operations across core business domains including community, e-commerce, and advertising.Domain Data Warehousing & Data Products: Collaborate with business units to lead the creation of domain-specific data warehouses. Construct data products and analytical models, providing accurate datasets and services that facilitate strategic decision-making.Data Governance Framework: Establish a comprehensive data governance framework that integrates business needs, metadata management, and technical implementation while consistently optimizing data quality, security, and efficiency.

Activate Interactive Pte Ltd is seeking a Data Engineer based in Singapore. This role centers on building and maintaining data architecture and analytics solutions that help drive business decisions. The work plays a direct part in how clients use data to enhance their operations. Key responsibilities Design and implement data architecture that fits specific business needs Create analytics solutions to uncover insights from complex datasets Assist teams in applying data to address operational challenges Requirements Background in data engineering, data architecture, or analytics Ability to solve problems using data-driven methods Interest in supporting clients to improve through effective data use This position offers the chance to influence how organizations make informed decisions through data.

Join Accion Labs as a Senior Big Data Engineer and play a pivotal role in shaping our data infrastructure and analytics capabilities. You will collaborate with cross-functional teams to design, develop, and implement robust data solutions that drive business insights and strategic decision-making.Your expertise in big data technologies will enable you to handle large datasets efficiently while ensuring data quality and integrity. If you are passionate about leveraging data to create impactful solutions, we would love to hear from you!

Join CSIT, a leader in developing innovative solutions to bolster the national security of Singapore. Our cutting-edge products are utilized across various domains, including Counter-terrorism and Computer Network Defence. We are seeking skilled software engineers to spearhead the creation of vital applications that effectively identify, analyze, and mitigate potential threats. Step into a role where your expertise will directly contribute to the safety and security of the nation.

Cloudera Data EngineerAs a Cloudera Data Engineer, you will play a pivotal role in designing, developing, and maintaining robust data pipelines and platforms, with a primary focus on the Cloudera Hadoop ecosystem. You will collaborate closely with data analysts, scientists, and business stakeholders to guarantee data accessibility, integrity, and security.Your Responsibilities:Design, build, and manage the Cloudera Hadoop Distribution (CDH/CDP) environment.Develop and maintain ETL pipelines using tools such as Apache NiFi, Hive, Spark, and Impala.Optimize and manage HDFS, YARN, Kafka, HBase, and Oozie workflows.Monitor and troubleshoot cluster performance, utilizing strong problem-solving and debugging skills.Work in collaboration with DevOps and Data Science teams to integrate data platforms into applications and analytics workflows.Ensure data governance, security, and compliance by leveraging tools such as Apache Ranger, Atlas, and Kerberos.Mentor and provide guidance to a team of data engineers to deliver comprehensive data solutions.

Join CSIT, where we are dedicated to enhancing the national security of Singapore through innovative software solutions. Our products play a crucial role in various applications, particularly in counter-terrorism and computer network defense. We are seeking skilled Senior Software Engineers to spearhead the development of mission-critical systems that detect, analyze, and investigate threats effectively.

About AirwallexAirwallex stands as the premier unified payments and financial platform designed for global enterprises. By harnessing our distinctive blend of proprietary infrastructure and cutting-edge software, we empower over 200,000 businesses worldwide—including notable names like Brex, Rippling, Navan, Qantas, SHEIN, and many others—with seamlessly integrated solutions. These solutions encompass everything from business accounts and payment processing to spend management, treasury services, and embedded finance at a global scale.Founded in Melbourne, our dynamic team of over 2,000 innovative tech professionals spans 26 offices globally. With a valuation of US$8 billion and backed by prestigious investors such as T. Rowe Price, Visa, Mastercard, Robinhood Ventures, Sequoia, Salesforce Ventures, DST Global, and Lone Pine Capital, Airwallex is at the forefront of constructing the future landscape of global payments and finance. If you’re prepared to embark on the most ambitious journey of your career, we invite you to join us.

CSIT is dedicated to enhancing the national security of Singapore through innovative product development. Our solutions are integral to various operations, including Counter-terrorism and Cyber Defense. Become a vital member of the CSIT team and leverage state-of-the-art technologies to safeguard our nation. We are actively seeking a skilled Platform Engineer to oversee the management of our Data Exploration Platform. This platform empowers users to analyze, visualize, and interact with data in a flexible and user-friendly manner, enabling them to extract valuable insights.

Join our innovative team as a Data Engineer at nascompany, where your expertise will help drive data solutions that empower our business decisions. You will play a critical role in designing, constructing, and maintaining scalable data pipelines and architectures. Collaborate with cross-functional teams to enhance data accessibility and ensure data quality.

Exciting Opportunity Awaits!NCS is in search of a seasoned Cloud Data Platform Solution Architect to spearhead the design, configuration, and deployment of a cutting-edge, secure, and scalable cloud data platform. This innovative platform will be developed on AWS and will seamlessly integrate various tools including Talend Big Data Management, Talend Data Catalog, RStudio Workbench, Posit Package Manager, Denodo, Keycloak, CKAN, Tyk, and AWS API Gateway.The ideal candidate will possess extensive experience in constructing data platforms from inception, showcasing robust expertise in data integration, metadata management, data virtualization, access control, API management, and secure cloud deployment.In this role, you will collaborate closely with cloud infrastructure stakeholders, scrum masters, project managers, and technical teams to establish a comprehensive enterprise data platform that supports analytics and AI initiatives.Additionally, the ability to translate user stories and technical security requirements into actionable platform infrastructure plans is crucial, as you oversee the establishment of a government cloud platform to empower self-service analytics or AI projects. Familiarity with Government Commercial Cloud (GCC) and GCC+ is a plus.Key Responsibilities:Design and oversee the full setup of a cloud-based data platform architecture on AWS, integrating an array of tools and services.Implement and configure:Talend Big Data Management for efficient data ingestion, transformation, and orchestration.Talend Data Catalog for effective enterprise data governance and metadata management.Denodo for advanced data virtualization.RStudio Workbench and Posit Package Manager to facilitate secure, collaborative data science workflows.Tyk API Gateway and AWS API Gateway to build a robust data API layer for secure and scalable data access.CKAN for effective data publishing and discovery.Keycloak for identity and access management, ensuring SSO, RBAC, and secure authentication across all platform components.AWS services including S3, Redshift, and SageMaker to support data storage, transformation, and querying.Define and document the platform architecture, integration patterns, and operational procedures.Ensure security, compliance, and scalability across all platform components.Collaborate with infrastructure, DevOps, data engineering, and business teams to align platform capabilities with organizational needs.