Software Engineer Specializing in Big Data Processing
Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.
Unlock Your Potential
Generate Job-Optimized Resume
One Click And Our AI Optimizes Your Resume to Match The Job Description.
Is Your Resume Optimized For This Role?
Find Out If You're Highlighting The Right Skills And Fix What's Missing
Experience Level
Experience
Qualifications
About CSIT
CSIT is dedicated to advancing the national security interests of Singapore through innovative technological solutions. Our mission is to provide reliable products that address critical security challenges, ensuring a safer environment for all.
Similar jobs
Search for Software Engineer Data Discovery And Operations
1,895 results
Join our dynamic team as a Software Engineer specializing in Data Discovery and Operations. In this role, you'll be an integral part of a multidisciplinary product development group dedicated to empowering data-driven decision-making through innovative technical solutions. Your efforts will focus on designing, developing, and implementing advanced data solutions to enhance data search capabilities, facilitate seamless exploration of data assets, and support effective data sensemaking. You will work across the entire technology stack, building robust data processing pipelines, backend data services, and user-friendly front-end interfaces. Embrace the opportunity to leverage state-of-the-art technologies, including AI components, to create impactful solutions.
As a Manager of Data Centre & Cloud Operations, you will take charge of the design, execution, and upkeep of the infrastructure supporting our data center operations. This role requires an in-depth knowledge of data center systems encompassing hardware, networking, cooling, power, and security. You will also possess strong leadership capabilities to manage teams, streamline processes, and uphold the facility's operational excellence.Key Responsibilities:Infrastructure Management:Oversee the management and maintenance of both physical and virtual infrastructures, including servers, storage, network devices, and power and cooling systems.Ensure the data center infrastructure remains secure, reliable, scalable, and aligned with the organization’s business and operational requirements.Plan, implement, and upgrade infrastructure to satisfy performance and capacity expectations.Team Leadership and Collaboration:Lead, supervise, and collaborate with other departments, such as IT, network operations, security, and facilities, to ensure seamless data center operations.Establish and uphold operational standards and best practices for data center personnel.Capacity Planning and Optimization:Monitor data center performance and capacity to forecast future infrastructure requirements and proactively tackle potential challenges.Formulate and execute strategies to optimize resource utilization within the data center, including space, power, cooling, and network bandwidth.Project Management:Direct the planning and execution of various infrastructure projects, including data center builds, expansions, and migrations.Oversee timelines, budgets, and resources to guarantee successful project outcomes.Track and report progress on significant milestones, ensuring projects remain on schedule and within budget.Security and Compliance:Ensure the data center adheres to industry standards and complies with applicable security, regulatory, and environmental regulations.Implement physical security measures and collaborate with security teams to safeguard data integrity and access controls.Develop disaster recovery and business continuity plans for data center operations.Troubleshooting and Incident Management:Lead troubleshooting initiatives and guarantee swift resolution of any infrastructure issues or outages.Develop and maintain incident response procedures to minimize downtime and meet recovery objectives.Conduct root cause analyses and continuous improvement processes for infrastructure incidents.Cost Management:Oversee the budget for data center infrastructure, identifying opportunities for cost-saving measures.
Join Motional as a Senior Software Engineer to drive the development of our cutting-edge Data Platform. In this role, you will leverage your expertise in software engineering to build scalable and efficient data solutions. Collaborate with a talented team to shape the future of autonomous vehicles through innovative data management.
NCS Pte Ltd
Join our dynamic team as a Data Center IT Operator at NCS, where you will play a crucial role in ensuring the smooth operation of our data center facilities. Your responsibilities will include monitoring and maintaining data center infrastructure, troubleshooting hardware and software issues, and providing technical support to ensure optimal performance.
Join CSIT, a leader in developing innovative solutions to bolster the national security of Singapore. Our cutting-edge products are utilized across various domains, including Counter-terrorism and Computer Network Defence. We are seeking skilled software engineers to spearhead the creation of vital applications that effectively identify, analyze, and mitigate potential threats. Step into a role where your expertise will directly contribute to the safety and security of the nation.
Join Airwallex as a Staff Software EngineerAre you ready to shape the future of global finance? At Airwallex, we take pride in being a pioneering financial technology platform that serves over 200,000 businesses worldwide, including industry leaders like Brex, Qantas, and SHEIN. We provide a comprehensive suite of solutions for payments, treasury management, and embedded finance, all designed to empower modern businesses to thrive across borders.Founded in Melbourne with a global presence spanning 26 offices, our diverse team of over 2,000 talented professionals is on a mission to revolutionize the way businesses manage their financial operations. With a valuation of US$8 billion and support from top-tier investors, we are at the forefront of building the financial platform of the future. Join us and take on challenging projects that will redefine the global banking landscape.
The Economist Group
Join The Economist Group as a Principal Product Manager specializing in Search & Discovery. In this pivotal role, you will lead the development and execution of innovative product strategies that enhance user experiences and drive engagement across our platforms. You will work closely with cross-functional teams to identify user needs, define product vision, and prioritize features that align with business goals.
Join our dynamic team at NCS as a Data Center IT Operator!If you are passionate about exceeding expectations, striving for excellence, and seamlessly integrating people with technology, we want to hear from you!Your responsibilities will include:Providing 24/7 operational support for Data Center (DC) activities during shifts.Managing the IT equipment hardware inventory within individual racks at the Data Center.Overseeing on-site activities such as site preparations, network cabling, electrical wiring, air-conditioning, power supply testing (including generators), and system maintenance.Coordinating preventive maintenance for downstream infrastructure, including UPS systems, water detection systems, fire suppression systems, PDUs, CCTV, and access control systems.Operating the Electronic Visitation Management System, ensuring timely and accurate updates for authorizations and access requests.Providing Remote Hand Support, including media management, visual inspections, rebooting devices, physical connections/disconnections of HDDs, network cable connectivity tests, and fiber SFP insertions.Handling media with integrity to ensure data security and usability for future use, including off-site storage.Monitoring Data Center facilities for optimal performance, including UPS, power, temperature control, humidity, and water detection sensors.Monitoring IT systems and network infrastructure for incidents.Escalating incidents as necessary, ensuring timely responses and appropriate resolution based on criticality and Service Level Agreements (SLAs).Managing escalations of high-impact system failures, tracking incidents until resolution.
Join CSIT, where we are dedicated to enhancing the national security of Singapore through innovative software solutions. Our products play a crucial role in various applications, particularly in counter-terrorism and computer network defense. We are seeking skilled Senior Software Engineers to spearhead the development of mission-critical systems that detect, analyze, and investigate threats effectively.
Airwallex
About AirwallexAirwallex stands as the premier unified payments and financial platform tailored for global enterprises. Our innovative blend of proprietary infrastructure and cutting-edge software empowers over 200,000 businesses worldwide, including industry leaders like Brex, Rippling, Navan, Qantas, and SHEIN. Our fully integrated solutions facilitate the management of everything from business accounts to payments, spend management, treasury services, and embedded finance on a global scale.Founded in Melbourne, our team comprises over 2,000 of the most talented and innovative professionals in technology, spread across 26 offices globally. Valued at $8 billion and supported by renowned investors such as T. Rowe Price, Visa, Mastercard, Robinhood Ventures, Sequoia, Salesforce Ventures, DST Global, and Lone Pine Capital, Airwallex is at the forefront of creating the future of global payments and financial solutions. If you're ready to engage in the most ambitious work of your career, we invite you to join us.Attributes We ValueAt Airwallex, we seek dynamic builders who possess an entrepreneurial spirit and a desire for genuine impact, rapid learning, and true ownership of their work. You will bring substantial expertise and sharp analytical skills, driven by our mission and operating principles. Your ability to move swiftly with sound judgment, coupled with a deep curiosity and a principle-based decision-making approach, will be crucial as you balance speed with thoroughness.You are collaborative and humble, adept at transforming innovative concepts into tangible products, with a strong track record of executing projects from start to finish. Utilizing AI to optimize efficiency and problem-solving is second nature to you. In this role, you will confront complex, high-impact challenges alongside exceptional team members, fostering your career as we revolutionize the global banking landscape. If this resonates with you, let’s create the future together.Role OverviewTo facilitate Airwallex's ongoing global growth and operational efficiency, we are searching for a skilled and highly motivated Data Operations Associate to join our Data Operations team in Singapore.In this position, you will oversee intricate data pipelines, reporting systems, and automation projects that bolster key global functions. Your contributions will be vital in designing scalable, reliable, and automation-centric data solutions, ensuring high data quality, operational efficacy, and regulatory compliance within a rapidly evolving fintech environment.
About AirwallexAirwallex stands as the premier unified payments and financial platform tailored for global enterprises. Our innovative blend of proprietary infrastructure and software enables over 200,000 businesses globally—including esteemed names like Brex, Rippling, Navan, Qantas, and SHEIN—to seamlessly manage everything from business accounts and payments to spend management and treasury, all while facilitating embedded finance on a grand scale.Founded in Melbourne, our team comprises over 2,000 of the brightest minds in technology, operating across 26 offices worldwide. With a valuation of US$8 billion and support from top-tier investors such as T. Rowe Price, Visa, Mastercard, Robinhood Ventures, Sequoia, Salesforce Ventures, DST Global, and Lone Pine Capital, Airwallex is at the forefront of revolutionizing the global payments and financial services landscape. If you’re prepared to embark on the most ambitious journey of your career, come join us.Attributes We ValueWe seek out dynamic builders with an entrepreneurial spirit who desire meaningful impact, rapid learning, and true ownership of their work. You should possess strong technical expertise and keen analytical skills, and be driven by our mission and operating principles. Your speed and sound judgment, paired with an insatiable curiosity, will empower you to make decisions grounded in first principles, effectively balancing pace with thoroughness.Collaboration and humility are key; you will transform innovative concepts into tangible products, executing projects from inception to completion. Leveraging AI, you will optimize your workflow and expedite problem-solving. Here, you will engage with complex, high-stakes challenges alongside exceptional colleagues, fostering your professional growth as we shape the future of global banking. If this resonates with you, let’s create what comes next.Who You Are & Role OverviewAs part of the Platform Engineering team, you will be pivotal in designing Airwallex’s next-generation foundational infrastructure. We are advancing beyond conventional pipelines to establish a robust, distributed ecosystem that facilitates real-time AI enablement and global financial data management.Our goal is to redefine the limits of distributed storage, stream processing, and service-layer interfaces. We are in search of 'Engineers’ Engineers'—visionaries who relish delving into the intricacies of distributed systems, enhancing JVM performance, and implementing resilient architectural frameworks such as Lakehouse and real-time data.
Join our dynamic AI Engineering team as a Senior Software Engineer, where you'll be at the forefront of developing, deploying, and maintaining cutting-edge applications and AI/ML services, including large language model (LLM) services. Your expertise will help build data pipelines that support scalable production AI services while providing essential development tools for our data scientists and product engineers. You'll be tasked with designing and implementing these systems with a focus on performance, reliability, and maintainability, all while employing effective unit, integration, and performance testing methodologies.
PitchBook Data
At PitchBook, a part of Morningstar, we are driven by our forward-thinking vision. Our commitment to innovation, growth, and self-investment enables us to unlock everyone's potential. Our collaborative spirit fosters an exciting, energetic, and enjoyable work environment.We provide extensive learning and mentorship programs that cultivate a culture of curiosity, inspiring us to discover new solutions and improve our processes. As we navigate a rapidly evolving industry, we embrace the challenges and uncertainties, excelling as we push our boundaries. We are unafraid to take risks, learn from our failures, and pursue excellence relentlessly.If you possess a positive attitude and a readiness to take initiative, PitchBook is the perfect place for you.About the Role:At PitchBook, we recognize that the Data Operations team is crucial in differentiating us from our competitors. We take great pride in delivering high-quality data to our clients, emphasizing accountability, collaboration, and receptiveness to feedback. Our team members are engaged, detail-oriented, and eager to learn and adapt as the industry evolves.Our esteemed reputation is a testament to our dedication to constructing the premier private market database, and we understand the significance of investing in our team from day one. That's why we offer specialized training and a mentorship program tailored to the unique needs of the Data Operations team.We celebrate the diverse perspectives, skills, and experiences our team members bring and understand the importance of cultivating trust and strong cross-functional partnerships. If you're seeking a challenging and rewarding opportunity to elevate your career, we welcome you to join us at PitchBook.
nascompany
Join our innovative team as a Data Engineer at nascompany, where your expertise will help drive data solutions that empower our business decisions. You will play a critical role in designing, constructing, and maintaining scalable data pipelines and architectures. Collaborate with cross-functional teams to enhance data accessibility and ensure data quality.
Role overview asm is seeking a Lead, Operations Intelligence Data Governance to join the team in Singapore. This position is responsible for strengthening data governance across operational teams. The focus is on maintaining data integrity, meeting compliance requirements, and enabling effective data use to support business objectives. What you will do Lead efforts to improve data governance practices across operations Ensure data accuracy, security, and compliance with relevant policies Develop and update data policies, standards, and guidelines Provide guidance and support to teams on data management best practices Location This role is based in Singapore.
Join Rapsodo, a leading innovator in Sports Technology, where we empower athletes globally through our state-of-the-art sports analytics products. With offices in the USA, Singapore, Turkey, and Japan, we specialize in creating data-driven, portable, and user-friendly solutions that cater to athletes at all levels—from aspiring youth to elite professionals. Our technology is trusted by coaches and athletes alike, delivering real-time insights that enhance performance in sports such as Major League Baseball and golf.We are a dynamic and rapidly expanding team that values creativity and collaboration. As a Senior Software Engineer specializing in C++, you will play a pivotal role in designing, developing, and integrating high-performance software modules for our sports analytics systems. Your expertise will be crucial in low-latency, multithreaded environments, and your work will encompass the entire software development lifecycle—from conceptualization and architecture to deployment and optimization. Collaborating with cross-functional teams, you will help deliver seamless, data-driven experiences for athletes and coaches worldwide.
Overview We invite skilled and dedicated individuals to join our team as Data Center Operations Shift Technicians. In this critical role, you will be responsible for supporting daily operations in our data center. You will work on a 12-hour rotating shift schedule to ensure optimal functionality, manage incidents efficiently, and uphold the high availability of our data center facilities and systems.Responsibilities Execute daily operational tasks, including ticket management, infrastructure monitoring, and remote hands assistance. Analyze and resolve incidents, escalating any complex issues to internal teams or vendors when necessary. Perform regular health checks and document any anomalies in data center facilities, IT, and network systems. Assist with equipment setup and relocation tasks, including rack stacking, intra-rack cabling, power cycling, and related activities. Supervise and escort vendors, contractors, and customers during their visits, deliveries, and installations. Carry out planned and on-the-fly maintenance activities in alignment with established SOPs/MOPs. Maintain detailed documentation of operational activities, update SOPs/EOPs, and ensure effective shift handover reporting. Engage in competency assessments, audits, and operational reviews. Adhere to safety protocols, PPE requirements, and the company code of conduct. Qualifications A minimum of ITE or Polytechnic Diploma in Engineering or a related field. 1 to 2 years of relevant experience in a Data Center environment. Proficiency with ticketing tools, monitoring systems, and incident escalation processes. Hands-on experience with cabling, power cycling, hot swapping, tape management, and basic server/network troubleshooting. Excellent verbal and written communication skills in English. Willingness to commit to 12-hour rotating shifts (day/night) and be available for standby as needed.
Job OverviewJoin Cygnify as a Data Platform Engineer, where you will manage expansive big data platforms within hybrid environments, ensuring seamless analytics and data-driven insights. Collaborate with data engineers, scientists, infrastructure, security, and business teams to uphold data integrity, platform reliability, and operational excellence. This position emphasizes the development, management, and optimization of production-grade data platforms and pipelines with a strong focus on infrastructure, automation, and reliability.Core ResponsibilitiesDesign and manage scalable data platform infrastructure and pipelines across both on-premises and cloud setups.Oversee the complete lifecycle of the platform including architecture, deployment, operations, performance tuning, and reliability engineering.Support data platform clusters and nodes (compute, storage, networking) to ensure high availability and optimal performance levels.Provision and manage cloud data services such as AWS S3 and Redshift.Monitor platform performance, health, and capacity; establish observability, alerting, and operational runbooks to maintain system reliability.Enhance and support ETL/ELT pipelines, ensuring consistent data ingestion, transformation, and delivery.Operate and maintain both on-premises and cloud data storage platforms to ensure durability and scalability.Implement security best practices including IAM, VPC configurations, encryption, backup strategies, and disaster recovery.Ensure adherence to data governance and regulatory mandates (e.g., PDPA) in collaboration with infrastructure and security teams.Work closely with cross-functional teams to align platform capabilities with business and analytical requirements.Create and maintain comprehensive technical documentation covering system architecture, data flows, configurations, and operational procedures.
PitchBook Data, a Morningstar company
At PitchBook, part of the esteemed Morningstar family, we are committed to forward-thinking innovation, continuous evolution, and substantial investment in our team members to unlock their full potential. Our collaborative culture thrives on excitement, energy, and a sense of fun that resonates throughout our organization. Our robust learning programs and mentorship opportunities foster a culture of curiosity, motivating us to discover new solutions and enhance our methodologies. In an ever-evolving industry marked by high aspirations, we embrace ambiguity and excel in self-challenge. We are unafraid to take calculated risks, learn from our failures, and strive for excellence repeatedly. If you possess a proactive attitude and are ready to engage in hands-on work, PitchBook is the ideal environment for you. About the Role:At PitchBook, we acknowledge that the Data Operations team is crucial to distinguishing us from our competitors. We take great pride in delivering exceptional data to our clients while maintaining accountability, collaboration, and openness to feedback. Our team comprises highly engaged, detail-oriented individuals who are always eager to learn and adapt as our industry progresses.Our esteemed reputation is a direct result of our unwavering commitment to developing the world’s premier private market database. We understand the significance of investing in our team members from the outset. Therefore, we provide specialized training and a mentorship program tailored specifically to the Data Operations team.We appreciate and celebrate the diverse perspectives, talents, and experiences of our team members and recognize the importance of establishing trust and strong cross-functional collaborations. If you seek a challenging yet rewarding opportunity to elevate your career, we welcome you to join us at PitchBook.
Join us as a Data Engineer at fuku, a dynamic and rapidly growing global consumer internet platform based in Singapore. This exciting role is focused on enhancing our data engineering capabilities to support millions of users across diverse ecosystems including content, community, e-commerce, and advertising.As we expand our international footprint, data has become a pivotal element for our decision-making and growth strategies. You will play a vital role in architecting a cutting-edge global data platform, crucial for driving user growth and optimizing commercial activities. Your expertise will be essential in designing and scaling robust data warehouse architectures and governance systems, empowering business teams worldwide to leverage data effectively.Key ResponsibilitiesFoundational Data Platform & Common Data Layer: Design, develop, and sustain the foundational data platform and shared data structures. Enhance the performance and stability of data operations across core business domains including community, e-commerce, and advertising.Domain Data Warehousing & Data Products: Collaborate with business units to lead the creation of domain-specific data warehouses. Construct data products and analytical models, providing accurate datasets and services that facilitate strategic decision-making.Data Governance Framework: Establish a comprehensive data governance framework that integrates business needs, metadata management, and technical implementation while consistently optimizing data quality, security, and efficiency.
Sign in to browse more jobs
Create account — see all 1,895 results

