Senior Data Engineer - AWS

Join our dynamic team at UBDS Group as an AWS Data Platform Engineer, where you’ll leverage your expertise to design, implement, and enhance AWS cloud infrastructure and CI/CD pipelines. This pivotal role emphasizes AWS-native data services, infrastructure automation, and orchestration to facilitate large-scale data operations.Key Responsibilities: Provision, manage, and optimize AWS data services: S3, Redshift, OpenSearch, Athena, Lambda, Glue, and Batch. Implement Infrastructure as Code (IaC) using Terraform. Manage orchestration workflows through Apache Airflow. Support and maintain CI/CD pipelines and version control with GitLab. Monitor core services including security file scanning for S3, data infrastructure access, and usage patterns. Oversee infrastructure supporting Data Engineering workflows, focusing on disaster recovery and performance enhancements. Collaborate with Data Engineering, SRE, and Security teams to ensure secure and efficient data operations. Diagnose and resolve incidents related to AWS data infrastructure. Participate in documentation and process improvements. Manage access and Role-Based Access Control (RBAC). Requirements: Demonstrated hands-on experience with AWS native data services such as S3, Redshift, OpenSearch, Athena, Lambda, Glue, Batch, Step Function, SQS, CloudWatch, CloudTrail, and EMR. Proficient in using Terraform for Infrastructure as Code. Experience with Airflow for DAG orchestration and monitoring. Familiarity with YAML for CI/CD pipelines (e.g., GitLab CI/CD, GitHub Actions). Proficient in Python, SQL, and Bash for automation, querying, and troubleshooting. Strong understanding of AWS Security best practices, IAM policies, and RBAC. Knowledge of AWS Networking and VPC. Experience with containerization technologies such as Docker. Experience with Disaster Recovery, backups, and snapshots. Desirable Skills: Familiarity with AWS Neptune and EKS. Experience with Jira Service Desk. Experience in supporting Data Engineers. Consulting experience is a plus. Ability to produce README and Confluence documentation. Soft Skills: Exceptional problem-solving and troubleshooting abilities. Able to thrive in an Agile environment. Skilled in stakeholder management. Excellent communication and collaboration skills. Benefits:At UBDS Group, we pride ourselves on being a forward-thinking organization that nurtures talent and encourages growth. Join us to be part of innovative projects that shape the future of data.

We are seeking a talented and motivated Mid-Level AWS Data Engineer to join our dynamic team at Capco in London. As a key player in our data engineering initiatives, you will work on cutting-edge projects that leverage AWS technologies to transform data into actionable insights. You will collaborate with cross-functional teams to design and implement robust data pipelines, ensuring data integrity and accessibility.

With Intelligence, now a part of S&P Global, is at the forefront of revolutionizing data offerings for participants in alternatives and private markets. As a member of a global organization boasting over 35,000 employees, we possess the unique ability to understand intricate nuances while maintaining a wide-ranging perspective. We empower our clients to assess new investment opportunities within the capital and commodities markets, navigate the energy sector's expansion, harness the acceleration of artificial intelligence, and adapt to the evolving landscape of public and private markets. Our mission is to advance essential intelligence.We are embarking on an exciting phase of growth, with significant funding aimed at transforming us into a pioneering, data-centric platform that places information, automation, and insights at its core.To meet the escalating demands of a dynamic, data-driven organization, we are expanding our data capabilities. This role is an outstanding opportunity for an enthusiastic individual ready to make a tangible impact while engaging with cutting-edge tools and contributing to our data strategy across products and teams.Your ResponsibilitiesDesign, develop, and maintain scalable data architectures and ETL pipelines.Build and manage data models and data warehouse solutions utilizing Airflow, dbt, and Redshift.Write clean, efficient Python and SQL code for data processing and transformation.Integrate data from internal and third-party APIs and services.Optimize data pipelines for performance, scalability, and reliability.Collaborate with data scientists, analysts, and engineering teams to fulfill business requirements.Implement and uphold data security and compliance standards.Utilize version control systems (e.g., Git) to manage and maintain project codebases.Contribute to the ongoing enhancement of data processes and tooling across the organization.

About Caxton Associates:Founded in 1983, Caxton Associates is a premier global trading and investment firm, with a presence in key financial hubs including New York, London, Bengaluru, Monaco, Singapore, and Dubai. Our firm is dedicated to managing client and proprietary capital, offering a diverse range of products specifically tailored to meet the unique needs of our investors. By employing a multi-portfolio manager framework, we excel in discretionary global macro investing, leveraging extensive expertise across various asset classes and markets.About the Role:We are on the lookout for a skilled Database Engineer to enhance our London-based technology team. This hands-on position is pivotal in the design, development, and optimization of the company's core data platforms. You will be instrumental in shaping and scaling our data architecture, directly influencing trading and investment decisions. Candidates must possess strong technical skills, a keen eye for data quality, and the ability to thrive in a dynamic, high-stakes environment.

Join Our Dynamic Team as a Senior AWS Platform EngineerLocation: London, UK (Hybrid – typically ~1 day per week on-site)Contract Type: Permanent, Full-timeSalary Package: £75,000 – £90,000 + 10% Bonus + 10% Equity + Additional BenefitsAbout AppviaAt Appvia, we specialize in cloud and platform engineering consultancy, empowering organizations to effectively build, secure, and scale their operations in the cloud. We collaborate with both public and private sector clients to craft cutting-edge cloud platforms, integrate robust engineering practices, and accelerate software delivery.Our expertise lies in platform engineering, DevOps, automation, and cloud-native solutions, establishing a balance between developer agility, security, resilience, and governance.Role OverviewAs a Senior AWS Platform Engineer, you will play an integral role in our platform engineering projects, taking a hands-on approach in designing, building, and managing secure and scalable AWS environments. This position is perfect for an experienced engineer who thrives on tackling intricate technical challenges and collaborating closely with development teams to enhance cloud platforms and delivery pipelines. You will work within multidisciplinary teams, supporting application and platform workloads while guiding customers in adopting modern DevOps and platform engineering methodologies.Your responsibilities will include leading technical deliveries, contributing to solution design, and mentoring junior engineers through knowledge sharing.Interview Process - 4 StagesInitial discussion with Talent AcquisitionTechnical assessment paired with an Engineering team memberIn-depth technical interview with Practice LeadershipFinal competency-based interview with Engineering LeadershipImportant NoteTo be considered for this role, you must either possess an active SC clearance or be eligible for SC, which requires:British Passport or Indefinite Leave to RemainResidence in the UK for at least the last 5 yearsNo criminal convictionsNo financial irregularitiesCandidate ProfileYou are a proficient AWS engineer with a strong background in cloud-native infrastructure and DevOps, comfortable in client-facing environments and directly contributing to project delivery. You will offer:Demonstrable experience in building and operating AWS platformsA comprehensive understanding of modern CI/CD and automation practicesConfidence in collaborating with engineers, architects, and project leadsA pragmatic mindset towards enhancing reliability, security, and developer experienceKey ResponsibilitiesDesign, build, and maintain secure AWS platformsCollaborate with cross-functional teams to deliver high-quality solutionsMentor and guide junior engineersContinuously improve and optimize platform performance

yuno is looking for an Engineering Manager to join the Data Platform team in London. This position centers on strengthening the company’s data infrastructure, which is essential for collecting, managing, and using data across multiple products and teams. Role overview The Engineering Manager will oversee a group of engineers dedicated to the development and performance of yuno’s data platform. The work involves guiding the team through the design and implementation of data systems that are both scalable and reliable. What you will do Lead and support a team working on the data platform’s development and ongoing performance. Direct the design and rollout of data systems built for scale and reliability. Encourage a collaborative and creative team culture. Ensure delivery of data solutions that align with business goals. Location This role is based in London.

Join Storio Group as an Engineering ManagerRole Overview:We are on the lookout for a skilled Engineering Manager specializing in Data to lead our dynamic London-based data team. Your primary focus will be to develop and enhance a platform that fosters a decentralized data adoption model throughout our organization.At Storio, we prioritize delivering reliable and actionable data that fulfills business requirements. We’re eager for you to build and manage a high-performing team dedicated to this objective. If you have a background in software engineering management with a focus on data, we would love to hear from you!Our data and AI team is expanding across the UK and the Netherlands, serving as the backbone for various data-driven consumers and platforms within Marketing, Finance, Operations, and Product teams.Our AI photo services are pivotal to enhancing customer experience, and we are broadening our efforts towards decentralized machine learning adoption within the business. Following a series of mergers, our team has unified and is transitioning from a phase of simplifying legacy systems to a stage of consolidation and growth.Our Technology Stack:• Cloud Data Warehouse - Snowflake• AWS Data Solutions - Kinesis, SNS, SQS, S3, ECS, Lambda• Data Governance & Quality - Collate & Monte Carlo• Infrastructure as Code - Terraform• Data Integration & Transformation - Python, DBT, Fivetran, Airflow• CI/CD - Github Actions / Jenkins

Recursion Pharmaceuticals brings together technology and biology to advance drug discovery. The company’s Recursion Operating System combines machine learning, large-scale experiments, and a proprietary dataset that spans biological, chemical, and patient-related data. Each week, the team conducts millions of wet lab experiments and uses a supercomputing environment to find new connections in biology and chemistry. What you will do Develop, scale, and manage the core data platform. This includes building, operating, and optimizing systems that support querying and exploration across Recursion’s vast datasets, such as a chemistry library with billions of compounds, petabytes of microscopy images, and diverse assay results. Help make complex datasets accessible for scientific teams. Work closely with biologists, chemists, and data scientists to ensure data from different biological models and treatments can be explored and queried, even for new and evolving research questions. Mentor and support colleagues by sharing technical expertise and experience, helping others grow and increasing impact across teams. The team This role joins the Data Lake team, responsible for building and maintaining Recursion’s Data Lake and Data Lakehouse. The group manages both relational and object storage, ensuring all data is discoverable, queryable, and connected. As Recursion grows, the team integrates new data types under the guiding principle that all data flows to the Data Lake. Location London, England; Milton Park, England

Role overview As a Staff Engineer on the Data Platform team at yuno in London, the focus is on designing and developing scalable data solutions. These systems help internal teams operate more efficiently and contribute to product improvements across the company. This position involves hands-on work with technical architecture, providing the chance to influence how data systems are built and maintained. Projects in this role are closely tied to business goals, with a direct impact on yuno’s progress. Key responsibilities Build and maintain scalable data platforms to support internal stakeholders Contribute to the design and evolution of technical architecture Work on projects that drive product and business growth Location This role is based in London.

Join our dynamic Data Processing Product Area at Spotify, where we create innovative platforms and tools that transform the way we process, manage, and leverage data on a massive scale. Our team empowers various departments within Spotify to tackle intricate data challenges with assurance. We emphasize enhancing efficiency, quality, and innovation, enabling engineers and data professionals to accelerate their work while ensuring reliability and cost-effectiveness.

Role Overview Spotify is looking for a Backend Engineer to join the Data Platform team in London. This position focuses on building and improving the backend systems that power Spotify’s data processing and analytics. The work supports a seamless experience for millions of listeners around the globe. What You Will Do Develop and maintain scalable backend systems for data processing and analytics. Work closely with cross-functional teams to optimize Spotify’s data infrastructure. Help ensure high availability and strong performance across backend services. About the Team The engineering team at Spotify values collaboration and technical excellence. The Data Platform group plays a key role in supporting the company’s ability to deliver music and insights at scale.

Role overview Wise is hiring a Data Platform Engineer focused on the Database Platform, working primarily with Python. This role centers on improving data processes, maintaining strong performance, and supporting scalable solutions. The work involves close collaboration with teams across the business to deliver reliable and efficient data systems. What you will do Optimize and streamline data workflows for better performance and scalability Work with cross-functional teams to implement effective data solutions Contribute technical expertise to improve Wise’s data architecture Location This position is based in London.

Job Title: Engineering Manager - Data Platform & Analytics Engineering Location: London, Bristol or Edinburgh (Hybrid options available) Salary: £92,800 - £115,000 Reporting to: Head of Data Science & Products Eligibility: Must have the right to work in the UK; visa sponsorship is currently not available. Kaluza is at the forefront of reshaping the energy landscape through our Energy Intelligence Platform. We empower energy companies to navigate the complexities of modern energy demands while driving the transition to a sustainable, electrified future. Utilizing cutting-edge Data, AI technologies, and real-time decision-making, we convert energy challenges into growth opportunities for our partners. Our innovative approach combines predictive algorithms with user-centric design, ensuring that clean energy remains reliable and affordable. With a diverse team spanning Europe, North America, Asia, and Australia, and a strategic partnership with Mitsubishi Corporation in Japan, we are proud to support industry leaders such as OVO, AGL, and ENGIE, along with pioneering companies like Volvo and Volkswagen. Join the Kaluza Data Community: Data is pivotal to our mission, and we seek curious minds who can transform data into actionable insights and strategies. You will be instrumental in enhancing the Kaluza platform, a pioneering technology designed to revolutionize energy retail operations globally, with a focus on regional adaptability and decarbonization efforts.

Join Spotify as a Senior Fullstack Engineer and play a pivotal role in developing our innovative Data Platform. You will collaborate with cross-functional teams to design and implement robust solutions that enhance our data processing capabilities. This is an exciting opportunity to work with cutting-edge technologies in a dynamic environment.

Recursion Pharmaceuticals is reimagining drug discovery by combining biology and data in new ways. The Senior Scientific Data Engineer - Data Platform will help shape and maintain the data infrastructure that drives this mission. This position is based in either London or Oxford. Role overview This role focuses on designing, developing, and maintaining scientific data systems that underpin Recursion’s research and product development. The emphasis is on data architecture rather than machine learning or model building. The work involves: Managing the ingestion, standardization, and distribution of public and proprietary datasets essential for drug discovery. Enabling competitor intelligence, chemical tractability analysis, and compound design workflows through well-structured data products. Owning and evolving the data infrastructure that supports predictive modeling and machine learning across the company. This position suits engineers who enjoy building complex scientific data systems. It is not a modeling or data science role. Key data systems and products Flagship SAR Data Mart: Integrates commercial and public bioactivity databases (such as ChEMBL) with internal assay results. Commercial Vendor Data Mart: Maintains a catalog of purchasable compounds for internal design tools and tractability assessments. Biomedical Knowledge Graph: Offers semantic graph infrastructure connecting targets, diseases, and compounds to support AI-driven research. Chemical Synthesis Data: Stores reaction datasets for training retrosynthesis models and predicting chemical tractability. Patent Intelligence System: Converts patent feeds and competitor data into actionable insights for research and strategy. Compound Standardization Registry: Maintains a large-scale chemical structure repository to ensure consistency across billions of compounds, similar to UniChem. Important note This is a specialized Data Engineering position focused on data infrastructure and stewardship. The work does not include training or building predictive models, but it directly supports those efforts through reliable systems and curated datasets.

Checkout.com supports online payments for major brands including eBay, ASOS, Klarna, Uber Eats, and Sony, processing billions of transactions every year. With a presence in 19 offices across six continents and headquarters in London, the company emphasizes high performance, continuous improvement, and innovation. Employees contribute directly to shaping the future of fintech. Role overview The Senior Engineering Manager - Data Platform leads the Data and AI Platform Team. This group provides the systems and tools that enable products, merchants, and internal teams to make effective use of data and AI. The goal is to maximize time spent on innovation and solving business problems, while reducing the complexity of technical implementation, deployment, and monitoring. As Checkout.com grows, the Data Platform must scale to support hundreds of teams and manage petabyte-scale data volumes. What you will do Guide the team in designing technical architecture and building user-focused systems and tools. Oversee technical delivery and operational reliability, driving process automation and maintaining high engineering standards. Ensure service levels (SLAs/SLOs) are met with minimal manual intervention. Manage a team of Junior and Senior Data Engineers, providing hands-on support when needed. Foster an inclusive culture and mentor team members in both technical and interpersonal development. Lead quarterly execution of roadmap deliverables, ensuring alignment with business objectives. Location This position is based in London.

Join Spotify as a Senior Android Engineer within our innovative Data Platform team. In this role, you will leverage your extensive Android development experience to enhance our data services and deliver optimal user experiences. You will collaborate with cross-functional teams, including product managers and data scientists, to design and implement robust solutions that support our growing user base.

Join Relay in Revolutionizing Logistics!At Relay, we are fundamentally transforming the way goods are transported in the digital age. With the backing of Europe’s largest logistics Series A funding ($35M) from visionary investors like Plural—whose portfolio ranges from fusion energy to space exploration—we are growing at an unprecedented pace, surpassing 99.98% of venture-backed startups. We are building an exceptionally talented team that is setting new benchmarks in the logistics sector.Our Mission is to eliminate barriers to commerce. Currently, high delivery costs function as a hidden tax on e-commerce, dictating what can be sold online and who can engage in this space. We aspire to create a world where goods move freely among people, ensuring a seamless and accessible online shopping experience for all.The Team• A dynamic team of approximately 110 individuals, over half of whom are in engineering, product, and data roles.• Home to 45+ advanced degrees in fields such as computer science, mathematics, and operations research.• Handling thousands of data points for each parcel we manage, with extensive calculations, analyses, and predictions.• A culture that thrives on first-principles thinking, rapid feedback loops, and relentless experimentation.Your OpportunityAt Relay, our network generates data at every interaction—couriers, routes, parcels, sortation, pricing, and demand signals. This data serves as the foundation for every decision we make, especially as we increasingly integrate AI systems for autonomous decision-making.As the Head of Data Platform, you will oversee the infrastructure that transforms raw data into actionable insights. This includes managing the transformation layer (dbt), the semantic layer (Cube), the pipelines that supply them, and the standards that ensure the output is reliable. You will be tasked with ensuring data readiness for human analysts, dashboards, machine learning models, and autonomous agents.This is a pivotal leadership role where you will inherit a high-performing engine. The platform currently supports critical decision-making across all departments, backed by a robust dbt architecture and a semantic layer with strict naming conventions. Your mission is to elevate this 'V1' success into a world-class platform that remains the ultimate source of truth as our complexity scales.You will lead a team of dedicated data and analytics engineers who possess deep technical expertise and take great pride in their work. They are autonomous and have a clear vision of excellence. What they need is a leader who can...

LemFi (Series B) is on a mission to revolutionize financial services for the Global South.Relocating to a new country should not mean starting from square one. Our dedicated team of over 400 professionals across 20+ countries is crafting a financial ecosystem designed to empower immigrants to maintain connections to their home countries, establish stability, and build wealth, irrespective of their origin or current residence.What started as a platform for swift and affordable remittances is now transforming into a comprehensive solution for multi-currency accounts, seamless payments, credit options, and long-term financial prosperity.With millions of users worldwide, we facilitate over $1 billion in transactions monthly across 30+ countries, demonstrating that financial opportunities should transcend borders.Your RoleAs a Senior Platform Engineer at LemFi, you will play a crucial role in designing, building, and enhancing the cloud infrastructure that enables global money transfers at scale.Your objective is to develop a secure, scalable, and cost-efficient AWS cloud platform that empowers engineers to deploy solutions rapidly while adhering to the operational and regulatory standards expected of a leading fintech organization.Beyond mere infrastructure maintenance, you will create a self-service internal cloud platform that boosts reliability, fortifies security, and ensures our systems are resilient as we manage billions in global transactions.How You'll Make an ImpactDesign and scale robust AWS infrastructure with an emphasis on reliability, security, and cost-efficiency.Develop and uphold Infrastructure as Code (Terraform / CloudFormation) ensuring that modifications are auditable and reproducible.Enhance our observability features (monitoring, logging, alerting, tracing) and fortify SLO-driven reliability.Advance our CI/CD pipelines and contribute to the development of our Internal Developer Platform.Assist in incident response, disaster recovery, and compliance with standards such as GDPR, PCI DSS, SOC2, DORA, ISO27001.Who You AreOwnership-driven — you take initiatives from design through to production.Proactive and innovative — always looking for ways to enhance processes and systems.