Senior Data Engineer

Join our team as a Senior Data Engineer specializing in AWS!Location: London (Hybrid) | Practice Area: Technology & Engineering | Type: PermanentAbout the RoleWe are seeking a talented Senior Data Engineer with expertise in AWS to be a key player in our dynamic team of engineering professionals. You will spearhead the design, construction, and deployment of innovative cloud-based data pipelines that drive transformative outcomes for Tier 1 financial services clients. Your contributions will significantly enhance data ingestion, transformation, and delivery at scale across the financial services landscape.Your ResponsibilitiesDesign and implement end-to-end data pipelines using AWS-native tools and cutting-edge data architectures.Collaborate closely with clients to gather requirements, craft tailored solutions, and deploy production-ready systems.Utilize AWS Well-Architected Principles to ensure your solutions are scalable, secure, and resilient.Lead the development of robust, thoroughly tested, and fault-tolerant data engineering solutions.Mentor junior engineers, fostering a culture of knowledge sharing and continuous learning within the team.What We Seek

With Intelligence, now a part of S&P Global, is at the forefront of revolutionizing data offerings for participants in alternatives and private markets. As a member of a global organization boasting over 35,000 employees, we possess the unique ability to understand intricate nuances while maintaining a wide-ranging perspective. We empower our clients to assess new investment opportunities within the capital and commodities markets, navigate the energy sector's expansion, harness the acceleration of artificial intelligence, and adapt to the evolving landscape of public and private markets. Our mission is to advance essential intelligence.We are embarking on an exciting phase of growth, with significant funding aimed at transforming us into a pioneering, data-centric platform that places information, automation, and insights at its core.To meet the escalating demands of a dynamic, data-driven organization, we are expanding our data capabilities. This role is an outstanding opportunity for an enthusiastic individual ready to make a tangible impact while engaging with cutting-edge tools and contributing to our data strategy across products and teams.Your ResponsibilitiesDesign, develop, and maintain scalable data architectures and ETL pipelines.Build and manage data models and data warehouse solutions utilizing Airflow, dbt, and Redshift.Write clean, efficient Python and SQL code for data processing and transformation.Integrate data from internal and third-party APIs and services.Optimize data pipelines for performance, scalability, and reliability.Collaborate with data scientists, analysts, and engineering teams to fulfill business requirements.Implement and uphold data security and compliance standards.Utilize version control systems (e.g., Git) to manage and maintain project codebases.Contribute to the ongoing enhancement of data processes and tooling across the organization.

Join our dynamic team at UBDS Group as an AWS Data Platform Engineer, where you’ll leverage your expertise to design, implement, and enhance AWS cloud infrastructure and CI/CD pipelines. This pivotal role emphasizes AWS-native data services, infrastructure automation, and orchestration to facilitate large-scale data operations.Key Responsibilities: Provision, manage, and optimize AWS data services: S3, Redshift, OpenSearch, Athena, Lambda, Glue, and Batch. Implement Infrastructure as Code (IaC) using Terraform. Manage orchestration workflows through Apache Airflow. Support and maintain CI/CD pipelines and version control with GitLab. Monitor core services including security file scanning for S3, data infrastructure access, and usage patterns. Oversee infrastructure supporting Data Engineering workflows, focusing on disaster recovery and performance enhancements. Collaborate with Data Engineering, SRE, and Security teams to ensure secure and efficient data operations. Diagnose and resolve incidents related to AWS data infrastructure. Participate in documentation and process improvements. Manage access and Role-Based Access Control (RBAC). Requirements: Demonstrated hands-on experience with AWS native data services such as S3, Redshift, OpenSearch, Athena, Lambda, Glue, Batch, Step Function, SQS, CloudWatch, CloudTrail, and EMR. Proficient in using Terraform for Infrastructure as Code. Experience with Airflow for DAG orchestration and monitoring. Familiarity with YAML for CI/CD pipelines (e.g., GitLab CI/CD, GitHub Actions). Proficient in Python, SQL, and Bash for automation, querying, and troubleshooting. Strong understanding of AWS Security best practices, IAM policies, and RBAC. Knowledge of AWS Networking and VPC. Experience with containerization technologies such as Docker. Experience with Disaster Recovery, backups, and snapshots. Desirable Skills: Familiarity with AWS Neptune and EKS. Experience with Jira Service Desk. Experience in supporting Data Engineers. Consulting experience is a plus. Ability to produce README and Confluence documentation. Soft Skills: Exceptional problem-solving and troubleshooting abilities. Able to thrive in an Agile environment. Skilled in stakeholder management. Excellent communication and collaboration skills. Benefits:At UBDS Group, we pride ourselves on being a forward-thinking organization that nurtures talent and encourages growth. Join us to be part of innovative projects that shape the future of data.

We are seeking a talented and motivated Mid-Level AWS Data Engineer to join our dynamic team at Capco in London. As a key player in our data engineering initiatives, you will work on cutting-edge projects that leverage AWS technologies to transform data into actionable insights. You will collaborate with cross-functional teams to design and implement robust data pipelines, ensuring data integrity and accessibility.

Role overview Version 1 is hiring a Senior AWS Engineer to design, build, and manage scalable cloud systems for a varied client base. This role focuses on delivering practical AWS solutions that support clients’ business goals and digital transformation. Locations Positions are available in London, Birmingham, Manchester, Newcastle upon Tyne, Edinburgh, and Belfast.

We are seeking an experienced Senior AWS Engineer to join our dynamic team at Version 1. In this pivotal role, you will leverage your expertise in Amazon Web Services to design, build, and maintain innovative cloud solutions that meet the needs of our clients. You will collaborate closely with cross-functional teams to ensure seamless integration of AWS services, enhancing operational efficiency and driving scalability.As a Senior AWS Engineer, you will also mentor junior engineers, contribute to architectural decisions, and stay updated with the latest industry trends. Your contributions will directly impact the success of our projects and the satisfaction of our clients.

Role overview As a Senior Infrastructure Engineer (AWS) at umed, the focus is on building and maintaining the company’s cloud infrastructure. This position is fully remote and supports the London-based team. The main responsibilities involve designing, implementing, and managing scalable environments within AWS. What you will do Design and implement AWS infrastructure to meet evolving business requirements Manage and fine-tune cloud services to ensure high reliability and strong performance Collaborate with teams across umed to keep services available and responsive Incorporate security and compliance best practices into all infrastructure work Location This is a remote position, supporting the team in London, England, United Kingdom.

Role Overview Legal & General is hiring a Senior Engineer with expertise in MongoDB and AWS Serverless. This position is based in London. The role focuses on building and improving solutions that support core business needs. What You Will Do Develop and maintain systems using MongoDB and AWS Serverless technologies Work closely with teams from different disciplines to improve data operations Uphold high standards for quality and performance in all deliverables

Role overview hmgroup needs a Senior Data Engineer based in London to influence how data is used across the company. This position centers on building and maintaining systems that move and organize large amounts of data, helping teams make informed decisions. Main responsibilities Design and manage data pipelines that process significant data volumes Build architecture to ensure reliable data processing and analytics Convert raw data into insights that support teams throughout hmgroup

Join our innovative data engineering team as a Senior Data Engineer! We are looking for a talented professional to design, develop, and optimize data pipelines and workflows utilizing Databricks and AWS. You will play a pivotal role in enhancing our data processing capabilities while ensuring data quality, security, and compliance.Key Responsibilities:Provide L2 and L3 support within Data Engineering to troubleshoot and resolve production pipeline issues.Create and sustain high-performance data pipelines using Databricks.Collaborate with architects and analysts to construct data models and transformations.Ensure data quality, security, and compliance in Databricks environments.Implement monitoring and logging strategies for data pipeline reliability and performance.Deploy and manage code through CI/CD workflows.Efficiently troubleshoot and resolve complex data processing challenges.

About XYZ RealityXYZ Reality is an innovative, award-winning Series-A startup on the cusp of our next funding round. Our goal is to enhance our platform by improving its features, performance, and scalability, all while transforming the construction industry.As a dynamic multi-disciplinary organization, we operate across various fields such as cloud development, data governance, data processing pipelines, electronics, embedded software/hardware, mechanical design/manufacturing, AI & computer vision, and data science, all contributing to the efficacy of our Building Information Modeling (BIM) Platform.To help propel our mission, we are in search of a Senior Data Engineer who possesses extensive experience in data modeling, database management, and data pipeline development. The ideal candidate will play a pivotal role in maintaining our existing tech stack and developing new features with an emphasis on performance and scalability. Collaboration with our API/backend development and data pipeline teams will be crucial to create robust and efficient solutions.

Join Cloudscaler as an AWS Cloud Engineer!Location: London, UKAt Cloudscaler, located in the heart of London, we proudly serve clients across the UK. This role requires some travel to customer sites, varying by client, with potential onsite commitments of up to 3 days each week. Notably, one of our clients mandates an onsite presence in Bath once every two weeks.Salary: £45,000 - £70,000Security Clearance Requirements:Due to our collaborations with government entities, SC clearance is essential for our client-facing teams. While active SC clearance isn't required at the outset, candidates must be eligible to obtain it. Future roles may necessitate DV clearance, so a willingness to pursue this is a plus.Note: We can only accept applications from individuals based in the UK.About UsAt Cloudscaler, we specialize in AWS landing zones, cloud risk mitigation, and cloud operating models. As thought leaders, we partner with both public and private sector enterprises to help them fully leverage cloud technology.Why Join Us?We prioritize our people and believe that high-performance teams are forged through openness, collaboration, and trust. We offer ample opportunities for connection, idea sharing, and collaboration, both inside and outside of work. Our inclusive culture is bolstered by regular team socials, quarterly company days, and monthly town halls.Acknowledging that each team member brings unique skills and experiences, our tailored learning and development programs support individual growth, helping you navigate our transparent career pathways to meet your professional goals.What We’re Looking ForWe seek AWS Cloud Engineers with experience in AWS Landing Zones, who have hands-on experience in building, testing, packaging, deploying, and operating AWS platforms. An understanding of managing multi-tenant platforms and applying SRE principles is advantageous.

Join Our Dynamic Team as a Senior AWS Platform EngineerLocation: London, UK (Hybrid – typically ~1 day per week on-site)Contract Type: Permanent, Full-timeSalary Package: £75,000 – £90,000 + 10% Bonus + 10% Equity + Additional BenefitsAbout AppviaAt Appvia, we specialize in cloud and platform engineering consultancy, empowering organizations to effectively build, secure, and scale their operations in the cloud. We collaborate with both public and private sector clients to craft cutting-edge cloud platforms, integrate robust engineering practices, and accelerate software delivery.Our expertise lies in platform engineering, DevOps, automation, and cloud-native solutions, establishing a balance between developer agility, security, resilience, and governance.Role OverviewAs a Senior AWS Platform Engineer, you will play an integral role in our platform engineering projects, taking a hands-on approach in designing, building, and managing secure and scalable AWS environments. This position is perfect for an experienced engineer who thrives on tackling intricate technical challenges and collaborating closely with development teams to enhance cloud platforms and delivery pipelines. You will work within multidisciplinary teams, supporting application and platform workloads while guiding customers in adopting modern DevOps and platform engineering methodologies.Your responsibilities will include leading technical deliveries, contributing to solution design, and mentoring junior engineers through knowledge sharing.Interview Process - 4 StagesInitial discussion with Talent AcquisitionTechnical assessment paired with an Engineering team memberIn-depth technical interview with Practice LeadershipFinal competency-based interview with Engineering LeadershipImportant NoteTo be considered for this role, you must either possess an active SC clearance or be eligible for SC, which requires:British Passport or Indefinite Leave to RemainResidence in the UK for at least the last 5 yearsNo criminal convictionsNo financial irregularitiesCandidate ProfileYou are a proficient AWS engineer with a strong background in cloud-native infrastructure and DevOps, comfortable in client-facing environments and directly contributing to project delivery. You will offer:Demonstrable experience in building and operating AWS platformsA comprehensive understanding of modern CI/CD and automation practicesConfidence in collaborating with engineers, architects, and project leadsA pragmatic mindset towards enhancing reliability, security, and developer experienceKey ResponsibilitiesDesign, build, and maintain secure AWS platformsCollaborate with cross-functional teams to deliver high-quality solutionsMentor and guide junior engineersContinuously improve and optimize platform performance

Join our innovative team at Synthesia as a Senior Data Engineer, where you will play a pivotal role in shaping the future of AI-driven video synthesis. As a key member of our data engineering team, you will design, implement, and maintain robust data pipelines that enable our advanced machine learning models to thrive. Your expertise will help us harness the power of data, ensuring high availability and performance. Collaborate with cross-functional teams to transform raw data into actionable insights that drive our product's success and enhance user experiences.

Join physicsx as a Senior Simulation Data Engineer, where you'll play a critical role in developing and optimizing simulation data workflows. You will collaborate closely with cross-functional teams to enhance our simulation capabilities and ensure data integrity. Your expertise will be instrumental in driving innovation and improving our processes.

Recursion Pharmaceuticals brings together technology and biology to advance drug discovery. The company’s Recursion Operating System combines machine learning, large-scale experiments, and a proprietary dataset that spans biological, chemical, and patient-related data. Each week, the team conducts millions of wet lab experiments and uses a supercomputing environment to find new connections in biology and chemistry. What you will do Develop, scale, and manage the core data platform. This includes building, operating, and optimizing systems that support querying and exploration across Recursion’s vast datasets, such as a chemistry library with billions of compounds, petabytes of microscopy images, and diverse assay results. Help make complex datasets accessible for scientific teams. Work closely with biologists, chemists, and data scientists to ensure data from different biological models and treatments can be explored and queried, even for new and evolving research questions. Mentor and support colleagues by sharing technical expertise and experience, helping others grow and increasing impact across teams. The team This role joins the Data Lake team, responsible for building and maintaining Recursion’s Data Lake and Data Lakehouse. The group manages both relational and object storage, ensuring all data is discoverable, queryable, and connected. As Recursion grows, the team integrates new data types under the guiding principle that all data flows to the Data Lake. Location London, England; Milton Park, England

Join Our Team! Contentful is seeking a Senior Data Engineer to play a pivotal role in designing, developing, and scaling advanced data solutions that drive analytics, operational reporting, and strategic decision-making within our organization. You will collaborate closely with our data, analytics, and business teams to create robust data pipelines, models, and integrations that ensure clean, reliable, and actionable data. You will be an integral part of a small, geographically diverse engineering team that operates with a product mindset—delivering iterative value while partnering closely with business and analytics stakeholders, and taking ownership of both the development and operational aspects of a critical data platform. Your Responsibilities Design, build, and maintain scalable data pipelines and transformations that integrate multiple systems and sources. Create high-quality data models that cater to analytics, reporting, and operational use cases. Collaborate with analytics, product, and business teams to identify data needs and translate them into effective technical solutions. Establish and enforce strong data quality, validation, and monitoring protocols to ensure the reliability and trustworthiness of our data. Optimize data storage, processing, and performance within cloud data warehousing environments. Contribute to the ongoing improvement of our modern data platform, including tooling, standards, and best practices. Support the operations of the data platform by troubleshooting issues, enhancing reliability, and ensuring SLAs are consistently met. Engage with cross-functional partners on governance, documentation, definitions, and data stewardship. Implement CI/CD practices and Infrastructure-as-Code (IaC) for automated deployment, testing, and environment management. Participate in code reviews, design discussions, and operational on-call rotations as required. Mentor team members and promote data engineering best practices across the organization. Your Skills and Experience Essential Qualifications 5+ years of experience in a Data Engineering or similar technical role. Expertise in SQL and experience working with cloud data warehouses (e.g., Snowflake, Redshift, BigQuery). Experience in building and maintaining ETL/ELT pipelines using tools such as dbt, Airflow, or similar frameworks. Proficiency in Python or another scripting language. Strong understanding of data modeling, data structures, and modern data architecture principles.

The RoleWe are excited to invite applications for the position of Senior Data Engineer to join our dynamic Data team based in London.This is an office-based position located at our London headquarters.Working at WGSNTogether, we shape the future.At WGSN, we thrive in a fast-paced and innovative environment filled with opportunities for professional growth. Our diverse team consists of consumer and design trend forecasters, content creators, designers, data analysts, advisory consultants, and more, all dedicated to a shared mission: to create tomorrow.Our reliable consumer and design forecasts empower exceptional product design, helping our clients envision a better future. Our offerings span consumer insights, beauty, consumer technology, fashion, interiors, lifestyle, food and drink forecasting, data analytics, and expert advisory services. If you're a specialist in your field, we would love to hear from you.Role OverviewAs WGSN expands its AI and Data capabilities, we aim to enhance our data architecture. As a Senior Data Engineer, you will be instrumental in designing, optimizing, and maintaining the data pipelines, models, and infrastructure that support our classification systems, AI workflows, forecasting models, TikTok insights, and consumer intelligence products.You will collaborate closely with our senior data scientists, analysts, and engineers, especially within the TikTok and Pulse pods, ensuring high-quality, well-structured, reliable data flows across Snowflake, Databricks, and downstream systems. This position is tailored for an individual with substantial technical expertise, advanced SQL and data modeling skills, and a passion for developing scalable, efficient data systems. This role is hands-on and requires a minimum of 5 years of experience in data engineering, including the ability to mentor junior engineers when necessary.Key ResponsibilitiesData Architecture & Modeling- Design, develop, and maintain scalable data architectures...

About Us:At AND Digital, we are a pioneering tech company committed to accelerating digital delivery and bridging the digital skills divide. Since our inception in 2014, we have empowered organizations to create superior digital products and build robust digital teams.Our philosophy is rooted in leaving a lasting legacy for our clients by fostering close-knit relationships through our regional 'Clubs', ensuring our partners are prioritized by dedicated teams in their vicinity.This distinctive approach has fueled remarkable organic growth for both our clients and ourselves, and we invite you to join us in our mission to close the global digital skills gap.Position Overview:We are in search of a Lead Data Engineer to serve as the technical practice lead for our Luna data team. This pivotal role involves spearheading a high-priority migration from our existing Redshift environment to a new AWS RDS (Postgres) architecture.In addition to overseeing technical architecture, you will mentor and develop the skills of our Data Analysts, guiding their transition from SQL-centric workflows to production-ready Python and DataOps methodologies, while collaborating with stakeholders to convert business requirements into scalable technical roadmaps.