Senior Data Engineer - GCP

Who are we? At Ki Insurance, we’re making headlines by insuring everything from space shuttles to world tours, wind farms, and even footballers' legs.Our mission is clear: to digitally transform and revolutionize a 335-year-old insurance market. Collaborating with Google and UCL, we’ve developed a platform that harnesses algorithms, machine learning, and large language models to provide insurance brokers with quotes in seconds instead of days.As the largest global algorithmic insurance carrier, Ki is the fastest growing syndicate in the Lloyd's of London market, achieving an unprecedented $100 million in profit within just three years.Our diverse teams work collaboratively in an agile, cross-functional environment to create the best possible experience for our customers. With ambitious goals ahead, we’re seeking brilliant minds to challenge the status quo and help us reach new heights.What will you do? Collaborate with business teams, data scientists, and engineers to design, build, optimize, and maintain production-grade data pipelines and reporting solutions using GCP and BigQuery.Engage with finance, actuaries, and data experts to maximize the potential of new internal and external data sources.Partner with our delivery teams at EY/IBM to ensure the robustness of data model design and engineering that supports our growth ambitions.Take ownership of data models, reporting, and integrations/pipelines as part of our Business As Usual (BAU) operations.Develop frameworks, infrastructure, and systems to manage and govern Ki’s data assets.Create comprehensive documentation to facilitate ongoing support and maintenance of data structures, schemas, and reporting.Collaborate with the broader engineering community to enhance our data and MLOps capabilities.Ensure data quality, governance, and compliance with both internal and external standards.Monitor and troubleshoot data pipeline issues to guarantee reliability and accuracy.

About UsAt Ki Insurance, we are at the forefront of innovation in the insurance industry. With a diverse range of clients from space shuttles to world tours, we ensure coverage for extraordinary ventures. Our mission is to digitally disrupt a 335-year-old market by leveraging advanced technologies.Partnering with Google and UCL, we have developed a cutting-edge platform that utilizes algorithms, machine learning, and large language models to provide insurance brokers with quotes in a matter of seconds, rather than days.As the largest global algorithmic insurance carrier and the fastest-growing syndicate in the Lloyd's of London market, Ki has made history by achieving $100 million in profit within just three years. Our teams, comprised of individuals from various backgrounds, collaborate in an agile and cross-functional environment to enhance customer experience and challenge the status quo.Your RoleIn this pivotal role, you will support our middle and back-office operations, crucial for our continued success. As part of a multi-disciplinary team, you will collaborate with software and data engineers, full-stack developers, platform operations experts, algorithm researchers, and data scientists to deliver impactful solutions. Your primary focus will be on designing and developing sophisticated data processing modules and reporting using BigQuery and Tableau.Key Responsibilities: Collaborate with business teams in finance and actuarial science, along with data scientists and engineers, to design, build, optimize, and maintain production-grade data pipelines and reporting from our internal Data Warehouse solution based on GCP/BigQuery.Engage with various stakeholders to identify opportunities for leveraging new internal and external data sources.Partner with EY and IBM to ensure the robustness of data model design and engineering, supporting our ambitious growth and scalability plans.Oversee business-as-usual (BAU) management of data models, reporting, and integration pipelines.Establish frameworks, infrastructure, and systems for effective management and governance of Ki’s data assets.Create detailed documentation to facilitate ongoing BAU support and maintenance of data structures, schemas, and reporting.Collaborate with the broader engineering community to enhance our data and MLOps capabilities.Ensure compliance with internal and external data quality and governance standards.Monitor and resolve data pipeline issues to maintain reliability and accuracy.

Valtech partners with well-known brands to design and deliver customer experiences. The company emphasizes growth, international opportunities, and a culture shaped by clear values. The role The Conversational Analytics Engineer position centers on developing digital solutions that improve how customers interact with businesses. This role involves exploring new approaches, questioning established methods, and helping to create customer experiences that can influence entire industries. What to expect Work on projects that focus on conversational analytics and digital innovation Contribute to solutions that aim to improve customer engagement Participate in a team culture that values learning and professional growth Location This position is based in London.

Join Devoteam as a Lead Consultant specializing in Google Cloud Platform (GCP) and Data & AI/ML pre-sales architecture. In this pivotal role, you will leverage your expertise to drive innovative solutions that empower our clients to harness the power of data and artificial intelligence.Your responsibilities will include collaborating with sales teams to identify client needs, designing tailored solutions, and presenting compelling proposals that highlight our capabilities in GCP and AI/ML technologies.

Join Pace Consulting as a GCP Architect, where you will lead the design and implementation of innovative cloud solutions on the Google Cloud Platform. You will collaborate with cross-functional teams to drive cloud transformation initiatives, ensuring that our clients achieve their business objectives efficiently and effectively.

Lead Data Engineer - Google Cloud Platform (GCP) Location: London (Hybrid) | Department: Technology & Engineering | Employment Type: Permanent Transform Financial Services with Innovative Data Solutions About the RoleWe are seeking a skilled Lead Data Engineer specializing in Google Cloud Platform to enhance our dynamic Technology & Engineering team based in London. In this pivotal role, you will collaborate with top-tier financial institutions on groundbreaking transformation initiatives, leveraging your extensive knowledge of GCP to develop resilient, scalable data architectures. This opportunity is perfect for engineers who are passionate about innovation, eager to tackle challenges head-on, and thrive in collaborative, agile environments. Key Responsibilities Architect and implement robust, scalable data pipelines utilizing GCP offerings such as BigQuery, Dataflow, and Dataproc. Engage closely with clients to ascertain business needs and design tailored data solutions. Implement engineering best practices throughout the software development lifecycle (SDLC), including CI/CD, testing, and version control using Git. Lead the development of well-tested, fault-tolerant data engineering solutions. Mentor and support junior engineers, fostering a culture of knowledge sharing within the team. Desired Qualifications Extensive hands-on experience with GCP, including BigQuery, Pub/Sub, Cloud Composer, and IAM. Proficient in Python, SQL, and PySpark, with a solid background in data lakes, warehousing, and data modeling. Strong understanding of DevOps methodologies, containerization, and CI/CD tools such as Jenkins or GitHub Actions. A proven track record of delivering data engineering solutions in agile settings. Excellent communication skills, capable of articulating technical concepts to non-technical audiences. Preferred Qualifications Familiarity with real-time streaming technologies like Kafka or Spark Streaming. Experience in MLOps and maintaining machine learning models in production. Knowledge of data visualization tools such as Power BI, Qlik, or Tableau. Experience developing applications on Vertex AI is a plus. Understanding of SQL and NoSQL databases, with the ability to evaluate ETL vs ELT trade-offs. Why Capco? Drive impactful technology solutions for leading financial institutions. Be part of a collaborative culture that values innovation and personal growth. Enjoy a hybrid work environment that promotes work-life balance.

Join Trainline as a Data Engineer and become an integral part of our dynamic data team. In this role, you will leverage cutting-edge technologies to build and maintain robust data infrastructure that supports our mission of providing seamless travel solutions. Your expertise will contribute to optimizing data pipelines, ensuring data quality, and delivering actionable insights that drive strategic decisions.

Role overview hmgroup needs a Senior Data Engineer based in London to influence how data is used across the company. This position centers on building and maintaining systems that move and organize large amounts of data, helping teams make informed decisions. Main responsibilities Design and manage data pipelines that process significant data volumes Build architecture to ensure reliable data processing and analytics Convert raw data into insights that support teams throughout hmgroup

Role Overview:We are looking for a talented Data Engineer to contribute significantly to a vital client initiative. This role will involve the design, construction, and optimization of data pipelines within a cloud-centric data and analytics ecosystem. The ideal candidate will possess a solid foundation in data engineering principles, a commitment to delivering reliable solutions, and the capability to work collaboratively with both technical and business teams.Key Responsibilities:Data Engineering & Pipeline DevelopmentDesign, build, and sustain scalable data pipelines for both batch and streaming workloads.Develop robust ingestion, transformation, and curation processes using contemporary data engineering tools and methodologies.Create and maintain data models, curated datasets, and integration layers to facilitate analytics and reporting.Enhance data processing for optimum performance, reliability, and cost-effectiveness.Data Quality, Governance & SecurityEstablish data quality checks, validation processes, and automated monitoring.Ensure comprehensive and accurate data lineage, metadata management, and documentation.Implement necessary security measures, including role-based access controls, data masking, and protection of sensitive information.Cloud & Platform EngineeringUtilize cloud-native services for storage, compute, and workflow orchestration.Oversee pipeline and platform performance, identifying and resolving any issues or bottlenecks.Assist in configuring environments, standardizing processes, and implementing best practices.DevOps, Automation & ObservabilityLeverage CI/CD practices to deploy code, configurations, and data assets across different environments.Maintain version control, engage in code reviews, and adhere to release processes.Construct monitoring, alerting, and logging systems to support high-quality operations and quick issue resolution.Collaboration & DeliveryWork closely with technical and business stakeholders to ensure alignment and successful project delivery.

Join Trainline as a Junior Data Engineer and embark on an exciting journey to revolutionize the rail travel experience through data-driven solutions. In this role, you will collaborate with a dynamic team of professionals, utilizing cutting-edge technologies to manage and optimize our data infrastructure. Your contributions will directly impact our mission to simplify rail travel for millions of customers.

Note: This position requires 4 days of in-office work in Central London and 1 day of remote work.Key Responsibilities:Develop features, resolve issues, and perform daily monitoring on the cloud delta lakehouse data platform.Collaborate within an agile technical team, actively engaging in all ceremonies, including daily stand-ups and backlog refinement sessions.Make architectural decisions, mentor junior engineers, and contribute to the establishment of engineering standards, documentation, and reusable frameworks.Experience Required:Minimum of 10 years of overall experience in data engineering.At least 5 years of experience in a data warehouse solution landscape.Proven experience leading complex data initiatives and making architectural decisions.Familiar with agile delivery methodologies, preferably SCRUM or Kanban.Ability to take ownership of data issues, conduct investigations and root cause analysis, and implement fixes through code and data modifications.Understanding of data warehouse testing strategies and quality assurance processes.Proficient in git branching strategies and code management.Solid understanding of technical release management processes in Azure DevOps.Strong communication skills, capable of driving alignment, collaboration, and efficiency within teams.

Join our team as a Senior Data Engineer specializing in AWS!Location: London (Hybrid) | Practice Area: Technology & Engineering | Type: PermanentAbout the RoleWe are seeking a talented Senior Data Engineer with expertise in AWS to be a key player in our dynamic team of engineering professionals. You will spearhead the design, construction, and deployment of innovative cloud-based data pipelines that drive transformative outcomes for Tier 1 financial services clients. Your contributions will significantly enhance data ingestion, transformation, and delivery at scale across the financial services landscape.Your ResponsibilitiesDesign and implement end-to-end data pipelines using AWS-native tools and cutting-edge data architectures.Collaborate closely with clients to gather requirements, craft tailored solutions, and deploy production-ready systems.Utilize AWS Well-Architected Principles to ensure your solutions are scalable, secure, and resilient.Lead the development of robust, thoroughly tested, and fault-tolerant data engineering solutions.Mentor junior engineers, fostering a culture of knowledge sharing and continuous learning within the team.What We Seek

Join Us in Revolutionizing Compensation.At Ravio, we recognize that fair compensation is crucial to both individual success and organizational growth. With a mission to transform how companies manage employee pay, we leverage advanced data solutions to enable our clients to attract and retain top talent. Our innovative real-time data platform redefines compensation management, offering insights into salary, equity, and benefits, ensuring everyone receives their rightful earnings regardless of their background.As a rapidly growing company, Ravio has positioned itself as a leader in Europe with over 1,200 clients, and we are on a journey to become the global authority in compensation data and tools. Joining our ambitious team provides an unparalleled opportunity to contribute to a product that is shaping the future of pay.We are currently seeking a Senior Data Engineer to enhance our data infrastructure, drive innovation, and contribute to our mission. If you’re excited about the prospect of scaling a startup into a global powerhouse, we want to hear from you!

Join the leading gift experience provider in the UK, Buyagift and Red Letter Days, where we transform special moments into unforgettable memories! With a diverse selection of over 4000 experiences ranging from spa days to thrilling skydives, we excel in delivering the gift of surprise. As part of the esteemed Moonpig Group, our vision is to establish ourselves as the most reliable platform within the UK gift experience sector. Our mission centers on spreading joy through thoughtful, enriching experiences that resonate with our customers. People are integral to our operations. Since becoming a part of the Moonpig Group in 2022, we have thrived on strong values, innovative ideas, and a unified passion for making a genuine impact. Here, you will have the opportunity to create unforgettable experiences and foster meaningful connections.Position: Data Engineering Manager | London – Hybrid (2 days in office) | Competitive Salary + BenefitsRole OverviewWe are seeking a talented Data Engineering Manager to spearhead our Data Engineering team at Buyagift & Red Letter Days, a proud member of the Experience More group.This pivotal role involves utilizing data to enhance our business understanding and improve customer service. You will lead a team of data engineers dedicated to developing and maintaining a robust, scalable, and secure data infrastructure, ensuring timely access to the right data for the right individuals.Your responsibilities will blend team leadership with hands-on technical oversight, guiding our data strategy, data models, and architecture while enhancing data quality and governance. Collaborating closely with business stakeholders, you will design and implement structured, reliable data that supports reporting, analytics, and informed, data-driven decisions.

About XYZ RealityXYZ Reality is an innovative, award-winning Series-A startup on the cusp of our next funding round. Our goal is to enhance our platform by improving its features, performance, and scalability, all while transforming the construction industry.As a dynamic multi-disciplinary organization, we operate across various fields such as cloud development, data governance, data processing pipelines, electronics, embedded software/hardware, mechanical design/manufacturing, AI & computer vision, and data science, all contributing to the efficacy of our Building Information Modeling (BIM) Platform.To help propel our mission, we are in search of a Senior Data Engineer who possesses extensive experience in data modeling, database management, and data pipeline development. The ideal candidate will play a pivotal role in maintaining our existing tech stack and developing new features with an emphasis on performance and scalability. Collaboration with our API/backend development and data pipeline teams will be crucial to create robust and efficient solutions.

With Intelligence, now a part of S&P Global, is at the forefront of revolutionizing data offerings for participants in alternatives and private markets. As a member of a global organization boasting over 35,000 employees, we possess the unique ability to understand intricate nuances while maintaining a wide-ranging perspective. We empower our clients to assess new investment opportunities within the capital and commodities markets, navigate the energy sector's expansion, harness the acceleration of artificial intelligence, and adapt to the evolving landscape of public and private markets. Our mission is to advance essential intelligence.We are embarking on an exciting phase of growth, with significant funding aimed at transforming us into a pioneering, data-centric platform that places information, automation, and insights at its core.To meet the escalating demands of a dynamic, data-driven organization, we are expanding our data capabilities. This role is an outstanding opportunity for an enthusiastic individual ready to make a tangible impact while engaging with cutting-edge tools and contributing to our data strategy across products and teams.Your ResponsibilitiesDesign, develop, and maintain scalable data architectures and ETL pipelines.Build and manage data models and data warehouse solutions utilizing Airflow, dbt, and Redshift.Write clean, efficient Python and SQL code for data processing and transformation.Integrate data from internal and third-party APIs and services.Optimize data pipelines for performance, scalability, and reliability.Collaborate with data scientists, analysts, and engineering teams to fulfill business requirements.Implement and uphold data security and compliance standards.Utilize version control systems (e.g., Git) to manage and maintain project codebases.Contribute to the ongoing enhancement of data processes and tooling across the organization.

About UsAt Trainline, we are passionate advocates for rail travel, dedicated to crafting a sustainable and eco-friendly travel future. Our platform empowers millions of travelers to discover and reserve the most cost-effective tickets across various carriers and journey options via our award-winning mobile app, website, and B2B partnerships.Join the Journey with Trainline As Europe's leading rail app, we boast over 125 million monthly visits and generate £5.9 billion in annual ticket sales. Collaborating with over 270 rail and coach companies across more than 40 countries, we aim to make travel simple, seamless, and affordable.With our team of over 1,000 talented individuals from more than 50 nationalities, our offices span London, Paris, Barcelona, Milan, Edinburgh, and Madrid. With growth at the forefront of our mission in the UK and Europe, now is the ideal time to embark on this exciting journey with us.The Data Engineering Team at Trainline As a Principal Data Engineer, you will serve as a senior technical leader, working across various teams to instill best practices, elevate engineering standards, and drive ambitious data, ML, and AI projects.You will proactively identify high-impact challenges across cross-functional squads, collaborating closely with Machine Learning Engineers (MLEs), ML Engineering Managers, and Product and Platform teams to create robust, scalable, and future-proof data foundations for ML-driven products, including our innovative Travel Assistant.Embedded Data Engineering (Embedded DE) is a vital aspect of your role. You will integrate within ML-led teams, shaping architecture, guiding implementation, and ensuring alignment between Data Engineering and ML Engineering best practices across Trainline.Key Responsibilities as a Principal Data Engineer: Act as a technical authority across multiple teams, establishing standards and frameworks for data and ML-adjacent infrastructure.Collaborate with ML teams to design, develop, and enhance data platforms that support AI and ML workloads.Influence technical direction while not holding direct line management responsibility.Partner with the Data Engineering team to drive excellence in data management practices.

Join our dynamic team at Jane Street as a Data Centre Engineer in London! In this role, you will be pivotal in ensuring the smooth operation, maintenance, and optimization of our data centre facilities. You will work closely with various teams to implement innovative infrastructure solutions that enhance performance and reliability.

blueinnrecruitment is excited to announce an opportunity for a Temporary Works Coordinator (TWC) to join a prestigious Civil Engineering firm engaged in the Construction Industry. This is a permanent position, and the successful candidate will play a pivotal role in the landmark HS2 project located in Euston. The ideal TWC candidate will be responsible for overseeing all facets of design, including coordination, compliance, submission, and management of engineering and assurance processes, alongside maintaining and updating the Temporary Works Procedure (WI300). Previous experience in similar roles within the construction sector is essential.Key ResponsibilitiesThe responsibilities of the TWC encompass, but are not limited to:Acting as the primary liaison between Temporary Works designers and the site team.Coordinating all Temporary Works activities.Designating Temporary Works Supervisors as required.Formulating procedures for the management of Temporary Works and ensuring their implementation on-site.Assigning responsibilities to relevant parties, including Designated Individuals and the Construction team.Preparing and ensuring the adequacy of the design brief in alignment with site requirements.Overseeing satisfactory Temporary Works design execution and ensuring design checks are conducted and approved.Delegating design checks to ensure independence where necessary.Making Temporary Works design available to all interested parties, including the CDM Coordinator.Maintaining comprehensive records related to the final design of Temporary Works, including drawings and calculations.Providing constructors with detailed design information, limitations, and guidance notes, along with specific method statements.Ensuring implementation of the Temporary Works design according to specifications and drawings.Reviewing actual conditions against assumed conditions in the Temporary Works design.