Data Platform Solutions Architect - Professional Services

Lead Principal Azure Data Engineer (Databricks)Location: London (Hybrid) | Practice Area: Technology & Engineering | Type: PermanentShape the Future of Financial Services with Data InnovationThe RoleAs a Lead Principal Azure Data Engineer specializing in Databricks at Capco, you will spearhead the architectural design and implementation of cutting-edge enterprise data solutions within the Azure ecosystem. Your expertise will drive the creation of both streaming and batch data pipelines, enabling our clients to advance their data capabilities. Collaborating with diverse teams, you will provide strategic guidance on best practices and technical approaches, ensuring adherence to the highest quality and security standards throughout all deployments.What You’ll DoLead comprehensive delivery of Databricks-driven solutions within Azure environments.Design secure, scalable data pipelines utilizing DeltaLake, Spark Structured Streaming, and Unity Catalog.Establish and uphold engineering best practices across the data lifecycle.Collaborate with clients to design solution strategies and robust data governance frameworks.Mentor engineering teams and actively participate in internal capability enhancement programs.What We’re Looking ForDemonstrated proficiency in the Databricks platform, including Unity Catalog, DeltaLake, and orchestration.Advanced skills in Python, PySpark, and distributed data processing frameworks.Extensive experience developing CI/CD pipelines with tools such as Azure DevOps, Jenkins, and GitHub Actions.Thorough understanding of data lakehouse concepts, data modeling, and GDPR-compliant design methodologies.Proven track record in creating robust, production-grade data pipelines from ingestion to serving.Bonus Points ForStrong client-facing and commercial acumen to support pre-sales and RFP engagements.Experience in coaching and mentoring engineering teams.Development skills in Scala or Java.Familiarity with handling PII and sensitive data in compliance with regulations.

At Databricks, we're committed to empowering data teams to tackle some of the world's most challenging issues, including security threat detection and cancer drug development. Our mission is to create and manage the premier data and AI infrastructure platform so our customers can dedicate their efforts to the high-value challenges crucial to their missions. Our engineering teams develop cutting-edge products that meet significant real-world needs. We operate one of the largest-scale software platforms, comprising millions of virtual machines that generate terabytes of logs and process exabytes of data daily. Given our scale, we frequently encounter hardware, network, and operating system faults, and our software must effectively shield our customers from these challenges. The Delta DML team is responsible for the core write-path operations for Delta Lake, the open-source storage layer underlying the Databricks Lakehouse. Our goal is to deliver industry-leading performance and a seamless user experience at massive scale, with most data written in Databricks passing through our platform. We innovate in performance through features like Low Shuffle Merge and Deletion Vectors, and actively contribute to open-source initiatives that unify Delta and Iceberg formats. We are on the lookout for a highly skilled and experienced Senior Staff Software Engineer to join our backend team. In this pivotal role, you will design, develop, and maintain robust backend systems that power Databricks workspaces. You will work on building the next-generation platform for serving workspace assets, ensuring high queries per second (QPS), low latency, reliability, and performance while proactively addressing future growth challenges. As a senior member of the team, your responsibilities will also include providing technical leadership, mentorship, and guidance to junior engineers, thereby enhancing the overall coding practices and system designs of the team.

As a Senior Forward Deployed Engineer at Databricks, you will play a critical role in deploying our cutting-edge data analytics solutions to our clients. You will work closely with customers, providing technical expertise and support to ensure successful implementation and utilization of our platform. Your role will involve collaborating with various teams to address complex customer challenges, enhance user experience, and drive product adoption.

AI Engineer - Forward Deployed Engineer (All Levels) Req ID: CSQ426R186 Our Mission The AI Forward Deployed Engineering (AI FDE) team at Databricks is a specialized, customer-centric group focused on delivering exceptional AI solutions. We engage with our clients to develop and implement innovative AI applications that are cutting-edge and tailored to their unique needs. Our collaborative environment allows us to work closely with engineering, product management, and developer relations, as well as support our internal subject matter experts. We seek passionate individuals who thrive on customer interaction, teamwork, and a desire to stay ahead of the latest trends in Generative AI, LLMOps, and machine learning. Your Impact Design and develop groundbreaking Generative AI solutions utilizing the latest advancements from our Mosaic AI research to address client challenges. Lead the deployment of consumer-facing and internal Generative AI applications into production. Act as a trusted technical consultant to clients across various industries. Represent Databricks as a thought leader at industry events such as the Data + AI Summit. Work collaboratively with product and engineering teams to shape strategic priorities and influence the product roadmap. What We Value in You Proven experience in developing Generative AI applications, including retrieval-augmented generation (RAG), multi-agent systems, Text2SQL, and fine-tuning, with tools such as HuggingFace, LangChain, and DSPy. Strong background in deploying production-grade Generative AI applications, including evaluation and optimization techniques. Several years of hands-on experience in data science, utilizing common tools such as pandas, scikit-learn, and PyTorch. Experience in building scalable machine learning deployments on cloud platforms like AWS, Azure, or GCP. A graduate degree in a quantitative field (Computer Science, Engineering, Statistics, Operations Research, etc.) or equivalent practical experience. Ability to communicate and teach technical concepts effectively to both technical and non-technical audiences. A genuine passion for collaboration, continuous learning, and leveraging AI to drive business success. [Preferred] Familiarity with the Databricks Intelligence Platform and Apache Spark™ for processing large-scale distributed datasets.

Join our innovative data engineering team as a Senior Data Engineer! We are looking for a talented professional to design, develop, and optimize data pipelines and workflows utilizing Databricks and AWS. You will play a pivotal role in enhancing our data processing capabilities while ensuring data quality, security, and compliance.Key Responsibilities:Provide L2 and L3 support within Data Engineering to troubleshoot and resolve production pipeline issues.Create and sustain high-performance data pipelines using Databricks.Collaborate with architects and analysts to construct data models and transformations.Ensure data quality, security, and compliance in Databricks environments.Implement monitoring and logging strategies for data pipeline reliability and performance.Deploy and manage code through CI/CD workflows.Efficiently troubleshoot and resolve complex data processing challenges.

At Databricks, we are driven by a passion for empowering data teams to tackle some of the world's most challenging problems—whether it's revolutionizing transportation or accelerating medical advancements. Our mission is to build and operate the premier data and AI infrastructure platform, enabling our clients to harness deep data insights to enhance their businesses.Founded by engineers and deeply committed to our customers, we eagerly embrace every opportunity to confront technical challenges. From designing next-gen UI/UX for data interfaces to scaling our services and infrastructure across millions of virtual machines, we are just getting started.As part of our ongoing commitment, we are embarking on a multi-year journey to develop the best Lakehouse Platform. While we are building on a solid foundation, our aim is to create significantly improved products. This involves re-evaluating every component to deliver our customers the fastest, easiest to use, and most secure data platform for all their data workloads.As a Software Engineer, you will play a vital role as a founding member of our London site and the core team in our journey towards achieving the Lakehouse vision. You will be engaged in the complete development lifecycle and will embody the core values that define Databricks.Your Impact:Our backend teams tackle diverse challenges across essential service platforms. You may work on:Complex problems that encompass product and infrastructure components, including distributed systems, scalable service architecture, monitoring, workflow orchestration, and enhancing developer experience.Developing reliable, secure, and high-performance services and client libraries for managing vast amounts of data on cloud storage backends such as AWS S3, GCS, and Azure Blob Store.Creating product features that empower our customers to seamlessly store and access their data.Addressing reliability issues related to Lakebase.Proactively identifying downtime causes and systematically eliminating root issues.Assisting the organization in defining SLIs, achieving SLOs, and driving long-term reliability improvements.

Role Overview Databricks is looking for a Senior Forward Deployed Engineer based in London, United Kingdom. This role focuses on connecting Databricks technology with customer goals, helping organizations get the most from the Databricks platform. What You Will Do Guide customers through integration and deployment of Databricks solutions Work with internal teams to spot areas for improvement in customer projects Support clients as they adopt and scale Databricks technology Contribute technical expertise to ensure customer success Collaboration This position involves close collaboration with product, engineering, and customer teams. The goal is to identify needs, solve problems, and help customers realize value from Databricks products.

At Databricks, we are dedicated to empowering data teams to tackle some of the world's most challenging problems — from revolutionizing transportation to advancing medical innovations. We achieve this by developing and operating the world's leading data and AI infrastructure platform, enabling our customers to harness deep insights from data to elevate their business outcomes. Founded by engineers and driven by customer obsession, we seize every opportunity to confront complex technical challenges, whether it's crafting next-generation UI/UX for data interfaces or scaling our services and infrastructure across millions of virtual machines. Our journey has only just begun. Our engineering teams are at the forefront of creating impactful products that address significant global needs. We operate one of the largest-scale software platforms, managing millions of virtual machines, generating vast amounts of logs, and processing exabytes of data daily. Given our scale, we frequently encounter cloud hardware, network, and operating system faults, and our software must seamlessly shield our customers from these challenges. Unity Catalog serves as our platform's native unified and open governance solution for data and AI. It eradicates silos, streamlines governance, and accelerates insights at scale. We are seeking a Senior Staff Software Engineer to lead the technical direction of Unity Catalog Runtime Enforcement. In this role, you will build and fortify the runtime enforcement layer for Unity Catalog, guaranteeing secure and consistent authorization and data access across Databricks compute, engines, and cloud environments. This initiative aims to reduce incidents and simplify customer choices by unifying enforcement semantics.

REQ ID: FEQ227R147Location: London, UKRecruiter: Dina HussainAt Databricks, our fundamental values shape our operations, fostering a culture of proactivity and a client-focused approach. We are dedicated to creating a cohesive platform that democratizes access to data and AI, empowering our customers to make informed decisions that drive their businesses forward.In the UK&I Digital Natives Hunting territory, we operate at the pace of the world’s most innovative companies. We don’t merely sell software; we collaborate with technical founders, CTOs, and VPs of Engineering at rapidly growing startups to shape the future of AI. You will play a pivotal role in this mission, leveraging your executive-level technical credibility and a 'Hunter' mentality to gain mindshare and secure new business opportunities. Join us in transforming the way people interact with data and contribute to building a better world!Reporting to Manager, Field EngineeringYour Impact:Executive Evangelism & Thought Leadership: Serve as a Technical Advisor, establishing peer-to-peer relationships with CTOs, VPs of Engineering, and technical founders at high-growth DNBs. You will secure technical mindshare in initial meetings by articulating a vision for Data + AI that resonates with their rapid innovation cycles.Drive New Logo Motion: Execute the high-velocity 'Hunter DNA'—prioritizing Time to Value, qualifying out rigorously when necessary, and concentrating efforts on challenging, high-prestige accounts that position Databricks as the benchmark for the UK startup ecosystem.Ecosystem Building: Foster awareness within the UK startup and VC ecosystem. You will represent Databricks at key events, cultivating strategic relationships with VCs, accelerators, and incubators to identify and influence the next generation of 'unicorns.'Strategic Technical Discovery: Transition from traditional 'hands-on' SA work to focus on high-level architecture and strategic road-mapping. You will connect complex business requirements with technical solutions, ensuring that the Databricks Intelligence platform is recognized as a strategic enabler of a startup's core product.Regional Mentorship: Act as a role model and mentor for the broader Field Engineering team, especially guiding Solutions Architects on effectively engaging with CxOs and navigating the unique challenges of the digital-native segment.

Join Databricks as an Engineering Manager specializing in Storage. In this pivotal role, you will lead a talented team of engineers to develop and enhance our innovative storage solutions that empower data-driven organizations. Your leadership will not only drive technical excellence but also foster a culture of collaboration and continuous improvement.

Databricks seeks a Senior Director of Industry Solutions to lead client engagement across EMEA. The focus is on guiding organizations as they use data to address business challenges and improve operations. This leadership position emphasizes shaping tailored solutions that drive measurable results. Key responsibilities Collaborate with clients to identify industry-specific needs and objectives Develop and implement solutions aimed at increasing operational efficiency and supporting growth Formulate strategies that apply advanced technology to solve complex business issues Oversee projects that encourage organizations to adopt data-driven approaches Locations Germany London, United Kingdom Paris, France Remote - Netherlands Other EMEA locations may be considered

Join Databricks as a Data Platform Solutions Architect in our professional services team, focusing on emerging enterprises and DNB. In this pivotal role, you will collaborate with clients to design and implement innovative data solutions that drive business transformation. Your expertise will empower organizations to leverage the full potential of the Databricks platform, enhancing their data analytics capabilities.

Join Capco as a Senior Azure Data Engineer (Databricks)Location: London (Hybrid) | Practice Area: Technology & Engineering | Type: PermanentTransform data engineering within a prestigious consulting firmYour RoleAs a Senior Azure Data Engineer (Databricks) at Capco, you will be instrumental in architecting, developing, and deploying secure and scalable data pipelines utilizing the Databricks platform on Azure. You’ll engage closely with clients to comprehend their data requirements, crafting innovative solutions that catalyze business transformation. Your contributions will also enhance best practices and foster continuous improvement across multidisciplinary engineering teams.Key ResponsibilitiesDesign and implement resilient data pipelines leveraging DeltaLake, Spark Structured Streaming, and Unity CatalogDevelop real-time event-driven architectures employing tools like Kafka and Azure Event HubsUtilize DevOps methodologies to construct CI/CD pipelines via Azure DevOps, Jenkins, or GitHub ActionsCollaborate with clients and stakeholders to translate their data needs into strategic technical solutionsPromote clean coding practices, data lifecycle optimization, and adherence to software engineering best practicesIdeal Candidate ProfileDemonstrated hands-on experience with the Databricks platform and orchestration techniquesProficiency in Python, PySpark, and SQL, alongside a solid understanding of distributed data systemsExpertise in crafting full lifecycle data pipelines encompassing ingestion, transformation, and serving stagesFamiliarity with data lakehouse architecture, schema design, and GDPR-compliant strategiesPractical knowledge of DevOps tools and CI/CD workflowsPreferred QualificationsExperience with Scala or Java developmentKnowledge of Cloudera, Hadoop, HIVE, and the Spark ecosystemUnderstanding of data privacy laws, including GDPR, and familiarity with handling sensitive informationAbility to swiftly learn and adapt to emerging technologies to fulfill business objectives

REQ ID: FEQ127R254 Location: Hybrid – London Join our dynamic Professional Services team at Databricks, where we are actively seeking talented individuals for various roles, including Senior Solutions Consultant, Resident Solutions Architect, or Senior Resident Solutions Architect. This position is ideal for those with a strong background in big data solutions, analytics architecture, or technical consulting. As a Big Data Solutions Architect (Internally known as Resident Solutions Architect), you will collaborate with clients to address their big data challenges using the Databricks platform. This role involves overseeing data engineering, data science, and cloud technology projects, ensuring seamless integration with client systems, delivering training, and executing technical tasks that maximize the value derived from their data. Our RSAs are billable professionals who excel in project execution while providing exceptional customer service. You will report directly to the regional Manager/Lead. Your Impact: Lead impactful technical projects, including the design and construction of reference architectures, and the productionalization of customer use cases. Collaborate with engagement managers to define the scope of diverse professional services based on client input. Guide strategic clients through the implementation of transformative big data projects, including third-party migrations, from initial design to deployment of leading big data and AI applications. Consult on architectural design and assist in bootstrapping or implementing customer projects, fostering a solid understanding and adoption of Databricks solutions. Provide elevated support for customer operational challenges. Work closely with the Databricks technical team, Project Manager, Architect, and client teams to ensure all technical components meet customer requirements. Engage with Engineering and Databricks Customer Support to offer product feedback and facilitate rapid resolution of engagement-specific issues. What We Seek: Extensive experience in data engineering, data platforms, and analytics. Proficient in coding with Python or Scala. Familiarity with at least two major cloud ecosystems (AWS, Azure, GCP) with deep expertise in one. Strong communication skills and a passion for customer success.

Join our dynamic team at asos as a Senior Software Engineer specializing in Azure and C#. In this pivotal role, you'll be responsible for designing, developing, and deploying innovative software solutions that enhance our e-commerce platform. You'll collaborate with cross-functional teams to ensure the delivery of high-quality software that meets our business objectives and customer needs.

At Databricks, we are dedicated to empowering data teams to tackle the world's most pressing challenges — from transforming transportation to accelerating medical innovations. Our mission is to create and maintain the premier data and AI infrastructure platform, enabling our clients to leverage profound data insights to enhance their operations. Established by engineers with a customer-centric approach, we enthusiastically seize every opportunity to address technical hurdles, whether that involves designing next-generation UI/UX for data interaction or scaling our services across millions of virtual machines. We're just getting started. The Lakebase Platform Reliability team operates across a diverse array of stacks, systems, and stakeholders. This includes AI-driven tools and workflows for customer management, real-time incident observability, and systems that support compliance through monitoring and auditing, as well as customer-facing operational APIs and maintenance workflows. As part of this team, you'll play a vital role in our overarching platform mission: to develop robust resource management infrastructure, dependable distributed services, and internal tools that empower Databricks engineers to operate seamlessly across various cloud environments.

Req: FEQ127R163 Location: London Skills: Expertise in Data Science, Machine Learning, Artificial Intelligence, Large Language Models, Generative AI, and Big Data technologies like Spark As a Specialist Solutions Architect specializing in Machine Learning Engineering, you will serve as a pivotal technical resource for Databricks customers and the Field Engineering team. Collaborating closely with Solution Architects, you will assist customers in designing and implementing production-grade machine learning applications on the Databricks platform, ensuring alignment with the evolving Databricks Data Intelligence Platform roadmap. You will continually advance your technical acumen by leveraging cutting-edge technologies in Generative AI, LLMOps, and Machine Learning, while also enhancing your influence through mentorship and establishing yourself as an authority in ML. Your Impact: Design and architect production-ready ML workloads for customers on our unified platform, which includes comprehensive ML pipelines, optimization for training and inference, integration with cloud-native services, and MLOps practices. Deliver advanced technical support to Solution Engineers during the technical sales process, covering aspects from feature engineering and model training to tracking, serving, and monitoring—all within a single integrated platform, and participating actively in the Databricks ML Subject Matter Expert community. Work collaboratively with product and engineering teams to voice customer needs, set priorities, and shape the product development roadmap, facilitating the adoption of Databricks’ ML solutions. Enhance customer data science capabilities and apply best practices in MLOps to effectively deploy these capabilities across various domains. Act as a trusted technical advisor for customers developing Generative AI solutions, including Retrieval-Augmented Generation (RAG) architectures, querying structured data using natural language, content generation, and monitoring solutions. Qualifications: Minimum of 5 years of experience in a customer-facing technical role, with a focus on pre-sales or post-sales support across diverse industry sectors. 5+ years of hands-on machine learning experience in at least one of the following roles: ML Engineer: Developing production-grade cloud infrastructure (AWS/Azure/GCP) to support the deployment of machine learning applications, including drift monitoring. Data Scientist: Proficient in modern natural language processing techniques, including vector databases, fine-tuning of large language models (LLMs), and deploying LLMs using tools such as HuggingFace, Langchain, and OpenAI. Graduate degree in a relevant field is preferred.

At Databricks, our mission is to empower organizations to tackle the world's most challenging data problems using the Databricks Data Intelligence Platform. As a Senior Delivery Solutions Architect (DSA), you will be a pivotal contributor to this mission. In collaboration with our sales and field engineering teams, you will enhance the adoption and growth of the Databricks platform among our clients. Your role will be crucial in ensuring customer success by providing increased focus and technical accountability to our most intricate clients, helping them optimize their usage of Databricks workloads that they have chosen, and maximizing their return on investment.This position combines technical expertise with commercial acumen. You will drive growth in your assigned accounts and use cases by engaging with key stakeholders, building executive relationships, and orchestrating specialized teams within Databricks. You will develop and implement strategic plans to enhance the efforts of your colleagues. Additionally, you will take on a technical leadership role post-sale across all Databricks products, leveraging your skills and credibility to engage at all organizational levels. You will report directly to a DSA Manager within the Field Engineering organization.Your Impact:Collaborate with Solutions Architects to comprehend the complete use case demand plan for prioritized customers.Lead the post-technical win account strategy and execution plan for the majority of Databricks use cases within our strategic accounts.Assume accountability as the technical leader for specific use cases and customers across various selling teams and internal stakeholders, fostering certainty from uncertainty while driving onboarding, enablement, success, go-live, and healthy consumption of workloads where customers have chosen Databricks.Act as the primary point of contact for technical inquiries or issues regarding the production/go-live status of agreed use cases within an account, often servicing multiple use cases within the largest and most complex organizations.Utilize Shared Services, User Education, Onboarding/Technical Services, and Support resources, while escalating to expert-level technical professionals to carry out tasks beyond your expertise.Develop, own, and execute a perspective on how key use cases can be expedited into production, coordinating with Professional Services resources for delivery.

Join Appvia as a Senior Azure Platform Engineer - UK Security Clearance eligibility required.Contract Type: Permanent - Full-timeLocation: London, UK - Hybrid (1-2 days in office per month)Compensation: £75,000 - £90,000 + 10% Bonus + 10% Shares + Additional BenefitsAbout UsAt Appvia, we specialize in crafting cloud-native solutions that empower organizations to build, secure, and scale their operations in the cloud. Our offerings include self-service platforms, governance strategies, cost optimization, and AI accelerators. By collaborating with leading public cloud providers, we facilitate the development of modern cloud platforms in both public and private sectors, ensuring best practices in platform engineering to enhance governance and optimize costs, thereby boosting developer velocity and delivery efficiency.Role OverviewAs a Senior Azure Platform Engineer and Cloud Consultant, you will be pivotal in steering our clients towards cloud and DevOps maturity. Drawing from your extensive knowledge of cloud technologies and best practices, you'll work hand-in-hand with clients to design, implement, and refine solutions that meet their specific requirements. Your efforts will involve collaboration with multidisciplinary teams aimed at fostering innovation and delivering unparalleled value to our clients.Interview Process - Four Stages:Initial discovery discussion with our Talent Acquisition team.Technical assessment paired with our Engineering team.In-depth technical interview with Practice Leadership.Final interview focused on competencies with Engineering Leadership.Important NoteEligibility for Security Clearance is mandatory. Candidates must either possess an active SC clearance or be eligible for it. Requirements include:A valid British Passport or Indefinite Leave to Remain (ILR).Residence in the UK for a minimum of the last five years.No criminal records.No financial irregularities.QualificationsWe are looking for someone who is enthusiastic about emerging technologies and automation, with substantial experience in an Engineering Team adhering to Agile and DevOps best practices. You should be prepared to discuss your:Expertise in continuous integration and deployment methodologies.Collaboration skills across varying technical proficiency levels.Understanding of industry best practices.Experience in project management.Exceptional interpersonal skills, including the ability to inspire a team toward shared objectives.Main ResponsibilitiesPartner with clients to evaluate their existing infrastructure, pinpoint areas for improvement, and develop customized cloud and DevOps strategies.Architect and deploy scalable, resilient, and secure cloud-native solutions by leveraging industry standards and best practices.