Senior Databricks Data Engineer

About WPP MediaWPP Media is the trusted growth partner for the world’s leading brands. Combining exceptional talent, reliable data and intelligence, along with world-class partnerships, we empower clients to navigate change and seize opportunities for transformative growth through our innovative marketing platform, WPP Open.As WPP's AI-driven media operating unit, WPP Media integrates media, data, and partnerships to deliver large-scale creative personalization. Through WPP Open and powered by Open Intelligence, our clients gain clear insights into the effectiveness of their media investments.For further details, please visit wppmedia.com.WPP Media OverviewAt WPP, we harness the power of creativity to foster better futures for our people, planet, clients, and communities. Explore more at wpp.com.WPP Media, our global media collective, thrives in a world where media is omnipresent. We unite the finest platforms, talent, and partners to unlock limitless growth opportunities. Discover more at wppmedia.com.We pride ourselves on our vibrant culture and team. This role is essential for embodying the core values shared by WPP and WPP Media:Be Extraordinary by collectively leading to inspire transformational creativity.Create an Open environment by balancing people and client experiences through trust cultivation.Lead Optimistically by championing growth and development to mobilize the enterprise.

Lead Data EngineerAs a Lead Data Engineer at Brillio, you will spearhead the design and implementation of data solutions that drive business intelligence and analytics. Your expertise will play a crucial role in optimizing data pipelines and ensuring data integrity across various platforms. Join our innovative team in Bangalore, where you will collaborate with cross-functional teams to leverage data in transformative ways.

Lead Data EngineerAs a Lead Data Engineer at Brillio, you will spearhead our data engineering initiatives, driving the development and implementation of robust data solutions. Your expertise will enhance our capabilities in data analytics and machine learning, ensuring we leverage data as a strategic asset. Collaborating with cross-functional teams, you will design and optimize data pipelines, enabling efficient data management and analysis. This role requires a passion for data and the ability to lead a team towards achieving excellence in data engineering.

Lead Data EngineerJoin our dynamic team at Brillio as a Lead Data Engineer, where you will take charge of designing, developing, documenting, and testing cutting-edge data pipelines. You will work with both structured and unstructured data sources in the Azure cloud environment, leveraging tools such as Azure Synapse and Azure Data Factory to drive impactful data solutions.In this role, you will utilize your expertise to create complex data pipelines, demonstrating your proficiency in Azure Synapse and Azure Data Factory. Your skills in SQL and Python (with a preference for Pyspark) will be essential, and experience with Databricks or Synapse notebooks will be highly valued. You will also engage in source control processes and collaborate effectively with business stakeholders, showcasing your excellent communication skills.

Join Our Team as a Senior Lead Data EngineerAre you an innovative and experienced Data Engineer ready to take the lead in transforming data into actionable insights? At Brillio, we are looking for a Senior Lead Data Engineer who is passionate about leveraging advanced data engineering techniques to drive our AI and data initiatives forward.In this role, you will oversee data architecture, design, and development, ensuring that our data solutions meet business needs while optimizing performance and reliability. Your expertise will guide the team in building robust data pipelines and implementing best practices in data management and governance.

Senior Data EngineerJoin our innovative team at Brillio, where we are dedicated to harnessing the power of data to drive business solutions. As a Senior Data Engineer, you will play a pivotal role in designing and implementing robust data pipelines and architectures that support our AI and data engineering initiatives. Your expertise will help us transform complex data into actionable insights, enabling our clients to make informed decisions. This is an exciting opportunity for professionals who are passionate about data and eager to contribute to cutting-edge projects.

At Emergent Labs, we are pioneering the development of autonomous coding agents that redefine traditional software engineering. Our innovative systems transform plain-language intent into fully functional applications, which are rigorously tested and deployed in real-time across a global scale. With millions of applications built on our platform, we are revolutionizing the software development landscape.Since our public launch, we have achieved remarkable success, reaching $100 million in Annual Recurring Revenue (ARR) within just 8 months. Over 6 million users from more than 190 countries have created over 6.5 million applications using our technology. Supported by investors including Khosla Ventures, SoftBank, Google, Lightspeed, Prosus, Together, and Y Combinator, we have raised over $100 million.Our mission is to tackle the complexities of AI-driven software creation, ensuring correctness, reliability, security, and scalability in production environments. Our team comprises repeat founders, Olympiad medalists, and alumni from prestigious institutions like IIT and IIM, as well as leaders from Google, Amazon, and Dropbox.We are looking for motivated builders who seek ownership, speed, and the opportunity to make a global impact.

Lead Data EngineerJoin our dynamic team at Brillio as a Lead Data Engineer, where you will take charge of designing and implementing robust data solutions. You will work closely with our AI & Data Engineering departments to drive innovation and efficiency in data processing and analytics. Your expertise will be crucial in guiding our data strategy and ensuring optimal performance of our data infrastructure.

Jumio Corporation is hiring a Data Engineer II to join the biometrics team in Bangalore. This role focuses on enhancing how biometric data is processed and managed, directly supporting the company’s identity verification products. Key responsibilities Build and maintain data pipelines that handle biometric information Use modern technologies to improve data processing workflows Contribute to stronger data management practices and help ensure reliability Location The position is based on-site in Bangalore.

About Us Moniepoint Inc. stands as Africa's premier financial ecosystem, offering comprehensive solutions that empower over 10 million businesses and individuals with seamless access to payment frameworks, banking services, credit solutions, and essential business management tools since its inception in 2019. As Nigeria's foremost merchant acquirer, Moniepoint facilitates the majority of the country's Point of Sale (POS) transactions. Our subsidiaries collectively handle a staggering $22 billion in transactions monthly, all while maintaining profitable operations. Role Overview: At Moniepoint, data is integral to our mission. As a Data Engineering Lead, you will be pivotal in enabling our teams to leverage data for informed decision-making that drives our business success. You will engineer scalable, robust data systems that bolster our business intelligence and analytics capabilities. We seek leaders who are not only technically proficient but also passionate about mentoring their teams and exploring innovative data solutions. Curious about our workplace culture? Discover how we foster innovation, teamwork, and personal growth. Key Responsibilities: Design and maintain robust data pipelines to handle large data volumes efficiently. Conduct analyses of extensive data sets utilizing tools such as Python and SQL. Enhance our data platform for improved speed, scalability, and cost-effectiveness. Collaborate with various teams to understand and fulfill their data requirements. Create processes and tools for monitoring and evaluating model performance and data accuracy. Address general data-related challenges. Establish new data pipelines for the complete stream, enrichment, and curation processes. Maintain source code repositories. Explore and implement machine learning and AI to enhance our cloud offerings. Support the development of junior team members. Qualifications for Success: 5-7+ years of proven experience as a Data Engineer, with a strong portfolio of accomplishments. Demonstrated leadership experience. Exceptional problem-solving abilities. Advanced SQL skills. Proficiency in Python. Familiarity with cloud platforms such as Google Cloud, AWS, or Azure. Experience with version control systems like Git. Excellent verbal and written communication skills. A strong desire to learn and grow within the field.

Couchbase, Inc. is seeking a Senior Finance Data Engineer to join its Finance team in Bangalore, India. This position centers on supporting the company’s financial operations through data engineering expertise. Role overview The Senior Finance Data Engineer will play a central part in the Finance team. The role involves working with financial data and supporting the team’s objectives through data-driven solutions. Location This position is based in Bangalore, India. Company background Couchbase provides an operational data platform used by leading organizations to manage operational, analytical, mobile, and AI workloads. The platform helps enterprises modernize infrastructure and unify data services for performance and scalability. Learn more at couchbase.com.

Position Summary: The Senior Clinical Data Engineer is pivotal in the strategic advancement and enhancement of clinical data systems, ensuring alignment with regulatory standards, facilitating advanced analytics, and promoting operational excellence across global clinical trials. This role spearheads enterprise-level data standardization projects and designs scalable validation frameworks, effectively addressing systemic data challenges. With extensive expertise in programming languages such as Python, R, SQL, and SAS, the engineer develops and sustains modular codebases, establishes coding standards, and provides mentorship to junior engineers. The position also involves ensuring compliance with regulatory requirements such as GCP and FDA 21 CFR Part 11 by creating comprehensive documentation and audit trail protocols. Utilizing dynamic dashboards and analytical tools, the engineer provides actionable insights into trial performance and data quality. Acting as a strategic liaison among Biostatistics, Clinical Operations, and Regulatory Affairs, the engineer translates clinical requirements into scalable technical solutions, leading the design of secure, high-performance databases and ETL pipelines that integrate data from various clinical systems. Essential Functions: Data Standardization & Mapping: Lead the creation of enterprise-level data mapping strategies to convert raw clinical data into standardized formats for impactful analytics. Ensure governance of data standards across programs for regulatory compliance and consistency. Data Quality Assurance: Develop and implement robust validation frameworks that proactively identify and mitigate systemic data issues, collaborating closely with Clinical Data Managers and cross-functional teams to enhance data integrity across global trials. Programming & Scripting: Design and maintain advanced modular codebases using Python, R, SQL, and SAS to support complex data engineering workflows. Set coding standards and mentor junior engineers in automation, reproducibility, and performance optimization. Regulatory Compliance & Documentation: Lead initiatives to ensure data systems and workflows align with GCP, FDA 21 CFR Part 11, and evolving global regulatory standards. Establish documentation protocols and oversee audit trail governance for inspection readiness. Reporting & Visualization: Develop and operationalize dynamic dashboards and analytics tools, delivering insights into trial performance and data quality.

Join Airbnb as a Senior Data Engineer in our Payments team, where you will play a pivotal role in transforming data into actionable insights. As part of our dynamic team, you will design and implement robust data pipelines to support our payment processing systems. Your expertise will help us enhance our data-driven decision-making process, enabling us to deliver a seamless experience for our users.

Proven experience in establishing data pipelines using Azure technologies.Hands-on expertise with Azure Data Factory for data integration and transformation.Proficient in setting up Azure Data Lake to handle both structured and unstructured data.Ideal candidates will demonstrate self-motivation and the ability to independently design, develop, and implement solutions with minimal guidance.In-depth knowledge of Azure services, including Storage (AFS, Blob, Data Lake) and Azure Functions.Strong database skills, with the capability to write complex SQL queries and design efficient schemas.Experience in establishing CI/CD pipelines in Azure using GitHub.

About WPP Media WPP is a leader in creative transformation, utilizing the power of creativity to foster better futures for our workforce, the planet, our clients, and communities. Discover more at wpp.com. WPP Media stands as WPP’s global media collective. In an era where media is omnipresent, we unite the finest platforms, talent, and partnerships to unlock boundless growth opportunities. Explore further at wppmedia.com. At WPP Media, we cherish our culture and our people, which empowers us to deliver extraordinary experiences for both our clients and ourselves. In this position, embracing WPP and WPP Media’s united core values will be essential: Be Extraordinary by Leading Collectively to Inspire Transformational Creativity. Create an Open environment by Balancing People and Client Experiences through Trust. Lead Optimistically by Fostering Growth and Development to Mobilize the Enterprise. Key Responsibilities: Oversee the maintenance and enhancement of WPP’s Measure reporting platform, aligning it with client reporting needs. Utilize Google Cloud Platform applications to efficiently transfer data into client environments (Azure, GCP, etc.), enhancing performance and ensuring data quality and service excellence. Deploy and resolve issues with data collectors in Adverity to aggregate data from various media and agency systems. Enhance existing data “recipes” and transformations in SQL via DBT running on Google Cloud Platform, sharing scripts with a central repository. Develop and uphold data quality checks and procedures to proactively address data issues impacting reporting solutions. Collaborate with the program lead to sustain a development roadmap for new advertising platforms, reports, and provisioning destinations. Lead a team of two junior engineers, managing support tickets, troubleshooting issues, and fostering their professional growth. Exhibit proficiency in Google Cloud Platform and related technologies, ensuring adherence to industry best practices. Monitor automated jobs, addressing data issues as they arise.

Join Our Team as a Senior Data EngineerAt Brillio, we are on the lookout for an experienced and innovative Senior Data Engineer to join our AI & Data Engineering department. In this pivotal role, you will leverage your expertise in data architecture, pipelines, and analytics to help drive our data-driven initiatives. You will collaborate with cross-functional teams to design, implement, and optimize complex data solutions that empower our clients to make informed decisions. If you're passionate about building scalable data systems and are eager to work in a fast-paced environment, we want to hear from you!

Position Summary:The Senior Clinical Data Engineer plays a pivotal role in the strategic creation and enhancement of clinical data systems, ensuring compliance with regulatory standards while driving advanced analytics and operational excellence for global clinical trials. This position leads enterprise-wide data standardization initiatives and designs scalable validation frameworks to proactively tackle systemic data challenges. With extensive proficiency in Python, R, SQL, and SAS, the engineer develops and sustains modular codebases, sets coding standards, and provides mentorship to junior engineers. Furthermore, the role entails ensuring regulatory alignment with Good Clinical Practice (GCP) and FDA 21 CFR Part 11 by establishing rigorous documentation and audit trail protocols. By leveraging dynamic dashboards and analytical tools, the engineer offers actionable insights into trial performance and data quality. As a strategic collaborator among Biostatistics, Clinical Operations, and Regulatory Affairs, the engineer translates clinical requirements into scalable technical solutions while leading the design of secure, high-performance databases and ETL pipelines that integrate data from various clinical systems.Key Responsibilities:Data Standardization & Mapping - Lead the development of enterprise-level data mapping strategies that convert raw clinical data into standardized formats for impactful analytics. Champion the implementation and governance of data standards across programs to ensure regulatory compliance and consistency.Data Quality Assurance - Design and deploy robust, scalable validation frameworks that proactively identify and rectify systemic data issues. Collaborate closely with Clinical Data Managers and cross-functional teams to enhance data integrity across global trials.Programming & Scripting - Architect and maintain advanced modular codebases utilizing Python, R, SQL, and SAS to support intricate data engineering workflows. Establish coding standards and mentor junior engineers in automation, reproducibility, and performance optimization. Key applications include edit checks, reconciliations, exception listings, programmed protocol deviations, and resource projections based on site data entry volumes.Regulatory Compliance & Documentation - Spearhead compliance efforts to ensure that all data systems and workflows adhere to GCP, FDA 21 CFR Part 11, and evolving global regulatory requirements. Define documentation protocols and oversee audit trail governance to maintain inspection readiness and transparency.Reporting & Visualization - Design and implement dynamic dashboards and analytics tools to visualize trial performance and ensure data quality.

About WPP MediaWPP is recognized as the reliable growth partner for leading global brands. With an exceptional workforce, trusted data, and strategic alliances, we leverage our innovative marketing platform, WPP Open, to assist clients in navigating transformation, seizing opportunities, and achieving significant growth.As WPP's AI-driven media operating unit, WPP Media merges media, data, and partnerships to deliver large-scale creative personalization. Utilizing WPP Open and powered by Open Intelligence, clients gain precise insights into their media investments.To learn more, visit wppmedia.com.About WPPWPP is the creative transformation company. We harness the power of creativity to foster better futures for our employees, planet, clients, and communities. For more information, visit wpp.com.WPP Media is WPP’s global media collective. In an era where media permeates all aspects of life, we unite the best platforms, talent, and partners to create endless growth opportunities. For further details, visit wppmedia.com.At WPP Media, we value our culture and our people, which empower us to deliver extraordinary experiences for our clients and one another. In this position, it is essential to embody WPP's and WPP Media's shared core values:Be Extraordinary by leading collaboratively to inspire transformational creativity.Create an Open environment by balancing people and client experiences through trust.Lead Optimistically by advocating growth and development to mobilize the enterprise.This role will be a vital member of a data engineering team dedicated to one of WPP’s prominent global clients, tasked with maintaining and expanding a global data warehouse, automated reports, and data provisioning applications to ensure that media and marketing stakeholders worldwide have access to accurate data and insights to guide their marketing strategies.WPP has introduced the Measure platform, a suite of standardized technologies (Adverity for data collection, DBT for modeling, Google Cloud Platform for orchestration, computing, and storage, and Microsoft PowerBI for visualization) and templates to accelerate deployment and streamline support for automated reporting and analytics tools.

Join Our Team as a Senior Data Engineer!Are you passionate about data engineering and AI? At Brillio, we are seeking a talented Senior Data Engineer to help us transform the way organizations leverage data. In this role, you will design and implement scalable data solutions, ensuring high-quality data flow and architecture. Collaborate with cross-functional teams to build data pipelines that drive insights and support business decisions. If you're ready to take your career to the next level and make an impact, we want to hear from you!