companyDeepLight AI logo

Data Assurance Lead

DeepLight AIDubai, Dubai, United Arab Emirates
On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Senior

Qualifications

Your responsibilities as the Data Assurance Lead will encompass:Data Quality Framework ImplementationExecute Soda Core data quality checks across all Medallion layers (Bronze, Silver, Gold). Establish and sustain a library of data quality rules, including:Schema validation (ensuring completeness, uniqueness, and data types). Business rule validation (maintaining referential integrity and value ranges). Reconciliation checks (source-to-target, row counts, checksums). Freshness and timeliness SLAs as outlined in data contracts. Automation & GovernanceDeploy automated data contracts using Soda and secure agreement with both data producers and consumers. Develop automated validation and reconciliation protocols. Create data quality scorecards in OpenMetadata, integrated with Soda. Retrofit assurance checks across all active data streams. Construct automated regression test suites for critical data flows. Monitoring & Incident ManagementSet up data quality alerts and thresholds. Establish escalation protocols for data-related incidents. Collaborate with operational teams for alerting and monitoring. Investigate data issues, implement corrective actions, and enhance check performance.

About the job

DeepLight AI is a leading consultancy specializing in artificial intelligence and data solutions, renowned for our in-depth experience in deploying intelligent enterprise systems across various sectors, particularly in financial services and banking. Our expert team blends comprehensive knowledge of data science, statistical modeling, AI/ML technologies, workflow automation, and systems integration with a nuanced understanding of intricate business operations.

We are currently seeking a Data Assurance Lead to act as the principal steward of data integrity within our clients' multifaceted Lakehouse environments. In this pivotal consultancy position, you will not only oversee data but also architect, execute, and operationalize a comprehensive Data Assurance Framework from the ground up. By leveraging Soda Core within the Medallion architecture (Bronze, Silver, Gold), you will establish stringent quality standards, automate data contracts, and incorporate scorecards into OpenMetadata.

In this consultative role, you will transcend the role of a mere technical specialist; you will become a strategic champion for data reliability. Exceptional communication skills are essential to effectively convey the significance of data assurance to stakeholders, guide cross-functional teams through ambitious migration objectives, and foster a culture of quality within AWS Glue and Data Factory workflows. If you have over 8 years of experience—preferably within the Financial Services or Banking industries—and flourish in dynamic, Agile environments where you can simplify complexity and engage senior stakeholders, we invite you to take on this exciting challenge.

About DeepLight AI

At DeepLight AI, we combine cutting-edge AI technologies with deep-rooted industry knowledge to provide innovative data solutions. Our team is dedicated to delivering exceptional results in data integrity and automating complex processes, ensuring our clients can navigate their digital transformations effectively.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.