companyDeepLight AI logo

Data Engineer at DeepLight AI | Dubai

DeepLight AIDubai, Dubai, United Arab Emirates
On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Experience

Qualifications

Key Responsibilities:Design and optimize scalable data solutions using Lakehouse architecture to unify data warehousing and lake capabilities. Guide stakeholders in choosing between Data Warehouse, Data Lake, and Lakehouse architectures based on business requirements, cost, and latency. Develop and maintain scalable, reliable data pipelines to process diverse datasets from various sources including structured and unstructured data, streaming data, and real-time feeds. Implement standards and tools to ensure ACID properties, schema evolution, and high data quality in the Lakehouse environment, alongside robust data governance frameworks. Continuously enhance data storage, compute resources, and query performance to minimize costs and improve latency for BI and ML workloads through indexing, partitioning, and parallel processing techniques. Establish CI/CD pipelines to automate the machine learning lifecycle, covering data validation, model training, deployment, and infrastructure provisioning. Deploy and manage machine learning models in production using MLOps principles for reliable operations. Set up monitoring systems to track model performance, detect data drift, and ensure model accuracy. Maintain rigorous version control for all components, including code, datasets, and trained model artifacts.

About the job

DeepLight AI is a premier consultancy specializing in artificial intelligence and data solutions, renowned for our extensive expertise in deploying intelligent enterprise systems across diverse industries, particularly in financial services and banking. Our team merges profound knowledge in data science, statistical modeling, AI/ML technologies, workflow automation, and systems integration with a pragmatic grasp of intricate business operations.

The Data Engineer will play a pivotal role in designing, implementing, and optimizing data pipelines and infrastructure to bolster our innovative AI systems. This role involves close collaboration with our cross-functional team to ensure the effective collection, storage, processing, and analysis of large-scale data, unlocking valuable insights and fostering innovation across various sectors.

About DeepLight AI

At DeepLight AI, we pride ourselves on being at the forefront of AI and data consultancy. With a focus on delivering intelligent enterprise solutions, our team is equipped with the skills and experience necessary to transform data into actionable insights, driving innovation and efficiency in numerous industries, especially in the financial sector.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.