About the job
We are looking for a talented Data Engineer to contribute significantly to a vital client initiative. This role will involve the design, construction, and optimization of data pipelines within a cloud-centric data and analytics ecosystem. The ideal candidate will possess a solid foundation in data engineering principles, a commitment to delivering reliable solutions, and the capability to work collaboratively with both technical and business teams.
Key Responsibilities:
Data Engineering & Pipeline Development
Design, build, and sustain scalable data pipelines for both batch and streaming workloads.
Develop robust ingestion, transformation, and curation processes using contemporary data engineering tools and methodologies.
Create and maintain data models, curated datasets, and integration layers to facilitate analytics and reporting.
Enhance data processing for optimum performance, reliability, and cost-effectiveness.
Data Quality, Governance & Security
Establish data quality checks, validation processes, and automated monitoring.
Ensure comprehensive and accurate data lineage, metadata management, and documentation.
Implement necessary security measures, including role-based access controls, data masking, and protection of sensitive information.
Cloud & Platform Engineering
Utilize cloud-native services for storage, compute, and workflow orchestration.
Oversee pipeline and platform performance, identifying and resolving any issues or bottlenecks.
Assist in configuring environments, standardizing processes, and implementing best practices.
DevOps, Automation & Observability
Leverage CI/CD practices to deploy code, configurations, and data assets across different environments.
Maintain version control, engage in code reviews, and adhere to release processes.
Construct monitoring, alerting, and logging systems to support high-quality operations and quick issue resolution.
Collaboration & Delivery
Work closely with technical and business stakeholders to ensure alignment and successful project delivery.

