Qualifications
Key Responsibilities:Design, develop, and maintain scalable ETL pipelines leveraging AWS services including Glue, Lambda, Kinesis, Step Functions, and EMR. Create and manage AWS Glue crawlers and jobs for the automated ingestion and cataloging of both structured and unstructured data sources. Build and optimize data workflows utilizing Apache Airflow and PySpark. Design and manage data warehouse solutions using AWS Redshift, focusing on performance tuning and query optimization. Develop and maintain data models, frameworks, and source-to-target mappings (STTM). Enable seamless data consumption for analytics and reporting tools such as QuickSight and SageMaker. Efficiently manage large-scale data using AWS storage solutions like S3 and RDS. Ensure data quality through automated testing and validation processes. Support User Acceptance Testing (UAT), deployment, and go-live activities for data solutions. Monitor and enhance cluster performance and resource utilization. Implement security and governance practices utilizing IAM and CloudTrail. Collaborate with teams using version control systems like Git or SVN for effective code management.
About the job
Join a leading client of Weekday as an AWS Data Engineer!
We are seeking a highly skilled AWS Data Engineer with a passion for designing, developing, and optimizing scalable data solutions within cloud environments. This full-time position emphasizes the importance of creating robust data pipelines that enhance data processing efficiency and support analytics and reporting initiatives.
As an integral member of our cross-functional teams, you will ensure that data is reliable, accessible, and aligned with business objectives. Your expertise in AWS data services and hands-on experience in managing extensive data environments will be crucial in maintaining seamless data operations from ingestion to consumption while upholding performance and reliability standards.
About Weekday's Client
Weekday's Client is at the forefront of leveraging cloud technologies to drive data-driven decisions. We value innovation, collaboration, and the continuous growth of our employees as we strive to deliver exceptional data solutions.
