About the job
Join our dynamic team at gsstech-group as a Senior Data Engineer. In this pivotal role, you will design, build, and enhance scalable data pipelines that empower advanced analytics and machine learning initiatives.
Collaborating closely with Data Scientists, Analytics Delivery Leads, and interdisciplinary teams, you will transform raw data into impactful insights within a fast-paced Agile environment.
Key Responsibilities
- Partner with stakeholders to collect and evaluate data requirements.
- Conduct Exploratory Data Analysis (EDA) to discern data patterns and quality.
- Architect and implement robust, scalable, and high-performance data pipelines.
- Ingest, process, and convert extensive structured and unstructured datasets.
- Apply feature engineering techniques that bolster machine learning models.
- Enhance Spark jobs for optimal performance, scalability, and cost-effectiveness.
- Maintain data quality, integrity, and security across all pipelines.
- Work collaboratively with Data Scientists and Analytics teams to deploy ML pipelines.
- Engage in Agile ceremonies and contribute to ongoing improvements.
- Effectively communicate technical solutions to both technical and non-technical stakeholders.
Required Skills & Qualifications
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related discipline.
- 8–10 years of experience in Data Engineering and Big Data ecosystems.
- Proficient programming skills in Python.
- Practical experience with PySpark / Apache Spark, including performance optimization.
- Strong knowledge of the Hadoop ecosystem.
- Advanced skills in SQL.
- Experience with data pipeline development and ETL frameworks.
- Familiarity with Machine Learning pipelines and feature engineering.
- Knowledge of version control systems (Git).
- Excellent problem-solving and analytical abilities.
Good to Have
- Experience with cloud platforms (AWS / Azure / GCP).
- Understanding of data warehousing solutions.
- Familiarity with workflow orchestration tools (e.g., Airflow).
- Experience in the banking or financial services sector.
Key Competencies
- Strong collaboration and communication abilities.
- Capability to thrive in a fast-paced Agile setting.
- Detail-oriented with an ownership mindset.
- Proficient in stakeholder management and coordination.

