About the job
We are excited to announce an opening for a Senior Big Data Developer at one of the world's premier professional services firms, celebrated for its dedication to innovation, excellence, and making a global impact. Operating in over 150 countries, this firm provides a wide array of services including consulting, audit, tax, risk advisory, and financial advisory, assisting Fortune 500 companies and governments in overcoming complex challenges.
About the Role:
We are looking for a talented Big Data Developer with extensive experience in Spark and Scala to join our vibrant team. The successful candidate will have practical experience with cloud platforms like AWS, Azure, or GCP, specifically for big data processing and storage solutions. You will be instrumental in designing, developing, and maintaining robust data pipelines and backend services utilizing cutting-edge big data technologies.
Key Responsibilities:
- Design, optimize, and maintain large-scale data processing pipelines utilizing Apache Spark and Scala.
- Manage and implement cloud-based big data storage and processing solutions on Azure Data Lake Storage (DLS) and Azure Databricks.
- Work collaboratively with cross-functional teams to identify data needs and deliver scalable backend services using Java and the Spring Boot framework.
- Maintain best practices in data security, performance optimization, and code quality.
- Diagnose and resolve production issues related to big data workflows and backend systems.
- Continuously assess emerging technologies to propose enhancements to existing systems.
Must-Have Qualifications:
- Minimum of 6 years of experience in Big Data development.
- Deep expertise in Apache Spark and Scala for data processing.
- Hands-on experience with cloud platforms like AWS, Azure, or GCP, with a strong emphasis on Azure Data Lake Storage (DLS) and Azure Databricks.
- Proficient backend development skills in Java and Spring Boot framework.
- Experience in architecting and implementing scalable, fault-tolerant data pipelines.
- Strong understanding of big data architectures, ETL processes, and data modeling.
- Exceptional problem-solving abilities and experience working in an agile environment.
Preferred Skills:
- Familiarity with machine learning frameworks is a plus.
- Experience in data visualization tools.
- Knowledge of Docker and Kubernetes.

