companyIMC Trading logo

Data Platform Engineer

IMC TradingMumbai, India
On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Mid to Senior

Qualifications

Your Key Responsibilities:Oversee and monitor distributed systems, storage infrastructure, and data processing platforms, including HDFS, Kubernetes, Dremio, and in-house data pipelines. Prioritize automation and CI/CD processes to facilitate rapid deployment of hardware and software solutions. Collaborate with systems and network engineers, traders, and developers to address and resolve inquiries effectively. Keep abreast of industry technology trends; propose, assess, and implement cutting-edge solutions. Your Skills and Experience:5-7 years of experience managing large-scale multi-petabyte data infrastructures in a comparable role. In-depth knowledge of Linux system administration and internals, demonstrating strong troubleshooting capabilities in Linux environments. Extensive expertise with at least one of the following technologies: Kafka, Spark, Cassandra/Scylla, or HDFS. Proficient in Docker, Kubernetes, and Helm. Familiarity with data access technologies such as Dremio and Presto. Experience with workflow orchestration tools like Airflow and Prefect. Exposure to cloud platforms like AWS, GCP, or Azure. Strong competency in CI/CD pipelines and version control systems, especially Git. Knowledge of data security and compliance best practices. Proven problem-solving skills with a proactive and innovative approach. Adaptable and quick to learn with excellent troubleshooting abilities.

About the job

Become a vital member of our innovative and results-driven Data team as a Data Platform Engineer. In this pivotal role, you will be entrusted with the secure management and storage of trading-related data for our teams in India. You will also oversee and enhance our shared data access and processing systems, which are crucial for a wide range of trader analytics, simulations, reporting, and insights. The ideal candidate will possess a solid foundation in systems engineering, ideally with experience in financial markets, and will demonstrate expertise in Linux administration, orchestration and automation tools, systems hardware architecture, and data storage and protection technologies.

About IMC Trading

IMC Trading is a global trading firm known for its advanced research environment and robust technological infrastructure. Since 1989, we have played a stabilizing role in financial markets, delivering innovative trading solutions across the globe.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.