Intermediate Data Engineer

Role Overview:We are on the lookout for a dynamic Big Data Lead who will play a pivotal role in taking our data capabilities to the next level. Your primary focus will be on solving intricate data challenges using cutting-edge big data technologies, dedicating almost 50% of your time to hands-on coding tasks.Key Responsibilities:Develop and manage large-scale text data processing and event-driven data pipelines, optimizing performance across CPU, network IO, and disk IO.Utilize cloud-native services on platforms such as AWS and GCP to enhance data processing and storage capabilities.About You:You possess a strong foundation in computer engineering, with expertise in Unix, data structures, and algorithms.You have successfully designed and implemented multiple big data modules and data pipelines capable of handling vast volumes of data.Passionate about technology, you have experience in initiating and executing projects from the ground up.

Capco is seeking a Big Data Tester in Pune, India. This role centers on verifying the quality and performance of big data solutions. The position involves working closely with teams from different disciplines to create and carry out detailed test plans. Role overview The Big Data Tester will help ensure data integrity by identifying defects and validating results throughout the testing process. Collaboration with colleagues across various functions is a key part of the job. What you will do Develop and execute test plans for big data systems Detect and document defects Validate the accuracy and integrity of data Work with cross-functional teams to support testing goals Work environment This position offers the chance to work with modern technologies as part of Capco’s data testing initiatives. The team values thoroughness and collaboration in a setting focused on continuous improvement.

Role Overview Syngenta Group is hiring an Engineering Lead for the Data & Analytics team in Pune. This position leads an engineering group focused on building and improving data solutions. The role works closely with colleagues from different functions to design and implement strong data architectures. What You Will Do Guide a team of engineers in developing and delivering data and analytics solutions Collaborate with other teams to shape and maintain effective data architectures Support the creation of analytics tools that help stakeholders make informed decisions

Join Assent as a Technical Lead in Data Engineering and play a pivotal role in transforming our data architecture. You will lead a talented team of data engineers, driving innovative solutions that enhance our data capabilities. Collaborate across teams to design, develop, and implement robust data pipelines and frameworks, ensuring data integrity and availability for analytical and operational needs.

Job Overview:Join our dynamic product organization as a Senior Data Engineer, where you will be pivotal in designing and developing sophisticated Big Data systems. This full-time position emphasizes your expertise in Spark and Delta/Data Lake technologies.In this role, you will spearhead the design, development, and maintenance of intricate data pipelines and API products crucial for our business operations and large-scale analytics. We seek candidates who can quickly adapt to new technologies and possess a solid foundation in data engineering or software engineering.Key Responsibilities:Collaborative Development: Partner with fellow engineers to architect and implement complex systems autonomously, while collaborating with team leadership to enhance platform capabilities.Pipeline Engineering: Develop and maintain sophisticated data pipeline products that underpin critical business operations and analytics applications.Team Support: Work alongside analytics, data science, and engineering teams to address their unique data challenges.Continuous Improvement: Stay abreast of the latest advancements in data engineering and embrace new technologies.Independent Contribution: Enjoy a role that provides significant independence while advancing the organization's technical capabilities.

Lead Data EngineerJoin our innovative team at Brillio as a Lead Data Engineer. In this pivotal role, you will spearhead the design and implementation of cutting-edge data engineering solutions that empower our clients to harness the full potential of their data. Collaborate with cross-functional teams to develop robust data pipelines, ensuring data quality, scalability, and efficiency. Your expertise will drive the success of our AI and data engineering initiatives, making a significant impact on our clients' business outcomes.

About Us Capco, a Wipro company, is a leading global technology and management consulting firm. Recognized as the Consultancy of the Year at the British Bank Awards and ranked among the Top 100 Best Companies for Women in India 2022 by Avtar & Seramount, we operate in 32 cities worldwide and support over 100 clients in the banking, financial, and energy sectors. Our expertise lies in delivering transformative solutions that drive deep change. WHY JOIN CAPCO? Engage in exciting projects with major international and local banks, insurance firms, payment service providers, and other key industry players. Be part of initiatives that are reshaping the financial services landscape. MAKE AN IMPACT Utilize your innovative thinking and delivery excellence to help our clients transform their operations. Collaborate with industry partners to deliver groundbreaking work that is revolutionizing energy and financial services. #BEYOURSELFATWORK Capco fosters an inclusive and open culture that celebrates diversity and creativity. CAREER ADVANCEMENT At Capco, we embrace a flat hierarchy where everyone has the chance to grow alongside the company, taking control of their career progression. DIVERSITY & INCLUSION We believe that diverse perspectives and backgrounds provide us with a competitive edge. MAKE AN IMPACT Location: Pune/BangaloreExperience Range: 5–9 years Role Overview:The Senior Data Engineer will be responsible for designing and developing intricate data pipelines, ensuring comprehensive solution delivery across enterprise-scale Big Data environments. This role focuses on data reliability, performance, and adherence to engineering best practices. Must-Have Skills:• 5–9 years of experience in Data Engineering within Data Warehouse/Data Lake/Lakehouse environments• Proficient in Spark development (Scala/Python/Java) on Hadoop or object storage• Strong SQL skills (Oracle/Netezza/Hive or similar)• Proven experience in delivering large-scale data pipelines• Familiarity with Agile/Scrum methodologies Optional Skills:• Experience building NiFi pipelines and using cloud platforms is a plus.

Join telefonicatech as a Senior Data Engineer in our Managed Services team, where you will play a pivotal role in designing, implementing, and maintaining data solutions that drive business decisions. You will work collaboratively within a dynamic team to create robust data pipelines and ensure data integrity across various platforms.

Role Overview metromakro is hiring a Data Architect in Pune. This role shapes the design and implementation of data solutions that support business growth. The Data Architect defines and maintains the data architecture, making sure it meets standards for performance, scalability, and security. What You Will Do Design and implement data architectures that align with company objectives Guide the overall data strategy for the organization Work with cross-functional teams to improve data infrastructure Enable data-driven decision-making by ensuring reliable and accessible data systems Who We’re Looking For The ideal candidate brings leadership and vision to data architecture. Strong collaboration skills are essential to work across teams and build solutions that support business needs.

At SiteMinder, we value the unique contributions of our team members as the driving force behind our success. We foster an environment that embraces diversity, encouraging teams to incorporate a rich variety of voices, identities, backgrounds, experiences, and perspectives. Our inclusive culture empowers employees to express their authentic selves at work, ensuring that our differences fuel our ongoing revolution in delivering exceptional service to our customers. Together, we achieve more!About UsSince 2006, our passion for technology has led us to create a world-class hotel commerce platform that simplifies the booking process for accommodation owners. We empower hotels of all sizes—from boutique establishments to major chains—by enabling travelers to easily book a wide range of accommodations, from igloos to castles and everything in between.Today, we proudly support over 50,000 hotels across 150+ countries, processing more than 130 million reservations annually through our innovative technology.The OpportunityWe are on the lookout for an exceptionally skilled and hands-on Principal Data Engineer to become the cornerstone of our data platform. In this pivotal role, you will align executive strategy with technical execution, collaborating closely with our Chief Data Officer and VP of Data & Business Systems.The ideal candidate will be an expert in the modern data stack, particularly with Databricks and dbt, showcasing a profound passion for clean Kimball-style data modeling and the Medallion Architecture. Beyond individual contributions, you will serve as a mentor and coach, committed to enhancing the engineering standards of our team.Key ResponsibilitiesDesign & Implementation: Create and deploy robust, end-to-end data pipelines using Databricks, adhering to the Medallion Architecture.Data Modeling Authority: Serve as the definitive expert on data modeling, implementing Kimball best practices (including Star Schemas and Dimensional Modeling) to optimize data performance and usability.dbt Project Leadership: Drive the implementation and enhancement of dbt projects, ensuring modular architecture and clear documentation.

About the Role  Join PubMatic as a Senior Software Engineer focused on Data Analytics, where you will leverage your expertise to craft and refine AI agents. Your proficiency in technologies such as Hadoop, Spark, Scala, Kafka, and cloud solutions, alongside programming skills in Scala and Python, will be essential. In this role, you will develop sophisticated AI agents that elevate our data analytics capabilities, facilitating complex information retrieval, contextual comprehension, and adaptive interactions, thereby enhancing data-driven insights and analytical workflows.What You'll Do:Design, build, and implement a highly scalable, fault-tolerant big data platform to process vast amounts of data and deliver comprehensive analytics to clients.Develop backend services utilizing Java, REST APIs, JDBC, and AWS.Construct and maintain Big Data pipelines using Spark, Hadoop, Kafka, and Snowflake.Architect real-time data processing workflows and automation frameworks.Create GenAI-powered agents for analytics, operational tasks, and data enrichment, employing frameworks such as LangChain and LlamaIndex.Integrate large language models (e.g., OpenAI, Claude, Mistral) into existing services for enhanced query understanding, summarization, and decision-making support.Oversee end-to-end GenAI workflows, including prompt engineering, fine-tuning, vector embeddings, and retrieval-augmented generation (RAG).Collaborate with cross-functional teams to improve the availability and scalability of large data platforms and enhance PubMatic software functionality.Engage in Agile/Scrum practices such as sprint planning, retrospective sessions, backlog grooming, and user story management.Regularly consult with product managers regarding the integration of new features into the PubMatic Data Analytics platform.Provide support for customer issues through email or JIRA, offering updates and patches to resolve problems.

Join us at DemandMatrix as a Lead Data Scientist, where you will spearhead a talented team dedicated to uncovering insights hidden within extensive datasets. Your mission will be to leverage these insights to enhance our decision-making processes and improve our product offerings. Collaborate with our data scientists to drive initiatives focused on advanced data mining techniques, statistical analysis, and the development of high-quality predictive systems. This role is pivotal in the technographics domain, addressing challenges such as the buyer's journey and Technology Adoption Models (TAM).Key Responsibilities:Lead CRISP-DM projects with a team of 3 data scientists, focusing on:Feature selection, classifier building and optimization (including logistic regression and RF-based propensity models), and developing recommendation systems using machine learning methodologies.Utilize cutting-edge data mining techniques to automate scoring processes, enhance recommendation and propensity modeling algorithms, and expand feature sets.Integrate third-party data sources when necessary to enrich company data.Improve data collection processes to capture relevant information for analytical frameworks.Ensure data integrity through processing, cleansing, and verification while performing comprehensive exploratory data analysis (EDA).Conduct ad-hoc analyses and present findings in an understandable format.Create and monitor recommendation and propensity models, adjusting for concept drift as needed.

Join NielsenIQ as a Lead Data Scientist and take the lead in driving innovative data solutions. In this role, you will be responsible for developing advanced analytical models and insights that empower our clients to make data-driven decisions. Collaborate with cross-functional teams to harness large datasets and transform them into actionable business strategies. Your expertise will play a crucial role in enhancing our data science capabilities and delivering high-impact results.

Join our dynamic team at Pattern as a Data Collections Team Lead in Pune, India. We are seeking a proactive and people-focused leader to guide our expanding Marketplace Data Acquisition team. This role uniquely combines team leadership with hands-on involvement in our daily data collection initiatives. The ideal candidate will possess a strong background in managing operational teams, exceptional process management capabilities, and a readiness to engage directly in data collection activities when necessary.

Join our innovative team at Metromakro as a Lead Enterprise Data Architect. In this pivotal role, you will design and implement data architecture strategies that align with our business objectives. You will work closely with cross-functional teams to ensure data integrity and drive data-driven decision-making across the organization. Your expertise will help shape our data landscape and propel our analytics capabilities to new heights.

Join our dynamic team at v4c as an Associate Data Engineer, where you'll embark on an exciting journey to master the latest data engineering tools and methodologies. Key Responsibilities: Engage in structured training programs to learn about cutting-edge data engineering technologies and best practices. Collaborate effectively with senior engineers in designing and developing robust data pipelines and processing systems. Work hands-on with real-world datasets and cloud platforms to gain invaluable practical experience.

Join HackerOne as a Senior Data Engineer and be a cornerstone in our mission to help organizations find and fix vulnerabilities in their systems. You will be responsible for designing, developing, and maintaining robust data pipelines that ensure our data is clean, accurate, and accessible for key stakeholders.In this role, you will collaborate with cross-functional teams to understand their data needs and deliver innovative solutions that improve data-driven decision-making processes. Your contributions will play a vital role in our analytics capabilities and overall business strategy.

Empower Hardware Innovators to Create Superior Products, SwiftlyAt Fictiv, we thrive on enabling product innovators to bring their visions to life.Fictiv stands at the forefront of global manufacturing and supply chain solutions, empowering organizations to scale seamlessly across our four manufacturing hubs located in India, Mexico, China, and the United States. Businesses turn to Fictiv for unparalleled production quality, optimized supply chain logistics, and effective risk management—facilitating a smooth transition from prototypes to full-scale manufacturing with agility and assurance. With over 35 million commercial and prototype parts delivered across various industries, including aerospace, robotics, automotive, and climate tech, Fictiv is dedicated to accelerating innovation and fostering resource optimization for sustainable growth. Why Join Us?Unleash Your CreativityBreak free from the constraints of conventional processes. At Fictiv, a growth mindset is woven into our culture, granting you the creative freedom and collaborative support to explore bold ideas and meet our sales and customer objectives.Advance Your CareerBe part of a team that nurtures your growth—surrounded by passionate peers who inspire you to reach your fullest potential.Role ImpactJoin our Data Intelligence team, where you will develop insightful reports and dashboards that translate data from our warehouse into actionable insights. Collaborate closely with cross-functional teams and utilize various Business Intelligence (BI) technologies to promote data-driven decision-making throughout the organization.

Role overview MetroMakro seeks a Team Lead for Article Master Data Management in Pune. This role guides a team focused on ensuring the accuracy and quality of article master data used in commercial operations. The position shapes how core article data is managed and maintained across the business. What you will do Oversee the integrity, accuracy, and accessibility of article master data. Lead and support a team responsible for keeping data records current and reliable. Collaborate with cross-functional groups to improve data collection and management processes. Drive projects that strengthen data strategy and promote accountability. Foster a culture of continuous improvement within the team. Requirements Proven leadership skills and experience managing teams. Keen attention to detail and a structured approach to solving problems. Background in data management within a commercial or similar environment. Strong ability to work collaboratively across departments. This position is based in Pune.