Lead Data Engineer

Position: Big Data Lead & DeveloperExperience: 8-10 yearsLocation: BengaluruIndustry: TelecommunicationsEmployment Type: Full-time Visa Sponsorship: Available for on-site client workCore Competency: In-depth knowledge of the data management landscape with a strong grasp of core Big Data design patterns and challenges in data analytics, modeling, quality improvement, and data management implementation. Proficient in technologies such as Hadoop, Spark, Amazon Web Services, Google Cloud Platform, and Microsoft Azure.Position Overview: The Big Data Lead will spearhead the design and development of scalable and distributed applications utilizing the Hadoop Technology Stack, including Apache Pig, Apache Hive, and HDFS.Key Responsibilities:Develop cutting-edge ICT big data solutions that integrate existing systems with new data analytics strategies.Design, test, deploy, and document Big Data platforms and analytical procedures.Deliver scalable and distributed applications utilizing Hadoop technologies.Provide efficient solutions based on project requirements.Implement Map/Reduce jobs, UDFs, and tune the performance of Hadoop jobs.Collaborate with data scientists, analysts, and product management to summarize data analysis results for business decision-making.Document functional processes within data quality applications.Research and assess the suitability of various technologies to advise on optimal project solutions.

Role overview Weekday's Client seeks a Big Data Developer in Bengaluru to improve and maintain data pipelines and processing systems that drive business intelligence and analytics. The position works with large volumes of both structured and unstructured data, spanning cloud and on-premise environments. Collaboration with data engineers, analysts, and product teams is central to delivering reliable, high-performance solutions that support business decisions. What you will do Design, develop, and maintain scalable data pipelines and big data processing systems. Build and optimize data architectures using AWS services to increase availability and performance. Use PostgreSQL for data storage, querying, and performance tuning. Process and analyze large datasets to enable analytics and reporting. Work with cross-functional teams to gather requirements and deliver data solutions. Maintain data quality, integrity, and security across all systems. Optimize data workflows for better performance, scalability, and cost efficiency. Implement ETL and ELT processes for smooth data ingestion and transformation. Monitor and troubleshoot data pipelines to ensure reliability and uptime. Integrate cloud and on-premise data systems to support hybrid environments. Document data architecture, workflows, and best practices for future growth. Location This role is based in Bengaluru, Karnataka, India.

Chief Big Data ArchitectBengaluru, IndiaPosition OverviewHuawei is a recognized leader in both fixed and mobile network technologies. As the industry shifts towards a unified CT & IT networking paradigm, we are enhancing our R&D initiatives to develop a scalable, multi-tenant computing and communication infrastructure platform, specifically designed to meet the diverse requirements of our CT & IT clientele.We are seeking talented architects to join our Big Data team at the Huawei India R&D center, where you will play a pivotal role in advancing our big data platform solutions.If you have a passion for big data storage technologies, such as distributed file systems and noSQL data stores, alongside experience with open-source projects like HDFS and HBase, this is an opportunity to lead architectural design, tackle complex technical challenges, and contribute to innovative solutions at Huawei.Key Responsibilities:Collaborate closely with the Product/Platform team in China and the R&D team in the USA to:· Define short-term and long-term business roadmaps for Big Data, addressing customer pain points and delivering competitive products.· Architect and design the next generation of storage engines that are secure, reliable, and scalable.· Analyze challenges in big data storage and innovate solutions for distributed storage engines through POCs and partnerships.· Rapidly iterate on new designs and technologies, delivering prototypes and releases.Qualifications:15+ years of relevant experience in big data and distributed systems.Strong analytical and problem-solving skills.Bachelor's degree or higher in Computer Science or a related field.

Join our dynamic team as an Azure Big Data Engineer at Bosch Group in Bengaluru. In this role, you will be responsible for designing, implementing, and maintaining big data solutions using Azure technologies. You will work closely with data scientists and analysts to ensure data is accessible, reliable, and secure. Your contribution will aid in driving data-driven decisions across the organization.

Join Huawei Technologies as a Big Data Automation Tester!Location: BengaluruEmployment Type: 2-Year Contract (Under Third Party Payroll)This contract may be renewable after two years based on performance.Experience Required: 3+ YearsTechnical Skills Required: C, Python, Linux Kernel, Scripting, Big DataJob Summary:We are seeking a dedicated Automation Tester passionate about fixing and debugging software issues. This full-time contractor position will involve testing our advanced suite of solutions for the ARM64 platform, a cutting-edge technology in the industry.Your Responsibilities:Conduct comprehensive testing of the ARM64-based solution, ensuring the identification and verification of various use cases for data center applications.Develop automated test cases and scripts, assist in building test environments, and consolidate reporting for test results.Explore and apply various testing methodologies, and depending on performance, there may be opportunities to engage with open-source projects.What We’re Looking For:Experience in testing or benchmarking server applications, including databases, distributed file systems, Big Data, and virtualization.A strong understanding of use case testing for server and data center applications.Proficient automation skills in scripting languages such as C, Python, or other testing programming languages.Experience with ARM or hardware-based application testing is an added advantage.

CSQ127R179MissionThe Manager of Technical Solutions in Data & AI will spearhead the development and expansion of a specialized team in India, dedicated to ensuring the resilience and seamless operation of customer production workloads. This leadership position involves overseeing support operations during APJ and EMEA business hours while closely collaborating with global teams to guarantee 24/7 support coverage. The team will tackle intricate and protracted data engineering challenges presented by Databricks clients, facilitating the success of real-time use cases. Responsibilities include performance optimization, ensuring production job reliability, and assisting customers in stabilizing workloads on innovative products and features. You will deeply understand the genuine business challenges our clients face with data and be committed to enhancing the reliability and performance of their systems to achieve their objectives.The Impact You Will Have:Lead as the Technical Solutions Manager for an elite team of Data & AI professionals, providing support across EMEA and APJ business hours.Enhance the technical proficiency of the team to ensure successful adoption of new Databricks platform products and features for customer production workloads.Engage with top-tier clients to comprehend their business needs pertaining to Data & AI strategy, collaborating with field engineering and sales as necessary.Partner with internal product engineering teams to improve Databricks products’ supportability and performance.Maintain high reliability of the Databricks platform to help customers achieve their business goals.

Teamwork makes the stream work. Join Roku and Transform the Future of TV Streaming!As the leading TV streaming platform in the U.S., Canada, and Mexico, Roku is at the forefront of revolutionizing how audiences engage with television. Our goal is to power every TV worldwide, connecting viewers to their favorite content while empowering publishers and advertisers with innovative solutions.From day one, your contributions at Roku will be recognized and valued. We are a dynamic, growing public company where every team member plays a crucial role in delighting millions of viewers around the globe while acquiring invaluable experience across diverse fields. About Our Big Data TeamRoku operates one of the largest data lakes globally, managing over 70 PB of data and executing more than 10 million queries each month. Our Big Data team is responsible for developing and maintaining the platform that makes this possible. We offer tools to acquire, generate, process, monitor, validate, and access data for both streaming and batch processing. Our technologies include Scribe, Kafka, Hive, Presto, Spark, Flink, Pinot, and more. The team actively contributes to the Open Source community and aims to expand its involvement.Your RoleWe are modernizing our Big Data Platform and need your expertise to redefine our architecture to enhance user experience, reduce costs, and boost efficiency. If you are passionate about Big Data technologies and eager to explore Open Source, this position is tailored for you!Key ResponsibilitiesOptimize and fine-tune existing Big Data systems and pipelines, while also developing new ones to ensure they operate efficiently and cost-effectively.

We are seeking a talented and experienced Big Data Architect to join our dynamic team at Squircle IT Consulting Services. In this role, you will be pivotal in designing and implementing robust data architectures that support our clients' needs in the ERP and Business Intelligence domains. Your expertise in big data technologies will enable us to deliver innovative solutions that drive efficiency and scalability.

Join our dynamic team as a Senior Talend Developer / Lead Data Engineer at Bosch Group in Bengaluru. In this pivotal role, you will leverage your expertise in Talend to drive data integration processes and lead engineering initiatives that enhance our data infrastructure.

Join our dynamic team at Cermaticom as a Lead Data Engineer, where your expertise in Java will play a pivotal role in driving our data initiatives forward. You will be responsible for designing, implementing, and maintaining robust data architectures while ensuring data quality and security. Collaborate with cross-functional teams to create innovative data solutions that empower decision-making across the organization.

Join our dynamic team at Squircle IT Consulting Services Pvt Ltd as a Spark Developer. In this role, you will harness the power of Apache Spark to develop innovative data processing solutions, enabling our clients to make data-driven decisions. You will work closely with data scientists and analysts to design, implement, and optimize data pipelines, ensuring high performance and reliability.

Role Overview Freshworks is looking for a Lead Data Scientist in Bengaluru. This role centers on guiding data-driven strategies and using advanced analytics to inform business decisions. The position offers the chance to work closely with teams across the company to build solutions that improve Freshworks products. What You Will Do Apply data analysis, machine learning, and statistical modeling to uncover insights that shape business direction Partner with cross-functional teams to design and implement new solutions Contribute to developing and enhancing Freshworks product offerings through data-driven approaches

We are seeking an experienced Senior Data Engineer with a strong background in DevOps and Data Engineering technologies. The ideal candidate will have between 7 to 12 years of relevant experience and will be responsible for designing and implementing scalable data solutions.Key Responsibilities:Develop, maintain, and optimize data pipelines and architecture.Leverage DevOps principles to automate processes and enhance data workflows.Collaborate with cross-functional teams to deliver high-quality solutions.

Company OverviewCommerceIQ’s AI-driven digital commerce platform is transforming the way brands manage online sales. Our integrated ecommerce management solutions empower brands to make informed and rapid decisions through insights that enhance digital shelf performance, boost retail media ROI, and drive incremental sales across major marketplaces worldwide. With a vast network connecting over 900 retailers, our comprehensive platform assists more than 2,200 of the world’s leading brands in optimizing marketing, supply chain, and sales operations to profitably expand market share in over 50 countries. Ten of the top twelve CPG brands collaborate with us, including Coca-Cola, Nestle, Colgate-Palmolive, and Mondelez. We have secured over $200 million from leading investors such as SoftBank, Insight Partners, and Madrona. Discover more at commerceiq.ai.

Teamwork makes the stream work. Roku is revolutionizing the way the world experiences televisionAs the leading TV streaming platform in the U.S., Canada, and Mexico, Roku aims to empower every television globally. With a pioneering spirit, we connect users to their favorite content, support content creators in growing their audiences, and provide advertisers with innovative ways to engage viewers.From your first day at Roku, you'll be an integral part of our journey. As a fast-growing public company, everyone here plays a crucial role. Join us in delighting millions of TV streamers worldwide while gaining invaluable experience across various disciplines. About the TeamThe Roku Data Engineering team is dedicated to building a state-of-the-art big data platform that empowers both internal and external stakeholders to leverage data for business growth. Our team collaborates closely with business partners and engineering teams to gather metrics on essential initiatives for success. As a Senior Data Engineer focused on device metrics, you will design data models and develop scalable data pipelines to capture critical business metrics across our diverse range of Roku devices. About the RoleAt Roku, we connect users to the streaming content they love and enable content publishers to monetize large audiences while providing advertisers with unique capabilities to engage consumers. Our Roku streaming players and Roku TV™ models are available worldwide through direct retail sales and partnerships with TV brands and pay-TV operators. With millions of devices sold in numerous countries, thousands of streaming channels, and billions of hours of content consumed, the development of a scalable, highly available, fault-tolerant big data platform is crucial to our success. This role is based in Bengaluru, India and requires hybrid work, with three days in the office. What You'll Be DoingDevelop and maintain highly scalable, fault-tolerant distributed data processing systems (both batch and streaming) handling terabytes of data ingested daily and managing a petabyte-sized data warehouse.Design and implement efficient data models and pipelines that support business growth and decision-making.

Join our dynamic and expanding team at Vendavo, where we prioritize our people and their growth. As our Lead Database Administrator, you will be integral to enhancing our Cloud Operations team. In this role, you will leverage your expertise in both traditional RDBMS systems and cutting-edge big-data technologies, contributing significantly to database design, management, and performance optimization.

We are seeking a passionate Data Scientist with a strong affinity for solving complex problems involving large datasets. The ideal candidate will have a solid understanding of machine learning algorithms and principles, complemented by exceptional organizational and interpersonal skills.Key Responsibilities:Analyze and extract meaningful insights from unstructured data while adhering to organizational guidelines.Collaborate in the development of components for frameworks or products.Utilize database management systems such as Oracle or MS SQL Server.Employ programming languages and tools including JQuery, JavaScript, HTML, CSS, SVN, and GIT.

Join Aarnahr Solutions Pvt Ltd as a Lead Java Developer and take the next step in your career! We are looking for a skilled developer who is passionate about technology and has a proven track record of leading projects to success. In this role, you will guide a team of developers, contribute to architecture discussions, and ensure the delivery of high-quality software solutions.

As a pivotal member of our engineering team, the .NET Development Lead plays a crucial role in overseeing the entire feature lifecycle. With foundational domain knowledge, you will collaborate closely with fellow engineers to ensure the seamless delivery of high-quality software solutions. Your commitment to continuous improvement will be instrumental in aligning with departmental strategies, while your insights will contribute to refining practices, toolkits, and processes.Core ResponsibilitiesSFIA Responsibility Level: 2 - AssistAutonomyOperate under routine guidance, exercising limited discretion in resolving queries. You will identify when to seek assistance in unexpected scenarios and manage your workload effectively within short timeframes.InfluenceEngage with and potentially influence immediate colleagues, along with some external interactions with clients, suppliers, and partners. You will be conscious of the necessity to collaborate with your team and prioritize user and customer needs.ComplexityHandle a diverse array of work activities in various environments. You may assist in routine issue resolution and contribute creative ideas to enhance task approaches.Business SkillsPossess strong oral and written communication skills for effective collaboration with peers and internal users/customers. Familiarity with suitable methods, tools, applications, and processes is essential.Demonstrate an organized and rational approach to your work, alongside adequate digital competencies necessary for your role.Proactively identify and negotiate opportunities for personal and professional development.Be fully informed of organizational standards concerning security, privacy, and ethics, applying appropriate practices in your work.KnowledgeHold foundational domain knowledge, showcasing essential generic knowledge typically recognized in the industry. You will effectively absorb and apply new information presented in a structured manner.Professional ResponsibilitiesEngage in implementing software development processes, standards, and best practices to ensure the consistent delivery of high-quality software products while adhering to the overarching Software Development Lifecycle and Agile methodology.Exhibit engineering excellence and quality through the effective use of analysis tools, control gates, and peer reviews, fostering innovative thinking to enhance design, productivity, and quality while mentoring junior Squad members.Stay informed about the evaluation of emerging technologies and methodologies to contribute to competitive differentiation and strengthen existing product technologies.Assist in optimizing the engineering lifecycle through systematic knowledge sharing and collaboration.