Senior Python Data Engineer at ShyftLabs | Noida, Uttar Pradesh

We are seeking a talented and motivated Data Engineer to join our dynamic team at weekday-1. In this role, you will be responsible for developing, constructing, testing, and maintaining data architectures (such as databases and large-scale processing systems). You will play a crucial role in data management and analytics.

Role Overview Paytm seeks a Principal Engineer - Data DevOps for its Noida, Uttar Pradesh office. This role leads the development, management, and optimization of secure, large-scale big data platforms. The position calls for a blend of technical depth and leadership, driving best practices in cloud infrastructure, automation, CI/CD, and big data technologies. The Principal Engineer will guide cross-functional goals, mentor engineers, and ensure delivery of scalable data solutions. Main Responsibilities Lead, mentor, and develop a high-performing Data DevOps team with a focus on technical excellence and accountability. Direct the architecture, design, and implementation of cloud and data infrastructures to meet scalability, performance, and security needs. Work closely with Data Engineering, Data Science, Analytics, and Product teams to deliver reliable and efficient data platforms. Manage and optimize AWS-based infrastructure, including VPC, EC2, S3, EMR, EKS, SageMaker, Lambda, CloudFront, CloudWatch, and IAM. Scale and oversee big data platforms using Kafka, Hive HMS, Apache Ranger, Apache Airflow, EMR, Spark, Trino, Looker, and Jupyter Notebooks. Establish and maintain CI/CD pipelines and infrastructure automation with Terraform, Ansible, and CloudFormation. Ensure observability, proactive incident management, and compliance with SLAs. Promote cloud security practices, including API security, TLS/HTTPS, and access control policies. Collaborate with stakeholders to set priorities, manage budgets, and optimize cloud and operational spending. Required Qualifications At least 8 years of experience in DevOps, Data DevOps, or related fields, with a minimum of 4 years in a leadership role. Demonstrated success managing large-scale big data infrastructure and leading engineering teams. Hands-on expertise with AWS services and infrastructure automation tools such as Terraform, Ansible, and CloudFormation. Extensive experience with Kafka, Hive HMS, Apache Ranger, Apache Airflow, EMR, Spark, Trino, Jupyter Notebooks, and Looker. Proficiency with Kubernetes/EKS, Docker, ECS, and CI/CD tools. Strong understanding of networking, cloud security, and compliance requirements. Excellent communication, stakeholder management, and decision-making skills. Familiarity with SQL and data query optimization is considered a plus.

Join Our Team:At ION, we are excited to expand our AutomatION team in Noida by welcoming talented Senior Data Engineers. In this critical role, you will collaborate directly with key stakeholders and leadership from Finance and Revenue teams across our global offices. We are seeking highly skilled professionals to enhance our finance data infrastructure, ensuring it meets the evolving needs of the business.As a Senior Finance Data Engineer, you will be instrumental in scaling our finance data capabilities in Noida. Utilizing cutting-edge technologies such as Microsoft Fabric, Power BI, Power Apps, Power Automate, DAX, Power Query, and sophisticated data modeling, you will create and maintain high-performance data pipelines and solutions. Your efforts will directly influence strategic financial decision-making, as you work alongside senior stakeholders and leadership globally. Excellent communication skills are essential as you will liaise with international teams, manage complex requirements, and deliver impactful data insights.

As a Data Analyst, you will play a crucial role in driving insights and strategic recommendations for our business. Your primary responsibilities will include enhancing our reporting capabilities, collaborating with partner teams for ad-hoc analyses, and providing strategic support to the executive leadership. You will also be tasked with creating standardized metrics and reporting systems that keep our organization informed and responsive to market dynamics. Your analytical expertise and meticulous attention to detail will position you as the key resource for performance metrics and product development insights. The ideal candidate will be highly motivated, leveraging technical skills to make an immediate impact and contribute to our sustained growth trajectory!ABOUT THE TEAMThe BOLD Business Intelligence (BI) team is a centralized unit dedicated to overseeing all facets of the organization's BI strategy, projects, and systems. This team empowers business leaders to make informed, data-driven decisions by delivering comprehensive reports and analyses. We are responsible for developing and managing a high-performance enterprise data warehouse that serves as a critical resource for decision-making across various functions, including Product, Finance, Marketing, and Customer Support.Our BI team encompasses four key areas: Data Analysis, ETL, Data Visualization, and Quality Assurance. We utilize Snowflake, Sisense, and Microstrategy as our primary infrastructure solutions, while also incorporating technologies like Python, R, and Airflow for ETL, QA, and data visualization.WHAT YOU’LL DOPerform comprehensive analyses to assess business performance and identify opportunities for growth.Deliver data-driven insights through dashboards, scorecards, and both descriptive and ad-hoc analyses.Monitor and evaluate website performance, click-stream data, and user pathways to inform decision-making.Assist in developing data roadmaps for new product launches and adapting to evolving business needs.Analyze and present data to enhance customer segmentation strategies.Contribute to the creation of customer engagement reporting and modeling.

Position Overview:Join our dynamic team at ShyftLabs as a Data Engineer, where your expertise in Google Cloud Platform (GCP) and Google BigQuery will be pivotal. You will be responsible for designing, developing, and maintaining robust data pipelines that serve as the backbone for our analytics and data science projects.In this role, you'll oversee the complete data lifecycle—from ingestion and processing to warehousing and serving. Your contributions will create a reliable, efficient, and high-quality data environment that empowers our data analysts, scientists, and business leaders to make informed, data-driven decisions.Founded in early 2020, ShyftLabs is an innovative data product company collaborating with Fortune 500 clients. We focus on delivering digital solutions that accelerate business growth across diverse industries by fostering value through ingenuity and technological advancement.

Join us at Paytm as a Senior Data Engineer, where you will leverage your expertise in data engineering to drive impactful data solutions. In this role, you will be responsible for designing, building, and maintaining data pipelines that enable our analytics and machine learning initiatives.You will collaborate with cross-functional teams to optimize data flow and ensure the integrity and accessibility of our data infrastructure. If you have a passion for data and a desire to work in a dynamic environment, we encourage you to apply!

Join Paytm as a Technical Lead in Data Engineering, where you will spearhead innovative projects that drive the evolution of our data infrastructure. You will manage a talented team of engineers, guiding them in building scalable data solutions that empower our business decisions.In this role, you will be responsible for architecting data pipelines, optimizing data processing, and ensuring data quality across various platforms. Your leadership will be crucial in enhancing our data capabilities and delivering impactful solutions to our clients.

Senior Staff Software Engineer - Data IngestionLocation: Noida/Bengaluru (Hybrid)Join our dynamic Data Ingest team as a Senior Staff Software Engineer, where you will play a pivotal role in crafting a robust, scalable, and high-performing data platform designed for observability and security solutions. Your work will empower our clients to conduct high-quality analyses swiftly, enabling real-time responses to events and incidents. Our team optimizes the ingestion pipeline, managing petabytes of data daily and processing millions of data points per minute in metrics and terabytes in tracing.Key ResponsibilitiesDesign and develop high-volume, fault-tolerant, scalable backend systems to efficiently process petabytes of customer data.Analyze and enhance the efficiency, scalability, and reliability of our backend systems.Write robust code and validate its quality through automated tests.Collaborate as a team member, supporting the team in responding swiftly and effectively to changing business requirements.Mentor junior engineers, fostering skill development and refining software processes.Assess, test, and present technology and design recommendations to management.Produce comprehensive design documents and maintain documentation on system design and implementation.Take ownership of breaking down requirements into actionable technical tasks and assist in estimating timelines.

BOLD is on the lookout for a talented professional to join our dynamic Data Science team. In this role, you will leverage your analytical expertise and business acumen to provide crucial insights to our Product and Management teams. Your contributions will be instrumental in steering product development by utilizing extensive user data to enhance existing products and uncover valuable inferences and relationships that can lead to the creation of innovative solutions.ABOUT THIS TEAMThe Data Science department at BOLD plays a pivotal role in identifying patterns and trends within datasets to extract insights, develop predictive algorithms, and refine data quality or product offerings through advanced machine learning techniques. The team also communicates findings and strategic suggestions to other departments and senior management. Our data tools include Python and SQL.Collaboration is key within the Data Science team as we work closely with various verticals such as Engineering, Portals, BI, Product, and Legal. Our projects often tackle challenges that require a blend of natural language processing and machine learning. Current initiatives include resume parsing, ranking, summary generation, data quality assessment, content generation, job recommendations, and conversion analysis. We are committed to exploring state-of-the-art methodologies and staying updated with technological advancements.WHAT YOU’LL DOEngage in data science projects involving predictive modeling, NLP, statistical analysis, vector space modeling, and machine learning.Utilize our rich datasets to conduct research and develop models that inform product strategies and enhance user experiences.

Join Our Dynamic Team!BOLD is on the lookout for an innovative Engineering Manager specializing in Data Science to enhance our existing team. In this pivotal role, you will leverage your analytical prowess and business acumen to provide valuable insights that will influence our product development and management strategies. You will harness our extensive user datasets to improve our existing offerings and uncover relationships that will guide the creation of new products.About Our TeamThe Data Science department at BOLD is dedicated to identifying trends and patterns within datasets, developing predictive algorithms, and enhancing our product quality through machine learning techniques. Our team actively collaborates with various departments including Engineering, Portals, Business Intelligence, Product, and Legal, focusing on projects that involve natural language processing and machine learning. Current projects include resume parsing, ranking, summary generation, content generation, job recommendations, and conversion analysis. We are committed to exploring cutting-edge methodologies and staying current with technological advancements.Your ResponsibilitiesDevelop AI/ML models for content generation, recommendation, and moderation utilizing LLMs.

Position Overview:Join ShyftLabs as a Data Lead and take charge of architecting and implementing comprehensive data features that drive our booking and content management systems. In this pivotal role, you will lead a dynamic team, oversee the entire data pipeline lifecycle, and significantly influence the development and scaling of our data infrastructure across batch, real-time, and NoSQL environments.Founded in 2020, ShyftLabs is an innovative data product company that collaborates mainly with Fortune 500 companies. Our mission is to create digital solutions that accelerate business growth across various sectors by focusing on value creation through cutting-edge innovation.

Join our dynamic team at Squircle IT Consulting Services Pvt Ltd as a Data Mapping Specialist. In this role, you will leverage your analytical skills to design and implement data mapping solutions that drive business intelligence and operational efficiency. You will collaborate with cross-functional teams to understand data requirements and ensure seamless data integration across platforms.

Position OverviewJoin our innovative team at ShyftLabs as a Data Enterprise Architect, where your expertise will play a crucial role in shaping the architecture for our IT systems. In this pivotal position, you will collaborate with various IT groups to develop comprehensive architectures and lead projects that span across multiple functional agency systems as well as other state entities. Your responsibilities will include coordinating, planning, and scheduling during the project's transition, development, and implementation phases. This role allows you to work with significant independence, utilizing your initiative and judgment to drive success. Founded in early 2020, ShyftLabs is a rapidly expanding data product company that partners primarily with Fortune 500 companies. We are dedicated to delivering cutting-edge digital solutions that accelerate business growth across diverse industries, with a strong focus on innovation and value creation.

Position Overview:Join ShyftLabs as a Senior Data Analyst, often referred to as a Data Storyteller. We seek an inquisitive, insight-driven analyst who excels at diving deep into data, identifying patterns, and transforming findings into compelling visualizations and narratives that ignite action. You will play a crucial role in converting raw data into impactful stories that inform and guide strategic decisions across marketing, merchandising, and operations.You will thrive in this position if you enjoy exploring data independently, can correlate numerical insights with business objectives, and excel at creating visually engaging dashboards that simplify complex concepts.Founded in early 2020, ShyftLabs is an innovative data product company dedicated to partnering with Fortune 500 companies. Our mission is to deliver digital solutions that accelerate business growth across diverse industries by prioritizing value creation through cutting-edge innovation.

Founded in 2019, Level AI is a dynamic Series C startup based in Mountain View, California, dedicated to revolutionizing customer engagement. Our AI-driven platform transforms contact centers into strategic assets, utilizing cutting-edge technologies like Large Language Models to derive profound insights from customer interactions. By offering actionable intelligence, Level AI enables organizations to elevate customer experience and foster growth. With a commitment to staying at the forefront of AI advancements, we are recognized as the most adaptable and innovative solution in the industry.Position Overview: We are on the lookout for a talented Principal Software Engineer who will spearhead the design and development of our data warehouse and analytics platform. In this role, you will elevate the engineering standards across Level AI's technology stack, enhancing applications, platforms, and infrastructure.You will collaborate closely with team members and the broader Level AI engineering community to build highly scalable and efficient systems. As a technical thought leader, your mission will be to address intricate challenges of today and tomorrow by crafting simple yet elegant technical solutions. You will also mentor junior engineers and advocate for engineering best practices, working collaboratively with product managers and various stakeholders.

About Ouro:Ouro is a pioneering global financial services and technology firm committed to delivering innovative financial empowerment solutions for consumers worldwide. Our diverse financial products and services encompass prepaid, debit, cross-border payments, and loyalty solutions catering to both consumers and enterprise partners.Ouro's flagship offering, Netspend, provides prepaid and debit account solutions, granting customers secure and convenient access to extensive global payment networks for effective money management and everyday purchases. With an expansive retail network across the U.S., customers can easily purchase and reload their Netspend products at over 130,000 locations.Since our inception in 1999, founded by industry experts, Ouro has successfully processed billions in transaction volumes, serving millions of satisfied customers globally. Headquartered in Austin, Texas, we proudly employ a diverse team of professionals around the world.Role Overview:We are in search of a skilled Senior Software Engineer to architect, develop, and enhance our data ecosystem. Your primary focus will be on migrating and managing intricate data pipelines transitioning from legacy Oracle systems to Snowflake, utilizing Python as your main engine for automation and transformation. The ideal candidate is a strategic thinker, ensuring data integrity at scale while staying updated with the latest in AI/ML integration.Key Responsibilities:Legacy Integration: Sustain and optimize current Oracle databases while spearheading strategic data migration initiatives to the cloud.Automation: Leverage Python to automate repetitive data tasks, construct custom API integrations, and manage workflow orchestration.Performance Tuning: Execute advanced SQL optimization and performance tuning in both Snowflake and Oracle to guarantee low-latency data availability.Collaboration: Engage closely with Data Science and Analytics teams to deliver clean, structured, and efficient datasets for business intelligence.AI Readiness: (Preferred) Investigate and implement AI-driven data processing techniques, such as LLM-based data cleaning or predictive pipeline monitoring.Technical Requirements (Must-Have):Python: Expert-level proficiency in data manipulation (e.g., Pandas, PySpark) and scripting.Snowflake: Demonstrated expertise with Snowflake architecture (Snowpipe, Tasks, Streams).

Join Nagarro as a Senior ETL Engineer, where you will play a pivotal role in designing and implementing ETL processes to facilitate seamless data integration and transformation. You will collaborate with cross-functional teams to extract insights from complex datasets, ensuring data quality and reliability.

Position Overview:We are on the lookout for a talented and driven Analytics Engineer with a strong command of Looker and Google BigQuery to become a vital part of our innovative data team. In this role, you will be responsible for designing and implementing robust, scalable data models, refining SQL queries for maximum performance, and developing comprehensive dashboards and reporting solutions that enable our business stakeholders to leverage data for informed decision-making.ShyftLabs is an emerging data product company established in early 2020, primarily serving Fortune 500 clients. We specialize in delivering digital solutions that foster growth across diverse industries by prioritizing innovation and value creation.

About ShyftLabsFounded in early 2020, ShyftLabs is an innovative data product company that partners with Fortune 500 clients to deliver state-of-the-art digital and data-centric solutions. Our mission is to empower businesses by accelerating their growth, enhancing decision-making capabilities, and unlocking measurable value through continuous innovation.Position OverviewWe are on the lookout for a skilled Data Scientist who can leverage their expertise in machine learning (ML) and infrastructure systems to drive performance enhancements and cost efficiencies within our product offerings. This role entails providing insightful, data-driven analyses and scientific solutions that will significantly shape our product strategy and influence business outcomes.