Senior Software Engineer - Big Data Platform

P-1385 In today's landscape, businesses are channeling substantial investments into the development and implementation of AI technologies and the data platforms that support them. However, do they truly understand the intricacies of their operations? At Databricks, we are dedicated to empowering data teams to tackle some of the most challenging global issues, from revolutionizing transportation to expediting medical innovations. We achieve this by constructing and maintaining the world's premier data and AI infrastructure platform, enabling our clients to leverage deep data insights to enhance their operations. Founded by engineers who prioritize customer satisfaction, we eagerly embrace every opportunity to confront technical challenges, including designing next-generation UI/UX for data interaction and optimizing our services across millions of virtual machines. And this is just the beginning. As a Senior Software Engineer on the Customer Foresight Team, you will spearhead the development of tools that empower customers to gain insights into their AI and data workloads, optimize performance, and reduce costs. You will craft data infrastructure capable of processing billions of entries daily, deploy across over 65 cloud regions globally, and support some of the world's most prominent companies in executing their DevOps, FinOps, SecOps, and AIOps operations. This role involves directing technical development throughout product milestones, from requirement refinement to execution, operation, and collaboration with the broader product development and partner teams to guarantee product success.

P-1394 At Databricks, we are dedicated to empowering data teams to tackle some of the world's most significant challenges—from revolutionizing transportation to accelerating medical advancements. Our mission is fulfilled by creating and managing the industry's leading data and AI infrastructure platform, enabling our customers to harness deep data insights to enhance their operations. Founded by engineers with a customer-centric mindset, we eagerly embrace every challenge, whether it's creating cutting-edge UI/UX for data interaction or scaling our infrastructure across millions of virtual machines. Our engineering teams design technical products that address real, critical needs in today's world. We continuously push the limits of data and AI technology while ensuring the security and scalability essential for our customers' success on our platform. We operate one of the largest software platforms globally, comprising millions of virtual machines that generate terabytes of logs and process exabytes of data daily. At this scale, we monitor cloud hardware, network, and operating system faults, and our software is designed to shield our customers from these issues seamlessly. As a Senior Software Engineer on the Observability team, you will develop observability solutions that provide critical insights into the health and performance of our products and infrastructure.

Teamwork makes the stream work. Join Roku in transforming the way the world experiences televisionAs the leading TV streaming platform in the U.S., Canada, and Mexico, Roku is on a mission to empower every television globally. We revolutionized the television experience through streaming and aim to connect the entire TV ecosystem. Our platform links viewers with their favorite content, aids publishers in building and monetizing expansive audiences, and offers advertisers innovative tools to engage users effectively.From day one, you will play an essential role in our dynamic environment. At Roku, we are a rapidly expanding public company where every employee is a crucial contributor. This is your chance to create delightful experiences for millions of TV streamers while acquiring significant expertise across various disciplines. About the Team The Observability team, part of Roku’s Cloud Technology Infrastructure, plays a vital role in our platform. We are a high-performing, agile international team that values ownership, effective communication, and impactful engineering solutions. Our goal is to enhance Roku’s observability platform, managing vast amounts of data daily and supporting numerous active series. We focus on constructing scalable, high-performance systems tailored to Roku’s unique requirements, utilizing open-source tools and custom solutions to empower engineering teams in monitoring, debugging, and optimizing their applications seamlessly.

At Databricks, we are dedicated to empowering data teams to tackle some of the most complex challenges globally — from revolutionizing transportation to accelerating groundbreaking medical advancements. Our mission is realized through the development and management of the premier data and AI infrastructure platform, enabling our customers to harness profound data insights for business enhancement. Founded by engineers with a relentless focus on customer satisfaction, we eagerly embrace every opportunity to address technical challenges, ranging from crafting next-generation UI/UX for data interaction to scaling our services and infrastructure across millions of virtual machines. Our journey in Bengaluru, India is just beginning, as we are in the exciting phase of assembling 10 new teams from the ground up!Our engineering teams create technical products that meet real and significant needs in the world. We constantly push the limits of data and AI technology while maintaining the security and scalability essential for our customers' success on our platform.We operate one of the largest-scale software platforms, consisting of millions of virtual machines that generate terabytes of logs and process exabytes of data daily. At this scale, we encounter cloud hardware, network, and operating system faults, and our software must seamlessly shield our customers from these issues.As a software engineer in the Observability team, your role will be to develop observability solutions that deliver insights into the health and performance of our products and infrastructure.

Join Roku, a pioneering company in streaming technology, as a Senior Software Engineer specializing in Cloud Infrastructure and Observability. In this role, you will design and implement robust cloud solutions, focusing on performance, reliability, and scalability. You will collaborate with cross-functional teams to enhance our observability frameworks, ensuring seamless user experiences. If you're passionate about cloud technologies and want to make a significant impact, we want to hear from you!

Cognite is a leader in the realm of industrial digitalization, dedicated to creating cutting-edge AI and data solutions designed to tackle some of the most formidable and impactful challenges globally. Drawing on our unparalleled industrial expertise and a robust array of AI capabilities, including low-code AI agents, Cognite is committed to accelerating digital transformation for enhanced operational efficiencies.Our ambitious moonshot aims to unlock $100 billion in customer value by 2035 and revolutionize the way global industries operate.

Aerospike is the leading real-time database tailored for mission-critical applications and workloads, encompassing machine learning, generative AI, and agentic AI. Our platform supports millions of transactions per second while maintaining millisecond latency, all at a significantly lower total cost of ownership compared to traditional databases.Renowned organizations such as Adobe, Airtel, Barclays, Criteo, DBS Bank, Experian, Grab, HDFC Bank, PayPal, Sony Interactive Entertainment, The Trade Desk, and Wayfair trust Aerospike for various applications including customer 360, fraud detection, real-time bidding, profile stores, and recommendation engines. With our headquarters in Mountain View, California, we boast a global footprint, including offices in London, Bangalore, and Tel Aviv. This position offers a hybrid work model.Employees are expected to work from the Bangalore office 2-3 times a week.Job SummaryWe seek a Senior Engineer to craft and implement an extensive suite of management and observability tools designed for the operation of Aerospike’s distributed database at an enterprise scale.Your role will involve developing solutions to monitor, manage, and administer clusters, users, and security, ensuring a seamless integration with leading enterprise IT environments, whether on-premises or in the cloud.The ideal candidate will possess substantial experience in building large-scale systems and will be well-versed in contemporary monitoring, logging, and management technologies utilized in enterprise contexts.

Join Acceldata and transform how organizations observe their data!As a trailblazer in data observability, Acceldata is reshaping the way enterprises monitor and manage their data. Our innovative platform provides deep insights into critical data elements, pipelines, and infrastructure, empowering data teams to enhance product efficacy, ensure data quality, mitigate failures, and optimize costs.Role Overview: Senior Software EngineerIn this role, you will play a crucial part in developing, scaling, and sustaining the core functionalities of our Data Observability suite. Collaborating closely with frontend and product teams, you will help create a robust and scalable platform.Daily Responsibilities: - Design, build, and enhance key product features. - Investigate software-related issues and implement adjustments for optimal performance. - Dive deep into open-source data engines, optimizing their performance. - Create and maintain low-latency APIs. - Develop services for frontend and solution engineers. - Participate in team meetings to discuss projects and brainstorm solutions.Ideal Candidate: - 4-8 years of experience with JVM languages (Java, Scala, Kotlin). - Solid understanding of data structures, algorithm design, and problem-solving skills. - Familiarity with database systems including RDBMS, MongoDB, and Elastic Search. - Experience with cloud technologies. - Knowledge of distributed systems and SQL.Desirable Qualifications: - Experience with Spark and Kafka. - Background in Data Quality or Data Catalog is a plus.

Anyscale is hiring a Full-Stack Software Engineer focused on Observability for its Bengaluru team. This position centers on building and improving observability features across both front-end and back-end systems, supporting the platform's performance and insight capabilities. Role overview This role involves developing tools that provide real-time analytics and monitoring for users. The work directly supports the scalability and reliability of Anyscale's products, contributing to the overall success of the platform. Collaboration Engineers in this position join a team that values collaboration and innovation. Expect to share ideas and work closely with others to deliver solutions that help users understand and monitor their systems more effectively. Impact Efforts in this role will give users better visibility into system performance and health, making a measurable difference in how Anyscale's services operate and scale.

Join Our Innovative India Tech Hub!Kobie Marketing, a leader in the loyalty industry with over 35 years of expertise, a multi-year Forrester Leader, and recognized as a Top Workplace in the USA, is expanding its global operations by launching a Tech Hub in India. We collaborate with renowned global brands to establish deep connections with their customers through tailored, data-driven loyalty experiences, all while fostering enterprise value through loyalty. This Tech Hub will function as a Global Capabilities Center for a diverse array of technology roles, presenting you with a unique opportunity to significantly influence our growth and presence in India. As we continue to excel in loyalty, delivering cutting-edge customer experiences for some of the world's most prestigious brands, you'll have the chance to work alongside a talented team dedicated to innovation.About the Team and Our VisionAs the Lead Observability Engineer, you will spearhead the strategy, implementation, and advancement of observability practices across all production and delivery environments. Your pivotal role will be to ensure system reliability, enhance performance visibility, and facilitate proactive issue resolution across our platforms.Operating at the crossroads of Engineering, DevOps, and Production Support, you will instill structure, standardization, and intelligence into our monitoring and system management practices. You will lead the transition from reactive operations to a proactive, AI-driven observability model, focusing on automated reliability.In this exciting role, your responsibilities will include:Owning and enhancing the observability platform (e.g., New Relic) to deliver comprehensive visibility across applications and infrastructure.Setting standards for monitoring, alerting, dashboards, and telemetry (logs, metrics, traces).Utilizing AIOps capabilities to enhance anomaly detection, diminish noise, and expedite root cause analysis.Driving automation and self-healing workflows to reduce manual intervention and enhance system resilience.Collaborating across teams to ensure systems are designed with observability in mind and meet reliability objectives.Continuously evaluating system behavior and incident patterns to optimize performance, scalability, and uptime.Join us in building a highly reliable, data-driven, and scalable operational ecosystem, where observability serves as a fundamental pillar for engineering excellence.

Join Acceldata as we transform data observability, enabling enterprises to manage and monitor their data effectively through innovative solutions tailored to meet distinct organizational needs. Our Open Data Platform (ODP) seamlessly integrates cutting-edge technologies to provide unparalleled data observability for modern enterprises.About the Role: We are seeking a talented Software Engineer to enhance and scale the Acceldata Open Data Platform (ODP) - a robust, enterprise-grade, open-source platform designed for cloud, hybrid, and on-premises environments. You will tackle significant technological challenges, ranging from distributed systems to data observability, assisting global clients in modernizing their platforms without vendor lock-in.This position provides an exciting opportunity to develop state-of-the-art data solutions, influence the open-source landscape, and collaborate with industry leaders. Your contributions will leave a lasting impact on our data platform and the wider open-source community.

Teamwork Makes the Stream Work. Roku is Revolutionizing Television ViewingRoku stands at the forefront as the leading TV streaming platform across the U.S., Canada, and Mexico, with an ambitious goal to power every television worldwide. We initiated the streaming journey for TVs and aim to be the central platform connecting the entire TV ecosystem. Our mission is to connect viewers with their favorite content, empower publishers to grow and monetize large audiences, and provide advertisers with innovative tools to engage effectively.From your first day at Roku, your contributions will be valued and impactful. We are a rapidly expanding public company where every team member plays a crucial role. Join us in delighting millions of viewers globally while gaining significant experience across diverse disciplines. About the Team The Data Insights team is integral to Roku’s Advertising organization, spearheading measurement and analytics efforts that drive strategic decisions within the advertising landscape. We craft and oversee products that yield actionable insights for advertisers while fulfilling the operational and analytical requirements of internal teams. Collaboration is key as we partner with Product Managers, Data Scientists, Ad Sales, Ads Operations, and various groups within Advertising Engineering to deliver high-impact solutions. Looking ahead, we are investigating AI-driven measurement capabilities to enhance advertising campaign effectiveness and bolster internal analytics. About the Role We are in search of a talented Senior Software Engineer with extensive expertise in big data technologies, such as Apache Spark and Apache Airflow. This hybrid role merges software engineering and data engineering, necessitating skills in designing, building, and maintaining scalable systems for application development and large-scale data processing. In this position, you will collaborate with cross-functional teams to architect and manage robust, production-grade data products that fuel essential analytics and measurement capabilities. You will engage with technologies including Apache Spark, Apache Airflow, Trino, Druid, Spring Boot, and StarRocks.

Join Acceldata - Redefining Data Observability!Acceldata is at the forefront of data observability, transforming how organizations manage and monitor their data by providing in-depth insights into critical elements of data, data pipelines, and infrastructure in diverse environments. Our innovative platform equips data teams to manage their products effectively, ensuring data quality, minimizing failures, and optimizing costs.Role Overview: Senior SDETIn this pivotal role, you will oversee the quality assurance of our products and platforms. You will devise comprehensive test strategies, project plans, resource allocation, and execution methodologies. Your expertise will help develop sustainable test automation tools and automated test suites. Collaborating closely with Software Engineers and solution architects from the inception of the development cycle, you will play a crucial role in the engineering team. Alongside automation, you will cultivate proficiency in data technologies and platform components while maintaining test coverage, regression pipelines, and managing releases.A Typical Day as a Senior SDET - Design, develop, and uphold test automation frameworks and tools using programming languages such as Java, JavaScript, or Python. - Collaborate with development teams to establish test strategies and plans for newly introduced product features. - Develop, execute, and maintain automated test suites to guarantee product quality. - Conduct manual testing as necessary, identifying and documenting defects. - Utilize build management tools like Git, Jenkins, and CI/CD tools to ensure seamless build and deployment processes. - Work with cross-functional teams to troubleshoot and resolve issues, enhancing product quality. - Analyze and monitor test results, providing constructive feedback to development teams to improve testing efficiency and effectiveness.Ideal Candidate Profile - Bachelor's degree in Computer Science or a related discipline. - Over 5 years of experience in UI and API automation.

P-1403 At Databricks, we are dedicated to empowering data teams to tackle the most challenging problems in the world—ranging from transforming transportation to accelerating groundbreaking medical advancements. Our mission is realized through the development and operation of the premier data and AI infrastructure platform, enabling our clients to leverage deep data insights for enhanced business performance. The ingestion of data into the Lakehouse represents a pivotal investment area for Databricks, serving as a vital enabler for Data and AI processes. The Lakeflow Connect initiative aims to address this challenge by offering intuitive, ready-to-use connectors for a diverse array of sources, including enterprise applications (such as Salesforce, Workday, ServiceNow, SharePoint), databases (e.g., SQL Server), cloud storage, message queues, and local files. In addition to being a crucial component of Lakeflow and Data Engineering, Connect is a fundamental platform capability. Every interface at Databricks (Dashboards, Notebooks, SQL, AI) relies on ingestion functionality, and the leader in this role will collaborate closely with other product teams to integrate Connect into these interfaces. We are seeking engineers who possess a strong foundation in core database internals to join our Lakeflow Connect team. A significant aspect of Connect involves extracting data from OLTP systems while minimizing the impact on production environments. To achieve this efficiently, we are developing systems that implement techniques such as incremental data capture and log parsing. We are looking for hands-on engineers eager to make a substantial impact on a critical challenge facing the company.

P-1348 At Databricks, we are dedicated to empowering data teams to tackle some of the most challenging problems in the world, ranging from security threat detection to the development of cancer drugs. Our mission is to create and manage the leading data and AI infrastructure platform, allowing our customers to concentrate on the critical challenges central to their missions. Our engineering teams are committed to developing innovative technical products that meet real and significant needs globally. We continuously push the limits of data and AI technology while ensuring resilience, security, and scalability to enhance our customers' success on our platform. We are responsible for the operation of one of the largest scale software platforms, comprising millions of virtual machines that generate terabytes of logs and process exabytes of data on a daily basis. At this scale, we encounter cloud hardware, network, and operating system issues, and our software must effectively shield our customers from these challenges. As a Senior Software Engineer on the Data Platform team, you will contribute to building the Data Intelligence Platform for Databricks, which aims to automate decision-making across the organization. You will collaborate closely with Databricks Product Teams, Data Science, Applied AI, and more. Your role will involve developing a range of tools for logging, orchestration, data transformation, metric storage, governance platforms, and data consumption layers. You will leverage the latest and most advanced Databricks products and other tools in the data ecosystem. Our team also serves as a substantial in-house customer, using Databricks to inform the future direction of our product. Your Impact: Design and manage the Databricks metrics store, enabling all business units and engineering teams to consolidate and share detailed metrics on a common platform with high quality, introspection capabilities, and query performance. Lead the development of the cross-company Data Intelligence Platform, which encapsulates all business and product metrics essential for running Databricks. You will play a pivotal role in balancing data protection with ease of shareability as we transition to a public company. Create tools and infrastructure to efficiently manage and operate Databricks on Databricks at scale across multiple clouds, geographies, and deployment types. This includes CI/CD processes, testing frameworks for pipelines and data quality, and infrastructure-as-code tooling. Establish the foundational ETL framework utilized by all pipelines developed within the company. Collaborate with our engineering teams to provide...

Join AlphaSense as a Senior Software Engineer specializing in AI applications, where you'll develop innovative solutions that leverage artificial intelligence to enhance our platform. You will be part of a dynamic team, collaborating to build scalable and efficient software that empowers users with cutting-edge technologies.

Since its inception, Fivetran has been on a mission to simplify and enhance data accessibility, making it as reliable as electricity. Our platform seamlessly delivers customer data to warehouses in a ready-to-query format, eliminating the need for complex engineering or ongoing maintenance. We take pride in empowering organizations to harness data-driven insights with our technology on a daily basis.About the RoleWe are seeking a talented Senior Software Engineer to join our data pipeline service team. In this role, you will be responsible for developing and maintaining data pipelines that transfer data from various sources to data warehouses. Your responsibilities will encompass a wide range of tasks, from patching existing software to designing and implementing new connectors on our global Kubernetes compute cluster. You will ensure technical excellence within your team and services by actively contributing to code development, conducting code reviews, participating in architectural design, and mentoring junior engineers.This full-time position is based in our Bangalore office, where our hybrid work model combines remote flexibility with in-person collaboration. Team members are expected to work in the office twice a week to foster connections and teamwork.

At Databricks, we are driven by our mission to empower data teams in tackling some of the most challenging issues facing the world today. From realizing the future of transportation to expediting medical innovations, we build and maintain the leading data and AI infrastructure platform, enabling our clients to harness deep data insights for business enhancement. Founded by engineers with a relentless focus on customer satisfaction, we eagerly embrace every challenge, whether it's designing next-gen UI/UX for data interaction or scaling our services across millions of virtual machines.Our Databricks Mosaic AI utilizes a distinctive data-focused approach to develop enterprise-grade Machine Learning and Generative AI solutions, allowing organizations to securely and cost-effectively manage and deploy models trained with their proprietary data. We're excited to expand our team in Bengaluru, India, where we are in the process of launching 14 new teams from scratch!As a Senior Software Engineer at Databricks India, you will engage with various domains including:BackendDistributed Data Systems (DDS)Full Stack DevelopmentYour Impact:1. As part of our Backend teams, you will tackle diverse challenges across our core service platforms, including:Addressing intricate issues ranging from product development to infrastructure, focusing on distributed systems, large-scale service architecture, monitoring, workflow orchestration, and enhancing developer experience.Delivering dependable, high-performance services and client libraries designed for storing and accessing vast amounts of data on cloud storage solutions such as AWS S3 and Azure Blob Store.Creating robust, scalable services using technologies like Scala, Kubernetes, and Apache Spark™, supporting an infrastructure that handles millions of cluster-hours daily, while developing product features that empower customers to effortlessly manage and monitor their platform usage.2. Our DDS team encompasses:Apache Spark™Data Plane StorageDelta LakeDelta PipelinesPerformance Engineering3. As a Full Stack engineer, you will collaborate closely with your team and product management to deliver an outstanding user experience.

Role Overview Nielsen is hiring a Lead Software Engineer (Senior AI Architect) in Bengaluru. This position centers on designing and building advanced software solutions that use artificial intelligence. The role involves setting technical direction and guiding the architecture for AI-driven projects. What You Will Do Lead the design and implementation of software systems that incorporate AI technologies Apply strong software engineering principles to create reliable, maintainable solutions Collaborate with other engineers and stakeholders to shape project direction What We Look For Extensive experience in software engineering Deep understanding of AI architecture and related technologies Ability to guide teams and drive technical progress

P-1346 At Databricks, we are dedicated to empowering data teams to tackle some of the world's most challenging problems—from transforming transportation to speeding up medical innovations. Our mission revolves around creating and operating the most advanced data and AI infrastructure platform, allowing our clients to harness deep data insights to enhance their businesses. Founded by engineers and driven by a strong customer focus, we eagerly embrace every chance to address technical obstacles, whether it's designing next-generation UI/UX for data interaction or scaling our services and infrastructure across millions of virtual machines. With Databricks Mosaic AI, we offer a distinctive data-centric methodology for constructing enterprise-grade Machine Learning and Generative AI solutions, enabling organizations to securely and cost-effectively manage ML and Generative AI models, augmented or trained using their enterprise data. As we expand in Bengaluru, India, we are in the process of establishing 14 new teams from the ground up! As a Senior Software Engineer in the Infrastructure domain at Databricks India, you will have the opportunity to work across: Backend (Infrastructure) Your impact will include: Engaging with diverse challenges that bridge product and infrastructure, including distributed systems, large-scale service architecture and monitoring, workflow orchestration, and enhancing developer experience. Delivering reliable and high-performance services and client libraries for managing vast amounts of data on cloud storage backends, such as AWS S3 and Azure Blob Store. Building robust, scalable services using technologies like Scala and Kubernetes, alongside data pipelines with Apache Spark™ and Databricks, to support a pricing infrastructure that serves millions of cluster-hours daily while developing product features that allow customers to manage and monitor platform usage effortlessly.