Staff Database Engineer

At Databricks, we strive to revolutionize the data lifecycle from ingestion to ETL, business intelligence (BI), and machine learning (ML) with our unified platform. We envision a future where the traditional data warehouse architecture is superseded by an innovative architectural model known as the Lakehouse (CIDR 2021 paper). This cutting-edge approach integrates data warehousing with advanced analytics, effectively addressing significant challenges such as data staleness, reliability, cost of ownership, data lock-in, and limited use-case support.A pivotal component of achieving this vision is the development of the next-gen (decoupled) query engine and structured storage system designed to surpass the performance of conventional data warehouses for relational queries while maintaining the flexibility of general-purpose systems like Apache Spark™. This will empower a wide range of workloads, from ETL processes to data science applications.As a member of our team, you will engage in one or more of the following areas to design and implement these advanced systems that set new benchmarks:Query compilation and optimizationDistributed query execution and schedulingVectorized execution engineData securityResource managementTransaction coordinationEfficient storage structures (encodings, indexes)Automatic physical data optimization

P-188 At Databricks, we are on a mission to fundamentally transform the data lifecycle, simplifying processes from data ingestion to ETL, Business Intelligence (BI), and extending to Machine Learning (ML) and Artificial Intelligence (AI) through a unified platform. We envision a future where traditional data warehouse architectures are replaced by innovative solutions like the Lakehouse architecture (CIDR 2021 paper), which integrate data warehousing and advanced analytics, effectively addressing critical challenges such as data staleness, reliability, cost of ownership, data lock-in, and limited use-case support. To turn this vision into reality, we are developing a next-generation decoupled query engine and structured storage system designed to surpass specialized data warehouses in relational query performance while maintaining the versatility of general-purpose systems like Apache Spark™. This system is intended to support a wide array of workloads, from ETL processes to data science applications. As a member of our team, you will engage in one or more of the following areas, contributing to the design and implementation of cutting-edge systems that redefine industry standards: Query compilation and optimization Distributed query execution and scheduling Vectorized execution engine Data security measures Resource management strategies Transaction coordination processes Efficient storage structures (encodings, indexes) Automatic physical data optimization techniques

Role overview Nuro is looking for a Senior Middleware Software Engineer to help build and support the software that powers its autonomous delivery platform. This role focuses on developing and maintaining middleware systems that connect different parts of the technology stack. The work directly impacts the reliability and efficiency of Nuro’s services.

About Nuro Nuro is a pioneering self-driving technology firm dedicated to making autonomous driving accessible to everyone. Established in 2016, we are developing the world’s most scalable driver by merging advanced AI with automotive-grade hardware. Our flagship technology, the Nuro Driver™, is licensed to facilitate a variety of applications, from robotaxis to commercial fleets and personal vehicles. With years of proven self-driving deployments, we offer automakers and mobility platforms a clear path to achieving commercial-scale autonomous vehicles, enhancing safety and connectivity for a better future. Join Our Team Our team is committed to empowering engineers to revolutionize transportation by equipping them with the tools and infrastructure necessary for productivity and success. We aim to achieve this through: Identifying and resolving engineering process challenges. Creating innovative tools and infrastructure for enhanced efficiency. Educating engineers on best practices. Utilizing cutting-edge technologies to amplify productivity. Our passionate engineers are dedicated to solving complex problems and making a positive impact on the future of transportation. Role Overview Collaborate with engineers across Nuro to pinpoint inefficiencies in the engineering workflow. Define, analyze, and monitor metrics relating to engineering velocity and system health. Innovatively address daily developer challenges by creating new tools or enhancing existing ones. Develop scalable infrastructure for continuous code integration, testing, and release, while optimizing for coverage, speed, and cost, addressing the unique complexities of Nuro’s machine learning and hardware tests. Oversee and enhance essential libraries and APIs for interaction with complex systems, managing code dependencies and the overall structure of Nuro’s codebase. Utilize Generative AI to enhance engineering productivity. Provide guidance to developers on best practices and newly implemented tools.

P-1137 Summary At Databricks, we are dedicated to empowering data teams to tackle the world's most challenging issues, from detecting security threats to advancing cancer treatments. We achieve this by developing and operating the premier data and AI infrastructure platform, enabling our clients to concentrate on the high-impact challenges central to their missions. Founded in 2013 by the original creators of Apache Spark, Databricks has evolved from a modest office in Berkeley, CA, to a global leader with over 1,500 employees. Thousands of organizations, ranging from startups to Fortune 100 companies, rely on Databricks for their mission-critical workloads, establishing us as one of the fastest-growing SaaS firms globally. Our engineering teams are focused on creating highly technical products that address significant real-world needs. We continuously push the limits of data and AI technology while maintaining the resilience, security, and scalability essential for our customers' success on our platform. Customers entrust Databricks with their most valuable data, and our Trust & Safety division is committed to creating the most reliable data analytics and machine learning platform worldwide. Security Engineering plays a vital role in safeguarding customer data from malicious threats. We seek senior leaders to shape the vision and define the strategic approach within this critical domain. The impact you will have: Enhance the safety of Databricks for our customers by identifying and addressing critical vulnerabilities in our infrastructure and services. Attract top-tier talent from across the industry. Advocate for the security engineering discipline across the organization, wielding a significant voice to drive data-driven decisions. Represent Databricks at academic and industry conferences and events.

Aerospike is a leading real-time database solution designed for mission-critical applications and workloads, including machine learning, generative AI, and autonomous systems. Our platform powers millions of transactions per second with millisecond latency, offering a significantly lower total cost of ownership compared to traditional databases.Renowned organizations such as Adobe, Airtel, Barclays, Criteo, DBS Bank, Experian, Grab, HDFC Bank, PayPal, Sony Interactive Entertainment, The Trade Desk, and Wayfair trust Aerospike to manage their customer 360 insights, fraud detection, real-time bidding, profile stores, recommendation engines, and more.At Aerospike, we dream big and deliver even bigger. Our mission is to harness the power of the world's real-time data with a database engineered for infinite scale, speed, and sustainability.If you’re ready to shape the future of data, we invite you to join our team.As we expand rapidly, we are heavily investing in our Cloud Platform, a sophisticated multi-cloud, multi-tenant solution that delivers the capabilities of Aerospike to our customers with unparalleled simplicity, speed, and scalability.Senior Software Engineer, CloudWe are looking for a talented Senior Software Engineer to join our Cloud team. In this pivotal role, you will design and develop the infrastructure orchestration, control systems, and operational frameworks that underpin Aerospike Cloud. Your contributions will directly influence the reliability, scalability, and security of production database clusters that serve clients across the globe.

Join Waymo, a leader in autonomous vehicle technology, as a Senior Software Engineer specializing in Behavior Test Engineering. In this role, you will collaborate with cross-functional teams to design, develop, and implement robust test frameworks that ensure the safety and reliability of our self-driving technology.Your expertise will contribute to creating innovative solutions that push the boundaries of what is possible in autonomous driving. You will be responsible for enhancing the testing processes and ensuring our software meets the highest standards of quality and performance.

Waymo is an innovative leader in autonomous driving technology, dedicated to becoming the world's most trusted driver. Originating from the Google Self-Driving Car Project in 2009, we have developed the Waymo Driver—The World’s Most Experienced Driver™—to enhance mobility access and save lives lost in traffic accidents. Our Waymo Driver powers a fully autonomous ride-hail service, having completed over ten million rider-only trips, backed by vast experience driving over 100 million miles on public roads and tens of billions in simulation across more than 15 U.S. states.Within our Driver Understanding and Evaluation (DUE) team, we strive to develop comprehensive metrics for analyzing the Waymo Driver's behavior in real-world scenarios.In this hybrid role, you will report directly to a Software Engineering Manager.

Company OverviewDeductive AI is pioneering the development of the world's first real-time reasoning engine designed to identify and mitigate large-scale software outages by analyzing distributed systems, code, and statistical anomalies in real-time across vast telemetry data (including metrics, logs, traces, and events). Our talented team comprises industry veterans with extensive experience in managing large-scale production systems from renowned companies such as Databricks, Facebook, Thoughtspot, Google, Splunk, and Amazon. We are proudly backed by some of the most prestigious venture capitalists in Silicon Valley and are fortunate to have the support of exceptional investors and advisors.Internship RoleWe are actively seeking enthusiastic interns for the Fall 2024 season. This paid internship position will take place on-site at our Mountain View, CA office. As a Software Engineering Intern at Deductive AI, you will contribute to the creation of the next generation of core coding and data processing systems that can intelligently analyze substantial volumes of structured and unstructured data. This role presents exciting technical challenges as you tackle intriguing problems at the intersection of artificial intelligence, code comprehension, and data analytics.

Nuro develops self-driving technology, aiming to make autonomous vehicles accessible for everyone. Since 2016, the team has blended advanced AI with automotive-grade hardware, licensing the Nuro Driver™ to support robotaxis, commercial fleets, and personal vehicles. Partnerships with automakers and mobility platforms help bring these autonomous solutions to commercial scale. The Senior Software Engineer - Software Update Infrastructure role is part of the Fleet Connectivity team based in Mountain View, California. This position focuses on building and maintaining systems that support release infrastructure and over-the-air (OTA) updates for Nuro’s autonomous vehicles. The work covers both cloud and robotics stacks, ensuring reliable network connectivity, telemetry, and software updates that are vital to Nuro’s mission. What you will do Design, build, test, deploy, and maintain software for release infrastructure and OTA updates. Manage project priorities, deadlines, and deliverables within the team and when working with other groups. Write high-quality, testable code that meets strict code quality standards. Monitor release system performance by defining and tracking KPIs, and implement optimizations to improve build costs, times, and storage usage. Create testing and validation programs to ensure system architecture and data flows are reliable. Contribute to documentation and participate in on-call rotations during business hours. Requirements 5+ years of experience working with large-scale distributed systems. Proficiency in C++ or Go. Comfortable working in Unix/Linux environments and with Bash scripting. Ability to translate broad requirements into detailed system designs. Strong knowledge of data structures, algorithms, and distributed system software design. Bachelor’s degree in Computer Science, Electrical Engineering, or a closely related field. Bonus points Experience with SQL. Familiarity with Google Cloud Platform (GCP). UI development experience. Background in OTA updates execution and management.

P-78 At Databricks, we are driven by a commitment to empower data teams in tackling some of the most significant challenges facing the world today—from revolutionizing transportation to speeding up the discovery of medical innovations. By constructing and managing the premier data and AI infrastructure platform, we enable our clients to harness profound data insights to enhance their operations. Founded by engineers and intensely focused on customer satisfaction, we eagerly embrace every chance to address technical challenges, whether it’s crafting next-generation UI/UX for data interaction or scaling our services and infrastructure across millions of virtual machines. And we are just getting started. As a Senior Software Engineer with a focus on backend development, you will collaborate with your team to create scalable infrastructure and products for the Databricks platform.

Harness is at the forefront of AI-driven software delivery, founded by the visionary technologist Jyoti Bansal, who previously established AppDynamics, leading to its acquisition by Cisco for an impressive $3.7 billion. With approximately $570 million raised in funding and a valuation of $5.5 billion, Harness is supported by prominent investors such as Goldman Sachs, Menlo Ventures, IVP, Unusual Ventures, and Citi Ventures. As AI transforms code generation, the critical bottleneck has shifted to the post-coding phase, including testing, deployments, application security, reliability, compliance, and cost optimization. Harness leverages AI and automation to streamline these processes, empowering teams to deliver software more efficiently while ensuring security and governance throughout the software delivery lifecycle.Utilizing Harness AI and the Software Delivery Knowledge Graph, our platform integrates deep contextual insights and intelligent automation across the software delivery landscape, embedding governance and policy-driven controls throughout.In just the past year, Harness has facilitated over 185 million deployments, 82 million builds, and 18 trillion flag evaluations, alongside conducting 8 million security scans, optimizing 9.1 billion tests, and protecting 3 trillion API calls. We have effectively managed $2.8 billion in cloud expenditures, assisting clients such as United Airlines, Morningstar, and Choice Hotels in accelerating their release cycles by up to 75%, reducing cloud costs by up to 60%, and achieving a remarkable 10x improvement in DevOps efficiency.With a diverse global workforce spanning 14 offices in 25 countries, Harness is pioneering the future of AI-driven software delivery, and we are on the lookout for extraordinary talent to join us on this exciting journey.Position SummaryJoin us as a Senior Software Engineer in a dynamic, high-growth startup environment. As part of the Platform team, you will architect, design, develop, and deliver top-notch software solutions that significantly influence our product offerings.About the RoleDesign and implement scalable platform featuresCreate comprehensive software functional specifications and design documentationQuickly grasp complex systems and code, taking ownership of critical components, including their qualityCollaborate with cross-functional teams to drive innovation and efficiency

About Us Nuro is a pioneering self-driving technology firm dedicated to democratizing autonomy. Established in 2016, we are at the forefront of creating the world's most scalable autonomous driver, merging advanced AI with automotive-grade hardware. Our innovative technology, the Nuro Driver™, is licensed for diverse applications, including robotaxis, commercial fleets, and personal vehicles. With years of successful self-driving deployments, Nuro is paving the way for automakers and mobility platforms to adopt autonomous vehicles at a commercial scale—fostering a future that is safer, richer, and more interconnected. Role Overview As a Software Engineering Intern at Nuro, you will collaborate with top professionals in machine learning, robotics, and software development. Depending on your expertise and interests, you may contribute to various teams, including Data Platform, Onboard Systems, ML Infrastructure, Simulation, or Technical Infrastructure. Key Responsibilities Data Platform: Engage with a comprehensive data management system for Nuro's AI Driver, overseeing data annotation in areas like 2D/3D perception, mapping, and behavior trajectory. You will also work on data ingestion and mining techniques. Onboard Systems: Collaborate with software and hardware teams to ensure the seamless integration of autonomy software across self-driving platforms, addressing onboard errors and performance issues. ML Infrastructure: Assist in developing solutions that enhance machine learning capabilities at Nuro, including distributed training platforms and model component libraries. Simulation: Participate in the creation of advanced simulation models that facilitate testing and validation of autonomous technologies.

About UsAt MAI, we are driven by a vision to make advanced advertising technology accessible to all. Our innovative platform harnesses the power of AI to automate and enhance performance marketing, enabling small and medium-sized businesses to increase their advertising effectiveness without the need for costly agencies or extensive manual management.Founded by industry experts from Google and Instacart, we are proud to have secured $25 million in Seed funding led by Kleiner Perkins to fuel our growth. This investment will allow us to expand our product and engineering teams as we bring our vision of intelligent marketing to reality. Our AI agents have already demonstrated their capabilities, driving 40% more sales and managing millions in monthly ad spend. With a rapidly growing client waitlist, we are excited to shape the future of growth marketing.Why Join Us Now?As we venture into the uncharted territory of building infrastructure for intelligent agents, your role as a Software Engineer Intern at MAI will be pivotal. You will not only write code; you will help design the ecosystem for our AI agents to thrive and evolve. This is a unique opportunity to apply your research expertise to real-world challenges that have a significant impact.This internship offers the chance to contribute to the development of a truly AI-first product while solving industry-leading problems. You will be part of a small, agile team of fewer than ten engineers, where your contributions will be significant and influential in shaping the future of our company. We are in the early stages of forming three core teams:Product Engineering & InfrastructureAI Platform & FoundationAgent Application & QualityTake advantage of this opportunity to enhance your skills and grow as an engineer. We encourage you to leverage your strengths while exploring new projects, learning from your peers, and becoming a more versatile engineer.

Join Our Team!At Otter.ai, we are on the lookout for a Senior Frontend Software Engineer to spearhead our feature development initiatives and act as a technical authority within the organization. In this pivotal role, you will enhance the performance, improve the infrastructure, and elevate the user experience of our innovative platform.The ideal candidate is a strategic innovator with a robust background in platform optimization. If you have a knack for transforming concepts into powerful solutions and thrive in a fast-paced, collaborative setting, we would love to hear from you!Your ContributionsLead the ongoing development and enhancement of our web application, ensuring it evolves to meet our business objectives.Design and optimize our existing web application, transitioning it into a responsive, mobile-first single-page application (SPA) focused on performance and user experience.Produce clean, maintainable, and reusable code that complies with industry best practices and our internal coding standards.Proactively identify, troubleshoot, and fix bugs to enhance app quality and stability.Implement thorough testing protocols to ensure the application meets security standards and functions efficiently across diverse platforms and devices.

Waymo, an innovative leader in autonomous driving technology, aims to become the world's most trusted driver. Established in 2009 from the Google Self-Driving Car Project, Waymo focuses on developing the Waymo Driver—The World’s Most Experienced Driver™—to enhance mobility access and prevent traffic-related fatalities. The Waymo Driver facilitates our fully autonomous ride-hail service and is adaptable to a variety of vehicle platforms and use cases. With over ten million rider-only trips completed and more than 100 million miles driven autonomously on public roads, along with extensive simulation across 15+ U.S. states, Waymo is redefining transportation.The Planner Evaluation team is at the forefront of addressing one of the critical challenges in autonomous driving: assessing and enhancing the quality of the software that operates the vehicles. We are in search of skilled data-centric software engineers and data scientists who are eager to improve our methodologies for characterizing and evaluating modifications to the onboard software stack. If you're enthusiastic about autonomous vehicles and utilizing complex data to inform decision-making, this is the ideal opportunity for you!This hybrid role will report to an Engineering Manager.Your responsibilities will include:Developing metrics to evaluate the performance and driving characteristics of the Waymo Driver using various techniques such as statistics, mathematics, physics, algorithms, and machine learning.Utilizing simulations creatively while analyzing real-world driving logs to assess driving performance.Designing and implementing methods to establish a robust connection between onboard software modifications and simulated results.Promoting code health and adherence to best practices within a large and intricate codebase.Analyzing data to provide actionable insights on enhancing metric quality and interpretability.Collaborating with fellow engineers, data scientists, statisticians, and leadership to produce evaluation tools and support data-driven decisions.

At Databricks, we are dedicated to empowering data teams to tackle some of the most challenging issues in the world—whether it's realizing the next breakthrough in transportation or accelerating medical innovations. Our mission is to build and operate the leading data and AI infrastructure platform, allowing our clients to harness deep data insights for business enhancement.Our engineering teams create impactful technical products that address significant global needs. We consistently push the limits of data and AI technology while ensuring the security and scalability crucial for our customers' success on our platform.We manage one of the largest software platforms globally, comprising millions of virtual machines that generate terabytes of logs and process exabytes of data daily. At this scale, we monitor cloud hardware, network, and operating system faults, ensuring our software effectively shields our customers from these challenges.As a member of the Observability team, you will be at the forefront of developing solutions that deliver critical insights into the health and performance of our products and infrastructure.

Join Our TeamAt Unity Technologies, we are on a mission to create a powerful, near real-time reporting platform that drives essential analytics and decision-making across our diverse ecosystem. We are seeking a Senior Software Engineer to play a pivotal role in architecting and implementing distributed data systems that enable our platform to operate at scale.As a Senior Software Engineer, you will design and develop high-throughput, low-latency data processing pipelines that support reporting needs for both internal teams and external customers. Your work will involve navigating the complexities of distributed systems, stream processing, and cloud-native infrastructure, ensuring correctness, reliability, and scalability in a high-volume production setting.This is a high-stakes position where engineering excellence, architectural clarity, and ownership of production systems are paramount.

Join Otter.ai as a Senior Software Engineer specializing in Search & Recommendations, where you will play a pivotal role in enhancing our platform's ability to deliver tailored content and improve user experiences. You will collaborate with a talented team of engineers and product managers to develop innovative solutions that leverage machine learning and natural language processing.