DatabricksMountain View, California; San Francisco, California
On-site Full-time
Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.
Unlock Your Potential
Generate Job-Optimized Resume
One Click And Our AI Optimizes Your Resume to Match The Job Description.
Is Your Resume Optimized For This Role?
Find Out If You're Highlighting The Right Skills And Fix What's Missing
Experience Level
Senior
Qualifications
Proven experience in software engineering with a focus on data pipelines and large-scale data processing. Strong proficiency in programming languages such as Python, Scala, or Java. Experience with cloud platforms like AWS, Azure, or Google Cloud. Familiarity with data processing frameworks such as Apache Spark or Apache Flink. Excellent problem-solving skills and the ability to work collaboratively in a team environment. Strong communication skills to articulate complex technical concepts to non-technical stakeholders.
About the job
Join Databricks as a Senior Staff Software Engineer focusing on Lakeflow Pipelines Datasets. In this pivotal role, you will be at the forefront of developing scalable data processing solutions that empower organizations to harness the full potential of their data. Your expertise will directly contribute to the enhancement of our Lakeflow platform, ensuring seamless data integration and processing workflows.
As part of a dynamic team, you will collaborate closely with product managers, data scientists, and other engineers to design and implement robust pipelines that can efficiently handle large datasets. This role offers the opportunity to influence architectural decisions and drive best practices in data engineering.
About Databricks
Databricks is a leader in unified data analytics, offering a platform that combines data engineering and data science. Our innovative solutions empower organizations to make data-driven decisions faster and more efficiently. With a focus on collaboration and continuous improvement, we strive to create a culture of excellence and innovation.
Similar jobs
1 - 20 of 70,969 Jobs
Search for Senior Software Engineer - Python AI Pipelines
Full-time|Remote|Remote — Boston, Massachusetts, United States
Join Our Team as a Senior Software Engineer – Python AI PipelinesAt code-metal, we are pioneering the development of next-gen transpilation tools that harness the power of AI and cutting-edge verification techniques. Our mission is to seamlessly connect algorithm development with deployment on embedded systems.In this pivotal role, you will collaborate with a team of seasoned engineers and domain experts to create innovative code generation pipelines. You will utilize Generative AI, Static Analysis, and Formal Verification methods to facilitate the translation of code across different programming languages.Develop sophisticated AI-driven pipelines, incorporating complex workflows through state machines, message queues, and distributed systems.Construct robust, scalable, and thoroughly tested codebases for code translation solutions.Leverage Docker for containerized services in both local development and deployment environments.Integrate formal verification and static analysis methodologies into the pipeline in partnership with domain specialists.Contribute to distributed and cloud-based architectures enhancing reliability and scalability.
Full-time|On-site|Boston, Massachusetts, United States
Job TitleLead Principal Software Engineer - Python AI PipelinesOverviewJoin our innovative team at code-metal, where we are pioneering the next generation of transpilation tools powered by artificial intelligence and cutting-edge verification techniques. Our mission is to seamlessly connect the realms of algorithm development and deployment for embedded systems.In this pivotal role, you will be at the forefront of designing and implementing advanced code generation pipelines. Our methodologies incorporate a blend of Generative AI, Static Analysis, and Formal Verification to facilitate the translation of code from one programming language to another.
Contract|$80/hr - $80/hr|Remote|Remote — United States
Please submit your CV in English and specify your level of English proficiency.Mindrift is your gateway to project-based AI opportunities, connecting skilled professionals with top-tier tech companies focused on testing, evaluating, and enhancing AI systems. This is a project-based collaboration, not a permanent position.About the RoleWe are looking for a seasoned Python Engineer with extensive functional testing expertise. The ideal candidate will have robust skills in Linux and Docker, a proficiency for reading code across multiple languages (such as C, Rust, and Go) with the aid of LLMs, and the capability to translate migration requirements effectively. Familiarity with tools like Roo Code or Claude Code to streamline iterative development is essential.Key ResponsibilitiesDevelop and implement functional black box tests for sizable codebases across various programming languages.Set up and oversee Docker environments to guarantee fully reproducible builds and test executions across platforms.Monitor code coverage and develop automated scoring criteria aligning with industry benchmarks.Utilize LLMs (such as Roo Code and Claude) to enhance development cycles, automate repetitive tasks, and elevate overall code quality.Requirements5+ years of software engineering experience, primarily in Python.In-depth knowledge of pytest (including fixtures, session-scoped, timeouts) and experience in designing black-box functional tests for CLI tools.Advanced proficiency with Docker (including reproducible Dockerfiles, user contexts, and secure workspaces).Strong skills in Linux & Bash scripting and debugging within containers.Familiarity with modern Python tools (like uv, pyproject.toml, and packaging).Ability to interpret and understand multiple programming languages with LLM support (such as C, C++, Rust, or Go).Experience leveraging LLMs (Claude Code, Roo Code, Cursor) for accelerating iterative development and generating test cases.English proficiency at a B2 level or higher.Preferred QualificationsPrevious experience with agent evaluation platforms and MCP CLI.Tools and Technologies: Python (pytest, uv, Pillow), Docker, Bash, Git Submodules, C/C++/Rust/Go (reading), Dagger, GitHub Codespaces, LLMs (Claude Code, Roo Code, Cursor), coverage.py, gcov, kcov.BenefitsProject-based freelance collaboration via the Mindrift platform (powered by Toloka AI).Fully remote and flexible participation—choose your working hours and commitment (20-30 hours per week).Compensation based on task performance, up to $80/hour*.
Join FullStory as a Senior Software Engineer specializing in Data Pipeline. In this role, you will be pivotal in designing, implementing, and optimizing data pipelines that empower organizations to gain valuable insights from their user interactions. You’ll work with a talented team of engineers to leverage cutting-edge technologies and best practices in data engineering.
Join Aledade, Inc. as a Senior Software Engineer II focusing on Continuous Integration (CI) Pipeline Engineering. In this pivotal role, you will be responsible for designing and implementing robust CI pipelines that facilitate seamless integration and deployment of software solutions. Your expertise will help us enhance our development processes, ensuring high-quality software delivery.
Full-time|$190K/yr - $200K/yr|On-site|Read AI - Seattle HQ
Senior Backend Software EngineerJoin Read AI's innovative Backend team as a Senior Software Engineer. In this pivotal role, you will be instrumental in designing, developing, and optimizing robust backend systems that fuel our AI-driven productivity platform. Engage in a dynamic, collaborative setting where you’ll deploy code weekly and make a substantial impact on millions of users.Complete your application with a Provn skills assessment.
Join Oteemo Inc. as a Senior Pipeline Engineer and play a vital role in our engineering team. You will be responsible for designing, developing, and maintaining state-of-the-art pipeline systems that meet our clients' needs. This position requires a deep understanding of pipeline engineering principles and the ability to work collaboratively in a dynamic environment.
General SummaryAt LAIKA, we create enchanting stop-motion films that seamlessly blend traditional artistic techniques with cutting-edge technology. As a Senior Pipeline Engineer on our Studio Pipeline team, you will play a pivotal role in designing, constructing, and sustaining the pipeline and workflow tools that empower artists and production managers throughout the creative journey.In this position, your primary focus will be on developing and supporting essential pipeline tools, middleware, and services that drive studio workflows and operations. You'll engage with the entire technology stack—from user-facing workflow tools to API design, service development, and data modeling—while collaborating closely with fellow developers, artists, and production teams.You will report directly to the Studio Pipeline Senior Manager and work in tandem with other engineers and development teams, as well as artists and production managers across fabrication, visual effects (VFX), and editorial departments.
Full-time|Hybrid|Dallas, TX - Hybrid (3x in office/week)
About LanternLantern is a cutting-edge specialty care platform dedicated to connecting individuals with top-tier healthcare when they need it most. By establishing a curated Network of Excellence consisting of the nation’s leading specialists in surgery, cancer care, infusions, and more, Lantern ensures superior care while offering substantial cost savings to employers and their teams. Each member is paired with a dedicated care team, including Care Advocates and nurses, to guide them throughout their healthcare journey, supporting their return to good health, family, and work. With accessible specialists nationwide, Lantern makes quality healthcare conveniently close for most. Trusted by some of the largest employers across the country, Lantern proudly serves over 6 million members nationwide. Discover more about us at lanterncare.com.About You:You rely on LOGIC in your decision-making process and recognize that progress is essential for instigating change. You emphasize executing your tasks effectively while thriving in a dynamic environment, taking time to celebrate both small and significant achievements.INCLUSION is a fundamental aspect of your values. A diverse and inclusive workplace is crucial for you, and you actively seek to engage with a team that brings varied experiences and perspectives, appreciating the uniqueness of every individual.You possess the GRIT, determination, and ambition required to solve substantial challenges. Tackling big problems necessitates innovative thinking and a supportive team.With a strong commitment to HUMANITY, you deeply care for your customers, who inspire your drive to evoke change. Your customers are not just users of your product; they are the motivation behind your efforts.Integrity is your guiding principle, as you prioritize TRUTH over providing convenient answers.You flourish in a collaborative team environment, understanding that teamwork is vital for innovation and effecting change.These pillars of LIGHT remind us of the impact we have by offering guidance and support in navigating the often intricate and confusing healthcare landscape. We aspire to help individuals find their way to the best care, resources, and support they need to return to life.If this resonates with you, we would be eager to discuss career opportunities at Lantern.
g2i seeks a Software Engineer with experience in Python and AI to join its Miami office. This position centers on developing AI-driven solutions that align with business objectives. Role overview Collaboration is key in this role. The Software Engineer will work alongside a team of skilled professionals, tackling technical challenges and contributing to the direction of AI projects within the company. Requirements Professional experience with Python Background in AI development Ability to work on site in Miami What you will do Build and refine AI solutions to support business needs Collaborate with team members to solve complex problems Contribute to the evolution of AI initiatives at g2i
Full-time|Hybrid|Boston, Massachusetts, United States
Join our innovative team at Code Metal as a Senior Software Engineer specializing in Rust and Python. We are at the forefront of creating cutting-edge AI-powered transpilation and code generation tools that seamlessly connect algorithm development with embedded deployment. By utilizing the latest advancements in Generative AI, Static Analysis, and Formal Verification, you will play a crucial role in shaping the future of software engineering.This role transcends traditional backend responsibilities; we are searching for engineers with a holistic approach to system design and development. You will engage with user needs and UX, delivering resilient and scalable solutions across the entire technology stack.
Full-time|On-site|Mountain View, California; San Francisco, California
Join Databricks as a Senior Staff Software Engineer focusing on Lakeflow Pipelines Datasets. In this pivotal role, you will be at the forefront of developing scalable data processing solutions that empower organizations to harness the full potential of their data. Your expertise will directly contribute to the enhancement of our Lakeflow platform, ensuring seamless data integration and processing workflows.As part of a dynamic team, you will collaborate closely with product managers, data scientists, and other engineers to design and implement robust pipelines that can efficiently handle large datasets. This role offers the opportunity to influence architectural decisions and drive best practices in data engineering.
Full-time|On-site|New York, New York, United States
Join kunai as a Senior Software Engineer specializing in Python, where you will be an integral part of our innovative team. You will design, develop, and implement high-quality software solutions that enhance our products and services.Your expertise in Python will drive our projects forward, allowing us to maintain high standards of excellence while meeting tight deadlines. Collaborate with cross-functional teams to optimize our software development processes and deliver value to our clients.
Join Ocrolus, where we are revolutionizing the financial technology landscape by merging AI with lending solutions. Our goal is to empower lenders by automating workflows, enhancing the evaluation of borrowers, and facilitating swift, precise lending decisions.Our advanced AI-driven workflow and analytics platform processes nearly one million credit applications each month across various lending sectors, including small business, mortgage, and consumer lending. By utilizing cutting-edge AI models combined with our human-in-the-loop verification engine, we achieve over 99% accuracy in data extraction from financial documents. Our innovative fraud detection and comprehensive cash flow analytics significantly improve risk management for our customers, broadening access to credit and fostering a more inclusive financial ecosystem.With a client base of over 400, including industry pioneers such as Better Mortgage, Brex, Enova, Nova Credit, PayPal, Plaid, SoFi, and Square, Ocrolus is at the forefront of AI innovation in fintech. Join us to redefine the way today’s most innovative lenders conduct business.
About Our Team Join our innovative team at avride, where we are pioneering the future of autonomous vehicle technology. We focus on developing a foundational framework for executing autopilot code, emphasizing reliability, reproducibility, and determinism—essential components for effective offline quality evaluations. Additionally, our team is tasked with creating the infrastructure necessary for offline A/B testing, which is crucial for the rigorous validation and optimization of our autopilot technology. About the Opportunity We are seeking a skilled software engineer who is passionate about creating a robust and dependable platform for autonomous vehicles and robotics. The core of our self-driving technology is the pipeline—a specialized framework that orchestrates the interactions among autopilot components. Your role will involve collaborating with technology developers to understand their needs, designing effective solutions, and implementing them. Given the critical importance of performance, safety, and reliability, you will significantly influence the quality of our products by establishing best development practices. Key Responsibilities Identify the needs of technology teams and design a foundational framework for executing autopilot code. Prioritize performance and safety by writing high-performance code and building monitoring infrastructure. Ensure long-term data compatibility and algorithm reproducibility, using recorded data to enhance algorithms and reliably assess their quality. Create infrastructure that assists developers in identifying and resolving issues in their code. Automate testing processes for autopilot code committed to our repository. Write well-structured and maintainable code, documenting solutions in design documents. Required Qualifications Proficient in modern C++ with strong experience. Demonstrated ability to write high-performance code. Excellent problem-solving skills, capable of clearly understanding problems and evaluating different solutions based on their implications. Experience in designing complex systems. Preferred Qualifications Familiarity with Python for non-time-critical coding tasks. Experience with automated testing frameworks.
Full-time|$132K/yr - $209.3K/yr|Remote|United States - Remote
Our PurposeAt SentinelOne, our mission is clear: empowering those who safeguard our future. With AI transforming the landscape of organizational operations and innovation, the need for robust security is more vital than ever. By joining SentinelOne, your contributions will help protect global enterprises, critical infrastructures, and the technologies that will define tomorrow. If you thrive on tackling significant challenges and desire to make a tangible, global impact, you will find your purpose here.About UsSentinelOne stands at the forefront of AI and security, creating a revolutionary model for cybersecurity. Our AI-driven platform integrates protection across endpoint, cloud, identity, data, and AI systems, enabling autonomous detection and response with exceptional clarity and speed. By leveraging real-time analytics, intelligent automation, and a cohesive data foundation, we minimize distractions, streamline complexities, and empower security teams to concentrate on what truly matters.Our teams are innovators, builders, and problem solvers dedicated to shaping a safer future. If you're excited about solving complex issues alongside talented, mission-driven individuals, we invite you to collaborate with us in constructing a safer world.What Are We Looking For?We seek individuals who are driven by curiosity and committed to continuous learning. With AI transforming every aspect of our operations, we encourage every team member, regardless of their role, to develop fluency in AI tools and concepts. Those who excel here actively pursue new solutions, engage in thoughtful experimentation, and apply their insights to foster improved, faster, and smarter outcomes.As a Senior AI Software Engineer, you will be responsible for designing and maintaining Python backend services that support AI-driven features and workflows. Utilizing tools such as FastAPI, you will create scalable, high-performance systems focused on reliability and practical application. You will oversee projects from inception to deployment, delivering solutions for both our clients and internal teams.Your Responsibilities:Design, develop, and manage backend services in Python that power AI-centric products and shared functionalities.Establish and uphold robust service integrations across internal and external systems, effectively managing failure scenarios, rate limits, and interface modifications.Take ownership of complex, end-to-end challenges: from initial design and architecture to implementation, rollout, and iterative improvements in production.Develop and enhance LLM-supported features and automated workflows utilized in production, prioritizing reliability and observability.
Full-time|$160.8K/yr - $193K/yr|Remote|Ann Arbor, MI ;Remote - US
About Torc RoboticsAt Torc Robotics, we are driven by the belief that autonomous vehicle technology will revolutionize transportation, freight logistics, and business operations. As a pioneering force in autonomous driving since 2007, we have invested over a decade in bringing our advanced solutions to market alongside trusted partners. Now integrated into the Daimler family, we are dedicated to creating cutting-edge software for automated trucks, reshaping the future of freight movement. Join us to elevate your career with the first autonomous vehicle software company to collaborate directly with a truck manufacturer.Meet Our TeamThe Build and Tools group at Torc Robotics is tasked with developing the infrastructure, hosted systems, developer platforms, and build pipelines essential for our products. Within this group, the Release Pipelines team is a newly established unit focusing on constructing automation systems and workflow pipelines that facilitate the swift and secure release of our software.
Full-time|$148K/yr - $210K/yr|On-site|Cambridge, MA USA
Your Role at Lila Sciences We are in search of a Senior Software Engineer to become a pivotal member of our Applied AI team, contributing to the development of our next-generation AI-powered scientific platform. This position involves designing and refining backend systems, data pipelines, and AI integrations that facilitate intelligent, data-centric applications. You will operate at the crossroads of backend engineering and machine learning, ensuring that our platform scales effectively and supports state-of-the-art applied AI methodologies such as Retrieval-Augmented Generation (RAG), agentic AI, and large language model (LLM) integration. This opportunity is perfect for individuals who excel at merging software engineering with applied AI, transforming research into production-level systems that foster genuine scientific breakthroughs. If you are driven by the challenge of building high-performing, sophisticated systems that maximize the utility and impact of AI, we would be eager to connect with you! Your Contributions Applied AI Integration: Design and implement backend services and data pipelines that underpin advanced AI applications, including LLMs, RAG, and agentic frameworks. API & Service Development: Create high-performance APIs and microservices that facilitate seamless interactions between AI models, scientific tools, and user-facing applications. Data Pipeline Architecture: Architect and oversee scalable pipelines adept at managing structured, unstructured, and vectorized data for AI/ML workloads. Database & Knowledge Systems: Develop and optimize SQL, NoSQL, and vector databases to ensure low-latency AI retrieval and inference tasks. Cloud & Infrastructure: Utilize AWS, Kubernetes, and infrastructure-as-code (Terraform/CloudFormation) to construct resilient, production-ready AI platforms. Performance & Reliability: Identify system bottlenecks, optimize for efficiency and speed, and guarantee the reliability and fault-tolerance of AI-driven processes. Collaboration: Work closely with ML researchers, platform engineers, and scientists to translate models and algorithms into scalable, production-ready solutions.
About Retell AIAt Retell AI, we are pioneering the future of call centers through innovative voice AI technology. Our cutting-edge solutions are transforming how companies engage with customers.In just 18 months since our inception, we've empowered thousands of businesses with our AI voice agents that efficiently manage sales, support, and logistics calls, significantly reducing the need for large teams of human agents. Supported by industry-leading investors including Y Combinator and Alt Capital, we've grown our annual recurring revenue from $5M to an impressive $36M while expanding our team from 5 to 20 talented individuals since 2025.Our ambitious vision for 2026 is to develop a state-of-the-art customer experience platform where entire contact centers are driven by AI. Unlike basic automation requiring constant human oversight, we’re engineering intelligent AI “workers” capable of serving as frontline agents, quality assurance analysts, and managerial roles, all while optimizing customer interactions continuously.We are rapidly expanding and seeking driven builders who thrive on solving complex technical challenges, act decisively, and wish to make a tangible impact in one of the fastest-growing voice AI startups.Join us in shaping the future!Recognized as a top 50 AI application in the a16z list: https://tinyurl.com/5853dt2xRanked #4 in Brex's Fast-Growing Software Vendors of 2025: https://www.brex.com/journal/brex-benchmark-december-2025Featured among the top startups on: https://leanaileaderboard.com/
Join Provectus as a Senior Software Engineer / Solutions Architect specializing in Python and Generative AI. In this critical role, you will leverage your expertise to architect and implement innovative software solutions that drive business success. Collaborate with cross-functional teams to deliver high-quality, scalable applications while pushing the boundaries of technology.
Mar 30, 2026
Sign in to browse more jobs
Create account — see all 70,969 results
Tailoring 0 resumes…
Tailoring 0 resumes…
We'll move completed jobs to Ready to Apply automatically.