Data Engineer specializing in Azure, Databricks, and Python

Lead Data Engineer - Azure, Databricks, PythonAbout UsAt Two Circles, we are pioneers in the Sports & Entertainment Marketing industry, dedicated to amplifying audiences and enhancing revenue streams. Our deep understanding of fan behavior allows us to empower our clients to connect with their audiences more effectively. We collaborate with renowned organizations such as the English Premier League, Red Bull, UEFA, VISA, the NFL, Nike, and Amazon, providing insights that drive growth in both direct-to-consumer and B2B sectors. With a global presence encompassing nearly 1,000 professionals across 14 offices, we are committed to delivering innovative solutions to sports and entertainment businesses worldwide. Your RoleWe are seeking an exceptional Data Engineer to join our dynamic team of over 100 Data & BI Engineers, focusing on our Audience Intelligence Platform. In this position, you will be instrumental in developing a cutting-edge data management and analytics platform tailored for the sports industry. You will leverage advanced technologies to design, create, and optimize scalable data solutions that enable teams and organizations to harness the full potential of their data. If you are passionate about data engineering and thrive in a collaborative and fast-paced environment, we encourage you to apply! Your responsibilities will evolve as you grow, starting with:Designing, building, and testing scalable data platform solutions within Azure, utilizing tools such as ADF, Databricks, and Function Apps, with expertise in Python.Creating high-quality data products that ensure efficiency, reliability, and performance across our data pipelines.Collaborating closely with product and marketing teams to deliver actionable data-driven insights and solutions that are of significant business value.Writing clean, maintainable code in accordance with industry best practices and development frameworks, upholding robust data engineering standards.Continuously enhancing and optimizing data workflows, monitoring performance metrics, and implementing innovations to drive progress.

Join Databricks, where our mission is to simplify and democratize data and AI. We are pioneering the next wave of technological advancements, from transforming transportation to accelerating medical breakthroughs. Our world-class data and AI infrastructure platform empower customers to harness deep data insights and enhance their business operations. With a foundation built by engineers who are dedicated to customer satisfaction, we embrace every challenge, from crafting next-gen UI/UX to scaling our services and infrastructure across millions of virtual machines. The journey has just begun!As a Fullstack Software Engineer, you will collaborate with your team and product management to distill complex data insights into simple, user-friendly experiences. We seek engineers driven by a passion for customer-centric solutions, capable of taking ownership of the entire product lifecycle and user experience beyond mere technical implementation. You will play a critical role in establishing the groundwork for building robust, scalable, and delightful products.Our Vancouver location marks the newest R&D hub for Databricks, allowing us to expand our footprint in the Pacific Northwest. We are actively seeking exceptional engineers to join us in our quest to democratize data and AI. We envision this site becoming a pivotal center for product innovation at Databricks, with several strategic areas being developed here, including:Log Analytics - Our clients increasingly rely on Databricks for real-time analysis of petabyte-scale logs, presenting new challenges across the data processing pipeline, including ingestion, indexing, processing, and enhancing user experience.AI/BI - AI/BI is reshaping Business Intelligence for the AI era. Since its launch last summer, adoption has soared (with 98.7% of our data warehousing customers utilizing AI/BI). Our innovative products feature rich dashboarding, advanced visualizations, and powerful talk-to-your-data solutions, encompassing exciting technical challenges across the entire stack.Unity Catalog Business Semantics - In the world of AI, context is paramount. Unity Catalog Business Semantics ensures that enterprise data context is effectively governed and managed. After launching our first Semantics modeling capability, Unity Catalog Metrics, at the recent Data + AI Summit, we have ambitious plans for the future. Engineers in this team navigate the intersection of large-scale distributed systems, data modeling, governance, and AI enablement.Databricks Apps - Databricks Apps is one of the fastest-growing areas in our portfolio, focusing on...

At Databricks, we are dedicated to empowering data teams to tackle some of the most challenging issues in the world. From revolutionizing transportation to accelerating medical advancements, our mission is to provide exceptional data and AI infrastructure that enables clients to leverage deep insights for business enhancement. Founded by engineers with a customer-centric mindset, we embrace every opportunity to overcome technical hurdles, from crafting next-generation UI/UX for data interactions to scaling our services across millions of virtual machines. Our journey has just begun. As part of the AI/BI team, we strive to make Databricks the premier platform for business users to create, locate, and utilize data insights. Our focus revolves around four core pillars: Dashboards, Genie, Databricks One, and Unity Catalog Business Semantics. The Unity Catalog empowers users to establish business metrics and metadata within a centrally governed system, ensuring trustworthy access. Databricks One simplifies the user experience for non-technical users to uncover and leverage data insights, while Genie enables conversational queries through advanced text-to-SQL functionality, and Dashboards facilitate everyday business operations. We are on the lookout for a passionate Engineering Leader to expand our Data Visualization and Unity Catalog Business Semantics teams. These teams will engage in complex full-stack challenges, such as enhancing visualization accessibility, creating highly interactive dashboards, developing compelling augmented analytics experiences, offering industry-leading low/no-code authoring capabilities, and boosting the analytical expressiveness of our business semantics products. You will report directly to the Senior Manager of Engineering.

Join Databricks, a pioneering force in data and AI, as we strive to redefine the way businesses leverage data insights! Our mission spans from revolutionizing transportation to enhancing medical advancements through our unparalleled data and AI infrastructure platform. With a foundation built by engineers and a relentless focus on customer needs, we tackle complex technical challenges, from crafting next-generation UI/UX to scaling our services across vast virtual environments. Our journey is just beginning. With the establishment of our Vancouver R&D center, we are expanding our footprint in the Pacific Northwest and are on the lookout for exceptional engineers to help us democratize data and AI. The Vancouver site is poised to become a vital hub for product innovation at Databricks. We are excited to bring strategic initiatives to this location and have multiple roles available across various teams, including: Log Analytics - As more customers utilize Databricks for real-time analysis of petabyte-scale logs, our team faces new challenges across the data processing pipeline, including ingestion, indexing, and processing. AI/BI - Our AI/BI solutions are transforming Business Intelligence for the AI era, with remarkable adoption rates (98.7% among our data warehousing clients). Join us to work on advanced dashboarding, visualizations, and innovative talk-to-your-data functionalities. Unity Catalog Business Semantics - Context is essential for AI, and our Unity Catalog ensures that enterprise data context is meticulously governed and managed. Our recent launch of the Unity Catalog Metrics marks a significant milestone, with more innovations ahead for this team focused on distributed systems, data modeling, governance, and AI integration. Databricks Apps - As one of our fastest-growing products, Databricks Apps has over 2,500 users creating more than 20,000 apps. This team works on low-level platform components, including Kubernetes and networking, while heavily investing in AI-driven app builders.

At Databricks, we are dedicated to empowering data teams in tackling some of the world's most challenging issues — from speeding up medical innovations to crafting the next wave of intelligent products. We achieve this by developing the premier Data Intelligence Platform, enabling our clients to transform vast amounts of data into profound, actionable insights. Founded by engineers and fueled by innovation, we are passionate about creating intuitive, high-performance user experiences that simplify complex data exploration. As a Senior Frontend Engineer specializing in Data Visualization, you will create interactive and scalable visual experiences that allow users to explore, analyze, and share insights from vast datasets. You will collaborate closely with designers, product managers, and backend engineers to develop the next generation of visualization frameworks, dashboards, and analytical interfaces within Databricks.

At Databricks, we are dedicated to revolutionizing the world of data and AI. Our goal is to make data-driven insights accessible to everyone, from pioneering the next mode of transportation to facilitating groundbreaking medical advancements. We achieve this by developing and maintaining the premier data and AI infrastructure platform, empowering our clients to leverage deep data insights to enhance their operations. Founded by engineers with a strong customer focus, we eagerly embrace every chance to tackle technical challenges, whether it involves crafting next-generation UI/UX for data interactions or optimizing our services and infrastructure across millions of virtual machines. And we are just getting started. As a Senior Fullstack Software Engineer, you will collaborate closely with your team and product management to streamline data insights for users. We seek engineers who are passionate about customer satisfaction and can oversee the entire product scope, extending their vision beyond mere technical execution. You will play a crucial role in establishing a solid foundation for the development of robust, scalable, and enjoyable products. Our Vancouver location is set to become the latest research and development hub for Databricks, enhancing our footprint in the Pacific Northwest. We are actively recruiting top-tier engineers to join us on our mission to democratize data and AI. We envision the Vancouver site as a critical catalyst for product innovation at Databricks, initially focusing on several strategic areas and multiple open roles across the following teams: Log Analytics - Our customers increasingly utilize Databricks for real-time analysis of petabyte-scale logs, presenting new challenges throughout the data processing pipeline, including ingestion, indexing, processing, and user experience. AI/BI - AI/BI is transforming Business Intelligence for the AI era. Launched last summer, this product has rapidly gained traction, with 98.7% of our data warehousing customers already utilizing AI/BI. The solutions we are developing, from intricate dashboards to advanced visualizations and interactive data exploration, present exciting technical challenges across the full stack. Unity Catalog Business Semantics - Understanding context is vital for AI. For enterprise data, this context must be governed effectively, which is the purpose of Unity Catalog Business Semantics. Recently launched at our Data + AI Summit, our first semantics modeling capability, Unity Catalog Metrics, is just the beginning. Engineers on this team work at the intersection of large-scale distributed systems, data modeling, governance, and AI enablement. Databricks Apps - Databricks Apps is one of the fastest-growing areas in our portfolio, focusing on creating seamless applications that enhance user engagement and data interaction.

Join Databricks, an innovative leader in data and AI, on our mission to simplify access to data and AI technologies. We are dedicated to transforming industries, from revolutionizing transportation to advancing medical breakthroughs, by providing the world's foremost data and AI infrastructure platform. Our engineering-driven culture fuels our relentless pursuit of solving technical challenges, whether it's enhancing the user experience with next-gen UI/UX or expanding our infrastructure to support millions of virtual machines.As we establish our new R&D center in Vancouver, we are on the lookout for exceptional engineers to help us democratize data and AI. This site is poised to become a cornerstone of product innovation at Databricks, with several strategic initiatives underway.The Vancouver team will focus on key areas, including:Log Analytics - Tackling the challenges of real-time petabyte-scale log analysis, encompassing the entire data processing pipeline from ingestion to user experience.AI/BI - Our AI/BI product is revolutionizing business intelligence with unmatched adoption rates, enabling rich dashboarding and advanced visualizations.Unity Catalog Business Semantics - Governing and managing enterprise data context through our innovative Unity Catalog, enhancing data modeling and AI enablement.Databricks Apps - Contributing to one of our fastest-growing products, with opportunities to work on low-level platform components and AI-driven app builder agents.

About LanternLantern is a leading specialty care platform designed to connect individuals with top-tier healthcare when they need it most. By establishing a curated Network of Excellence, which includes the nation's foremost specialists across various medical fields such as surgery, cancer care, and infusions, Lantern not only ensures quality care but also delivers substantial cost savings to employers and their employees. Our dedicated care teams, comprising Care Advocates and nurses, accompany members throughout their healthcare journey, empowering them to regain their health, reconnect with their families, and return to their professional lives. With convenient access to specialists across the nation, Lantern makes quality healthcare accessible to most individuals. Trusted by some of the largest employers in the country, we serve over 6 million members nationwide. Discover more about us at lanterncare.com.About You:You leverage LOGIC in your decision-making, understanding that progress is essential for enacting change. You prioritize executing your tasks while thriving in a fast-paced environment, celebrating both minor and major victories along the way.INCLUSION is a fundamental aspect of your values. You highly value a diverse and inclusive workplace, eager to collaborate with a team that encompasses a variety of experiences and perspectives.With GRIT, determination, and ambition, you are equipped to tackle significant challenges. You believe that substantial problems necessitate innovative solutions and a supportive team to foster new ideas.You possess a deep commitment to your customers, driven to maintain HUMANITY in every decision made. Your motivation stems from the individuals utilizing your product, as they are the core of your drive for change.Guided by integrity, you emphasize the importance of TRUTH over simply providing answers that are comfortable to hear.Collaboration is vital for you, and you flourish in a team environment where innovation and change are fostered.These pillars of LIGHT serve as a reminder to our team of the impact we have by offering guidance and support in navigating the often intricate landscape of healthcare. We aspire to illuminate pathways for individuals to access the best care, resources, and support they require to return to their lives.If this resonates with you, we would be delighted to discuss career opportunities at Lantern.

About LanternLantern serves as a premier specialty care platform, dedicated to connecting individuals with optimal healthcare solutions precisely when they need them. By assembling a curated Network of Excellence featuring the nation's most renowned specialists in surgery, cancer care, infusions, and beyond, Lantern not only ensures exceptional care but also facilitates considerable cost savings for employers and their employees. Our platform pairs each member with a devoted care team, comprising Care Advocates and nurses, who support them throughout their entire care journey, allowing them to return to good health, family, and work. With seamless access to specialists nationwide, Lantern makes quality care just a short drive away for the majority. Trusted by some of the largest employers in the nation, Lantern provides care to over 6 million members across the country. Discover more about us at lanterncare.com.About You:You employ LOGIC in your decision-making and recognize that progress is vital for instigating change. You prioritize the effective execution of your tasks while adapting to a fast-paced environment, and you take the time to acknowledge both minor and major achievements.INCLUSION is a fundamental aspect of your personal values. You value a diverse and inclusive environment and are eager to contribute to a team enriched by varied experiences and perspectives, celebrating the uniqueness of every individual.You possess the GRIT, determination, and ambition to address significant challenges, understanding that substantial issues require innovative solutions and a supportive team.Your dedication to customers drives you to keep HUMANITY at the forefront of all decisions, viewing customers not merely as users of your product, but as the central motivation behind your efforts to create impactful changes.Integrity is your guiding principle. You prioritize TRUTH over providing comforting answers.You excel in a team-oriented environment. Collaboration is essential for innovation and driving change.These principles of LIGHT remind our team that we are making a difference by offering guidance and support in navigating the often complex and confusing healthcare landscape. Through this LIGHT, we hope individuals can find their way to the best care, resources, and support they need to resume their lives.If this resonates with you, we would be thrilled to connect and discuss potential career opportunities at Lantern.

Remarcable Inc. supports trade contractors in managing procurement, tools, and warehouse operations by providing greater visibility and control. As the company expands throughout North America, data remains at the heart of its strategy. Role overview The Data Engineer will help shape and maintain Remarcable’s AWS Lakehouse infrastructure. This position focuses on designing ELT pipelines and building data models that inform decisions for product, operations, and leadership teams. The work also involves developing data infrastructure to enable AI and machine learning features for both contractors and back-office users. Location This hybrid role is based in Vancouver, BC. What you will do Build and maintain AWS Lakehouse architecture Design and implement ELT data pipelines Develop data models to guide business and product choices Create and support data infrastructure for AI and ML features What Remarcable values Strong interest in clean, reliable data architecture Motivation to influence the future of construction technology Ownership mindset and a willingness to take initiative

Role overview Asana is seeking a Senior Data Engineer based in Vancouver, BC. This position centers on developing and enhancing the company’s data architecture. The Senior Data Engineer partners with teams throughout the organization to build and maintain scalable data pipelines that support business growth. What you will do Design, implement, and maintain data pipelines that adapt to evolving business requirements Work with cross-functional partners to gather and deliver on analytical needs Support and improve data infrastructure, ensuring reliable access for analytics and reporting Impact The solutions built in this role enable Asana to make informed, data-driven decisions. By maintaining effective and reliable data systems, the Senior Data Engineer helps ensure that analytics and reporting are accessible and trustworthy across the company.

At ZoomInfo, we accelerate careers by fostering a fast-paced environment where bold thinking is encouraged. Join us to do the best work of your life alongside a supportive team that values collaboration, challenges the status quo, and celebrates achievements. We provide you with tools that enhance your impact and a culture that empowers your ambitions, allowing you to not just contribute but to truly make things happen.About the RoleWe are on the lookout for a Senior Data Engineering Analyst to become the go-to expert on our data pipeline, which is responsible for ingesting, processing, and profiling millions of company records that drive our clients' go-to-market strategies.In this pivotal role, you will develop a comprehensive understanding of our data flow—from acquisition to profiling and output. You'll analyze code to grasp data transformations and system dependencies, provide valuable insights during design discussions with Engineering and Product teams, and help guide the evolution of our next-generation data infrastructure. As you gain expertise, you will lead strategic data improvement initiatives that require both systems thinking and innovative problem-solving.This role transcends typical dashboard creation or SQL reporting; it focuses on understanding data systems architecturally, tackling ambiguous data challenges, and evolving our pipeline infrastructure to meet customer demands and maintain a competitive edge.Your collaboration with fellow data analysts will be crucial during our active infrastructure transition. As our systems stabilize and your expertise grows, you will progressively take ownership of the pipeline architecture and lead strategic initiatives. This position offers significant growth potential for those looking to be the technical authority on company data systems.

Rivian and Volkswagen Group Technologies brings together two leaders in automotive innovation to shape the future of mobility. This collaboration focuses on developing advanced operating systems, zonal controllers, and cloud connectivity for software-defined vehicles. The team is dedicated to solving challenges in electric vehicle technology, aiming to set new standards in the industry. By combining expertise in connectivity, artificial intelligence, and security, the partnership works toward a more connected and sustainable future. Role overview The Senior Data Engineer, Ingestion Framework, joins the Data & AI Platform team in Vancouver. This role centers on supporting the big data platform, which operates at a petabyte scale. The main focus is on architecting and maintaining a custom vehicle data processing framework built with Go, and ensuring it integrates smoothly with the Databricks platform. What you will do Design and maintain a custom-built data ingestion framework using Go. Support seamless integration between the ingestion framework and Databricks. Help ensure reliable, large-scale operation of the vehicle data platform. Location This position is based in Vancouver, British Columbia.

Join cima2 as a Lead Project Engineer specializing in substations, where you will play a critical role in the design and execution of innovative electrical projects. Your expertise will guide a team of engineers and technicians, ensuring that projects are delivered on time and within budget, while adhering to the highest industry standards.

cima2 is seeking a Lead Project Engineer - Lines based in Vancouver. This position focuses on leading engineering projects related to infrastructure lines, from initial design through implementation. Role overview The Lead Project Engineer - Lines works closely with a team to develop and deliver engineering solutions. The role involves overseeing project phases, coordinating with colleagues, and ensuring that technical standards are met throughout the process. Key responsibilities Guide the design and implementation of infrastructure line projects Collaborate with engineers and other team members to achieve project goals Focus on improving operational efficiency and project outcomes Location This position is based in Vancouver.

cima2 seeks a Lead Project Engineer with a background in lines to join its Vancouver office. This role manages engineering projects from early planning through final delivery, with a strong focus on quality, budget, and schedule at every step. Key responsibilities Direct projects centered on lines, steering them from initial concept through completion Lead and support a team of engineers, providing mentorship and guidance Collaborate with stakeholders from various functions to keep projects on track Introduce and apply engineering solutions to achieve project goals Maintain high standards for quality, budget control, and timely delivery Location This position is located in Vancouver.

Role Overview MineSense Technologies Ltd. is hiring a Mechanical Engineering Team Lead in Vancouver. This leadership role shapes the future of mining technology by guiding mechanical engineering projects from concept through execution. What You Will Do Lead mechanical engineering projects and guide teams toward successful delivery Work closely with colleagues from other disciplines to develop and improve mining solutions Mentor and support junior engineers as they grow their technical skills Monitor project progress and help ensure milestones are achieved on time and to a high standard

Join Flagler Health, a dynamic healthtech innovator, as we revolutionize the delivery of healthcare services through cutting-edge AI-driven workflow automation, remote patient engagement, and comprehensive chronic care programs. Our platform has positively impacted over 1.5 million patients and is a trusted partner for healthcare providers and payers aiming to improve operational efficiency and patient outcomes while reducing costs. With a unique freemium model and limited competition, we are set to capture a significant portion of the $4.5 trillion U.S. healthcare market.Key ResponsibilitiesDatabricks Platform Expertise• Design, manage, and enhance data pipelines utilizing the Databricks platform.• Troubleshoot and debug Spark applications to ensure optimal performance and reliability.• Apply best practices in Spark computing and workload optimization.• Python Development• Write clean, efficient, and reusable Python code adhering to object-oriented principles.• Develop APIs to facilitate data integration and application functionality.• Create scripts and tools that automate data processing and workflows.MongoDB Management• Manage, query, and integrate data within MongoDB.• Ensure efficient data storage and retrieval tailored to application needs.• Optimize MongoDB's performance for handling large datasets.• Collaboration and Problem Solving• Collaborate closely with data scientists, analysts, and stakeholders to address data requirements and deliver effective solutions.• Identify and resolve technical challenges related to data processing and system architecture.

Join Hootsuite as a Data Engineering Intern/Co-op for Summer 2026 and immerse yourself in the dynamic world of data analytics and engineering. Work alongside a talented team, gaining hands-on experience in building data pipelines, optimizing data processes, and leveraging the latest technologies in data management. This internship is a fantastic opportunity to apply your skills in a real-world environment and make a significant impact on our data-driven initiatives.