Lead Data Engineer - Azure, Databricks, Python

Data Engineer (Azure / Databricks / Python)About UsAt Two Circles, we are a leading Sports & Entertainment Marketing firm dedicated to enhancing audience engagement and driving revenue growth. By leveraging deep insights into fan behavior, we empower our clients to effectively connect with their audiences, amplifying both consumer and B2B revenues. Our trusted platforms and services cater to an impressive roster of over 900 clients worldwide, including renowned names like the English Premier League, Red Bull, UEFA, VISA, the NFL, Nike, and Amazon. With a workforce nearing 1000 and 14 global offices, we are committed to delivering innovative solutions to sports and entertainment entities of all sizes.Your RoleWe are seeking a passionate Data Engineer to join our dynamic team of over 100 Data & BI Engineers, contributing to our Audience Intelligence Platform. In this pivotal role, you will play a key part in developing a cutting-edge data management and analytics platform tailored for the sports industry. You will harness the latest technologies to design, build, and optimize scalable data solutions, helping teams, leagues, and organizations unlock the full value of their data. If you thrive in a fast-paced environment and are eager to make a significant impact in the sports sector, we want to hear from you!Key ResponsibilitiesDesign, develop, and test scalable data platform solutions in Azure, utilizing tools such as ADF, Databricks, and Function Apps, with a focus on Python.Create high-quality data products, ensuring efficiency, reliability, and performance across our data pipelines.Collaborate closely with product and marketing teams to deliver data-driven insights and impactful solutions that drive business success.Write clean, maintainable code adhering to best practices and development frameworks, upholding robust data engineering standards.Continuously enhance and optimize data workflows, monitoring performance and implementing advancements to foster innovation.

Join Databricks, where our mission is to simplify and democratize data and AI. We are pioneering the next wave of technological advancements, from transforming transportation to accelerating medical breakthroughs. Our world-class data and AI infrastructure platform empower customers to harness deep data insights and enhance their business operations. With a foundation built by engineers who are dedicated to customer satisfaction, we embrace every challenge, from crafting next-gen UI/UX to scaling our services and infrastructure across millions of virtual machines. The journey has just begun!As a Fullstack Software Engineer, you will collaborate with your team and product management to distill complex data insights into simple, user-friendly experiences. We seek engineers driven by a passion for customer-centric solutions, capable of taking ownership of the entire product lifecycle and user experience beyond mere technical implementation. You will play a critical role in establishing the groundwork for building robust, scalable, and delightful products.Our Vancouver location marks the newest R&D hub for Databricks, allowing us to expand our footprint in the Pacific Northwest. We are actively seeking exceptional engineers to join us in our quest to democratize data and AI. We envision this site becoming a pivotal center for product innovation at Databricks, with several strategic areas being developed here, including:Log Analytics - Our clients increasingly rely on Databricks for real-time analysis of petabyte-scale logs, presenting new challenges across the data processing pipeline, including ingestion, indexing, processing, and enhancing user experience.AI/BI - AI/BI is reshaping Business Intelligence for the AI era. Since its launch last summer, adoption has soared (with 98.7% of our data warehousing customers utilizing AI/BI). Our innovative products feature rich dashboarding, advanced visualizations, and powerful talk-to-your-data solutions, encompassing exciting technical challenges across the entire stack.Unity Catalog Business Semantics - In the world of AI, context is paramount. Unity Catalog Business Semantics ensures that enterprise data context is effectively governed and managed. After launching our first Semantics modeling capability, Unity Catalog Metrics, at the recent Data + AI Summit, we have ambitious plans for the future. Engineers in this team navigate the intersection of large-scale distributed systems, data modeling, governance, and AI enablement.Databricks Apps - Databricks Apps is one of the fastest-growing areas in our portfolio, focusing on...

At Databricks, we are dedicated to empowering data teams to tackle some of the most challenging issues in the world. From revolutionizing transportation to accelerating medical advancements, our mission is to provide exceptional data and AI infrastructure that enables clients to leverage deep insights for business enhancement. Founded by engineers with a customer-centric mindset, we embrace every opportunity to overcome technical hurdles, from crafting next-generation UI/UX for data interactions to scaling our services across millions of virtual machines. Our journey has just begun. As part of the AI/BI team, we strive to make Databricks the premier platform for business users to create, locate, and utilize data insights. Our focus revolves around four core pillars: Dashboards, Genie, Databricks One, and Unity Catalog Business Semantics. The Unity Catalog empowers users to establish business metrics and metadata within a centrally governed system, ensuring trustworthy access. Databricks One simplifies the user experience for non-technical users to uncover and leverage data insights, while Genie enables conversational queries through advanced text-to-SQL functionality, and Dashboards facilitate everyday business operations. We are on the lookout for a passionate Engineering Leader to expand our Data Visualization and Unity Catalog Business Semantics teams. These teams will engage in complex full-stack challenges, such as enhancing visualization accessibility, creating highly interactive dashboards, developing compelling augmented analytics experiences, offering industry-leading low/no-code authoring capabilities, and boosting the analytical expressiveness of our business semantics products. You will report directly to the Senior Manager of Engineering.

Join Databricks, a pioneering force in data and AI, as we strive to redefine the way businesses leverage data insights! Our mission spans from revolutionizing transportation to enhancing medical advancements through our unparalleled data and AI infrastructure platform. With a foundation built by engineers and a relentless focus on customer needs, we tackle complex technical challenges, from crafting next-generation UI/UX to scaling our services across vast virtual environments. Our journey is just beginning. With the establishment of our Vancouver R&D center, we are expanding our footprint in the Pacific Northwest and are on the lookout for exceptional engineers to help us democratize data and AI. The Vancouver site is poised to become a vital hub for product innovation at Databricks. We are excited to bring strategic initiatives to this location and have multiple roles available across various teams, including: Log Analytics - As more customers utilize Databricks for real-time analysis of petabyte-scale logs, our team faces new challenges across the data processing pipeline, including ingestion, indexing, and processing. AI/BI - Our AI/BI solutions are transforming Business Intelligence for the AI era, with remarkable adoption rates (98.7% among our data warehousing clients). Join us to work on advanced dashboarding, visualizations, and innovative talk-to-your-data functionalities. Unity Catalog Business Semantics - Context is essential for AI, and our Unity Catalog ensures that enterprise data context is meticulously governed and managed. Our recent launch of the Unity Catalog Metrics marks a significant milestone, with more innovations ahead for this team focused on distributed systems, data modeling, governance, and AI integration. Databricks Apps - As one of our fastest-growing products, Databricks Apps has over 2,500 users creating more than 20,000 apps. This team works on low-level platform components, including Kubernetes and networking, while heavily investing in AI-driven app builders.

At Databricks, we are dedicated to empowering data teams in tackling some of the world's most challenging issues — from speeding up medical innovations to crafting the next wave of intelligent products. We achieve this by developing the premier Data Intelligence Platform, enabling our clients to transform vast amounts of data into profound, actionable insights. Founded by engineers and fueled by innovation, we are passionate about creating intuitive, high-performance user experiences that simplify complex data exploration. As a Senior Frontend Engineer specializing in Data Visualization, you will create interactive and scalable visual experiences that allow users to explore, analyze, and share insights from vast datasets. You will collaborate closely with designers, product managers, and backend engineers to develop the next generation of visualization frameworks, dashboards, and analytical interfaces within Databricks.

At Databricks, we are dedicated to revolutionizing the world of data and AI. Our goal is to make data-driven insights accessible to everyone, from pioneering the next mode of transportation to facilitating groundbreaking medical advancements. We achieve this by developing and maintaining the premier data and AI infrastructure platform, empowering our clients to leverage deep data insights to enhance their operations. Founded by engineers with a strong customer focus, we eagerly embrace every chance to tackle technical challenges, whether it involves crafting next-generation UI/UX for data interactions or optimizing our services and infrastructure across millions of virtual machines. And we are just getting started. As a Senior Fullstack Software Engineer, you will collaborate closely with your team and product management to streamline data insights for users. We seek engineers who are passionate about customer satisfaction and can oversee the entire product scope, extending their vision beyond mere technical execution. You will play a crucial role in establishing a solid foundation for the development of robust, scalable, and enjoyable products. Our Vancouver location is set to become the latest research and development hub for Databricks, enhancing our footprint in the Pacific Northwest. We are actively recruiting top-tier engineers to join us on our mission to democratize data and AI. We envision the Vancouver site as a critical catalyst for product innovation at Databricks, initially focusing on several strategic areas and multiple open roles across the following teams: Log Analytics - Our customers increasingly utilize Databricks for real-time analysis of petabyte-scale logs, presenting new challenges throughout the data processing pipeline, including ingestion, indexing, processing, and user experience. AI/BI - AI/BI is transforming Business Intelligence for the AI era. Launched last summer, this product has rapidly gained traction, with 98.7% of our data warehousing customers already utilizing AI/BI. The solutions we are developing, from intricate dashboards to advanced visualizations and interactive data exploration, present exciting technical challenges across the full stack. Unity Catalog Business Semantics - Understanding context is vital for AI. For enterprise data, this context must be governed effectively, which is the purpose of Unity Catalog Business Semantics. Recently launched at our Data + AI Summit, our first semantics modeling capability, Unity Catalog Metrics, is just the beginning. Engineers on this team work at the intersection of large-scale distributed systems, data modeling, governance, and AI enablement. Databricks Apps - Databricks Apps is one of the fastest-growing areas in our portfolio, focusing on creating seamless applications that enhance user engagement and data interaction.

Join Databricks, an innovative leader in data and AI, on our mission to simplify access to data and AI technologies. We are dedicated to transforming industries, from revolutionizing transportation to advancing medical breakthroughs, by providing the world's foremost data and AI infrastructure platform. Our engineering-driven culture fuels our relentless pursuit of solving technical challenges, whether it's enhancing the user experience with next-gen UI/UX or expanding our infrastructure to support millions of virtual machines.As we establish our new R&D center in Vancouver, we are on the lookout for exceptional engineers to help us democratize data and AI. This site is poised to become a cornerstone of product innovation at Databricks, with several strategic initiatives underway.The Vancouver team will focus on key areas, including:Log Analytics - Tackling the challenges of real-time petabyte-scale log analysis, encompassing the entire data processing pipeline from ingestion to user experience.AI/BI - Our AI/BI product is revolutionizing business intelligence with unmatched adoption rates, enabling rich dashboarding and advanced visualizations.Unity Catalog Business Semantics - Governing and managing enterprise data context through our innovative Unity Catalog, enhancing data modeling and AI enablement.Databricks Apps - Contributing to one of our fastest-growing products, with opportunities to work on low-level platform components and AI-driven app builder agents.

About LanternLantern is a leading specialty care platform designed to connect individuals with top-tier healthcare when they need it most. By establishing a curated Network of Excellence, which includes the nation's foremost specialists across various medical fields such as surgery, cancer care, and infusions, Lantern not only ensures quality care but also delivers substantial cost savings to employers and their employees. Our dedicated care teams, comprising Care Advocates and nurses, accompany members throughout their healthcare journey, empowering them to regain their health, reconnect with their families, and return to their professional lives. With convenient access to specialists across the nation, Lantern makes quality healthcare accessible to most individuals. Trusted by some of the largest employers in the country, we serve over 6 million members nationwide. Discover more about us at lanterncare.com.About You:You leverage LOGIC in your decision-making, understanding that progress is essential for enacting change. You prioritize executing your tasks while thriving in a fast-paced environment, celebrating both minor and major victories along the way.INCLUSION is a fundamental aspect of your values. You highly value a diverse and inclusive workplace, eager to collaborate with a team that encompasses a variety of experiences and perspectives.With GRIT, determination, and ambition, you are equipped to tackle significant challenges. You believe that substantial problems necessitate innovative solutions and a supportive team to foster new ideas.You possess a deep commitment to your customers, driven to maintain HUMANITY in every decision made. Your motivation stems from the individuals utilizing your product, as they are the core of your drive for change.Guided by integrity, you emphasize the importance of TRUTH over simply providing answers that are comfortable to hear.Collaboration is vital for you, and you flourish in a team environment where innovation and change are fostered.These pillars of LIGHT serve as a reminder to our team of the impact we have by offering guidance and support in navigating the often intricate landscape of healthcare. We aspire to illuminate pathways for individuals to access the best care, resources, and support they require to return to their lives.If this resonates with you, we would be delighted to discuss career opportunities at Lantern.

About LanternLantern serves as a premier specialty care platform, dedicated to connecting individuals with optimal healthcare solutions precisely when they need them. By assembling a curated Network of Excellence featuring the nation's most renowned specialists in surgery, cancer care, infusions, and beyond, Lantern not only ensures exceptional care but also facilitates considerable cost savings for employers and their employees. Our platform pairs each member with a devoted care team, comprising Care Advocates and nurses, who support them throughout their entire care journey, allowing them to return to good health, family, and work. With seamless access to specialists nationwide, Lantern makes quality care just a short drive away for the majority. Trusted by some of the largest employers in the nation, Lantern provides care to over 6 million members across the country. Discover more about us at lanterncare.com.About You:You employ LOGIC in your decision-making and recognize that progress is vital for instigating change. You prioritize the effective execution of your tasks while adapting to a fast-paced environment, and you take the time to acknowledge both minor and major achievements.INCLUSION is a fundamental aspect of your personal values. You value a diverse and inclusive environment and are eager to contribute to a team enriched by varied experiences and perspectives, celebrating the uniqueness of every individual.You possess the GRIT, determination, and ambition to address significant challenges, understanding that substantial issues require innovative solutions and a supportive team.Your dedication to customers drives you to keep HUMANITY at the forefront of all decisions, viewing customers not merely as users of your product, but as the central motivation behind your efforts to create impactful changes.Integrity is your guiding principle. You prioritize TRUTH over providing comforting answers.You excel in a team-oriented environment. Collaboration is essential for innovation and driving change.These principles of LIGHT remind our team that we are making a difference by offering guidance and support in navigating the often complex and confusing healthcare landscape. Through this LIGHT, we hope individuals can find their way to the best care, resources, and support they need to resume their lives.If this resonates with you, we would be thrilled to connect and discuss potential career opportunities at Lantern.

Remarcable Inc. supports trade contractors in managing procurement, tools, and warehouse operations by providing greater visibility and control. As the company expands throughout North America, data remains at the heart of its strategy. Role overview The Data Engineer will help shape and maintain Remarcable’s AWS Lakehouse infrastructure. This position focuses on designing ELT pipelines and building data models that inform decisions for product, operations, and leadership teams. The work also involves developing data infrastructure to enable AI and machine learning features for both contractors and back-office users. Location This hybrid role is based in Vancouver, BC. What you will do Build and maintain AWS Lakehouse architecture Design and implement ELT data pipelines Develop data models to guide business and product choices Create and support data infrastructure for AI and ML features What Remarcable values Strong interest in clean, reliable data architecture Motivation to influence the future of construction technology Ownership mindset and a willingness to take initiative

Role overview Asana is seeking a Senior Data Engineer based in Vancouver, BC. This position centers on developing and enhancing the company’s data architecture. The Senior Data Engineer partners with teams throughout the organization to build and maintain scalable data pipelines that support business growth. What you will do Design, implement, and maintain data pipelines that adapt to evolving business requirements Work with cross-functional partners to gather and deliver on analytical needs Support and improve data infrastructure, ensuring reliable access for analytics and reporting Impact The solutions built in this role enable Asana to make informed, data-driven decisions. By maintaining effective and reliable data systems, the Senior Data Engineer helps ensure that analytics and reporting are accessible and trustworthy across the company.

At ZoomInfo, we accelerate careers by fostering a fast-paced environment where bold thinking is encouraged. Join us to do the best work of your life alongside a supportive team that values collaboration, challenges the status quo, and celebrates achievements. We provide you with tools that enhance your impact and a culture that empowers your ambitions, allowing you to not just contribute but to truly make things happen.About the RoleWe are on the lookout for a Senior Data Engineering Analyst to become the go-to expert on our data pipeline, which is responsible for ingesting, processing, and profiling millions of company records that drive our clients' go-to-market strategies.In this pivotal role, you will develop a comprehensive understanding of our data flow—from acquisition to profiling and output. You'll analyze code to grasp data transformations and system dependencies, provide valuable insights during design discussions with Engineering and Product teams, and help guide the evolution of our next-generation data infrastructure. As you gain expertise, you will lead strategic data improvement initiatives that require both systems thinking and innovative problem-solving.This role transcends typical dashboard creation or SQL reporting; it focuses on understanding data systems architecturally, tackling ambiguous data challenges, and evolving our pipeline infrastructure to meet customer demands and maintain a competitive edge.Your collaboration with fellow data analysts will be crucial during our active infrastructure transition. As our systems stabilize and your expertise grows, you will progressively take ownership of the pipeline architecture and lead strategic initiatives. This position offers significant growth potential for those looking to be the technical authority on company data systems.

Rivian and Volkswagen Group Technologies brings together two leaders in automotive innovation to shape the future of mobility. This collaboration focuses on developing advanced operating systems, zonal controllers, and cloud connectivity for software-defined vehicles. The team is dedicated to solving challenges in electric vehicle technology, aiming to set new standards in the industry. By combining expertise in connectivity, artificial intelligence, and security, the partnership works toward a more connected and sustainable future. Role overview The Senior Data Engineer, Ingestion Framework, joins the Data & AI Platform team in Vancouver. This role centers on supporting the big data platform, which operates at a petabyte scale. The main focus is on architecting and maintaining a custom vehicle data processing framework built with Go, and ensuring it integrates smoothly with the Databricks platform. What you will do Design and maintain a custom-built data ingestion framework using Go. Support seamless integration between the ingestion framework and Databricks. Help ensure reliable, large-scale operation of the vehicle data platform. Location This position is based in Vancouver, British Columbia.

Conseil Scolaire Francophone de la Colombie-Britannique seeks a part-time specialized teacher in Vancouver. This position centers on supporting students with a range of educational needs and building an inclusive classroom community. Role overview Work one-on-one or in small groups with students to address specific learning requirements Promote an inclusive and welcoming atmosphere for all students Collaborate with fellow teachers to achieve shared educational goals Requirements Strong commitment to education Dedication to helping students reach their potential Interest in fostering inclusion within the classroom This specialized teaching role offers the chance to make a difference for students and contribute to a supportive school environment.

Conseil Scolaire Francophone de la Colombie-Britannique is hiring a Specialized Teacher for a part-time position in Vancouver. This role is set at 0.0500 FTE and takes place in a French-language educational environment. Role overview The Specialized Teacher will help support students with a range of learning needs. The focus is on fostering an inclusive classroom where each student has the chance to succeed. Collaboration with colleagues is an important part of the work, with a shared commitment to educational growth. Key responsibilities Assist students who have diverse learning requirements Encourage a welcoming and inclusive atmosphere in the classroom Work closely with other educators as part of a team Position details Location: Vancouver Part-time schedule: 0.0500 FTE

The Conseil Scolaire Francophone de la Colombie-Britannique is seeking a Specialized Teacher for a part-time position in Vancouver. This role centers on supporting students with a range of learning needs and helping to create an environment where all learners feel included. Role overview This teaching position focuses on engaging students who benefit from specialized support. The work involves contributing to a culture where every student has the opportunity to succeed and participate fully in the classroom community. Key responsibilities Support students with diverse learning needs Help foster an inclusive and welcoming classroom environment Work collaboratively with colleagues to promote student growth Position details Part-time role Based in Vancouver

School District No. 93 (Conseil Scolaire Francophone de la Colombie-Britannique) is hiring an Orthopédagogue for a full-time role in Vancouver. This position focuses on providing specialized educational support for students who need additional assistance. What you will do Provide targeted support to students with special education needs Collaborate with colleagues to foster an inclusive learning environment Use specialized strategies to help students achieve their academic goals Location and schedule This role is based in Vancouver and is a 1.0 FTE (full-time equivalent) position.

Join Flagler Health, a dynamic healthtech innovator, as we revolutionize the delivery of healthcare services through cutting-edge AI-driven workflow automation, remote patient engagement, and comprehensive chronic care programs. Our platform has positively impacted over 1.5 million patients and is a trusted partner for healthcare providers and payers aiming to improve operational efficiency and patient outcomes while reducing costs. With a unique freemium model and limited competition, we are set to capture a significant portion of the $4.5 trillion U.S. healthcare market.Key ResponsibilitiesDatabricks Platform Expertise• Design, manage, and enhance data pipelines utilizing the Databricks platform.• Troubleshoot and debug Spark applications to ensure optimal performance and reliability.• Apply best practices in Spark computing and workload optimization.• Python Development• Write clean, efficient, and reusable Python code adhering to object-oriented principles.• Develop APIs to facilitate data integration and application functionality.• Create scripts and tools that automate data processing and workflows.MongoDB Management• Manage, query, and integrate data within MongoDB.• Ensure efficient data storage and retrieval tailored to application needs.• Optimize MongoDB's performance for handling large datasets.• Collaboration and Problem Solving• Collaborate closely with data scientists, analysts, and stakeholders to address data requirements and deliver effective solutions.• Identify and resolve technical challenges related to data processing and system architecture.

Conseil Scolaire Francophone de la Colombie-Britannique is hiring a part-time Orthopedic Educator to join its special education team in Vancouver. This position centers on supporting students who face learning challenges, helping them work toward their academic goals. Key Responsibilities Provide direct support to students who need specialized assistance in their learning process Use orthopedagogical techniques to foster student engagement and academic progress Work closely with teachers and special education professionals to tailor strategies for each student Requirements Background or training in orthopedagogy or special education Dedication to helping students with a range of learning needs Strong ability to collaborate within a multidisciplinary team