About the job
The Data Engineering Intern will play a vital role in supporting AccuWeather’s data engineering team. This position focuses on developing and automating systems that improve data accessibility, reliability, and documentation. The intern will contribute to innovative projects aimed at enhancing AccuWeather's data infrastructure, engaging in automation initiatives, and investigating AI-driven solutions. Under the mentorship of seasoned data engineers, this internship offers hands-on experience with tools such as Databricks, Spark, and Azure, aligning with AccuWeather’s operational and business objectives.
KEY RESPONSIBILITIES
- Assist in the development and maintenance of data pipelines utilizing Databricks, Spark, and related technologies.
- Craft and optimize SQL and Python scripts to facilitate data transformation, integration, and automation tasks.
- Create automation scripts that enhance metadata documentation across Databricks tables using structured definitions (e.g., CSV files).
- Help in the construction of a proof-of-concept (POC) for an automated data dictionary that utilizes existing Databricks metadata.
- Contribute to the prototyping of an AI-powered knowledge agent designed to leverage internal data and documentation for answering common inquiries.
- Collaborate with team members to improve data quality, cataloging, and metadata management across the data ecosystem.
- Engage in code reviews, design discussions, and sprint ceremonies to adopt engineering best practices.
- Document findings, workflows, and automation processes for future reference.
- Undertake additional tasks as assigned.

