company

Senior Python Data Scraping Engineer (Freelance)

MindriftRemote — Glasgow, Scotland, United Kingdom
Remote Part-time $37/hr - $37/hr

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Senior

Qualifications

Minimum of 5 years of relevant experience in data engineering, web scraping, automation, or software development (required). Bachelor's or Master’s degree in Engineering, Applied Mathematics, Computer Science, or related technical fields is advantageous. Proficiency in Python web scraping technologies such as BeautifulSoup, Selenium, or similar tools, including experience with dynamic content extraction.

About the job

Mindrift is hiring a Senior Python Data Scraping Engineer for a freelance, remote role based in Glasgow, Scotland, United Kingdom. This position focuses on the Tendem project and involves guiding data extraction workflows as an AI Pilot. The work is part-time and designed for professionals with strong experience in web scraping, data extraction, and data processing.

Role Overview

This role centers on overseeing the full data extraction process from complex websites. The Senior Python Data Scraping Engineer will collaborate with Tendem Agents, who manage repetitive tasks, while taking responsibility for the technical direction and quality of data workflows.

What You Will Do

  • Manage end-to-end extraction of structured datasets from a range of complex web sources, ensuring accuracy and timely completion.
  • Utilize internal tools such as Apify and OpenRouter, and apply custom strategies to improve efficiency in data collection and validation.
  • Adjust scraping techniques for dynamic and JavaScript-heavy websites with varying structures.
  • Conduct thorough validation to maintain high data quality, ensuring consistency and correct formatting across all sources.
  • Scale data operations by batching or parallelizing tasks, monitor for failures, and respond to minor changes in website layouts.

Compensation

Freelance contributors on this project can earn up to $37 per hour, depending on experience and pace. Actual rates may vary based on project scope, complexity, and required expertise.

About Mindrift

Mindrift connects skilled professionals with innovative AI projects from major technology companies, aiming to unlock the potential of Generative AI through real-world expertise.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.