About the job
Join Mindrift as a Freelance Python Data Scraping Engineer, where you'll be pivotal in the Tendem project, orchestrating sophisticated data scraping workflows within our innovative hybrid AI and human system.
In this role, referred to as an AI Pilot at Mindrift, you will work in tandem with Tendem Agents who manage repetitive tasks. Your role will focus on applying your critical thinking, domain expertise, and quality control skills to ensure the delivery of accurate and actionable results.
This part-time remote opportunity is perfect for technical professionals with a solid background in web scraping, data extraction, and processing.
About Mindrift
Mindrift connects specialists with groundbreaking AI projects from leading tech innovators. Our mission is to unleash the potential of Generative AI by leveraging real-world expertise from around the globe.
Role Overview
This freelance position involves executing data scraping tasks that demand technical precision for web extraction and processing. You will utilize various tools, including Apify and OpenRouter, alongside your creative problem-solving methods.
Key Responsibilities
- Manage end-to-end data extraction workflows across complex websites, ensuring comprehensive coverage, accuracy, and reliable delivery of structured datasets.
- Utilize internal tools (Apify, OpenRouter) along with custom workflows to expedite data collection, validation, and task execution while adhering to defined requirements.
- Ensure dependable extraction from dynamic and interactive web sources, adjusting strategies as necessary to accommodate JavaScript-rendered content and evolving site behaviors.
- Implement data quality standards through validation checks, cross-source consistency controls, adherence to formatting specifications, and systematic verification prior to delivery.
- Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability amidst minor site structure changes.
Compensation
Contributors to this project can earn up to $32 per hour, depending on their contribution level and pace. Compensation may vary across different projects based on scope, complexity, and expertise required.
How to Apply
Apply to this posting, qualify, and seize the opportunity to engage in projects that align with your technical skills on your own schedule. From coding and automation to fine-tuning AI outputs, your role will be instrumental in advancing AI capabilities and real-world applications.
Requirements
- A minimum of 3 years of relevant experience in data engineering, web scraping, automation, or a related field.
