Senior Python Data Scraping Engineer (Freelance)

The Opportunity

Join the Tendem project at Mindrift as a freelance Senior Python Data Scraping Engineer. In this remote position, you will design and manage sophisticated end-to-end data extraction pipelines that power modern AI technologies. Instead of just writing basic scripts, you'll be building intelligent systems that can navigate complex web architectures and provide high-quality datasets for real-world applications.

Technical Vibe

This isn't your standard scraping job; it's built for the modern developer who leverages AI to work faster. You'll work with a stack designed for automation and intelligence, including:

• AI Integration: Utilizing LangChain and OpenRouter for smarter automation.
• Python Power: Mastering BeautifulSoup and Selenium alongside modern APIs.
• Cloud & Containers: Deploying scalable solutions via AWS and Docker.
• Acceleration Tools: Using Apify to streamline data collection and validation.

Impact & Growth

As a technical professional with over 5 years of experience, you’ll have the autonomy to solve non-trivial problems and bypass advanced anti-bot mechanisms. You will play a crucial role in ensuring data accuracy and consistency, directly influencing the quality of the AI tools Mindrift develops. This role offers the flexibility of freelance work (10-20 hours per week) while keeping you at the cutting edge of AI-assisted engineering and large-scale data processing.