Senior Python Data Scraping Engineer (Freelance)

The Opportunity

Mindrift is looking for senior freelance engineers to join the Tendem project, focusing on architecting sophisticated data extraction pipelines. This isn't just about writing scripts; it's about building intelligent, resilient systems that can navigate the complexities of the modern web. You will take ownership of end-to-end workflows, transforming messy, dynamic web content into high-quality, structured datasets for AI development.

The Vibe Stack

This role sits at the intersection of traditional data engineering and the new AI-first development paradigm. You will utilize Python and standard libraries like BeautifulSoup and Selenium, but the real power comes from integrating modern AI tools. By leveraging Apify, OpenRouter, and LangChain, you'll create automated processes that handle JavaScript-heavy sites and sophisticated anti-bot measures with ease.

Growth and Requirements

As a senior contributor, you'll need at least five years of experience in data automation and a mastery of cloud infrastructure like AWS and Docker. This project offers the chance to pioneer 'vibe coding' techniques in a professional setting, where your ability to troubleshoot independently and apply LLM frameworks to automation tasks will be the key to scaling operations. This is a remote, part-time engagement (10–20 hours/week) designed for engineers who want to stay on the cutting edge of AI-driven development.