Senior Python Data Scraping Engineer (Freelance)

The Role: AI-Driven Data Architecture

Mindrift is looking for a freelance engineer to join the Tendem project, focusing on the high-level orchestration of web data pipelines. In this position, you won't just be writing boilerplate scripts; you will be designing sophisticated systems that pull structured intelligence from the messy, dynamic web. You will take full ownership of end-to-end extraction workflows, ensuring that the datasets fueling modern AI models are accurate, reliable, and perfectly formatted.

The Vibe Stack & Workflow

This role is tailor-made for developers who prefer leveraging high-level tools over manual coding. You will utilize a modern toolkit designed for automation and AI integration:

• AI Frameworks: Using LangChain and OpenRouter to build intelligent scraping logic.
• Automation Platforms: Leveraging Apify and custom Python workflows to scale collection.
• Dynamic Handling: Utilizing Selenium and API-based proxies to navigate JavaScript-heavy environments and bypass anti-bot measures.
• Infrastructure: Deploying with Docker and AWS to ensure your scraping agents run reliably at scale.

Why Join?

This is a remote-first, flexible opportunity that rewards technical creativity and efficiency. You will be at the forefront of the 'vibe coding' movement, using LLMs to solve non-trivial engineering problems and refine the data that powers the next generation of artificial intelligence. It is a high-impact role where your ability to prompt, automate, and validate matters more than the number of lines you type manually.