Senior Python Data Scraping Engineer (Freelance)

The Role

As a Senior Data Engineer on the Tendem project, you will architect sophisticated data extraction pipelines that bridge the gap between traditional web scraping and AI-powered processing. This freelance position focuses on building end-to-end workflows that transform messy web data into structured, high-quality intelligence using a mix of custom scripts and modern AI tools.

Technical Integration

This project is built for the modern era of development, moving beyond simple BeautifulSoup scripts to incorporate LangChain and OpenRouter for intelligent data parsing. You will utilize Python, Apify, and Selenium to navigate complex site architectures, while deploying your solutions via Docker and AWS. The focus is on using AI-assisted logic to solve non-trivial extraction problems and bypass sophisticated anti-bot mechanisms.

What You Will Achieve

• Orchestrate AI Pipelines: Use LLMs to automate the cleaning, normalization, and validation of large-scale datasets.
• Scalable Automation: Build and manage parallelized scraping operations that remain stable despite frequent website changes.
• Modern Workflow: Experience a remote-first, flexible environment that explicitly values 'vibe coding'—using the best AI tools available to deliver results faster and more accurately.