Web Scraping Engineer

Job Description

Volix is a technology consultancy specialized in smart pricing and advanced AI. We combine strategic consulting and cutting-edge technology to help large companies maximize profitability, efficiency, and competitiveness — we have generated over R$ 50MM in EBITDA for our clients and analyze over 500 million prices per month.

Our products include automatic price monitoring (MAP), AI-driven quote automation (QuoteGPT), algorithmic pricing, and predictive analytics.

Senior Web Scraping Engineer

About the Role

You will architect and maintain data collection pipelines at scale, dealing with the real complexities of the web: CAPTCHAs, rate limits, anti-bots, layout changes, and dynamic sites. You will work closely with the data and product team to ensure that information arrives clean, on time, and with high availability.

What You Will Do

• Develop and maintain robust scrapers with Python (Scrapy, Playwright, Selenium, or similar)
• Orchestrate data collection pipelines ensuring monitoring, alerts, and reprocessing
• Manage the infrastructure of the pipelines (containers, queues, proxies, storage)
• Handle anti-scraping mechanisms: proxy rotation, fingerprint evasion, Akamai, and intelligent rate limiting
• Document, version, and ensure the quality of the collected data

Requirements

• Advanced Python (minimum of 5 years)
• Docker & Kubernetes
• Cloud (AWS, GCP, or Azure)
• Scrapy / Playwright / Selenium
• SQL and databases
• Proven experience with scraping projects in production (portfolio or cases are welcome)

Differentials (not mandatory)

• Knowledge of observability tools (Grafana, Datadog, etc.)
• Familiarity with parsing unstructured data and basic NLP
• Knowledge in back-end (Django or FastAPI)

What We Offer

• Startup environment with a direct impact on the product
• Senior technical team and solid engineering culture

Criteria

• Experience Level: Mid-Senior
• Employment Type: Full-time
• Function: Engineering
• Industries: IT project services