This role involves developing scalable web scrapers and back-end solutions for scraping and parsing challenges, as part of a team that handles significant data traffic and serves major global clients. The position requires expertise in Python and various scraping techniques.
Scraping & Automation Jobs
209 open roles at 123 companies building scrapers, crawlers, browser automation — and the systems that stop them.
The role is for a Senior Site Reliability Engineer at a company specializing in proxy and web data scraping solutions, where the engineer will manage and evolve the production infrastructure, ensuring high availability and driving observability.
The role involves patching a Chromium-based browser and collaborating with engineers to create a stealth-focused browser for web scraping solutions. The position requires expertise in C++ and knowledge of browser fingerprinting and anti-bot techniques.
This role involves developing scalable web scrapers and back-end solutions for scraping and parsing challenges, while maintaining the existing system and implementing new features.
The role of AI Engineer involves developing and optimizing AI services to enhance productivity for a team of developers, while managing the lifecycle of these services within a large-scale infrastructure that handles significant data traffic. The position requires ownership of problem statements from design to production, focusing on creating impactful internal tools.
This role is for a hands-on Web Scraping / Crawling Engineer with 3-5 years of experience in web scraping and browser automation, responsible for designing, developing, and maintaining scalable web crawling and data extraction systems.
The role is for a Mid-Senior Backend Developer specializing in Golang at a company that provides web data scraping solutions. The developer will work on high-load systems, manage APIs, and contribute to the technical direction of projects involving significant data traffic.

Apify is seeking a Fullstack Engineer to enhance the discovery experience on their platform, focusing on search, recommendations, and categorization of web automation tools. The role involves building user-facing features and backend services to improve how users and AI agents find relevant tools.

The Product Engineer - Agent role involves building and shipping developer-facing features that enable AI agents to navigate and act on the web, focusing on creating reliable APIs that enhance developer experience.

The Product Engineer at Firecrawl will develop and deliver document-parsing features that convert various document formats into structured data for AI applications, focusing on enhancing the developer experience and ensuring high-quality output.
Actowiz Solutions is seeking a skilled Python Web Scraping Engineer with at least 2 years of experience to design, deploy, and maintain scalable crawling spiders for data extraction from public sources, ensuring high-volume data extraction is clean and reliable.
NationGraph is seeking a Software Engineer specializing in Data Mining to develop systems for acquiring public-sector information from the internet at scale, focusing on building and maintaining a large fleet of scrapers.
The role is for a Lead Product Manager at ScrapingBee, focusing on shaping the product strategy, managing the product lifecycle, and understanding developer needs to drive growth and adoption of their scraping API.
This role involves building and managing a fleet of checkout robots that verify discount codes across various e-commerce platforms, ensuring accurate and efficient automation of the checkout process.
YipitData is looking for a Web Scraping Engineer to design, build, and maintain web scrapers that support critical reports and customer experiences. The role involves tackling complex scraping challenges and collaborating with cross-functional teams to ensure efficient data ingestion processes.
The role is for a Senior Golang Developer in a team that develops advanced proxy and web data scraping solutions. The position involves designing and building backend services, working with distributed systems, and contributing to a high-scale web scraping platform.
The role is for a Senior DevOps Engineer at a company specializing in proxy and web data scraping solutions, focusing on managing and optimizing a large-scale infrastructure with significant data traffic. Responsibilities include building scalable infrastructure, implementing monitoring solutions, and contributing to continuous improvement of technical practices.

The Machine Learning Engineer at Firecrawl will develop and deploy machine learning models for search ranking and relevance, oversee A/B testing, and collaborate with engineers to optimize data pipelines and model performance in production environments.

The Cloud DevOps Engineer at Firecrawl will design, build, and operate cloud infrastructure, focusing on Kubernetes, storage, and networking to support the company's web crawling and data extraction products. The role requires extensive experience in DevOps and cloud infrastructure management.
The role of Product Owner involves bridging business requirements and technical execution for a team developing web data scraping solutions, focusing on enhancing product capabilities for B2B clients. The position requires managing product backlogs, collaborating with development teams, and translating complex technical concepts into actionable user stories.
Wise is seeking a Senior Backend Engineer to develop and scale their price comparison platform, focusing on building robust scrapers and data pipelines to enhance competitive intelligence and data quality.
Mindrift is seeking a Python Data Scraping Engineer to work on the Tendem project, focusing on web scraping, data extraction, and processing to deliver high-quality datasets. This part-time remote role requires expertise in handling complex data workflows and ensuring data accuracy.
This role seeks an experienced Data Scraping Expert to collect large volumes of accurate business and contact data, primarily through data scraping techniques, while managing CRM and lead management as secondary tasks, at Reality Marble, a small investment-management team focused on backing the creator economy.
Mindrift is seeking a Senior Python Data Scraping Engineer to work on the Tendem project, focusing on web scraping, data extraction, and processing to deliver high-quality datasets from complex websites. This part-time remote role requires expertise in handling dynamic content and ensuring data accuracy.

Apify is seeking a Team Lead for the Universe team to build and scale web scraping tools that power AI applications, while also leading a small, cross-functional team and contributing to open-source projects.
The Platform Engineering Manager role at Oxylabs involves leading a team focused on maintaining and enhancing the company's infrastructure that supports web data scraping solutions for major businesses. Responsibilities include team leadership, managing operations, and influencing DevOps practices.
The role is for a Data Analyst at a company specializing in web data scraping solutions, where the candidate will analyze customer behavior and marketing data to support business decisions, while also creating self-service dashboards and utilizing analytical tools.
The role is for a Mobile Applications Developer at a company specializing in proxy and web data scraping solutions, where the candidate will work on creating and maintaining applications across multiple platforms while contributing to technical decisions and architecture.
The role involves reverse engineering anti-bot and fingerprinting systems, building automation tools and pipelines, and leveraging AI to enhance data extraction processes at Zyte.

The Product Engineer role at Firecrawl involves building and managing the Exchange system, which enables developers to monetize data partnerships through an API. The position requires a strong engineering background with experience in production data systems and a focus on developer experience.
The role is for a Mobile Applications Developer at a company specializing in proxy and web data scraping solutions, where the candidate will work on creating and maintaining applications across multiple platforms, contributing to technical decisions and enhancing user experience.
The Technical Content Specialist at ScrapingBee will manage the blog and website content pipeline, ensuring technical accuracy and clarity while collaborating with various teams to enhance the company's content operations and authority in the developer community.
The Senior Analytics Engineer role involves bridging engineering infrastructure and commercial decision-making, focusing on data modeling and automation to derive actionable insights from large datasets. The position requires advanced skills in dbt, SQL, and Python, and offers the opportunity to work with a team on scalable data solutions for a leading web data scraping company.
The Senior Web Scraping Engineer will be responsible for the reliability of a large-scale web data acquisition pipeline, ensuring system uptime and building resilient infrastructure to bypass anti-bot protections. The role requires proactive improvements and expertise in web scraping technologies.

The Success Engineer at Firecrawl is responsible for ensuring customer success by deepening product usage, solving technical issues, and managing account health throughout the customer lifecycle. This role requires a blend of technical expertise and customer-facing skills to drive adoption and expansion of the company's AI-driven data extraction solutions.

The Implementation Specialist at Firecrawl is responsible for onboarding customers by integrating their systems with Firecrawl's API, ensuring a smooth transition from purchase to production. This hands-on, customer-facing role requires technical expertise to diagnose issues and facilitate successful product launches.

The Sales Engineer at Firecrawl will act as a technical partner in the sales process, demonstrating the product's capabilities, architecting solutions, and addressing technical inquiries to facilitate deals. This role requires a blend of technical expertise and commercial acumen, reporting directly to the VP of Deployment.

The Forward Deployed Engineer at Firecrawl is responsible for integrating the company's web data extraction solutions into customer environments, addressing technical challenges, and ensuring successful adoption of the product. This role requires hands-on technical skills and customer-facing experience to drive product usage and expansion.
The Senior Data Acquisition & Automation Specialist will take ownership of data collection engines and automation pipelines, focusing on building and maintaining data extraction infrastructure while leading a future team. The role involves advanced data extraction using web scraping and AI integration.
The role involves designing and developing scalable web scraping systems for large-scale data extraction and brand protection, ensuring data quality and governance, and optimizing performance and reliability of scraping systems.
This role involves developing and maintaining asynchronous web crawlers and backend services using Rust, while ensuring the stability and adaptability of crawlers for authorized data sources. Responsibilities include handling pagination, rate limiting, retries, task scheduling, and data integrity issues.
The role involves developing complex data products, maintaining infrastructure, and handling large datasets while collaborating with cross-functional teams to understand customer needs and market trends.
The role is for a Lead Backend Developer at Oxylabs, focusing on leading a Dashboard squad while being hands-on in coding, particularly using PHP and Symfony. The position involves designing scalable systems, driving architecture decisions, and mentoring engineers during a significant architecture migration.
The Automation Engineer at Datawords will develop, maintain, and optimize web scraping and automation solutions using Python tools, collaborating with cross-functional teams to ensure project goals are met.
The role of Ecom Squad Lead involves leading a team responsible for delivering data solutions for AI, e-commerce, and advertising companies, while ensuring operational excellence and mentoring the next generation of scraping engineers.
The Head of Data, Analytics & AI will lead a multi-disciplinary team focused on data engineering and analytics, ensuring the data function supports business needs and drives competitive advantage through analytics and AI strategies.

The Senior Software Engineer at Firecrawl will be responsible for developing the monetization funnel, including pricing, plans, and conversion strategies, while leveraging full-stack engineering skills to drive revenue growth.

The Research Engineer - Evals role involves designing evaluation systems to measure the effectiveness of Firecrawl's data extraction capabilities across various websites, formats, and edge cases, while also generating datasets and establishing metrics for quality assessment.

The Backend Infrastructure Engineer at Firecrawl will focus on building and maintaining the infrastructure for reliable data collection, enhancing success rates against sites with aggressive defenses, and managing the proxy layer under heavy load.

The Product Engineer role at Firecrawl involves building and shipping developer-facing products that transform web data into structured formats for AI applications, focusing on reliability and user experience.

The Search Engineer role at Firecrawl involves designing and building systems for crawling, indexing, and retrieval to enhance their search product, focusing on performance and cost-efficiency at scale.
This role involves designing, developing, and maintaining back-end services and RESTful APIs using Node.js and TypeScript, while also working with PostgreSQL databases and contributing to AI-powered features for client-facing products in a data scraping company.
The role involves researching and testing AI agent tools and developer products, while maintaining a strong understanding of developer workflows and the AI tooling landscape. The position focuses on shaping the company's AI direction and ensuring product recommendations resonate with a technical audience.

Apify is seeking a Team Lead for their Universe team to build and scale web automation tools, particularly focusing on web scraping and AI integration, while leading a small team and contributing to open-source projects.
The role is for a Lead Backend Engineer who will work on developing and maintaining scalable proxy and web data scraping solutions, managing high-load APIs and big data challenges. The engineer will also mentor the development team and influence technical decision-making within a modern tech stack.
SearchApi is seeking a Ruby Engineer with expertise in browser automation and anti-bot evasion to develop and maintain their SERP API, which delivers structured data from various search engines. The role involves fixing parsers, building new integrations, and directly interacting with customers.
This role involves researching and implementing anti-bot evasion techniques, reverse engineering bot detection systems, and optimizing configurations for stealth in web scraping. The engineer will work on complex technical challenges related to bypassing protections and improving the company's scraping capabilities.
The role involves researching and implementing anti-bot evasion techniques, reverse engineering bot detection systems, and working with browser fingerprinting to bypass protections. The position is highly technical and requires deep expertise in web scraping and anti-bot technologies.
The role of GEO Specialist at Oxylabs involves enhancing the company's visibility in AI-driven search environments, focusing on execution and measurement while collaborating with various teams to improve AI discoverability and content structure. The position requires SEO fluency and a strong understanding of large language models and their implications for B2B marketing.
The role involves developing scalable web scrapers and backend solutions for scraping and parsing challenges, while maintaining the existing system and implementing new features. The team supports learning and sharing knowledge about building scrapers.