209 open roles at 123 companies building scrapers, crawlers, browser automation — and the systems that stop them.
This role involves developing scalable web scrapers and back-end solutions for scraping and parsing challenges, as part of a team that handles significant data traffic and serves major global clients. The position requires expertise in Python and various scraping techniques.
The role is for a Senior Site Reliability Engineer at a company specializing in proxy and web data scraping solutions, where the engineer will manage and evolve the production infrastructure, ensuring high availability and driving observability.
The role involves patching a Chromium-based browser and collaborating with engineers to create a stealth-focused browser for web scraping solutions. The position requires expertise in C++ and knowledge of browser fingerprinting and anti-bot techniques.
This role involves developing scalable web scrapers and back-end solutions for scraping and parsing challenges, while maintaining the existing system and implementing new features.
The role of AI Engineer involves developing and optimizing AI services to enhance productivity for a team of developers, while managing the lifecycle of these services within a large-scale infrastructure that handles significant data traffic. The position requires ownership of problem statements from design to production, focusing on creating impactful internal tools.
This role is for a hands-on Web Scraping / Crawling Engineer with 3-5 years of experience in web scraping and browser automation, responsible for designing, developing, and maintaining scalable web crawling and data extraction systems.
The role is for a Mid-Senior Backend Developer specializing in Golang at a company that provides web data scraping solutions. The developer will work on high-load systems, manage APIs, and contribute to the technical direction of projects involving significant data traffic.
Apify is seeking a Fullstack Engineer to enhance the discovery experience on their platform, focusing on search, recommendations, and categorization of web automation tools. The role involves building user-facing features and backend services to improve how users and AI agents find relevant tools.
The Product Engineer - Agent role involves building and shipping developer-facing features that enable AI agents to navigate and act on the web, focusing on creating reliable APIs that enhance developer experience.
The Product Engineer at Firecrawl will develop and deliver document-parsing features that convert various document formats into structured data for AI applications, focusing on enhancing the developer experience and ensuring high-quality output.
Actowiz Solutions is seeking a skilled Python Web Scraping Engineer with at least 2 years of experience to design, deploy, and maintain scalable crawling spiders for data extraction from public sources, ensuring high-volume data extraction is clean and reliable.
NationGraph is seeking a Software Engineer specializing in Data Mining to develop systems for acquiring public-sector information from the internet at scale, focusing on building and maintaining a large fleet of scrapers.
The role is for a Lead Product Manager at ScrapingBee, focusing on shaping the product strategy, managing the product lifecycle, and understanding developer needs to drive growth and adoption of their scraping API.
This role involves building and managing a fleet of checkout robots that verify discount codes across various e-commerce platforms, ensuring accurate and efficient automation of the checkout process.
YipitData is looking for a Web Scraping Engineer to design, build, and maintain web scrapers that support critical reports and customer experiences. The role involves tackling complex scraping challenges and collaborating with cross-functional teams to ensure efficient data ingestion processes.
The role is for a Senior Golang Developer in a team that develops advanced proxy and web data scraping solutions. The position involves designing and building backend services, working with distributed systems, and contributing to a high-scale web scraping platform.
The role is for a Senior DevOps Engineer at a company specializing in proxy and web data scraping solutions, focusing on managing and optimizing a large-scale infrastructure with significant data traffic. Responsibilities include building scalable infrastructure, implementing monitoring solutions, and contributing to continuous improvement of technical practices.
The Machine Learning Engineer at Firecrawl will develop and deploy machine learning models for search ranking and relevance, oversee A/B testing, and collaborate with engineers to optimize data pipelines and model performance in production environments.
The Cloud DevOps Engineer at Firecrawl will design, build, and operate cloud infrastructure, focusing on Kubernetes, storage, and networking to support the company's web crawling and data extraction products. The role requires extensive experience in DevOps and cloud infrastructure management.
The role of Product Owner involves bridging business requirements and technical execution for a team developing web data scraping solutions, focusing on enhancing product capabilities for B2B clients. The position requires managing product backlogs, collaborating with development teams, and translating complex technical concepts into actionable user stories.
Wise is seeking a Senior Backend Engineer to develop and scale their price comparison platform, focusing on building robust scrapers and data pipelines to enhance competitive intelligence and data quality.
Mindrift is seeking a Python Data Scraping Engineer to work on the Tendem project, focusing on web scraping, data extraction, and processing to deliver high-quality datasets. This part-time remote role requires expertise in handling complex data workflows and ensuring data accuracy.
This role seeks an experienced Data Scraping Expert to collect large volumes of accurate business and contact data, primarily through data scraping techniques, while managing CRM and lead management as secondary tasks, at Reality Marble, a small investment-management team focused on backing the creator economy.
Mindrift is seeking a Senior Python Data Scraping Engineer to work on the Tendem project, focusing on web scraping, data extraction, and processing to deliver high-quality datasets from complex websites. This part-time remote role requires expertise in handling dynamic content and ensuring data accuracy.
Apify is seeking a Team Lead for the Universe team to build and scale web scraping tools that power AI applications, while also leading a small, cross-functional team and contributing to open-source projects.
The Platform Engineering Manager role at Oxylabs involves leading a team focused on maintaining and enhancing the company's infrastructure that supports web data scraping solutions for major businesses. Responsibilities include team leadership, managing operations, and influencing DevOps practices.
The role is for a Data Analyst at a company specializing in web data scraping solutions, where the candidate will analyze customer behavior and marketing data to support business decisions, while also creating self-service dashboards and utilizing analytical tools.
The role is for a Mobile Applications Developer at a company specializing in proxy and web data scraping solutions, where the candidate will work on creating and maintaining applications across multiple platforms while contributing to technical decisions and architecture.
The role involves reverse engineering anti-bot and fingerprinting systems, building automation tools and pipelines, and leveraging AI to enhance data extraction processes at Zyte.
The Product Engineer role at Firecrawl involves building and managing the Exchange system, which enables developers to monetize data partnerships through an API. The position requires a strong engineering background with experience in production data systems and a focus on developer experience.
The role is for a Mobile Applications Developer at a company specializing in proxy and web data scraping solutions, where the candidate will work on creating and maintaining applications across multiple platforms, contributing to technical decisions and enhancing user experience.
The Technical Content Specialist at ScrapingBee will manage the blog and website content pipeline, ensuring technical accuracy and clarity while collaborating with various teams to enhance the company's content operations and authority in the developer community.
The Senior Analytics Engineer role involves bridging engineering infrastructure and commercial decision-making, focusing on data modeling and automation to derive actionable insights from large datasets. The position requires advanced skills in dbt, SQL, and Python, and offers the opportunity to work with a team on scalable data solutions for a leading web data scraping company.
The Senior Web Scraping Engineer will be responsible for the reliability of a large-scale web data acquisition pipeline, ensuring system uptime and building resilient infrastructure to bypass anti-bot protections. The role requires proactive improvements and expertise in web scraping technologies.
The Success Engineer at Firecrawl is responsible for ensuring customer success by deepening product usage, solving technical issues, and managing account health throughout the customer lifecycle. This role requires a blend of technical expertise and customer-facing skills to drive adoption and expansion of the company's AI-driven data extraction solutions.
The Implementation Specialist at Firecrawl is responsible for onboarding customers by integrating their systems with Firecrawl's API, ensuring a smooth transition from purchase to production. This hands-on, customer-facing role requires technical expertise to diagnose issues and facilitate successful product launches.
The Sales Engineer at Firecrawl will act as a technical partner in the sales process, demonstrating the product's capabilities, architecting solutions, and addressing technical inquiries to facilitate deals. This role requires a blend of technical expertise and commercial acumen, reporting directly to the VP of Deployment.
The Forward Deployed Engineer at Firecrawl is responsible for integrating the company's web data extraction solutions into customer environments, addressing technical challenges, and ensuring successful adoption of the product. This role requires hands-on technical skills and customer-facing experience to drive product usage and expansion.
The Senior Data Acquisition & Automation Specialist will take ownership of data collection engines and automation pipelines, focusing on building and maintaining data extraction infrastructure while leading a future team. The role involves advanced data extraction using web scraping and AI integration.
The role involves designing and developing scalable web scraping systems for large-scale data extraction and brand protection, ensuring data quality and governance, and optimizing performance and reliability of scraping systems.
This role involves developing and maintaining asynchronous web crawlers and backend services using Rust, while ensuring the stability and adaptability of crawlers for authorized data sources. Responsibilities include handling pagination, rate limiting, retries, task scheduling, and data integrity issues.
The role involves developing complex data products, maintaining infrastructure, and handling large datasets while collaborating with cross-functional teams to understand customer needs and market trends.
The role is for a Lead Backend Developer at Oxylabs, focusing on leading a Dashboard squad while being hands-on in coding, particularly using PHP and Symfony. The position involves designing scalable systems, driving architecture decisions, and mentoring engineers during a significant architecture migration.
The Automation Engineer at Datawords will develop, maintain, and optimize web scraping and automation solutions using Python tools, collaborating with cross-functional teams to ensure project goals are met.
The role of Ecom Squad Lead involves leading a team responsible for delivering data solutions for AI, e-commerce, and advertising companies, while ensuring operational excellence and mentoring the next generation of scraping engineers.
The Head of Data, Analytics & AI will lead a multi-disciplinary team focused on data engineering and analytics, ensuring the data function supports business needs and drives competitive advantage through analytics and AI strategies.
The Senior Software Engineer at Firecrawl will be responsible for developing the monetization funnel, including pricing, plans, and conversion strategies, while leveraging full-stack engineering skills to drive revenue growth.
The Research Engineer - Evals role involves designing evaluation systems to measure the effectiveness of Firecrawl's data extraction capabilities across various websites, formats, and edge cases, while also generating datasets and establishing metrics for quality assessment.
The Backend Infrastructure Engineer at Firecrawl will focus on building and maintaining the infrastructure for reliable data collection, enhancing success rates against sites with aggressive defenses, and managing the proxy layer under heavy load.
The Product Engineer role at Firecrawl involves building and shipping developer-facing products that transform web data into structured formats for AI applications, focusing on reliability and user experience.
The Search Engineer role at Firecrawl involves designing and building systems for crawling, indexing, and retrieval to enhance their search product, focusing on performance and cost-efficiency at scale.
This role involves designing, developing, and maintaining back-end services and RESTful APIs using Node.js and TypeScript, while also working with PostgreSQL databases and contributing to AI-powered features for client-facing products in a data scraping company.
The role involves researching and testing AI agent tools and developer products, while maintaining a strong understanding of developer workflows and the AI tooling landscape. The position focuses on shaping the company's AI direction and ensuring product recommendations resonate with a technical audience.
Apify is seeking a Team Lead for their Universe team to build and scale web automation tools, particularly focusing on web scraping and AI integration, while leading a small team and contributing to open-source projects.
The role is for a Lead Backend Engineer who will work on developing and maintaining scalable proxy and web data scraping solutions, managing high-load APIs and big data challenges. The engineer will also mentor the development team and influence technical decision-making within a modern tech stack.
SearchApi is seeking a Ruby Engineer with expertise in browser automation and anti-bot evasion to develop and maintain their SERP API, which delivers structured data from various search engines. The role involves fixing parsers, building new integrations, and directly interacting with customers.
This role involves researching and implementing anti-bot evasion techniques, reverse engineering bot detection systems, and optimizing configurations for stealth in web scraping. The engineer will work on complex technical challenges related to bypassing protections and improving the company's scraping capabilities.
The role involves researching and implementing anti-bot evasion techniques, reverse engineering bot detection systems, and working with browser fingerprinting to bypass protections. The position is highly technical and requires deep expertise in web scraping and anti-bot technologies.
The role of GEO Specialist at Oxylabs involves enhancing the company's visibility in AI-driven search environments, focusing on execution and measurement while collaborating with various teams to improve AI discoverability and content structure. The position requires SEO fluency and a strong understanding of large language models and their implications for B2B marketing.
The role involves developing scalable web scrapers and backend solutions for scraping and parsing challenges, while maintaining the existing system and implementing new features. The team supports learning and sharing knowledge about building scrapers.
The role is for a Senior Site Reliability Engineer at a company specializing in proxy and web data scraping solutions, focusing on maintaining and evolving their production infrastructure, including migrating to Kubernetes and ensuring high availability across services.
As a Security Researcher, you will simulate advanced adversaries against data collection products, focusing on web application security and machine learning data collection methods to enhance the Bright Data platform -- Bright Data's web-data infrastructure powers AI and business intelligence for more than 20,000 clients worldwide.
The role is for a Senior Backend Engineer who will design and build new backend services and product endpoints for a web scraping platform, focusing on high-scale solutions and utilizing AI tools in their development process.
Mercado Libre is seeking an expert in Scraping & Information Security to lead the development of resilient, privacy-first, and AI-powered systems for enhancing strategic intelligence capabilities, focusing on web data extraction and information protection.
The Head of Product & Growth will lead the launch and market positioning of a new product, focusing on growth strategies, customer acquisition, and collaboration with various teams to drive sustainable growth in a web data gathering solutions company.
The role is for a Technical Product Manager in the Data Search & AI squad, focusing on developing AI-driven search products and managing product strategy, evaluation, and customer discovery related to data querying. The position involves collaboration with cross-functional teams and requires a strong understanding of AI and machine learning.
The role involves managing the Data Product roadmap, designing multi-source datasets, and integrating machine learning capabilities while ensuring data quality from a customer perspective. The position requires strong product management skills, technical fluency, and collaboration with cross-functional teams.
The role is for a Product Manager at Oxylabs, focusing on the development and growth of their Web Scraper API product portfolio, which includes defining product vision, collaborating with engineering, and engaging with enterprise clients to enhance API usability and adoption.
The role is for a Product Manager at Oxylabs, focusing on developing AI-native products and exploring new opportunities in the AI landscape. The position involves creating new product concepts, driving AI product strategy, and ensuring that AI capabilities address real user problems.
This role seeks a highly skilled technical expert in web data extraction resilience, focusing on overcoming complex blocking challenges and ensuring reliable data extraction from dynamic web environments.
Apify is seeking a backend developer to join their team, responsible for running Actors, managing storage, and ensuring the deployment of applications on AWS infrastructure, while collaborating with a cross-functional team.
The Web Scraping Engineer role involves building, maintaining, and optimizing web scraping systems while investigating anti-bot detection systems and collaborating with product teams to address scraping failures. The ideal candidate has extensive experience in production-level scraping and a strong understanding of anti-bot techniques.
As a Senior Anti-Bot Engineer at Adthena, you will design and maintain large-scale web scraping systems focused on Google and similar platforms, addressing complex scraping challenges and ensuring data accuracy and reliability.
Exa is seeking a Web Crawler engineer to build and optimize a large-scale web crawling system capable of processing over 100 million pages per day, focusing on advanced crawling techniques and handling dynamic content.
Kpler is seeking a Data Engineer to enhance their Natural Gas product by scaling data sources, developing analytics, and maintaining data scrapers. The role involves collaboration with software engineers and market analysts to ensure data quality and performance.
The role involves designing, developing, and maintaining internal systems and RESTful APIs, with a focus on developing advanced web scraping tools and analyzing data flows to support business decisions.
The role involves hiring an Automation Developer to expand and operate a social automation and outreach platform for web3 growth, focusing on automated engagement campaigns and lead generation.
Car.info is seeking a high-level PHP developer to take ownership of external data flows, drive scraping initiatives, and develop the engine behind their data platform, focusing on automating the retrieval, processing, and structuring of large amounts of information from various sources and APIs.
This role involves data collection, structuring, and information extraction to meet data quality goals, while collaborating with various teams to improve data quality. The candidate will also explore and implement advanced technologies alongside a mentor or team leader.
This role involves web data scraping, cleaning, parsing, and storage, requiring proficiency in Python and familiarity with JavaScript and FastAPI. The candidate will also work with databases and various scraping technologies, including anti-scraping techniques.
Car Info Nordic AB is seeking a high-level PHP developer to take ownership of external data flows, drive scraping efforts, and develop the engine behind their data platform, focusing on automating the retrieval, processing, and structuring of large amounts of information from various sources and APIs.
As a Data Scraping Engineer at Moojing Market Intelligence, you will design, develop, and maintain web crawlers and scrapers, collaborating with project managers and ensuring the crawler system operates smoothly.
The role involves architecting and maintaining data collection pipelines at scale, addressing real web complexities such as CAPTCHAs and anti-bot measures. The engineer will work closely with data and product teams to ensure timely and clean data delivery.
This role involves building and operating large-scale web crawling systems to continuously collect and process content from the internet, directly impacting AI model performance, at Reflection, a research lab founded by former DeepMind, OpenAI, and Anthropic researchers working to make frontier AI open and accessible.
The role involves working as a Python Developer within the scraping team, focusing on optimizing data collection through the design and implementation of robust Scrapy spiders, conducting code reviews, and developing sophisticated web crawling solutions.
The role is for a Data Acquisition Engineer in the Internal Security Department, focusing on building platforms that collect and process structured data from various online sources, utilizing software engineering, browser automation, and AI.
Deepki is seeking a Software Engineer to develop and maintain their data collection platform, ensuring reliable and automated data consumption for clients. The role involves working with a multidisciplinary team to optimize data pipelines and enhance the overall system architecture.
The role is for a senior Back-End Software Engineer focused on building and scaling high-performance web scanning and data ingestion systems, involving the design and operation of distributed services that crawl, scrape, process, and store large volumes of web data.
This role involves contributing to the development and maintenance of a fleet of web crawlers for automated large-scale data collection, as well as participating in the migration of the existing ecosystem to a new Python-based platform using Scrapy.
The role is for a Full Stack Engineer who will design and develop scalable automation applications, focusing on web scraping and data processing, while collaborating with cross-functional teams.
Krawlnet Technologies is seeking a Web Scraping Engineer to design and operate web data acquisition systems, focusing on overcoming anti-bot challenges and ensuring data accuracy at scale.
OpenAI is seeking a skilled Software Engineer to join their Data Acquisition team, responsible for data collection to support model training operations, including web crawling and data ingestion.
The Data Engineer will build and maintain web-crawling solutions to collect high-quality data from websites, collaborating with various teams and ensuring reliable data collection through automated scripts.
Delectatech is seeking a Data Crawler Specialist to manage and enhance their production crawling system, focusing on complex data extraction from various sources while ensuring operational efficiency and resolving daily issues.
The role involves building and operating large-scale data ingestion systems for AI model training, focusing on web crawling and data extraction, while collaborating with researchers to enhance model performance.
This role involves web data scraping, cleaning, parsing, and storage, requiring proficiency in Python and familiarity with JavaScript and FastAPI. The candidate will also work with various databases and scraping technologies, including anti-scraping techniques.
iCapital is seeking an experienced Python Developer to design and implement advanced web scraping solutions using tools like Playwright and AWS. The role involves automating interactions with complex web applications and managing scalable scraping tasks.
McKesson is seeking a Senior Software Engineer to design, develop, and maintain complex software solutions, focusing on scalable data pipelines and web crawlers using Scrapy and Python.
This role involves web data scraping, cleaning, parsing, and storage, requiring proficiency in Python and familiarity with JavaScript and FastAPI. The candidate will also work with databases and various scraping technologies, including anti-scraping techniques.
The Data Engineer I role at Dun & Bradstreet involves supporting Research and Managed Services through coding, automation, and operational tasks, while evaluating data sources for AI workflows.
