This role involves developing scalable web scrapers and back-end solutions for scraping and parsing challenges, as part of a team that handles significant data traffic and serves major global clients. The position requires expertise in Python and various scraping techniques.
Scraping & Automation Jobs
269 open roles at 164 companies building scrapers, crawlers, browser automation — and the systems that stop them.
The role involves patching a Chromium-based browser and collaborating with engineers to create a stealth-focused browser for web scraping solutions. The position requires expertise in C++ and knowledge of browser fingerprinting and anti-bot techniques.
This role is for a hands-on Web Scraping / Crawling Engineer with 3-5 years of experience in web scraping and browser automation, responsible for designing, developing, and maintaining scalable web crawling and data extraction systems.
YipitData is looking for a Web Scraping Engineer to design, build, and maintain web scrapers that support critical reports and customer experiences. The role involves tackling complex scraping challenges and collaborating with cross-functional teams to ensure efficient data ingestion processes.
This role seeks an experienced Data Scraping Expert to collect large volumes of accurate business and contact data, primarily through data scraping techniques, while managing CRM and lead management as secondary tasks, at Reality Marble, a small investment-management team focused on backing the creator economy.
The role involves reverse engineering anti-bot and fingerprinting systems, building automation tools and pipelines, and leveraging AI to enhance data extraction processes at Zyte.
The Technical Content Specialist at ScrapingBee will manage the blog and website content pipeline, ensuring technical accuracy and clarity while collaborating with various teams to enhance the company's content operations and authority in the developer community.
The Senior Web Scraping Engineer will be responsible for the reliability of a large-scale web data acquisition pipeline, ensuring system uptime and building resilient infrastructure to bypass anti-bot protections. The role requires proactive improvements and expertise in web scraping technologies.
SearchApi is seeking a Ruby Engineer with expertise in browser automation and anti-bot evasion to develop and maintain their SERP API, which delivers structured data from various search engines. The role involves fixing parsers, building new integrations, and directly interacting with customers.
The role involves researching and implementing anti-bot evasion techniques, reverse engineering bot detection systems, and working with browser fingerprinting to bypass protections. The position is highly technical and requires deep expertise in web scraping and anti-bot technologies.
This role involves researching and implementing anti-bot evasion techniques, reverse engineering bot detection systems, and optimizing configurations for stealth in web scraping. The engineer will work on complex technical challenges related to bypassing protections and improving the company's scraping capabilities.
The role is for a Senior Site Reliability Engineer at a company specializing in proxy and web data scraping solutions, focusing on maintaining and evolving their production infrastructure, including migrating to Kubernetes and ensuring high availability across services.
As a Security Researcher, you will simulate advanced adversaries against data collection products, focusing on web application security and machine learning data collection methods to enhance the Bright Data platform -- Bright Data's web-data infrastructure powers AI and business intelligence for more than 20,000 clients worldwide.
The Web Scraping Engineer role involves building, maintaining, and optimizing web scraping systems while investigating anti-bot detection systems and collaborating with product teams to address scraping failures. The ideal candidate has extensive experience in production-level scraping and a strong understanding of anti-bot techniques.
As a Senior Anti-Bot Engineer at Adthena, you will design and maintain large-scale web scraping systems focused on Google and similar platforms, addressing complex scraping challenges and ensuring data accuracy and reliability.
The role involves hiring an Automation Developer to expand and operate a social automation and outreach platform for web3 growth, focusing on automated engagement campaigns and lead generation.
The role is for a senior Back-End Software Engineer focused on building and scaling high-performance web scanning and data ingestion systems, involving the design and operation of distributed services that crawl, scrape, process, and store large volumes of web data.
Delectatech is seeking a Data Crawler Specialist to manage and enhance their production crawling system, focusing on complex data extraction from various sources while ensuring operational efficiency and resolving daily issues.
Alternative Path is looking for a Business Analyst specializing in web scraping to collaborate with a US-based hedge fund, focusing on delivering high-quality datasets that support investment decisions. The role involves client interaction, technical data validation, and process innovation.
As an AI Engineer at Blacksmith Agency, you will be responsible for building and shipping internal automation systems based on a documented roadmap, focusing on integrating AI technologies into workflows.
The role involves owning the data pipelines that scrape, normalize, and land transaction and listing data from external marketplaces to support real-time pricing for trading cards. Responsibilities include designing and optimizing the ingestion layer, building monitoring systems, and collaborating with various teams to ensure data quality.
Blacksmith Agency is seeking an AI Automation Engineer to build and implement automation workflows using various frameworks and APIs, focusing on production systems rather than model training.
As an Automation Engineer at Blacksmith Agency, you will be responsible for building and shipping internal automation systems based on a documented roadmap, working directly with engineering and delivery leadership.
The AI Automation Engineer at BairesDev will architect scalable web scraping pipelines and build generative AI agents to automate business processes, utilizing advanced Python skills and systems integration expertise.
The AI Automation Engineer at BairesDev will architect scalable web scraping pipelines and build generative AI agents to automate business processes, leveraging advanced Python skills and systems integration expertise.
The GTM Engineer at HyperOrbit will build systems and automation to enhance the company's go-to-market strategies, integrating engineering, sales, and AI to optimize customer engagement and revenue generation.
GlobalLogic is seeking a Software Engineer with expertise in web technologies and data extraction to develop and maintain web scrapers for automating browser interactions and ensuring high-quality data delivery for web intelligence projects -- a Hitachi Group company that's been a digital engineering partner to major brands since 2000.
The role involves building scalable data infrastructure and tools for the Teamwear business, focusing on data pipelines, algorithms, and data quality management.
REPS & Co. is looking for a Senior Fullstack Engineer to deliver high-quality software and collaborate with teammates in a fast-paced environment, focusing on data analytics in the entertainment industry.
Cohere is seeking a Senior Member of Technical Staff to develop a large-scale web data pipeline for their advanced language models, focusing on transforming raw internet data into high-quality training data.
Cohere is seeking a Senior Member of Technical Staff specializing in web data to develop a large-scale web data pipeline for their advanced language models, focusing on transforming raw internet data into high-quality training data.
Cohere is seeking a Senior Member of Technical Staff to develop a large-scale web data pipeline for their advanced language models, focusing on transforming raw internet data into high-quality training data.
The AI Automation Engineer at BairesDev will architect scalable web scraping pipelines, orchestrate workflows using low-code/no-code platforms, and build generative AI agents to automate business processes, leveraging advanced Python skills and systems integration expertise.
The Lead AI Automation & Integration Engineer will design and deploy scalable data extraction systems and intelligent automation workflows for a market intelligence platform, focusing on integrating generative AI agents and optimizing automated processes.
The Lead AI Automation & Integration Engineer will design and deploy scalable data extraction systems and intelligent automation workflows for a market intelligence platform, utilizing Python and modern web scraping frameworks.
Censys is seeking a Staff Software Developer to design, build, and operate systems for Internet-wide scanning, DNS resolution, and data pipelines, focusing on improving the accuracy and reliability of their Internet Map.
Speechify is seeking a Software Engineer to join their AI team, focusing on data collection to support model training operations, including building high-quality datasets at petabyte-scale.
The role involves designing, building, and maintaining automation workflows using n8n, integrating APIs, and developing AI-powered web applications. The engineer will work collaboratively to enhance automation processes and explore AI-agent solutions.
Hanzo is seeking a Senior Crawl Engineer to manage crawler operations, configure and develop custom crawler code, and support customers in web archiving. This role involves working with various web technologies and requires strong problem-solving skills.
HEROIC Cybersecurity is looking for a senior-level Threat Intelligence Data Engineer to design and operate automated intelligence collection systems for cybersecurity and breach intelligence platforms, focusing on discovering and indexing data from various sources including the dark web.