Data Scraping Engineer

About us

• Moojing Market Intelligence is an AI-empowered retail data insights provider, covering more than 100 million local and international brands each month.
• In near real-time we track the market dynamics that influence a consumer’s online intent to purchase through social listening, versus their actual buying behaviour through what they purchase on various Ecommerce platforms and the reviews they give after they’ve made a purchase.
• This anonymised iterative feedback helps brands assess their priorities for NPD, online marketing and product allocation.
• We utilise machine learning and proprietary AI algorithms to marry an incredible volume of data each month. Established in 2010 and now with a team of 140+ members, our company operates across multiple locations, including Beijing and Hong Kong.

As a Data Scraping Engineer, you will be a crucial part of our engineering team, responsible for designing, developing, and maintaining robust web crawlers and scrapers. This role involves collaboration with project managers, understanding client requirements, and staying updated on the latest web scraping technologies.

Responsibilities:

• Collect and monitor various types of websites and APPs;
• Ensure that the crawler system continues to work normally every day;
• Write crawler code for new projects;
• Clean the data

Requirements:

• College degree or above; Computer Science equivalent preferred
• 1 to 3 years of hands-on experience in software development; Crawler related engineering experience is preferred
• Familiar with Python or Java programming language; familiar with HTML, JavaScript, regular expressions, and XML; familiar with HTTP/HTTPS protocol, understanding shell
• Familiar with pandas is preferred
• Chinese as a working language

Seniority level

Entry level

Employment type

Full-time

Job function

Information Technology

Industry

Market Research