How to Make a Web Crawler with Cheerio in September, 2023
Whether you are looking to obtain data from a website, track changes on the internet, or use a website API, website crawlers are a great way to get the data you need. While they have many components, crawlers fundamentally use a simple process: download the raw data, process and extract it, and, if desired, store the data in a file or database. There are many ways to do this, and many languages you can build your spider or crawler in.
This tutorial uses Node.js to to download pages and the Cheerio library to parse the DOM of the downloaded page.
This tutorial overviews Node.js and Cheerio and gives an in-depth example of how to crawl Steam and extract data from pages there.
This tutorial focuses on extracting data with Cheerio, focusing on selecting data for extraction.
This tutorial goes over parsing pages using the Cheerio library. It spends significant time going over the setup of Cheerio and the rest of the project, as well as a number of DOM access and manipulations you can do with Cheerio.
This is a tutorial on how to use node.js, jQuery, and Cheerio to set up simple web crawler. This include instructions for installing the required modules and code for extracting desired content from the HTML DOM, calculated using Cheerio.