PhantomJS Website Crawler Tutorials

Whether you are looking to obtain data from a website, track changes on the internet, or use a website API, website crawlers are a great way to get the data you need. While they have many components, crawlers fundamentally use a simple process: download the raw data, process and extract it, and, if desired, store the data in a file or database. There are many ways to do this, and many languages you can build your spider or crawler in.

PhantomJS is a Webkit-based simulator for running JavaScript outside the browser. It is designed both for speed and the ability to be automated. These tutorials primarily use PhantomJS to run the JavaScript used to call a Node.js server instance. This allows the Node.js crawlers to be run outside of a browser in an automated fashion.

PhantomJS Web Crawler Tutorials

Web scraping with Node.js Matt’s Hacking Blog

This is a tutorial made by Matt Hacklings about web scraping and building a crawler using JavaScript, Phantom.js, Node.js, Ajax. This include codes for creating a JavaScript crawler function and the implementation of limits on the maximum number of concurrent browser sessions performing the downloading.

Getting started with Selenium Webdriver for node.js

This is a tutorial made by Max Edmands about using the selenium-webdriver library with node.js and phantom.js to build a website crawler. It includes steps for setting up the run environment, building the driver, visiting the page, verification of the page, querying the HTML DOM to obtain the desired content, and interacting with the page once the HTML has been downloaded and parsed.

Crawl you website including login form with Phantomjs – Adaltas

This is a tutorial made by Adaltas about crawling a website requiring a login form using jQuery-based JavaScript, Phantom.js to run the JavaScript, and Node.js for the server-side. It breaks the requirements for the crawler into multiple scripts, performing actions such as the: login action, function action, the action runner, and the pilot to control the system.

Website Crawlers

Looking to download a lot of data? Need to find the exact information in a gigantic internet haystack that you are looking for? These resources are designed to help you build spiders, crawlers, and other tools to obtain data from the internet.

Website Crawler Tutorials

Website Tools

These tools are designed to help you build your website, add content, and improve your website’s appearance.

Javascript Graphing Libraries

Node.js Tutorials

How to install, program for, and implement Node.js for scalable and easy server-side Javascript for quick AJAX-style processing.

Parallax Website Design Techniques

Create websites with parallax scrolling using: jQuery.js | Stellar.js | Skrollr.js | CSS

Reveal.js

Parallax Web Design

Parallax website design moves one part of your website at a different speed than the rest of your page. This often creates a 3D-like effect, adding depth and interest to your webpage design. The resources, including themes, tutorials, and examples, are designed to help you build a website with parallax scrolling.

Parallax Web Design Resources

Parallax Technologies

Tools to create parallax scrolling websites: jQuery, Skrollr.js, Stellar.js, CSS

Parallax Tutorials

A Simple Parallax Scrolling Tutorial about how parallax scrolling works.

Tutorials for creating parallax websites using: jQuery | Stellar.js | Skrollr.js | CSS

Infininite Scrolling Web Design

Build an endless scrolling website, loading new content when your visitors reach the end of your webpage.

Infinite Scroll Tutorials

Tutorials about how to build an infinite scrolling website, including: WordPress, Drupal, Blogger, jQuery, Jetpack, Masonry, Isotope, and the Infinite-Scroll plugin for WordPress.

Infinite Scroll, Card Design Tutorial

How to build an infinite scrolling website with card design using Masonry, AJAX, JavaScript, PHP, and MySQL.

Website Theme Resources

Website themes are an easy to create a great website quickly. They provide a beginning point for you to build your websites, giving you layout, code, and functionality to work with. These resources are made to help you find the right theme to help you start building your website.

Website Theme Research

Our comprehensive, analytical research into the website theme industry, focusing on trends and major changes affecting website designers and website theme customers.

Theme Forest Analysis Report

Our Fall, 2014 Theme Forest Analysis Report shows a major shift in the theme marketplace. The empirical assesment of Theme Forest over a 28 month period indicates a series of interesting trends and patterns.

Analysis of Parallax Scrolling in Website Themes

Our assement of the popularity of parallax scrolling in website themes published on Theme Forest shows that parallax design elements are an increasingly popular trend.

WordPress Themes

Top Ranked WordPress Themes

The best WordPress themes for a new website, as calculated by our WordPress Theme Search Engine. These themes are selected for reliability, quality, popularity, and many other factors.