cheapCrawler
Module 3

JavaScript SPA Crawling

Chromium 128 Engine & Client Rendering

Client-Side vs Server-Side Rendering

Traditional HTTP crawlers only inspect the raw static HTML response. CheapCrawler includes an embedded Chromium engine (v128) that waits for JavaScript execution, ensuring dynamic links, client-rendered schema, and lazy-loaded elements are accurately captured.

Enabling Headless Rendering

In Settings → Spider Engine, check the box: "Render JavaScript (Chromium)". Set your DOM settlement timeout (default is 500ms after network idle).