Node Crawler

Web Crawler/Spider for NodeJS + server-side jQuery

This is an exact mirror of the Node Crawler project, hosted at https://github.com/bda-research/node-crawler. SourceForge is not affiliated with Node Crawler.

Add a Review

Downloads: 3 This Week

Last Update: 6 days ago

Download

Get an email when there's a new version of Node Crawler

Windows Mac Linux BSD ChromeOS

Most powerful, popular and production crawling/scraping package for Node, happy hacking.

Features

Server-side DOM & automatic jQuery insertion with Cheerio (default) or JSDOM
Configurable pool size and retries
Control rate limit
Priority queue of requests
forceUTF8 mode to let crawler deal for you with charset detection and conversion
Compatible with 4.x or newer version

Project Samples

Project Activity

See All Activity >

License

MIT License

Follow Node Crawler

Node Crawler Web Site

Other Useful Business Software

Hybrid Bare Metal Cloud Infrastructure | Servers.com

Scale, customize and manage your bare metal servers - all in one place.

Three bare metal hosting solutions on one global network. Spin up on demand to cover peaks, then optimize for cost when usage stabilizes.

Learn More

Rate This Project

User Reviews

Be the first to post a review of Node Crawler!

Additional Project Details

Programming Language

JavaScript

Related Categories

JavaScript Libraries

Registered

2023-09-20

Similar Business Software

SurveyJS

SurveyJS is an embeddable, self-hosted, white-label form builder for teams building custom forms, surveys, questionnaires, and other data collection tools inside web applications. It runs entirely on the client and is fully compatible with all modern JavaScript frameworks, including React,...

See Software
DHTMLX

DHTMLX is a JavaScript UI library that provides a set of highly customizable and flexible components for building modern and responsive web applications. The library includes more than 30 UI components, such as Gantt, Scheduler, Kanban, diagrams, charts, grids, spreadsheets, calendars, trees,...

See Software
FusionCharts

FusionCharts is a powerful and easy-to-use JavaScript charting library that helps developers to add interactive charts and data visualizations to their web and mobile applications. With 100+ chart types, including column, bar, line, area, pie, doughnut, scatter, bubble, and more, it's easy to...

See Software
JsPlumb

JsPlumb is a Javascript diagramming library that allows you to rapidly create complex applications featuring visual connectivity without having to build any of the boring stuff: it provides pan/zoom, a minimap widget, automatic layouts, data binding, path finding, and much, much more. JsPlumb...

See Software
Webix

JavaScript UI library and framework for speeding up web development. JS Framework for cross-platform web Apps development 102 UI widgets and feature-rich CSS / HTML5 JavaScript controls. Save at least 3000+ development hours by using ready-made widgets and UI controls. Develop Web UI 30% faster....

See Software
Bryntum

Bryntum is a leading provider of high-performance scheduling solutions for the web. Our suite of JavaScript components—including Gantt, Scheduler, Task Board, and Calendar—enables developers to build modern project management applications with features like drag-and-drop scheduling, resource...

See Software

Report inappropriate content

Hybrid Bare Metal Cloud Infrastructure | Servers.com

Scale, customize and manage your bare metal servers - all in one place.

Three bare metal hosting solutions on one global network. Spin up on demand to cover peaks, then optimize for cost when usage stabilizes.

Learn More

Recommended Projects

EasySpider
A visual no-code/code-free web crawler/spider
spider_collection
Collection of Python web scraping scripts for data extraction tasks
mzitu
Python crawler that downloads image galleries and analyzes titles
Happy DOM
Happy DOM is a JavaScript implementation of a web browser
python-fxxk-spider
Collection of 100+ Python web scraping projects and crawler examples