The Crawler Man
pre-defined APIs provider explicitly designed for scraping
01
Overview
The Crawler Man offers a comprehensive collection of pre-defined APIs explicitly designed for scraping. With The Crawler Man, you can easily extract data from various websites without the hassle.
02
Achievements
- 01
Reusable data access
Designed pre-defined APIs to make common web-data extraction workflows easier to reuse.
- 02
Backend automation
Applied Node.js, Puppeteer, Cheerio, MongoDB, and Firebase to the crawler platform.
03
Timeline
CodingSpace IndiaAugment · 2022 – PresentThe Crawler Man
- 3 years
- On this project
- 2023 – Present
- Active
- Side project
- Where
04
The stack
NodeJS
MongoDB
Firebase
Cheerio
Puppeteer
05