Skip to content
/ scrapi Public

πŸ‘€ A webapp for managing scheduled jobs, scraping data and parsing it afterwards

Notifications You must be signed in to change notification settings

redii/scrapi

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

68 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

πŸ‘€ Scrapi

Scheduled API scraping made easy πŸ€™πŸΌ

  1. Setup Scraping Jobs with Endpoints, Headers and Crontabs
  2. Parse the returned data and send notifications if needed
  3. Manage and monitor your Jobs using a webapp

πŸ‘¨β€πŸ’» Webapp

A SvelteKit application used to CRUD your scraping jobs.

The code can be found here.

⏰ Daemon

A Node.js Script scheduling scraping jobs and executing parser functions.

Parser functions are used to analyze the data and send out notifications if needed.

The code can be found here.

About

πŸ‘€ A webapp for managing scheduled jobs, scraping data and parsing it afterwards

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published