🕷️ Web ScrapMaster

Web Scraping Automation Platform

Loading...

Dashboard

System Health

Memory -
Storage -
Active Jobs
-
Running
-
Queued

System Status

Online

Total Batches

-

Total Scripts

-

Running Batch Activity

Loading...

Recent Activity

Loading...

Upload New Batch

Use alphanumeric characters, hyphens, and underscores only. If this batch already exists, your upload will be added as a new sub-batch inside it.
Required — every upload is grouped under a sub-batch name, even for the first upload.

Drag & Drop ZIP file here

or

All Batches

Live · just now

Loading batches...

Job History

Loading jobs...

URL Health Monitor

Manage URLs

Enter one URL per line. These URLs will be checked on your schedule.

Automated Scheduler

Friday Batch Runs

All scripts run automatically every Friday at 9:00 AM

Active

Next run: Loading...

URL Health Checks

URLs checked every Monday & Thursday at 8:00 AM

Active

Next check: Loading...

Testing / QA Review

Files moved to QA for review and approval

Loading QA files...

Production Files

QA-approved files ready for final delivery

Loading production files...

Activity Log

Audit trail of QA/Production status changes, resends, and validations

Loading activity log...

User Management

System Backups

Full project export — scripts, database, source code. Excludes output files, debug folders and venvs.

Loading backups…

WebScraper.io

Loading accounts...

Auto Validation Rules

Custom rules that extend the validator automatically, on every future validation - global, and applied to both the standard and WebScraper validators. The existing validation always runs first; these rules apply as a final cleanup pass afterward.

Loading rules...

Validation

Quickly triage validation status across every file in a batch without digging through each sub-batch individually.

Assigned to Me

Files another dev has handed off to you for fixing. Editing and saving works normally here - only moving a file to QA stays with its original owner.

Loading...

Email Notification Settings

Configure SMTP settings for sending user notifications

SMTP Configuration

For Gmail, use an App Password

How Email Notifications Work

  • Each user provides their email when created
  • Users receive notifications about their own jobs only
  • Notification types:
    • Job completed successfully
    • Job failed with errors
    • Scheduled job results
    • URL health check reports