[Change]: no url included in rate limited log message

Open Beginner friendly
#3,715 0 comments 0 reactions 0 assignees View on GitHub

Maintainers usually reply within 1 day

Nobody has claimed this yet.

Assessment

Difficulty
2/5
Estimated time
1-3 hours
Newbie friendliness
85/100
Issue type
Feature
Clarity
Clearly specified
Activity status
Active
Tech stack
typescript
Domain
backend

Research direction

Find the code that logs rate limit messages during page crawling. Add the URL or domain to that log message. Test by running a crawl that triggers rate limiting and verifying the new information appears in the logs.

Written by the indexing model from the issue text.

Description

enhancement idea
Browsertrix Host

Self-Hosted

What change would you like to see?

When doing "List of pages" crawl, and getting rate limited it would be a great help to get info about exactliy what url/domain is being rate limited.

I can see no such details in

Image
Additional details

No response

Dominant language
TypeScript
Stars
502
Forks
83
Avg merge
2d 14h
Merged PRs (30d)
32

Getting set up

  • No Dockerfile or Docker Compose file
  • Has a pull request template
  • No contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from webrecorder/browsertrix

All issues in webrecorder/browsertrix

Similar issues

More TypeScript issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.