feat: rate limiter #2

Merged

yl25946 merged 1 commit from refs/pull/2/head into main 2026-01-23 23:41:08 +00:00

Conversation 0 Commits 1 Files changed 1 +39 -10

yl25946 commented 2026-01-22 05:18:50 +00:00 (Migrated from codeberg.org)

Copy link

Added rate limiter (webarchive server does time weird, so 180 stops us from ever hitting the rate limit)

Additionally refactored code so that it would send all the websites to be saved first, and then check later, minimizing downtime.

Added rate limiter (webarchive server does time weird, so 180 stops us from ever hitting the rate limit) Additionally refactored code so that it would send all the websites to be saved first, and then check later, minimizing downtime.

Sign in to join this conversation.

Reviewers

No reviewers

Labels

Clear labels

  

needs/docs

Must have documentation written

  

needs/research

Discuss the ideal implementation with the tech lead

  

needs/upstream

Needs a contribution to an upstream project

  

type/bug

Something not working as intended

  

type/external

Lives outside of code

  

type/feature

New functionality

  

type/refactor

Improving existing code

  

urgency

high

This is currently causing issues

  

urgency

immediate

This is making a project or feature unusable

  

urgency

low

This can happen whenever

  

urgency

medium

This is expected to cause issues soon

No labels

needs/docs

needs/research

needs/upstream

type/bug

type/external

type/feature

type/refactor

urgency

high

urgency

immediate

urgency

low

urgency

medium

Milestone

Clear milestone

No items

No milestone

Projects

Clear projects

No items

No project

Assignees

Clear assignees

No assignees

1 participant

Notifications

Subscribe

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference

ScottyLabs/internet-archive!2

No description provided.