feat(scraper): import TartanConnect club events weekly #103

Open
jalenluorion wants to merge 1 commit from feat/scrape-weekly into main
Member

Club events were imported once, by hand, on Oct 3, so anything clubs posted since never reached cmucal.com. This runs the TartanConnect import every Monday at 10:00 UTC.

  • A scheduled run has no inputs, so source defaults to tartanconnect and profile to prod. Manual dispatch is unchanged.
  • The SOC scrape stays manual. It defaults to the semester in session and refuses a SOC page for another term, which is the case every November once next semester is posted.
  • The import is idempotent and skips stale-event deletion when the feed looks short (#93), so a bad week can't wipe saved events.

Merge order: after #99. The workflow runs devenv shell, which fails on main until #99 repairs devenv. Before merging, one manual tartanconnect dispatch against prod should be watched end to end, as the workflow's comment asked.

Club events were imported once, by hand, on Oct 3, so anything clubs posted since never reached cmucal.com. This runs the TartanConnect import every Monday at 10:00 UTC. - A scheduled run has no inputs, so `source` defaults to `tartanconnect` and `profile` to `prod`. Manual dispatch is unchanged. - The SOC scrape stays manual. It defaults to the semester in session and refuses a SOC page for another term, which is the case every November once next semester is posted. - The import is idempotent and skips stale-event deletion when the feed looks short (#93), so a bad week can't wipe saved events. **Merge order:** after #99. The workflow runs `devenv shell`, which fails on main until #99 repairs devenv. Before merging, one manual `tartanconnect` dispatch against prod should be watched end to end, as the workflow's comment asked.
feat(scraper): import TartanConnect club events weekly
Some checks failed
nixbot/nix-eval evaluation succeeded in 0s (1 warning)
nixbot/nix-build 0 attributes built
kennel/build build succeeded
CI / check-1 (pull_request) Failing after 44s
CI / build (pull_request) Failing after 1m1s
CI / check (pull_request) Failing after 0s
63511b1550
Club events were imported once, by hand, on Oct 3, so new listings never
reached the site. The Scrape workflow now also runs every Monday at 10:00 UTC;
a scheduled run has no inputs, so it defaults to the TartanConnect import
against prod. The SOC scrape stays manual.
Some checks are pending
nixbot/nix-eval evaluation succeeded in 0s (1 warning)
Required
Details
nixbot/nix-build 0 attributes built
Required
Details
kennel/build build succeeded
CI / check-1 (pull_request) Failing after 44s
CI / build (pull_request) Failing after 1m1s
CI / check (pull_request) Failing after 0s
CI / checks*
Required
kennel/deploy
Required
This pull request doesn't have enough approvals yet. 0 of 1 approvals granted.
You are not authorized to merge this pull request.
View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.
git fetch -u origin 'feat/scrape-weekly:feat/scrape-weekly'
git switch 'feat/scrape-weekly'
Sign in to join this conversation.
No reviewers
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
ScottyLabs/cal!103
No description provided.