Skip to content

Add PE subjects#284

Merged
psvenk merged 98 commits intomainfrom
pe
Jan 26, 2026
Merged

Add PE subjects#284
psvenk merged 98 commits intomainfrom
pe

Conversation

@dtemkin1
Copy link
Copy Markdown
Collaborator

In collaboration with DAPER

dtemkin1 and others added 14 commits January 25, 2026 12:03
Accept single files as well as directories, and match load_json_data in
its API.
We now ingest the raw file from PE&W instead of applying a manual
cleaning process beforehand. This involves operationalizing in code what
the manual cleaning process was accomplishing: adding building numbers
and end times.

Building numbers are now added by a new augment_location function in
scrapers/pe.py, and end times are added separately in the overrides
file.
psvenk pushed a commit that referenced this pull request Jan 26, 2026
We fetch things from `/` a lot. When setting up the gh-pages branch for
#284 testing, this was complicated since we were deploying from a
subdirectory. Adding this now will make setting up a dev endpoint in the
(possible) future easier.
@psvenk psvenk merged commit 03248f8 into main Jan 26, 2026
7 checks passed
@dtemkin1 dtemkin1 deleted the pe branch January 26, 2026 04:44
@dtemkin1 dtemkin1 mentioned this pull request Jan 26, 2026
psvenk added a commit that referenced this pull request Jan 27, 2026
Some finishing touches on the PE classes feature (prev: #284).

---------

Co-authored-by: Diego Temkin <65834932+dtemkin1@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants