Repository navigation

pypi package - #55

Draft

damian0815 wants to merge 34 commits into

mainfrom

damian/feat/pypi-package

Draft

pypi package#55
damian0815 wants to merge 34 commits into
mainfrom
damian/feat/pypi-package

Commits on Oct 16, 2025
- well-formed example passes
  Damian Stewart
  committed
  70bdd93
Commits on Oct 17, 2025
- wip (back to basics on pyspark)
  Damian Stewart
  committed
  92f30c6
- identical output with different format and sort order
  Damian Stewart
  committed
  fed0b2c
- typo
  Damian Stewart
  committed
  9bb3f41
- fix failing tests by spinning up a proper spark session and RDD
  Damian Stewart
  committed
  458cb2e
Commits on Oct 20, 2025
- exactly match cc-mrjob output
  Damian Stewart
  committed
  ada1471
- wip content encoding and invalid url tests
  Damian Stewart
  committed
  1f82d33
- Add test for >50 sitemaps; add accumulator checks to tests
  Damian Stewart
  committed
  35de5ca
- add fastwarc implementation
  Damian Stewart
  committed
  0bd0b4a
- fix logging
  Damian Stewart
  committed
  d17683f
Commits on Oct 30, 2025
- simplify & address review comments
  Damian Stewart
  committed
  41a3d0b
- add exception handling for urljoin
  Damian Stewart
  committed
  d50a39a
- add python unit test github workflow
  Damian Stewart
  committed
  c163959
- downgrade from uv
  Damian Stewart
  committed
  1ba160f
- remove same-host optimization
  Damian Stewart
  committed
  e2e9646
- split PySpark into its own requirements.txt; update README
  Damian Stewart
  committed
  94a98d7
- typo
  Damian Stewart
  committed
  6a23d23
- typos
  Damian Stewart
  committed
  8339e6c
- polish
  Damian Stewart
  committed
  be9a046
- cleanup remaining spark-submit invocations
  Damian Stewart
  committed
  0210cd8
Commits on Oct 31, 2025
- update docs with expanded PySpark info
  Damian Stewart
  committed
  cb9c4ca
- typo; clarify debugging limitations
  Damian Stewart
  committed
  2dd22dc
- address review comments
  Damian Stewart
  committed
  126b31b
- wip
  Damian Stewart
  committed
  3a7ba3b
- add pyproject.toml
  Damian Stewart
  committed
  69d66a0
Commits on Nov 3, 2025
- wip packaging
  Damian Stewart
  committed
  8fa2c04
Commits on Nov 7, 2025
- wip package_and_run_job
  Damian Stewart
  committed
  2daa4b7
- update version
  Damian Stewart
  committed
  5c4b1c6
- add pypi publish workflow
  Damian Stewart
  committed
  f6edfb4
- Merge branch 'main' into damian/feat/pypi-package
  Damian Stewart
  committed
  ca345e1
Commits on Nov 13, 2025
- try and make the workflow run
  Damian Stewart
  committed
  1ffe57d
- try and make the workflow run 2
  Damian Stewart
  committed
  f29d614
- try and make the workflow run 3
  Damian Stewart
  committed
  3618e7b
- fix pypi project url
  Damian Stewart
  committed
  9c08fc3

Commits

Commits on Oct 16, 2025

Commits on Oct 17, 2025

Commits on Oct 20, 2025

Commits on Oct 30, 2025

Commits on Oct 31, 2025

Commits on Nov 3, 2025

Commits on Nov 7, 2025

Commits on Nov 13, 2025