2.2.0 Performance improvements and fallback/retry support added

What's Changed

• chore: uplift redis container from v3 to v7 as rq 2.0.0 drops below v4 by @duttonw in #250
• perf: implement chunked fulltext indexing for large datasets by @cgoldshtein in #256
• feat: add selective HTTP error retries for network failures by @cgoldshtein in #258
• Backport features from QGOV fork by @ThrawnCA in #261

New Contributors

• @cgoldshtein made their first contribution in #256

Full Changelog: 2.1.0...2.2.0

2.1.0

What's Changed

• fix Flake8 complaints by @ThrawnCA in #247
• Feature/custom xloader site url rebased by @pwalsh @kowh-ai @duttonw in #243

Full Changelog: 2.0.1...2.1.0

2.0.1

What's Changed

• Avoid loading R/W datastore resources by @wardi in #241
• Fix: Support CKAN 2.11.x Config apitoken_header_name - default to 'Authorization' by @Engerrs in #245
• fix: #244 include static webassets on packaging by @duttonw in #246

New Contributors

• @Engerrs made their first contribution in #245

Full Changelog: 2.0.0...2.0.1

2.0.0

Major

Dropped CKAN 2.9.x and Python2.

Feat:

• Adds Strip White Space fields to the Data Dictionary (defualts to True for each field). This will strip surrounding white space from data values prior to inserting them into the database.
• Adds support for ckanext-validation. Config ckanext.xloader.validation.requires_successful_report controls whether a resource requires a successful validation report to be XLoadered. By default, a resource would also require a Validation Schema, which can be turned off with ckanext.xloader.validation.enforce_schema.
• Frontend Status Badges by @JVickery-TBS in #224

Fix:

• Properly handle REDIS queue timeouts to close/delete any temporary files.
• Fix automated PyPI publishing by @ThrawnCA in #231

What's Changed

• Update README, migrate it to Markdown by @amercader in #235
• chore: switch to pyproject.toml by @duttonw in #236
• Validation Extension Support (Squashed) by @JVickery-TBS in #237
• Strip White Space from Cell Values (Squashed) by @JVickery-TBS in #238
• RQ Job Timeout Handling (Squashed) by @JVickery-TBS in #239
• SQLAlchemy v2 support by @smotornyuk in #225

Full Changelog: 1.2.0...2.0.0

1.2.0

What's Changed

• Fix PyPI publishing by @ThrawnCA in #233
• Enhancement/Bugfix: Downstream qld-gov-au fix's by @duttonw in #232
  • feat: @JVickery-TBS work on validation integration (await successful validation prior to doing datastore work via 'IPipeValidation'
  • fix: handle gracefully if tabulator load fails by trying 'direct load'
  • fix: Excel blank header row bug
  • fix: Datastore truncate, restart identity so numbering restarts from 0 again (when imported data has same columns and types
  • fix: parital fix on DB deadlock by adding timeouts on DDL events
  • test: test_simple_large_file, test_with_blanks, test_with_empty_lines, test_with_extra_blank_cells
  • test: test_require_validation, test_enforce_validation_schema
  • chore: min version requirements for cve's,
    • requests>=2.32.0
    • urllib3>=2.2.2
    • zipp>=3.19.1

Full Changelog: 1.1.2...1.2.0

1.1.1

What's Changed

• feat: Add pypi cicd publish via github action via environment controls by @duttonw in #228

Full Changelog: 1.1.0...1.1.1

What's Changed

• feat: Add pypi cicd publish via github action via environment controls by @duttonw in #228

Full Changelog: 1.1.0...1.1.1

1.1.0

What's Changed

• add README note about running on separate server, #191 by @ThrawnCA in #192
• Use IDomainObjectModification Implementation by @JVickery-TBS in #198
• Hide excessive numbers of resource_data log entries, #187 by @ThrawnCA in #188
• #182 Type guessing fixes by @ThrawnCA in #186
• Document the ckan.download_proxy setting, #176 by @ThrawnCA in #204
• Conditional DataStore Tab in Resource Edit by @JVickery-TBS in #190
• Make locking behaviour more robust by @ThrawnCA in #205
• Delete Datastore Table Button by @JVickery-TBS in #197
• Quality of life improvements by @duttonw in #195
• Clean Datastore Tables Job by @JVickery-TBS in #196
• strip extra space for column name by @mutantsan in #210
• Skip empty lines instead of erroring by @ThrawnCA in #208
• add more options for maintainers to expedite XLoader runs, GitHub #202 by @ThrawnCA in #212
• Add Mixed Integers Type Guessing to NUMERIC Tests by @JVickery-TBS in #217
• PY2 & PY3 String/Binary Fixes by @JVickery-TBS in #203
• In plugin.py, there is an fix of resource format key error by @Nisha1293 in #209
• CKAN 2.11 support by @amercader in #220

New Contributors

• @JVickery-TBS made their first contribution in #198
• @duttonw made their first contribution in #195
• @mutantsan made their first contribution in #210
• @Nisha1293 made their first contribution in #209

Full Changelog: 1.0.1...1.1.0

1.0.1

Bugfix

• Include config_declaration.yaml into MANIFEST by @pdelboca in #183

Full Changelog: 1.0.0...1.0.1

1.0.0

What's Changed

• Fixed date parsing while fetching entries for task_status by @muhammed-ajmal in #179
• Drop support for old CKAN versions and add CSRF support by @pdelboca in #180
• Refactor test_jobs.py by @pdelboca in #181

New Contributors

• @muhammed-ajmal made their first contribution in #179

Full Changelog: 0.12.2...1.0.0

0.12.2

• Fix python-dateutil requirement for Python 2.7 support

See 0.12.0 for more relevant changes