Add blacklight_dynamic_sitemap, deprecate resourcelist #7314
Description
Descriptive summary
In order to sustainably create sitemaps, we should use the pre-existing blacklight_dynamic_sitemap gem, rather than trying to fix the resourcelist.
Actual behavior
See #59 - this issue has been open almost 10 years and not resolved. Instead of trying to fix the existing class, which probably would have been done by now if it were easy, instead add the blacklight_dynamic_sitemap gem, and deprecate the resourcelist.
Acceptance Criteria/Expected Behavior
- Blacklight dynamic sitemap is added as part of generated app
- Come up with a plan / follow-up ticket for adding a robots.txt that points to the generated sitemap
- The ResourceList is marked as deprecated for next major release
Rationale (for feature request only)
Many institutions using Hyrax want their sites indexed by "good bots", e.g. Googlebot. Without an index page for sitemaps for large repositories, their sitemaps cannot be added.
It's possible that by adding the sitemap to the robots.txt, it's less likely we will have the issue of bots crawling through all the combinations of facets, which can be very expensive for Solr.
Related work
- For previous ticket, see ResourceSync resource lists should scale to > 50K items #59