Releases · hysds/hysds_commons

HC-530: Updates to support Data in Transit (#66)
- Initial ES/OP update for DIT
- Initial OS/ES credentials netrc load and use
- Tweak interface slightly for credentials
- Change to default credential entry and use ~/.netrc-os by default
- auth -> http_auth for opensearchpy call
- Add connection_class to ES/OS calls for self-signed certs
- Add ca_certs
- Add jittered_backoff_class_factory to OS/ES connection
- Update queue_utils requests call

Assets 2

15 Jul 00:18

mcayanan

v1.2.0

5dc868f

v1.2.0: HySDS commons utils version 1.2.0

Bug Fixes and Enhancements:

HC-563: Upgrade to Python 3.12 (#65)
- Add python_requires='>=3.12' to setup.py
- Update classifiers to only include Python 3.12
- Remove future imports as they're not needed in Python 3.12
- Run pyupgrade --py312-plus to update syntax
- Update string formatting to use f-strings where appropriate
- Remove unnecessary file mode 'r' in open() calls

Assets 2

06 Jun 01:34

mcayanan

v1.1.6

319756f

v1.1.6: HySDS commons utils version 1.1.6

Minor search utils doc fix (#64)

Very minor documentation update to SearchUtility.search_by_id's id
kwarg parameter to address discrepancy between docstring and code.

Assets 2

27 Feb 22:02

mcayanan

v1.1.5

6b7b1c3

v1.1.5: HySDS commons utils version 1.1.5

HC-562: Pin numpy<2.0.0 (#62)

This is due to > 2.0.0 being incompatible with the pinned versions of elasticsearch. Otherwise this error appears during cluster provisioning:

module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out: Traceback (most recent call last):
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:   File "/export/home/hysdsops/sciflo/ops/grq2/scripts/install_base_es_template.py", line 13, in <module>
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:     from grq2 import grq_es
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:   File "/export/home/hysdsops/sciflo/ops/grq2/grq2/__init__.py", line 11, in <module>
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:     from hysds.es_util import get_grq_es, get_mozart_es
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:   File "/export/home/hysdsops/sciflo/ops/hysds/hysds/es_util.py", line 8, in <module>
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:     from elasticsearch import RequestsHttpConnection as RequestsHttpConnectionES
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:   File "/export/home/hysdsops/sciflo/lib/python3.9/site-packages/elasticsearch/__init__.py", line 36, in <module>
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:     from .client import Elasticsearch
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:   File "/export/home/hysdsops/sciflo/lib/python3.9/site-packages/elasticsearch/client/__init__.py", line 23, in <module>
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:     from ..transport import Transport, TransportError
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:   File "/export/home/hysdsops/sciflo/lib/python3.9/site-packages/elasticsearch/transport.py", line 31, in <module>
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:     from .serializer import DEFAULT_SERIALIZERS, Deserializer, JSONSerializer
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:   File "/export/home/hysdsops/sciflo/lib/python3.9/site-packages/elasticsearch/serializer.py", line 50, in <module>
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:     np.float_,
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:   File "/export/home/hysdsops/conda/lib/python3.9/site-packages/numpy/__init__.py", line 397, in __getattr__
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out:     raise AttributeError(
module.common.aws_instance.mozart (remote-exec): [100.104.3.25] out: AttributeError: `np.float_` was removed in the NumPy 2.0 release. Use `np.float64` instead.

Co-authored-by: Mike Cayanan michael.d.cayanan@jpl.nasa.gov

Assets 2