Can't install the plugin on QGIS 3.40 on a Mac

[alexgleith]

Error message below:

Couldn't load plugin 'LDMP' 

TypeError: 'str' object is not callable 
Traceback (most recent call last):
  File "/Applications/QGIS-LTR.app/Contents/MacOS/../Resources/python/qgis/utils.py", line 447, in loadPlugin
    __import__(packageName)
  File "/Applications/QGIS-LTR.app/Contents/MacOS/../Resources/python/qgis/utils.py", line 1100, in _import
    mod = _builtin_import(name, globals, locals, fromlist, level)
  File "/Users/alex/Library/Application Support/QGIS/QGIS3/profiles/default/python/plugins/LDMP/__init__.py", line 112, in 
    from . import conf  # noqa: E402
  File "/Applications/QGIS-LTR.app/Contents/MacOS/../Resources/python/qgis/utils.py", line 1100, in _import
    mod = _builtin_import(name, globals, locals, fromlist, level)
  File "/Users/alex/Library/Application Support/QGIS/QGIS3/profiles/default/python/plugins/LDMP/conf.py", line 240, in 
    KNOWN_SCRIPTS = _load_script_config(_SCRIPT_CONFIG)
  File "/Users/alex/Library/Application Support/QGIS/QGIS3/profiles/default/python/plugins/LDMP/conf.py", line 207, in _load_script_config
    script = ExecutionScript.Schema().load(raw_config)
TypeError: 'str' object is not callable


Python version: 3.9.5 (default, Sep 10 2021, 16:18:19) [Clang 12.0.5 (clang-1205.0.22.11)] 
QGIS version: 3.40.5-Bratislava Bratislava, 8d6d1b54486 

Python Path:
/Applications/QGIS-LTR.app/Contents/MacOS/../Resources/python
/Users/alex/Library/Application Support/QGIS/QGIS3/profiles/default/python/plugins/LDMP/ext-libs
/Users/alex/Library/Application Support/QGIS/QGIS3/profiles/default/python/plugins/LDMP/ext-libs
/Users/alex/Library/Application Support/QGIS/QGIS3/profiles/default/python
/Users/alex/Library/Application Support/QGIS/QGIS3/profiles/default/python/plugins
/Applications/QGIS-LTR.app/Contents/MacOS/../Resources/python/plugins
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python39.zip
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/statsmodels-0.11.1-py3.9-macosx-10.13.0-x86_64.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/lib-dynload
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/numba-0.50.1-py3.9-macosx-10.13.0-x86_64.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/Pillow-7.2.0-py3.9-macosx-10.13.0-x86_64.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/geopandas-0.8.1-py3.9.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/cftime-1.2.1-py3.9-macosx-10.13.0-x86_64.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/Fiona-1.8.13.post1-py3.9-macosx-10.13.0-x86_64.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/patsy-0.5.1-py3.9.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/numpy-1.20.1-py3.9-macosx-10.13.0-x86_64.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/netCDF4-1.5.4-py3.9-macosx-10.13.0-x86_64.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/rasterio-1.1.5-py3.9-macosx-10.13.0-x86_64.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/GDAL-3.3.2-py3.9-macosx-10.13.0-x86_64.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/opencv_contrib_python-4.3.0.36-py3.9-macosx-10.13.0-x86_64.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/pandas-1.3.3-py3.9-macosx-10.13.0-x86_64.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/matplotlib-3.3.0-py3.9-macosx-10.13.0-x86_64.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/Rtree-0.9.7-py3.9-macosx-10.13.0-x86_64.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/scipy-1.5.1-py3.9-macosx-10.13.0-x86_64.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/pyproj-3.2.0-py3.9-macosx-10.13.0-x86_64.egg
/Users/alex/Library/Application Support/QGIS/QGIS3/profiles/default/python

[azvoleff]

@alexgleith what version of the plugin is this? and is this installed from the QGIS repo or directly on your machine?

[azvoleff]

Looks like the issue here may be that MacOS ships an old version of marshmallow. What does the below return in QGIS python?

from importlib.metadata import version
print(version("marshmallow-dataclass"))

If it says something other than 8.7.1 it must be picking up your system install rather than the version we package with the plugin.

[alexgleith]

Installed direct from the plugin installer, which is showing 2.1.20.

Trying that command in the Python console:

importlib.metadata.PackageNotFoundError: marshmallow-dataclass

[azvoleff]

@alexgleith can you try to install the development version from the latest zipfile? I've added a fix that will hopefully address this. Unfortunately I've been unable to reproduce this on Windows or Linux, so seems like an issue with the libraries that ship with the MacOS QGIS installer

[alexgleith]

Sorry @azvoleff, but it failed to install still.

I installed the zipfile from this URL: https://s3.amazonaws.com/trends.earth/sharing/LDMP_main.zip

Couldn't load plugin 'LDMP' 

TypeError: 'str' object is not callable 
Traceback (most recent call last):
  File "/Applications/QGIS-LTR.app/Contents/MacOS/../Resources/python/qgis/utils.py", line 447, in loadPlugin
    __import__(packageName)
  File "/Applications/QGIS-LTR.app/Contents/MacOS/../Resources/python/qgis/utils.py", line 1100, in _import
    mod = _builtin_import(name, globals, locals, fromlist, level)
  File "/Users/alex/Library/Application Support/QGIS/QGIS3/profiles/default/python/plugins/LDMP/__init__.py", line 127, in 
    from . import conf  # noqa: E402
  File "/Applications/QGIS-LTR.app/Contents/MacOS/../Resources/python/qgis/utils.py", line 1100, in _import
    mod = _builtin_import(name, globals, locals, fromlist, level)
  File "/Users/alex/Library/Application Support/QGIS/QGIS3/profiles/default/python/plugins/LDMP/conf.py", line 249, in 
    KNOWN_SCRIPTS = _load_script_config(_SCRIPT_CONFIG)
  File "/Users/alex/Library/Application Support/QGIS/QGIS3/profiles/default/python/plugins/LDMP/conf.py", line 216, in _load_script_config
    script = ExecutionScript.Schema().load(raw_config)
TypeError: 'str' object is not callable


Python version: 3.9.5 (default, Sep 10 2021, 16:18:19) [Clang 12.0.5 (clang-1205.0.22.11)] 
QGIS version: 3.40.5-Bratislava Bratislava, 8d6d1b54486 

Python Path:
/Users/alex/Library/Application Support/QGIS/QGIS3/profiles/default/python/plugins/LDMP/ext-libs
/Applications/QGIS-LTR.app/Contents/MacOS/../Resources/python
/Users/alex/Library/Application Support/QGIS/QGIS3/profiles/default/python
/Users/alex/Library/Application Support/QGIS/QGIS3/profiles/default/python/plugins
/Applications/QGIS-LTR.app/Contents/MacOS/../Resources/python/plugins
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/GDAL-3.3.2-py3.9-macosx-10.13.0-x86_64.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/statsmodels-0.11.1-py3.9-macosx-10.13.0-x86_64.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/netCDF4-1.5.4-py3.9-macosx-10.13.0-x86_64.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/matplotlib-3.3.0-py3.9-macosx-10.13.0-x86_64.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/Pillow-7.2.0-py3.9-macosx-10.13.0-x86_64.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/cftime-1.2.1-py3.9-macosx-10.13.0-x86_64.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/Rtree-0.9.7-py3.9-macosx-10.13.0-x86_64.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/opencv_contrib_python-4.3.0.36-py3.9-macosx-10.13.0-x86_64.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/Fiona-1.8.13.post1-py3.9-macosx-10.13.0-x86_64.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/scipy-1.5.1-py3.9-macosx-10.13.0-x86_64.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/pandas-1.3.3-py3.9-macosx-10.13.0-x86_64.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/numba-0.50.1-py3.9-macosx-10.13.0-x86_64.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/numpy-1.20.1-py3.9-macosx-10.13.0-x86_64.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/pyproj-3.2.0-py3.9-macosx-10.13.0-x86_64.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/geopandas-0.8.1-py3.9.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python39.zip
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/patsy-0.5.1-py3.9.egg
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/lib-dynload
/Applications/QGIS-LTR.app/Contents/MacOS/lib/python3.9/site-packages/rasterio-1.1.5-py3.9-macosx-10.13.0-x86_64.egg
/Users/alex/Library/Application Support/QGIS/QGIS3/profiles/default/python

[azvoleff]

@alexgleith I see you have python 3.9.5. Are you able to upgrade? It looks like 3.9 end-of-lifed Oct 31. I wonder if there may be an out of date library leading to issues

[alexgleith]

I use Python 3.11 daily, not sure what MacOS system Python is.

python --version

Python 3.11.11

Looks like MacOS system Python is 3.9, like you say:

!python3 --version
Python 3.9.6

(From the QGIS Python console)

Looks like I can change the main Python version for the system, using these instructions, but I don't really like doing that as it might mess with system processes.

[azvoleff]

Are you using any other plugins? Still not sure what is causing this, but seems like most likely there is another plugin that uses an older version of marshmallow and/or marshmallow-dataclass that is getting loaded before trends.earth. Do you get this error if you install trends.earth in a clean QGIS profile without any other plugins installed?

[alexgleith]

I don't have a lot of plugins installed or enabled.

[azvoleff]

Hmm, yeah, so seems like maybe not another plugin. Can you tell me what you get if you run the below line by line in the QGIS python console?

import marshmallow, marshmallow_dataclass, te_schemas
import LDMP
print("LDMP path:", LDMP.__file__)
print("marshmallow path:", marshmallow.__file__)
print("marshmallow version:", getattr(marshmallow, "__version__", "unknown"))
print("marshmallow_dataclass path:", marshmallow_dataclass.__file__
print("te_schemas path:", te_schemas.__file__)

[alexgleith]

import LDMP fails:

Traceback (most recent call last):
  File "/Applications/QGIS-LTR.app/Contents/MacOS/../Resources/python/code.py", line 90, in runcode
    exec(code, self.locals)
  File "<input>", line 1, in <module>
  File "/Applications/QGIS-LTR.app/Contents/MacOS/../Resources/python/qgis/utils.py", line 1100, in _import
    mod = _builtin_import(name, globals, locals, fromlist, level)
  File "/Users/alex/Library/Application Support/QGIS/QGIS3/profiles/default/python/plugins/LDMP/__init__.py", line 127, in <module>
    from . import conf  # noqa: E402
  File "/Applications/QGIS-LTR.app/Contents/MacOS/../Resources/python/qgis/utils.py", line 1100, in _import
    mod = _builtin_import(name, globals, locals, fromlist, level)
  File "/Users/alex/Library/Application Support/QGIS/QGIS3/profiles/default/python/plugins/LDMP/conf.py", line 249, in <module>
    KNOWN_SCRIPTS = _load_script_config(_SCRIPT_CONFIG)
  File "/Users/alex/Library/Application Support/QGIS/QGIS3/profiles/default/python/plugins/LDMP/conf.py", line 216, in _load_script_config
    script = ExecutionScript.Schema().load(raw_config)
TypeError: 'str' object is not callable

Other commands:

print("marshmallow path:", marshmallow.__file__)
marshmallow path: /Users/alex/Library/Application Support/QGIS/QGIS3/profiles/default/python/plugins/LDMP/ext-libs/marshmallow/__init__.py
print("marshmallow version:", getattr(marshmallow, "__version__", "unknown"))
marshmallow version: 4.1.0
print("marshmallow_dataclass path:", marshmallow_dataclass.__file__
print("te_schemas path:", te_schemas.__file__)
Traceback (most recent call last):
  File "/Applications/QGIS-LTR.app/Contents/MacOS/../Resources/python/code.py", line 63, in runsource
    code = self.compile(source, filename, symbol)
  File "/Applications/QGIS-LTR.app/Contents/MacOS/../Resources/python/codeop.py", line 178, in __call__
    return _maybe_compile(self.compiler, source, filename, symbol)
  File "/Applications/QGIS-LTR.app/Contents/MacOS/../Resources/python/codeop.py", line 106, in _maybe_compile
    raise err1
  File "/Applications/QGIS-LTR.app/Contents/MacOS/../Resources/python/codeop.py", line 93, in _maybe_compile
    code1 = compiler(source + "\n", filename, symbol)
  File "/Applications/QGIS-LTR.app/Contents/MacOS/../Resources/python/codeop.py", line 143, in __call__
    codeob = compile(source, filename, symbol, self.flags, True)
  File "<input>", line 2
    print("te_schemas path:", te_schemas.__file__)
    ^
SyntaxError: invalid syntax

[azvoleff]

Thanks, and sorry - can you run the last two lines again? Looks like I left off a parentheses:

print("marshmallow_dataclass path:", marshmallow_dataclass.__file__)
print("te_schemas path:", te_schemas.__file__)

[alexgleith]

left off a parenthesis

Oops, I should have noticed this!

print("marshmallow_dataclass path:", marshmallow_dataclass.__file__)
marshmallow_dataclass path: /Users/alex/Library/Application Support/QGIS/QGIS3/profiles/default/python/plugins/LDMP/ext-libs/marshmallow_dataclass/__init__.py
print("te_schemas path:", te_schemas.__file__)
te_schemas path: /Users/alex/Library/Application Support/QGIS/QGIS3/profiles/default/python/plugins/LDMP/ext-libs/te_schemas/__init__.py

[azvoleff]

Ok, I think I have this fixed. Can you try the latest development zipfile @alexgleith? Let me know if that fixes it