Calibration Notes

[jsclein-uaf]

this will be for calibration CMT 50

[jsclein-uaf]

this is CMT50 with trail valley creek climate

multiprocessing.pool.RemoteTraceback: 
"""
Traceback (most recent call last):
  File "/home/develop/.pyenv/versions/3.8.6/lib/python3.8/multiprocessing/pool.py", line 125, in worker
    result = (True, func(*args, **kwds))
  File "/home/develop/.pyenv/versions/3.8.6/lib/python3.8/multiprocessing/pool.py", line 48, in mapstar
    return list(map(*args))
  File "/work/mads_calibration/mads_sensitivity.py", line 900, in run_model
    completed_process = subprocess.run(
  File "/home/develop/.pyenv/versions/3.8.6/lib/python3.8/subprocess.py", line 512, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '/work/dvmdostem --pr-yrs 100 --eq-yrs 100 --sp-yrs 0 --tr-yrs 0 --sc-yrs 0 -l fatal --force-cmt 50 --ctrl-file /data/workflows/CMT50/Step1/test/sample_000000002/config/config.js' returned non-zero exit status 255.
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "run_mads_sensitivity.py", line 65, in <module>
    driver.run_all_samples()
  File "/work/mads_calibration/mads_sensitivity.py", line 880, in run_all_samples
    results = pool.map(self.run_model, folders)
  File "/home/develop/.pyenv/versions/3.8.6/lib/python3.8/multiprocessing/pool.py", line 364, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/home/develop/.pyenv/versions/3.8.6/lib/python3.8/multiprocessing/pool.py", line 771, in get
    raise self._value
subprocess.CalledProcessError: Command '/work/dvmdostem --pr-yrs 100 --eq-yrs 100 --sp-yrs 0 --tr-yrs 0 --sc-yrs 0 -l fatal --force-cmt 50 --ctrl-file /data/workflows/CMT50/Step1/test/sample_000000002/config/config.js' returned non-zero exit status 255.

this is CMT50 with Scotty Creek Climate

multiprocessing.pool.RemoteTraceback: 
"""
Traceback (most recent call last):
  File "/home/develop/.pyenv/versions/3.8.6/lib/python3.8/multiprocessing/pool.py", line 125, in worker
    result = (True, func(*args, **kwds))
  File "/home/develop/.pyenv/versions/3.8.6/lib/python3.8/multiprocessing/pool.py", line 48, in mapstar
    return list(map(*args))
  File "/work/mads_calibration/mads_sensitivity.py", line 900, in run_model
    completed_process = subprocess.run(
  File "/home/develop/.pyenv/versions/3.8.6/lib/python3.8/subprocess.py", line 512, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '/work/dvmdostem --pr-yrs 100 --eq-yrs 100 --sp-yrs 0 --tr-yrs 0 --sc-yrs 0 -l fatal --force-cmt 50 --ctrl-file /data/workflows/CMT50/Step1/test/sample_000000001/config/config.js' returned non-zero exit status 255.
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "run_mads_sensitivity.py", line 65, in <module>
    driver.run_all_samples()
  File "/work/mads_calibration/mads_sensitivity.py", line 880, in run_all_samples
    results = pool.map(self.run_model, folders)
  File "/home/develop/.pyenv/versions/3.8.6/lib/python3.8/multiprocessing/pool.py", line 364, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/home/develop/.pyenv/versions/3.8.6/lib/python3.8/multiprocessing/pool.py", line 771, in get
    raise self._value
subprocess.CalledProcessError: Command '/work/dvmdostem --pr-yrs 100 --eq-yrs 100 --sp-yrs 0 --tr-yrs 0 --sc-yrs 0 -l fatal --force-cmt 50 --ctrl-file /data/workflows/CMT50/Step1/test/sample_000000001/config/config.js' returned non-zero exit status 255.
develop@35a7425705e3:/work/mads_calibration$ 

[jsclein-uaf]

this is CMT60 with trali valley climate

multiprocessing.pool.RemoteTraceback: 
"""
Traceback (most recent call last):
  File "/home/develop/.pyenv/versions/3.8.6/lib/python3.8/multiprocessing/pool.py", line 125, in worker
    result = (True, func(*args, **kwds))
  File "/home/develop/.pyenv/versions/3.8.6/lib/python3.8/multiprocessing/pool.py", line 48, in mapstar
    return list(map(*args))
  File "/work/mads_calibration/mads_sensitivity.py", line 900, in run_model
    completed_process = subprocess.run(
  File "/home/develop/.pyenv/versions/3.8.6/lib/python3.8/subprocess.py", line 512, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '/work/dvmdostem --pr-yrs 100 --eq-yrs 100 --sp-yrs 0 --tr-yrs 0 --sc-yrs 0 -l fatal --force-cmt 60 --ctrl-file /data/workflows/CMT60/Step1/test/sample_000000004/config/config.js' returned non-zero exit status 134.
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "run_mads_sensitivity.py", line 65, in <module>
    driver.run_all_samples()
  File "/work/mads_calibration/mads_sensitivity.py", line 880, in run_all_samples
    results = pool.map(self.run_model, folders)
  File "/home/develop/.pyenv/versions/3.8.6/lib/python3.8/multiprocessing/pool.py", line 364, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/home/develop/.pyenv/versions/3.8.6/lib/python3.8/multiprocessing/pool.py", line 771, in get
    raise self._value
subprocess.CalledProcessError: Command '/work/dvmdostem --pr-yrs 100 --eq-yrs 100 --sp-yrs 0 --tr-yrs 0 --sc-yrs 0 -l fatal --force-cmt 60 --ctrl-file /data/workflows/CMT60/Step1/test/sample_000000004/config/config.js' returned non-zero exit status 134.

[tobeycarman]

@jsclein-uaf I think the next step is to

1. verify that the sample_00000000N/ directories have been setup correctly and then
2. try running in an individual sample directory (without any of the mads/sensitivity wrapper scripts) and see if you can find out exactly what it is complaining about... You should be able to change into the sample directory and simply run dvmdostem, but with a higher log level, like this:

$ cd /data/workflows/CMT60/Step1/test/sample_000000004

# NOTE! differences from command in your traceback above!
#  --> relative path to config file and increased log level.
$ /work/dvmdostem --pr-yrs 100 --eq-yrs 100 --sp-yrs 0 --tr-yrs 0 --sc-yrs 0 -l note --force-cmt 60 --ctrl-file config/config.js

[jsclein-uaf]

got this output for both CMT50 and CMT with the newest climate data provided by Helene

[note] [] Searching file for community: CMT60
[note] [] --> CLIMATE --> BETTER CTOR
[note] [] Getting value for pixel(y,x): (0,0).
[err] [] Unknown datatype: '6'. Returning empty vector.
[note] [] Getting value for pixel(y,x): (0,0).
[err] [] Unknown datatype: '6'. Returning empty vector.
[note] [] Getting value for pixel(y,x): (0,0).
[err] [] Unknown datatype: '6'. Returning empty vector.
[note] [] Getting value for pixel(y,x): (0,0).
[err] [] Unknown datatype: '6'. Returning empty vector.
dvmdostem: src/Climate.cpp:496: std::vector<float> Climate::avg_over(const std::vector<float>&, int, int): Assertion `var.size() >= 12*window_length && "The data vector is too short to average over the window!"' failed.
Aborted (core dumped)

[jsclein-uaf]

tried running an individual cell for both CMT 50 and 60, with the NEW input climate files (although I did have to add the run-mask, and explicit fire and projected climate, and 2 others from other places).
ERRORS were the same:

[warn] [] WARNING! No Grid Mapping found in file with ncid: 131072
[warn] [] A grid_mapping variable is not available for copying!! Your output files will not be spatially referenced!

[note] [] Searching file for community: CMT60
[note] [] --> CLIMATE --> BETTER CTOR
[note] [] Getting value for pixel(y,x): (0,0).
[err] [] Unknown datatype: '6'. Returning empty vector.
[note] [] Getting value for pixel(y,x): (0,0).
[err] [] Unknown datatype: '6'. Returning empty vector.
[note] [] Getting value for pixel(y,x): (0,0).
[err] [] Unknown datatype: '6'. Returning empty vector.
[note] [] Getting value for pixel(y,x): (0,0).
[err] [] Unknown datatype: '6'. Returning empty vector.
dvmdostem: src/Climate.cpp:496: std::vector<float> Climate::avg_over(const std::vector<float>&, int, int): Assertion `var.size() >= 12*window_length && "The data vector is too short to average over the window!"' failed.
Aborted (core dumped)

additionally, if I ncdump the soil-texture file, the pct_silt is -94 when it should be 5
also might want to double check that soil texture is the same for trail valley and scotty creek
also, still don't understand the importance (or not ) of the long lats being that same for all the inputs...