Skip to content
Failed

Console Output

Skipping 1,697 KB.. Full Log
============================================================
   Binary file test423.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test423.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test423.py", line 40, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 423 test name: RoundSheetShelfGLMigrationSSA2d field: N/A
----------------finished:423-----------------------
----------------starting:424-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[0] ??? Error using ==> ./classes/IoModel.cpp:
3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test424.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test424.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test424.py", line 28, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 424 test name: SquareSheetShelfGroundingLine2dAggressive field: N/A
----------------finished:424-----------------------
----------------starting:427-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


============================================================
   Binary file test427.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test427.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test427.py", line 28, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 427 test name: SquareSheetShelfGroundingLine3dSoft field: N/A
----------------finished:427-----------------------
----------------starting:430-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:
[3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file
1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


============================================================
   Binary file test430.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test430.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test430.py", line 58, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 430 test name: MISMIP3D field: N/A
----------------finished:430-----------------------
----------------starting:431-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.0332852
   Total Core solution elapsed time:       0.0929839
   Linear solver elapsed time:             0.0397983 (43%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 7.4e-15 <  0.0008 test id: 431 test name: SquareSheetShelfSteaEnthalpySSA3d field: Vx
SUCCESS difference: 1.5e-15 <  0.0005 test id: 431 test name: SquareSheetShelfSteaEnthalpySSA3d field: Vy
SUCCESS difference: 3.2e-15 <  0.0005 test id: 431 test name: SquareSheetShelfSteaEnthalpySSA3d field: Vz
SUCCESS difference: 1.4e-15 <  0.0005 test id: 431 test name: SquareSheetShelfSteaEnthalpySSA3d field: Vel
SUCCESS difference:   1e-16 <   1e-13 test id: 431 test name: SquareSheetShelfSteaEnthalpySSA3d field: Pressure
SUCCESS difference: 4.2e-16 <  0.0001 test id: 431 test name: SquareSheetShelfSteaEnthalpySSA3d field: Temperature
SUCCESS difference:   2e-12 <  0.0005 test id: 431 test name: SquareSheetShelfSteaEnthalpySSA3d field: Waterfraction
SUCCESS difference: 1.5e-15 <  0.0005 test id: 431 test name: SquareSheetShelfSteaEnthalpySSA3d field: Enthalpy
----------------finished:431-----------------------
----------------starting:432-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.0317782
   Total Core solution elapsed time:       0.123316
   Linear solver elapsed time:             0.0561839 (46%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 6.2e-10 <   3e-09 test id: 432 test name: SquareSheetShelfSteaEnthalpyHO field: Vx
SUCCESS difference:   2e-10 <   1e-09 test id: 432 test name: SquareSheetShelfSteaEnthalpyHO field: Vy
SUCCESS difference: 5.8e-11 <   1e-09 test id: 432 test name: SquareSheetShelfSteaEnthalpyHO field: Vz
SUCCESS difference: 1.9e-10 <   1e-09 test id: 432 test name: SquareSheetShelfSteaEnthalpyHO field: Vel
SUCCESS difference:   1e-16 <   1e-13 test id: 432 test name: SquareSheetShelfSteaEnthalpyHO field: Pressure
SUCCESS difference: 1.4e-11 <   2e-10 test id: 432 test name: SquareSheetShelfSteaEnthalpyHO field: Temperature
SUCCESS difference: 8.1e-11 <   5e-10 test id: 432 test name: SquareSheetShelfSteaEnthalpyHO field: Waterfraction
SUCCESS difference: 7.5e-11 <   3e-09 test id: 432 test name: SquareSheetShelfSteaEnthalpyHO field: Enthalpy
----------------finished:432-----------------------
----------------starting:436-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
 
 ====== Testing rheology law: LliboutryDuval = 
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.0511586
   Total Core solution elapsed time:       0.179541
   Linear solver elapsed time:             0.080244 (45%)

   Total elapsed time: 0 hrs 0 min 0 sec
 
 ====== Testing rheology law: CuffeyTemperate = 
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.032542
   Total Core solution elapsed time:       0.164795
   Linear solver elapsed time:             0.0523016 (32%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 2.5e-10 <   2e-09 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: VxLliboutryDuval
SUCCESS difference: 1.9e-10 <   1e-09 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: VyLliboutryDuval
SUCCESS difference: 8.3e-11 <   1e-09 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: VzLliboutryDuval
SUCCESS difference: 1.9e-10 <   1e-09 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: VelLliboutryDuval
SUCCESS difference:   1e-16 <   1e-13 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: PressureLliboutryDuval
SUCCESS difference: 3.1e-11 <   2e-10 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: TemperatureLliboutryDuval
SUCCESS difference: 1.4e-10 <   6e-10 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: WaterfractionLliboutryDuval
SUCCESS difference: 1.7e-10 <   1e-09 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: EnthalpyLliboutryDuval
SUCCESS difference: 4.6e-10 <   2e-09 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: VxCuffeyTemperate
SUCCESS difference: 1.9e-10 <   1e-09 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: VyCuffeyTemperate
SUCCESS difference: 4.7e-11 <   1e-09 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: VzCuffeyTemperate
SUCCESS difference: 1.9e-10 <   1e-09 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: VelCuffeyTemperate
SUCCESS difference:   1e-16 <   1e-13 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: PressureCuffeyTemperate
SUCCESS difference: 3.2e-11 <   2e-10 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: TemperatureCuffeyTemperate
SUCCESS difference: 1.3e-10 <   6e-10 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: WaterfractionCuffeyTemperate
SUCCESS difference: 1.8e-10 <   1e-09 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: EnthalpyCuffeyTemperate
----------------finished:436-----------------------
----------------starting:437-----------------------
----------------running-----------------------
      creating thickness
      creating velocities
      creating drag
      creating temperatures
      creating flow law parameter
      creating surface mass balance
      boundary conditions for stressbalance model
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
      boundary conditions for thermal model
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file SquareThermal.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: SquareThermal.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test437.py", line 60, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 437 test name: ThermalEnthBasalcondsTrans field: N/A
----------------finished:437-----------------------
----------------starting:439-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test439.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test439.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test439.py", line 24, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 439 test name: TransientFrictionWaterlayer3D field: N/A
----------------finished:439-----------------------
----------------starting:441-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[
[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test441.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test441.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test441.py", line 59, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 441 test name: MISMIP3D field: N/A
----------------finished:441-----------------------
----------------starting:443-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[
[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test443.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test443.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test443.py", line 56, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 443 test name: SquareSheetShelfTranSSA3dAggressiveRegionalOutput field: N/A
----------------finished:443-----------------------
----------------starting:447-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

[

[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test447.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test447.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test447.py", line 31, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 447 test name: SquareSheetShelfTranMOLHO2d field: N/A
----------------finished:447-----------------------
----------------starting:460-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.079352
   Total Core solution elapsed time:       0.0477912
   Linear solver elapsed time:             0.0318766 (67%)

   Total elapsed time: 0 hrs 0 min 0 sec
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.0638935
   Total Core solution elapsed time:       0.143252
   Linear solver elapsed time:             0.0815809 (57%)

   Total elapsed time: 0 hrs 0 min 0 sec
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.0337769
   Total Core solution elapsed time:       0.319704
   Linear solver elapsed time:             0.132046 (41%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 3.2e-15 <   7e-06 test id: 460 test name: SquareSheetShelfStressFSEstar field: VxSSA
SUCCESS difference: 8.5e-16 <   2e-05 test id: 460 test name: SquareSheetShelfStressFSEstar field: VySSA
SUCCESS difference: 8.2e-16 <   2e-06 test id: 460 test name: SquareSheetShelfStressFSEstar field: VzSSA
SUCCESS difference: 7.2e-16 <   5e-06 test id: 460 test name: SquareSheetShelfStressFSEstar field: VelSSA
SUCCESS difference:   1e-16 <   8e-07 test id: 460 test name: SquareSheetShelfStressFSEstar field: PressureSSA
SUCCESS difference: 3.9e-10 <   7e-06 test id: 460 test name: SquareSheetShelfStressFSEstar field: VxHO
SUCCESS difference: 1.4e-10 <   2e-05 test id: 460 test name: SquareSheetShelfStressFSEstar field: VyHO
SUCCESS difference: 2.8e-11 <   2e-06 test id: 460 test name: SquareSheetShelfStressFSEstar field: VzHO
SUCCESS difference: 1.4e-10 <   5e-06 test id: 460 test name: SquareSheetShelfStressFSEstar field: VelHO
SUCCESS difference:   1e-16 <   8e-07 test id: 460 test name: SquareSheetShelfStressFSEstar field: PressureHO
SUCCESS difference: 5.4e-08 <   7e-06 test id: 460 test name: SquareSheetShelfStressFSEstar field: VxFS
SUCCESS difference: 3.8e-08 <   2e-05 test id: 460 test name: SquareSheetShelfStressFSEstar field: VyFS
SUCCESS difference: 4.8e-08 <   2e-06 test id: 460 test name: SquareSheetShelfStressFSEstar field: VzFS
SUCCESS difference: 4.8e-08 <   5e-06 test id: 460 test name: SquareSheetShelfStressFSEstar field: VelFS
SUCCESS difference: 3.1e-08 <   8e-07 test id: 460 test name: SquareSheetShelfStressFSEstar field: PressureFS
----------------finished:460-----------------------
----------------starting:461-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test461.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test461.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test461.py", line 32, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 461 test name: SquareSheetShelfThermalFSEstar field: N/A
----------------finished:461-----------------------
----------------starting:463-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


===================================================================================
=   BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
=   PID 971596 RUNNING AT Debian-12-VM
=   EXIT CODE: 9
=   CLEANING UP REMAINING PROCESSES
=   YOU CAN IGNORE THE BELOW CLEANUP MESSAGES
===================================================================================
YOUR APPLICATION TERMINATED WITH THE EXIT STRING: Killed (signal 9)
This typically refers to a problem with your application.
Please see the FAQ page for debugging suggestions
============================================================
   Binary file test463.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test463.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test463.py", line 38, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 463 test name: SquareSheetShelfAmrBamgGroundingline field: N/A
----------------finished:463-----------------------
----------------starting:464-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test464.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test464.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test464.py", line 38, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 464 test name: SquareSheetShelfAmrBamgIceFront field: N/A
----------------finished:464-----------------------
----------------starting:481-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test481.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test481.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test481.py", line 25, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 481 test name: TransientFrictionSchoof field: N/A
----------------finished:481-----------------------
----------------starting:492-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test492.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test492.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test492.py", line 30, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 492 test name: SquareSheetShelfTranMeltStreamlineUpwind  field: N/A
----------------finished:492-----------------------
----------------starting:493-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test493.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test493.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test493.py", line 31, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 493 test name: SquareSheetShelfTranMeltDG  field: N/A
----------------finished:493-----------------------
----------------starting:501-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as observed velocities
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.028778
   Total Core solution elapsed time:       0.0260314
   Linear solver elapsed time:             0.0161868 (62%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 4.7e-16 <   1e-12 test id: 501 test name: PigStressSSA2d field: Vx
SUCCESS difference: 4.4e-16 <   2e-12 test id: 501 test name: PigStressSSA2d field: Vy
SUCCESS difference: 6.3e-16 <   2e-12 test id: 501 test name: PigStressSSA2d field: Vel
SUCCESS difference: 1.1e-16 <   1e-13 test id: 501 test name: PigStressSSA2d field: Pressure
----------------finished:501-----------------------
----------------starting:502-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as observed velocities
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.0413628
   Total Core solution elapsed time:       0.0856252
   Linear solver elapsed time:             0.0431354 (50%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 3.7e-13 <   1e-08 test id: 502 test name: PigStressHO field: Vx
SUCCESS difference: 1.4e-13 <   1e-08 test id: 502 test name: PigStressHO field: Vy
SUCCESS difference: 2.2e-13 <   1e-08 test id: 502 test name: PigStressHO field: Vz
SUCCESS difference: 1.8e-13 <   1e-08 test id: 502 test name: PigStressHO field: Vel
SUCCESS difference: 1.1e-16 <   1e-08 test id: 502 test name: PigStressHO field: Pressure
----------------finished:502-----------------------
----------------starting:504-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as observed velocities
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> 
[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test504.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test504.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test504.py", line 18, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 504 test name: PigTranSSA2d field: N/A
----------------finished:504-----------------------
----------------starting:505-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as observed velocities
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test505.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test505.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test505.py", line 17, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 505 test name: PigTranSSA3d field: N/A
----------------finished:505-----------------------
----------------starting:506-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as observed velocities
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[
[
[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file
0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


============================================================
   Binary file test506.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test506.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test506.py", line 19, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 506 test name: PigTranHO field: N/A
----------------finished:506-----------------------
----------------starting:511-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as observed velocities
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:

       x       |  Cost function f(x)  |  List of contributions
====================== step 1/2 ===============================
 x =         0 | f(x) =    0.0537942  |      0.0537942
 x =         1 | f(x) =   0.04886803  |     0.04886803
====================== step 2/2 ===============================
 x =         0 | f(x) =   0.04875168  |     0.04875168
 x =         1 | f(x) =   0.05273747  |     0.05273747
 x =  0.381966 | f(x) =   0.04920111  |     0.04920111
 x =  0.618034 | f(x) =   0.05036058  |     0.05036058
write lock file:

   FemModel initialization elapsed time:   0.0251178
   Total Core solution elapsed time:       0.0958767
   Linear solver elapsed time:             0.0192327 (20%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 1.1e-13 <   5e-11 test id: 511 test name: PigCMBFS field: Gradient
SUCCESS difference: 3.8e-13 <   5e-11 test id: 511 test name: PigCMBFS field: Misfits
SUCCESS difference: 2.7e-13 <   5e-11 test id: 511 test name: PigCMBFS field: MaterialsRheologyB
SUCCESS difference: 1.2e-10 <   1e-09 test id: 511 test name: PigCMBFS field: Pressure
SUCCESS difference: 2.7e-13 <   1e-11 test id: 511 test name: PigCMBFS field: Vel
SUCCESS difference: 1.6e-13 <   5e-11 test id: 511 test name: PigCMBFS field: Vx
SUCCESS difference: 8.5e-14 <   1e-11 test id: 511 test name: PigCMBFS field: Vy
----------------finished:511-----------------------
----------------starting:512-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as observed velocities
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:

       x       |  Cost function f(x)  |  List of contributions
====================== step 1/2 ===============================
 x =         0 | f(x) =     125.7303  |       125.7296 0.0006420665
 x =         1 | f(x) =     119.1935  |       119.1928 0.0006447871
====================== step 2/2 ===============================
 x =         0 | f(x) =     119.1118  |       119.1111 0.0006447871
 x =         1 | f(x) =     112.5586  |       112.5579 0.0006652207
write lock file:

   FemModel initialization elapsed time:   0.0383056
   Total Core solution elapsed time:       0.1515 
   Linear solver elapsed time:             0.0578901 (38%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 1.2e-13 <   1e-11 test id: 512 test name: PigCMDragHO field: Gradient
SUCCESS difference: 2.9e-14 <   1e-11 test id: 512 test name: PigCMDragHO field: Misfits
SUCCESS difference: 7.1e-15 <   1e-11 test id: 512 test name: PigCMDragHO field: FrictionCoefficient
SUCCESS difference: 1.1e-16 <   1e-11 test id: 512 test name: PigCMDragHO field: Pressure
SUCCESS difference: 2.7e-13 <   1e-11 test id: 512 test name: PigCMDragHO field: Vel
SUCCESS difference: 2.3e-13 <   1e-11 test id: 512 test name: PigCMDragHO field: Vx
SUCCESS difference: 2.7e-13 <   1e-11 test id: 512 test name: PigCMDragHO field: Vy
----------------finished:512-----------------------
----------------starting:514-----------------------
----------------running-----------------------
Construction of a mesh from a given geometry
Construction of a mesh from a given geometry
      boundary conditions for stressbalance model: spc set as observed velocities
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
Anisotropic mesh adaptation

   new number of triangles = 485
Anisotropic mesh adaptation

   new number of triangles = 485
Anisotropic mesh adaptation

   new number of triangles = 1651
Anisotropic mesh adaptation

   new number of triangles = 6702
Anisotropic mesh adaptation

   new number of triangles = 2307
SUCCESS difference:       0 <   2e-10 test id: 514 test name: PigBamgMesh field: x1
SUCCESS difference:       0 <   7e-10 test id: 514 test name: PigBamgMesh field: y1
SUCCESS difference:       0 <   1e-13 test id: 514 test name: PigBamgMesh field: x2
SUCCESS difference:       0 <   1e-13 test id: 514 test name: PigBamgMesh field: y2
SUCCESS difference:       0 <   1e-13 test id: 514 test name: PigBamgMesh field: x3
SUCCESS difference:       0 <   1e-13 test id: 514 test name: PigBamgMesh field: y3
SUCCESS difference:       0 <   1e-13 test id: 514 test name: PigBamgMesh field: x4
SUCCESS difference:       0 <   1e-13 test id: 514 test name: PigBamgMesh field: y4
SUCCESS difference:       0 <   1e-13 test id: 514 test name: PigBamgMesh field: x5
SUCCESS difference:       0 <   1e-13 test id: 514 test name: PigBamgMesh field: y5
SUCCESS difference:       0 <   1e-13 test id: 514 test name: PigBamgMesh field: x6
SUCCESS difference:       0 <   1e-13 test id: 514 test name: PigBamgMesh field: y6
SUCCESS difference:       0 <   1e-13 test id: 514 test name: PigBamgMesh field: x7
SUCCESS difference:       0 <   1e-13 test id: 514 test name: PigBamgMesh field: y7
----------------finished:514-----------------------
----------------starting:515-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as observed velocities
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test515.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test515.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test515.py", line 23, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 515 test name: PigTherTranSUPG field: N/A
----------------finished:515-----------------------
----------------starting:517-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as observed velocities
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
converting inversion to m1qn3inversion
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:

┌────┬─────────────────┬────────────┬────────────────────────┐
│Iter│  Cost function  │ Grad. norm │  List of contributions │
├────┼─────────────────┼────────────┼────────────────────────┤
│  1 │ f(x)=  0.054509 │   1.32e-07 │   0.05451 6.124e-15    │
│  2 │ f(x)=7.0726e+11 │   1.78e+06 │   0.05377 7.073e+11    │
│  3 │ f(x)=7.0726e+07 │   1.78e+04 │   0.05376 7.073e+07    │
│  4 │ f(x)=1.7681e+05 │        892 │   0.05376 1.768e+05    │
│  5 │ f(x)=     11051 │        223 │   0.05376 1.105e+04    │
│  6 │ f(x)=    994.64 │       66.9 │   0.05376     994.6    │
│  7 │ f(x)=    89.566 │       20.1 │   0.05376     89.51    │
│  8 │ f(x)=    8.1099 │       6.02 │   0.05376     8.056    │
│  9 │ f(x)=   0.77881 │       1.81 │   0.05376    0.7251    │
│ 10 │ f(x)=   0.11901 │      0.542 │   0.05376   0.06525    │
│ 11 │ f(x)=  0.059631 │      0.163 │   0.05376  0.005873    │
└────┴─────────────────┴────────────┴────────────────────────┘
   stopped on dxmin during line search
write lock file:

   FemModel initialization elapsed time:   0.0286652
   Total Core solution elapsed time:       0.311093
   Linear solver elapsed time:             0.0575732 (19%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference:       0 <   6e-11 test id: 517 test name: PigCMBFSm1qn3 field: Gradient
SUCCESS difference: 2.6e-13 <   5e-11 test id: 517 test name: PigCMBFSm1qn3 field: Misfits
SUCCESS difference:       0 <   5e-10 test id: 517 test name: PigCMBFSm1qn3 field: MaterialsRheologyB
SUCCESS difference: 2.1e-10 <   1e-09 test id: 517 test name: PigCMBFSm1qn3 field: Pressure
SUCCESS difference: 1.1e-12 <   2e-11 test id: 517 test name: PigCMBFSm1qn3 field: Vel
SUCCESS difference: 6.2e-13 <   5e-11 test id: 517 test name: PigCMBFSm1qn3 field: Vx
SUCCESS difference: 3.7e-13 <   2e-11 test id: 517 test name: PigCMBFSm1qn3 field: Vy
----------------finished:517-----------------------
----------------starting:518-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as observed velocities
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.0288554
   Total Core solution elapsed time:       0.0788724
   Linear solver elapsed time:             0.0468878 (59%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference:   1e-15 <   5e-13 test id: 518 test name:  field: Vx
SUCCESS difference: 5.2e-16 <   6e-13 test id: 518 test name:  field: Vy
SUCCESS difference: 3.3e-16 <   6e-13 test id: 518 test name:  field: Vel
SUCCESS difference: 1.1e-16 <   1e-13 test id: 518 test name:  field: Pressure
SUCCESS difference:   1e-15 <   5e-13 test id: 518 test name:  field: VxSurface
SUCCESS difference: 5.2e-16 <   6e-13 test id: 518 test name:  field: VySurface
SUCCESS difference: 5.2e-16 <   1e-13 test id: 518 test name:  field: VxShear
SUCCESS difference: 6.4e-16 <   1e-13 test id: 518 test name:  field: VyShear
SUCCESS difference: 8.9e-16 <   5e-13 test id: 518 test name:  field: VxBase
SUCCESS difference: 5.2e-16 <   6e-13 test id: 518 test name:  field: VyBase
----------------finished:518-----------------------
----------------starting:540-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as observed velocities
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test540.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test540.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test540.py", line 34, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 540 test name: PigTranCalvingDevSSA2d field: N/A
----------------finished:540-----------------------
----------------starting:542-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as observed velocities
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test542.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test542.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test542.py", line 49, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 542 test name: PigTranFrontalforcingsrignot field: N/A
----------------finished:542-----------------------
----------------starting:546-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as observed velocities
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
      stochasticforcing.stocahstictimestep not specified: set to md.timestepping.time_step
      smb.lapserates not specified: set to 0
WARNING: md.timestepping.interp_forcing is 1, but be aware that there is no interpolation between covariance matrices
         the changes between covariance matrices occur at the time steps specified in md.stochasticforcing.timecovariance
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[
[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test546.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test546.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test546.py", line 123, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 546 test name: PigTranARMAandStochasticforcings field: N/A
----------------finished:546-----------------------
----------------starting:601-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.0255031
   Total Core solution elapsed time:       0.0302682
   Linear solver elapsed time:             0.0265143 (88%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 1.3e-15 <   1e-13 test id: 601 test name: 79NorthMasstransp2d field: Thickness
----------------finished:601-----------------------
----------------starting:602-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.0290162
   Total Core solution elapsed time:       0.0573183
   Linear solver elapsed time:             0.0297463 (52%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 1.3e-15 <   1e-13 test id: 602 test name: 79NorthMasstransp2dDG field: Thickness
----------------finished:602-----------------------
----------------starting:604-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.0320958
   Total Core solution elapsed time:       0.0335593
   Linear solver elapsed time:             0.0128044 (38%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 6.7e-16 <   1e-13 test id: 604 test name: 79NorthSurfSlop2d field: SurfaceSlopeX
SUCCESS difference: 5.8e-16 <   1e-13 test id: 604 test name: 79NorthSurfSlop2d field: SurfaceSlopeY
----------------finished:604-----------------------
----------------starting:608-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.264576
   Total Core solution elapsed time:       0.0112123
   Linear solver elapsed time:             0.00766353 (68%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 5.2e-16 <   1e-12 test id: 608 test name: 79NorthBalThic2d field: Thickness
----------------finished:608-----------------------
----------------starting:610-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test610.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test610.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test610.py", line 33, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 610 test name: 79NorthPISMhydro field: N/A
----------------finished:610-----------------------
----------------starting:612-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[
[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test612.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test612.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test612.py", line 39, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 612 test name: 79NorthPISMhydrofriction field: N/A
----------------finished:612-----------------------
----------------starting:613-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero

!! extract warning: spc values should be checked !!


uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
   preparing initial solution

       x       |  Cost function f(x)  |  List of contributions
====================== step 1/2 ===============================
 x =         0 | f(x) = 5.931532e+14  |   5.931532e+14
 x =         1 | f(x) = 5.011022e+14  |   5.011022e+14
====================== step 2/2 ===============================
 x =         0 | f(x) = 5.011022e+14  |   5.011022e+14
 x =         1 | f(x) = 4.265126e+14  |   4.265126e+14
   preparing final solution
write lock file:

   FemModel initialization elapsed time:   0.0361125
   Total Core solution elapsed time:       0.12482
   Linear solver elapsed time:             0.0911502 (73%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 9.1e-16 <   1e-12 test id: 613 test name: 79NorthCMBalThicVxVy field: Gradient1
SUCCESS difference:   1e-15 <   1e-12 test id: 613 test name: 79NorthCMBalThicVxVy field: Gradient2
SUCCESS difference:   5e-16 <   1e-12 test id: 613 test name: 79NorthCMBalThicVxVy field: Misfits
SUCCESS difference: 6.9e-17 <   1e-12 test id: 613 test name: 79NorthCMBalThicVxVy field: Vx
SUCCESS difference: 1.1e-16 <   1e-12 test id: 613 test name: 79NorthCMBalThicVxVy field: Vy
SUCCESS difference: 5.3e-16 <   1e-12 test id: 613 test name: 79NorthCMBalThicVxVy field: Thickness
----------------finished:613-----------------------
----------------starting:621-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
      stochasticforcing.stocahstictimestep not specified: set to md.timestepping.time_step
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> 
[./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test621.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test621.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test621.py", line 56, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 621 test name: 79NorthStochFrictionWaterPressure field: N/A
----------------finished:621-----------------------
----------------starting:701-----------------------
----------------running-----------------------
Construction of a mesh from a given geometry
 
=====Testing MINI Full-Stokes Finite element=====
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:

   solver residue: norm(KU-F)/norm(F)=1.33039e-16

   solver residue: norm(KU-F)/norm(F)=9.57467e-16

   solver residue: norm(KU-F)/norm(F)=1.19121e-16

   solver residue: norm(KU-F)/norm(F)=6.03192e-15
   mechanical equilibrium convergence criterion   100 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        7.19835e+23 > 1 %
   Convergence criterion: max(du)                 8.72588e+06
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.87287e-14
   mechanical equilibrium convergence criterion   2.12624 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        1.10539 > 1 %
   Convergence criterion: max(du)                 266316
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=3.11402e-14
   mechanical equilibrium convergence criterion   1.73917 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.642157 < 1 %
   Convergence criterion: max(du)                 136471
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=8.34035e-14
   mechanical equilibrium convergence criterion   0.717979 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.232724 < 1 %
   Convergence criterion: max(du)                 79604.1
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=5.84047e-14
   mechanical equilibrium convergence criterion   0.432302 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0930063 < 1 %
   Convergence criterion: max(du)                 25173.2
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=6.11386e-14
   mechanical equilibrium convergence criterion   0.265448 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0469947 < 1 %
   Convergence criterion: max(du)                 18682.5
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=6.14359e-14
   mechanical equilibrium convergence criterion   0.167098 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0264618 < 1 %
   Convergence criterion: max(du)                 12063.6
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=8.09116e-14
   mechanical equilibrium convergence criterion   0.106278 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0150307 < 1 %
   Convergence criterion: max(du)                 7028.6
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=4.97604e-14
   mechanical equilibrium convergence criterion   0.067923 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00855668 < 1 %
   Convergence criterion: max(du)                 3930.75
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=8.30767e-14
   mechanical equilibrium convergence criterion   0.0435415 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00491833 < 1 %
   Convergence criterion: max(du)                 2178.5
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=9.51428e-14
   mechanical equilibrium convergence criterion   0.0279973 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0028636 < 1 %
   Convergence criterion: max(du)                 1213.66
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=8.26251e-14
   mechanical equilibrium convergence criterion   0.0180659 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00168822 < 1 %
   Convergence criterion: max(du)                 682.744
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=7.48495e-14
   mechanical equilibrium convergence criterion   0.0117016 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00100627 < 1 %
   Convergence criterion: max(du)                 387.91
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=6.52364e-14
   mechanical equilibrium convergence criterion   0.00760798 < 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00060554 < 1 %
   Convergence criterion: max(du)                 222.316
   number of unstable constraints: 0

   total number of iterations: 14
write lock file:

   FemModel initialization elapsed time:   0.0799197
   Total Core solution elapsed time:       0.392602
   Linear solver elapsed time:             0.206704 (53%)

   Total elapsed time: 0 hrs 0 min 0 sec
 
=====Testing MINIcondensed Full-Stokes Finite element=====
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:

   solver residue: norm(KU-F)/norm(F)=1.33039e-16

   solver residue: norm(KU-F)/norm(F)=9.57467e-16

   solver residue: norm(KU-F)/norm(F)=1.19121e-16

   solver residue: norm(KU-F)/norm(F)=3.58124e-15
   mechanical equilibrium convergence criterion   100 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        7.19835e+23 > 1 %
   Convergence criterion: max(du)                 8.72588e+06
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=8.91029e-15
   mechanical equilibrium convergence criterion   1.96276 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        1.10539 > 1 %
   Convergence criterion: max(du)                 266316
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.68263e-14
   mechanical equilibrium convergence criterion   0.994782 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.642157 < 1 %
   Convergence criterion: max(du)                 136471
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=2.11572e-14
   mechanical equilibrium convergence criterion   0.635413 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.232724 < 1 %
   Convergence criterion: max(du)                 79604.1
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=2.61466e-14
   mechanical equilibrium convergence criterion   0.390791 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0930063 < 1 %
   Convergence criterion: max(du)                 25173.2
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=2.99704e-14
   mechanical equilibrium convergence criterion   0.243341 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0469947 < 1 %
   Convergence criterion: max(du)                 18682.5
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=3.5182e-14
   mechanical equilibrium convergence criterion   0.154189 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0264618 < 1 %
   Convergence criterion: max(du)                 12063.6
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=4.27558e-14
   mechanical equilibrium convergence criterion   0.0983817 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0150307 < 1 %
   Convergence criterion: max(du)                 7028.6
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=2.68886e-14
   mechanical equilibrium convergence criterion   0.063036 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00855668 < 1 %
   Convergence criterion: max(du)                 3930.75
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=2.99904e-14
   mechanical equilibrium convergence criterion   0.0405301 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00491833 < 1 %
   Convergence criterion: max(du)                 2178.5
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=3.04893e-14
   mechanical equilibrium convergence criterion   0.0261518 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0028636 < 1 %
   Convergence criterion: max(du)                 1213.66
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=4.08208e-14
   mechanical equilibrium convergence criterion   0.0169366 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00168822 < 1 %
   Convergence criterion: max(du)                 682.744
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=4.06537e-14
   mechanical equilibrium convergence criterion   0.0110089 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00100627 < 1 %
   Convergence criterion: max(du)                 387.91
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=3.8611e-14
   mechanical equilibrium convergence criterion   0.00718082 < 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00060554 < 1 %
   Convergence criterion: max(du)                 222.316
   number of unstable constraints: 0

   total number of iterations: 14
write lock file:

   FemModel initialization elapsed time:   0.0321938
   Total Core solution elapsed time:       0.373272
   Linear solver elapsed time:             0.141238 (38%)

   Total elapsed time: 0 hrs 0 min 0 sec
 
=====Testing TaylorHood Full-Stokes Finite element=====
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:

   solver residue: norm(KU-F)/norm(F)=1.33039e-16

   solver residue: norm(KU-F)/norm(F)=9.57467e-16

   solver residue: norm(KU-F)/norm(F)=1.19121e-16

   solver residue: norm(KU-F)/norm(F)=1.30215e-14
   mechanical equilibrium convergence criterion   100 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        7.20099e+23 > 1 %
   Convergence criterion: max(du)                 8.74189e+06
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=4.01704e-14
   mechanical equilibrium convergence criterion   2.00457 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        1.20805 > 1 %
   Convergence criterion: max(du)                 335077
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=9.16446e-14
   mechanical equilibrium convergence criterion   1.78268 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.75602 < 1 %
   Convergence criterion: max(du)                 132780
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.15725e-13
   mechanical equilibrium convergence criterion   0.832236 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.263456 < 1 %
   Convergence criterion: max(du)                 78736.2
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=2.04766e-13
   mechanical equilibrium convergence criterion   0.401028 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0758391 < 1 %
   Convergence criterion: max(du)                 23665.1
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.58632e-13
   mechanical equilibrium convergence criterion   0.238045 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0305218 < 1 %
   Convergence criterion: max(du)                 10429.3
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.80297e-13
   mechanical equilibrium convergence criterion   0.150226 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0152555 < 1 %
   Convergence criterion: max(du)                 6394.21
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.96953e-13
   mechanical equilibrium convergence criterion   0.0972593 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00801846 < 1 %
   Convergence criterion: max(du)                 3530.22
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=2.09809e-13
   mechanical equilibrium convergence criterion   0.0640213 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00429142 < 1 %
   Convergence criterion: max(du)                 1833.16
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.66636e-13
   mechanical equilibrium convergence criterion   0.0424357 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00234604 < 1 %
   Convergence criterion: max(du)                 940.664
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.88305e-13
   mechanical equilibrium convergence criterion   0.028166 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00130469 < 1 %
   Convergence criterion: max(du)                 481.928
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=2.71286e-13
   mechanical equilibrium convergence criterion   0.0186787 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.000736614 < 1 %
   Convergence criterion: max(du)                 247.852
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=2.49958e-13
   mechanical equilibrium convergence criterion   0.0123701 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.000421607 < 1 %
   Convergence criterion: max(du)                 128.51
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=2.09795e-13
   mechanical equilibrium convergence criterion   0.00818204 < 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.000244185 < 1 %
   Convergence criterion: max(du)                 67.3462
   number of unstable constraints: 0

   total number of iterations: 14
write lock file:

   FemModel initialization elapsed time:   0.0419484
   Total Core solution elapsed time:       0.916907
   Linear solver elapsed time:             0.575055 (63%)

   Total elapsed time: 0 hrs 0 min 0 sec
 
=====Testing LATaylorHood Full-Stokes Finite element=====
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:

   solver residue: norm(KU-F)/norm(F)=1.33039e-16

   solver residue: norm(KU-F)/norm(F)=9.57467e-16

   solver residue: norm(KU-F)/norm(F)=1.19121e-16

   solver residue: norm(KU-F)/norm(F)=2.03697e-13
   Convergence criterion: norm(du)/norm(u)        inf > 1 %

   solver residue: norm(KU-F)/norm(F)=8.86456e-13
   Convergence criterion: norm(du)/norm(u)        613.069 > 1 %

   solver residue: norm(KU-F)/norm(F)=1.67074e-12
   Convergence criterion: norm(du)/norm(u)        275.933 > 1 %

   solver residue: norm(KU-F)/norm(F)=2.49255e-12
   Convergence criterion: norm(du)/norm(u)        144.079 > 1 %

   solver residue: norm(KU-F)/norm(F)=3.066e-12
   Convergence criterion: norm(du)/norm(u)        81.951 > 1 %

   solver residue: norm(KU-F)/norm(F)=4.56611e-12
   Convergence criterion: norm(du)/norm(u)        49.2493 > 1 %

   solver residue: norm(KU-F)/norm(F)=4.16746e-12
   Convergence criterion: norm(du)/norm(u)        30.672 > 1 %

   solver residue: norm(KU-F)/norm(F)=7.42596e-12
   Convergence criterion: norm(du)/norm(u)        19.5516 > 1 %

   solver residue: norm(KU-F)/norm(F)=3.91013e-12
   Convergence criterion: norm(du)/norm(u)        12.654 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.86605e-12
   Convergence criterion: norm(du)/norm(u)        8.27209 > 1 %

   solver residue: norm(KU-F)/norm(F)=7.06034e-12
   Convergence criterion: norm(du)/norm(u)        5.44337 > 1 %

   solver residue: norm(KU-F)/norm(F)=7.03694e-12
   Convergence criterion: norm(du)/norm(u)        3.59763 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.62781e-12
   Convergence criterion: norm(du)/norm(u)        2.38464 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.68164e-12
   Convergence criterion: norm(du)/norm(u)        1.58367 > 1 %

   solver residue: norm(KU-F)/norm(F)=4.4633e-12
   Convergence criterion: norm(du)/norm(u)        1.05307 > 1 %

   solver residue: norm(KU-F)/norm(F)=8.00886e-12
   Convergence criterion: norm(du)/norm(u)        0.700842 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.52437e-17
   Convergence criterion: norm(du)/norm(u)        0.700842 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       inf > 1 %

   solver residue: norm(KU-F)/norm(F)=5.5385e-12
   Convergence criterion: norm(du)/norm(u)        0.466658 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.5445e-17
   Convergence criterion: norm(du)/norm(u)        0.466658 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       100.471 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.27529e-12
   Convergence criterion: norm(du)/norm(u)        0.310831 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.53028e-17
   Convergence criterion: norm(du)/norm(u)        0.310831 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       50.2749 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.07034e-12
   Convergence criterion: norm(du)/norm(u)        0.207079 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.19105e-17
   Convergence criterion: norm(du)/norm(u)        0.207079 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       33.5253 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.44341e-12
   Convergence criterion: norm(du)/norm(u)        0.137971 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.18522e-17
   Convergence criterion: norm(du)/norm(u)        0.137971 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       25.1428 > 1 %

   solver residue: norm(KU-F)/norm(F)=4.60902e-12
   Convergence criterion: norm(du)/norm(u)        0.0919261 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.18134e-17
   Convergence criterion: norm(du)/norm(u)        0.0919261 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       20.1099 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.20709e-12
   Convergence criterion: norm(du)/norm(u)        0.061242 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.17876e-17
   Convergence criterion: norm(du)/norm(u)        0.061242 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       16.7533 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.43141e-12
   Convergence criterion: norm(du)/norm(u)        0.0407918 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.17704e-17
   Convergence criterion: norm(du)/norm(u)        0.0407918 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       14.3552 > 1 %

   solver residue: norm(KU-F)/norm(F)=4.87958e-12
   Convergence criterion: norm(du)/norm(u)        0.0271613 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.1759e-17
   Convergence criterion: norm(du)/norm(u)        0.0271613 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       12.5566 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.63016e-12
   Convergence criterion: norm(du)/norm(u)        0.0180758 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.17513e-17
   Convergence criterion: norm(du)/norm(u)        0.0180758 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       11.1579 > 1 %

   solver residue: norm(KU-F)/norm(F)=9.60107e-12
   Convergence criterion: norm(du)/norm(u)        0.0120195 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.17463e-17
   Convergence criterion: norm(du)/norm(u)        0.0120195 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       10.0391 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.00939e-12
   Convergence criterion: norm(du)/norm(u)        0.0079825 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.17429e-17
   Convergence criterion: norm(du)/norm(u)        0.0079825 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       9.12392 > 1 %

   solver residue: norm(KU-F)/norm(F)=4.32647e-12
   Convergence criterion: norm(du)/norm(u)        0.0052914 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.17407e-17
   Convergence criterion: norm(du)/norm(u)        0.0052914 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       8.36151 > 1 %

   solver residue: norm(KU-F)/norm(F)=1.10387e-11
   Convergence criterion: norm(du)/norm(u)        0.00349749 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.17392e-17
   Convergence criterion: norm(du)/norm(u)        0.00349749 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       7.71658 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.11705e-12
   Convergence criterion: norm(du)/norm(u)        0.00230167 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.17383e-17
   Convergence criterion: norm(du)/norm(u)        0.00230167 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       7.16395 > 1 %

   solver residue: norm(KU-F)/norm(F)=7.74306e-12
   Convergence criterion: norm(du)/norm(u)        0.00150451 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.17376e-17
   Convergence criterion: norm(du)/norm(u)        0.00150451 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       6.68514 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.7777e-12
   Convergence criterion: norm(du)/norm(u)        0.000973122 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.17372e-17
   Convergence criterion: norm(du)/norm(u)        0.000973122 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       6.26629 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.71371e-12
   Convergence criterion: norm(du)/norm(u)        0.000618904 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.1737e-17
   Convergence criterion: norm(du)/norm(u)        0.000618904 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       5.89682 > 1 %

   solver residue: norm(KU-F)/norm(F)=4.45688e-12
   Convergence criterion: norm(du)/norm(u)        0.000382794 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.17368e-17
   Convergence criterion: norm(du)/norm(u)        0.000382794 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       5.56848 > 1 %

   solver residue: norm(KU-F)/norm(F)=4.0268e-12
   Convergence criterion: norm(du)/norm(u)        0.000225423 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.17367e-17
   Convergence criterion: norm(du)/norm(u)        0.000225423 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       5.27476 > 1 %
   maximum number of nonlinear iterations (20) exceeded

   total number of iterations: 19
write lock file:

   FemModel initialization elapsed time:   0.0505189
   Total Core solution elapsed time:       2.03608
   Linear solver elapsed time:             0.946579 (46%)

   Total elapsed time: 0 hrs 0 min 2 sec
 
=====Testing CrouzeixRaviart Full-Stokes Finite element=====
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:

   solver residue: norm(KU-F)/norm(F)=1.33039e-16

   solver residue: norm(KU-F)/norm(F)=9.57467e-16

   solver residue: norm(KU-F)/norm(F)=1.19121e-16

   solver residue: norm(KU-F)/norm(F)=1.67784e-13
   mechanical equilibrium convergence criterion   100 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        1.63969e+24 > 1 %
   Convergence criterion: max(du)                 8.83861e+06
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=4.10863e-13
   mechanical equilibrium convergence criterion   2.11064 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        1.08444 > 1 %
   Convergence criterion: max(du)                 446853
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=6.5399e-13
   mechanical equilibrium convergence criterion   2.09404 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.862624 < 1 %
   Convergence criterion: max(du)                 414759
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=7.76114e-13
   mechanical equilibrium convergence criterion   0.909059 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.341995 < 1 %
   Convergence criterion: max(du)                 161809
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=7.88557e-13
   mechanical equilibrium convergence criterion   0.479574 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.131721 < 1 %
   Convergence criterion: max(du)                 90123.3
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=8.63873e-13
   mechanical equilibrium convergence criterion   0.284195 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0670162 < 1 %
   Convergence criterion: max(du)                 54409.5
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=8.46391e-13
   mechanical equilibrium convergence criterion   0.175223 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0291123 < 1 %
   Convergence criterion: max(du)                 25524.6
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.12113e-12
   mechanical equilibrium convergence criterion   0.113576 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0147368 < 1 %
   Convergence criterion: max(du)                 11821.9
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.04582e-12
   mechanical equilibrium convergence criterion   0.0746106 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00819942 < 1 %
   Convergence criterion: max(du)                 6242.62
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=8.60439e-13
   mechanical equilibrium convergence criterion   0.0495047 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00471128 < 1 %
   Convergence criterion: max(du)                 3515.55
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.19633e-12
   mechanical equilibrium convergence criterion   0.0329431 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00276078 < 1 %
   Convergence criterion: max(du)                 2073.3
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.12288e-12
   mechanical equilibrium convergence criterion   0.0218954 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00164519 < 1 %
   Convergence criterion: max(du)                 1261.94
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.09959e-12
   mechanical equilibrium convergence criterion   0.0145181 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.000994648 < 1 %
   Convergence criterion: max(du)                 783.637
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.31335e-12
   mechanical equilibrium convergence criterion   0.00960519 < 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.000608466 < 1 %
   Convergence criterion: max(du)                 492.666
   number of unstable constraints: 0

   total number of iterations: 14
write lock file:

   FemModel initialization elapsed time:   0.0316896
   Total Core solution elapsed time:       1.24825
   Linear solver elapsed time:             0.8702  (70%)

   Total elapsed time: 0 hrs 0 min 1 sec
 
=====Testing LACrouzeixRaviart Full-Stokes Finite element=====
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:

   solver residue: norm(KU-F)/norm(F)=1.33039e-16

   solver residue: norm(KU-F)/norm(F)=9.57467e-16

   solver residue: norm(KU-F)/norm(F)=1.19121e-16

   solver residue: norm(KU-F)/norm(F)=2.18958e-13
   Convergence criterion: norm(du)/norm(u)        inf > 1 %

   solver residue: norm(KU-F)/norm(F)=9.13342e-13
   Convergence criterion: norm(du)/norm(u)        613.091 > 1 %

   solver residue: norm(KU-F)/norm(F)=2.10594e-12
   Convergence criterion: norm(du)/norm(u)        275.944 > 1 %

   solver residue: norm(KU-F)/norm(F)=2.53235e-12
   Convergence criterion: norm(du)/norm(u)        144.085 > 1 %

   solver residue: norm(KU-F)/norm(F)=4.10566e-12
   Convergence criterion: norm(du)/norm(u)        81.9547 > 1 %

   solver residue: norm(KU-F)/norm(F)=4.1214e-12
   Convergence criterion: norm(du)/norm(u)        49.2514 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.31446e-12
   Convergence criterion: norm(du)/norm(u)        30.6732 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.68395e-12
   Convergence criterion: norm(du)/norm(u)        19.5522 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.34112e-12
   Convergence criterion: norm(du)/norm(u)        12.6543 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.01705e-12
   Convergence criterion: norm(du)/norm(u)        8.27219 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.94131e-12
   Convergence criterion: norm(du)/norm(u)        5.44338 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.87639e-12
   Convergence criterion: norm(du)/norm(u)        3.5976 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.89727e-12
   Convergence criterion: norm(du)/norm(u)        2.3846 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.05662e-12
   Convergence criterion: norm(du)/norm(u)        1.58362 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.58428e-12
   Convergence criterion: norm(du)/norm(u)        1.05304 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.45924e-12
   Convergence criterion: norm(du)/norm(u)        0.700815 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.3322e-16
   Convergence criterion: norm(du)/norm(u)        0.700815 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       inf > 1 %

   solver residue: norm(KU-F)/norm(F)=4.74837e-12
   Convergence criterion: norm(du)/norm(u)        0.466662 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.31696e-16
   Convergence criterion: norm(du)/norm(u)        0.466662 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       100.47 > 1 %

   solver residue: norm(KU-F)/norm(F)=7.57086e-12
   Convergence criterion: norm(du)/norm(u)        0.310857 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.28033e-16
   Convergence criterion: norm(du)/norm(u)        0.310857 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       50.2739 > 1 %

   solver residue: norm(KU-F)/norm(F)=1.06073e-11
   Convergence criterion: norm(du)/norm(u)        0.207121 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.31591e-16
   Convergence criterion: norm(du)/norm(u)        0.207121 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       33.5245 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.93856e-12
   Convergence criterion: norm(du)/norm(u)        0.138023 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.32529e-16
   Convergence criterion: norm(du)/norm(u)        0.138023 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       25.1423 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.94459e-12
   Convergence criterion: norm(du)/norm(u)        0.0919849 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.35364e-16
   Convergence criterion: norm(du)/norm(u)        0.0919849 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       20.1095 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.02271e-12
   Convergence criterion: norm(du)/norm(u)        0.0613056 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.27882e-16
   Convergence criterion: norm(du)/norm(u)        0.0613056 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       16.753 > 1 %

   solver residue: norm(KU-F)/norm(F)=7.03817e-12
   Convergence criterion: norm(du)/norm(u)        0.0408587 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.28198e-16
   Convergence criterion: norm(du)/norm(u)        0.0408587 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       14.355 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.49282e-12
   Convergence criterion: norm(du)/norm(u)        0.0272303 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.29446e-16
   Convergence criterion: norm(du)/norm(u)        0.0272303 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       12.5564 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.42296e-12
   Convergence criterion: norm(du)/norm(u)        0.0181463 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.3024e-16
   Convergence criterion: norm(du)/norm(u)        0.0181463 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       11.1577 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.23114e-12
   Convergence criterion: norm(du)/norm(u)        0.012091 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.34859e-16
   Convergence criterion: norm(du)/norm(u)        0.012091 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       10.039 > 1 %

   solver residue: norm(KU-F)/norm(F)=7.60368e-12
   Convergence criterion: norm(du)/norm(u)        0.00805457 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.19764e-16
   Convergence criterion: norm(du)/norm(u)        0.00805457 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       9.12383 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.41001e-12
   Convergence criterion: norm(du)/norm(u)        0.0053639 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.21819e-16
   Convergence criterion: norm(du)/norm(u)        0.0053639 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       8.36144 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.72389e-12
   Convergence criterion: norm(du)/norm(u)        0.00357027 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.30793e-16
   Convergence criterion: norm(du)/norm(u)        0.00357027 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       7.71653 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.38237e-12
   Convergence criterion: norm(du)/norm(u)        0.00237462 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.25338e-16
   Convergence criterion: norm(du)/norm(u)        0.00237462 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       7.16391 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.99143e-12
   Convergence criterion: norm(du)/norm(u)        0.00157758 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.30202e-16
   Convergence criterion: norm(du)/norm(u)        0.00157758 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       6.68511 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.46449e-12
   Convergence criterion: norm(du)/norm(u)        0.00104627 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.34639e-16
   Convergence criterion: norm(du)/norm(u)        0.00104627 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       6.26627 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.77419e-12
   Convergence criterion: norm(du)/norm(u)        0.000692084 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.32317e-16
   Convergence criterion: norm(du)/norm(u)        0.000692084 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       5.8968 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.76803e-12
   Convergence criterion: norm(du)/norm(u)        0.000455983 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.26675e-16
   Convergence criterion: norm(du)/norm(u)        0.000455983 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       5.56847 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.71662e-12
   Convergence criterion: norm(du)/norm(u)        0.000298598 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.26361e-16
   Convergence criterion: norm(du)/norm(u)        0.000298598 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       5.27476 > 1 %
   maximum number of nonlinear iterations (20) exceeded

   total number of iterations: 19
write lock file:

   FemModel initialization elapsed time:   0.0878172
   Total Core solution elapsed time:       2.74567
   Linear solver elapsed time:             1.58787 (58%)

   Total elapsed time: 0 hrs 0 min 2 sec
SUCCESS difference:   3e-12 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VxMINI
SUCCESS difference: 3.6e-12 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VyMINI
SUCCESS difference: 3.5e-12 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VelMINI
SUCCESS difference: 8.1e-13 <   1e-10 test id: 701 test name: FlowbandFSshelf field: PressureMINI
SUCCESS difference: 1.7e-12 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VxMINIcondensed
SUCCESS difference: 2.3e-12 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VyMINIcondensed
SUCCESS difference: 2.2e-12 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VelMINIcondensed
SUCCESS difference: 4.2e-13 <   1e-10 test id: 701 test name: FlowbandFSshelf field: PressureMINIcondensed
SUCCESS difference: 4.4e-12 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VxTaylorHood
SUCCESS difference: 5.7e-12 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VyTaylorHood
SUCCESS difference: 5.6e-12 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VelTaylorHood
SUCCESS difference: 6.7e-13 <   1e-10 test id: 701 test name: FlowbandFSshelf field: PressureTaylorHood
SUCCESS difference:   1e-11 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VxLATaylorHood
SUCCESS difference: 1.3e-11 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VyLATaylorHood
SUCCESS difference: 1.3e-11 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VelLATaylorHood
SUCCESS difference: 2.7e-12 <   1e-10 test id: 701 test name: FlowbandFSshelf field: PressureLATaylorHood
SUCCESS difference: 1.8e-11 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VxCrouzeixRaviart
SUCCESS difference: 1.7e-11 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VyCrouzeixRaviart
SUCCESS difference: 1.7e-11 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VelCrouzeixRaviart
SUCCESS difference: 3.4e-12 <   1e-10 test id: 701 test name: FlowbandFSshelf field: PressureCrouzeixRaviart
SUCCESS difference: 3.2e-12 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VxLACrouzeixRaviart
SUCCESS difference: 3.9e-12 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VyLACrouzeixRaviart
SUCCESS difference: 3.9e-12 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VelLACrouzeixRaviart
SUCCESS difference: 5.3e-12 <   1e-10 test id: 701 test name: FlowbandFSshelf field: PressureLACrouzeixRaviart
----------------finished:701-----------------------
----------------starting:702-----------------------
----------------running-----------------------
/home/jenkins/workspace/Debian_Linux-Python/src/m/geometry/NowickiProfile.py:35: ComplexWarning: Casting complex values to real discards the imaginary part
  s[i] = ss[j]
Construction of a mesh from a given geometry
 
 == == == Testing MINI Full - Stokes Finite element == == = 
checking model consistency
marshalling file 'test702'.bin
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
   computing new velocity
computing slope...
   extruding SurfaceSlopeX from base...
   computing slope
   computing basal mass balance
   maximum number of nonlinear iterations (20) exceeded
write lock file:

   FemModel initialization elapsed time:   0.0709294
   Total Core solution elapsed time:       1.02827
   Linear solver elapsed time:             0.571536 (56%)

   Total elapsed time: 0 hrs 0 min 1 sec
loading results from cluster
 
 == == == Testing MINIcondensed Full - Stokes Finite element == == = 
checking model consistency
marshalling file 'test702'.bin
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
   computing new velocity
computing slope...
   extruding SurfaceSlopeX from base...
   computing slope
   computing basal mass balance
   maximum number of nonlinear iterations (20) exceeded
write lock file:

   FemModel initialization elapsed time:   0.0385895
   Total Core solution elapsed time:       0.607215
   Linear solver elapsed time:             0.213256 (35%)

   Total elapsed time: 0 hrs 0 min 0 sec
loading results from cluster
 
 == == == Testing TaylorHood Full - Stokes Finite element == == = 
checking model consistency
marshalling file 'test702'.bin
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
   computing new velocity
computing slope...
   extruding SurfaceSlopeX from base...
   computing slope
   computing basal mass balance
write lock file:

   FemModel initialization elapsed time:   0.0303302
   Total Core solution elapsed time:       1.1559 
   Linear solver elapsed time:             0.628737 (54%)

   Total elapsed time: 0 hrs 0 min 1 sec
loading results from cluster
 
 == == == Testing XTaylorHood Full - Stokes Finite element == == = 
checking model consistency
marshalling file 'test702'.bin
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
   computing new velocity
computing slope...
   extruding SurfaceSlopeX from base...
   computing slope
   computing basal mass balance
write lock file:

   FemModel initialization elapsed time:   0.0385591
   Total Core solution elapsed time:       0.315466
   Linear solver elapsed time:             0.123195 (39%)

   Total elapsed time: 0 hrs 0 min 0 sec
loading results from cluster
 
 == == == Testing LATaylorHood Full - Stokes Finite element == == = 
checking model consistency
marshalling file 'test702'.bin
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
   computing new velocity
computing slope...
   extruding SurfaceSlopeX from base...
   computing slope
   computing basal mass balance
write lock file:

   FemModel initialization elapsed time:   0.0285269
   Total Core solution elapsed time:       0.763976
   Linear solver elapsed time:             0.373369 (49%)

   Total elapsed time: 0 hrs 0 min 0 sec
loading results from cluster
SUCCESS difference: 9.8e-10 <   8e-05 test id: 702 test name: FlowbandFSsheetshelf field: VxMINI
SUCCESS difference: 9.5e-10 <   8e-05 test id: 702 test name: FlowbandFSsheetshelf field: VyMINI
SUCCESS difference: 9.5e-10 <   8e-05 test id: 702 test name: FlowbandFSsheetshelf field: VelMINI
SUCCESS difference:   6e-11 <   1e-08 test id: 702 test name: FlowbandFSsheetshelf field: PressureMINI
SUCCESS difference: 1.1e-10 <   8e-05 test id: 702 test name: FlowbandFSsheetshelf field: VxMINIcondensed
SUCCESS difference: 1.2e-10 <   8e-05 test id: 702 test name: FlowbandFSsheetshelf field: VyMINIcondensed
SUCCESS difference: 1.2e-10 <   8e-05 test id: 702 test name: FlowbandFSsheetshelf field: VelMINIcondensed
SUCCESS difference: 4.4e-10 <   1e-08 test id: 702 test name: FlowbandFSsheetshelf field: PressureMINIcondensed
SUCCESS difference:   3e-09 <   8e-05 test id: 702 test name: FlowbandFSsheetshelf field: VxTaylorHood
SUCCESS difference:   3e-09 <   8e-05 test id: 702 test name: FlowbandFSsheetshelf field: VyTaylorHood
SUCCESS difference:   3e-09 <   8e-05 test id: 702 test name: FlowbandFSsheetshelf field: VelTaylorHood
SUCCESS difference: 7.8e-10 <   1e-08 test id: 702 test name: FlowbandFSsheetshelf field: PressureTaylorHood
SUCCESS difference: 1.6e-09 <   8e-05 test id: 702 test name: FlowbandFSsheetshelf field: VxXTaylorHood
SUCCESS difference: 7.5e-09 <   8e-05 test id: 702 test name: FlowbandFSsheetshelf field: VyXTaylorHood
SUCCESS difference: 7.5e-09 <   8e-05 test id: 702 test name: FlowbandFSsheetshelf field: VelXTaylorHood
SUCCESS difference: 7.3e-14 <   1e-08 test id: 702 test name: FlowbandFSsheetshelf field: PressureXTaylorHood
SUCCESS difference: 1.2e-08 <   8e-05 test id: 702 test name: FlowbandFSsheetshelf field: VxLATaylorHood
SUCCESS difference: 1.1e-08 <   8e-05 test id: 702 test name: FlowbandFSsheetshelf field: VyLATaylorHood
SUCCESS difference: 1.1e-08 <   8e-05 test id: 702 test name: FlowbandFSsheetshelf field: VelLATaylorHood
SUCCESS difference: 2.2e-11 <   1e-08 test id: 702 test name: FlowbandFSsheetshelf field: PressureLATaylorHood
----------------finished:702-----------------------
----------------starting:801-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test801.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test801.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test801.py", line 25, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 801 test name: ValleyGlacierLevelsetSSA2d field: N/A
----------------finished:801-----------------------
----------------starting:803-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test803.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test803.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test803.py", line 33, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 803 test name: ValleyGlacierLevelsetEnthalpyHO3d field: N/A
----------------finished:803-----------------------
----------------starting:804-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero

 !!! Warning: SIA's model is not consistent on ice shelves !!!

uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test804.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test804.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test804.py", line 30, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 804 test name: ValleyGlacierLevelsetCalvingSIA2d field: N/A
----------------finished:804-----------------------
----------------starting:806-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

[1] ??? Error using ==> 
./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test806.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test806.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test806.py", line 46, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 806 test name: SquareShelfLevelsetCalvingSSA2dLevermann field: N/A
----------------finished:806-----------------------
----------------starting:809-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[
[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test809.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test809.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test809.py", line 36, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 809 test name: ValleyGlacierLevelsetCalvingSSA2dCrevassedepth field: N/A
----------------finished:809-----------------------
----------------starting:810-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[
[
[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1 error message: could not find data with name "md.mmemasstransport.ids" in binary file

] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test810.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test810.outbin does not exist
Traceback (most recent call last):
  File "/home/jenkins/workspace/Debian_Linux-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test810.py", line 27, in <module>
    md = solve(md, 'Transient')
         ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/jenkins/workspace/Debian_Linux-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
           ^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 810 test name: ValleyGlacierLevelsetMOLHO2d field: N/A
----------------finished:810-----------------------
----------------starting:902-----------------------
----------------running-----------------------
      no hydrology.basal_moulin_input specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.0226121
   Total Core solution elapsed time:       0.251305
   Linear solver elapsed time:             0.0659411 (26%)

   Total elapsed time: 0 hrs 0 min 0 sec
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.0161733
   Total Core solution elapsed time:       0.292041
   Linear solver elapsed time:             0.0744285 (25%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 5.7e-16 <   1e-13 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: SedimentWaterHead1
SUCCESS difference:       0 <   1e-13 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: EplWaterHead1
SUCCESS difference:       0 <   1e-13 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: SedimentHeadResidual1
SUCCESS difference:   1e-15 <   1e-13 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: SedimentWaterHead4
SUCCESS difference:       0 <   1e-13 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: EplWaterHead4
SUCCESS difference:       0 <   1e-13 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: SedimentHeadResidual4
SUCCESS difference: 1.4e-15 <   1e-13 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: SedimentWaterHead5
SUCCESS difference: 1.1e-14 <   5e-12 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: EplWaterHead5
SUCCESS difference:       0 <   1e-11 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: SedimentHeadResidual5
SUCCESS difference: 2.4e-15 <   1e-13 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: SedimentWaterHead9
SUCCESS difference: 2.8e-14 <   5e-12 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: EplWaterHead9
SUCCESS difference:       0 <   1e-11 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: SedimentHeadResidual9
SUCCESS difference: 2.5e-14 <   1e-13 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: EplWaterHead10
SUCCESS difference: 3.3e-14 <   1e-13 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: EplWaterHeadSubstep10
SUCCESS difference: 1.3e-15 <   1e-13 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: SedimentWaterHead10
SUCCESS difference: 2.3e-15 <   1e-13 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: SedimentWaterHeadSubstep10
----------------finished:902-----------------------
----------------starting:905-----------------------
----------------running-----------------------
      no hydrology.basal_moulin_input specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.0203745
   Total Core solution elapsed time:       1.77005
   Linear solver elapsed time:             0.265789 (15%)

   Total elapsed time: 0 hrs 0 min 1 sec
WARNING! There are options you set that were not used!
WARNING! could be spelling mistake, etc!
There are 6 unused database options. They are:
Option left: name:-ksp_type value: preonly source: code
Option left: name:-mat_mumps_icntl_14 value: 120 source: code
Option left: name:-mat_mumps_icntl_28 value: 1 source: code
Option left: name:-mat_mumps_icntl_29 value: 2 source: code
Option left: name:-pc_factor_mat_solver_type value: mumps source: code
Option left: name:-pc_type value: lu source: code
SUCCESS difference:       0 <   1e-13 test id: 905 test name: SquareNoDynHydrologyDCSmbCoupled field: SedimentWaterHead1
SUCCESS difference:       0 <   1e-13 test id: 905 test name: SquareNoDynHydrologyDCSmbCoupled field: EplWaterHead1
SUCCESS difference:       0 <   1e-13 test id: 905 test name: SquareNoDynHydrologyDCSmbCoupled field: SedimentHeadResidual1
SUCCESS difference:       0 <   1e-13 test id: 905 test name: SquareNoDynHydrologyDCSmbCoupled field: SedimentWaterHead4
SUCCESS difference:       0 <   1e-13 test id: 905 test name: SquareNoDynHydrologyDCSmbCoupled field: EplWaterHead4
SUCCESS difference:       0 <   1e-13 test id: 905 test name: SquareNoDynHydrologyDCSmbCoupled field: SedimentHeadResidual4
SUCCESS difference:       0 <   1e-13 test id: 905 test name: SquareNoDynHydrologyDCSmbCoupled field: SedimentWaterHead5
SUCCESS difference:       0 <   5e-12 test id: 905 test name: SquareNoDynHydrologyDCSmbCoupled field: EplWaterHead5
SUCCESS difference:       0 <   1e-11 test id: 905 test name: SquareNoDynHydrologyDCSmbCoupled field: SedimentHeadResidual5
SUCCESS difference: 1.3e-15 <   1e-13 test id: 905 test name: SquareNoDynHydrologyDCSmbCoupled field: SedimentWaterHead9
SUCCESS difference:       0 <   5e-12 test id: 905 test name: SquareNoDynHydrologyDCSmbCoupled field: EplWaterHead9
SUCCESS difference:       0 <   1e-11 test id: 905 test name: SquareNoDynHydrologyDCSmbCoupled field: SedimentHeadResidual9
SUCCESS difference:       0 <   1e-13 test id: 905 test name: SquareNoDynHydrologyDCSmbCoupled field: EplWaterHead20
SUCCESS difference:       0 <   1e-13 test id: 905 test name: SquareNoDynHydrologyDCSmbCoupled field: EplWaterHeadSubstep20
SUCCESS difference: 2.6e-15 <   1e-13 test id: 905 test name: SquareNoDynHydrologyDCSmbCoupled field: SedimentWaterHead20
SUCCESS difference: 3.1e-15 <   1e-13 test id: 905 test name: SquareNoDynHydrologyDCSmbCoupled field: SedimentWaterHeadSubstep20
----------------finished:905-----------------------
----------------starting:906-----------------------
----------------running-----------------------
      no hydrology.basal_moulin_input specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.0192271
   Total Core solution elapsed time:       7.58303
   Linear solver elapsed time:             2.83705 (37%)

   Total elapsed time: 0 hrs 0 min 7 sec
SUCCESS difference: 1.1e-15 <   1e-13 test id: 906 test name: SquareNoDynHydrologyDCtimeadapt field: SedimentWaterHead2
SUCCESS difference: 2.9e-14 <   1e-13 test id: 906 test name: SquareNoDynHydrologyDCtimeadapt field: EplWaterHead2
SUCCESS difference: 3.9e-14 <   1e-13 test id: 906 test name: SquareNoDynHydrologyDCtimeadapt field: SedimentHeadResidual2
SUCCESS difference: 1.9e-15 <   1e-13 test id: 906 test name: SquareNoDynHydrologyDCtimeadapt field: SedimentHeadSubstep2
SUCCESS difference: 2.6e-14 <   1e-13 test id: 906 test name: SquareNoDynHydrologyDCtimeadapt field: EplHeadSubstep2
SUCCESS difference:       0 <   1e-13 test id: 906 test name: SquareNoDynHydrologyDCtimeadapt field: HydrologySubsteps2
SUCCESS difference:       0 <   1e-13 test id: 906 test name: SquareNoDynHydrologyDCtimeadapt field: HydrologySubTime2
SUCCESS difference: 1.6e-15 <   1e-13 test id: 906 test name: SquareNoDynHydrologyDCtimeadapt field: SedimentWaterHead3
SUCCESS difference: 1.4e-14 <   1e-13 test id: 906 test name: SquareNoDynHydrologyDCtimeadapt field: EplWaterHead3
SUCCESS difference: 1.4e-14 <   1e-13 test id: 906 test name: SquareNoDynHydrologyDCtimeadapt field: SedimentHeadResidual3
----------------finished:906-----------------------
-----------End of python_log.log-----------
Build step 'Execute shell' marked build as failure
Recording test results
Finished: FAILURE