Skip to content
Failed

Console Output

This log is too long to show here, 12,222 KB has been skipped — click to see the complete log
----------------finished:338-----------------------
----------------starting:339-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test339.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test339.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test339.py", line 34, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 339 test name: SquareSheetConstrainedSmbMeltComponents3d field: N/A
----------------finished:339-----------------------
----------------starting:342-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no dsl.global_average_thermosteric_sea_level specified: transient values set to zero
      no dsl.sea_surface_height_above_geoid specified: transient values set to zero
      no dsl.sea_water_pressure_at_sea_floor specified: transient values set to zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.008698
   Total Core solution elapsed time:       0.058315
   Linear solver elapsed time:             0.035764 (61%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 1.9e-15 <   1e-13 test id: 342 test name: SquareSheetTherSteaPlume field: Temperature
SUCCESS difference: 2.7e-09 <   1e-08 test id: 342 test name: SquareSheetTherSteaPlume field: BasalforcingsGroundediceMeltingRate
SUCCESS difference: 1.2e-15 <   1e-13 test id: 342 test name: SquareSheetTherSteaPlume field: BasalforcingsGeothermalflux
----------------finished:342-----------------------
----------------starting:343-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no dsl.global_average_thermosteric_sea_level specified: transient values set to zero
      no dsl.sea_surface_height_above_geoid specified: transient values set to zero
      no dsl.sea_water_pressure_at_sea_floor specified: transient values set to zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test343.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test343.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test343.py", line 30, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 343 test name: SquareSheetConstrainedSmbGradientsEla2d field: N/A
----------------finished:343-----------------------
----------------starting:346-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no dsl.global_average_thermosteric_sea_level specified: transient values set to zero
      no dsl.sea_surface_height_above_geoid specified: transient values set to zero
      no dsl.sea_water_pressure_at_sea_floor specified: transient values set to zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test346.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test346.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test346.py", line 25, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 346 test name: SquareSheetConstrainedTherTranNyeCO2 field: N/A
----------------finished:346-----------------------
----------------starting:347-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no dsl.global_average_thermosteric_sea_level specified: transient values set to zero
      no dsl.sea_surface_height_above_geoid specified: transient values set to zero
      no dsl.sea_water_pressure_at_sea_floor specified: transient values set to zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test347.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test347.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test347.py", line 28, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 347 test name: SquareSheetConstrainedTherTranNyeH2O field: N/A
----------------finished:347-----------------------
----------------starting:352-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: 
[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test352.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test352.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test352.py", line 30, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 352 test name: SquareSheetConstrainedSmbforcingClim2d field: N/A
----------------finished:352-----------------------
----------------starting:353-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test353.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test353.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test353.py", line 34, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 353 test name: SquareSheetConstrainedSmbComponentsClim2d field: N/A
----------------finished:353-----------------------
----------------starting:356-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no dsl.global_average_thermosteric_sea_level specified: transient values set to zero
      no dsl.sea_surface_height_above_geoid specified: transient values set to zero
      no dsl.sea_water_pressure_at_sea_floor specified: transient values set to zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:

       x       |  Cost function f(x)  |  List of contributions
====================== step 1/2 ===============================
 x =         0 | f(x) =      1008983  |        1008983 3.838459e-34
 x =         1 | f(x) =     915273.6  |       915273.6  1.12984e-05
 x =  0.381966 | f(x) =     899226.1  |       899226.1 1.648414e-06
 x =  0.618034 | f(x) =     873055.8  |       873055.8 4.315604e-06
====================== step 2/2 ===============================
 x =         0 | f(x) =     857940.3  |       857940.3 4.315604e-06
 x =         1 | f(x) =     803900.7  |       803900.7 2.963215e-05
 x =  0.381966 | f(x) =       807722  |         807722 1.131055e-05
 x =  0.618034 | f(x) =     795880.1  |       795880.1 1.728697e-05
write lock file:

   FemModel initialization elapsed time:   0.009905
   Total Core solution elapsed time:       0.221197
   Linear solver elapsed time:             0.162632 (74%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 2.3e-15 <   1e-12 test id: 356 test name: TransientFrictionSchoof field: Gradient
SUCCESS difference: 5.5e-15 <   1e-13 test id: 356 test name: TransientFrictionSchoof field: Misfits
SUCCESS difference: 1.4e-16 <   1e-13 test id: 356 test name: TransientFrictionSchoof field: FrictionC
SUCCESS difference:       0 <   1e-13 test id: 356 test name: TransientFrictionSchoof field: Pressure
SUCCESS difference: 6.6e-16 <   1e-13 test id: 356 test name: TransientFrictionSchoof field: Vel
SUCCESS difference: 1.6e-15 <   1e-13 test id: 356 test name: TransientFrictionSchoof field: Vx
SUCCESS difference: 8.4e-16 <   1e-13 test id: 356 test name: TransientFrictionSchoof field: Vy
----------------finished:356-----------------------
----------------starting:359-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no dsl.global_average_thermosteric_sea_level specified: transient values set to zero
      no dsl.sea_surface_height_above_geoid specified: transient values set to zero
      no dsl.sea_water_pressure_at_sea_floor specified: transient values set to zero
      no balancethickness.thickening_rate specified: values set as zero
checking model consistency
marshalling file 'testChannels'.bin
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
iteration 1/4  time [yr]: 0.00 (time step: 0.00)
   updating effective pressure
   saving temporary results
iteration 2/4  time [yr]: 0.00 (time step: 0.00)
   updating effective pressure
   saving temporary results
iteration 3/4  time [yr]: 0.00 (time step: 0.00)
   updating effective pressure
   saving temporary results
iteration 4/4  time [yr]: 0.00 (time step: 0.00)
   updating effective pressure
   saving temporary results
write lock file:

   FemModel initialization elapsed time:   0.010207
   Total Core solution elapsed time:       0.777024
   Linear solver elapsed time:             0.473717 (61%)

   Total elapsed time: 0 hrs 0 min 0 sec
loading results from cluster
SUCCESS difference: 4.6e-16 <   1e-14 test id: 359 test name: SquareSheetHydrologyGlaDSTransitionModel field: HydrologySheetThickness1
SUCCESS difference: 7.1e-14 <   8e-14 test id: 359 test name: SquareSheetHydrologyGlaDSTransitionModel field: HydraulicPotential1
SUCCESS difference: 2.7e-12 <   3e-12 test id: 359 test name: SquareSheetHydrologyGlaDSTransitionModel field: ChannelArea1
SUCCESS difference: 5.7e-16 <   1e-14 test id: 359 test name: SquareSheetHydrologyGlaDSTransitionModel field: HydrologySheetThickness2
SUCCESS difference: 7.2e-14 <   8e-14 test id: 359 test name: SquareSheetHydrologyGlaDSTransitionModel field: HydraulicPotential2
SUCCESS difference: 2.6e-12 <   3e-12 test id: 359 test name: SquareSheetHydrologyGlaDSTransitionModel field: ChannelArea2
SUCCESS difference: 1.1e-15 <   1e-14 test id: 359 test name: SquareSheetHydrologyGlaDSTransitionModel field: HydrologySheetThickness3
SUCCESS difference: 7.4e-14 <   8e-14 test id: 359 test name: SquareSheetHydrologyGlaDSTransitionModel field: HydraulicPotential3
SUCCESS difference: 2.6e-12 <   3e-12 test id: 359 test name: SquareSheetHydrologyGlaDSTransitionModel field: ChannelArea3
SUCCESS difference: 8.9e-16 <   1e-14 test id: 359 test name: SquareSheetHydrologyGlaDSTransitionModel field: HydrologySheetThickness4
SUCCESS difference: 8.3e-14 <   9e-14 test id: 359 test name: SquareSheetHydrologyGlaDSTransitionModel field: HydraulicPotential4
SUCCESS difference: 2.6e-12 <   3e-12 test id: 359 test name: SquareSheetHydrologyGlaDSTransitionModel field: ChannelArea4
----------------finished:359-----------------------
----------------starting:402-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.016576
   Total Core solution elapsed time:       0.169652
   Linear solver elapsed time:             0.118761 (70%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 3.2e-15 <   1e-13 test id: 402 test name: SquareSheetShelfStressSSA3d field: Vx
SUCCESS difference: 1.7e-15 <   1e-13 test id: 402 test name: SquareSheetShelfStressSSA3d field: Vy
SUCCESS difference: 8.7e-15 <   1e-13 test id: 402 test name: SquareSheetShelfStressSSA3d field: Vz
SUCCESS difference:   2e-15 <   1e-13 test id: 402 test name: SquareSheetShelfStressSSA3d field: Vel
SUCCESS difference:   1e-16 <   1e-13 test id: 402 test name: SquareSheetShelfStressSSA3d field: Pressure
----------------finished:402-----------------------
----------------starting:403-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.011973
   Total Core solution elapsed time:       0.076585
   Linear solver elapsed time:             0.05609 (73%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 5.1e-10 <   3e-09 test id: 403 test name: SquareSheetShelfStressHO field: Vx
SUCCESS difference:   3e-10 <   3e-09 test id: 403 test name: SquareSheetShelfStressHO field: Vy
SUCCESS difference: 2.1e-10 <   3e-09 test id: 403 test name: SquareSheetShelfStressHO field: Vz
SUCCESS difference:   3e-10 <   3e-09 test id: 403 test name: SquareSheetShelfStressHO field: Vel
SUCCESS difference:   1e-16 <   3e-09 test id: 403 test name: SquareSheetShelfStressHO field: Pressure
----------------finished:403-----------------------
----------------starting:406-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.009813
   Total Core solution elapsed time:       0.077913
   Linear solver elapsed time:             0.046539 (60%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 2.3e-15 <   1e-13 test id: 406 test name: SquareSheetShelfTherStea field: Temperature
SUCCESS difference: 1.5e-06 <   1e-05 test id: 406 test name: SquareSheetShelfTherStea field: BasalforcingsGroundediceMeltingRate
----------------finished:406-----------------------
----------------starting:407-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test407.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test407.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test407.py", line 21, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 407 test name: SquareSheetShelfTherTran field: N/A
----------------finished:407-----------------------
----------------starting:408-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test408.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test408.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test408.py", line 30, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 408 test name: SquareSheetShelfTranSSA3d field: N/A
----------------finished:408-----------------------
----------------starting:409-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test409.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test409.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test409.py", line 19, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 409 test name: SquareSheetShelfTranMHOPenalties field: N/A
----------------finished:409-----------------------
----------------starting:419-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.010218
   Total Core solution elapsed time:       0.070422
   Linear solver elapsed time:             0.04987 (71%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference:   1e-09 <   2e-09 test id: 419 test name: SquareSheetShelfStressSSAHOTiling field: Vx
SUCCESS difference: 6.9e-10 <   2e-09 test id: 419 test name: SquareSheetShelfStressSSAHOTiling field: Vy
SUCCESS difference: 1.7e-10 <   1e-09 test id: 419 test name: SquareSheetShelfStressSSAHOTiling field: Vz
SUCCESS difference:   7e-10 <   2e-09 test id: 419 test name: SquareSheetShelfStressSSAHOTiling field: Vel
SUCCESS difference:   1e-16 <   1e-09 test id: 419 test name: SquareSheetShelfStressSSAHOTiling field: Pressure
----------------finished:419-----------------------
----------------starting:426-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test426.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test426.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test426.py", line 30, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 426 test name: SquareSheetShelfGroundingLine3dAggressive field: N/A
----------------finished:426-----------------------
----------------starting:427-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test427.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test427.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test427.py", line 28, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 427 test name: SquareSheetShelfGroundingLine3dSoft field: N/A
----------------finished:427-----------------------
----------------starting:428-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.007479
   Total Core solution elapsed time:       0.082839
   Linear solver elapsed time:             0.057359 (69%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 6.5e-15 <   1e-13 test id: 428 test name: SquareSheetShelfStressSSA2dNewton field: Vx
SUCCESS difference:   2e-15 <   1e-13 test id: 428 test name: SquareSheetShelfStressSSA2dNewton field: Vy
SUCCESS difference:   2e-15 <   1e-13 test id: 428 test name: SquareSheetShelfStressSSA2dNewton field: Vel
SUCCESS difference:   1e-16 <   1e-13 test id: 428 test name: SquareSheetShelfStressSSA2dNewton field: Pressure
----------------finished:428-----------------------
----------------starting:429-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.013787
   Total Core solution elapsed time:       0.191493
   Linear solver elapsed time:             0.112614 (59%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 1.3e-09 <   2e-06 test id: 429 test name: SquareSheetShelfStressHONewton field: Vx
SUCCESS difference: 1.1e-09 <   2e-06 test id: 429 test name: SquareSheetShelfStressHONewton field: Vy
SUCCESS difference: 2.7e-10 <   1e-06 test id: 429 test name: SquareSheetShelfStressHONewton field: Vz
SUCCESS difference:   1e-09 <   2e-06 test id: 429 test name: SquareSheetShelfStressHONewton field: Vel
SUCCESS difference:   1e-16 <   1e-06 test id: 429 test name: SquareSheetShelfStressHONewton field: Pressure
----------------finished:429-----------------------
----------------starting:432-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.018131
   Total Core solution elapsed time:       0.25694
   Linear solver elapsed time:             0.177195 (69%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference:   3e-10 <   3e-09 test id: 432 test name: SquareSheetShelfSteaEnthalpyHO field: Vx
SUCCESS difference: 1.4e-10 <   1e-09 test id: 432 test name: SquareSheetShelfSteaEnthalpyHO field: Vy
SUCCESS difference: 4.1e-11 <   1e-09 test id: 432 test name: SquareSheetShelfSteaEnthalpyHO field: Vz
SUCCESS difference: 1.4e-10 <   1e-09 test id: 432 test name: SquareSheetShelfSteaEnthalpyHO field: Vel
SUCCESS difference:   1e-16 <   1e-13 test id: 432 test name: SquareSheetShelfSteaEnthalpyHO field: Pressure
SUCCESS difference: 1.7e-11 <   2e-10 test id: 432 test name: SquareSheetShelfSteaEnthalpyHO field: Temperature
SUCCESS difference: 1.4e-11 <   5e-10 test id: 432 test name: SquareSheetShelfSteaEnthalpyHO field: Waterfraction
SUCCESS difference: 9.2e-11 <   3e-09 test id: 432 test name: SquareSheetShelfSteaEnthalpyHO field: Enthalpy
----------------finished:432-----------------------
----------------starting:436-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
 
 ====== Testing rheology law: LliboutryDuval = 
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.017803
   Total Core solution elapsed time:       0.309707
   Linear solver elapsed time:             0.206479 (67%)

   Total elapsed time: 0 hrs 0 min 0 sec
 
 ====== Testing rheology law: CuffeyTemperate = 
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.013921
   Total Core solution elapsed time:       0.191331
   Linear solver elapsed time:             0.129485 (68%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 5.9e-10 <   2e-09 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: VxLliboutryDuval
SUCCESS difference:   2e-10 <   1e-09 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: VyLliboutryDuval
SUCCESS difference: 5.4e-11 <   1e-09 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: VzLliboutryDuval
SUCCESS difference:   2e-10 <   1e-09 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: VelLliboutryDuval
SUCCESS difference:   1e-16 <   1e-13 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: PressureLliboutryDuval
SUCCESS difference: 3.5e-11 <   2e-10 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: TemperatureLliboutryDuval
SUCCESS difference: 5.4e-11 <   6e-10 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: WaterfractionLliboutryDuval
SUCCESS difference: 1.9e-10 <   1e-09 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: EnthalpyLliboutryDuval
SUCCESS difference: 2.9e-10 <   2e-09 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: VxCuffeyTemperate
SUCCESS difference: 1.4e-10 <   1e-09 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: VyCuffeyTemperate
SUCCESS difference: 5.2e-11 <   1e-09 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: VzCuffeyTemperate
SUCCESS difference: 1.4e-10 <   1e-09 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: VelCuffeyTemperate
SUCCESS difference:   1e-16 <   1e-13 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: PressureCuffeyTemperate
SUCCESS difference: 2.9e-11 <   2e-10 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: TemperatureCuffeyTemperate
SUCCESS difference: 8.4e-11 <   6e-10 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: WaterfractionCuffeyTemperate
SUCCESS difference: 1.6e-10 <   1e-09 test id: 436 test name: SquareSheetShelfSteaEnthalpyRheologiesHO field: EnthalpyCuffeyTemperate
----------------finished:436-----------------------
----------------starting:437-----------------------
----------------running-----------------------
      creating thickness
      creating velocities
      creating drag
      creating temperatures
      creating flow law parameter
      creating surface mass balance
      boundary conditions for stressbalance model
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
      boundary conditions for thermal model
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file SquareThermal.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: SquareThermal.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test437.py", line 60, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 437 test name: ThermalEnthBasalcondsTrans field: N/A
----------------finished:437-----------------------
----------------starting:438-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
/Users/jenkins/workspace/macOS-Silicon-Python/src/m/consistency/checkfield.py:175: RuntimeWarning: All-NaN slice encountered
  minval = np.nanmin(field[:-1])
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test438.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test438.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test438.py", line 22, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 438 test name: TransientFrictionWaterlayer2D field: N/A
----------------finished:438-----------------------
----------------starting:439-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file
[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file



============================================================
   Binary file test439.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test439.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test439.py", line 24, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 439 test name: TransientFrictionWaterlayer3D field: N/A
----------------finished:439-----------------------
----------------starting:443-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file
[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file



============================================================
   Binary file test443.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test443.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test443.py", line 56, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 443 test name: SquareSheetShelfTranSSA3dAggressiveRegionalOutput field: N/A
----------------finished:443-----------------------
----------------starting:446-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.007912
   Total Core solution elapsed time:       0.080652
   Linear solver elapsed time:             0.064143 (80%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 3.5e-15 <   1e-13 test id: 446 test name: SquareSheetShelfStressMOLHO2d field: Vx
SUCCESS difference: 2.2e-15 <   1e-13 test id: 446 test name: SquareSheetShelfStressMOLHO2d field: Vy
SUCCESS difference: 2.4e-15 <   1e-13 test id: 446 test name: SquareSheetShelfStressMOLHO2d field: Vel
SUCCESS difference:       0 <   1e-13 test id: 446 test name: SquareSheetShelfStressMOLHO2d field: Pressure
SUCCESS difference: 3.5e-15 <   1e-13 test id: 446 test name: SquareSheetShelfStressMOLHO2d field: VxSurface
SUCCESS difference: 2.4e-15 <   1e-13 test id: 446 test name: SquareSheetShelfStressMOLHO2d field: VySurface
SUCCESS difference: 1.1e-15 <   1e-13 test id: 446 test name: SquareSheetShelfStressMOLHO2d field: VxShear
SUCCESS difference: 1.6e-15 <   1e-13 test id: 446 test name: SquareSheetShelfStressMOLHO2d field: VyShear
SUCCESS difference: 3.4e-15 <   1e-13 test id: 446 test name: SquareSheetShelfStressMOLHO2d field: VxBase
SUCCESS difference: 2.4e-15 <   1e-13 test id: 446 test name: SquareSheetShelfStressMOLHO2d field: VyBase
----------------finished:446-----------------------
----------------starting:449-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test449.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test449.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test449.py", line 62, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 449 test name: MISMIP3DMOLHO field: N/A
----------------finished:449-----------------------
----------------starting:481-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test481.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test481.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test481.py", line 25, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 481 test name: TransientFrictionSchoof field: N/A
----------------finished:481-----------------------
----------------starting:491-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test491.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test491.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test491.py", line 30, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 491 test name: SquareSheetShelfTranMeltArtDiff  field: N/A
----------------finished:491-----------------------
----------------starting:494-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test494.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test494.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test494.py", line 30, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 494 test name: SquareSheetShelfTranMeltFCT  field: N/A
----------------finished:494-----------------------
----------------starting:495-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test495.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test495.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test495.py", line 30, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 495 test name: SquareSheetShelfTranMeltSUPG  field: N/A
----------------finished:495-----------------------
----------------starting:502-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as observed velocities
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.011469
   Total Core solution elapsed time:       0.074075
   Linear solver elapsed time:             0.051703 (70%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 1.6e-13 <   1e-08 test id: 502 test name: PigStressHO field: Vx
SUCCESS difference: 4.1e-13 <   1e-08 test id: 502 test name: PigStressHO field: Vy
SUCCESS difference: 4.3e-13 <   1e-08 test id: 502 test name: PigStressHO field: Vz
SUCCESS difference: 3.5e-13 <   1e-08 test id: 502 test name: PigStressHO field: Vel
SUCCESS difference: 3.2e-16 <   1e-08 test id: 502 test name: PigStressHO field: Pressure
----------------finished:502-----------------------
----------------starting:503-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as observed velocities
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.015086
   Total Core solution elapsed time:       0.226839
   Linear solver elapsed time:             0.131323 (58%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 4.2e-11 <   1e-09 test id: 503 test name: PigStressFS field: Vx
SUCCESS difference: 3.9e-11 <   1e-09 test id: 503 test name: PigStressFS field: Vy
SUCCESS difference: 3.2e-11 <   1e-09 test id: 503 test name: PigStressFS field: Vz
SUCCESS difference: 3.2e-11 <   1e-09 test id: 503 test name: PigStressFS field: Vel
SUCCESS difference: 3.3e-11 <   1e-09 test id: 503 test name: PigStressFS field: Pressure
----------------finished:503-----------------------
----------------starting:506-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as observed velocities
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test506.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test506.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test506.py", line 19, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 506 test name: PigTranHO field: N/A
----------------finished:506-----------------------
----------------starting:509-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as observed velocities
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.012377
   Total Core solution elapsed time:       0.655504
   Linear solver elapsed time:             0.460833 (70%)

   Total elapsed time: 0 hrs 0 min 0 sec
WARNING! There are options you set that were not used!
WARNING! could be spelling mistake, etc!
There are 7 unused database options. They are:
Option left: name:-ksp_type value: preonly source: code
Option left: name:-mat_mumps_icntl_14 value: 120 source: code
Option left: name:-mat_mumps_icntl_28 value: 1 source: code
Option left: name:-mat_mumps_icntl_29 value: 2 source: code
Option left: name:-mat_type value: mpiaij source: code
Option left: name:-pc_factor_mat_solver_type value: mumps source: code
Option left: name:-pc_type value: lu source: code
SUCCESS difference: 3.8e-10 <   2e-09 test id: 509 test name: PigSteaHO field: Vx
SUCCESS difference:   4e-10 <   2e-09 test id: 509 test name: PigSteaHO field: Vy
SUCCESS difference: 1.5e-08 <   5e-08 test id: 509 test name: PigSteaHO field: Vz
SUCCESS difference: 1.5e-08 <   5e-08 test id: 509 test name: PigSteaHO field: Vel
SUCCESS difference: 2.1e-16 <   1e-09 test id: 509 test name: PigSteaHO field: Pressure
SUCCESS difference: 2.4e-09 <   8e-09 test id: 509 test name: PigSteaHO field: Temperature
SUCCESS difference: 2.6e-08 <   1e-06 test id: 509 test name: PigSteaHO field: BasalforcingsGroundediceMeltingRate
----------------finished:509-----------------------
----------------starting:512-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as observed velocities
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:

       x       |  Cost function f(x)  |  List of contributions
====================== step 1/2 ===============================
 x =         0 | f(x) =     125.7303  |       125.7296 0.0006420665
 x =         1 | f(x) =     119.1935  |       119.1928 0.0006447871
====================== step 2/2 ===============================
 x =         0 | f(x) =     119.1118  |       119.1111 0.0006447871
 x =         1 | f(x) =     112.5586  |       112.5579 0.0006652207
write lock file:

   FemModel initialization elapsed time:   0.010931
   Total Core solution elapsed time:       0.144518
   Linear solver elapsed time:             0.092405 (64%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 1.2e-13 <   1e-11 test id: 512 test name: PigCMDragHO field: Gradient
SUCCESS difference: 1.8e-14 <   1e-11 test id: 512 test name: PigCMDragHO field: Misfits
SUCCESS difference:   1e-14 <   1e-11 test id: 512 test name: PigCMDragHO field: FrictionCoefficient
SUCCESS difference: 3.2e-16 <   1e-11 test id: 512 test name: PigCMDragHO field: Pressure
SUCCESS difference: 2.8e-13 <   1e-11 test id: 512 test name: PigCMDragHO field: Vel
SUCCESS difference: 5.6e-13 <   1e-11 test id: 512 test name: PigCMDragHO field: Vx
SUCCESS difference: 2.7e-13 <   1e-11 test id: 512 test name: PigCMDragHO field: Vy
----------------finished:512-----------------------
----------------starting:513-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as observed velocities
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:

       x       |  Cost function f(x)  |  List of contributions
====================== step 1/2 ===============================
 x =         0 | f(x) =     99.51715  |       99.51669 0.0004575168
 x =         1 | f(x) =     93.99829  |       93.99784 0.0004559883
====================== step 2/2 ===============================
 x =         0 | f(x) =     93.78083  |       93.78038 0.0004559883
 x =         1 | f(x) =     88.30076  |        88.3003 0.0004621097
write lock file:

   FemModel initialization elapsed time:   0.030083
   Total Core solution elapsed time:       0.95591
   Linear solver elapsed time:             0.604634 (63%)

   Total elapsed time: 0 hrs 0 min 0 sec
WARNING! There are options you set that were not used!
WARNING! could be spelling mistake, etc!
There are 7 unused database options. They are:
Option left: name:-ksp_type value: preonly source: code
Option left: name:-mat_mumps_icntl_14 value: 120 source: code
Option left: name:-mat_mumps_icntl_28 value: 1 source: code
Option left: name:-mat_mumps_icntl_29 value: 2 source: code
Option left: name:-mat_type value: mpiaij source: code
Option left: name:-pc_factor_mat_solver_type value: mumps source: code
Option left: name:-pc_type value: lu source: code
SUCCESS difference: 1.6e-11 <   5e-08 test id: 513 test name: PigCMDragSteaSSA3d field: Gradient
SUCCESS difference: 2.2e-12 <   4e-10 test id: 513 test name: PigCMDragSteaSSA3d field: Misfits
SUCCESS difference: 9.2e-13 <   1e-10 test id: 513 test name: PigCMDragSteaSSA3d field: FrictionCoefficient
SUCCESS difference: 2.1e-16 <   1e-10 test id: 513 test name: PigCMDragSteaSSA3d field: Pressure
SUCCESS difference: 2.2e-11 <   3e-06 test id: 513 test name: PigCMDragSteaSSA3d field: Vel
SUCCESS difference: 5.4e-11 <   4e-06 test id: 513 test name: PigCMDragSteaSSA3d field: Vx
SUCCESS difference: 1.9e-11 < 3.4e-06 test id: 513 test name: PigCMDragSteaSSA3d field: Vy
SUCCESS difference: 5.1e-11 <   3e-06 test id: 513 test name: PigCMDragSteaSSA3d field: Vz
SUCCESS difference: 4.8e-11 <   2e-06 test id: 513 test name: PigCMDragSteaSSA3d field: Temperature
SUCCESS difference: 4.2e-08 <   2e-06 test id: 513 test name: PigCMDragSteaSSA3d field: BasalforcingsGroundediceMeltingRate
----------------finished:513-----------------------
----------------starting:516-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as observed velocities
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.009197
   Total Core solution elapsed time:       0.031442
   Linear solver elapsed time:             0.016915 (54%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 2.4e-13 <   1e-11 test id: 516 test name: PigTherSteaSUPG field: Temperature
SUCCESS difference: 6.1e-13 <   1e-11 test id: 516 test name: PigTherSteaSUPG field: BasalforcingsGroundediceMeltingRate
----------------finished:516-----------------------
----------------starting:518-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as observed velocities
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.010412
   Total Core solution elapsed time:       0.080722
   Linear solver elapsed time:             0.060298 (75%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 4.2e-13 <   5e-13 test id: 518 test name:  field: Vx
SUCCESS difference: 5.3e-13 <   6e-13 test id: 518 test name:  field: Vy
SUCCESS difference: 5.1e-13 <   6e-13 test id: 518 test name:  field: Vel
SUCCESS difference: 3.2e-16 <   1e-13 test id: 518 test name:  field: Pressure
SUCCESS difference: 4.2e-13 <   5e-13 test id: 518 test name:  field: VxSurface
SUCCESS difference: 5.3e-13 <   6e-13 test id: 518 test name:  field: VySurface
SUCCESS difference: 2.3e-14 <   1e-13 test id: 518 test name:  field: VxShear
SUCCESS difference: 6.6e-14 <   1e-13 test id: 518 test name:  field: VyShear
SUCCESS difference: 4.2e-13 <   5e-13 test id: 518 test name:  field: VxBase
SUCCESS difference: 5.3e-13 <   6e-13 test id: 518 test name:  field: VyBase
----------------finished:518-----------------------
----------------starting:519-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as observed velocities
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test519.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test519.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test519.py", line 21, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 519 test name: PigTranMOLHO2d field: N/A
----------------finished:519-----------------------
----------------starting:542-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as observed velocities
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test542.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test542.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test542.py", line 49, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 542 test name: PigTranFrontalforcingsrignot field: N/A
----------------finished:542-----------------------
----------------starting:543-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as observed velocities
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
      stochasticforcing.stocahstictimestep not specified: set to md.timestepping.time_step
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test543.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test543.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test543.py", line 140, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 543 test name: PigTranRignotarma  field: N/A
----------------finished:543-----------------------
----------------starting:601-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.006667
   Total Core solution elapsed time:       0.013127
   Linear solver elapsed time:             0.008487 (65%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 3.8e-15 <   1e-13 test id: 601 test name: 79NorthMasstransp2d field: Thickness
----------------finished:601-----------------------
----------------starting:604-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.007657
   Total Core solution elapsed time:       0.027578
   Linear solver elapsed time:             0.020956 (76%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 7.2e-16 <   1e-13 test id: 604 test name: 79NorthSurfSlop2d field: SurfaceSlopeX
SUCCESS difference: 6.3e-16 <   1e-13 test id: 604 test name: 79NorthSurfSlop2d field: SurfaceSlopeY
----------------finished:604-----------------------
----------------starting:605-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.006922
   Total Core solution elapsed time:       0.028496
   Linear solver elapsed time:             0.01977 (69%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 7.6e-16 <   1e-13 test id: 605 test name: 79NorthSurfSlop3d field: SurfaceSlopeX
SUCCESS difference: 6.3e-16 <   1e-13 test id: 605 test name: 79NorthSurfSlop3d field: SurfaceSlopeY
----------------finished:605-----------------------
----------------starting:610-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test610.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test610.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test610.py", line 33, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 610 test name: 79NorthPISMhydro field: N/A
----------------finished:610-----------------------
----------------starting:611-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:

       x       |  Cost function f(x)  |  List of contributions
====================== step 1/2 ===============================
 x =         0 | f(x) = 5.576527e+15  |   5.576527e+15
 x =         1 | f(x) = 2.800818e+15  |   2.800818e+15
====================== step 2/2 ===============================
 x =         0 | f(x) = 2.800818e+15  |   2.800818e+15
 x =         1 | f(x) = 9.878839e+14  |   9.878839e+14
write lock file:

   FemModel initialization elapsed time:   0.008757
   Total Core solution elapsed time:       0.089207
   Linear solver elapsed time:             0.058536 (66%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference: 1.9e-13 <   1e-12 test id: 611 test name: 79NorthCMBalThic2dCG field: Gradient
SUCCESS difference: 1.9e-14 <   1e-12 test id: 611 test name: 79NorthCMBalThic2dCG field: Misfits
SUCCESS difference: 2.4e-13 <   1e-12 test id: 611 test name: 79NorthCMBalThic2dCG field: BalancethicknessThickeningRate
SUCCESS difference: 2.3e-13 <   1e-12 test id: 611 test name: 79NorthCMBalThic2dCG field: Thickness
----------------finished:611-----------------------
----------------starting:621-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
      stochasticforcing.stocahstictimestep not specified: set to md.timestepping.time_step
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test621.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test621.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test621.py", line 56, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 621 test name: 79NorthStochFrictionWaterPressure field: N/A
----------------finished:621-----------------------
----------------starting:701-----------------------
----------------running-----------------------
Construction of a mesh from a given geometry
 
=====Testing MINI Full-Stokes Finite element=====
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:

   solver residue: norm(KU-F)/norm(F)=1.16409e-16

   solver residue: norm(KU-F)/norm(F)=8.74292e-16

   solver residue: norm(KU-F)/norm(F)=1.48305e-16

   solver residue: norm(KU-F)/norm(F)=5.92415e-15
   mechanical equilibrium convergence criterion   100 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        7.19835e+23 > 1 %
   Convergence criterion: max(du)                 8.72588e+06
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.53071e-14
   mechanical equilibrium convergence criterion   2.12624 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        1.10539 > 1 %
   Convergence criterion: max(du)                 266316
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=2.95709e-14
   mechanical equilibrium convergence criterion   1.73917 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.642157 < 1 %
   Convergence criterion: max(du)                 136471
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=4.84106e-14
   mechanical equilibrium convergence criterion   0.717979 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.232724 < 1 %
   Convergence criterion: max(du)                 79604.1
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=7.29524e-14
   mechanical equilibrium convergence criterion   0.432302 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0930063 < 1 %
   Convergence criterion: max(du)                 25173.2
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.03784e-13
   mechanical equilibrium convergence criterion   0.265448 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0469947 < 1 %
   Convergence criterion: max(du)                 18682.5
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=5.58839e-14
   mechanical equilibrium convergence criterion   0.167098 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0264618 < 1 %
   Convergence criterion: max(du)                 12063.6
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.14914e-13
   mechanical equilibrium convergence criterion   0.106278 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0150307 < 1 %
   Convergence criterion: max(du)                 7028.6
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=7.0132e-14
   mechanical equilibrium convergence criterion   0.067923 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00855668 < 1 %
   Convergence criterion: max(du)                 3930.75
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.25935e-13
   mechanical equilibrium convergence criterion   0.0435415 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00491833 < 1 %
   Convergence criterion: max(du)                 2178.5
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=8.30805e-14
   mechanical equilibrium convergence criterion   0.0279973 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0028636 < 1 %
   Convergence criterion: max(du)                 1213.66
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=6.07298e-14
   mechanical equilibrium convergence criterion   0.0180659 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00168822 < 1 %
   Convergence criterion: max(du)                 682.744
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=7.81766e-14
   mechanical equilibrium convergence criterion   0.0117016 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00100627 < 1 %
   Convergence criterion: max(du)                 387.91
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.02657e-13
   mechanical equilibrium convergence criterion   0.00760798 < 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00060554 < 1 %
   Convergence criterion: max(du)                 222.316
   number of unstable constraints: 0

   total number of iterations: 14
write lock file:

   FemModel initialization elapsed time:   0.009786
   Total Core solution elapsed time:       0.497393
   Linear solver elapsed time:             0.426422 (86%)

   Total elapsed time: 0 hrs 0 min 0 sec
 
=====Testing MINIcondensed Full-Stokes Finite element=====
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:

   solver residue: norm(KU-F)/norm(F)=1.16409e-16

   solver residue: norm(KU-F)/norm(F)=8.74292e-16

   solver residue: norm(KU-F)/norm(F)=1.48305e-16

   solver residue: norm(KU-F)/norm(F)=3.84108e-15
   mechanical equilibrium convergence criterion   100 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        7.19835e+23 > 1 %
   Convergence criterion: max(du)                 8.72588e+06
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=8.90978e-15
   mechanical equilibrium convergence criterion   1.96276 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        1.10539 > 1 %
   Convergence criterion: max(du)                 266316
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.75082e-14
   mechanical equilibrium convergence criterion   0.994782 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.642157 < 1 %
   Convergence criterion: max(du)                 136471
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=2.30287e-14
   mechanical equilibrium convergence criterion   0.635413 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.232724 < 1 %
   Convergence criterion: max(du)                 79604.1
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=2.53294e-14
   mechanical equilibrium convergence criterion   0.390791 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0930063 < 1 %
   Convergence criterion: max(du)                 25173.2
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=3.31294e-14
   mechanical equilibrium convergence criterion   0.243341 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0469947 < 1 %
   Convergence criterion: max(du)                 18682.5
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=3.52945e-14
   mechanical equilibrium convergence criterion   0.154189 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0264618 < 1 %
   Convergence criterion: max(du)                 12063.6
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=3.69497e-14
   mechanical equilibrium convergence criterion   0.0983817 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0150307 < 1 %
   Convergence criterion: max(du)                 7028.6
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=4.20963e-14
   mechanical equilibrium convergence criterion   0.063036 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00855668 < 1 %
   Convergence criterion: max(du)                 3930.75
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=4.42816e-14
   mechanical equilibrium convergence criterion   0.0405301 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00491833 < 1 %
   Convergence criterion: max(du)                 2178.5
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=4.33497e-14
   mechanical equilibrium convergence criterion   0.0261518 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0028636 < 1 %
   Convergence criterion: max(du)                 1213.66
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=4.56221e-14
   mechanical equilibrium convergence criterion   0.0169366 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00168822 < 1 %
   Convergence criterion: max(du)                 682.744
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=3.94604e-14
   mechanical equilibrium convergence criterion   0.0110089 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00100627 < 1 %
   Convergence criterion: max(du)                 387.91
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=3.45431e-14
   mechanical equilibrium convergence criterion   0.00718082 < 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00060554 < 1 %
   Convergence criterion: max(du)                 222.316
   number of unstable constraints: 0

   total number of iterations: 14
write lock file:

   FemModel initialization elapsed time:   0.013598
   Total Core solution elapsed time:       0.25905
   Linear solver elapsed time:             0.188005 (73%)

   Total elapsed time: 0 hrs 0 min 0 sec
 
=====Testing TaylorHood Full-Stokes Finite element=====
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:

   solver residue: norm(KU-F)/norm(F)=1.16409e-16

   solver residue: norm(KU-F)/norm(F)=8.74292e-16

   solver residue: norm(KU-F)/norm(F)=1.48305e-16

   solver residue: norm(KU-F)/norm(F)=1.60623e-14
   mechanical equilibrium convergence criterion   100 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        7.20099e+23 > 1 %
   Convergence criterion: max(du)                 8.74189e+06
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=3.27378e-14
   mechanical equilibrium convergence criterion   2.00457 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        1.20805 > 1 %
   Convergence criterion: max(du)                 335077
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.10831e-13
   mechanical equilibrium convergence criterion   1.78268 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.75602 < 1 %
   Convergence criterion: max(du)                 132780
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.11897e-13
   mechanical equilibrium convergence criterion   0.832236 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.263456 < 1 %
   Convergence criterion: max(du)                 78736.2
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.53998e-13
   mechanical equilibrium convergence criterion   0.401028 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0758391 < 1 %
   Convergence criterion: max(du)                 23665.1
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.85526e-13
   mechanical equilibrium convergence criterion   0.238045 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0305218 < 1 %
   Convergence criterion: max(du)                 10429.3
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.6275e-13
   mechanical equilibrium convergence criterion   0.150226 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0152555 < 1 %
   Convergence criterion: max(du)                 6394.21
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.86766e-13
   mechanical equilibrium convergence criterion   0.0972593 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00801846 < 1 %
   Convergence criterion: max(du)                 3530.22
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.88066e-13
   mechanical equilibrium convergence criterion   0.0640213 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00429142 < 1 %
   Convergence criterion: max(du)                 1833.16
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=2.14016e-13
   mechanical equilibrium convergence criterion   0.0424357 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00234604 < 1 %
   Convergence criterion: max(du)                 940.664
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=3.04155e-13
   mechanical equilibrium convergence criterion   0.028166 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00130469 < 1 %
   Convergence criterion: max(du)                 481.928
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=2.47958e-13
   mechanical equilibrium convergence criterion   0.0186787 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.000736614 < 1 %
   Convergence criterion: max(du)                 247.852
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.84468e-13
   mechanical equilibrium convergence criterion   0.0123701 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.000421607 < 1 %
   Convergence criterion: max(du)                 128.51
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=2.83024e-13
   mechanical equilibrium convergence criterion   0.00818204 < 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.000244185 < 1 %
   Convergence criterion: max(du)                 67.3462
   number of unstable constraints: 0

   total number of iterations: 14
write lock file:

   FemModel initialization elapsed time:   0.010119
   Total Core solution elapsed time:       0.637077
   Linear solver elapsed time:             0.545781 (86%)

   Total elapsed time: 0 hrs 0 min 0 sec
 
=====Testing LATaylorHood Full-Stokes Finite element=====
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:

   solver residue: norm(KU-F)/norm(F)=1.16409e-16

   solver residue: norm(KU-F)/norm(F)=8.74292e-16

   solver residue: norm(KU-F)/norm(F)=1.48305e-16

   solver residue: norm(KU-F)/norm(F)=2.14916e-13
   Convergence criterion: norm(du)/norm(u)        inf > 1 %

   solver residue: norm(KU-F)/norm(F)=8.57854e-13
   Convergence criterion: norm(du)/norm(u)        613.069 > 1 %

   solver residue: norm(KU-F)/norm(F)=1.52382e-12
   Convergence criterion: norm(du)/norm(u)        275.933 > 1 %

   solver residue: norm(KU-F)/norm(F)=3.76759e-12
   Convergence criterion: norm(du)/norm(u)        144.079 > 1 %

   solver residue: norm(KU-F)/norm(F)=4.75133e-12
   Convergence criterion: norm(du)/norm(u)        81.951 > 1 %

   solver residue: norm(KU-F)/norm(F)=4.19743e-12
   Convergence criterion: norm(du)/norm(u)        49.2493 > 1 %

   solver residue: norm(KU-F)/norm(F)=4.67572e-12
   Convergence criterion: norm(du)/norm(u)        30.672 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.58412e-12
   Convergence criterion: norm(du)/norm(u)        19.5516 > 1 %

   solver residue: norm(KU-F)/norm(F)=4.20428e-12
   Convergence criterion: norm(du)/norm(u)        12.654 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.02114e-12
   Convergence criterion: norm(du)/norm(u)        8.27209 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.13764e-12
   Convergence criterion: norm(du)/norm(u)        5.44337 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.37761e-12
   Convergence criterion: norm(du)/norm(u)        3.59763 > 1 %

   solver residue: norm(KU-F)/norm(F)=9.62009e-12
   Convergence criterion: norm(du)/norm(u)        2.38464 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.71541e-12
   Convergence criterion: norm(du)/norm(u)        1.58367 > 1 %

   solver residue: norm(KU-F)/norm(F)=9.76156e-12
   Convergence criterion: norm(du)/norm(u)        1.05307 > 1 %

   solver residue: norm(KU-F)/norm(F)=4.14386e-12
   Convergence criterion: norm(du)/norm(u)        0.700842 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.52437e-17
   Convergence criterion: norm(du)/norm(u)        0.700842 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       inf > 1 %

   solver residue: norm(KU-F)/norm(F)=6.03819e-12
   Convergence criterion: norm(du)/norm(u)        0.466658 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.5445e-17
   Convergence criterion: norm(du)/norm(u)        0.466658 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       100.471 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.07575e-12
   Convergence criterion: norm(du)/norm(u)        0.310831 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.53028e-17
   Convergence criterion: norm(du)/norm(u)        0.310831 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       50.2749 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.01072e-12
   Convergence criterion: norm(du)/norm(u)        0.207079 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.19105e-17
   Convergence criterion: norm(du)/norm(u)        0.207079 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       33.5253 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.01333e-12
   Convergence criterion: norm(du)/norm(u)        0.137971 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.18522e-17
   Convergence criterion: norm(du)/norm(u)        0.137971 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       25.1428 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.20645e-12
   Convergence criterion: norm(du)/norm(u)        0.0919261 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.18134e-17
   Convergence criterion: norm(du)/norm(u)        0.0919261 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       20.1099 > 1 %

   solver residue: norm(KU-F)/norm(F)=4.07725e-12
   Convergence criterion: norm(du)/norm(u)        0.061242 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.17876e-17
   Convergence criterion: norm(du)/norm(u)        0.061242 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       16.7533 > 1 %

   solver residue: norm(KU-F)/norm(F)=4.45468e-12
   Convergence criterion: norm(du)/norm(u)        0.0407918 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.17704e-17
   Convergence criterion: norm(du)/norm(u)        0.0407918 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       14.3552 > 1 %

   solver residue: norm(KU-F)/norm(F)=8.45778e-12
   Convergence criterion: norm(du)/norm(u)        0.0271613 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.1759e-17
   Convergence criterion: norm(du)/norm(u)        0.0271613 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       12.5566 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.3917e-12
   Convergence criterion: norm(du)/norm(u)        0.0180758 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.17513e-17
   Convergence criterion: norm(du)/norm(u)        0.0180758 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       11.1579 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.6327e-12
   Convergence criterion: norm(du)/norm(u)        0.0120195 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.17463e-17
   Convergence criterion: norm(du)/norm(u)        0.0120195 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       10.0391 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.03205e-12
   Convergence criterion: norm(du)/norm(u)        0.0079825 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.17429e-17
   Convergence criterion: norm(du)/norm(u)        0.0079825 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       9.12392 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.70345e-12
   Convergence criterion: norm(du)/norm(u)        0.0052914 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.17407e-17
   Convergence criterion: norm(du)/norm(u)        0.0052914 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       8.36151 > 1 %

   solver residue: norm(KU-F)/norm(F)=8.24319e-12
   Convergence criterion: norm(du)/norm(u)        0.00349749 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.17392e-17
   Convergence criterion: norm(du)/norm(u)        0.00349749 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       7.71658 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.86067e-12
   Convergence criterion: norm(du)/norm(u)        0.00230167 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.17383e-17
   Convergence criterion: norm(du)/norm(u)        0.00230167 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       7.16395 > 1 %

   solver residue: norm(KU-F)/norm(F)=4.88964e-12
   Convergence criterion: norm(du)/norm(u)        0.00150451 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.17376e-17
   Convergence criterion: norm(du)/norm(u)        0.00150451 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       6.68514 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.80102e-12
   Convergence criterion: norm(du)/norm(u)        0.000973122 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.17372e-17
   Convergence criterion: norm(du)/norm(u)        0.000973122 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       6.26629 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.71826e-12
   Convergence criterion: norm(du)/norm(u)        0.000618906 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.1737e-17
   Convergence criterion: norm(du)/norm(u)        0.000618906 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       5.89682 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.3669e-12
   Convergence criterion: norm(du)/norm(u)        0.000382789 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.17368e-17
   Convergence criterion: norm(du)/norm(u)        0.000382789 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       5.56848 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.23667e-12
   Convergence criterion: norm(du)/norm(u)        0.000225425 < 1 %

   solver residue: norm(KU-F)/norm(F)=4.17367e-17
   Convergence criterion: norm(du)/norm(u)        0.000225425 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       5.27476 > 1 %
   maximum number of nonlinear iterations (20) exceeded

   total number of iterations: 19
write lock file:

   FemModel initialization elapsed time:   0.011666
   Total Core solution elapsed time:       0.988718
   Linear solver elapsed time:             0.699215 (71%)

   Total elapsed time: 0 hrs 0 min 1 sec
 
=====Testing CrouzeixRaviart Full-Stokes Finite element=====
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:

   solver residue: norm(KU-F)/norm(F)=1.16409e-16

   solver residue: norm(KU-F)/norm(F)=8.74292e-16

   solver residue: norm(KU-F)/norm(F)=1.48305e-16

   solver residue: norm(KU-F)/norm(F)=1.02557e-13
   mechanical equilibrium convergence criterion   100 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        1.63969e+24 > 1 %
   Convergence criterion: max(du)                 8.83861e+06
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=7.37023e-13
   mechanical equilibrium convergence criterion   2.11064 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        1.08444 > 1 %
   Convergence criterion: max(du)                 446853
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=5.68032e-13
   mechanical equilibrium convergence criterion   2.09404 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.862624 < 1 %
   Convergence criterion: max(du)                 414759
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=5.89984e-13
   mechanical equilibrium convergence criterion   0.909059 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.341995 < 1 %
   Convergence criterion: max(du)                 161809
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=7.71003e-13
   mechanical equilibrium convergence criterion   0.479574 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.131721 < 1 %
   Convergence criterion: max(du)                 90123.3
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=7.9251e-13
   mechanical equilibrium convergence criterion   0.284195 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0670162 < 1 %
   Convergence criterion: max(du)                 54409.5
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=7.07585e-13
   mechanical equilibrium convergence criterion   0.175223 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0291123 < 1 %
   Convergence criterion: max(du)                 25524.6
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.16145e-12
   mechanical equilibrium convergence criterion   0.113576 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.0147368 < 1 %
   Convergence criterion: max(du)                 11821.9
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.05395e-12
   mechanical equilibrium convergence criterion   0.0746106 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00819942 < 1 %
   Convergence criterion: max(du)                 6242.62
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.43206e-12
   mechanical equilibrium convergence criterion   0.0495047 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00471128 < 1 %
   Convergence criterion: max(du)                 3515.55
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.25723e-12
   mechanical equilibrium convergence criterion   0.0329431 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00276078 < 1 %
   Convergence criterion: max(du)                 2073.3
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.22524e-12
   mechanical equilibrium convergence criterion   0.0218954 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.00164519 < 1 %
   Convergence criterion: max(du)                 1261.94
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=1.17357e-12
   mechanical equilibrium convergence criterion   0.0145181 > 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.000994648 < 1 %
   Convergence criterion: max(du)                 783.637
   number of unstable constraints: 0

   solver residue: norm(KU-F)/norm(F)=9.75324e-13
   mechanical equilibrium convergence criterion   0.00960519 < 0.01 %
   Convergence criterion: norm(du)/norm(u)        0.000608466 < 1 %
   Convergence criterion: max(du)                 492.666
   number of unstable constraints: 0

   total number of iterations: 14
write lock file:

   FemModel initialization elapsed time:   0.01304
   Total Core solution elapsed time:       0.816123
   Linear solver elapsed time:             0.69173 (85%)

   Total elapsed time: 0 hrs 0 min 0 sec
 
=====Testing LACrouzeixRaviart Full-Stokes Finite element=====
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:

   solver residue: norm(KU-F)/norm(F)=1.16409e-16

   solver residue: norm(KU-F)/norm(F)=8.74292e-16

   solver residue: norm(KU-F)/norm(F)=1.48305e-16

   solver residue: norm(KU-F)/norm(F)=2.25601e-13
   Convergence criterion: norm(du)/norm(u)        inf > 1 %

   solver residue: norm(KU-F)/norm(F)=8.79076e-13
   Convergence criterion: norm(du)/norm(u)        613.091 > 1 %

   solver residue: norm(KU-F)/norm(F)=1.74552e-12
   Convergence criterion: norm(du)/norm(u)        275.944 > 1 %

   solver residue: norm(KU-F)/norm(F)=3.02177e-12
   Convergence criterion: norm(du)/norm(u)        144.085 > 1 %

   solver residue: norm(KU-F)/norm(F)=3.65509e-12
   Convergence criterion: norm(du)/norm(u)        81.9547 > 1 %

   solver residue: norm(KU-F)/norm(F)=3.77401e-12
   Convergence criterion: norm(du)/norm(u)        49.2514 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.12885e-12
   Convergence criterion: norm(du)/norm(u)        30.6732 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.12073e-12
   Convergence criterion: norm(du)/norm(u)        19.5522 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.69029e-12
   Convergence criterion: norm(du)/norm(u)        12.6543 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.55876e-12
   Convergence criterion: norm(du)/norm(u)        8.27219 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.29538e-12
   Convergence criterion: norm(du)/norm(u)        5.44338 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.98179e-12
   Convergence criterion: norm(du)/norm(u)        3.5976 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.03255e-12
   Convergence criterion: norm(du)/norm(u)        2.3846 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.54679e-12
   Convergence criterion: norm(du)/norm(u)        1.58362 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.63939e-12
   Convergence criterion: norm(du)/norm(u)        1.05304 > 1 %

   solver residue: norm(KU-F)/norm(F)=4.93329e-12
   Convergence criterion: norm(du)/norm(u)        0.700815 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.31795e-16
   Convergence criterion: norm(du)/norm(u)        0.700815 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       inf > 1 %

   solver residue: norm(KU-F)/norm(F)=6.7075e-12
   Convergence criterion: norm(du)/norm(u)        0.466662 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.34632e-16
   Convergence criterion: norm(du)/norm(u)        0.466662 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       100.47 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.61003e-12
   Convergence criterion: norm(du)/norm(u)        0.310857 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.3365e-16
   Convergence criterion: norm(du)/norm(u)        0.310857 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       50.2739 > 1 %

   solver residue: norm(KU-F)/norm(F)=7.71302e-12
   Convergence criterion: norm(du)/norm(u)        0.207121 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.33587e-16
   Convergence criterion: norm(du)/norm(u)        0.207121 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       33.5245 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.03136e-12
   Convergence criterion: norm(du)/norm(u)        0.138023 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.26718e-16
   Convergence criterion: norm(du)/norm(u)        0.138023 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       25.1423 > 1 %

   solver residue: norm(KU-F)/norm(F)=7.12969e-12
   Convergence criterion: norm(du)/norm(u)        0.0919849 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.27897e-16
   Convergence criterion: norm(du)/norm(u)        0.0919849 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       20.1095 > 1 %

   solver residue: norm(KU-F)/norm(F)=1.11949e-11
   Convergence criterion: norm(du)/norm(u)        0.0613056 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.25644e-16
   Convergence criterion: norm(du)/norm(u)        0.0613056 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       16.753 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.06433e-12
   Convergence criterion: norm(du)/norm(u)        0.0408587 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.31989e-16
   Convergence criterion: norm(du)/norm(u)        0.0408587 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       14.355 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.91819e-12
   Convergence criterion: norm(du)/norm(u)        0.0272303 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.33288e-16
   Convergence criterion: norm(du)/norm(u)        0.0272303 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       12.5564 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.22433e-12
   Convergence criterion: norm(du)/norm(u)        0.0181463 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.31206e-16
   Convergence criterion: norm(du)/norm(u)        0.0181463 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       11.1577 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.39459e-12
   Convergence criterion: norm(du)/norm(u)        0.012091 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.33921e-16
   Convergence criterion: norm(du)/norm(u)        0.012091 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       10.039 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.64638e-12
   Convergence criterion: norm(du)/norm(u)        0.00805458 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.34134e-16
   Convergence criterion: norm(du)/norm(u)        0.00805458 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       9.12383 > 1 %

   solver residue: norm(KU-F)/norm(F)=1.00306e-11
   Convergence criterion: norm(du)/norm(u)        0.00536389 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.3136e-16
   Convergence criterion: norm(du)/norm(u)        0.00536389 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       8.36144 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.19103e-12
   Convergence criterion: norm(du)/norm(u)        0.00357027 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.33417e-16
   Convergence criterion: norm(du)/norm(u)        0.00357027 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       7.71653 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.73058e-12
   Convergence criterion: norm(du)/norm(u)        0.00237462 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.31409e-16
   Convergence criterion: norm(du)/norm(u)        0.00237462 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       7.16391 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.64625e-12
   Convergence criterion: norm(du)/norm(u)        0.00157758 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.29002e-16
   Convergence criterion: norm(du)/norm(u)        0.00157758 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       6.68511 > 1 %

   solver residue: norm(KU-F)/norm(F)=4.56566e-12
   Convergence criterion: norm(du)/norm(u)        0.00104627 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.32577e-16
   Convergence criterion: norm(du)/norm(u)        0.00104627 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       6.26627 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.30999e-12
   Convergence criterion: norm(du)/norm(u)        0.000692088 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.32642e-16
   Convergence criterion: norm(du)/norm(u)        0.000692088 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       5.8968 > 1 %

   solver residue: norm(KU-F)/norm(F)=5.54397e-12
   Convergence criterion: norm(du)/norm(u)        0.000455982 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.29666e-16
   Convergence criterion: norm(du)/norm(u)        0.000455982 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       5.56847 > 1 %

   solver residue: norm(KU-F)/norm(F)=6.67369e-12
   Convergence criterion: norm(du)/norm(u)        0.000298596 < 1 %

   solver residue: norm(KU-F)/norm(F)=1.35017e-16
   Convergence criterion: norm(du)/norm(u)        0.000298596 < 1 %
   Convergence criterion: norm(dp/)/norm(p)       5.27476 > 1 %
   maximum number of nonlinear iterations (20) exceeded

   total number of iterations: 19
write lock file:

   FemModel initialization elapsed time:   0.00725
   Total Core solution elapsed time:       1.56204
   Linear solver elapsed time:             1.28232 (82%)

   Total elapsed time: 0 hrs 0 min 1 sec
SUCCESS difference: 2.5e-12 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VxMINI
SUCCESS difference: 3.6e-12 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VyMINI
SUCCESS difference: 3.4e-12 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VelMINI
SUCCESS difference:   9e-13 <   1e-10 test id: 701 test name: FlowbandFSshelf field: PressureMINI
SUCCESS difference: 3.3e-12 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VxMINIcondensed
SUCCESS difference: 4.6e-12 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VyMINIcondensed
SUCCESS difference: 4.5e-12 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VelMINIcondensed
SUCCESS difference: 6.6e-13 <   1e-10 test id: 701 test name: FlowbandFSshelf field: PressureMINIcondensed
SUCCESS difference: 1.5e-11 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VxTaylorHood
SUCCESS difference: 1.8e-11 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VyTaylorHood
SUCCESS difference: 1.8e-11 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VelTaylorHood
SUCCESS difference: 1.8e-12 <   1e-10 test id: 701 test name: FlowbandFSshelf field: PressureTaylorHood
SUCCESS difference: 2.7e-11 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VxLATaylorHood
SUCCESS difference: 3.7e-11 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VyLATaylorHood
SUCCESS difference: 3.6e-11 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VelLATaylorHood
SUCCESS difference: 2.3e-12 <   1e-10 test id: 701 test name: FlowbandFSshelf field: PressureLATaylorHood
SUCCESS difference: 1.1e-10 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VxCrouzeixRaviart
SUCCESS difference: 1.4e-10 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VyCrouzeixRaviart
SUCCESS difference: 1.4e-10 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VelCrouzeixRaviart
SUCCESS difference: 1.4e-11 <   1e-10 test id: 701 test name: FlowbandFSshelf field: PressureCrouzeixRaviart
SUCCESS difference: 2.6e-11 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VxLACrouzeixRaviart
SUCCESS difference: 3.4e-11 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VyLACrouzeixRaviart
SUCCESS difference: 3.4e-11 <   9e-05 test id: 701 test name: FlowbandFSshelf field: VelLACrouzeixRaviart
SUCCESS difference:   5e-12 <   1e-10 test id: 701 test name: FlowbandFSshelf field: PressureLACrouzeixRaviart
----------------finished:701-----------------------
----------------starting:802-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test802.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test802.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test802.py", line 31, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 802 test name: ValleyGlacierLevelsetThermalSSA3d field: N/A
----------------finished:802-----------------------
----------------starting:803-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test803.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test803.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test803.py", line 33, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 803 test name: ValleyGlacierLevelsetEnthalpyHO3d field: N/A
----------------finished:803-----------------------
----------------starting:806-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test806.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test806.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test806.py", line 46, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 806 test name: SquareShelfLevelsetCalvingSSA2dLevermann field: N/A
----------------finished:806-----------------------
----------------starting:807-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no smb.mass_balance specified: values set as zero
      no basalforcings.groundedice_melting_rate specified: values set as zero
      no basalforcings.floatingice_melting_rate specified: values set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test807.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test807.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test807.py", line 43, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 807 test name: SquareShelfLevelsetMeltingSSA2d field: N/A
----------------finished:807-----------------------
----------------starting:809-----------------------
----------------running-----------------------
      boundary conditions for stressbalance model: spc set as zero
      no balancethickness.thickening_rate specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)


[0] ??? Error using ==> ./classes/IoModel.cpp:3145
[0] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[1] ??? Error using ==> ./classes/IoModel.cpp:3145
[1] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file


[2] ??? Error using ==> ./classes/IoModel.cpp:3145
[2] SetFilePointerToData error message: could not find data with name "md.mmemasstransport.ids" in binary file

============================================================
   Binary file test809.outbin not found                                 
                                                            
   This typically happens when the run crashed.             
   Please check for error messages above or in the outlog   
============================================================

WARNING: test809.outbin does not exist
Traceback (most recent call last):
  File "/Users/jenkins/workspace/macOS-Silicon-Python/test/NightlyRun/runme.py", line 196, in runme
    exec(compile(open('test{}.py'.format(id)).read(), 'test{}.py'.format(id), 'exec'), globals())
  File "test809.py", line 36, in <module>
    md = solve(md, 'Transient')
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/solve.py", line 164, in solve
    md = loadresultsfromcluster(md)
  File "/Users/jenkins/workspace/macOS-Silicon-Python/src/m/solve/loadresultsfromcluster.py", line 68, in loadresultsfromcluster
    remove(md.private.runtimename + '.tar.gz')
AttributeError: 'NoneType' object has no attribute 'private'

FAILURE difference: N/A test id: 809 test name: ValleyGlacierLevelsetCalvingSSA2dCrevassedepth field: N/A
----------------finished:809-----------------------
----------------starting:902-----------------------
----------------running-----------------------
      no hydrology.basal_moulin_input specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.004054
   Total Core solution elapsed time:       0.09039
   Linear solver elapsed time:             0.031683 (35%)

   Total elapsed time: 0 hrs 0 min 0 sec
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.004078
   Total Core solution elapsed time:       0.089677
   Linear solver elapsed time:             0.02898 (32%)

   Total elapsed time: 0 hrs 0 min 0 sec
SUCCESS difference:   1e-15 <   1e-13 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: SedimentWaterHead1
SUCCESS difference:       0 <   1e-13 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: EplWaterHead1
SUCCESS difference:       0 <   1e-13 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: SedimentHeadResidual1
SUCCESS difference: 1.1e-15 <   1e-13 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: SedimentWaterHead4
SUCCESS difference:       0 <   1e-13 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: EplWaterHead4
SUCCESS difference:       0 <   1e-13 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: SedimentHeadResidual4
SUCCESS difference: 1.6e-15 <   1e-13 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: SedimentWaterHead5
SUCCESS difference: 1.9e-14 <   5e-12 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: EplWaterHead5
SUCCESS difference:       0 <   1e-11 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: SedimentHeadResidual5
SUCCESS difference: 2.6e-15 <   1e-13 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: SedimentWaterHead9
SUCCESS difference: 5.1e-14 <   5e-12 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: EplWaterHead9
SUCCESS difference:       0 <   1e-11 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: SedimentHeadResidual9
SUCCESS difference: 4.5e-14 <   1e-13 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: EplWaterHead10
SUCCESS difference: 5.8e-14 <   1e-13 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: EplWaterHeadSubstep10
SUCCESS difference: 1.7e-15 <   1e-13 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: SedimentWaterHead10
SUCCESS difference: 2.3e-15 <   1e-13 test id: 902 test name: SquareNoDynHydrolgyDCTwoLayers field: SedimentWaterHeadSubstep10
----------------finished:902-----------------------
----------------starting:906-----------------------
----------------running-----------------------
      no hydrology.basal_moulin_input specified: values set as zero
uploading input file and queuing script
launching solution sequence on remote cluster

Ice-sheet and Sea-level System Model (ISSM) version  4.24
(website: http://issm.jpl.nasa.gov forum: https://issm.ess.uci.edu/forum/)

call computational core:
write lock file:

   FemModel initialization elapsed time:   0.0044 
   Total Core solution elapsed time:       2.77555
   Linear solver elapsed time:             1.5693  (57%)

   Total elapsed time: 0 hrs 0 min 2 sec
SUCCESS difference: 1.1e-15 <   1e-13 test id: 906 test name: SquareNoDynHydrologyDCtimeadapt field: SedimentWaterHead2
SUCCESS difference: 2.7e-14 <   1e-13 test id: 906 test name: SquareNoDynHydrologyDCtimeadapt field: EplWaterHead2
SUCCESS difference: 3.4e-14 <   1e-13 test id: 906 test name: SquareNoDynHydrologyDCtimeadapt field: SedimentHeadResidual2
SUCCESS difference: 1.7e-15 <   1e-13 test id: 906 test name: SquareNoDynHydrologyDCtimeadapt field: SedimentHeadSubstep2
SUCCESS difference: 2.4e-14 <   1e-13 test id: 906 test name: SquareNoDynHydrologyDCtimeadapt field: EplHeadSubstep2
SUCCESS difference:       0 <   1e-13 test id: 906 test name: SquareNoDynHydrologyDCtimeadapt field: HydrologySubsteps2
SUCCESS difference:       0 <   1e-13 test id: 906 test name: SquareNoDynHydrologyDCtimeadapt field: HydrologySubTime2
SUCCESS difference: 2.4e-15 <   1e-13 test id: 906 test name: SquareNoDynHydrologyDCtimeadapt field: SedimentWaterHead3
SUCCESS difference: 2.1e-14 <   1e-13 test id: 906 test name: SquareNoDynHydrologyDCtimeadapt field: EplWaterHead3
SUCCESS difference:   2e-14 <   1e-13 test id: 906 test name: SquareNoDynHydrologyDCtimeadapt field: SedimentHeadResidual3
----------------finished:906-----------------------
-----------End of python_log.log-----------
Build step 'Execute shell' marked build as failure
Recording test results
Finished: FAILURE