Standard Output

From WikiROMS
Revision as of 00:05, 27 February 2008 by Kate (talk | contribs) (Description of the standard output)
(change visibility) (diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigationJump to search

ROMS writes to the standard output, unit 6 by default. It writes a very complete set of diagnostics on startup so that you can check to make sure everything is in order. An example of this output for the BENCHMARK option is below. I will attempt to describe each section here, but it's a wiki, so fix what's wrong:

Node #  0 (pid=   13399) is active.
Node #  2 (pid=   13401) is active.
Node #  3 (pid=   13402) is active.
Node #  1 (pid=   13400) is active.

We've got four MPI processes here, with the respective Unix pid's.

Model Input Parameters:  ROMS/TOMS version 3.0  
                         Wednesday - January 30, 2008 -  3:07:49 PM
-----------------------------------------------------------------------------
Benchmark Test, Idealized Southern Ocean, Large Grid
Operating system : Linux
CPU/hardware     : x86_64
Compiler system  : pgi
Compiler command : mpif90
Compiler flags   :  -O3 -tp k8-64 -Mfree
Input Script  : External/ocean_benchmark3.in
SVN Root URL  : https://www.myroms.org/svn/omlab/branches/kate
SVN Revision  : 526M
Local Root    : /import/home/u1/uaf/kate/kate_branch
Header Dir    : ./ROMS/Include
Header file   : benchmark.h
Analytical Dir: /import/home/u1/uaf/kate/kate_branch/ROMS/Functionals

This is header information, including the title for this case, notes on the operating system, compiler, compiler options, and some information on which files were used.

Resolution, Grid 01: 2048x0256x030, Parallel Nodes: 4, Tiling: 002x002

We've got one grid, with 2048x256x30 grid points running on four nodes in a 2x2 tiling. This information comes from the ascii input file, so if you don't see this output, ROMS isn't reading the input correctly.

Physical Parameters, Grid: 01

=============================
       200  ntimes          Number of timesteps for 3-D equations.
   150.000  dt              Timestep size (s) for 3-D equations.
        20  ndtfast         Number of timesteps for 2-D equations between
                              each 3D timestep.
         1  ERstr           Starting ensemble/perturbation run number.
         1  ERend           Ending ensemble/perturbation run number.
         0  nrrec           Number of restart records to read from disk.
         T  LcycleRST       Switch to recycle time-records in restart file.
      1000  nRST            Number of timesteps between the writing of data
                              into restart fields.
         1  ninfo           Number of timesteps between print of information
                              to standard output.
         T  ldefout         Switch to create a new output NetCDF file(s).
      1000  nHIS            Number of timesteps between the writing fields
                              into history file.
5.0000E+02  tnu2(01)        Horizontal, harmonic mixing coefficient (m2/s)
                              for tracer 01: temp
5.0000E+02  tnu2(02)        Horizontal, harmonic mixing coefficient (m2/s)
                              for tracer 02: salt
5.0000E+03  visc2           Horizontal, harmonic mixing coefficient (m2/s)
                              for momentum.
1.0000E-05  Akt_bak(01)     Background vertical mixing coefficient (m2/s)
                              for tracer 01: temp
1.0000E-05  Akt_bak(02)     Background vertical mixing coefficient (m2/s)
                              for tracer 02: salt
1.0000E-04  Akv_bak         Background vertical mixing coefficient (m2/s)
                              for momentum.
3.0000E-04  rdrg            Linear bottom drag coefficient (m/s).
3.0000E-03  rdrg2           Quadratic bottom drag coefficient.
2.0000E-02  Zob             Bottom roughness (m).
1.0000E+01  blk_ZQ          Height (m) of surface air humidity measurement.
1.0000E+01  blk_ZT          Height (m) of surface air temperature measurement.
1.0000E+01  blk_ZW          Height (m) of surface winds measurement.
         1  lmd_Jwt         Jerlov water type.
5.0000E+00  theta_s         S-coordinate surface control parameter.
4.0000E-01  theta_b         S-coordinate bottom  control parameter.
   200.000  Tcline          S-coordinate surface/bottom layer width (m) used
                              in vertical coordinate stretching.
  1025.000  rho0            Mean density (kg/m3) for Boussinesq approximation.
     0.000  dstart          Time-stamp assigned to model initialization (days).
      0.00  time_ref        Reference time for units attribute (yyyymmdd.dd)
0.0000E+00  Tnudg(01)       Nudging/relaxation time scale (days)
                              for tracer 01: temp
0.0000E+00  Tnudg(02)       Nudging/relaxation time scale (days)
                              for tracer 02: salt
0.0000E+00  Znudg           Nudging/relaxation time scale (days)
                              for free-surface.
0.0000E+00  M2nudg          Nudging/relaxation time scale (days)
                              for 2D momentum.
0.0000E+00  M3nudg          Nudging/relaxation time scale (days)
                              for 3D momentum.
0.0000E+00  obcfac          Factor between passive and active
                              open boundary conditions.
    10.000  T0              Background potential temperature (C) constant.
    35.000  S0              Background salinity (PSU) constant.
     1.000  gamma2          Slipperiness variable: free-slip (1.0) or 
                                                   no-slip (-1.0).

Gory details about grid one and all its parameters.

Output/Input Files:
            Output Restart File:  ocean_rst.nc
   IO Variable Information File:  External/varinfo.dat

The I/O filenames. There aren't many for this case!

Tile partition information for Grid 01: 2048x0256x0030 tiling: 002x002

    tile     Istr     Iend     Jstr     Jend     Npts
       0        1     1024        1      128  3932160
       1     1025     2048        1      128  3932160
       2        1     1024      129      256  3932160
       3     1025     2048      129      256  3932160
Maximum halo size in XI and ETA directions:
              HaloSizeI(1) =    3108
              HaloSizeJ(1) =     417
               TileSide(1) =    1030
               TileSize(1) =  136990

Since this is a parallel application, we may want to know the details on the tiling. Here they are.

Activated C-preprocessing Options:

 BENCHMARK3         Benchmark Test, Idealized Southern Ocean, Large Grid
 ALBEDO             Shortwave radiation from albedo equation.
 ANA_BSFLUX         Analytical kinematic bottom salinity flux.
 ANA_BTFLUX         Analytical kinematic bottom temperature flux.
 ANA_CLOUD          Analytical cloud fraction.
 ANA_GRID           Analytical grid set-up.
 ANA_HUMIDITY       Analytical surface air humidity.
 ANA_INITIAL        Analytical initial conditions.
 ANA_PAIR           Analytical surface air pressure.
 ANA_RAIN           Analytical rain fall rate.
 ANA_SRFLUX         Analytical kinematic shortwave radiation flux.
 ANA_SSFLUX         Analytical kinematic surface salinity flux.
 ANA_WINDS          Analytical surface wind components.
 ASSUMED_SHAPE      Using assumed-shape arrays.
 BULK_FLUXES        Surface bulk fluxes parametererization.
 CURVGRID           Orthogonal curvilinear grid.
 DJ_GRADPS          Parabolic Splines density Jacobian (Shchepetkin, 2002).
 DOUBLE_PRECISION   Double precision arithmetic.
 EW_PERIODIC        East-West periodic boundaries.
 LMD_CONVEC         LMD convective mixing due to shear instability.
 LMD_MIXING         Large/McWilliams/Doney interior mixing.
 LMD_NONLOCAL       LMD convective nonlocal transport.
 LMD_RIMIX          LMD diffusivity due to shear instability.
 LMD_SKPP           KPP surface boundary layer mixing.
 LONGWAVE           Compute net longwave radiation internally.
 MIX_GEO_TS         Mixing of tracers along geopotential surfaces.
 MIX_S_UV           Mixing of momentum along constant S-surfaces.
 MPI                MPI distributed-memory configuration.
 NONLINEAR          Nonlinear Model.
 NONLIN_EOS         Nonlinear Equation of State for seawater.
 NORTHERN_WALL      Wall boundary at Northern edge.
 POWER_LAW          Power-law shape time-averaging barotropic filter.
 PROFILE            Time profiling activated .
 !RST_SINGLE        Double precision fields in restart NetCDF file.
 SALINITY           Using salinity.
 SOLAR_SOURCE       Solar Radiation Source Term.
 SOLVE3D            Solving 3D Primitive Equations.
 SOUTHERN_WALL      Wall boundary at Southern edge.
 SPLINES            Conservative parabolic spline reconstruction.
 SPHERICAL          Spherical grid configuration.
 TS_U3HADVECTION    Third-order upstream bias horizontal advection of tracers.
 TS_C4VADVECTION    Fourth-order centered vertical advection of tracers.
 TS_DIF2            Harmonic mixing of tracers.
 UV_ADV             Advection of momentum.
 UV_COR             Coriolis term.
 UV_U3HADVECTION    Third-order upstream bias advection of momentum.
 UV_QDRAG           Quadratic bottom stress.
 UV_VIS2            Harmonic mixing of momentum.
 VAR_RHO_2D         Variable density barotropic mode.

The list of C preprocessor variables that were defined, starting with the case name (BENCHMARK3).

INITIAL: Configurating and initializing forward nonlinear model ...

Vertical S-coordinate System: 
level   S-coord     Cs-curve          at_hmin  over_slope     at_hmax
   30   0.0000000   0.0000000           0.000       0.000       0.000
   29  -0.0333333  -0.0024174          -7.392     -11.622     -15.853
   28  -0.0666667  -0.0052838         -14.918     -24.165     -33.412
   27  -0.1000000  -0.0087922         -22.638     -38.024     -53.410
   26  -0.1333333  -0.0131904         -30.624     -53.707     -76.790
   25  -0.1666667  -0.0187972         -38.973     -71.868    -104.763
   24  -0.2000000  -0.0260168         -47.805     -93.334    -138.864
   23  -0.2333333  -0.0353508         -57.272    -119.136    -181.000
   22  -0.2666667  -0.0473981         -67.553    -150.499    -233.446
   21  -0.3000000  -0.0628318         -78.850    -188.805    -298.761
   20  -0.3333333  -0.0823381         -91.368    -235.460    -379.551
   19  -0.3666667  -0.1065031        -105.284    -291.665    -478.045
   18  -0.4000000  -0.1356491        -120.695    -358.081    -595.466
   17  -0.4333333  -0.1696534        -137.563    -434.456    -731.349
   16  -0.4666667  -0.2078237        -155.680    -519.372    -883.063
   15  -0.5000000  -0.2489214        -174.676    -610.289   -1045.901
   14  -0.5333333  -0.2913811        -194.081    -703.998   -1213.915
   13  -0.5666667  -0.3336756        -213.436    -797.368   -1381.301
   12  -0.6000000  -0.3746809        -232.404    -888.096   -1543.788
   11  -0.6333333  -0.4138998        -250.837    -975.161   -1699.486
   10  -0.6666667  -0.4514899        -268.780   -1058.888   -1848.995
    9  -0.7000000  -0.4881475        -286.444   -1140.702   -1994.960
    8  -0.7333333  -0.5249360        -304.147   -1222.785   -2141.423
    7  -0.7666667  -0.5631362        -322.274   -1307.762   -2293.251
    6  -0.8000000  -0.6041494        -341.245   -1398.506   -2455.768
    5  -0.8333333  -0.6494565        -361.504   -1498.053   -2634.601
    4  -0.8666667  -0.7006196        -383.519   -1609.604   -2835.688
    3  -0.9000000  -0.7593114        -407.793   -1736.588   -3065.383
    2  -0.9333333  -0.8273620        -434.875   -1882.759   -3330.642
    1  -0.9666667  -0.9068164        -465.378   -2052.307   -3639.236
    0  -1.0000000  -1.0000000        -500.000   -2250.000   -4000.000

This stuff is actually quite useful for finding out about your vertical coordinate system. You asked for 30 levels, the shallowest water is 500 meters deep and the deepest is 4000 meters deep. This lists the vertical resolution for shallow, deep, and intermediate waters.

Time Splitting Weights: ndtfast = 20 nfast = 29

   Primary            Secondary            Accumulated to Current Step
 1-0.0009651193358779 0.0500000000000000-0.0009651193358779 0.0500000000000000
 2-0.0013488780126037 0.0500482559667939-0.0023139973484816 0.1000482559667939
 3-0.0011514592651645 0.0501156998674241-0.0034654566136461 0.1501639558342179
 4-0.0003735756740661 0.0501732728306823-0.0038390322877122 0.2003372286649002
 5 0.0009829200513762 0.0501919516143856-0.0028561122363360 0.2505291802792859
 6 0.0029141799764308 0.0501428056118168 0.0000580677400948 0.3006719858911026
 7 0.0054132615310267 0.0499970966129953 0.0054713292711215 0.3506690825040979
 8 0.0084687837865132 0.0497264335364439 0.0139401130576347 0.4003955160405418
 9 0.0120633394191050 0.0493029943471183 0.0260034524767397 0.4496985103876600
10 0.0161716623600090 0.0486998273761630 0.0421751148367487 0.4983983377638231
11 0.0207585511322367 0.0478912442581626 0.0629336659689854 0.5462895820219856
12 0.0257765478740990 0.0468533167015507 0.0887102138430845 0.5931428987235363
13 0.0311633730493854 0.0455644893078458 0.1198735868924699 0.6387073880313821
14 0.0368391158442262 0.0440063206553765 0.1567127027366961 0.6827137086867586
15 0.0427031802506397 0.0421643648631652 0.1994158829873358 0.7248780735499238
16 0.0486309868367616 0.0400292058506332 0.2480468698240974 0.7649072794005569
17 0.0544704302037592 0.0375976565087951 0.3025173000278566 0.8025049359093520
18 0.0600380921294286 0.0348741349986072 0.3625553921572852 0.8373790709079591
19 0.0651152103984764 0.0318722303921357 0.4276706025557615 0.8692513013000948
20 0.0694434033194840 0.0286164698722119 0.4971140058752455 0.8978677711723067
21 0.0727201499285570 0.0251442997062377 0.5698341558038026 0.9230120708785446
22 0.0745940258796570 0.0215082922098099 0.6444281816834597 0.9445203630883544
23 0.0746596950216181 0.0177785909158270 0.7190878767050776 0.9622989540041814
24 0.0724526566618460 0.0140456061647461 0.7915405333669236 0.9763445601689275
25 0.0674437485167026 0.0104229733316538 0.8589842818836262 0.9867675335005814
26 0.0590334053485720 0.0070507859058187 0.9180176872321983 0.9938183194064001
27 0.0465456732896125 0.0040991156383901 0.9645633605218107 0.9979174350447902
28 0.0292219798521905 0.0017718319739095 0.9937853403740011 0.9996892670186996
29 0.0062146596259991 0.0003107329813000 1.0000000000000000 0.9999999999999996
ndtfast, nfast =   20  29   nfast/ndtfast = 1.45000
Centers of gravity and integrals (values must be 1, 1, approx 1/2, 1, 1):
   1.000000000000 1.060707743385 0.530353871693 1.000000000000 1.000000000000
Power filter parameters, Fgamma, gamma =  0.28400   0.14200

Timestepping details for those who know how to parse it.

Minimum X-grid spacing, DXmin =  6.67292613E+00 km
Maximum X-grid spacing, DXmax =  1.25747428E+01 km
Minimum Y-grid spacing, DYmin =  8.68753316E+00 km
Maximum Y-grid spacing, DYmax =  8.68753316E+00 km
Minimum Z-grid spacing, DZmin =  7.39187981E+00 m
Maximum Z-grid spacing, DZmax =  3.60764219E+02 m

As state, min and max grid spacings.

Minimum barotropic Courant Number =  9.46797803E-02
Maximum barotropic Courant Number =  2.63504236E-01
Maximum Coriolis   Courant Number =  2.05621375E-02
Maximum grid stiffness ratios:  rx0 =   4.193425E-01 (Beckmann and Haidvogel)
                                rx1 =   1.224868E+01 (Haney)
Initial basin volumes: TotVolume =  1.65993688308698E+17 m3
                       MinVolume =  4.30124999569357E+08 m3
                       MaxVolume =  3.93471529157603E+10 m3
                         Max/Min =  9.14784143101536E+01

Other diagnostics for determining if all your decisions were sensible.

NL ROMS/TOMS: started time-stepping:( TimeSteps: 00000001 - 00000200)

  STEP  time[DAYS]  KINETIC_ENRG    POTEN_ENRG    TOTAL_ENRG   NET_VOLUME  trd
     0     0.00000  0.000000E+00  1.962855E+04  1.962855E+04  1.659937E+17   0
     1     0.00174  9.462490E-09  1.962855E+04  1.962855E+04  1.659937E+17   0
     2     0.00347  3.773820E-08  1.962855E+04  1.962855E+04  1.659937E+17   0
     3     0.00521  8.474779E-08  1.962855E+04  1.962855E+04  1.659937E+17   0
     4     0.00694  1.504326E-07  1.962855E+04  1.962855E+04  1.659937E+17   0
     5     0.00868  2.347116E-07  1.962855E+04  1.962855E+04  1.659937E+17   0
     6     0.01042  3.374971E-07  1.962855E+04  1.962855E+04  1.659937E+17   0
     7     0.01215  4.586904E-07  1.962855E+04  1.962855E+04  1.659937E+17   0
                :
   198     0.34375  2.922162E-05  1.962855E+04  1.962855E+04  1.659937E+17   0
   199     0.34549  2.913050E-05  1.962855E+04  1.962855E+04  1.659937E+17   0
   200     0.34722  2.903620E-05  1.962855E+04  1.962855E+04  1.659937E+17   0

The actual timestepping - finally! Here, we asked for a diagnostics report every timestep for all 200 of them.

Elapsed CPU time (seconds):
Node   #  0 CPU:    3593.181
Node   #  1 CPU:    3593.181
Node   #  2 CPU:    3593.181
Node   #  3 CPU:    3593.181
Total:             14372.725
Nonlinear model elapsed time profile:
 Initialization ...................................         1.816  ( 0.0126 %)
 Reading of input data ............................         0.000  ( 0.0000 %)
 Processing of input data .........................         6.522  ( 0.0454 %)
 Computation of vertical boundary conditions ......         1.120  ( 0.0078 %)
 Computation of global information integrals ......        16.315  ( 0.1135 %)
 Writing of output data ...........................         0.001  ( 0.0000 %)
 Model 2D kernel ..................................      1032.187  ( 7.1816 %)
 2D/3D coupling, vertical metrics .................        24.186  ( 0.1683 %)
 Omega vertical velocity ..........................        31.447  ( 0.2188 %)
 Equation of state for seawater ...................       118.504  ( 0.8245 %)
 Atmosphere-Ocean bulk flux parameterization ......        70.950  ( 0.4936 %)
 KPP vertical mixing parameterization .............       438.943  ( 3.0540 %)
 3D equations right-side terms ....................       198.657  ( 1.3822 %)
 3D equations predictor step ......................       353.069  ( 2.4565 %)
 Pressure gradient ................................       129.359  ( 0.9000 %)
 Harmonic mixing of tracers, geopotentials ........       291.478  ( 2.0280 %)
 Harmonic stress tensor, S-surfaces ...............       115.342  ( 0.8025 %)
 Corrector time-step for 3D momentum ..............       227.856  ( 1.5853 %)
 Corrector time-step for tracers ..................       270.002  ( 1.8786 %)
                                             Total:      3327.755   23.1533
Nonlinear model message Passage profile:
 Message Passage: 2D halo exchanges ...............        25.312  ( 0.1761 %)
 Message Passage: 3D halo exchanges ...............        13.013  ( 0.0905 %)
 Message Passage: 4D halo exchanges ...............         6.765  ( 0.0471 %)
 Message Passage: data broadcast ..................         0.004  ( 0.0000 %)
 Message Passage: data reduction ..................       216.131  ( 1.5038 %)
                                             Total:       261.224    1.8175
All percentages are with respect to total time =         14372.725

Some timing statistics produced by ROMS internally. Some of its percentages are a little odd for parallel runs, but they should make sense for serial runs. Note that the 2D engine is significant. Also note that we've turned off writing of NetCDF files for this case - realistic problems spend a significant fraction in the I/O.

ROMS/TOMS - Output NetCDF summary for Grid 01:
Analytical header files used:
    ROMS/Functionals/ana_btflux.h
    ROMS/Functionals/ana_cloud.h
    ROMS/Functionals/ana_grid.h
    ROMS/Functionals/ana_humid.h
    ROMS/Functionals/ana_initial.h
    ROMS/Functionals/ana_pair.h
    ROMS/Functionals/ana_rain.h
    ROMS/Functionals/ana_srflux.h
    ROMS/Functionals/ana_stflux.h
    ROMS/Functionals/ana_tair.h
    ROMS/Functionals/ana_winds.h
ROMS/TOMS: DONE... Wednesday - January 30, 2008 -  4:07:42 PM

Wrap-up and report of ending time.