blow up at the lowest level__both two cases

[kee]

hi,

I made a 1/6deg grid, with 20 levels in vertical and 1151x0734 in horizontal.
Dt was set 600s. it blow up at the beginning of calculation. But I do not think it is much related with dt, since

Code: Select all

Minimum barotropic Courant Number =  1.38934555E-02
 Maximum barotropic Courant Number =  4.67089096E-01
 Maximum Coriolis   Courant Number =  7.97293427E-02

Code: Select all

STEP   Day HH:MM:SS  KINETIC_ENRG   POTEN_ENRG    TOTAL_ENRG    NET_VOLUME
          C => (i,j,k)       Cu            Cv            Cw         Max Speed

      0     0 00:00:00  8.454227E-17  2.252285E+04  2.252285E+04  5.553917E+17
         (0001,207,05)  3.557785E-07  0.000000E+00  0.000000E+00  1.553116E-05
      DEF_HIS   - creating history file, Grid 01: Outputs/pac_his_0001.nc
      WRT_HIS   - wrote history  fields (Index=1,1) into time record = 0000001
      DEF_AVG   - creating average file, Grid 01: Outputs/pac_avg.nc
      1     0 00:10:00 NaN           NaN           NaN           NaN
         (0319,640,20)  4.067729E-03  4.619708E-03  0.000000E+00  9.879360E-02

 Blowing-up: Saving latest model state into  RESTART file

the odd thing is that the blowing-up happened in the lowest level(check above).
So I made the grid once again with THETA_s = 5.0 and THETA_b =0.4, and 22 levels in vertical.
however this time the blowing-up occured also in the lowest level - 22th level(check below).

Code: Select all

STEP   Day HH:MM:SS  KINETIC_ENRG   POTEN_ENRG    TOTAL_ENRG    NET_VOLUME
          C => (i,j,k)       Cu            Cv            Cw         Max Speed

      0     0 00:00:00  2.653413E-17  2.240606E+04  2.240606E+04  5.729861E+17
         (0001,212,22)  1.062344E-07  0.000000E+00  0.000000E+00  4.636271E-06
      DEF_HIS   - creating history file, Grid 01: Outputs/pac_his_0001.nc
      WRT_HIS   - wrote history  fields (Index=1,1) into time record = 0000001
      DEF_AVG   - creating average file, Grid 01: Outputs/pac_avg.nc
      1     0 00:10:00 NaN           NaN           NaN           NaN
         (0310,574,22)  5.346942E-03  4.103753E-03  0.000000E+00  1.268982E-01

 Blowing-up: Saving latest model state into  RESTART file

using the same inputs and the same DT the AGRIF-version model ran smoothly. But I donot want to use that verion now for it does not have the PERFECT_RESTART option.

But I have succeeded running using myroms with a similar configuration before but not this time.

the CPP flags I used are

Code: Select all

#define UV_ADV
#define UV_COR
#define UV_QDRAG
#define DJ_GRADPS

#define TS_U3HADVECTION
#define TS_C4VADVECTION
#define UV_VIS2
#define MIX_S_UV
#define VISC_GRID

# define DIFF_GRID
# define MIX_GEO_TS
# define TS_DIF2

/*   general */
#define NONLIN_EOS
#define SALINITY
#define SOLVE3D
#define MASKING
#define SPLINES
#define QCORRECTION
#define SRELAXATION
#define CURVGRID

/*vertical mixing*/
#define LMD_MIXING
#ifdef LMD_MIXING
# define LMD_RIMIX
# define LMD_CONVEC
# define LMD_SKPP
# define LMD_NONLOCAL
#endif

#define CLIMATOLOGY
#define M2CLIMATOLOGY
#define M3CLIMATOLOGY
#define ZCLIMATOLOGY

#define RADIATION_2D
#define SPONGE
#define M2CLM_NUDGING
#define M3CLM_NUDGING
#define TCLM_NUDGING
#define ZCLM_NUDGING
#define TCLIMATOLOGY

#define ANA_BSFLUX
#define ANA_BTFLUX


/*I/O setting*/
#define PERFECT_RESTART
#define AVERAGES
#define AVERAGES2
#undef  DIAGNOSTICS_TS
#undef  DIAGNOSTICS_UV

the *.in file is like

Code: Select all

! Number of nested grids.

      Ngrids =  1

! Number of grid nesting layers.  This parameter is used to allow refinement
! and composite grid combinations.

  NestLayers =  1

! Number of grids in each nesting layer [1:NestLayers].

GridsInLayer =  1

! Grid dimension parameters. See notes below in the Glossary for how to set
! these parameters correctly.

          Lm == 1151            ! Number of I-direction INTERIOR RHO-points
          Mm == 734            ! Number of J-direction INTERIOR RHO-points
           N == 22            ! Number of vertical levels

        Nbed =  0             ! Number of sediment bed layers

         NAT =  2             ! Number of active tracers (usually, 2)
         NPT =  0             ! Number of inactive passive tracers
         NCS =  0             ! Number of cohesive (mud) sediment tracers
         NNS =  0             ! Number of non-cohesive (sand) sediment tracers

! Domain decomposition parameters for serial, distributed-memory or
! shared-memory configurations used to determine tile horizontal range
! indices (Istr,Iend) and (Jstr,Jend), [1:Ngrids].

      NtileI == 4                               ! I-direction partition
      NtileJ == 3                               ! J-direction partition

! Set lateral boundary conditions keyword. Notice that a value is expected
! for each boundary segment per nested grid for each state variable.
!
! Each tracer variable requires [1:4,1:NAT+NPT,Ngrids] values. Otherwise,
! [1:4,1:Ngrids] values are expected for other variables. The boundary
! order is: 1=west, 2=south, 3=east, and 4=north. That is, anticlockwise
! starting at the western boundary.
!
! The keyword is case insensitive and usually has three characters. However,
! it is possible to have compound keywords, if applicable. For example, the
! keyword "RadNud" implies radiation boundary condition with nudging. This
! combination is usually used in active/passive radiation conditions.
!
!   Keyword    Lateral Boundary Condition Type
!
!   Cha        Chapman_implicit (free-surface)
!   Che        Chapman_explicit (free-surface)
!   Cla        Clamped
!   Clo        Closed
!   Fla        Flather (2D momentum)                  _____N_____     j=Mm
!   Gra        Gradient                              |     4     |
!   Nes        Nested (refinement)                   |           |
!   Nud        Nudging                             1 W           E 3
!   Per        Periodic                              |           |
!   Rad        Radiation                             |_____S_____|
!   Red        Reduced Physics (2D momentum)               2          j=1
!   Shc        Shchepetkin (2D momentum)            i=1         i=Lm
!
!                   W       S       E       N
!                   e       o       a       o
!                   s       u       s       r
!                   t       t       t       t
!                           h               h
!
!                   1       2       3       4

   LBC(isFsur) ==   Cha     Cha     Clo     Clo         ! free-surface
   LBC(isUbar) ==   Fla     Fla     Clo     Clo         ! 2D U-momentum
   LBC(isVbar) ==   Fla     Fla     Clo     Clo         ! 2D V-momentum
   LBC(isUvel) ==   RadNud  RadNud  Clo     Clo         ! 3D U-momentum
   LBC(isVvel) ==   RadNud  RadNud  Clo     Clo      ! 3D V-momentum
   LBC(isMtke) ==   Gra     Gra     Clo     Clo         ! mixing TKE

   LBC(isTvar) ==   RadNud  RadNud  Clo     Clo \       ! temperature
                    RadNud  RadNud  Clo     Clo   ! salinity

! Adjoint-based algorithms can have different lateral boundary
! conditions keywords.

ad_LBC(isFsur) ==   Cha     Cha     Clo     Cha         ! free-surface
ad_LBC(isUbar) ==   Fla     Fla     Clo     Fla         ! 2D U-momentum
ad_LBC(isVbar) ==   Fla     Fla     Clo     Fla         ! 2D U-momentum
ad_LBC(isUvel) ==   Cla     Cla     Clo     Cla         ! 3D U-momentum
ad_LBC(isVvel) ==   Cla     Cla     Clo     Cla         ! 3D V-momentum
ad_LBC(isMtke) ==   Gra     Gra     Clo     Gra         ! mixing TKE

ad_LBC(isTvar) ==   Cla     Cla     Clo     Cla \       ! temperature
                    Cla     Cla     Clo     Cla         ! salinity

! Set lateral open boundary edge volume conservation switch for
! nonlinear model and adjoint-based algorithms. Usually activated
! with radiation boundary conditions to enforce global mass
! conservation, except if tidal forcing enabled. [1:Ngrids].

   VolCons(west)  ==  T                            ! western  boundary
   VolCons(east)  ==  F                            ! eastern  boundary
   VolCons(south) ==  T                            ! southern boundary
   VolCons(north) ==  F                            ! northern boundary

ad_VolCons(west)  ==  F                            ! western  boundary
ad_VolCons(east)  ==  F                            ! eastern  boundary
ad_VolCons(south) ==  F                            ! southern boundary
ad_VolCons(north) ==  F                            ! northern boundary

! Time-Stepping parameters.

      NTIMES == 777600
          DT == 600.0d0
     NDTFAST == 40

! Model iteration loops parameters.

       ERstr =  1
       ERend =  1
      Nouter =  1
      Ninner =  1
  Nintervals =  1

! Number of eigenvalues (NEV) and eigenvectors (NCV) to compute for the
! Lanczos/Arnoldi problem in the Generalized Stability Theory (GST)
! analysis. NCV must be greater than NEV (see documentation below).

         NEV =  2                               ! Number of eigenvalues
         NCV =  10                              ! Number of eigenvectors

! Input/Output parameters.

       NRREC == 0
   LcycleRST == T
        NRST == 432             ! 3 days
        NSTA == 1
        NFLT == 1
       NINFO == 1

! Output history, average, diagnostic files parameters.

     LDEFOUT == T
        NHIS == 144
     NDEFHIS == 4320
      NTSAVG == 1
        NAVG == 4320
     NDEFAVG == 0
      NTSDIA == 1
        NDIA == 40
     NDEFDIA == 0

! Output tangent linear and adjoint models parameters.

   LcycleTLM == F
        NTLM == 40
     NDEFTLM == 0
   LcycleADJ == F
        NADJ == 40
     NDEFADJ == 0
        NSFF == 40
        NOBC == 40

! GST output and check pointing restart parameters.

   LmultiGST =  F                               ! one eigenvector per file
     LrstGST =  F                               ! GST restart switch
  MaxIterGST =  500                             ! maximum number of iterations
        NGST =  10                              ! check pointing interval

! Relative accuracy of the Ritz values computed in the GST analysis.

    Ritz_tol =  1.0d-15

! Harmonic/biharmonic horizontal diffusion of tracer for nonlinear model
! and adjoint-based algorithms: [1:NAT+NPT,Ngrids].

        TNU2 == 50.0d0  50.0d0                  ! m2/s
        TNU4 == 2.0d+8  2.0d+8                  ! m4/s

     ad_TNU2 == 0.0d0    0.0d0                  ! m2/s
     ad_TNU4 == 0.0d0    0.0d0                  ! m4/s

! Harmonic/biharmonic, horizontal viscosity coefficient for nonlinear model
! and adjoint-based algorithms: [Ngrids].

       VISC2 == 100.0d0                          ! m2/s
       VISC4 == 4.0d0+8                         ! m4/s

    ad_VISC2 == 0.0d0                           ! m2/s
    ad_VISC4 == 0.0d0                           ! m4/s

! Vertical mixing coefficients for tracers in nonlinear model and
! basic state scale factor in adjoint-based algorithms: [1:NAT+NPT,Ngrids]

     AKT_BAK == 5.0d-6 5.0d-6                   ! m2/s

  ad_AKT_fac == 1.0d0  1.0d0                    ! nondimensional

! Vertical mixing coefficient for momentum for nonlinear model and
! basic state scale factor in adjoint-based algorithms: [Ngrids].

     AKV_BAK == 5.0d-5                          ! m2/s

  ad_AKV_fac == 1.0d0                           ! nondimensional

! Turbulent closure parameters.

     AKK_BAK == 5.0d-6                          ! m2/s
     AKP_BAK == 5.0d-6                          ! m2/s
      TKENU2 == 0.0d0                           ! m2/s
      TKENU4 == 0.0d0                           ! m4/s

! Generic length-scale turbulence closure parameters.

       GLS_P == 3.0d0                           ! K-epsilon
       GLS_M == 1.5d0
       GLS_N == -1.0d0
    GLS_Kmin == 7.6d-6
    GLS_Pmin == 1.0d-12

    GLS_CMU0 == 0.5477d0
      GLS_C1 == 1.44d0
      GLS_C2 == 1.92d0
     GLS_C3M == -0.4d0
     GLS_C3P == 1.0d0
    GLS_SIGK == 1.0d0
    GLS_SIGP == 1.30d0

! Constants used in surface turbulent kinetic energy flux computation.

  CHARNOK_ALPHA == 1400.0d0         ! Charnok surface roughness
 ZOS_HSIG_ALPHA == 0.5d0            ! roughness from wave amplitude
       SZ_ALPHA == 0.25d0           ! roughness from wave dissipation
      CRGBAN_CW == 100.0d0          ! Craig and Banner wave breaking

! Constants used in momentum stress computation.

        RDRG == 3.0d-04                    ! m/s
       RDRG2 == 3.0d-03                    ! nondimensional
         Zob == 0.02d0                     ! m
         Zos == 0.02d0                     ! m

! Height (m) of atmospheric measurements for Bulk fluxes parameterization.

      BLK_ZQ == 10.0d0                     ! air humidity
      BLK_ZT == 10.0d0                     ! air temperature
      BLK_ZW == 10.0d0                     ! winds

! Minimum depth for wetting and drying.

       DCRIT == 0.10d0                     ! m

! Various parameters.

       WTYPE == 1
     LEVSFRC == 15
     LEVBFRC == 1

! Set vertical, terrain-following coordinates transformation equation and
! stretching function (see below for details), [1:Ngrids].

  Vtransform == 1                          ! transformation equation
 Vstretching == 1                          ! stretching function

! Vertical S-coordinates parameters (see below for details), [1:Ngrids].

     THETA_S == 5.0d0                      ! surface stretching parameter
     THETA_B == 0.4d0                      ! bottom  stretching parameter
      TCLINE == 10.0d0                    ! critical depth (m)

! Mean Density and Brunt-Vaisala frequency.

        RHO0 =  1025.0d0                   ! kg/m3
     BVF_BAK =  1.0d-5                     ! 1/s2

! Time-stamp assigned for model initialization, reference time
! origin for tidal forcing, and model reference time for output
! NetCDF units attribute.

      DSTART =  0.0d0                      ! days
  TIDE_START =  0.0d0                      ! days
    TIME_REF =  0.0d0                      ! yyyymmdd.dd

! Nudging/relaxation time scales, inverse scales will be computed
! internally, [1:Ngrids].

       TNUDG == 360.0d0 360.0d0              ! days
       ZNUDG == 360.0d0                      ! days
      M2NUDG == 360.0d0                      ! days
      M3NUDG == 360.0d0                      ! days

! Factor between passive (outflow) and active (inflow) open boundary
! conditions, [1:Ngrids]. If OBCFAC > 1, nudging on inflow is stronger
! than on outflow (recommended).

      OBCFAC == 120.0d0                     ! nondimensional

! Linear equation of State parameters:

          R0 == 1027.0d0                   ! kg/m3
          T0 == 10.0d0                     ! Celsius
          S0 == 35.0d0                     ! nondimensional
       TCOEF == 1.7d-4                     ! 1/Celsius
       SCOEF == 7.6d-4                     ! nondimensional

! Slipperiness parameter: 1.0 (free slip) or -1.0 (no slip)

      GAMMA2 == 1.0d0

! Logical switches (TRUE/FALSE) to activate horizontal momentum transport
! point Sources/Sinks (like river runoff transport) and mass point
! Sources/Sinks (like volume vertical influx), [1:Ngrids].

      LuvSrc == F                          ! horizontal momentum transport
       LwSrc == F                          ! volume vertical influx

! Logical switches (TRUE/FALSE) to activate tracers point Sources/Sinks
! (like river runoff) and to specify which tracer variables to consider:
! [1:NAT+NPT,Ngrids].
! See glossary below for details.

  LtracerSrc == F F                        ! temperature, salinity, inert

! Logical switches (TRUE/FALSE) to specify which variables to process for
! tracers climatology: [1:NAT+NPT,Ngrids]. See glossary below for details.

  LtracerCLM == T T                        ! temperature, salinity, inert

! Starting (DstrS) and ending (DendS) day for adjoint sensitivity forcing.
! DstrS must be less or equal to DendS. If both values are zero, their
! values are reset internally to the full range of the adjoint integration.

       DstrS == 0.0d0                      ! starting day
       DendS == 0.0d0                      ! ending day

! Starting and ending vertical levels of the 3D adjoint state variables
! whose sensitivity is required.

       KstrS == 1                          ! starting level
       KendS == 1                          ! ending level

! Logical switches (TRUE/FALSE) to specify the adjoint state variables
! whose sensitivity is required.

Lstate(isFsur) == F                        ! free-surface
Lstate(isUbar) == F                        ! 2D U-momentum
Lstate(isVbar) == F                        ! 2D V-momentum
Lstate(isUvel) == F                        ! 3D U-momentum
Lstate(isVvel) == F                        ! 3D V-momentum

Lstate(isTvar) == F F                      ! NT tracers

! Logical switches (TRUE/FALSE) to specify the state variables for
! which Forcing Singular Vectors or Stochastic Optimals is required.

Fstate(isFsur) == F                        ! free-surface
Fstate(isUbar) == F                        ! 2D U-momentum
Fstate(isVbar) == F                        ! 2D V-momentum
Fstate(isUvel) == F                        ! 3D U-momentum
Fstate(isVvel) == F                        ! 3D V-momentum
Fstate(isTvar) == F F                      ! NT tracers

Fstate(isUstr) == T                        ! surface U-stress
Fstate(isVstr) == T                        ! surface V-stress
Fstate(isTsur) == F F                      ! NT surface tracers flux

! Stochastic Optimals time decorrelation scale (days) assumed for
! red noise processes.

      SO_decay == 2.0d0                    ! days

! Stochastic Optimals surface forcing standard deviation for
! dimensionalization.

SO_sdev(isFsur) == 1.0d0                   ! free-surface
SO_sdev(isUbar) == 1.0d0                   ! 2D U-momentum
SO_sdev(isVbar) == 1.0d0                   ! 2D V-momentum
SO_sdev(isUvel) == 1.0d0                   ! 3D U-momentum
SO_sdev(isVvel) == 1.0d0                   ! 3D V-momentum
SO_sdev(isTvar) == 1.0d0 1.0d0             ! NT tracers

SO_sdev(isUstr) == 1.0d0                   ! surface U-stress
SO_sdev(isVstr) == 1.0d0                   ! surface V-stress
SO_sdev(isTsur) == 1.0d0 1.0d0             ! NT surface tracers flux

! Logical switches (TRUE/FALSE) to activate writing of fields into
! HISTORY output file.

Hout(idUvel) == T       ! u                  3D U-velocity
Hout(idVvel) == T       ! v                  3D V-velocity
Hout(idu3dE) == F       ! u_eastward         3D U-eastward  at RHO-points
Hout(idv3dN) == F       ! v_northward        3D V-northward at RHO-points
Hout(idWvel) == T       ! w                  3D W-velocity
Hout(idOvel) == T       ! omega              omega vertical velocity
Hout(idUbar) == T       ! ubar               2D U-velocity
Hout(idVbar) == T       ! vbar               2D V-velocity
Hout(idu2dE) == F       ! ubar_eastward      2D U-eastward  at RHO-points
Hout(idv2dN) == F       ! vbar_northward     2D V-northward at RHO-points
Hout(idFsur) == T       ! zeta               free-surface
Hout(idBath) == T       ! bath               time-dependent bathymetry

Hout(idTvar) == T T     ! temp, salt         temperature and salinity

Hout(idUsms) == F       ! sustr              surface U-stress
Hout(idVsms) == F       ! svstr              surface V-stress

! Linear equation of State parameters:

          R0 == 1027.0d0                   ! kg/m3
          T0 == 10.0d0                     ! Celsius
          S0 == 35.0d0                     ! nondimensional
       TCOEF == 1.7d-4                     ! 1/Celsius
       SCOEF == 7.6d-4                     ! nondimensional

! Slipperiness parameter: 1.0 (free slip) or -1.0 (no slip)

      GAMMA2 == 1.0d0

! Logical switches (TRUE/FALSE) to activate horizontal momentum transport
! point Sources/Sinks (like river runoff transport) and mass point
! Sources/Sinks (like volume vertical influx), [1:Ngrids].

      LuvSrc == F                          ! horizontal momentum transport
       LwSrc == F                          ! volume vertical influx

! Logical switches (TRUE/FALSE) to activate tracers point Sources/Sinks
! (like river runoff) and to specify which tracer variables to consider:
! [1:NAT+NPT,Ngrids].
! See glossary below for details.

  LtracerSrc == F F                        ! temperature, salinity, inert

! Logical switches (TRUE/FALSE) to specify which variables to process for
! tracers climatology: [1:NAT+NPT,Ngrids]. See glossary below for details.

  LtracerCLM == T T                        ! temperature, salinity, inert

! Starting (DstrS) and ending (DendS) day for adjoint sensitivity forcing.
! DstrS must be less or equal to DendS. If both values are zero, their
! values are reset internally to the full range of the adjoint integration.

       DstrS == 0.0d0                      ! starting day
       DendS == 0.0d0                      ! ending day

! Starting and ending vertical levels of the 3D adjoint state variables
! whose sensitivity is required.

       KstrS == 1                          ! starting level
       KendS == 1                          ! ending level

! Logical switches (TRUE/FALSE) to specify the adjoint state variables
! whose sensitivity is required.

Lstate(isFsur) == F                        ! free-surface
Lstate(isUbar) == F                        ! 2D U-momentum
Lstate(isVbar) == F                        ! 2D V-momentum
Lstate(isUvel) == F                        ! 3D U-momentum
Lstate(isVvel) == F                        ! 3D V-momentum

Lstate(isTvar) == F F                      ! NT tracers

! Logical switches (TRUE/FALSE) to specify the state variables for
! which Forcing Singular Vectors or Stochastic Optimals is required.

Fstate(isFsur) == F                        ! free-surface
Fstate(isUbar) == F                        ! 2D U-momentum
Fstate(isVbar) == F                        ! 2D V-momentum
Fstate(isUvel) == F                        ! 3D U-momentum
Fstate(isVvel) == F                        ! 3D V-momentum
Fstate(isTvar) == F F                      ! NT tracers

! which Forcing Singular Vectors or Stochastic Optimals is required.

Fstate(isFsur) == F                        ! free-surface
Fstate(isUbar) == F                        ! 2D U-momentum
Fstate(isVbar) == F                        ! 2D V-momentum
Fstate(isUvel) == F                        ! 3D U-momentum
Fstate(isVvel) == F                        ! 3D V-momentum
Fstate(isTvar) == F F                      ! NT tracers

Fstate(isUstr) == T                        ! surface U-stress
Fstate(isVstr) == T                        ! surface V-stress
Fstate(isTsur) == F F                      ! NT surface tracers flux

! Stochastic Optimals time decorrelation scale (days) assumed for
! red noise processes.

      SO_decay == 2.0d0                    ! days

! Stochastic Optimals surface forcing standard deviation for
! dimensionalization.

SO_sdev(isFsur) == 1.0d0                   ! free-surface
SO_sdev(isUbar) == 1.0d0                   ! 2D U-momentum
SO_sdev(isVbar) == 1.0d0                   ! 2D V-momentum
SO_sdev(isUvel) == 1.0d0                   ! 3D U-momentum
SO_sdev(isVvel) == 1.0d0                   ! 3D V-momentum
SO_sdev(isTvar) == 1.0d0 1.0d0             ! NT tracers

SO_sdev(isUstr) == 1.0d0                   ! surface U-stress
SO_sdev(isVstr) == 1.0d0                   ! surface V-stress
SO_sdev(isTsur) == 1.0d0 1.0d0             ! NT surface tracers flux

can somebody help me?
many thanks!

bing

[kee]

hi,

when i set dt to 120s, the Courant number is less than 0.1, the result is the same.
any idea is appreciated!

bing

[kee]

I just wondering if there is some CPP flags that I set improperly!

[kate]

FYI, it's blowing up at the surface not the bottom. What are you using for surface forcing fields?

[kee]

FYI, it's blowing up at the surface not the bottom. What are you using for surface forcing fields?

Hi Kate,

thanks for your reply.
COADS05 (surface marine climatology 1945-89) 0.5deg resolution data was used.
I tried to use it to have a climatology run, and I have done that before.

what is the problem?

waiting...

[kate]

Rather than waiting for us, I think you need to do some investigating on your own. I don't know what's wrong, nor am I sure that your NaN is at the surface. I would use a debugger, but if you can't, you can always save a history record after one step and view the file.

[kee]

hi kate,

you are right. its most due to myself.
I check out the standard output carefully and found that there are NaNs in the inputs, like

Code: Select all

GET_2DFLD   - sea surface salinity climatology,          t =    15 00:00:00
                   (Rec=0000001, Index=2, File: roms_frc.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min =  1.79227009E+01 Max =  3.68974991E+01)
    GET_NGFLD   - free-surface western boundary condition,   t =    15 00:00:00
                   (Rec=0000001, Index=1, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min =  NaN            Max =  NaN           )
    GET_NGFLD   - free-surface southern boundary condition,  t =    15 00:00:00
                   (Rec=0000001, Index=1, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min =  NaN            Max =  NaN           )
    GET_NGFLD   - 2D u-momentum western boundary condition,  t =    15 00:00:00
                   (Rec=0000001, Index=1, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -2.77539068E-02 Max =  1.02432052E-02)
   
    ...........

    GET_NGFLD   - salinity southern boundary condition,      t =    15 00:00:00
                   (Rec=0000001, Index=1, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min =  3.40705099E+01 Max =  3.63118512E+01)

   STEP   Day HH:MM:SS  KINETIC_ENRG   POTEN_ENRG    TOTAL_ENRG    NET_VOLUME
          C => (i,j,k)       Cu            Cv            Cw         Max Speed

      0     0 00:00:00  2.653413E-17  2.240606E+04  2.240606E+04  5.729861E+17
         (0001,212,22)  1.062344E-07  0.000000E+00  0.000000E+00  4.636271E-06
      DEF_HIS   - creating history file: Outputs/pac_his_0001.nc
      WRT_HIS   - wrote history  fields (Index=1,1) into time record = 0000001
      DEF_AVG   - creating average file: Outputs/pac_avg.nc
      1     0 00:10:00 NaN           NaN           NaN           NaN
         (0310,574,22)  5.346916E-03  4.103665E-03  0.000000E+00  9.324760E-02

 Blowing-up: Saving latest model state into  RESTART file

I guessed the blowup was caused by those NaNs to a large extent , and so I made a new grid and new ICBC.
this time there is no NaN. But the model didnot run flawlessly as expected.

Anyhow I will still focus on the problem.

if you have experience about debugging, please tell me.

thanks.

[kee]

hi kate,
after last poster, I did some work.
Now I met with new problem, i wish the problem can be solved soon.
the following is the description.
sorry for its length.

I found out that the boundary conditions I made the first time is seriously wrong, all seems OK except "zeta" with all NaNs. So I modified the matlab code to get a resonable values with ZETA around | 0.1 m| over sea area, and 0 over land(I checked using ncdump command).
However, the model stop at step 2 this time without blowing-up info, but with:

Code: Select all

===================================================================================
=   BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
=   EXIT CODE: 174
=   CLEANING UP REMAINING PROCESSES
=   YOU CAN IGNORE THE BELOW CLEANUP MESSAGES
===================================================================================

I written all the first two steps records into his.nc, and found that there are 0s and _s in the first step, and nums and _s in the second step.
the maximum ZETA is 0.172807767987251; vbar=0.0143647622317076; ubar=0.0833217203617096;
temp=30.5731334686279;salt=36.6223678588867;u=0.106614135205746;v=0.0844850689172745; others are _s, which in the matlab appear as NaN.

output file is:

Code: Select all

..............
 Operating system : Linux
 CPU/hardware     : x86_64
 Compiler system  : ifort
 Compiler command : /app/intel/impi/4.0.2.003/intel64/bin/mpiifort
 Compiler flags   : -heap-arrays -fp-model precise -ip -O3 -free -free -free

 Input Script  : sea.in

 SVN Root URL  : https://www.myroms.org/svn/src/trunk
 SVN Revision  : exported

 Local Root    : /scratch/myroms/trunk
 Header Dir    : /scratch/myroms/run/argo
 Header file   : argo.h
 Analytical Dir: /scratch/myroms/trunk/ROMS/Functionals

 Resolution, Grid 01: 1199x0734x022,  Parallel Nodes:   4,  Tiling: 002x002


 Physical Parameters, Grid: 01
 =============================

         50  ntimes          Number of timesteps for 3-D equations.
    600.000  dt              Timestep size (s) for 3-D equations.
         40  ndtfast         Number of timesteps for 2-D equations between
                               each 3D timestep.
          1  ERstr           Starting ensemble/perturbation run number.
          1  ERend           Ending ensemble/perturbation run number.
          0  nrrec           Number of restart records to read from disk.
          T  LcycleRST       Switch to recycle time-records in restart file.
        432  nRST            Number of timesteps between the writing of data
                               into restart fields.
          1  ninfo           Number of timesteps between print of information
                               to standard output.
          T  ldefout         Switch to create a new output NetCDF file(s).
          1  nHIS            Number of timesteps between the writing fields
                               into history file.
       4320  ndefHIS         Number of timesteps between creation of new
                               history files.
          1  ntsAVG          Starting timestep for the accumulation of output
                               time-averaged data.
       4320  nAVG            Number of timesteps between the writing of
                               time-averaged data into averages file.
 5.0000E+01  nl_tnu2(01)     NLM Horizontal, harmonic mixing coefficient
                               (m2/s) for tracer 01: temp
 5.0000E+01  nl_tnu2(02)     NLM Horizontal, harmonic mixing coefficient
                               (m2/s) for tracer 02: salt
 1.0000E+02  nl_visc2        NLM Horizontal, harmonic mixing coefficient
                               (m2/s) for momentum.
 5.0000E-06  Akt_bak(01)     Background vertical mixing coefficient (m2/s)
                               for tracer 01: temp
 5.0000E-06  Akt_bak(02)     Background vertical mixing coefficient (m2/s)
                               for tracer 02: salt
 5.0000E-05  Akv_bak         Background vertical mixing coefficient (m2/s)
                               for momentum.
 3.0000E-04  rdrg            Linear bottom drag coefficient (m/s).
 3.0000E-03  rdrg2           Quadratic bottom drag coefficient.
 2.0000E-02  Zob             Bottom roughness (m).
          1  lmd_Jwt         Jerlov water type.
          1  Vtransform      S-coordinate transformation equation.
          1  Vstretching     S-coordinate stretching function.
 5.0000E+00  theta_s         S-coordinate surface control parameter.
 4.0000E-01  theta_b         S-coordinate bottom  control parameter.
     10.000  Tcline          S-coordinate surface/bottom layer width (m) used
                               in vertical coordinate stretching.
   1025.000  rho0            Mean density (kg/m3) for Boussinesq approximation.
      0.000  dstart          Time-stamp assigned to model initialization (days).
       0.00  time_ref        Reference time for units attribute (yyyymmdd.dd)
 3.6000E+02  Tnudg(01)       Nudging/relaxation time scale (days)
                               for tracer 01: temp
 3.6000E+02  Tnudg(02)       Nudging/relaxation time scale (days)
                               for tracer 02: salt
 3.6000E+02  Znudg           Nudging/relaxation time scale (days)
                               for free-surface.
 3.6000E+02  M2nudg          Nudging/relaxation time scale (days)
                               for 2D momentum.
 3.6000E+02  M3nudg          Nudging/relaxation time scale (days)
                               for 3D momentum.
 1.2000E+02  obcfac          Factor between passive and active
                               open boundary conditions.
          T  VolCons(1)      NLM western  edge boundary volume conservation.
          T  VolCons(2)      NLM southern edge boundary volume conservation.
          F  VolCons(3)      NLM eastern  edge boundary volume conservation.
          F  VolCons(4)      NLM northern edge boundary volume conservation.
     10.000  T0              Background potential temperature (C) constant.
     35.000  S0              Background salinity (PSU) constant.
      1.000  gamma2          Slipperiness variable: free-slip (1.0) or 
                                                    no-slip (-1.0).
          T  LtracerCLM(01)  Processing climatology on tracer 01: temp
          T  LtracerCLM(02)  Processing climatology on tracer 02: salt
          T  Hout(idFsur)    Write out free-surface.
          T  Hout(idUbar)    Write out 2D U-momentum component.
          T  Hout(idVbar)    Write out 2D V-momentum component.
          T  Hout(idUvel)    Write out 3D U-momentum component.
          T  Hout(idVvel)    Write out 3D V-momentum component.
          T  Hout(idWvel)    Write out W-momentum component.
          T  Hout(idOvel)    Write out omega vertical velocity.
          T  Hout(idTvar)    Write out tracer 01: temp
          T  Hout(idTvar)    Write out tracer 02: salt
          T  Hout(idDano)    Write out density anomaly.

          T  Aout(idFsur)    Write out averaged free-surface.
          T  Aout(idUbar)    Write out averaged 2D U-momentum component.
          T  Aout(idVbar)    Write out averaged 2D V-momentum component.
          T  Aout(idUvel)    Write out averaged 3D U-momentum component.
          T  Aout(idVvel)    Write out averaged 3D V-momentum component.
          T  Aout(idWvel)    Write out averaged W-momentum component.
          T  Aout(idOvel)    Write out averaged omega vertical velocity.
          T  Aout(idTvar)    Write out averaged tracer 01: temp
          T  Aout(idTvar)    Write out averaged tracer 02: salt
          T  Aout(idDano)    Write out averaged density anomaly.

 Output/Input Files:

             Output Restart File:  Outputs/argo_rst.nc
        Prefix for History Files:  Outputs/argo_his
            Output Averages File:  Outputs/argo_avg.nc
                 Input Grid File:  Inputs/roms_grd.nc
    Input Nonlinear Initial File:  Inputs/roms_ini.nc
           Input Forcing File 01:  Inputs/roms_frc.nc
          Input Climatology File:  Inputs/roms_clm.nc
             Input Boundary File:  Inputs/roms_bry.nc

 Tile partition information for Grid 01:  1199x0734x0022  tiling: 002x002

     tile     Istr     Iend     Jstr     Jend     Npts

        0        1      600        1      367  4844400
        1      601     1199        1      367  4836326
        2        1      600      368      734  4844400
        3      601     1199      368      734  4836326

 Tile minimum and maximum fractional grid coordinates:
   (interior points only)

     tile     Xmin     Xmax     Ymin     Ymax     grid

        0     0.50   600.50     0.50   367.50  RHO-points
        1   600.50  1199.50     0.50   367.50  RHO-points
        2     0.50   600.50   367.50   734.50  RHO-points
        3   600.50  1199.50   367.50   734.50  RHO-points

        0     1.00   600.50     0.50   367.50    U-points
        1   600.50  1199.00     0.50   367.50    U-points
        2     1.00   600.50   367.50   734.50    U-points
        3   600.50  1199.00   367.50   734.50    U-points

        0     0.50   600.50     1.00   367.50    V-points
        1   600.50  1199.50     1.00   367.50    V-points
        2     0.50   600.50   367.50   734.00    V-points
        3   600.50  1199.50   367.50   734.00    V-points

 Maximum halo size in XI and ETA directions:

               HaloSizeI(1) =    1222
               HaloSizeJ(1) =     758
                TileSide(1) =     605
                TileSize(1) =  225665


 Lateral Boundary Conditions: NLM
 ============================

 Variable               Grid    West Edge   South Edge  East Edge   North Edge
 ---------              ----    ----------  ----------  ----------  ----------

 zeta                     1     Chapman     Chapman     Closed      Closed

 ubar                     1     Flather     Flather     Closed      Closed

 vbar                     1     Flather     Flather     Closed      Closed

 u                        1     Rad + Nud   Rad + Nud   Closed      Closed

 v                        1     Rad + Nud   Rad + Nud   Closed      Closed

 temp                     1     Rad + Nud   Rad + Nud   Closed      Closed

 salt                     1     Rad + Nud   Rad + Nud   Closed      Closed

 Activated C-preprocessing Options:

 ARGO                Argo 1/6 deg simulation
 ANA_BSFLUX          Analytical kinematic bottom salinity flux.
 ANA_BTFLUX          Analytical kinematic bottom temperature flux.
 ASSUMED_SHAPE       Using assumed-shape arrays.
 AVERAGES            Writing out time-averaged nonlinear model fields.
 CURVGRID            Orthogonal curvilinear grid.
 DIFF_GRID           Horizontal diffusion coefficient scaled by grid size.
 DJ_GRADPS           Parabolic Splines density Jacobian (Shchepetkin, 2002).
 DOUBLE_PRECISION    Double precision arithmetic.
 LMD_CONVEC          LMD convective mixing due to shear instability.
 LMD_MIXING          Large/McWilliams/Doney interior mixing.
 LMD_NONLOCAL        LMD convective nonlocal transport.
 LMD_RIMIX           LMD diffusivity due to shear instability.
 LMD_SKPP            KPP surface boundary layer mixing.
 M2CLIMATOLOGY       Processing 2D momentum climatology data.
 M2CLM_NUDGING       Nudging toward 2D momentum climatology.
 M3CLIMATOLOGY       Processing 3D momentum climatology data.
 M3CLM_NUDGING       Nudging toward 3D momentum climatology.
 MASKING             Land/Sea masking.
 MIX_GEO_TS          Mixing of tracers along geopotential surfaces.
 MIX_S_UV            Mixing of momentum along constant S-surfaces.
 MPI                 MPI distributed-memory configuration.
 NONLINEAR           Nonlinear Model.
 NONLIN_EOS          Nonlinear Equation of State for seawater.
 PERFECT_RESTART     Processing perfect restart variables.
 POWER_LAW           Power-law shape time-averaging barotropic filter.
 PROFILE             Time profiling activated .
 QCORRECTION         Surface net heat flux correction.
 RADIATION_2D        Use tangential phase speed in radiation conditions.
 !RST_SINGLE         Double precision fields in restart NetCDF file.
 SALINITY            Using salinity.
 SRELAXATION         Surface salinity relaxation as surface flux.
 SOLAR_SOURCE        Solar Radiation Source Term.
 SOLVE3D             Solving 3D Primitive Equations.
 SPLINES             Conservative parabolic spline reconstruction.
 SPONGE              Enhanced horizontal mixing in the sponge areas.
 TCLIMATOLOGY        Processing tracer climatology data.
 TCLM_NUDGING        Nudging toward tracer climatology.
 TS_U3HADVECTION     Third-order upstream horizontal advection of tracers.
 TS_C4VADVECTION     Fourth-order centered vertical advection of tracers.
 TS_DIF2             Harmonic mixing of tracers.
 UV_ADV              Advection of momentum.
 UV_COR              Coriolis term.
 UV_U3HADVECTION     Third-order upstream horizontal advection of 3D momentum.
 UV_C4VADVECTION     Fourth-order centered vertical advection of momentum.
 UV_QDRAG            Quadratic bottom stress.
 UV_VIS2             Harmonic mixing of momentum.
 VAR_RHO_2D          Variable density barotropic mode.
 VISC_GRID           Horizontal viscosity coefficient scaled by grid size.
 ZCLIMATOLOGY        Processing sea surface height climatology data.

 Process Information:

 Node #  0 (pid=   14675) is active.
 Node #  2 (pid=   14673) is active.
 Node #  1 (pid=   14672) is active.
 Node #  3 (pid=   14674) is active.

 INITIAL: Configuring and initializing forward nonlinear model ...


 Vertical S-coordinate System: 

 level   S-coord     Cs-curve   Z   at hmin       at hc    half way     at hmax

    22   0.0000000   0.0000000        0.000       0.000       0.000       0.000
    21  -0.0454545  -0.0033986       -0.472      -0.455     -10.642     -20.812
    20  -0.0909091  -0.0077587       -0.948      -0.909     -24.166     -47.383
    19  -0.1363636  -0.0136448       -1.432      -1.364     -42.264     -83.096
    18  -0.1818182  -0.0218511       -1.927      -1.818     -67.317    -132.706
    17  -0.2272727  -0.0334707       -2.440      -2.273    -102.601    -202.762
    16  -0.2727273  -0.0499319       -2.977      -2.727    -152.398    -301.819
    15  -0.3181818  -0.0729252       -3.546      -3.182    -221.775    -440.004
    14  -0.3636364  -0.1041026       -4.157      -3.636    -315.684    -627.211
    13  -0.4090909  -0.1444594       -4.813      -4.091    -437.108    -869.403
    12  -0.4545455  -0.1935296       -5.513      -4.545    -584.650   -1163.788
    11  -0.5000000  -0.2489214       -6.245      -5.000    -751.142   -1496.039
    10  -0.5454545  -0.3068509       -6.989      -5.455    -925.240   -1843.492
     9  -0.5909091  -0.3636663       -7.727      -5.909   -1095.999   -2184.270
     8  -0.6363636  -0.4173773       -8.451      -6.364   -1257.452   -2506.453
     7  -0.6818182  -0.4682107       -9.159      -6.818   -1410.280   -2811.400
     6  -0.7272727  -0.5181817       -9.864      -7.273   -1560.522   -3111.181
     5  -0.7727273  -0.5703414      -10.579      -7.727   -1717.326   -3424.073
     4  -0.8181818  -0.6282324      -11.323      -8.182   -1891.309   -3771.294
     3  -0.8636364  -0.6956834      -12.115      -8.636   -2093.947   -4175.780
     2  -0.9090909  -0.7768608      -12.975      -9.091   -2337.731   -4662.487
     1  -0.9545455  -0.8764645      -13.928      -9.545   -2636.748   -5259.568
     0  -1.0000000  -1.0000000      -15.000     -10.000   -3007.500   -6000.000

 Time Splitting Weights: ndtfast =  40    nfast =  56

    Primary            Secondary            Accumulated to Current Step

  1-0.0006038999279304 0.0250000000000000-0.0006038999279304 0.0250000000000000
  2-0.0011053727845635 0.0250150974981983-0.0017092727124939 0.0500150974981983
  3-0.0015044206959555 0.0250427318178123-0.0032136934084494 0.0750578293160106
  4-0.0018010519301026 0.0250803423352112-0.0050147453385520 0.1001381716512218
  5-0.0019952879837948 0.0251253686334638-0.0070100333223467 0.1252635402846856
  6-0.0020871735042116 0.0251752508330587-0.0090972068265583 0.1504387911177443
  7-0.0020767890452586 0.0252274301706640-0.0111739958718169 0.1756662212884082
  8-0.0019642666586465 0.0252793498967954-0.0131382625304634 0.2009455711852036
  9-0.0017498083197106 0.0253284565632616-0.0148880708501740 0.2262740277484652
 10-0.0014337071879729 0.0253722017712543-0.0163217780381469 0.2516462295197196
 11-0.0010163717024450 0.0254080444509537-0.0173381497405919 0.2770542739706733
 12-0.0004983525116731 0.0254334537435148-0.0178365022522649 0.3024877277141881
 13 0.0001196277614762 0.0254459125563066-0.0177168744907887 0.3279336402704947
 14 0.0008366419202876 0.0254429218622697-0.0168802325705011 0.3533765621327644
 15 0.0016515227599278 0.0254220058142625-0.0152287098105733 0.3787985679470269
 16 0.0025628247984349 0.0253807177452643-0.0126658850121384 0.4041792856922913
 17 0.0035687831729657 0.0253166471253035-0.0090971018391727 0.4294959328175947
 18 0.0046672697013015 0.0252274275459793-0.0044298321378712 0.4547233603635741
 19 0.0058557461086128 0.0251107458034468 0.0014259139707416 0.4798341061670209
 20 0.0071312144194823 0.0249643521507315 0.0085571283902239 0.5047984583177524
 21 0.0084901645151857 0.0247860717902444 0.0170472929054096 0.5295845301079968
 22 0.0099285188562319 0.0245738176773648 0.0269758117616416 0.5541583477853615
 23 0.0114415743701613 0.0243256047059590 0.0384173861318028 0.5784839524913206
 24 0.0130239415046020 0.0240395653467049 0.0514413276364049 0.6025235178380255
 25 0.0146694804455855 0.0237139668090899 0.0661108080819904 0.6262374846471154
 26 0.0163712345011199 0.0233472297979502 0.0824820425831103 0.6495847144450656
 27 0.0181213606500220 0.0229379489354222 0.1006034032331323 0.6725226633804878
 28 0.0199110572560077 0.0224849149191717 0.1205144604891400 0.6950075782996595
 29 0.0217304889470413 0.0219871384877715 0.1422449494361813 0.7169947167874310
 30 0.0235687086599425 0.0214438762640955 0.1658136580961238 0.7384385930515265
 31 0.0254135768502523 0.0208546585475969 0.1912272349463761 0.7592932515991234
 32 0.0272516778673573 0.0202193191263406 0.2184789128137333 0.7795125707254640
 33 0.0290682334948725 0.0195380271796567 0.2475471463086058 0.7990505979051207
 34 0.0308470136562825 0.0188113213422849 0.2783941599648883 0.8178619192474056
 35 0.0325702442858409 0.0180401460008778 0.3109644042507291 0.8359020652482834
 36 0.0342185123647286 0.0172258898937318 0.3451829166154578 0.8531279551420151
 37 0.0357706681224704 0.0163704270846136 0.3809535847379282 0.8694983822266287
 38 0.0372037244036097 0.0154761603815518 0.4181573091415379 0.8849745426081804
 39 0.0384927531996420 0.0145460672714616 0.4566500623411799 0.8995206098796420
 40 0.0396107793462069 0.0135837484414705 0.4962608416873868 0.9131043583211125
 41 0.0405286713855386 0.0125934789578153 0.5367895130729254 0.9256978372789278
 42 0.0412150295941741 0.0115802621731769 0.5780045426670996 0.9372780994521047
 43 0.0416360711759210 0.0105498864333225 0.6196406138430206 0.9478279858854273
 44 0.0417555126200830 0.0095089846539245 0.6613961264631036 0.9573369705393517
 45 0.0415344492249439 0.0084650968384224 0.7029305756880475 0.9658020673777742
 46 0.0409312317865102 0.0074267356077988 0.7438618074745578 0.9732288029855730
 47 0.0399013404525124 0.0064034548131361 0.7837631479270702 0.9796322577987091
 48 0.0383972557416642 0.0054059213018233 0.8221604036687344 0.9850381791005324
 49 0.0363683267281804 0.0044459899082817 0.8585287303969148 0.9894841690088140
 50 0.0337606363915535 0.0035367817400771 0.8922893667884684 0.9930209507488911
 51 0.0305168641315885 0.0026927658302883 0.9228062309200569 0.9957137165791794
 52 0.0265761454486959 0.0019298442269986 0.9493823763687528 0.9976435608061780
 53 0.0218739287894439 0.0012654405907812 0.9712563051581966 0.9989090013969592
 54 0.0163418295573680 0.0007185923710451 0.9875981347155646 0.9996275937680043
 55 0.0099074812890402 0.0003100466321109 0.9975056160046047 0.9999376404001151
 56 0.0024943839953957 0.0000623595998849 1.0000000000000004 1.0000000000000000

 ndtfast, nfast =   40  56   nfast/ndtfast =  1.40000

 Centers of gravity and integrals (values must be 1, 1, approx 1/2, 1, 1):

    1.000000000000 1.039265571007 0.519632785503 1.000000000000 1.000000000000

 Power filter parameters, Fgamma, gamma =  0.28400   0.21300

 Minimum X-grid spacing, DXmin =  7.53007254E+00 km
 Maximum X-grid spacing, DXmax =  1.85221397E+01 km
 Minimum Y-grid spacing, DYmin =  7.56018655E+00 km
 Maximum Y-grid spacing, DYmax =  1.85221067E+01 km
 Minimum Z-grid spacing, DZmin =  4.71538685E-01 m
 Maximum Z-grid spacing, DZmax =  7.40432111E+02 m

 Minimum barotropic Courant Number =  1.38934555E-02
 Maximum barotropic Courant Number =  4.67089096E-01
 Maximum Coriolis   Courant Number =  7.97293427E-02

 Horizontal mixing scaled by grid size, GRDMAX =  1.85221232E+01 km

 NLM: GET_STATE - Read state initial conditions,             t =     0 00:00:00
                   (File: roms_ini.nc, Rec=0001, Index=1)
                - free-surface
                   (Min =  0.00000000E+00 Max =  0.00000000E+00)
                - vertically integrated u-momentum component
                   (Min =  0.00000000E+00 Max =  0.00000000E+00)
                - vertically integrated v-momentum component
                   (Min =  0.00000000E+00 Max =  0.00000000E+00)
                - u-momentum component
                   (Min =  0.00000000E+00 Max =  0.00000000E+00)
                - v-momentum component
                   (Min =  0.00000000E+00 Max =  0.00000000E+00)
                - potential temperature
                   (Min = -4.13677702E+00 Max =  3.13571210E+01)
                - salinity
                   (Min =  2.30339857E+01 Max =  3.70519772E+01)
    GET_2DFLD   - surface u-momentum stress,                 t =   345 00:00:00
                   (Rec=0000012, Index=1, File: roms_frc.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -1.69058764E-04 Max =  1.69168324E-04)
    GET_2DFLD   - surface v-momentum stress,                 t =   345 00:00:00
                   (Rec=0000012, Index=1, File: roms_frc.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -2.31120405E-04 Max =  1.20757092E-04)
    GET_2DFLD   - solar shortwave radiation flux,            t =   345 00:00:00
                   (Rec=0000012, Index=1, File: roms_frc.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min =  1.49879169E-08 Max =  8.99074356E-05)
    GET_2DFLD   - surface net heat flux,                     t =   345 00:00:00
                   (Rec=0000012, Index=1, File: roms_frc.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -1.22602394E-04 Max =  4.64116730E-05)
    GET_2DFLD   - sea surface temperature climatology,       t =   345 00:00:00
                   (Rec=0000012, Index=1, File: roms_frc.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -1.63312799E+00 Max =  3.16506419E+01)
    GET_2DFLD   - surface net heat flux sensitivity to SST,  t =   345 00:00:00
                   (Rec=0000012, Index=1, File: roms_frc.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -1.57100404E-05 Max = -2.27535225E-06)
    GET_2DFLD   - sea surface salinity climatology,          t =   345 00:00:00
                   (Rec=0000012, Index=1, File: roms_frc.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min =  1.93234005E+01 Max =  3.67027701E+01)
    GET_NGFLD   - free-surface western boundary condition,   t =   345 00:00:00
                   (Rec=0000012, Index=2, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -3.15834247E-01 Max =  2.24152096E-01)
    GET_NGFLD   - free-surface southern boundary condition,  t =   345 00:00:00
                   (Rec=0000012, Index=2, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -2.69894263E-01 Max =  1.98267389E-01)
    GET_NGFLD   - 2D u-momentum western boundary condition,  t =   345 00:00:00
                   (Rec=0000012, Index=2, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -4.11347408E-02 Max =  9.12044920E-03)
    GET_NGFLD   - 2D v-momentum western boundary condition,  t =   345 00:00:00
                   (Rec=0000012, Index=2, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -2.13815795E-03 Max =  1.89117041E-03)
    GET_NGFLD   - 2D u-momentum southern boundary condition, t =   345 00:00:00
                   (Rec=0000012, Index=2, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -1.55597982E-02 Max =  6.02321609E-04)
    GET_NGFLD   - 2D v-momentum southern boundary condition, t =   345 00:00:00
                   (Rec=0000012, Index=2, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -1.00027303E-01 Max =  9.57801877E-03)
    GET_NGFLD   - 3D u-momentum western boundary condition,  t =   345 00:00:00
                   (Rec=0000012, Index=2, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -3.88883082E-01 Max =  1.73160569E-01)
    GET_NGFLD   - 3D v-momentum western boundary condition,  t =   345 00:00:00
                   (Rec=0000012, Index=2, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -7.88849476E-02 Max =  1.28806898E-01)
    GET_NGFLD   - 3D u-momentum southern boundary condition, t =   345 00:00:00
                   (Rec=0000012, Index=2, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -2.91201117E-02 Max =  3.42919065E-03)
    GET_NGFLD   - 3D v-momentum southern boundary condition, t =   345 00:00:00
                   (Rec=0000012, Index=2, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -1.31029581E-01 Max =  4.49862584E-02)
    GET_NGFLD   - temperature western boundary condition,    t =   345 00:00:00
                   (Rec=0000012, Index=2, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min =  1.09181011E+00 Max =  2.86817951E+01)
    GET_NGFLD   - salinity western boundary condition,       t =   345 00:00:00
                   (Rec=0000012, Index=2, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min =  2.90600065E+01 Max =  3.58896334E+01)
    GET_NGFLD   - temperature southern boundary condition,   t =   345 00:00:00
                   (Rec=0000012, Index=2, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min =  9.93035054E-01 Max =  2.34587154E+01)
    GET_NGFLD   - salinity southern boundary condition,      t =   345 00:00:00
                   (Rec=0000012, Index=2, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min =  3.41131270E+01 Max =  3.61924478E+01)
    GET_2DFLD   - sea surface height climatology,            t =   345 00:00:00
                   (Rec=0000012, Index=1, File: roms_clm.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min =  0.00000000E+00 Max =  0.00000000E+00)
    GET_2DFLD   - vertically integrated u-momentum climatologt =   345 00:00:00
                   (Rec=0000012, Index=1, File: roms_clm.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min =  0.00000000E+00 Max =  0.00000000E+00)
    GET_2DFLD   - vertically integrated v-momentum climatologt =   345 00:00:00
                   (Rec=0000012, Index=1, File: roms_clm.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min =  0.00000000E+00 Max =  0.00000000E+00)
    GET_3DFLD   - potential temperature climatology,         t =   345 00:00:00
                   (Rec=0000012, Index=1, File: roms_clm.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -2.39141408E+00 Max =  3.10215932E+01)
    GET_3DFLD   - salinity climatology,                      t =   345 00:00:00
                   (Rec=0000012, Index=1, File: roms_clm.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min =  2.33278067E+01 Max =  3.74720047E+01)
    GET_3DFLD   - u-momentum component climatology,          t =   345 00:00:00
                   (Rec=0000012, Index=1, File: roms_clm.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min =  0.00000000E+00 Max =  0.00000000E+00)
    GET_3DFLD   - v-momentum component climatology,          t =   345 00:00:00
                   (Rec=0000012, Index=1, File: roms_clm.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min =  0.00000000E+00 Max =  0.00000000E+00)

 Maximum grid stiffness ratios:  rx0 =   1.714993E-01 (Beckmann and Haidvogel)
                                 rx1 =   3.594306E+00 (Haney)


 Initial basin volumes: TotVolume =  5.6990134372E+17 m3
                        MinVolume =  2.8044199960E+07 m3
                        MaxVolume =  2.5169518815E+11 m3
                          Max/Min =  8.9749462818E+03


 NL ROMS/TOMS: started time-stepping: (Grid: 01 TimeSteps: 00000001 - 00000050)

    GET_2DFLD   - surface u-momentum stress,                 t =    15 00:00:00
                   (Rec=0000001, Index=2, File: roms_frc.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -1.51869680E-04 Max =  1.82257249E-04)
    GET_2DFLD   - surface v-momentum stress,                 t =    15 00:00:00
                   (Rec=0000001, Index=2, File: roms_frc.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -2.30584444E-04 Max =  1.35796765E-04)
    GET_2DFLD   - solar shortwave radiation flux,            t =    15 00:00:00
                   (Rec=0000001, Index=2, File: roms_frc.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min =  2.71899561E-07 Max =  8.01640752E-05)
    GET_2DFLD   - surface net heat flux,                     t =    15 00:00:00
                   (Rec=0000001, Index=2, File: roms_frc.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -1.29089152E-04 Max =  4.74124576E-05)
    GET_2DFLD   - sea surface temperature climatology,       t =    15 00:00:00
                   (Rec=0000001, Index=2, File: roms_frc.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -2.00034715E+00 Max =  3.23796349E+01)
    GET_2DFLD   - surface net heat flux sensitivity to SST,  t =    15 00:00:00
                   (Rec=0000001, Index=2, File: roms_frc.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -1.50599021E-05 Max = -2.83887841E-06)
    GET_2DFLD   - sea surface salinity climatology,          t =    15 00:00:00
                   (Rec=0000001, Index=2, File: roms_frc.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min =  1.79227009E+01 Max =  3.68974991E+01)
    GET_NGFLD   - free-surface western boundary condition,   t =    15 00:00:00
                   (Rec=0000001, Index=1, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -2.47861235E-01 Max =  1.66857876E-01)
    GET_NGFLD   - free-surface southern boundary condition,  t =    15 00:00:00
                   (Rec=0000001, Index=1, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -2.42446140E-01 Max =  2.39906726E-01)
    GET_NGFLD   - 2D u-momentum western boundary condition,  t =    15 00:00:00
                   (Rec=0000001, Index=1, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -2.77539068E-02 Max =  1.02432052E-02)
    GET_NGFLD   - 2D v-momentum western boundary condition,  t =    15 00:00:00
                   (Rec=0000001, Index=1, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -6.17405111E-04 Max =  2.75377126E-03)
    GET_NGFLD   - 2D u-momentum southern boundary condition, t =    15 00:00:00
                   (Rec=0000001, Index=1, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -1.78040810E-02 Max =  4.67195980E-04)
    GET_NGFLD   - 2D v-momentum southern boundary condition, t =    15 00:00:00
                   (Rec=0000001, Index=1, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -8.32982569E-02 Max =  9.28796936E-03)
    GET_NGFLD   - 3D u-momentum western boundary condition,  t =    15 00:00:00
                   (Rec=0000001, Index=1, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -3.15316576E-01 Max =  8.27096790E-02)
    GET_NGFLD   - 3D v-momentum western boundary condition,  t =    15 00:00:00
                   (Rec=0000001, Index=1, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -4.75169230E-02 Max =  1.73285595E-01)
    GET_NGFLD   - 3D u-momentum southern boundary condition, t =    15 00:00:00
                   (Rec=0000001, Index=1, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -3.36974298E-02 Max =  3.55146055E-03)
    GET_NGFLD   - 3D v-momentum southern boundary condition, t =    15 00:00:00
                   (Rec=0000001, Index=1, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -1.08980142E-01 Max =  4.65836660E-02)
    GET_NGFLD   - temperature western boundary condition,    t =    15 00:00:00
                   (Rec=0000001, Index=1, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min =  1.09181011E+00 Max =  2.88292018E+01)
    GET_NGFLD   - salinity western boundary condition,       t =    15 00:00:00
                   (Rec=0000001, Index=1, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min =  2.70494558E+01 Max =  3.60505522E+01)
    GET_NGFLD   - temperature southern boundary condition,   t =    15 00:00:00
                   (Rec=0000001, Index=1, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min =  9.93035054E-01 Max =  2.48906474E+01)
    GET_NGFLD   - salinity southern boundary condition,      t =    15 00:00:00
                   (Rec=0000001, Index=1, File: roms_bry.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min =  3.40705099E+01 Max =  3.63118512E+01)
    GET_2DFLD   - sea surface height climatology,            t =    15 00:00:00
                   (Rec=0000001, Index=2, File: roms_clm.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -9.55220660E-01 Max =  7.81256151E-01)
    GET_2DFLD   - vertically integrated u-momentum climatologt =    15 00:00:00
                   (Rec=0000001, Index=2, File: roms_clm.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -6.33885880E+00 Max =  2.77417347E+00)
    GET_2DFLD   - vertically integrated v-momentum climatologt =    15 00:00:00
                   (Rec=0000001, Index=2, File: roms_clm.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -5.01532450E+00 Max =  5.38458122E+00)
    GET_3DFLD   - potential temperature climatology,         t =    15 00:00:00
                   (Rec=0000001, Index=2, File: roms_clm.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -4.13677702E+00 Max =  3.13571210E+01)
    GET_3DFLD   - salinity climatology,                      t =    15 00:00:00
                   (Rec=0000001, Index=2, File: roms_clm.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min =  2.30339857E+01 Max =  3.70519772E+01)
    GET_3DFLD   - u-momentum component climatology,          t =    15 00:00:00
                   (Rec=0000001, Index=2, File: roms_clm.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -6.33967881E+00 Max =  2.77807589E+00)
    GET_3DFLD   - v-momentum component climatology,          t =    15 00:00:00
                   (Rec=0000001, Index=2, File: roms_clm.nc)
                   (Tmin=         15.0000 Tmax=        345.0000)
                   (Min = -5.12125820E+00 Max =  5.38614161E+00)

   STEP   Day HH:MM:SS  KINETIC_ENRG   POTEN_ENRG    TOTAL_ENRG    NET_VOLUME
          C => (i,j,k)       Cu            Cv            Cw         Max Speed

      0     0 00:00:00  2.653413E-17  2.240606E+04  2.240606E+04  5.729861E+17
         (0001,212,22)  1.062344E-07  0.000000E+00  0.000000E+00  4.636271E-06
      DEF_HIS   - creating history file: Outputs/argo_his_0001.nc
      WRT_HIS   - wrote history  fields (Index=1,1) into time record = 0000001
      1     0 00:10:00  1.496350E-06  2.240606E+04  2.240606E+04  5.729861E+17
         (0182,353,22)  3.860088E-03  7.170810E-03  0.000000E+00  2.293176E-01
      WRT_HIS   - wrote history  fields (Index=1,2) into time record = 0000002
      2     0 00:20:00  4.940291E-06  2.240606E+04  2.240606E+04  5.729861E+17
         (0377,002,22)  3.455036E-04  1.777455E-04  1.783519E-01  1.216520E-01
===================================================================================
=   BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
=   EXIT CODE: 174
=   CLEANING UP REMAINING PROCESSES
=   YOU CAN IGNORE THE BELOW CLEANUP MESSAGES
=================================================================================== 

*.h and *.in files are similar like the former posters.

could you give me some hints?

[kate]

If you have a land mask, the _ numbers you get are what ROMS writes for _FillValue in the land mask. The error you report is not from ROMS but from the MPI system and I have no idea what caused it. Have you tried again?