problems in INLET_TEST case

[ljzhong]

When I ran ROMS/SWAN coupling test case INLET_TEST, the program terminated in initial.F where subroutine ocn2wav_coupling is called. It seems that SWAN was running normally because there were a number of SWAN output files, such as PRINT-00x, ***.mat-00x, point1-spc2d-00x, etc, but ROMS part was stuck because of the communication between ROMS and SWAN.

There was once an error when I built MCT library. It complained CLK_TCK not defined in get_zeits.c. I tried to replace #include <time.h> with #include <bits/time.h> and I am sure CLK_TCK is defined in this new time.h, but it still complained, so I had to define it manually in get_zeits.c by #define CLK_TCK CLOCKS_PER_SEC. Not sure if it caused the above problem. Meanwhile, I built MCT using the same flags as in ROMS, as suggested in the forum.

I set 2 CPUS for both ROMS and SWAN and ifort is my fortran compiler.

Any suggestions that someone can advise? Thanks.

Liejun

[jcwarner]

can you look into the standard out file and see what is happening when it dies? Look for swan Errfiles, and see if there is any relevant info. Look in the SWAN Print-00* files and see if all that looks ok.

I remember that get_zeits problme with an older version of fortran. Which ifort -ver ?

[ljzhong]

John, thanks for your quick response.

I'm using ifort v9.1. I downloaded the newest MCT v2.5 and compiled it successfully without any complaint or warning messages, but the same problem still exists in ROMS/SWAN.

My ROMS/SWAN code is the latest version, 258M. There is no Errfiles from SWAN. The model died without any error message. I ran the model with 1 CPU for SWAN and found no output from SWAN except PRINT. Here is is the last few lines from PRINT.

BLOCK 'COMPGRID' NOHEADER 'xp.mat' LAY 4 XP 1.

BLOCK 'COMPGRID' NOHEADER 'yp.mat' LAY 4 YP 1.

POINTS 'point1' 5000.0 10000.0

SPECOUT 'point1' SPEC2D 'point1.spc2d' OUTPUT 20000101.000000 1 HR

PROP BSBT

COMPUTE NONSTATIONARY 20000101.000000 60 SEC 20000103.000000
** Warning : Limiter is de-activated in case of no quadruplets

Looks like something was wrong with SWAN.

[jcwarner]

that swan message is just a warning, not a show stopper.
Can you post the roms std out here:

[ljzhong]

here is ROMS output

Coupled Input File name = input/coupling_inlet_test.in

Model Coupling Parallel Threads:

Ocean Model MPI nodes: 000 - 001
Waves Model MPI nodes: 002 - 002

Ocean Export: bath:SSH:Ubar:Vbar
Waves Export: Wdir:Wamp:Wlen:Wptop:Wpbot

Process Information:

Node # 0 (pid= 19590) is active.
Node # 1 (pid= 19591) is active.

Model Input Parameters: ROMS/TOMS version 3.0
Thursday - November 6, 2008 - 4:18:14 PM
-----------------------------------------------------------------------------

SWAN is preparing computation ...

Inlet Test Case

Operating system : Linux
CPU/hardware : ia64
Compiler system : ifort
Compiler command : ifort
Compiler flags : -ip -O2 -fpe0 -I/xxx/MCT/include -free

Input Script : input/ocean_inlet_test.in

SVN Root URL : https://www.myroms.org/svn/src/trunk
SVN Revision :

Local Root : xxx
Header Dir : xxx
Header file : inlet_test.h
Analytical Dir: xxx

Resolution, Grid 01: 0075x0070x008, Parallel Nodes: 2, Tiling: 001x002

Physical Parameters, Grid: 01
=============================

34560 ntimes Number of timesteps for 3-D equations.
5.000 dt Timestep size (s) for 3-D equations.
20 ndtfast Number of timesteps for 2-D equations between
each 3D timestep.
1 ERstr Starting ensemble/perturbation run number.
1 ERend Ending ensemble/perturbation run number.
0 nrrec Number of restart records to read from disk.
T LcycleRST Switch to recycle time-records in restart file.
720 nRST Number of timesteps between the writing of data
into restart fields.
1 ninfo Number of timesteps between print of information
to standard output.
T ldefout Switch to create a new output NetCDF file(s).
2 nHIS Number of timesteps between the writing fields
into history file.
1.0000E-03 visc2 Horizontal, harmonic mixing coefficient (m2/s)
for momentum.
5.0000E-06 Akt_bak(01) Background vertical mixing coefficient (m2/s)
for tracer 01: temp
5.0000E-06 Akt_bak(02) Background vertical mixing coefficient (m2/s)
for tracer 02: salt
5.0000E-05 Akv_bak Background vertical mixing coefficient (m2/s)
for momentum.
5.0000E-06 Akk_bak Background vertical mixing coefficient (m2/s)
for turbulent energy.
5.0000E-06 Akp_bak Background vertical mixing coefficient (m2/s)
for turbulent generic statistical field.
3.000 gls_p GLS stability exponent.
1.500 gls_m GLS turbulent kinetic energy exponent.
-1.000 gls_n GLS turbulent length scale exponent.
7.6000E-06 gls_Kmin GLS minimum value of turbulent kinetic energy.
1.0000E-12 gls_Pmin GLS minimum value of dissipation.
5.4770E-01 gls_cmu0 GLS stability coefficient.
1.4400E+00 gls_c1 GLS shear production coefficient.
1.9200E+00 gls_c2 GLS dissipation coefficient.
-4.0000E-01 gls_c3m GLS stable buoyancy production coefficient.
1.0000E+00 gls_c3p GLS unstable buoyancy production coefficient.
1.0000E+00 gls_sigk GLS constant Schmidt number for TKE.
1.3000E+00 gls_sigp GLS constant Schmidt number for PSI.
1400.000 charnok_alpha Charnok factor for Zos calculation.
0.500 zos_hsig_alpha Factor for Zos calculation using Hsig(Awave).
0.250 sz_alpha Factor for Wave dissipation surface tke flux .
100.000 crgban_cw Factor for Craig/Banner surface tke flux.
3.0000E-04 rdrg Linear bottom drag coefficient (m/s).
2.5000E-02 rdrg2 Quadratic bottom drag coefficient.
1.5000E-02 Zob Bottom roughness (m).
5.0000E-01 Zos Surface roughness (m).
1.0000E+00 theta_s S-coordinate surface control parameter.
1.0000E+00 theta_b S-coordinate bottom control parameter.
0.000 Tcline S-coordinate surface/bottom layer width (m) used
in vertical coordinate stretching.
1025.000 rho0 Mean density (kg/m3) for Boussinesq approximation.
0.0000E+00 Tnudg(02) Nudging/relaxation time scale (days)
for tracer 02: salt
0.0000E+00 Znudg Nudging/relaxation time scale (days)
for free-surface.
0.0000E+00 M2nudg Nudging/relaxation time scale (days)
for 2D momentum.
0.0000E+00 M3nudg Nudging/relaxation time scale (days)
for 3D momentum.
0.0000E+00 obcfac Factor between passive and active
open boundary conditions.
10.000 T0 Background potential temperature (C) constant.
30.000 S0 Background salinity (PSU) constant.
1027.000 R0 Background density (kg/m3) used in linear Equation
of State.
1.7000E-04 Tcoef Thermal expansion coefficient (1/Celsius).
7.6000E-04 Scoef Saline contraction coefficient (1/PSU).
1.000 gamma2 Slipperiness variable: free-slip (1.0) or
no-slip (-1.0).
T Hout(idBath) Write out time-dependent bathymetry.
T Hout(idFsur) Write out free-surface.
T Hout(idUbar) Write out 2D U-momentum component.
T Hout(idVbar) Write out 2D V-momentum component.
T Hout(idUvel) Write out 3D U-momentum component.
T Hout(idVvel) Write out 3D V-momentum component.
T Hout(idWvel) Write out W-momentum component.
T Hout(idOvel) Write out omega vertical velocity.
T Hout(idTvar) Write out tracer 01: temp
T Hout(idTvar) Write out tracer 02: salt
T Hout(idUbrs) Write out bottom U-current stress.
T Hout(idVbrs) Write out bottom V-current stress.
T Hout(idUbws) Write out wind-induced, bottom U-wave stress.
T Hout(idVbws) Write out wind-induced, bottom V-wave stress.
T Hout(idUbcs) Write out max wind + current, bottom U-wave stress.
T Hout(idVbcs) Write out max wind + current, bottom V-wave stress.
T Hout(idW2xx) Write out 2D radiation stress, Sxx.
T Hout(idW2xy) Write out 2D radiation stress, Sxy.
T Hout(idW2yy) Write out 2D radiation stress, Syy.
T Hout(idWamp) Write out wave height.
T Hout(idWlen) Write out wave length.
T Hout(idWdir) Write out wave direction.
T Hout(idBott) Write out bottom property 01: grain_diameter
T Hout(idBott) Write out bottom property 02: grain_density
T Hout(idBott) Write out bottom property 03: settling_vel
T Hout(idBott) Write out bottom property 04: erosion_stress
T Hout(idBott) Write out bottom property 05: ripple_length
T Hout(idBott) Write out bottom property 06: ripple_height
T Hout(idBott) Write out bottom property 07: bed_wave_amp
T Hout(idBott) Write out bottom property 08: Zo_def
T Hout(idBott) Write out bottom property 09: Zo_app

Output/Input Files:

Output Restart File: ocean_rst.nc
Output History File: ocean_his.nc
Physical parameters File: input/ocean_inlet_test.in
Input Grid File: input/inlet_test_grid.nc

Tile partition information for Grid 01: 0075x0070x0008 tiling: 001x002

tile Istr Iend Jstr Jend Npts

0 1 75 1 35 21000
1 1 75 36 70 21000

Maximum halo size in XI and ETA directions:

HaloSizeI(1) = 255
HaloSizeJ(1) = 144
TileSide(1) = 79
TileSize(1) = 3318

Sediment Parameters, Grid: 01
=============================

Size Sd50 Csed Srho Wsed Erate poros
Class (mm) (kg/m3) (kg/m3) (mm/s) (kg/m2/s) (nondim)

1 1.0000E-01 0.0000E+00 2.6500E+03 1.0000E+01 5.0000E-03 0.0000E+00

tau_ce tau_cd tnu2 tnu4 Akt_bak Tnudg
(N/m2) (N/m2) (m2/s) (m4/s) (m2/s) (day)

1 1.0000E-01 1.0000E-02 0.0000E+00 0.0000E+00 5.0000E-06 0.0000E+00

morph_fac
(nondim)

1 1.0000E+01

New bed layer formed when deposition exceeds 0.10000E-01 (m).
Two first layers are combined when 2nd layer smaller than 0.00000E+00 (m).
Rate coefficient for bed load transport = 0.15000E+00

T Hout(idTvar) Write out sediment01: mud_01
T Hout(idfrac) Write out bed fraction, sediment 01: mudfrac_01
T Hout(idfrac) Write out mass, sediment 01: mudmass_01
T Hout(idSbed) Write out BED property 01: bed_thickness
T Hout(idSbed) Write out BED property 02: bed_age
T Hout(idSbed) Write out BED property 03: bed_porosity

Activated C-preprocessing Options:

INLET_TEST Inlet Test Case
ANA_BPFLUX Analytical bottom passive tracers fluxes.
ANA_BSFLUX Analytical kinematic bottom salinity flux.
ANA_BSFLUX Analytical kinematic bottom salinity flux.
ANA_BTFLUX Analytical kinematic bottom temperature flux.
ANA_FSOBC Analytical free-surface boundary conditions.
ANA_INITIAL Analytical initial conditions.
ANA_M2OBC Analytical 2D momentum boundary conditions.
ANA_SEDIMENT Analytical sediment initial conditions.
ANA_SMFLUX Analytical kinematic surface momentum flux.
ANA_SPFLUX Analytical surface passive tracer fluxes.
ANA_SSFLUX Analytical kinematic surface salinity flux.
ANA_STFLUX Analytical kinematic surface temperature flux.
ASSUMED_SHAPE Using assumed-shape arrays.
DJ_GRADPS Parabolic Splines density Jacobian (Shchepetkin, 2002).
DOUBLE_PRECISION Double precision arithmetic.
EAST_FSGRADIENT Eastern edge, free-surface, gradient condition.
EAST_M2GRADIENT Eastern edge, 2D momentum, gradient condition.
EAST_M3GRADIENT Eastern edge, 3D momentum, gradient condition.
FSOBC_REDUCED Using free-surface data in reduced physics condtions
GLS_MIXING Generic Length-Scale turbulence closure.
KANTHA_CLAYSON Kantha and Clayson stability function formulation.
MASKING Land/Sea masking.
MCT_LIB Using Model Coupling Toolkit library.
MIX_S_UV Mixing of momentum along constant S-surfaces.
MPI MPI distributed-memory configuration.
NEARSHORE_MELLOR Nearshore RAdiation Stress Terms.
NONLINEAR Nonlinear Model.
!NONLIN_EOS Linear Equation of State for seawater.
NORTH_FSGRADIENT Northern edge, free-surface, gradient condition.
NORTH_M2REDUCED Northern edge, 2D momentum, reduced-physics condition.
NORTH_M3GRADIENT Northern edge, 3D momentum, gradient condition.
N2S2_HORAVG Horizontal smoothing of buoyancy and shear.
POWER_LAW Power-law shape time-averaging barotropic filter.
PROFILE Time profiling activated .
K_GSCHEME Third-order upstream advection of TKE fields.
!RST_SINGLE Double precision fields in restart NetCDF file.
SEDIMENT Cohesive and noncohesive sediments.
SED_MORPH Allow bottom model elevation to evolve.
SUSPLOAD Activate suspended sediment transport.
SOLVE3D Solving 3D Primitive Equations.
SOUTHERN_WALL Wall boundary at Southern edge.
SPLINES Conservative parabolic spline reconstruction.
SSW_BBL Styles and Glenn Bottom Boundary Layer - modified.
SSW_CALC_ZNOT Internal computation of bottom roughness.
SWAN_COUPLING Two-way SWAN/ROMS coupling.
THREE_GHOST Using three Ghost Points in halo regions.
TS_MPDATA Recursive flux corrected MPDATA 3D advection of tracers.
UV_ADV Advection of momentum.
UV_U3HADVECTION Third-order upstream horizontal advection of 3D momentum.
UV_C4VADVECTION Fourth-order centered vertical advection of momentum.
UV_VIS2 Harmonic mixing of momentum.
VAR_RHO_2D Variable density barotropic mode.
WAVES_OCEAN Two-way wave-ocean models coupling.
WEST_FSGRADIENT Western edge, free-surface, gradient condition.
WEST_M2GRADIENT Western edge, 2D momentum, gradient condition.
WEST_M3GRADIENT Western edge, 3D momentum, gradient condition.

if I set 2 cpus for SWAN, there is a little more output till ROMS reads the grid info

Centers of gravity and integrals (values must be 1, 1, approx 1/2, 1, 1):

1.000000000000 1.060707743385 0.530353871693 1.000000000000 1.000000000000

Power filter parameters, Fgamma, gamma = 0.28400 0.14200

Minimum X-grid spacing, DXmin = 2.00000000E-01 km
Maximum X-grid spacing, DXmax = 2.00000000E-01 km
Minimum Y-grid spacing, DYmin = 2.00000000E-01 km
Maximum Y-grid spacing, DYmax = 2.00000000E-01 km
Minimum Z-grid spacing, DZmin = 4.49062569E-01 m
Maximum Z-grid spacing, DZmax = 2.08817024E+00 m

Minimum barotropic Courant Number = 1.10736173E-02
Maximum barotropic Courant Number = 2.18124964E-02
Maximum Coriolis Courant Number = 7.29000000E-04


Maximum grid stiffness ratios: rx0 = 3.846154E-02 (Beckmann and Haidvogel)
rx1 = 6.467265E-01 (Haney)

Initial basin volumes: TotVolume = 1.43456000000009E+09 m3
MinVolume = 1.79625027600252E+04 m3
MaxVolume = 8.18046072184575E+04 m3
Max/Min = 4.55418759353014E+00

Anyway, ROMS seems have no chance to move one single time step forward.

I may have to dig into SWAN code and I will report here if I find something.

[jcwarner]

I just updated to the latest rutgers trunk version. Compiled the inlet test. It ran. It works for me on my systems, and so it is hard for me to help you.
I am not sure what to tell you to try. By default it has 1 proc for roms and 1 proc for swan. Can you try to run it with just 1 proc roms and 1 proc swan, as it is distributed?