RBL4D-Var Analysis Observation Impact Tutorial: Difference between revisions
From WikiROMS
Jump to navigationJump to search
No edit summary (change visibility) |
No edit summary (change visibility) |
||
Line 1: | Line 1: | ||
<div class="title">4-DVar PSAS Observation Impact</div> | <div class="title">4-DVar PSAS Observation Impact</div> | ||
The various files in the <span class=" | The various files in the <span class="twilightBlue">PSAS_impact</span> folder are needed to run the Strong/Weak constraint, 4-Dimensional Variational ('''4D-Var''') data assimilation observation impact based on the Physical-space Statistical Analysis System ('''PSAS''') algorithm in the California Current System, 1/3° resolution, application ('''WC13'''). | ||
Line 12: | Line 12: | ||
==Important CPP Options== | ==Important CPP Options== | ||
<div class="box"> W4DPSAS_SENSITIVITY 4D-PSAS observation sensitivity driver<br /> AD_IMPULSE Force ADM with intermittent impulses<br /> OBS_IMPACT Compute observation impact<br /> OBS_IMPACT_SPLIT separate impact due to IC, forcing, and OBC<br /> WC13 Application CPP option</div> | <div class="box"> [[W4DPSAS_SENSITIVITY]] 4D-PSAS observation sensitivity driver<br /> [[AD_IMPULSE]] Force ADM with intermittent impulses<br /> [[OBS_IMPACT]] Compute observation impact<br /> [[OBS_IMPACT_SPLIT]] separate impact due to IC, forcing, and OBC<br /> [[WC13]] Application CPP option</div> | ||
==Input NetCDF Files== | ==Input NetCDF Files== | ||
<div class="box"> Grid File: ../Data/wc13_grd.nc<br /> Nonlinear Initial File: wc13_ini.nc<br /> Forcing File 01: ../Data/coamps_wc13_lwrad_down.nc<br /> Forcing File 02: ../Data/coamps_wc13_Pair.nc<br /> Forcing File 03: ../Data/coamps_wc13_Qair.nc<br /> Forcing File 04: ../Data/coamps_wc13_rain.nc<br /> Forcing File 05: ../Data/coamps_wc13_swrad.nc<br /> Forcing File 06: ../Data/coamps_wc13_Tair.nc<br /> Forcing File 07: ../Data/coamps_wc13_wind.nc<br /> Boundary File: ../Data/wc13_ecco_bry.nc<br /><br /> Initial Conditions STD File: ../Data/wc13_std_i.nc<br /> Model STD File: ../Data/wc13_std_m.nc< | <div class="box"> <span class="twilightBlue">Grid File:</span> ../Data/wc13_grd.nc<br /> <span class="twilightBlue">Nonlinear Initial File:</span> wc13_ini.nc<br /> <span class="twilightBlue">Forcing File 01:</span> ../Data/coamps_wc13_lwrad_down.nc<br /> <span class="twilightBlue">Forcing File 02:</span> ../Data/coamps_wc13_Pair.nc<br /> <span class="twilightBlue">Forcing File 03:</span> ../Data/coamps_wc13_Qair.nc<br /> <span class="twilightBlue">Forcing File 04:</span> ../Data/coamps_wc13_rain.nc<br /> <span class="twilightBlue">Forcing File 05:</span> ../Data/coamps_wc13_swrad.nc<br /> <span class="twilightBlue">Forcing File 06:</span> ../Data/coamps_wc13_Tair.nc<br /> <span class="twilightBlue">Forcing File 07:</span> ../Data/coamps_wc13_wind.nc<br /> <span class="twilightBlue">Boundary File:</span> ../Data/wc13_ecco_bry.nc<br /><br /> <span class="twilightBlue">Adjoint Sensitivity File:</span> wc13_ads.nc<br /> <span class="twilightBlue">Initial Conditions STD File:</span> ../Data/wc13_std_i.nc<br /> <span class="twilightBlue">Model STD File:</span> ../Data/wc13_std_m.nc<br /> <span class="twilightBlue">Boundary Conditions STD File:</span> ../Data/wc13_std_b.nc<br /> <span class="twilightBlue">Surface Forcing STD File:</span> ../Data/wc13_std_f.nc<br /> <span class="twilightBlue">Initial Conditions Norm File:</span> ../Data/wc13_nrm_i.nc<br /> <span class="twilightBlue">Model Norm File:</span> ../Data/wc13_nrm_m.nc<br /> <span class="twilightBlue">Boundary Conditions Norm File:</span> ../Data/wc13_nrm_b.nc<br /> <span class="twilightBlue">Surface Forcing Norm File:</span> ../Data/wc13_nrm_f.nc<br/> <span class="twilightBlue">Observations File:</span> wc13_obs.nc<br /> <span class="twilightBlue">Lanczos Vectors File:</span> wc13_lcz.nc</div> | ||
==Various Scripts and Include Files== | ==Various Scripts and Include Files== | ||
<div class="box"> build.bash bash shell script to compile application<br /> build.sh csh Unix script to compile application<br /> job_psas_sen.sh job configuration script<br /> ocean_wc13.in ROMS standard input script for WC13<br /> s4dvar.in 4D-Var standard input script template<br /> wc13.h WC13 header with CPP options</div> | <div class="box"> [[build_Script|build.bash]] bash shell script to compile application<br /> [[build_Script|build.sh]] csh Unix script to compile application<br /> [[job_psas_sen|job_psas_sen.sh]] job configuration script<br /> <span class="twilightBlue">ocean_wc13.in</span> ROMS standard input script for WC13<br /> [[s4dvar.in]] 4D-Var standard input script template<br /> <span class="twilightBlue">wc13.h</span> WC13 header with CPP options</div> | ||
==Important parameters in standard input <span class=" | ==Important parameters in standard input <span class="twilightBlue">ocean_wc13.in</span> script== | ||
*Notice that this driver uses the following adjoint sensitivity parameters (see input script for details): | *Notice that this driver uses the following adjoint sensitivity parameters (see input script for details): | ||
:<div class="box"> DstrS == 0.0d0 ! starting day<br /> DendS == 0.0d0 ! ending day<br /><br /> KstrS == 1 ! starting level<br /> KendS == 30 ! ending level<br /><br /> Lstate(isFsur) == T ! free-surface<br /> Lstate(isUbar) == T ! 2D U-momentum<br /> Lstate(isVbar) == T ! 2D V-momentum<br /> Lstate(isUvel) == T ! 3D U-momentum<br /> Lstate(isVvel) == T ! 3D V-momentum<br /><br /> Lstate(isTvar) == T T ! tracers</div> | :<div class="box"> [[Variables#DstrS|DstrS]] == 0.0d0 ! starting day<br /> [[Variables#DendS|DendS]] == 0.0d0 ! ending day<br /><br /> [[Variables#KstrS|KstrS]] == 1 ! starting level<br /> [[Variables#KendS|KendS]] == 30 ! ending level<br /><br /> [[Variables#Lstate|Lstate(isFsur)]] == T ! free-surface<br /> [[Variables#Lstate|Lstate(isUbar)]] == T ! 2D U-momentum<br /> [[Variables#Lstate|Lstate(isVbar)]] == T ! 2D V-momentum<br /> [[Variables#Lstate|Lstate(isUvel)]] == T ! 3D U-momentum<br /> [[Variables#Lstate|Lstate(isVvel)]] == T ! 3D V-momentum<br /><br /> [[Variables#Lstate|Lstate(isTvar)]] == T T ! tracers</div> | ||
*Both '''FWDNAME''' and '''HISNAME''' must be the same: | *Both '''FWDNAME''' and '''HISNAME''' must be the same: | ||
:<div class="box"> FWDNAME == wc13_fwd.nc<br /> HISNAME == wc13_fwd.nc</div> | :<div class="box"> [[Variables#FWDname|FWDNAME]] == wc13_fwd.nc<br /> [[Variables#HISname|HISNAME]] == wc13_fwd.nc</div> | ||
==Instructions== | ==Instructions== | ||
To run this application you need to take the following steps: | To run this application you need to take the following steps: | ||
#Before you run this application, you need to run the standard [[PSAS_Tutorial|4D-PSAS | #Before you run this application, you need to run the standard [[PSAS_Tutorial|4D-PSAS]] ('''../PSAS''' directory) since we need the Lanczos vectors. Notice that in [[job_psas_sen|job_psas_sen.sh]] we have the following operation:<div class="box"><span class="red">cp -p ${Dir}/PSAS/wc13_mod.nc wc13_lcz.nc</span></div>In 4D-Var (observartion space minimization), the Lanczos vectors are stored in the output 4D-Var NetCDF file <span class="twilightBlue">wc13_mod.nc</span>. | ||
#In addition, to run this application you need an adjoint sensitivity functional. This is computed by the following Matlab script:<div class="box">../Data/adsen_37N_transport.m</div>which creates the NetCDF file <span class=" | #In addition, to run this application you need an adjoint sensitivity functional. This is computed by the following Matlab script:<div class="box"><span class="red">../Data/adsen_37N_transport.m</span></div>which creates the NetCDF file <span class="twilightBlue">wc13_ads.nc</span>. This file has already been created for you.<br /><br />The adjoint sensitivity functional is defined as the time-averaged transport crossing 37N in the upper 500m. | ||
#Customize your preferred | #Customize your preferred [[build_Script|build script]] and provide the appropriate values for: | ||
#*Root directory, MY_ROOT_DIR | #*Root directory, MY_ROOT_DIR | ||
#*ROMS source code, MY_ROMS_SRC | #*ROMS source code, MY_ROMS_SRC | ||
Line 38: | Line 38: | ||
#*MPI flags, USE_MPI and USE_MPIF90 | #*MPI flags, USE_MPI and USE_MPIF90 | ||
#*Path of MPI, NetCDF, and ARPACK libraries according to the compiler. Notice that you need to provide the correct places of these libraries for your computer. If you want to ignore this section, comment out the assignment for the variable USE_MY_LIBS. | #*Path of MPI, NetCDF, and ARPACK libraries according to the compiler. Notice that you need to provide the correct places of these libraries for your computer. If you want to ignore this section, comment out the assignment for the variable USE_MY_LIBS. | ||
#Notice that the most important CPP options for this application are specified in the | #Notice that the most important CPP options for this application are specified in the [[build_Script|build script]] instead of <span class="twilightBlue">wc13.h</span>:<div class="box"><span class="twilightBlue">setenv MY_CPP_FLAGS "-DW4DPSAS_SENSITIVITY"<br />setenv MY_CPP_FLAGS "${MY_CPP_FLAGS} -DAD_IMPULSE"<br />setenv MY_CPP_FLAGS "${MY_CPP_FLAGS} -DOBS_IMPACT"<br />setenv MY_CPP_FLAGS "${MY_CPP_FLAGS} -DOBS_IMPACT_SPLIT"</span></div>This is to allow flexibility with different CPP options.<br /><br />For this to work, however, any '''#undef''' directives MUST be avoided in the header file <span class="twilightBlue">wc13.h</span> since it has precedence during C-preprocessing. | ||
#You MUST use the | #You MUST use the [[build_Script|build script]] to compile. | ||
#Customize the ROMS input script <span class=" | #Customize the ROMS input script <span class="twilightBlue">ocean_wc13.in</span> and specify the appropriate values for the distributed-memory partition. It is set by default to:<div class="box">[[Variables#NtileI|NtileI]] == 2 ! I-direction partition<br />[[Variables#NtileJ|NtileJ]] == 2 ! J-direction partition</div>Notice that the adjoint-based algorithms can only be run in parallel using MPI. This is because of the way that the adjoint model is constructed. | ||
#Customize the configuration script | #Customize the configuration script [[job_psas_sen|job_psas_sen.sh]] and provide the appropriate place for the "substitute" Perl script:<div class="box"><span class="twilightBlue">set SUBSTITUTE=${ROMS_ROOT}/ROMS/Bin/substitute</span></div>This script is distributed with ROMS and it is found in the ROMS/Bin sub-directory. Alternatively, you can define ROMS_ROOT environmental variable in your .cshrc login script. For example, I have:<div class="box"><span class="twilightBlue">setenv ROMS_ROOT /home/arango/ocean/toms/repository/trunk</span></div> | ||
#Execute the configuration | #Execute the configuration [[job_psas_sen|job_psas_sen.sh]] '''BEFORE''' running the model. It copies the required files and creates <span class="twilightBlue">psas.in</span> input script from template <span class="twilightBlue">s4dvar.in</span>. This has to be done '''EVERY TIME''' that you run this application. We need a clean and fresh copy of the initial conditions and observation files since they are modified by ROMS during execution. | ||
#Run ROMS with data assimilation:<div class="box">mpirun -np 4 oceanM ocean_wc13.in > & log &</div> | #Run ROMS with data assimilation:<div class="box"><span class="red">mpirun -np 4 oceanM ocean_wc13.in > & log &</span></div> | ||
==References== | ==References== |
Revision as of 15:56, 29 June 2010
4-DVar PSAS Observation Impact
The various files in the PSAS_impact folder are needed to run the Strong/Weak constraint, 4-Dimensional Variational (4D-Var) data assimilation observation impact based on the Physical-space Statistical Analysis System (PSAS) algorithm in the California Current System, 1/3° resolution, application (WC13).
This page is under construction
Important CPP Options
W4DPSAS_SENSITIVITY 4D-PSAS observation sensitivity driver
AD_IMPULSE Force ADM with intermittent impulses
OBS_IMPACT Compute observation impact
OBS_IMPACT_SPLIT separate impact due to IC, forcing, and OBC
WC13 Application CPP option
AD_IMPULSE Force ADM with intermittent impulses
OBS_IMPACT Compute observation impact
OBS_IMPACT_SPLIT separate impact due to IC, forcing, and OBC
WC13 Application CPP option
Input NetCDF Files
Grid File: ../Data/wc13_grd.nc
Nonlinear Initial File: wc13_ini.nc
Forcing File 01: ../Data/coamps_wc13_lwrad_down.nc
Forcing File 02: ../Data/coamps_wc13_Pair.nc
Forcing File 03: ../Data/coamps_wc13_Qair.nc
Forcing File 04: ../Data/coamps_wc13_rain.nc
Forcing File 05: ../Data/coamps_wc13_swrad.nc
Forcing File 06: ../Data/coamps_wc13_Tair.nc
Forcing File 07: ../Data/coamps_wc13_wind.nc
Boundary File: ../Data/wc13_ecco_bry.nc
Adjoint Sensitivity File: wc13_ads.nc
Initial Conditions STD File: ../Data/wc13_std_i.nc
Model STD File: ../Data/wc13_std_m.nc
Boundary Conditions STD File: ../Data/wc13_std_b.nc
Surface Forcing STD File: ../Data/wc13_std_f.nc
Initial Conditions Norm File: ../Data/wc13_nrm_i.nc
Model Norm File: ../Data/wc13_nrm_m.nc
Boundary Conditions Norm File: ../Data/wc13_nrm_b.nc
Surface Forcing Norm File: ../Data/wc13_nrm_f.nc
Observations File: wc13_obs.nc
Lanczos Vectors File: wc13_lcz.nc
Nonlinear Initial File: wc13_ini.nc
Forcing File 01: ../Data/coamps_wc13_lwrad_down.nc
Forcing File 02: ../Data/coamps_wc13_Pair.nc
Forcing File 03: ../Data/coamps_wc13_Qair.nc
Forcing File 04: ../Data/coamps_wc13_rain.nc
Forcing File 05: ../Data/coamps_wc13_swrad.nc
Forcing File 06: ../Data/coamps_wc13_Tair.nc
Forcing File 07: ../Data/coamps_wc13_wind.nc
Boundary File: ../Data/wc13_ecco_bry.nc
Adjoint Sensitivity File: wc13_ads.nc
Initial Conditions STD File: ../Data/wc13_std_i.nc
Model STD File: ../Data/wc13_std_m.nc
Boundary Conditions STD File: ../Data/wc13_std_b.nc
Surface Forcing STD File: ../Data/wc13_std_f.nc
Initial Conditions Norm File: ../Data/wc13_nrm_i.nc
Model Norm File: ../Data/wc13_nrm_m.nc
Boundary Conditions Norm File: ../Data/wc13_nrm_b.nc
Surface Forcing Norm File: ../Data/wc13_nrm_f.nc
Observations File: wc13_obs.nc
Lanczos Vectors File: wc13_lcz.nc
Various Scripts and Include Files
build.bash bash shell script to compile application
build.sh csh Unix script to compile application
job_psas_sen.sh job configuration script
ocean_wc13.in ROMS standard input script for WC13
s4dvar.in 4D-Var standard input script template
wc13.h WC13 header with CPP options
build.sh csh Unix script to compile application
job_psas_sen.sh job configuration script
ocean_wc13.in ROMS standard input script for WC13
s4dvar.in 4D-Var standard input script template
wc13.h WC13 header with CPP options
Important parameters in standard input ocean_wc13.in script
- Notice that this driver uses the following adjoint sensitivity parameters (see input script for details):
- DstrS == 0.0d0 ! starting day
DendS == 0.0d0 ! ending day
KstrS == 1 ! starting level
KendS == 30 ! ending level
Lstate(isFsur) == T ! free-surface
Lstate(isUbar) == T ! 2D U-momentum
Lstate(isVbar) == T ! 2D V-momentum
Lstate(isUvel) == T ! 3D U-momentum
Lstate(isVvel) == T ! 3D V-momentum
Lstate(isTvar) == T T ! tracers
- Both FWDNAME and HISNAME must be the same:
Instructions
To run this application you need to take the following steps:
- Before you run this application, you need to run the standard 4D-PSAS (../PSAS directory) since we need the Lanczos vectors. Notice that in job_psas_sen.sh we have the following operation:cp -p ${Dir}/PSAS/wc13_mod.nc wc13_lcz.ncIn 4D-Var (observartion space minimization), the Lanczos vectors are stored in the output 4D-Var NetCDF file wc13_mod.nc.
- In addition, to run this application you need an adjoint sensitivity functional. This is computed by the following Matlab script:../Data/adsen_37N_transport.mwhich creates the NetCDF file wc13_ads.nc. This file has already been created for you.
The adjoint sensitivity functional is defined as the time-averaged transport crossing 37N in the upper 500m. - Customize your preferred build script and provide the appropriate values for:
- Root directory, MY_ROOT_DIR
- ROMS source code, MY_ROMS_SRC
- Fortran compiler, FORT
- MPI flags, USE_MPI and USE_MPIF90
- Path of MPI, NetCDF, and ARPACK libraries according to the compiler. Notice that you need to provide the correct places of these libraries for your computer. If you want to ignore this section, comment out the assignment for the variable USE_MY_LIBS.
- Notice that the most important CPP options for this application are specified in the build script instead of wc13.h:setenv MY_CPP_FLAGS "-DW4DPSAS_SENSITIVITY"This is to allow flexibility with different CPP options.
setenv MY_CPP_FLAGS "${MY_CPP_FLAGS} -DAD_IMPULSE"
setenv MY_CPP_FLAGS "${MY_CPP_FLAGS} -DOBS_IMPACT"
setenv MY_CPP_FLAGS "${MY_CPP_FLAGS} -DOBS_IMPACT_SPLIT"
For this to work, however, any #undef directives MUST be avoided in the header file wc13.h since it has precedence during C-preprocessing. - You MUST use the build script to compile.
- Customize the ROMS input script ocean_wc13.in and specify the appropriate values for the distributed-memory partition. It is set by default to:Notice that the adjoint-based algorithms can only be run in parallel using MPI. This is because of the way that the adjoint model is constructed.
- Customize the configuration script job_psas_sen.sh and provide the appropriate place for the "substitute" Perl script:set SUBSTITUTE=${ROMS_ROOT}/ROMS/Bin/substituteThis script is distributed with ROMS and it is found in the ROMS/Bin sub-directory. Alternatively, you can define ROMS_ROOT environmental variable in your .cshrc login script. For example, I have:setenv ROMS_ROOT /home/arango/ocean/toms/repository/trunk
- Execute the configuration job_psas_sen.sh BEFORE running the model. It copies the required files and creates psas.in input script from template s4dvar.in. This has to be done EVERY TIME that you run this application. We need a clean and fresh copy of the initial conditions and observation files since they are modified by ROMS during execution.
- Run ROMS with data assimilation:mpirun -np 4 oceanM ocean_wc13.in > & log &
References
Moore, A.M., H.G. Arango, G. Broquet, B.S. Powell, J. Zavala-Garay, and A.T. Weaver, 2010: The Regional Ocean Modeling System (ROMS) 4-dimensional variational data assimilation systems, Part I: System overview, Ocean Modelling, draft.
Moore, A.M., H.G. Arango, and G. Broquet, C. Edwards, M. Veneziani, B.S. Powell, D. Foley, J. Doyle, D. Costa, and P. Robinson, 2010: The Regional Ocean Modeling System (ROMS) 4-dimensional variational data assimilation systems, Part II: Performance and application to the California Current System, Ocean Modelling, Draft.
Moore, A.M., H.G. Arango, and G. Broquet, C. Edwards, M. Veneziani, B.S. Powell, D. Foley, J. Doyle, D. Costa, and P. Robinson, 2010: The Regional Ocean Modeling System (ROMS) 4-dimensional variational data assimilation systems, Part III: Observation Impact and Observation Sensitivity in the California Current System, Ocean Modelling, Draft.