4DVar Tutorial Introduction: Difference between revisions
No edit summary (change visibility) |
|||
(26 intermediate revisions by 2 users not shown) | |||
Line 2: | Line 2: | ||
This tutorial shows several examples of ROMS 4D-Var data assimilation algorithms in the California Current System (CCS), 1/3 degree resolution ([[WC13]]). | This tutorial shows several examples of ROMS 4D-Var data assimilation algorithms in the California Current System (CCS), 1/3 degree resolution ([[Options#WC13|WC13]]). | ||
Line 13: | Line 13: | ||
<section begin=setup /> | <section begin=setup /> | ||
==Model Set-up== | ==Model Set-up== | ||
The [[WC13]] model domain is shown in Fig. 1 and has open boundaries along the northern, western, and southern edges of the model domain. | The [[Options#WC13|WC13]] model domain is shown in Fig. 1 and has open boundaries along the northern, western, and southern edges of the model domain. | ||
[[Image:hraw_coarse_transect.png|500px|thumb|center|<center>'''Fig. 1:''' Model Bathymetry with 37°N Transect</center>]] | [[Image:hraw_coarse_transect.png|500px|thumb|center|<center>'''Fig. 1:''' Model Bathymetry with 37°N Transect and Target Area</center>]] | ||
<div style="clear: both"></div> | <div style="clear: both"></div> | ||
In the tutorial, you will perform a 4D-Var data assimilation cycle that spans the period 3-6 January, 2004. The 4D-Var control vector ''δ'''''z''' is comprised of increments to the initial conditions, ''δ'''''x'''(''t<sub>0</sub>''), surface forcing, δ'''f'''(''t''), and open boundary conditions, δ'''b'''(''t''). The ''prior'' initial conditions, '''x<sub>b</sub>'''(''t<sub>0</sub>''), are taken from the sequence of 4D-Var experiments described by [[Bibliography# | In the tutorial, you will perform a 4D-Var data assimilation cycle that spans the period 3-6 January, 2004. The 4D-Var control vector ''δ'''''z''' is comprised of increments to the initial conditions, ''δ'''''x'''(''t<sub>0</sub>''), surface forcing, δ'''f'''(''t''), and open boundary conditions, δ'''b'''(''t''). The ''prior'' initial conditions, '''x<sub>b</sub>'''(''t<sub>0</sub>''), are taken from the sequence of 4D-Var experiments described by [[Bibliography#MooreAM_2011b|Moore ''et al.'' (2011b)]] in which data were assimilated every 7 days during the period July 2002- December 2004. The ''prior'' surface forcing, '''f<sub>b</sub>'''(''t''), takes the form of surface wind stress, heat flux, and a freshwater flux computed using the ROMS bulk flux formulation, and using near surface air data from COAMPS ([[Bibliography#DoyleJD_2009|Doyle ''et al.'', 2009]]). Clamped open boundary conditions are imposed on (''u'',''v'') and tracers, and the ''prior'' boundary conditions, '''b<sub>b</sub>'''(''t''), are taken from the global ECCO product ([[Bibliography#WunschC_2007|Wunsch and Heimbach, 2007]]). The free-surface height and vertically integrated velocity components are subject to the usual Chapman and Flather radiation conditions at the open boundaries. The ''prior'' surface forcing and open boundary conditions are provided daily and linearly interpolated in time. Similarly, the increments ''δ'''''f'''(''t'') and ''δ'''''b'''(''t'') are also computed daily and linearly interpolated in time. | ||
The observations assimilated into the model are satellite SST, satellite SSH in the form of a gridded product from Aviso, and hydrographic observations of temperature and salinity collected from Argo floats and during the GLOBEC/LTOP and CalCOFI cruises off the coast of Oregon and southern California, respectively. The observation locations are illustrated in Fig. 2. | The observations assimilated into the model are satellite SST, satellite SSH in the form of a gridded product from Aviso, and hydrographic observations of temperature and salinity collected from Argo floats and during the GLOBEC/LTOP and CalCOFI cruises off the coast of Oregon and southern California, respectively. The observation locations are illustrated in Fig. 2. | ||
{|align="center" | {|align="center" | ||
|+style="caption-side:bottom;"|'''Figure 2:''' WC13 Observations | |||
|- | |- | ||
|[[Image: | |[[Image:aviso_ssh_2019.png|thumb|400px|<center>'''a)''' Aviso SSH</center>]] | ||
|[[Image: | |[[Image:blended_sst_2019.png|thumb|400px|<center>'''b)''' Blended SST</center>]] | ||
|- | |- | ||
|[[Image: | |[[Image:in_situ_T_2019.png|thumb|400px|<center>'''c)''' In Situ Temperature</center>]] | ||
|[[Image: | |[[Image:in_situ_S_2019.png|thumb|400px|<center>'''d)''' In Situ Salinity</center>]] | ||
|- | |- | ||
|}<section end=setup /> | |}<section end=setup /> | ||
Line 34: | Line 35: | ||
==Download Lectures and Exercises== | ==Download Lectures and Exercises== | ||
Links to the | The workshop Agenda can be found [https://www.myroms.org/Workshops/4DVAR2019/Agenda.pdf here]. Links to the [https://www.myroms.org/index.php?page=4DVAR_2019_info 2019 ROMS 4D-Var workshop] lectures are provided below. These lectures are meant to supplement this 4D-Var tutorial. | ||
*'''Lecture 1:''' <span style="font-size: 75%">[http://www.myroms.org/ | *'''Lecture 1:''' <span style="font-size: 75%">[http://www.myroms.org/Workshops/4DVAR2019/Lectures/Lecture_1_2019.pdf PDF]</span> <span class="twilightBlue">4D-Var: Some Basics</span> | ||
*'''Lecture 2:''' <span style="font-size: 75%">[http://www.myroms.org/ | *'''Lecture 2:''' <span style="font-size: 75%">[http://www.myroms.org/Workshops/4DVAR2019/Lectures/Lecture_2_2019.pdf PDF]</span> <span class="twilightBlue">The Mechanics of 4D-Var</span> | ||
*'''Lecture 3:''' <span style="font-size: 75%">[http://www.myroms.org/ | *'''Lecture 3:''' <span style="font-size: 75%">[http://www.myroms.org/Workshops/4DVAR2019/Lectures/Lecture_3_2019.pdf PDF]</span> <span class="twilightBlue">Dual 4D-Var</span> | ||
*'''Lecture 4:''' <span style="font-size: 75%">[http://www.myroms.org/ | *'''Lecture 4:''' <span style="font-size: 75%">[http://www.myroms.org/Workshops/4DVAR2019/Lectures/Lecture_4_2019.pdf PDF]</span> <span class="twilightBlue">Observing System Simulation Experiments (OSSEs)</span> | ||
*'''Lecture 5:''' <span style="font-size: 75%">[http://www.myroms.org/ | *'''Lecture 5:''' <span style="font-size: 75%">[http://www.myroms.org/Workshops/4DVAR2019/Lectures/Lecture_5_2019.pdf PDF]</span> <span class="twilightBlue">Observation Impact & Observation Sensitivity</span> | ||
*'''Lecture 6:''' <span style="font-size: 75%">[http://www.myroms.org/Workshops/4DVAR2019/Lectures/Lecture_6_2019.pdf PDF]</span> <span class="twilightBlue">The MARACOOS analysis-forecast system</span> | |||
*'''Lecture 7:''' <span style="font-size: 75%">[http://www.myroms.org/Workshops/4DVAR2019/Lectures/Lecture_7_2019.pdf PDF]</span> <span class="twilightBlue">Array Modes</span> | |||
*'''Lecture 8:''' <span style="font-size: 75%"><!--[http://www.myroms.org/Workshops/4DVAR2019/Lectures/Lecture_8_2019.pdf PDF]-->PDF</span> <span class="twilightBlue">The West Coast Ocean Forecasting System (WCOFS)</span> | |||
*'''Lecture 9:''' <span style="font-size: 75%"><!--[http://www.myroms.org/Workshops/4DVAR2019/Lectures/Lecture_9_2019.pdf PDF]-->PDF</span> <span class="twilightBlue">The CeNCOOS and PacIOOS analysis-forecast systems</span> | |||
Below are the | Below are the tutorials pertinent to the [https://www.myroms.org/index.php?page=4DVAR_2019_info 2019 ROMS 4D-Var workshop]: | ||
*'''Exercise 1:''' <span style="font-size: 75%">[http://www.myroms.org/ | *'''Tutorial 01:''' <span style="font-size: 75%">[http://www.myroms.org/Workshops/4DVAR2019/Tutorials/Tutorial_01_2019.pdf PDF]</span> <span class="twilightBlue">Explanation of cpp options, ocean.in, s4dvar.in (I4DVAR)</span> | ||
*'''Exercise 2:''' <span style="font-size: 75%">[http://www.myroms.org/ | *'''Tutorial 02:''' <span style="font-size: 75%">[http://www.myroms.org/Workshops/4DVAR2019/Tutorials/Tutorial_02_2019.pdf PDF]</span> <span class="twilightBlue">Multiple outer loops</span> | ||
*'''Exercise 3:''' <span style="font-size: 75%">[http://www.myroms.org/ | *'''Tutorial 03:''' <span style="font-size: 75%"><!--[http://www.myroms.org/Workshops/4DVAR2019/Tutorials/Tutorial_03_2019.pdf PDF]--></span> <span class="twilightBlue">Discussion of exercises 1 and 2</span> | ||
*'''Exercise 4:''' <span style="font-size: 75%">[http://www.myroms.org/ | *'''Tutorial 04:''' <span style="font-size: 75%">[http://www.myroms.org/Workshops/4DVAR2019/Tutorials/Tutorial_04_2019.pdf PDF]</span> <span class="twilightBlue">Calculation of prior error standard deviations</span> | ||
*'''Exercise 5:''' <span style="font-size: 75%">[http://www.myroms.org/ | *'''Tutorial 05:''' <span style="font-size: 75%">[http://www.myroms.org/Workshops/4DVAR2019/Tutorials/Tutorial_05_2019.pdf PDF]</span> <span class="twilightBlue">Explanation of cpp options, ocean.in, s4dvar.in (RBL4D-Var)</span> | ||
*'''Exercise | *'''Tutorial 06:''' <span style="font-size: 75%">[http://www.myroms.org/Workshops/4DVAR2019/Tutorials/Tutorial_06_2019.pdf PDF]</span> <span class="twilightBlue">Semi-variograms</span> | ||
*'''Tutorial 07:''' <span style="font-size: 75%">[http://www.myroms.org/Workshops/4DVAR2019/Tutorials/Tutorial_07_2019.pdf PDF]</span> <span class="twilightBlue">ERDDAP data server and management tools</span> | |||
*'''Tutorial 08:''' <span style="font-size: 75%"><!--[http://www.myroms.org/Workshops/4DVAR2019/Tutorials/Tutorial_08_2019.pdf PDF]--></span> <span class="twilightBlue">Discussion of exercises 3 & 4</span> | |||
*'''Tutorial 09:''' <span style="font-size: 75%">[http://www.myroms.org/Workshops/4DVAR2019/Tutorials/Tutorial_09_2019.pdf PDF]</span> <span class="twilightBlue">Computing normalization coefficients for covariance models</span> | |||
*'''Tutorial 10:''' <span style="font-size: 75%">[http://www.myroms.org/Workshops/4DVAR2019/Tutorials/Tutorial_10_2019.pdf PDF_Arango] | [http://www.myroms.org/Workshops/4DVAR2019/Tutorials/Tutorial_10a_2019.pdf PDF_Wilkin]</span> <span class="twilightBlue">Building your observation files</span> | |||
*'''Tutorial 11:''' <span style="font-size: 75%">[http://www.myroms.org/Workshops/4DVAR2019/Tutorials/Tutorial_11_2019.pdf PDF]</span> <span class="twilightBlue">Observation Impact & Observation Sensitivity</span> | |||
*'''Tutorial 12:''' <span style="font-size: 75%"><!--[http://www.myroms.org/Workshops/4DVAR2019/Tutorials/Tutorial_12_2019.pdf PDF]--></span> <span class="twilightBlue">Discussion of exercise 5</span> | |||
*'''Tutorial 13:''' <span style="font-size: 75%">[http://www.myroms.org/Workshops/4DVAR2019/Tutorials/Tutorial_13_2019.pdf PDF]</span> <span class="twilightBlue">Using ERDDAP to view observation impact information</span> | |||
*'''Tutorial 14:''' <span style="font-size: 75%"><!--[http://www.myroms.org/Workshops/4DVAR2019/Tutorials/Tutorial_14_2019.pdf PDF]--></span> <span class="twilightBlue">Discussion of exercise 6 & 7</span> | |||
*'''Tutorial 15:''' <span style="font-size: 75%"><!--[http://www.myroms.org/Workshops/4DVAR2019/Tutorials/Tutorial_15_2019.pdf PDF]--></span> <span class="twilightBlue">Putting it all together</span> | |||
Below are the exercises pertinent to the [https://www.myroms.org/index.php?page=4DVAR_2019_info 2019 ROMS 4D-Var workshop]: | |||
*'''Exercise 1:''' <span style="font-size: 75%">[http://www.myroms.org/Workshops/4DVAR2019/Exercises/EXERCISE_1_2019.pdf PDF]</span> <span class="twilightBlue">Incremental, Strong Constraint 4D-Var</span> | |||
*'''Exercise 2:''' <span style="font-size: 75%">[http://www.myroms.org/Workshops/4DVAR2019/Exercises/EXERCISE_2_2019.pdf PDF]</span> <span class="twilightBlue">I4D-Var with Multiple Outer-loops</span> | |||
*'''Exercise 3:''' <span style="font-size: 75%">[http://www.myroms.org/Workshops/4DVAR2019/Exercises/EXERCISE_3_2019.pdf PDF]</span> <span class="twilightBlue">Dual Formulation 4D-Var - RBL4D-Var</span> | |||
*'''Exercise 4:''' <span style="font-size: 75%">[http://www.myroms.org/Workshops/4DVAR2019/Exercises/EXERCISE_4_2019.pdf PDF]</span> <span class="twilightBlue">Weak Constraint Dual Formulation 4D-Var</span> | |||
*'''Exercise 5:''' <span style="font-size: 75%">[http://www.myroms.org/Workshops/4DVAR2019/Exercises/EXERCISE_5_2019.pdf PDF]</span> <span class="twilightBlue">Analysis Cycle Observation Impacts</span> | |||
*'''Exercise 6:''' <span style="font-size: 75%">[http://www.myroms.org/Workshops/4DVAR2019/Exercises/EXERCISE_6_2019.pdf PDF]</span> <span class="twilightBlue">Analysis Cycle Observation Sensitivity</span> | |||
*'''Exercise 7:''' <span style="font-size: 75%">[http://www.myroms.org/Workshops/4DVAR2019/Exercises/EXERCISE_7_2019.pdf PDF]</span> <span class="twilightBlue">Reduced-Rank Array Modes</span> | |||
*'''Exercise 8:''' <span style="font-size: 75%">[http://www.myroms.org/Workshops/4DVAR2019/Exercises/EXERCISE_8_2019.pdf PDF]</span> <span class="twilightBlue">Forecast Cycle Observation Impacts</span> | |||
*'''Exercise 9:''' <span style="font-size: 75%">[http://www.myroms.org/Workshops/4DVAR2019/Exercises/EXERCISE_9_2019.pdf PDF]</span> <span class="twilightBlue">Forecast Cycle Observation Sensitivities</span> | |||
Below are the homeworks pertinent to the [https://www.myroms.org/index.php?page=4DVAR_2019_info 2019 ROMS 4D-Var workshop]: | |||
*'''Homework 1:''' <span class="twilightBlue">Building the standard deviation file for user model configuration</span> | |||
*'''Homework 2:''' <span class="twilightBlue">Building the file of normalization coefficients for the prior error covariance matrix for user model configuration</span> | |||
*'''Homework 3:''' <span class="twilightBlue">Build observation file for user model configuration</span> | |||
==Download Tutorial Files== | ==Download Tutorial Files== | ||
All | All data files and scripts necessary to run the 4D-Var tests discussed in this tutorial are available from the ROMS [https://github.com/myroms GitHub] repository. To download, execute the following command: | ||
<div class="box"><span class="red"> git clone https://github.com/myroms/roms_test.git</div> | |||
==Tutorial Directory Structure== | |||
==Directory Structure== | |||
When the checkout is complete, you will have the following directory structure under your <span class="twilightBlue">my_test</span> directory. | When the checkout is complete, you will have the following directory structure under your <span class="twilightBlue">my_test</span> directory. | ||
<span class="twilightBlue">/WC13 | <span class="twilightBlue">/WC13 Main California Current System 4D-Var applications | ||
/ARRAY_MODES | /ARRAY_MODES Stabilized representer matrix array modes and clipping | ||
/Data | /Data Input data directory | ||
/Functionals | /Functionals Analytical expressions header files | ||
/I4DVAR | /I4DVAR Primal form of incremental, strong constraint 4D-Var, I4D-Var | ||
/Normalization 4D-Var error covariance normalization coefficients | |||
/Normalization | /plotting 4D-Var plotting scripts (Matlab and ROMS plotting package) | ||
/plotting | /RBL4DVAR Dual form of 4D-Var, Restricted B-preconditioned Lanczos Analysis System, RBL4D-Var | ||
/ | /RBL4DVAR_analysis_impact RBL4D-Var analysis observation impact | ||
/ | /RBL4DVAR_analysis_sensitivity RBL4D-Var analysis observation sensitivity (adjoint of RBL4D-Var) | ||
/ | /RBL4DVAR_forecast_impact RBL4D-Var forecast observation impact | ||
/ | /RBL4DVAR_forecast_sensitivity RBL4D-Var forecast observation sensitivity (adjoint of RBL4D-Var) | ||
/ | |||
</span> | </span> | ||
Mostly all the directories have a <span class="twilightBlue">Readme</span> file with detailed instructions for configuring, compiling, running, and plotting the results. | Mostly all the directories have a <span class="twilightBlue">Readme</span> file with detailed instructions for configuring, compiling, running, and plotting the results. | ||
==References== | |||
The technical description of the algorithms and application used in this tutorial are described in Moore ''et al.'' ([[Bibliography#MooreAM_2011a|2011a]], [[Bibliography#MooreAM_2011b|b]], [[Bibliography#MooreAM_2011c|c]]). |
Latest revision as of 16:55, 14 February 2024
This tutorial shows several examples of ROMS 4D-Var data assimilation algorithms in the California Current System (CCS), 1/3 degree resolution (WC13).
Model Set-up
The WC13 model domain is shown in Fig. 1 and has open boundaries along the northern, western, and southern edges of the model domain.
In the tutorial, you will perform a 4D-Var data assimilation cycle that spans the period 3-6 January, 2004. The 4D-Var control vector δz is comprised of increments to the initial conditions, δx(t0), surface forcing, δf(t), and open boundary conditions, δb(t). The prior initial conditions, xb(t0), are taken from the sequence of 4D-Var experiments described by Moore et al. (2011b) in which data were assimilated every 7 days during the period July 2002- December 2004. The prior surface forcing, fb(t), takes the form of surface wind stress, heat flux, and a freshwater flux computed using the ROMS bulk flux formulation, and using near surface air data from COAMPS (Doyle et al., 2009). Clamped open boundary conditions are imposed on (u,v) and tracers, and the prior boundary conditions, bb(t), are taken from the global ECCO product (Wunsch and Heimbach, 2007). The free-surface height and vertically integrated velocity components are subject to the usual Chapman and Flather radiation conditions at the open boundaries. The prior surface forcing and open boundary conditions are provided daily and linearly interpolated in time. Similarly, the increments δf(t) and δb(t) are also computed daily and linearly interpolated in time.
The observations assimilated into the model are satellite SST, satellite SSH in the form of a gridded product from Aviso, and hydrographic observations of temperature and salinity collected from Argo floats and during the GLOBEC/LTOP and CalCOFI cruises off the coast of Oregon and southern California, respectively. The observation locations are illustrated in Fig. 2.
Download Lectures and Exercises
The workshop Agenda can be found here. Links to the 2019 ROMS 4D-Var workshop lectures are provided below. These lectures are meant to supplement this 4D-Var tutorial.
- Lecture 1: PDF 4D-Var: Some Basics
- Lecture 2: PDF The Mechanics of 4D-Var
- Lecture 3: PDF Dual 4D-Var
- Lecture 4: PDF Observing System Simulation Experiments (OSSEs)
- Lecture 5: PDF Observation Impact & Observation Sensitivity
- Lecture 6: PDF The MARACOOS analysis-forecast system
- Lecture 7: PDF Array Modes
- Lecture 8: PDF The West Coast Ocean Forecasting System (WCOFS)
- Lecture 9: PDF The CeNCOOS and PacIOOS analysis-forecast systems
Below are the tutorials pertinent to the 2019 ROMS 4D-Var workshop:
- Tutorial 01: PDF Explanation of cpp options, ocean.in, s4dvar.in (I4DVAR)
- Tutorial 02: PDF Multiple outer loops
- Tutorial 03: Discussion of exercises 1 and 2
- Tutorial 04: PDF Calculation of prior error standard deviations
- Tutorial 05: PDF Explanation of cpp options, ocean.in, s4dvar.in (RBL4D-Var)
- Tutorial 06: PDF Semi-variograms
- Tutorial 07: PDF ERDDAP data server and management tools
- Tutorial 08: Discussion of exercises 3 & 4
- Tutorial 09: PDF Computing normalization coefficients for covariance models
- Tutorial 10: PDF_Arango | PDF_Wilkin Building your observation files
- Tutorial 11: PDF Observation Impact & Observation Sensitivity
- Tutorial 12: Discussion of exercise 5
- Tutorial 13: PDF Using ERDDAP to view observation impact information
- Tutorial 14: Discussion of exercise 6 & 7
- Tutorial 15: Putting it all together
Below are the exercises pertinent to the 2019 ROMS 4D-Var workshop:
- Exercise 1: PDF Incremental, Strong Constraint 4D-Var
- Exercise 2: PDF I4D-Var with Multiple Outer-loops
- Exercise 3: PDF Dual Formulation 4D-Var - RBL4D-Var
- Exercise 4: PDF Weak Constraint Dual Formulation 4D-Var
- Exercise 5: PDF Analysis Cycle Observation Impacts
- Exercise 6: PDF Analysis Cycle Observation Sensitivity
- Exercise 7: PDF Reduced-Rank Array Modes
- Exercise 8: PDF Forecast Cycle Observation Impacts
- Exercise 9: PDF Forecast Cycle Observation Sensitivities
Below are the homeworks pertinent to the 2019 ROMS 4D-Var workshop:
- Homework 1: Building the standard deviation file for user model configuration
- Homework 2: Building the file of normalization coefficients for the prior error covariance matrix for user model configuration
- Homework 3: Build observation file for user model configuration
Download Tutorial Files
All data files and scripts necessary to run the 4D-Var tests discussed in this tutorial are available from the ROMS GitHub repository. To download, execute the following command:
Tutorial Directory Structure
When the checkout is complete, you will have the following directory structure under your my_test directory.
/WC13 Main California Current System 4D-Var applications
/ARRAY_MODES Stabilized representer matrix array modes and clipping
/Data Input data directory
/Functionals Analytical expressions header files
/I4DVAR Primal form of incremental, strong constraint 4D-Var, I4D-Var
/Normalization 4D-Var error covariance normalization coefficients
/plotting 4D-Var plotting scripts (Matlab and ROMS plotting package)
/RBL4DVAR Dual form of 4D-Var, Restricted B-preconditioned Lanczos Analysis System, RBL4D-Var
/RBL4DVAR_analysis_impact RBL4D-Var analysis observation impact
/RBL4DVAR_analysis_sensitivity RBL4D-Var analysis observation sensitivity (adjoint of RBL4D-Var)
/RBL4DVAR_forecast_impact RBL4D-Var forecast observation impact
/RBL4DVAR_forecast_sensitivity RBL4D-Var forecast observation sensitivity (adjoint of RBL4D-Var)
Mostly all the directories have a Readme file with detailed instructions for configuring, compiling, running, and plotting the results.
References
The technical description of the algorithms and application used in this tutorial are described in Moore et al. (2011a, b, c).