CEDAR ETI
About the study
About the Challenge:
CEDAR Electrodynamics Thermosphere Ionosphere (CETI) Challenge was initiated at the 2009 CEDAR workshop. Its goal is to help to evaluate the current state of the ionosphere/thermosphere models, to track model improvements over time and facilitate interaction between research and operation communities in developing metrics for space weather model evaluations.
Call for participation in the 2nd round of the Challenge:
The Challenge heads into the second round in which the role of drivers on IT model results will be studied. Modelers are encouraged to submit simulation results by the due date of May 25, 2012.
In the first round of the CEDAT ETI Challenge, nine time intervals and six physical parameters were selected, and up to 10 submissions for each parameter were compared. The results of the first round of the Challenge were reported in two papers (one published and one to be submitted).
As a first step toward the second round of the Challenge, the December 2006 event (2006/12/13 (doy 347) 00:00 UT - 12/16 (doy 350) 00:00 UT) was selected to study the effect of different drivers. This study is also a part of GEM-CEDAR Modeling Challenge. We encourage IT modelers to perform simulations for the event with different models for the ionosphere potential pattern: 1) Weimer 2005 using 15-min averages of the IMF input parameters lagged -5 to -20 min provided by the NCAR and the CCMC; 2) AMIE provided by Aaron Ridley (University of Michigan); 3) Global magnetosphere models provided by the CCMC. Please contact Aaron Ridley or Ja Soon Shim, if you need assistance to get ionospheric potentials from AMIE and/or global magnetosphere models.
All participants to the Challenge will be co-authors of the papers, which will be used as important benchmark references for further studies. The preliminary results of the 2nd round of the Challenge were discussed at the CEDAR 2012 Workshop, June 24-29, 2012 in Santa Fe, NM.
The CEDAR community chose a ‘year’ of incoherent scatter radar (ISR) observations from 2007/03/01 (doy 060) – 2008/03/31 (doy 091), and also signed on for nine events and five physical parameters for the Modeling Challenge.
GEM events
E.2006.348: 2006/12/14 (doy 348) 12:00 UT - 12/16 (doy 350) 00:00 UT
2006/12/13 (doy 347) 00:00 UT - 12/16 (doy 350) 00:00 UT - for global electron density study (TEC, NmF2 and HmF2) (GEM event 2)
E.2001.243: 2001/08/31(doy 243) 00:00 UT - 09/01 (doy 244) 00:00 UT (GEM event 3)
E.2005.243: 2005/08/31 (doy 243) 10:00 UT - 09/01 (doy 244) 12:00 UT (GEM event 4)
Moderate storms
E.2007.091: 2007/04/01 (doy 091) 00:00 UT - 04/02 (doy 092) 12:00 UT
E.2007.142: 2007/05/22 (doy 142) 12:00 UT - 05/25 (doy 145) 00:00 UT
E.2008.059: 2008/02/28 (doy 059) 12:00 UT - 03/01 (doy 061) 12:00 UT
Quiet periods
E.2007.079: 2007/03/20 (doy 079) 00:00 UT - 03/22 (doy 081) 00:00 UT
E.2007.190: 2007/07/09 (doy 190) 00:00 UT - 07/10 (doy 191) 00:00 UT
E.2007.341: 2007/12/07 (doy 341) 00:00 UT - 12/09 (doy 343) 00:00 UT
Selected physical parameters:
1. Vertical and horizontal drifts at Jicamarca (VperpN and VperpE)
2. Neutral density at CHAMP orbit (Nden)
3. Electron density at CHAMP orbit (Eden)
4. NmF2 from LEO satellites (CHAMP and COSMIC) and ISRs
5. HmF2 from LEO satellites (CHAMP and COSMIC) and ISRs
Parameters added in June 2010:
6. Temperature Tn obtained by Fabry-Perot Spectrometer at 250 km (Resolute Bay, Canada)
7. Neutral winds obtained by Fabry-Perot Spectrometer at 250 km (Resolute Bay, Canada)
8. Ne at 300 km (Millstone Hill, Sondrestrom, EISCAT, Svalbard ISRs)
9. Te at 300 km (Millstone Hill, Sondrestrom, EISCAT, Svalbard ISRs)
10. Ti at 300 km (Millstone Hill, Sondrestrom, EISCAT, Svalbard ISRs)
11. Ion vertical velocity at Sonderstrom ISR
Global Electron Density (added in June 2011):
12. TEC from ground-based GPS in **eight 5° geographic longitude sectors
13. NmF2 from COSMIC in **eight 5° geographic longitude sectors
14. hmF2 from COSMIC in **eight 5° geographic longitude sectors
Note that not all parameters are considered for all selected events.
**5 deg. geographic longitude sectors: 025-030, 090-095, 140-145, 175-180, 200-205, 250-255, 285-290, 345-350. Each longitude has 36 latitude bins of 5 degrees each from -90 to +90.
Model Output File Format Description
Model output files should be in ASCII text format. Each file size should not exceed 1Mb. Full path name to the input file at your local disk should not contain any blank spaces or quotation marks. On DOS/Windows systems the recommended extension for the input file name is "txt".
The following file formats for model outputs for different physical parameters studies are expected.
Ionosphere/Thermosphere models or coupled model components:
TEC from ground-based GPS in eight 5° geographic longitude sectors
Year DOY Hour Min Sec Lat Lon TEC[TECU]
Here DOY is day of year, and TEC is Total Electron Content [TECU] at Lat + 2.5 [deg] and Lon + 2.5 [deg]. Lat and Lon are geographic latitude and longitude that correspond to first latitude and first longitude of the bin for measurement data to be compared with. Hour, Min and Sec also correspond to first Hour, Min, and Sec of the temporal bin for measurement data to be compared with.
TEC modeled value will be compared with GPS TEC measurement, which is median value over 15-min temporal bin (e.g., 00:00:00-00:15:00) and 5° lat x 5° lon spatial bin (e.g., -90°~ -85° lat and 25°~30° lon).
Click here [TXT] to view the FORTRAN statement to write the required format.
NmF2 from COSMIC in eight 5° geographic longitude sectors
Year DOY Hour Min Sec Lat Lon NmF2[cm-3]
Here DOY is day of year, and NmF2 is maximum electron density at Lat + 2.5 [deg] and Lon + 2.5 [deg]. Lat and Lon are geographic latitude and longitude that correspond to first latitude and first longitude of the bin for measurement data to be compared with. Hour, Min and Sec also correspond to first Hour, Min, and Sec of the temporal bin for measurement data to be compared with.
NmF2 modeled value will be compared with COSMIC NmF2 measurement, which is median value over 15-min temporal bin (e.g., 00:00:00-00:15:00) and 5° lat x 5° lon spatial bin (e.g., -90°~ -85° lat and 25°~30° lon).
Click here [TXT] to view the FORTRAN statement to write the required format.
hmF2 from COSMIC in eight 5° geographic longitude sectors
Year DOY Hour Min Sec Lat Lon hmF2[km] hmF2_a[km] hmF2_b[km]
Here DOY is day of year, and hmF2 is height of maximum electron density at Lat + 2.5 [deg] and Lon + 2.5 [deg]. Lat and Lon are geographic latitude and longitude that correspond to first latitude and first longitude of the bin for measurement data to be compared with. Hour, Min and Sec also correspond to first Hour, Min, and Sec of the temporal bin for measurement data to be compared with.
As optional parameters, hmF2_a and hmF2_b are height of 90% of the maximum electron density above hmF2, and below hmF2, respectively.
hmF2 modeled value will be compared with COSMIC hmF2 measurement, which is median value over 15 min temporal bin (e.g., 00:00:00-00:15:00) and 5° lat x 5° lon spatial bin (e.g., -90°~ -85° lat and 25°~30° lon).
Click here [TXT] to view the FORTRAN statement to write the required format.
Vertical and horizontal drifts at Jicamarca (VperpN and VperpE)
Year DOY Hour Min Sec Lat[deg] Lon[deg] Height[km] VperpN[m/s] VperpE[m/s]
Here DOY is day of year, andVperpN is vertical drift [m/s] and VperpE is horizontal drift [m/s] toward the east at Jicamarca (Lat[deg], Lon[deg]) at 155 km height. Lat and Lon are geographic latitude and longitude.
Neutral density at CHAMP orbit (Nden)
Year DOY Hour Min Sec Lat[deg] Lon[deg] Height[km] Nden[kg/m3]
Here DOY is day of year, andNden is neutral density [kg/m3] at CHAMP position (Lat [deg], Lon [deg], Height [km]. Lat and Lon are geographic latitude and longitude.
Electron density at CHAMP orbit (Eden)
Year DOY Hour Min Sec Lat[deg] Lon[deg] Height[km] Eden[1/cm3]
Here DOY is day of year, andEden is electron density [1/cm3] at CHAMP position (Lat [deg], Lon [deg], Height [km]). Lat and Lon are geographic latitude and longitude.
NmF2 from LEO satellites (CHAMP and COSMIC) and ISRs
Year DOY Hour Min Sec Lat[deg] Lon[deg] NmF2[1/cm3]
Here DOY is day of year, andNmF2 [1/cm3] is maximum electron density from either LEO satellites or ISRs. Lat [deg] and Lon [deg] for NmF2 from ISRs are geographic latitude and longitude of ISRs. For NmF2 from LEO radio occultation measurements, Hour, Min, Sec, Lat [deg] and Lon [deg] are universal time and geographic location at which maximum electron density occurs that are not on the satellite track.
Please see "Available measurements/locations/trajectories" to extract the maximum location and time.
HmF2 from LEO satellites (CHAMP and COSMIC) and ISRs
Year DOY Hour Min Sec Lat[deg] Lon[deg] HmF2[km] HmF2_a[km] HmF2_b[km]
Here DOY is day of year, and HmF2 [km] is height of maximum electron density from LEO satellites or ISRs. HmF2_a and HmF2_b [GIF] are height of 90% of the maximum electron density above HmF2, and below HmF2, respectively. Lat [deg] and Lon [deg] for NmF2 from ISRs are geographic latitude and longitude of ISRs. For NmF2 from LEO radio occultation measurements, Hour, Min, Sec, Lat [deg] and Lon [deg] are universal time and geographic location at which maximum electron density occurs that are not on the satellite track.
![HmF2_a and HmF2_b [GIF]](/static/images/CETI-HmF2.gif){kind=link}
Please see "Available measurements/locations/trajectories" to extract the maximum location and time.
Temperature Tn obtained by Fabry-Perot Spectrometer at 250 km (Arrival height, Antarctica; Resolute Bay, Canada)
Year DOY Hour Min Sec Lat [deg] Lon[deg] Height[km] Tn[K]
Neutral temperature Tn at 250 km height obtained by the Fabry-Perot Spectrometer at Arrival heights, Antarctica (only for E.2005.190 event) and Resolute Bay, Canada (only for E.2006.348 event)
Here DOY is day of year, and Hour, Min, Sec are universal time. Height[km] is 250 km which corresponds to the emission peak for atomic oxygen red line (630 nm). Tn[K] represents neutral temperature in kelvin. There are measurements from 5 observation look directions at Arrival heights the geographic locations (lat, lon) become
- N (-72.60, 166.67)
- W (-77.83, 142.62)
- S (-83.06, 166.67)
- Z (-77.83, 166.67)
- E (-77.83, 190.72).
Also, the geographic locations (lat, lon) from the 5 directions at Resolute Bay are
- N (76.98, -94.89)
- W (74.73, -103.42)
- S (72.48, -94.89)
- Z (74.73, -94.89)
- E (74.73, -86.36)
Lat [deg] and Lon [deg] are geographic location of one of ten geographic locations shown above.
View sample file for Tn from eastward direction (E) at Arrival heights during E.2005.190 event.
Neutral winds obtained by Fabry-Perot Spectrometer at 250 km (Arrival height, Antarctica; Resolute Bay, Canada)
Year DOY Hour Min Sec Lat [deg] Lon[deg] Height[km] Un[m/s] Vn[m/s] Wn[ms]
Here Un[m/s], Vn[m/s], and Wn[m/s] are zonal, meridional , and vertical winds, respectively. Un is positive eastwards, Vn is positive northwards, and Wn is positive upwards.
View sample file for winds from eastward direction at Arrival heights during E.2005.190 event.
Ne at 300 km (Millstone Hill, Sondrestrom, EISCAT, Svalbard ISRs).
Year DOY Hour Min Sec Lat[deg] Lon[deg] Height[km] Ne[1/cm3]
Here DOY is day of year, and Ne is electron density [1/cm3] at 300 km height. Lat [deg] and Lon [deg] are geographic latitude and longitude of ISRs.
Ne at 300 km rom ISRs:
- Millstone Hill(42.62, -71.49),
- Sondrestrom(66.99, -50.95) ,
- EISCAT (69.58, 19.23),
- EISCAT Svalbard (78.1, 16.05)
View sample file for Ne from Millstone Hill ISR during E.2006.348 event.
Te at 300 km (Millstone Hill, Sondrestrom, EISCAT, Svalbard ISRs).
Year DOY Hour Min Sec Lat[deg] Lon[deg] Height[km] Te[K]
Here DOY is day of year, and Te is electron temperature [K] at 300 km height
Te at 300 km rom ISRs:
- Millstone Hill(42.62, -71.49),
- Sondrestrom(66.99, -50.95) ,
- EISCAT (69.58, 19.23),
- EISCAT Svalbard (78.1, 16.05)
View sample file for Te from Millstone Hill ISR during E.2006.348 event.
Ti at 300 km (Millstone Hill, Sondrestrom, EISCAT, Svalbard ISRs).
Year DOY Hour Min Sec Lat[deg] Lon[deg] Height[km] Ti[K]
Here DOY is day of year, and Ti is ion temperature [K] at 300 km height
Ti at 300 rm from ISRs:
- Millstone Hill(42.62, -71.49),
- Sondrestrom(66.99, -50.95) ,
- EISCAT (69.58, 19.23),
- EISCAT Svalbard (78.1, 16.05)
View sample file for Ti from Millstone Hill ISR during E.2006.348 event.
Ion vertical velocity at Sonderstrom ISR
Year DOY Hour Min Sec Lat[deg] Lon[deg] Height[km] Wi[m/s]
Here DOY is day of year, and Wi[m/s] is ion vertical velocity at 300km height.
List of runs for the study performed at the CCMC
| Run Number | Key Words | Model | Model Version | Year | DoY at Start | Start Time | Run Duration [days] | E-field Model |
|---|---|---|---|---|---|---|---|---|
| CCMC_CETIC_060210_IT_1 | CETIC metrics | USU-GAIM | 2.4.3 | 2007 | 79 | 00:00:00 | 3 | -- |
| CCMC_CETIC_052510_IT_3 | CETIC metrics | USU-GAIM | 2.4.3 | 2008 | 59 | 00:00:00 | 5 | -- |
| CCMC_CETIC_052510_IT_2 | CETIC metrics | USU-GAIM | 2.4.3 | 2007 | 142 | 00:00:00 | 5 | -- |
| CCMC_CETIC_052510_IT_1 | CETIC metrics | USU-GAIM | 2.4.3 | 2007 | 91 | 00:00:00 | 3 | -- |
| CCMC_CETIC_052010_IT_1 | CETIC metrics | USU-GAIM | 2.4.3 | 2006 | 348 | 00:00:00 | 3 | -- |
| CCMC_CETIC_051710_IT_1 | CETIC metrics | USU-GAIM | 2.4.3 | 2005 | 241 | 00:00:00 | 4 | -- |
| CCMC_CETIC_E.2008.059 | CETIC metrics | TIE-GCM | 1.92 | 2008 | 59 | 00:00:00 | 3 | Heelis |
| CCMC_CETIC_E.2007.341 | CETIC metrics | TIE-GCM | 1.92 | 2007 | 341 | 00:00:00 | 2 | Heelis |
| CCMC_CETIC_E.2007.190 | CETIC metrics | TIE-GCM | 1.92 | 2007 | 190 | 00:00:00 | 1 | Heelis |
| CCMC_CETIC_E.2007.142 | CETIC metrics | TIE-GCM | 1.92 | 2007 | 142 | 00:00:00 | 3 | Heelis |
| CCMC_CETIC_E.2007.091 | CETIC metrics | TIE-GCM | 1.92 | 2007 | 91 | 00:20:00 | 2 | Heelis |
| CCMC_CETIC_E.2007.079 | CETIC metrics | TIE-GCM | 1.92 | 2007 | 79 | 00:20:00 | 1 | Heelis |
| CCMC_CETIC_E.2006.348 | CETIC metrics | TIE-GCM | 1.92 | 2006 | 348 | 00:20:00 | 3 | Heelis |
| CCMC_CETIC_E.2005.243 | CETIC metrics | TIE-GCM | 1.92 | 2005 | 243 | 00:20:00 | 2 | Heelis |
| CCMC_CETIC_E.2001.243 | CETIC metrics | TIE-GCM | 1.92 | 2001 | 243 | 00:20:00 | 1 | Heelis |
| CCMC_CETIC_053110 | CETIC metrics | CTIP | CTIPe | 2002 | 1 | 00:10:00 | 1440 | Weimer |
| CCMC_CETIC_053010 | CETIC metrics | CTIP | CTIPe | 2002 | 1 | 00:10:00 | 1440 | Weimer |
| CCMC_CETIC_052910 | CETIC metrics | CTIP | CTIPe | 2002 | 1 | 00:10:00 | 1440 | Weimer |
| CCMC_CETIC_052710 | CETIC metrics | CTIP | CTIPe | 2002 | 1 | 00:10:00 | 1440 | Weimer |
| CCMC_CETIC_052610 | CETIC metrics | CTIP | CTIPe | 2002 | 1 | 00:20:00 | 1440 | Weimer |
| CCMC_CETIC_052510 | CETIC metrics | CTIP | CTIPe | 2002 | 1 | 00:10:00 | 1440 | Weimer |
| CCMC_CETIC_052410 | CETIC metrics | CTIP | CTIPe | 2002 | 1 | 00:10:00 | 1440 | Weimer |
View Results via the Time-series Plotting Tool
Status of the Challenge
| Phys. Parameter / Metrics Study | When Initiated | Observational data time series preparation | Database of model results | Paper completion. |
|---|---|---|---|---|
| 1. NmF2 and hmF2 from ISRs, and Vertical drift at Jicamarca | summer 2009 | completed observ. data provided by:for vertical drift - J.L.Chau and D.Andersonfor NmF2 and hMF2 from ISRs - J.Sojka and B.Rideout | completed | doi:10.1029/2011SW000727 |
| 2. Electron and neutral densities at CHAMP orbits, and NmF2 and hmF2 from LEO | summer 2009 | completed observ. data for neutral density at CHAMP orbits provided by E.Sutton | completed | Assessment of the predictive capability of IT models at the Community Coordinated Modeling Center, doi:10.1029/2012SW000851, doi:10.1002/9781118704417.ch13 |
| 3. Thermospheric parameters at 250 km (Tn and Un/Vn/Wn) and ionospheric parameters at 300 km (Ne, Te, Ti, and Wi) | summer 2010 | completed observ. data provided by: for neutral winds and temperatures - Q.Wufor Ne,Te,Ti and Wi at 300 km - by J.Holt | submissions are being accepted | pending |
| 4. Climatology study | summer 2010 | available observ. data provided by:for TEC - A.Coster, L.Goncharenko and Xiaoqing Pifor NmF2 and hmF2 from Cosmic - L.Lomidze and L.Scherliessfor CHAMP Neutral density - E.Suttonfor ion drifts - C/NOFS | available | Discussions were held at GEM mini-workshops 2011-2013, CEDAR Workshops 2012 and 2013 and pre Space Weather 2013 Workshop |
| 5. Global TEC, NmF2 and hmF2 | summer 2011 | available for TEC - A.Coster and L.Goncharenkofor NmF2 and hmF2 from Cosmic - L.Lomidze and L.Schierliess | available | Discussions were held at 2011, 2013 and 2014 GEM mini workshops as well as 2012-2014 CEDAR Workshops. Paper: Shim et al. manuscript was submitted in April, 2017. Further discussions are planned for 2017 CEDAR Workshop. |
| 6. Role of drivers (models for ionosphere potential patterns) (joint with GEM) | summer 2011 | observ. data for AMIE potentials provided by A.Ridley and G.Crowley | submissions are being accepted | Discussions on tools for drivers swap were held at 2011 and 2012 GEM mini workshop, CEDAR Workshop 2012 and 2013 and pre Space Weather 2013 workshop |
| 7. Neutral Densities/Satellite Drag | 2013 | observ. data for neutral density at CHAMP orbits provided by E.SuttonHASDM data provided by B.Bowman | available | E.Kalafatoglu Eyiguler et al., 2013, 2014-1, and 2014-2. Discussions were held at the 2015 CEDAR Workshop |
| 8. Quantification of Storm Impacts: Ionospheric/Thermospheric disturbances | 2013 | available observ. data provided by:for TEC - A.Coster, L.Goncharenko and Xiaoqing Pifor NmF2 and hmF2 from I. Tsagourifor CHAMP Neutral density - E.Sutton | available | Discussions were held at the CEDAR Workshops (2013, 2014, 2016) and at the GEM mini Workshops (2013 , 2016). Further discussions are planned for the 2017 CEDAR Workshop. |
| 9. Regional TEC | 2014 | GPS TEC data provided by A.Coster and L.Goncharenko | available | Discussions were held at the 2015 GEM mini workshop. Further discussions are planned for the 2017 CEDAR Workshop. |
Presentations
Presentations from CEDAR Workshop 2012 (Santa Fe, NM)
- GITM validation studies [PDF], by A. Ridley
Mini-workshop at the Fall AGU 2011 Meeting (San Francisco, CA)
- About CETI ETI Challenge [PDF] poster by Ja Soon Shim
Presentations from GEM-CEDAR Workshop 2011
- Uncertainty Analysis of Model Output [PDF] by R.Schunk
Summer 2010 CEDAR Workshop (Boulder, CO)
- Introduction [PDF] by Masha Kuznetsova
- CEDAR ETI Challenge [PDF] by Ja Soon Shim
- CEDAR ETI Challenge Runs [PDF] by Barbara Emery