GEM Modeling Challenge
Summary
The GEM community has recognized that due to the maturity and the increasing complexity of the state-of-the-art global space weather models, there is a great need for a systematic and quantitative evaluation of different GGCM modeling approaches. In summer 2008 the GGCM Metrics and Validation Focus Group initiated the GGCM modeling Challenge. The goals of the Challenge:
- Evaluate the current state of the space science models and track model improvements over time
- Facilitate interaction between research and operation communities
- Facilitate collaboration among modelers and data providers and research communities.
- Facilitate further model improvement.
The project focuses on various scientific and operational aspects of GGCM model performance and addresses challenges of model-data comparisons and metrics studies (e.g., model output and observational time series preparation for comparison, measurement uncertainty, metrics selection).
Status of the Challenge
Phys. Parameter/Metrics Study | When Initiated | Observ. data time series preparation | Database of model results | Deliverables |
---|---|---|---|---|
1. Magnetic field at geosyn. orbit. | summer 2008 | completed | completed | Rastaetter et al., 2011Pulkkinen et al., 2010 |
2. Magnetopause crossing by geosyn. satellites | summer 2008 | completed, provided by Michelle Thompson | completed | Rastaetter et al, presented at GEM 2013 Summer WorkshopPapers:Rastaetter et al. manuscript in preparation (2017)Collado-Vega et al. manuscript in preparation (2017) |
3. Plasma parameters at geosyn. orbit | summer 2008 | SOPA corrections are required to proceed with the study | pending | pending |
4. Ground magnetic perturbations | summer 2008 | available | completed | Pulkkinen et al., 2009Pulkkinen et al., 2011Rastaetter et al., 2014a base for the operational geospace model validation |
4a. Time derivative of ground magnetic perturbations (Operational geospace model validation) | January 2011 | available | completed | Discussion at GEM 2012 Summer WorkshopPulkkinen et al., 2013Phase I Report on dB/dt Study, submitted to NOAA/SWPC at 2013 Space Weather Workshop |
4b. Regional-K index (Operational geospace model validation | Summer 2012 | completed | completed (Wing Kp results became available in December 2013) | Glocer et al, 2013, presented at 2013 GEM Summer WorkshopPaper: Glocer et al (2016), "Community-wide validation of geospace model localK-index predictions to support model transition tooperations",GEM Focus Group Report: Metrics and Validation (2008-2015) (GEMstone Vol. 27, No1 (2017). |
5. Dst Index | summer 2008 | available | completed | Rastaetter et al., presented at GEM 2011 mini-workshopRastaetter et al., poster at Fall AGU 2011Rastaetter et al., 2013 |
6. Heat flux into ionosphere (joint with CEDAR) | summer 2010 | provided by Liam Kilcommons and Delores Knipp | completed | Rastaetter et al., GEM 2011 mini-workshopRastaetter et al., 2012 (at GEM 2012 Summer Workshop)Discussions were held during the CEDAR June 2012 workshop, the pre-AGU 2012 GEM mini-workshop and the 2013 GEM summer workshop.Presentations at 2015 GEM Summer Workshop: "Systems-Science Tools, Methodologies, and Results (Thursday June 18, 3:30-5:00)"L. Rastaetter, "Modeled Joule heat in the ionosphere compared with DMSP-F15 Poynting flux"D. Knipp: "Estimating Uncertainty in DMSP-F15 Poynting flux"Paper: L. Rastaetter et al. (2016) |
7. Auroral oval (joint with CEDAR) | fall 2010 | Data submissions accepted | Report by C.Lane et al., GEM-CEDAR 2011 mini-workshopDiscussions were held at CEDAR June 2012 workshop, 2016 Joint GEM-CEDAR workshop, and pre-AGU 2012 mini-workshop and 2013 GEM (and CEDAR-GEM) workshops.Paper expected: spring 2018 |
Information about the Study
Prior to submission of your simulation results please review:
Selected Events
- Event 1: October 29th, 2003 06:00 UT - October 30th, 06:00 UT
- Event 2: December 14, 2006 12:00 UT - December 16, 00:00 UT
- Event 3: August 31, 2001 00:00 UT - September 1, 00:00 UT
- Event 4: August 31, 2005 10:00 UT - September 1, 12:00 UT
- Event 5: May 15, 2005 00:00 UT - May 16, 2005, 00:00 UT (for metric study 6)
- Event 6: July 9, 2005 00:00 UT - July 12, 2005, 00:00 UT (for metric study 6)
- Event 7: April 5, 2010 00:00 UT - April 6, 2010, 00:00 UT
- Event 8: August 5, 2011 09:00 UT - August 6, 2011, 09:00 UT
Selected Studies
- Metric Study 1: Magnetic field at geosynchronous orbit (GOES)
- Metric Study 2: Magnetopause crossings by geosynchronous satellite (GOES and LANL)
- Metric Study 3: Plasma density/temperature at geosynchronous orbit (LANL)
- Metric Study 4: Ground magnetic perturbations (ground based magnetometers) delta B
- Metric Study 4a: Ground magnetic perturbations (ground based magnetometers) dB/dt
- Metric Study 5: Dst index (added at the GEM 2009 summer workshop)
- Metric Study 6: Poynting Flux (added at the GEM 2010 summer workshop)
- Metric Study 7: Auroral Oval (added at the mini-workshop at the Fall 2010 AGU)
Satellite Trajectories
List of satellite trajectories to be used for the Geosynchronous Orbit Metrics (Metrics 1-3)
Satellite trajectories downloaded from SSCweb, original format with 3-minute interval
Event 1: October 29th, 2003 06:00 UT - October 30th, 06:00 UT
GOES_10 [TXT], GOES_12 [TXT],
LANL-90 [TXT], LANL-91 [TXT], LANL-94 [TXT], LANL-97 [TXT], LANL-01 [TXT], LANL-02 [TXT]
Event 2: December 14, 2006 12 UT - December 16, 00 UT
GOES_11 [TXT], GOES_12 [TXT],
LANL-89 [TXT], LANL-94 [TXT], LANL-97 [TXT], LANL-01 [TXT], LANL-02 [TXT]
Event 3: August 31, 2001 00 UT - September 1, 00 UT
GOES_8 [TXT], GOES_10 [TXT],
LANL-90 [TXT], LANL-94 [TXT], LANL-97 [TXT], LANL-01 [TXT]
Event 4: August 31, 2005 10:00 UT - September 1, 12:00 UT
GOES_10 [TXT], GOES_12 [TXT],
LANL-90 [TXT], LANL-94 [TXT], LANL-97 [TXT], LANL-01 [TXT], LANL-02 [TXT]
Groundbased Stations
Groundbased Station (Station name GemagLat GeomagLon)
YKC 68.93 299.36
MEA 61.57 306.20
NEW 54.85 304.68
FRN 43.52 305.25
IQA 73.98 5.24
PBQ 65.46 351.81
OTT 55.63 355.31
FRD 48.4 353.38
HRN 73.88 125.99
ABK 66.06 114.66
WNG 54.12 95.0
FUR 48.38 94.61
*HRN is missing for the August 31, 2001 event.
*IQA is missing for the August 31, 2005 event.
*Small data gaps do exist for some of the stations for some of the events.
Model Output File Format
Model output files should be in ASCII text format. Each file size should not exceed 1Mb. Full path name to the input file at your local disk should not contain any blank spaces or quotation marks. On DOS/Windows systems the recommended extension for the input file name is "txt".
The following file formats for model outputs for different physical parameters studies are expected:
Magnetic field at geosynchronous orbit
Year Month Day Hour Min Sec XGSE[Re] YGSE[Re] ZGSE[Re] BXGSE[nT] BYGSE[nT] BZGSE[nT]
Here BXGSE[nT] BYGSE[nT] BZGSE[nT] are magnetic field components at GOES position (XGSE[Re] YGSE[Re] ZGSE[Re] ) in GSE coordinates.
Ground magnetic perturbations
Year Month Day Hour Min Sec GeomagLat [deg] GeomagLon[deg] B_NorthGeomag[nT], B_EastGeomag[nT], B_DownGeomag[nT]
Here B_NorthGeomag[nT], B_EastGeomag[nT], B_DownGeomag[nT] are components of magnetic field perturbation (north, east, down) at ground station location (Geomagnetic Latitude, Geomagnetic Longitude). Please note that Geomagnetic Dipole Coordinates (Hapgood, 1992) are used.
References M.A. Hapgood, Space physics coordinate transformations: A user guide // Planet. Space Sci. 1992. V. 40, P. 711-717.
DST index
Year Month Day Hour Min Sec Dst[nT]
Auroral oval position (high latitude boundary)
Year Month Day Hour Min Sec Colat01[deg] Colat02[deg] Colat03[deg] Colat04[deg] Colat05[deg] Colat06[deg] Colat07[deg] Colat08[deg] Colat09[deg] Colat10[deg] Colat11[deg] Colat12[deg] Colat13[deg] Colat14[deg] Colat15[deg] Colat16[deg] Colat17[deg] Colat18[deg] Colat19[deg] Colat20[deg] Colat21[deg] Colat22[deg] Colat23[deg]
Here Colat00 - magnetic colatitude for magnetic local time 0, ColatHH - magnetic colatitude for magnetic local time HH [hours]
Auroral oval position (low latitude boundary)
Year Month Day Hour Min Sec Colat01[deg] Colat02[deg] Colat03[deg] Colat04[deg] Colat05[deg] Colat06[deg] Colat07[deg] Colat08[deg] Colat09[deg] Colat10[deg] Colat11[deg] Colat12[deg] Colat13[deg] Colat14[deg] Colat15[deg] Colat16[deg] Colat17[deg] Colat18[deg] Colat19[deg] Colat20[deg] Colat21[deg] Colat22[deg] Colat23[deg]
Here Colat00 - magnetic colatitude for magnetic local time 0, ColatHH - magnetic colatitude for magnetic local time HH [hours]
Poynting flux (Joule heating) into ionosphere along DMSP tracks
Year Month Day Hour Min Sec Mlat[deg] MLT[decimal hours] Sz[mW/m2]
Here MLAT: Corrected Geomagnetic Latitude [degrees], MLT: Magnetic Local Time [decimal hours] Sz: Height Integrated Joule Heating [mW/m2]
Plasma Velocity (Vx - along track, Vy cross track, Vz - vertical)
Year Month Day Hour Min Sec Mlat[deg] MLT[decimal hours] Vx[m/s] Vy[m/s] Vz[m/s]
Here MLAT: Corrected Geomagnetic Latitude [degrees], MLT: Magnetic Local Time [decimal hours], V: plasma velocity
Cross polar cap potential (northern and southern hemisphere)
Year Month Day Hour Min Sec CPCP_North (eV) CPCP_South (eV)
Joule heating (or Poynting flux) integrated over each hemisphere in GW.
Year Month Day Hour Min Sec JH_N [GW] JH_S[GW]
Solar Wind Input
Comments on Solar Wind (SW) Data Availability
For Event 2, Event 3, Event 4 verified solar wind (SW) data (Level 2) are available at the ACE science center.
Click HERE to generate SW input data file with magnetic (ACE MAG) and plasma data (ACE SWEPAM) interpolated on 1 minute temporal grid using CCMC on-line tool. The CCMC SW input file generation tool allows to project data from the ACE position to the simulation box inflow boundary and/or to add a time shift. SW parameters in the generated input data file are provided in the following order:
Year Month Day Hour Min Sec Msec BXGSM[nT] BYGSM[nT] BZGSM[nT] VXGSM[km/s] VYGSM[km/s] VZGSM[km/s] N[cm^(-3)] T[Kelvin]
For Event 1 there were problems with ACE plasma instrument (SWEPAM). Click HERE [TXT] to download solar wind input file prepared by Aaron Ridley. SW parameters are provided in the following order:
Year Month Day Hour Min Sec Msec BXGSE[nT] BYGSE[nT] BZGSE[nT] VXGSE[km/s] VYGSE[km/s] VZGSE[km/s] N[cm^(-3)] T[Kelvin] .
Magnetic field components ( BXGSE, BYGSE, BZGSE) are from ACE MAG, velocity components (VXGSE, VZGSE, VZGSE) and temperature (T) are from ACE SWEPAM, and density (N) is from the Geotail plasma wave experiment. The data are projected to Xgse = 32 Re.
Simulation results analysis tools
View Results via the Time-series Plotting Tool
Metrics Study 1 | Metrics Study 2 | Metrics Study 3 | Metrics Study 4 | Metrics Study 5 | |
---|---|---|---|---|---|
Event 1 | GOES12 GOES10 | LANL-02A LANL-01A LANL-97A LANL-1994 LANL-1991 LANL-1990 GOES12 GOES10 | LANL-02A LANL-01A LANL-97A LANL-1994 LANL-1991 LANL-1990 | YKC MEA NEW FRN IQA PBQ OTT FRD HRN ABK WNG FUR | KYOTO USGS |
Event 2 | GOES12 GOES11 | LANL-02A LANL-01A LANL-97A LANL-1994 LANL-1989 GOES12 GOES11 | LANL-02A LANL-01A LANL-97A LANL-1994 LANL-1989 | YKC MEA NEW FRN IQA PBQ OTT FRD HRN ABK WNG FUR | KYOTO USGS |
Event 3 | GOES10 GOES08 | LANL-01A LANL-97A LANL-1994 LANL-1990 GOES10 GOES08 | LANL-01A LANL-97A LANL-1994 LANL-1990 | YKC MEA NEW FRN IQA PBQ OTT FRD ABK WNG FUR | KYOTO USGS |
Event 4 | GOES12 GOES10 | LANL-02A LANL-01A LANL-97A LANL-1994 LANL-1990 GOES12 GOES10 | LANL-02A LANL-01A LANL-97A LANL-1994 LANL-1990 | YKC MEA NEW FRN PBQ OTT FRD HRN ABK WNG FUR | KYOTO USGS |
List of Runs for the study performed at the CCMC
Run Number | Key Words | Model | Model Version | Event Date | Start Time | End Time | Grid | Coordinate System for Input | Coordinate System for Output | Dipole Tilt (in the X-Z Plane) at Start deg | Dipole Tilt in Y-Z GSE plane) deg | Update Dipole Orientation with Time | Inflow Boundary (IB) RE | F10.7 | Conductance Model | Corotation |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
SWPC_SWMF_070914_2 | Event 2 | SWMF | v20110131 | December 14, 2006 | 2006/12/14 07:00 | 2006/12/16 00:00 | -- | GSM | GSM | -31.83 | -10.10 | yes | 32 | 91.00000 | auroral | real |
SWPC_SWMF_061214_2a | Event 2 | SWMF | v20140611 | December 14, 2006 | 2006/12/14 07:00 | 2006/12/16 00:00 | -- | GSM | GSM | -31.83 | -10.10 | yes | 32 | 91.00000 | auroral | real |
SWPC_LFM-MIX_082813_2a | rerun of 2_LFM-MIX | LFM | LTR-2_1_5 | December 14, 2006 | 2006/12/14 12:00 | 2006/12/16 00:00 | 53x48x64 cells | GSM | SM | -20.04 | -13.46 | yes | -- | 91.00000 | auroral | real |
SWPC_LFM-MIX-TIEGCM_082813_2 | rerun of 2_CMIT | LFM | LTR-2_1_1 | December 14, 2006 | 2006/12/14 12:00 | 2006/12/16 00:00 | 53x48x64 cells | GSM | SM | -20.04 | -13.46 | yes | 30 | 91.00000 | auroral | real |
SWPC_LFM-MIX_082813_2 | rerun of 2_CMIT | LFM | LTR-2_1_1 | December 14, 2006 | 2006/12/14 12:00 | 2006/12/16 00:00 | 53x48x64 cells | GSM | SM | -20.04 | -13.46 | yes | 30 | 91.00000 | auroral | real |
SWPC_LFM-MIX_082813_2b | rerun of 2_LFM-MIX | LFM | LTR-2_1_1 | December 14, 2006 | 2006/12/14 12:00 | 2006/12/16 00:00 | 53x48x64 cells | GSM | SM | -20.04 | -13.46 | yes | -- | 91.00000 | auroral | real |
SWPC_LFM-MIX_010213_1 | SWPC 2011 Challenge | LFM | LTR-2_1_5 | August 31, 2005 | 2005/08/31 10:00 | 2005/09/01 12:00 | 53x48x64 cells | GSM | SM | 7.41 | -31.97 | yes | 30 | 86.00000 | auroral | real |
SWPC_LFM-MIX-TIEGCM_030512_8 | dB/dt R2O Challenge 2011 August 5-6, 2011 | LFM | LTR-2_1_5 | August 05, 2011 | 2011/08/05 06:00 | 2011/08/06 12:00 | 53x48x64 cells | GSM | SM | -7.97 | 19.08 | yes | -- | 113.00000 | TIEGCM | real |
SWPC_LFM_030512_8 | dB/dt R2O Challenge 2011 August 5-6, 2011 | LFM | LTR-2_1_1 | August 05, 2011 | 2011/08/05 06:00 | 2011/08/06 12:00 | 53x48x64 cells | GSM | SM | -7.97 | 19.08 | yes | 30 | 113.00000 | auroral | real |
SWPC_LFM_030512_7 | dB/dt R2O Challenge 2012 April 5, 2010 | LFM | LTR-2_1_1 | April 04, 2010 | 2010/04/04 21:00 | 2010/04/06 00:00 | 53x48x64 cells | GSM | SM | -16.11 | -28.17 | yes | 30 | 79.00000 | auroral | real |
SWPC_LFM-MIX-TIEGCM_030512_7 | April 5, 2010 | LFM | LTR-2_1_4 | April 04, 2010 | 2010/04/04 21:00 | 2010/04/06 00:00 | 53x48x64 cells | GSM | SM | 12.27 | 31.67 | yes | 30 | 79.00000 | TIEGCM | real |
SWPC_OpenGGCM_022712_8 | dB/dt R2O Challenge 2012 | OpenGGCM | 4.0 | August 05, 2011 | 2011/08/05 06:00 | 2011/08/06 12:00 | 3M cells | GSM | GSE | 7.97 | -19.08 | yes | 30 | 113.00000 | Sig-CTIM | real |
SWPC_SWMF_022512_8 | dB/dt R2O Challenge 2011 August 05, 2011 | SWMF | v20110131 | August 05, 2011 | 2011/08/05 04:00 | 2011/08/06 09:00 | 1M cells | GSM | GSM | -7.68 | 13.92 | yes | 32 | 113.00000 | auroral | real |
SWPC_SWMF_022512_7 | dB/dt R2O Challenge 2011 April 05, 2010, SSW16 | SWMF | v20110131 | April 05, 2010 | 2010/04/04 19.00 | 2010/04/06 00:00 | 1M cells | GSM | GSM | -16.11 | -28.17 | yes | 32 | 79.00000 | auroral | real |
SWPC_SWMF_060411_6 | SWPC Challenge 2011 | SWMF | v20110131_ | May 14 2005 | 2005/05/14 19:00 | 2005/05/18 19:00 | 1M cells | GSM | GSM | 29.50 | 21.40 | yes | 32 | 110.00000 | auroral | yes |
SWPC_SWMF_060411_5a | SWPC Challenge 2011 | SWMF | v20110131_ | May 14 2005 | 2005/05/14 19:00 | 2005/05/16 00:00 | 2M cells | GSM | GSM | 29.50 | 21.40 | yes | 32 | 102.00000 | auroral | yes |
SWPC_SWMF_060411_5 | SWPC Challenge 2011 | SWMF | v20110131 | May 14 2005 | 2005/05/14 19:00 | 2005/05/16 00:00 | 1M cells | GSM | GSM | 29.50 | 21.40 | yes | 32 | 102.00000 | auroral | yes |
SWPC_SWMF_052811_2 | dB/dt R2O Challenge 2011 | SWMF | v20110131 | December 14 2006 | 2006/12/14 07:00 | 2006/12/16 00:00 | 1M cells | GSM | GSM | -32.50 | -10.90 | yes | 32 | 91.00000 | auroral | yes |
SWPC_SWMF_052811_4 | dB/dt R2O Challenge 2011 | SWMF | v20110131 | August 31 2005 | 2005/08/31 05:00 | 2005/09/01 12:00 | 1M cells | GSM | GSM | -2.60 | -22.60 | yes | 32 | 86.00000 | auroral | yes |
SWPC_SWMF_052811_3 | dB/dt R2O Challenge 2011 | SWMF | v20110131 | August 30 2001 | 2001/08/30 19:00 | 2001/09/01 00:00 | 1M cells | GSM | GSM | 18.50 | -15.40 | yes | 32 | 203.00000 | auroral | yes |
SWPC_CMIT-LFM-MIX_031711_2 | dB/dt R2O Challenge 2011 | LFM | LTR-2_1_1 | December 14 2006 | 2006/12/14 12:00 | 2006/12/16 00:00 | 53x48x64 | GSM | SM | 0.00 | 0.00 | yes | 30 | 99.00000 | auroral | yes |
SWPC_CMIT-LFM-MIX-TIEGCM_031711_2 | dB/dt Challenge test runs 2011 | LFM | LTR-2_1_1 | December 14 2006 | 2006/12/14 12:00 | 2006/12/16 00:00 | 53x48x64 | GSM | SM | 0.00 | 0.00 | yes | 30 | 99.00000 | auroral | real |
SWPC_CMIT-LFM-MIX_031711_1 | dB/dt R2O Challenge 2011 | LFM | LTR-2_1_1 | October 29 2003 | 2003/10/29 01:00 | 2003/10/30 06:00 | 53x48x64 | GSM | SM | 0.00 | 0.00 | yes | 30 | 275.00000 | auroral | yes |
SWPC_CMIT-LFM-MIX_031711_4 | dB/dt R2O Challenge 2011 | LFM | LTR-2_1_1 | August 31 2005 | 2005/08/31 10:00 | 2005/09/01 12:00 | 53x48x64 | GSM | SM | 0.00 | 0.00 | yes | 30 | 86.00000 | auroral | yes |
SWPC_CMIT-LFM-MIX-TIEGCM_031711_4 | dB/dt Challenge test runs 2011 | LFM | LTR-2_1_1 | August 31 2005 | 2005/08/31 10:00 | 2005/09/01 12:00 | 53x48x64 | GSM | SM | 0.00 | 0.00 | yes | 30 | 86.00000 | auroral | yes |
SWPC_CMIT-LFM-MIX_031711_3 | dB/dt R2O Challenge 2011 | LFM | LTR-2_1_1 | August 31 2001 | 2001/08/31 00:00 | 2001/09/01 00:00 | 53x48x64 | GSM | SM | 0.00 | 0.00 | yes | 30 | 192.00000 | auroral | yes |
SWPC_CMIT-LFM-MIX-TIEGCM_031711_3 | dB/dt Challenge test runs 2011 | LFM | LTR-2_1_1 | August 31 2005 | 2001/08/31 00:00 | 2001/09/01 00:00 | 53x48x64 | GSM | SM | 0.00 | 0.00 | yes | 30 | 86.00000 | auroral | yes |
SWPC_CMIT-LFM-MIX-TIEGCM_031711_1 | SWPC GEM Challenge | LFM | LTR-2_1_4 | -- | 2003/10/29 01:00 | 2003/10/30 06:00 | 53x48x64-24 | GSM | SM | 0.00 | 0.00 | no | -- | 275.00000 | TIEGCM | real |
SWPC_OpenGGCM_031111_2 | dB/dt R2O Challenge 2011 | OpenGGCM | 4.0 | December 14 2006 | 2006/12/14 07:00 | 2006/12/16 00:00 | 3M cells | GSM | GSE | -20.20 | -10.20 | yes | 30 | 275.00000 | Sig-CTIM | no |
SWPC_OpenGGCM_031111_3 | dB/dt R2O Challenge 2011 | OpenGGCM | 4.0 | August 30 2001 | 2001/08/30 19:00 | 2001/09/01 00:00 | 3M cells | GSM | GSE | 18.50 | -15.40 | yes | 30 | 203.00000 | Sig-CTIM | no |
SWPC_OpenGGCM_031111_4 | dB/dt R2O Challenge 2011 | OpenGGCM | 4.0 | August 31 2005 | 2005/08/30 19:00 | 2005/09/01 12:00 | 3M cells | GSM | GSE | -2.60 | -22.60 | yes | 30 | 86.00000 | Sig-CTIM | no |
SWPC_OpenGGCM_031111_1 | dB/dt R2O Challenge 2011 | OpenGGCM | 4.0 | October 29 2003 | 2003/10/29 01:00 | 2003/10/30 06:00 | 3M cells | GSM | GSE | -20.20 | -10.20 | yes | 30 | 275.00000 | Sig-CTIM | no |
SWPC_SWMF_030311_1 | tbd | SWMF | v20110131 | October 29 2003 | 2003/10/29 01:00 | 2003/10/30 06:00 | 1M cells | GSM | GSM | -20.20 | -10.20 | yes | 32 | 275.00000 | auroral | yes |
SWPC_SWMF_030311_1a | dB/dt R2O Challenge 2011, SSW16 | SWMF | v20110131 | October 29 2003 | 2003/10/29 01:00 | 2003/10/30 06:00 | 1M cells | GSM | GSM | -20.20 | -10.20 | yes | 32 | 275.00000 | auroral | yes |
SWPC_SWMF_030311_1b | tbd | SWMF | v20110131 | October 29 2003 | 2003/10/29 01:00 | 2003/10/30 06:00 | 1M cells | GSM | GSM | -20.20 | -10.20 | yes | 32 | 275.00000 | auroral | yes |
GEM_PFlux_121510_3 | GEM Challenge | OpenGGCM | 3.1 | July 09 2005 | 2005/07/09 00:00 | 2005/07/12 00:00 | 5M Low Mach number | GSE | GSE | 18.70 | 4.00 | no | 24 | 110.00000 | Sig-CTIM | no |
GEM_PFlux_091510_1 | GEM Challenge | BATSRUS | v8.01 | July 9 2005 | 2005/07/09 00:00 | 2005/07/12 00:00 | 2M cells | GSM | GSM | 18.70 | 4.00 | yes | 33 | 110.00000 | auroral | yes |
GEM_PFlux_081910_3d | GEM Challenge | OpenGGCM | 3.1 | May 15 2005 | 2005/05/15 00:00 | 2005/05/16 00:00 | 8M Low Mach number grid | GSE | GSE | 16.20 | 25.00 | no | 60 | 105.00000 | Sig-CTIM | no |
GEM_PFlux_081910_2a | GEM Challenge; run in progress | BATSRUS with RCM | v20101108 | May 15 2005 | 2005/05/15 00:00 | 2005/05/16 00:00 | 2M cells | GSM | GSM | 16.20 | 25.00 | yes | 33 | 105.00000 | auroral | yes |
GEM_PFlux_081910_1a | GEM Challenge | BATSRUS | v8.01 | May 15 2005 | 2005/05/15 18:00 | 2005/05/16 00:00 | 2M cells | GSM | GSM | 16.20 | 25.00 | yes | 57 | 105.00000 | auroral | yes |
GEM_PFlux_081910_1 | GEM Challenge | BATSRUS | v8.01 | May 15 2005 | 2005/05/15 00:00 | 2005/05/16 00:00 | 2M cells | GSM | GSM | 16.20 | 25.00 | yes | 33 | 105.00000 | auroral | yes |
Ilja_Honkonen_100116_1 | GEM 2008 Metrics Challenge | BATSRUS with RCM | v8.01 | -- | 2003/10/29 06:00 | 2003/10/29 07:00 | high-resolution grid with_1,958,688_cells | GSM | GSM | -25.40 | -24.10 | yes | -- | 275.40000 | auroral | real |
CCMC_CCMC_081309_2 | GEM 2008 Metrics Challenge | OpenGGCM | 3.1 | December 14 2006 | 2006/12/14 11:30 | 2006/12/16 00:00 | -- | GSM | GSE | -12.10 | -3.60 | no | 24 | 90.00000 | Sig-CTIM | no |
CCMC_CCMC_081109_2 | GEM 2008 Metrics Challenge | OpenGGCM | 3.1 | December 14 2006 | 2006/12/14 11:30 | 2006/12/16 00:00 | -- | GSM | GSE | -21.00 | -14.80 | no | 24 | 90.00000 | Sig-CTIM | no |
CCMC_CCMC_040209_2 | GEM 2008 Metrics Challenge | BATSRUS with RCM | v8.01 | December 14 2006 | 2006/12/14 12:00 | 2006/12/16 00:00 | 700K cells | GSM | GSM | -19.60 | -14.30 | yes | 33 | 90.00000 | auroral | yes |
CCMC_CCMC_040209_4 | GEM 2008 Metrics Challenge | BATSRUS with RCM | v8.01 | August 31 2005 | 2005/08/31 10:00 | 2005/09/01 12:00 | 700K cells | GSM | GSM | 7.40 | -32.80 | yes | 33 | 85.00000 | auroral | yes |
CCMC_CCMC_040209_3 | GEM 2008 Metrics Challenge | BATSRUS with RCM | v8.01 | August 31 2001 | 2001/08/31 00:00 | 2001/09/01 00:00 | 700K cells | GSM | GSM | 5.10 | -11.30 | yes | 33 | 192.00000 | auroral | yes |
CCMC_CCMC_040209_2a | GEM 2008 Metrics Challenge | BATSRUS with RCM | v8.01 | December 14 2006 | 2006/12/14 12:00 | 2006/12/16 00:00 | 700K cells | GSM | GSM | -19.60 | -14.30 | yes | 33 | 90.00000 | auroral | yes |
CCMC_CCMC_040209_1 | GEM 2008 Metrics Challenge | BATSRUS with RCM | v8.01 | October 29 2003 | 2003/10/29 06:00 | 2003/10/30 06:00 | 700K cells | GSM | GSM | -25.40 | -24.10 | yes | 33 | 275.00000 | auroral | yes |
CCMC_CCMC_123008_4 | GEM 2008 Metrics Challenge | OpenGGCM | 3.1 | August 31 2005 | 2005/08/31 10:00 | 2005/09/01 12:00 | 6.5M overview | GSM | GSE | -9.80 | -22.80 | no | 24 | 85.00000 | Sig-CTIM | no |
CCMC_CCMC_123008_3a | GEM 2008 Metrics Challenge | OpenGGCM | 3.1 | August 31 2001 | 2001/08/31 00:00 | 2001/09/01 00:00 | 6.5M overview | GSM | GSE | -10.50 | 9.10 | no | 24 | 192.00000 | Sig-CTIM | no |
CCMC_CCMC_123008_2 | GEM 2008 Metrics Challenge | OpenGGCM | 3.1 | December 14 2006 | 2006/12/14 12:00 | 2006/12/16 00:00 | 6.5 M cells | GSM | GSE | -12.10 | -3.60 | no | 24 | 90.00000 | Sig-CTIM | no |
CCMC_CCMC_123008_1 | GEM 2008 Metrics Challenge | OpenGGCM | 3.1 | October 29 2003 | 2003/10/29 06:00 | 2003/10/30 06:00 | 6.5 M cells | GSM | GSE | -2.50 | -19.30 | no | 24 | 275.00000 | Sig-CTIM | no |
CCMC_CCMC_123008_3 | GEM 2008 Metrics Challenge | OpenGGCM | 3.1 | August 31 2001 | 2001/08/31 00:00 | 2001/09/01 00:00 | 6.5M overview | GSM | GSE | -10.50 | 9.10 | no | 24 | 192.00000 | Sig-CTIM | no |
CCMC_CCMC_122408_1 | GEM 2008 Metrics Challenge | BATSRUS | v8.01 | October 29 2003 | 2003/10/29 06:00 | 2003/10/30 06:00 | 3mln, max res 0.125 | GSM | GSM | -25.40 | -24.10 | yes | 33 | 275.00000 | auroral | yes |
CCMC_CCMC_122408_2 | GEM 2008 Metrics Challenge | BATSRUS | v8.01 | December 14 2006 | 2006/12/14 12:00 | 2006/12/16 00:00 | 3mln, max res 0.125 | GSM | GSM | -19.60 | -14.30 | yes | 33 | 90.00000 | auroral | yes |
CCMC_CCMC_122408_3 | GEM 2008 Metrics Challenge | BATSRUS | v8.01 | August 31 2001 | 2001/08/31 00:00 | 2001/09/01 00:00 | 3mln, max res 0.125 | GSM | GSM | 5.10 | -11.30 | yes | 33 | 192.00000 | auroral | yes |
CCMC_CCMC_122408_4 | GEM 2008 Metrics Challenge | BATSRUS | v8.01 | August 31 2005 | 2005/08/31 10:00 | 2005/09/01 12:00 | 3mln, max res 0.125 | GSM | GSM | 7.40 | -32.80 | yes | 33 | 85.00000 | auroral | yes |
CCMC_CCMC_102708_1 | GEM 2008 Metrics Challenge | BATSRUS with RCM | v8.01 | October 29 2003 | 2003/10/29 06:00 | 2003/10/30 06:00 | 2M cells | GSM | GSM | -25.40 | -24.10 | yes | 33 | 275.00000 | auroral | yes |
CCMC_CCMC_090208_1b | GEM 2008 Metrics Challenge | OpenGGCM | 3.1 | August 31 2001 | 2001/08/31 00:00 | 2001/09/01 00:00 | 3M cells | GSM | GSE | -10.50 | 9.10 | no | 24 | 192.00000 | Sig-CTIM | no |
CCMC_CCMC_082908_2b | GEM 2008 Metrics Challenge | OpenGGCM | 3.1 | August 31 2005 | 2005/08/31 09:30 | 2005/09/01 12:00 | 3M cells | GSM | GSE | -9.80 | -22.80 | no | 24 | 85.00000 | Sig-CTIM | no |
CCMC_CCMC_102708_3 | GEM 2008 Metrics Challenge | BATSRUS with RCM | v8.01 | August 31 2001 | 2001/08/31 00:00 | 2001/09/01 00:00 | 2M cells | GSM | GSM | 5.10 | -11.30 | yes | 33 | 192.00000 | auroral | yes |
CCMC_CCMC_082908_3a | GEM 2008 Metrics Challenge | BATSRUS | v7.73 | August 31 2001 | 2001/08/31 00:00 | 2001/09/01 00:00 | 700K cells | GSM | GSM | 5.10 | -11.30 | yes | 33 | 192.00000 | auroral | yes |
CCMC_CCMC_082908_1b | GEM 2008 Metrics Challenge | OpenGGCM | 3.1 | December 14 2006 | 2006/12/14 11:30 | 2006/12/16 00:00 | 3M cells | GSM | GSE | -12.10 | -3.60 | no | 24 | 90.00000 | Sig-CTIM | no |
CCMC_CCMC_082908_3 | GEM 2008 Metrics Challenge | BATSRUS | v7.73 | August 31 2001 | 2001/08/31 00:00 | 2001/09/01 00:00 | 2M cells | GSM | GSM | 5.10 | -11.30 | yes | 33 | 192.00000 | auroral | yes |
CCMC_CCMC_102708_4 | GEM 2008 Metrics Challenge | BATSRUS with RCM | v8.01 | August 31 2005 | 2005/08/31 09:30 | 2005/09/01 12:00 | 2M cells | GSM | GSM | 5.80 | -32.40 | yes | 33 | 85.00000 | auroral | yes |
CCMC_CCMC_102708_2 | GEM 2008 Metrics Challenge | BATSRUS with RCM | v8.01 | December 14 2006 | 2006/12/14 11:30 | 2006/12/16 00:00 | 2M cells | GSM | GSM | -21.00 | -14.80 | yes | 33 | 90.00000 | auroral | yes |
CCMC_CCMC_082808_4a | GEM 2008 Metrics Challenge | BATSRUS | v7.73 | August 31 2005 | 2005/08/31 09:30 | 2005/09/01 12:00 | 700K cells | GSM | GSM | 5.80 | -32.40 | yes | 33 | 85.00000 | auroral | yes |
CCMC_CCMC_082808_3 | GEM 2008 Metrics Challenge | BATSRUS | v7.73 | December 14 2006 | 2006/12/14 11:30 | 2006/12/16 00:00 | 2M cells | GSM | GSM | -21.00 | -14.80 | yes | 33 | 90.00000 | auroral | yes |
CCMC_CCMC_082808_3a | GEM 2008 Metrics Challenge | BATSRUS | v7.73 | December 14 2006 | 2006/12/14 11:30 | 2006/12/16 00:00 | 700K cells | GSM | GSM | -21.00 | -14.80 | yes | 33 | 90.00000 | auroral | yes |
CCMC_CCMC_082808_4 | GEM 2008 Metrics Challenge | BATSRUS | v7.73 | August 31 2005 | 2005/08/31 09:30 | 2005/09/01 12:00 | 2M cells | GSM | GSM | 5.80 | -32.40 | yes | 33 | 85.00000 | auroral | yes |
CCMC_CCMC_082808_2b | GEM 2008 Metrics Challenge | OpenGGCM | 3.1 | October 29 2003 | 2003/10/29 06:00 | 2003/10/30 06:00 | 3M cells | GSM | GSE | -2.50 | -19.30 | no | 33 | 275.00000 | Sig-CTIM | no |
ccmc_ccmc_082208_1 | GEM 2008 Metrics Challenge | BATSRUS | v7.73 | October 29 2003 | 2003/10/29 06:00 | 2003/10/30 06:00 | 700K cells | GSM | GSM | -25.40 | -24.10 | yes | 33 | 275.00000 | auroral | yes |
ccmc_ccmc_082208_1a | GEM 2008 Metrics Challenge | BATSRUS | v7.73 | October 29 2003 | 2003/10/29 06:00 | 2003/10/30 06:00 | 2M cells | GSM | GSM | -25.40 | -24.10 | yes | 33 | 275.00000 | auroral | yes |
SWPC_OpenGGCM_022712_7 | dB/dt R2O Challenge 2012 | OpenGGCM | 4.0 | April 04, 2010 | 2010/04/04 21:00 | 2010/04/06 00:00 | 3M cells | GSM | GSE | 16.11 | 28.17 | yes | 30 | 79.00000 | Sig-CTIM | real |
Presentations
GEM Metrics and Validation focus group PROPOSAL for 2011-2015 extension [PDF]
Presentations from GEM 2013 Summer Workshop (Snowmass, CO)
Session 1: New Validation Results and Methods
- Initial result from LFM RCM for Oct 2012 Storm, Frank Toffoletto
- dB/dt study (MHD and empirical) results / discussion [PowerPoint], Lutz Rastaetter and Howard Singer
- Climatological analysis of 12 months of MHD simulated ground magnetometer measurements, Victoir Veibell and Bob Weigel (presented by Tim Guild)
- GUMICS-4 verification and footprint determination using static and dynamic global MHD simulations of the ECLAT project, Gabor Facsko
- Climatological Validation of the HEIDI Ring Current Model, Roxanne Katus and Michael Liemohn
- Statistical maps of TIMED/GUVI auroral emissions as a new global MHD validation data source, Haje Korth
- Metrics derived from multi-variate statistical distributions, Josh Rigler
Session 2: How Validation Studies Guide Model Improvements
- Session Intro and Comments on Ensemble Modeling, Howard Singer
- Multi-Model Validation with the Space Weather Modeling Framework, Dan Welling
- The effect of uncertain boundary conditions on ring current model validation, Margaret Chen
- Large-scale flow vortices following a magnetospheric sudden impulse (Simulations were done with SWMF, OpenGGCM and LFM.), Andrey Samsonov
- Lessons from MHD-AMPERE comparisons, Slava Merkin
Session 3: Validation of MHD models coupled with other modules such as the Ring Current and Polar Outflow
- OpenGGCM - RCM validations, Joachim Raeder (co-authors Gilson & Toffoletto)
- Coupling of SWMF magnetosphere and Heidi Ring Current, Raluca Ilie
- Validation of MFLFM Outflow Simulations, Michael Wiltberger
- All: Discussion on future Metrics and Validation Activities to Support GEM goals
Presentations from GEM 2012 Summer Workshop (Snowmass, CO)
Operational geospace model validation I: Evaluating geospace models ability to forecast time-derivative of ground magnetic perturbations dB/dt.
- dB/dt metrics results [PDF], A. Pulkkinen
- Discussion: Report/paper preparation. Next steps.
Operational geospace model validation II: Geomagnetic activity index
- Discussions: How to derive geomagnetic activity index from model outputs. Metrics format selection
GGCM Metrics Challenges status
- Auroral Oval Boundaries [PDF], Y. Zheng
- Joule heating into Ionosphere [PDF], L. Rastaetter
- GEM-CEDAR Challenge session planning at the pre-AGU mini-workshop
Presentations from GEM mini-workshop at the 2011 Fall AGU (San Francisco, CA)
- Auroral Model V& V Efforts [PDF] by Maj. C. Lane
Presentations from GEM-CEDAR Workshop 2011
- DST index in 2008 GEM modeling challenge [PDF] by L.Rastaetter
- RAM-SCB Dst Validation [PDF] by D. Welling
Presentations from GEM mini-workshop at the 2010 Fall AGU (San Francisco, CA)
- GGCM Metrics Challenge Status [PDF] by Masha Kuznetsova
- RAM-SCB Dst Validation [PDF]by Dan Welling
- DST Index in GEM Modeling Challenge [PDF] by Lutz Rastaetter
Presentations from GEM 2010 Summer Workshop (Snowmass, CO)
- GGCM Metrics Challenge Status [PDF] by Masha Kuznetsova
- Early RAM-SCB Validation: Dst [PDF] by Dan Welling
- Magnetopause standoff in 2009 GEM modeling challenge [PDF]by Lutz Rastaetter
- Operational Metrics for Geospace Models [PDF] by Howard Singer
- Auroral Precipitation Models [PDF] by Yihua Zheng
- RBSP model validation needs by Sasha Ukhorskiy
Presentations from GEM mini-workshop at the 2009 Fall AGU (San Francisco, CA)
- Introduction [PDF] by Masha Kuznetsova
- Inner-Magnetospheric Magnetic Fields [PDF] by Lutz Rastaetter
- Metrics Computations: Magnetopause Crossings [PDF] by Lutz Rastaetter
- Ground Magnetic Field Perturbations [PDF] by Antti Pulkkinen
- Operational Metrics for Geospace Models - Status Report [PDF] by Howard Singer
- Ground perturbations metrics ideas [PDF] by Dan Weimer
Presentations from 2009 Summer GEM workshop (Snowmass, CO)
- Introduction [PDF] by Masha Kuznetsova
- SOPA Corrections to the MPA Measurements [PDF] by Joe Borovsky
- GEM Challenge: Ground Magnetic Field Perturbations [PDF] by Antti Pulkkinen
- Magnetic Fields at GOES Geosynchronous Satellites [PDF] by Lutz Rastaetter
- Operational Metrics for Geospace Models [PDF] by Howard Singer
Presentations from GEM mini-workshop at the 2008 Fall AGU
- Magnetic Fields and Plasma Properties in the Inner Magnetosphere, L.Rastaetter
- Ground Magnetic Field Perturbations, A. Pulkkinen