Metrics Challenge Information

Presentations from 2009 Summer GEM workshop (Snowmass, CO) - PDF format:

Introduction by Masha Kuznetsova
SOPA Corrections to the MPA Measurements by Joe Borovsky
GEM Challenge: Ground Magnetic Field Perturbations by Antti Pulkkinen
Magnetic Fields at GOES Geosynchronous Satellites by Lutz Rastaetter
Publication options
Operational Metrics for Geospace Models by Howard Singer

CCMC Metrics Suite:

Simulation results submission interface, including:

Time series plotting tool
Runs for metric studies performed at the CCMC
Configurable table of metrics results
Feedback Collection

GEM Modeling Challenge update as of June 2009

Challenge Status

GGCM Metrics and Validation Focus Group is organizing Modeling Challenge focusing on the inner magnetospheric dynamics and ground magnetic field perturbations. The goals of the Challenge are to address differences between various modeling approaches, evaluate the current state of GGCM models, demonstrate effects of model coupling and grid resolution, encourage collaborations, and facilitate further model improvements.

Events and physical parameters for the Modeling Challenge were selected at the GEM 2008 Workshop.

Event 1: Oct 29, 2003 06:00 UT - Oct 30, 06:00 UT
Event 2: Dec 14, 2006 12:00 UT - Dec 16, 00:00 UT
Event 3: Aug 31, 2001 00:00 UT - Sep 01, 00:00 UT
Event 4: Aug 31, 2005 10:00 UT - Sep 01, 12:00 UT

Metric Study 1: Magnetic field at geosynchronous orbit (GOES)
Metric Study 2: Magnetopause crossings by geosynchronous satellite (GOES and LANL)
Metric Study 3: Plasma density/temperature at geosynchronous orbit (LANL)
Metric Study 4: Ground magnetic field perturbations (ground based magnetometers)
Metric Study 5: Dst index (added at the GEM 2009 summer workshop)

Challenge results were presented and discussed at the GEM Summer Workshop in Snowmass, CO. Session Summary is available at the GEM wiki. Reports on Metrics Study 4 (Ground magnetic field perturbations) and 1 (Magnetic field at geosynchronous orbit) based on simulation results submitted prior to the Workshop are available:

Ground Magnetic Field Perturbations, A. Pulkkinen
Magnetic Field at Geosynchronous Orbit, L.Rastaetter

Call for Participation:

Lutz Rastaetter and Antti Pulkkinen are working on two papers (Metrics Studies 1 & 4) to be submitted to Space Weather Journal by the GEM mini-Workshop at the Fall AGU. All participants to the individual Challenge Metrics Studies will be co-authors. It is still possible to get involved. The final deadline for simulation results submissions to be included in these papers is September 1, 2009.
Results of the Metrics Studies 2, 3, & 5 will be discussed at the GEM mini Workshop at the Fall AGU. Reports will be based on the simulation results submitted by November 15, 2009.
There is a plan to arrange a Special Issue on Geospace Models Metrics and Validation at the J. Atmospheric & Solar-Terrestrial Physics. The Special issue will include an introductory paper, 3-4 reports summarizing Challenge results, and a series of science papers with physics-based analysis. Expected primary focus of the science papers are the physical parameters addressed by the Challenge metric studies. Events selected for metrics Challenge are preferable but not required. Simulation results/visualization tools available at the CCMC can be used for research analysis. Participation in the Challenge is not required to submit a paper for the special issue. If you are interested to submit a paper for the Special Issue on Geospace Models Metrics and Validation please send a title, authors, and an Abstract to before the GEM mini-workshop at the Fall AGU.