SHINE
Summary
There is a large and growing number of models with different algorithms, data sources and levels of approximation being applied to study the corona and inner heliosphere. Recognizing this, at a special session of the SHINE Workshop in the summer of 2011, the community decided to establish a systematic effort to compare these different models and evaluate their absolute and relative performance. It was decided to define a set of test problems to be run by the models and to develop web-based support for the submission, analysis and public dissemination of the results of these model runs. The principal goals of this model comparison are to:
- Evaluate the current state of the coronal and inner heliospheric models and track model improvements over time.
- Facilitate interaction between the research and operation communities.
- Facilitate collaboration among modelers and data providers and research communities.
- Facilitate further model improvement.
Timeline
The initial call for submission of model results was emailed to the community on February 14, 2012.
The second call regarding the SHINE workgroup session was sent out on June 11, 2012.
Subsequent sessions were held at SHINE in 2012 and 2014.
At SHINE 2014, the session focused on two principal themes, a review of the existing web-based design and approach of the project, and the impact that the adoption of time-dependent magnetogram input data will have on this class of models and their validation.
Please send questions, comments and suggestions to Peter MacNeice and Aleksandre Taktakishvili.
To participate in the model comparison please submit your model results using the submission option below.
Information About the Study
Selected Case Studies
- Event 1: Carrington Rotation 2058 - Ambient Corona
- Event 2: Carrington Rotation 2062 - Ambient Corona
- Event 101: Carrington Rotation 2058 - Ambient Inner Heliosphere
- Event 102: Carrington Rotation 2062 - Ambient Inner Heliosphere
List of postprocessing diagnostics
Diagnostic 1: Full Disk EUV Images
- AIA-94
- AIA-131
- AIA-171
- AIA-193
- AIA-211
- AIA-304
- AIA-335
- Stereo-171
- Stereo-195
- Stereo-284
- Stereo-304
- EIT-171
- EIT-195
- EIT-284
- EIT-304
Diagnostic 2: Synthetic Heliographic Images
- LASCO-C2
- LASCO-C3
- Stereo-A-COR1
- Stereo-A-COR2
- Stereo-A-HI1
- Stereo-A-HI2
- Stereo-B-COR1
- Stereo-B-COR2
- Stereo-B-HI1
- Stereo-B-HI2
Diagnostic 3: Solution Timelines
- OMNI-density
- OMNI-windspeed
- OMNI-magnetic_field_strength
- OMNI-magnetic_field_polarity
- Ulysses-windspeed
- Ulysses-density
- Ulysses-Br
- Ulysses-Bt
- Ulysses-Bn
- Stereo-A-windspeed
- Stereo-A-ion-temperature
- Stereo-A-density
- Stereo-A-Bx
- Stereo-A-By
- Stereo-A-Bz
- Stereo-B-windspeed
- Stereo-B-ion_temperature
- Stereo-B-density
- Stereo-B-Bx
- Stereo-B-By
- Stereo-B-Bz
File Format Instruction (data cube)
- IDL code shine_valid_format.pro [TXT] to write a data cube in the required format.
- Fortran code shine_valid_format_fortran.F [TXT] to write a data cube in the required format.
- C code shine_valid_format_c.c [TXT] to write a data cube in the required format.
The above approved file format is strongly suggested. If you cannot submit your data in the approved file format please indicate so during your submission.
Note: Data files submitted in the approved format can be automatically processed by our processing scripts.
Call to Participate
CONTENTS
1. Summer 2011 Session Summary
2. Suggested Goals for SHINE 2012
3. YOUR ACTION ITEMS
4. Criteria for Selection of Solar Minimum CRs
Attachment: FORWARD input format specification
1. Summer 2011 Session Summary
We had a very lively and well attended session with a large number of participants expressing their interest and opinion about how the Challenge problems should be defined. My brief summary of the most salient points is as follows:
General Philosophy:
(a) The goal is to expose the scientific strengths and weaknesses of the models rather than to focus on specific narrowly defined parameters required for operational space weather forecasting. Therefore, the challenge should compare many different aspects of the model solutions.
(b) The challenge should be structured to require minimal recoding by the model owners.
(c) The CCMC will establish a web site to receive results posted by model owners and disseminate these results to all those participating in the challenge.
1. There should be two problem sets, one focused on coronal structure and the second on the structure in the inner heliosphere.
2. The problem sets should focus on ambient conditions, not on transient events such as flares and CMEs.
3. The problem sets should include solar minimum and solar maximum times.
4. The model runs should test the influence of different synoptic magnetogram sources.
5. A set of post-processing analysis and graphics products will be configured at the CCMC for application to the results from all relevant models.
6. The coronal model runs will be analyzed to compare field topology (including coronal hole locations and current sheet streamer base size), and EUV and X-ray emissivity in selected lines or broad-band ranges for comparison with full disk observations.
7. Additional metrics might include differential emission measures of selected features (i.e. loops, coronal holes, etc.) and possibly line cuts through the emissivity profiles.
8. The inner heliospheric models should be tested both in and out of the ecliptic.
9. Features to be tested against might include, sector boundaries, CIR and SIR location and structure, helmet streamer location.
2. Suggested Goals for SHINE 2012
Yesterday (2/13/12) I received confirmation from David Alexander that we WILL have a follow up session at this summer's workshop. Currently we are on the schedule for a half day session on the afternoon of Tuesday (June 26).
I suggest that our goal for this meeting be to submit preliminary results for the ambient corona and heliosphere for two CR's typical of solar minimum. I suggest that two good candidates are CRs 2058 and 2062. I have briefly outlined the criteria I considered in selecting these candidates at the end of this email.
I also suggest that we defer the Solar Maximum test cases to SHINE 2013, since this will enable us to select test cases with comprehensive SDO and Stereo coverage.
To generate our first cut at synthetic images of the corona based on model output, we will use Sarah Gibson's FORWARD tool. To generate synthetic heliospheric imager style images of the inner heliosphere we will use a suite of IDL programs developed by Dusan Odstrcil.
Initially participating modelers should submit output files to me at the CCMC and I will take responsibility for generating the synthetic image output, in consultation with the modelers. Eventually I hope that we will be able to automate this submission process. I have attached a brief description of the ideal format for submission of results for processing through FORWARD. A similar format is acceptable for the inner heliospheric results. It is my intention to discuss this issue in detail with each participant to make sure that they can deliver results in a format which we can use and which they can generate with minimal effort.
3. YOUR ACTION ITEMS
Everybody: Consider the suggested solar minimums (CRs 2058 and 2062), and if you feel there are better choices, please email me your alternate suggestions by no later than cob Feb 29.
Modelers: Please confirm your groups intention to participate and contact me (by email or phone (301-286-2061) to discuss specific issues associated with readying your model to run the test cases and generate the appropriately formatted output files.
4. Criteria for Selection of Solar Minimum CRs
In developing a list of candidate CRs for the solar minimum test cases I considered the following criteria:
1. Choose a time near solar minimum. (1996-1997 or 2007-2010)
2. Choose a time when the previous and succeeding CRs look very similar
3. Choose a time when more than one observatory is available for all three CRs
4. Choose a time when an inner heliosphere mission is out of the ecliptic but inside 2AU
5. Choose a time that has been studied before
6. Choose a time when good EUV full disk coverage is available
7. Choose a time when there are few CMEs
Ulysses Trajectory
Jan 1 1996 3.05AU Lat 53.1 HGI lon 67.7
Jul 1 1996 4.02AU Lat 32.7 HGI lon 74.7
Jan 1 1997 4.71AU Lat 19.0 HGI lon 77.7
Jul 1 1996 5.15AU Lat 8.5 HGI lon 79.6
Jan 1 1998 5.37AU Lat -0.9 HGI lon 81.2
Jan 1 2007 2.62AU Lat -76.5 HGI lon 130.3
Jul 1 2007 1.49AU Lat -27.8 HGI lon 255.4
Jan 1 2008 1.98AU Lat 78.7 HGI lon 325.9
Jul 1 2008 3.17AU Lat 51.6 HGI lon 67.7
Jan 1 2009 4.10AU Lat 31.7 HGI lon 74.5
Jul 1 2009 4.75AU Lat 18.4 HGI lon 77.5
Jan 1 2010 5.17AU Lat 7.7 HGI lon 79.5
Jul 1 2010 5.38AU Lat -1.6 HGI lon 81.2
Jan 1 2011 5.39AU Lat -10.7 HGI lon 82.9
Gong synoptic magnetograms available since July, 2006.
Mid to late 2007 is CR range 2058 to 2064
Magnetograms available from Gong, NSO, MWO, Wilcox and MDI(?) with the exception of CRs 2059 and 2063 from NSO which have bad data. Current sheet is very stable from 2058-2060 and 2061-2064 with relatively minor differences between the two periods. SOHO data is available from EIT, CDS, Lasco and UVCS, and Hinode XRT
STEREO had reasonable separation.
SHINE is now only 2 weeks away, and the schedule for our session and the project support web page at the CCMC are taking shape.
IF YOU HOPE TO HAVE SOME TIME TO MAKE A PRESENTATION AND HAVE NOT ALREADY NOTIFIED ME, PLEASE DO SO SOON.
ALSO
THE RESULTS SUBMISSION PAGE IS NOW AVAILABLE. SO FAR OUTPUT FILES FOR 5 DIFFERENT MODELS HAVE BEEN SUBMITTED AND OUR SYSTEM HAS SUCCESSFULLY PROCESSED THEM. IF YOU WISH TO HAVE YOUR RESULTS IN OUR SYSTEM PRIOR TO THE MEETING PLEASE UPLOAD THEM AS SOON AS POSSIBLE.
IF YOU ENCOUNTER ANY PROBLEMS WITH OUR ANONYMOUS FTP SERVER DURING THE SUBMISSION PROCESS PLEASE CONTACT ANNA CHULAKI at anna.chulaki-1@nasa.gov.
The goals for this meeting are to
- report on the preliminary runs done for our test cases
- report on the development of the supporting web site and post-processing tools at the CCMC
- discuss the most appropriate post-processing output for each case
- discuss selection of test cases representative of solar maximum
- collect feedback on the design and functionality of the support web-site
- Establish the schedule for on-going deliverables.
As with last years meeting, I am keen to see short (10-15 minute) interactive presentations rather than seminar style talks.
Status of Web-Site
The main functions of the support web site at the CCMC are to
- a. manage submission of run results
- b. automatically generate selected post-processing diagnostics
- c. present the model descriptions, run configurations and output graphics for public viewing.
Submission
The results submission page is NOW AVAILABLE for use. It can be accessed by going to the main SHINE Challenge Website.
Please follow the instructions provided there and use the option to "SUBMIT your desired diagnostics and receive file submission instructions >>" on the page to submit your results. If you encounter any problems with this submission process please contact Peter (Peter.J.MacNeice@nasa.gov).
Automated post-processing
The automated post-processing control has been implemented and is currently being debugged. As of now it can create synthethic STEREO Heliographic Images, selected 2D data slices of coronal models using FORWARD, and where appropriate, automatic generation of Kameleon(CDF) format files for use with Space Weather Explorer 2 (SWx2).
Submission Info
No longer accepting new submission for this challenge.
Study Results
Download 'SHINE Model Validation Study Results [tgz] '