FG1. GGCM Metrics and Validation

Conveners: Aaron Ridley <ridley@ umich.edu> and Masha Kuznetsova <Maria.M.Kuznetsova@nasa.gov>

Our group met for 1.5 hours, listening to talks on validation efforts by various groups (all of which have exceptionally good models). We further discussed having a modeling challenge focusing on inner magnetospheric dynamics - specifically, comparing geosynchronous (magnetic field, plasma, and magnetopause crossings) and ground-based magnetometer data with model results. The CCMC has volunteered to host the challenge, keeping track of both the data and model results. We have specifically allowed for modelers to enter more than one model result, so they can show what can be done in near-real-time and in a more science-grade production. It should also be noted that you don't have to participate in all aspects of the comparisons. For example, if you model only does magnetopause crossings, you can still participate. Four events have been chosen:

October 29 - 30, 2003 December 14-16, 2006 August 31 - September 1, 2001 August 31 - September 1, 2005

The details of the metrics challenge will be published at CCMC website and on the GEM wiki. The announcement will be made at GEM Messenger newsletter by mid-September.

We will have a session at the GEM mini-workshop at Fall AGU to discuss preliminary results from the challenge, so please, if you are interested in participating, try to do some of the simulations before Fall AGU.

GEM 2008/2009 MODELING CHALLENGE

Preparation for the GEM 2009 Summer Workshop.

GGCM Metrics and Validation Focus Group is organizing modeling Challenge focusing on the inner magnetospheric dynamics and ground magnetic field perturbations. The goal of the Challenge is to evaluate the current state of the space physics modeling capability and to address the differences between various modeling approaches. Community Coordinating Modeling Center (CCMC) is supporting the Challenge.

Lists of events and physical parameters for the metrics studies were selected at the GEM 2008 Workshop at Zermatt.

Model output can be submitted to CCMC via Challenge web site located at http://ccmc.gsfc.nasa.gov/support/GEM_metrics_08/index.php . CCMC will perform model/data comparisons for all submissions.

Initial results based on early submissions were discussed at the GEM mini-workshop at the 2008 Fall AGU. Preliminary reports on analyses of geosynchronous parameters and ground magnetic field perturbations are available at the Challenge website (see address above).

The Challenge results will be presented and discussed at the GEM 2009 Summer Workshop in Snowmass (http://www.cpe.vt.edu/gem/index.html). Joint publication by all participants and/or a series of back-to-back publications on the Challenge results are planned. Possible joint publications and future plans will be discussed at the GGCM Metrics and Validation Session at the GEM 2009 Workshop.

To participate in the Challenge please submit your model results using the web interface prior to May 15, 2009.

For more details, go to the Challenge Web site. Please send questions, comments and suggestions to: Masha Kuznetsova (Maria.M.Kuznetsova@nasa.gov) and Aaron Ridley (ridley@umich.edu).

GEM 2008/2009 MODELING CHALLENGE DETAILS

Four events have been chosen:

• Event 1: October 29th, 2003 06:00 UT - October 30th, 0600 UT
• Event 2: December 14, 2006 12:00 UT - December 16, 00:00 UT
• Event 3: August 31, 2001 00:00 UT - September 1, 00:00 UT
• Event 4: August 31, 2005 10:00 UT - September 1, 12:00 UT

The Challenge involves the following model/data comparisons (metrics studies):

• Metrics 1: Magnetic field at geosynchronous orbit (GOES)
• Metrics 2: Magnetopause crossings by geosynchronous satellite (GOES and LANL)
• Metrics 3: Plasma density/temperature at geosynchronous orbit (LANL)
• Metrics 4: Ground magnetic perturbations (ground based magnetometers)

GOES data for magnetic field at the geosynchronous orbit metrics were prepared by Howard Singer and Paul Loto'aniu. Stations for the ground magnetic perturbation metrics were selected by Terry Onsager. Michelle Thompsen indentified a list of times of the magnetopause crossings by geosynchronous satellites and analyzed Magnetospheric Plasma Analyzer (MPA) data quality for plasma density at the geosynchronous orbit metrics.

Satellite trajectories, coordinates of ground stations to be used for metrics studies and model output format can be downloaded from the Challenge Web Site at http://ccmc.gsfc.nasa.gov/support/GEM_metrics_08/index.php

Challenge participants can upload model results using CCMC Web interface at http://ccmc.gsfc.nasa.gov/support/GEM_metrics_08/challenge_registration.php.

Uploading the model results for one event simulated using certain model settings can be done in one submission. For each simulated event the modelers are invited to submit simulation results for one or more metrics studies (which can be selected during the submission procedure). For example, if your model calculates only magnetopause crossings or only ground magnetic perturbations, you can still participate.

Multiple submissions from the same participant for the same event and the same model but different model settings (e.g., for different model versions, different simulation grids, different ionosphere conductance models, different coupling options with inner magnetosphere, etc.) are possible. This will allow us to demonstrate what can be done in near-real-time and in a more science-grade production, as well as to demonstrate the effect of model coupling.

Please send questions, comments, and suggestions to: Masha Kuznetsova (Maria.M.Kuznetsova@nasa.gov) and Aaron Ridley (ridley@umich.edu).

You can also use the following link to submit your comments though the Web interface at http://ccmc.gsfc.nasa.gov/ComQues/submitFeedback.php.