FG1. GGCM Metrics and Validation - Revision history

Peterchi at 01:35, 4 June 2011

2011-06-04T01:35:58Z

Peterchi at 01:28, 4 June 2011

2011-06-04T01:28:12Z

Peterchi: Remove old materials

2011-06-04T01:27:28Z

Remove old materials

Gemeditor at 16:52, 23 April 2009

2009-04-23T16:52:55Z

Gemeditor at 16:46, 23 April 2009

2009-04-23T16:46:34Z

Gemeditor: New page: '''Conveners: Aaron Ridley and Masha Kuznetsova ''' Our group met for 1.5 hours, listening to talks on validation efforts by various grou...

2008-09-25T22:01:44Z

New page: '''Conveners: Aaron Ridley <ridley@ umich.edu> and Masha Kuznetsova <Maria.M.Kuznetsova@nasa.gov>''' Our group met for 1.5 hours, listening to talks on validation efforts by various grou...

New page

'''Conveners: Aaron Ridley <ridley@ umich.edu> and Masha Kuznetsova <Maria.M.Kuznetsova@nasa.gov>'''

Our group met for 1.5 hours, listening to talks on validation efforts by various groups (all of which have exceptionally good models). We further discussed having a modeling challenge focusing on inner magnetospheric dynamics - specifically, comparing geosynchronous (magnetic field, plasma, and magnetopause crossings) and ground-based magnetometer data with model results. The CCMC has volunteered to host the challenge, keeping track of both the data and model results. We have specifically allowed for modelers to enter more than one model result, so they can show what can be done in near-real-time and in a more science-grade production. It should also be noted that you don't have to participate in all aspects of the comparisons. For example, if you model only does magnetopause crossings, you can still participate. Four events have been chosen:

October 29 - 30, 2003
December 14-16, 2006
August 31 - September 1, 2001
August 31 - September 1, 2005

The details of the metrics challenge will be published at CCMC website and on the GEM wiki. The announcement will be made at GEM Messenger newsletter by mid-September.

We will have a session at the GEM mini-workshop at Fall AGU to discuss preliminary results from the challenge, so please, if you are interested in participating, try to do some of the simulations before Fall AGU.

'''GEM 2008 MODELING CHALLENGE'''

Following the discussion at the Metric and Validation Session during the GEM 2008 Workshop at Zermatt, the GGCM Metrics and Validation Focus Group is organizing Modeling Challenge focusing on the inner magnetospheric dynamics and ground magnetic perturbations. Community Coordinating Modeling Center (CCMC) is supporting the Challenge.

Four events have been chosen:

*Event 1: October 29th, 2003 06:00 UT - October 30th, 0600 UT
*Event 2: December 14, 2006 12:00 UT - December 16, 00:00 UT
*Event 3: August 31, 2001 00:00 UT - September 1, 00:00 UT
*Event 4: August 31, 2005 10:00 UT - September 1, 12:00 UT

The Challenge involves the following model/data comparisons (metrics
studies):

*Metrics 1: Magnetic field at geosynchronous orbit (GOES)
*Metrics 2: Magnetopause crossings by geosynchronous satellite (GOES and LANL)
*Metrics 3: Plasma density/temperature at geosynchronous orbit (LANL)
*Metrics 4: Ground magnetic perturbations (ground based magnetometers)

Details of the Challenge and instruction on how to participate can be found at the Community Coordinated Modeling Center (CCMC) web site: http://ccmc.gsfc.nasa.gov/

Challenge participants can upload model results using CCMC Web interface at http://ccmc.gsfc.nasa.gov/support/GEM_metrics_08/.

The CCMC will perform the model/data comparison for submitted simulation output. CCMC will keep track of both the data and model results.

Uploading the model results for one event simulated using certain model settings can be done in one submission. For each simulated event the modelers are invited to submit simulation results for one or more metrics studies (which can be selected during the submission procedure). For example, if your model calculates only magnetopause crossings or only ground magnetic perturbations, you can still participate.

Multiple submissions from the same participant for the same event and the same model but different model settings (e.g., for different model versions, different simulation grids, different ionosphere conductance models, different coupling options with inner magnetosphere, etc.) are possible. This will allow us to demonstrate what can be done in near-real-time and in a more science-grade production, as well as to demonstrate the effect of model coupling.

The first results of the Challenge will be discussed at the GEM mini-workshop at the Fall AGU. Using the experience of these preliminary metrics studies we will discuss what modifications to the challenge procedure should be made and whether we should modify the list of events selected for the comparison.

To participate in this first round of the Challenge please submit your model results using CCMC's on-line submission interface prior to November 15, 2008.

Please send questions and comments to:
Masha Kuznetsova (Maria.M.Kuznetsova@nasa.gov)
Aaron Ridley (ridley@umich.edu)

← Older revision		Revision as of 01:35, 4 June 2011
Line 1:		Line 1:
−	''~~Conveners: Aaron Ridley <ridley [at] umich.edu> and~~ Masha Kuznetsova <Maria.M.Kuznetsova [at] nasa.gov>''	+	Leaders: ''Masha Kuznetsova <Maria.M.Kuznetsova [at] nasa.gov> and Aaron Ridley <ridley [at] umich.edu>''
		+

	The GGCM Metrics and Validation Focus Group has ended, and the subject is now covered by another Focus Group [[FG: Metrics and Validation\|Metrics and Validation]] (2011 - ).		The GGCM Metrics and Validation Focus Group has ended, and the subject is now covered by another Focus Group [[FG: Metrics and Validation\|Metrics and Validation]] (2011 - ).

← Older revision		Revision as of 01:28, 4 June 2011
Line 1:		Line 1:
−	'''Conveners: Aaron Ridley <ridley@ umich.edu> and Masha Kuznetsova <Maria.M.Kuznetsova@nasa.gov>'''	+	''Conveners: Aaron Ridley <ridley [at] umich.edu> and Masha Kuznetsova <Maria.M.Kuznetsova [at] nasa.gov>''

	The GGCM Metrics and Validation Focus Group has ended, and the subject is now covered by another Focus Group [[FG: Metrics and Validation\|Metrics and Validation]] (2011 - ).		The GGCM Metrics and Validation Focus Group has ended, and the subject is now covered by another Focus Group [[FG: Metrics and Validation\|Metrics and Validation]] (2011 - ).

← Older revision		Revision as of 01:27, 4 June 2011
Line 1:		Line 1:
	'''Conveners: Aaron Ridley <ridley@ umich.edu> and Masha Kuznetsova <Maria.M.Kuznetsova@nasa.gov>'''		'''Conveners: Aaron Ridley <ridley@ umich.edu> and Masha Kuznetsova <Maria.M.Kuznetsova@nasa.gov>'''

−	Our group met for 1.5 hours, listening to talks on validation efforts by various groups (all of which have exceptionally good models). We further discussed having a modeling challenge focusing on inner magnetospheric dynamics - specifically, comparing geosynchronous (magnetic field, plasma, and magnetopause crossings) and ground-based magnetometer data with model results. The CCMC has volunteered to host the challenge, keeping track of both the data and model results. We have specifically allowed for modelers to enter more than one model result, so they can show what can be done in near-real-time and in a more science-grade production. It should also be noted that you don't have to participate in all aspects of the comparisons. For example, if you model only does magnetopause crossings, you can still participate. Four events have been chosen:	+	The GGCM Metrics and Validation Focus Group has ended, and the subject is now covered by another Focus Group [[FG: Metrics and Validation\|Metrics and Validation]] (2011 - ).
−
−	~~October 29 - 30, 2003~~
−	~~December 14-16, 2006~~
−	~~August 31 - September 1, 2001~~
−	~~August 31 - September 1, 2005~~
−
−	The ~~details of the metrics challenge will be published at CCMC website and on the GEM wiki. The announcement will be made at GEM Messenger newsletter by mid-September.~~
−
−	We will have a session at the GEM mini-workshop at Fall AGU to discuss preliminary results from the challenge, so please, if you are interested in participating, try to do some of the simulations before Fall AGU.
−
−	~~'''GEM 2008/2009 MODELING CHALLENGE'''~~
−
−	~~Preparation for the GEM 2009 Summer Workshop~~
−
−	GGCM Metrics and Validation Focus Group ~~is organizing modeling Challenge focusing on the inner magnetospheric dynamics~~ and ~~ground magnetic field perturbations. The goal of~~ the ~~Challenge~~ is to evaluate the current state of the space physics modeling capability and to address the differences between various modeling approaches. Community Coordinating Modeling Center (CCMC) is supporting the Challenge.
−
−	~~Lists of events and physical parameters for the metrics studies were selected at the GEM 2008 Workshop at Zermatt.~~
−
−	~~Model output can be submitted to CCMC via Challenge web site located at http://ccmc.gsfc.nasa.gov/support/GEM_metrics_08/index.php . CCMC will perform model/data comparisons for all submissions.~~
−
−	Initial results based on early submissions were discussed at the GEM mini-workshop at the 2008 Fall AGU. Preliminary reports on analyses of geosynchronous parameters and ground magnetic field perturbations are available at the Challenge website (see address above).
−
−	~~The Challenge results will be presented and discussed at the GEM 2009 Summer Workshop in Snowmass (http~~://www.cpe.vt.edu/gem/index.html). Joint publication by all participants and/or a series of back-to-back publications on the Challenge results are planned. Possible joint publications and future plans will be discussed at the GGCM Metrics and Validation ~~Session at the GEM 2009 Workshop.~~
−
−	~~To participate in the Challenge please submit your model results using the web interface prior to '''May 15, 2009'''.~~
−
−	~~For more details, go to the Challenge Web site. Please send questions, comments and suggestions to: Masha Kuznetsova (Maria.M.Kuznetsova@nasa.gov) and Aaron Ridley (ridley@umich.edu).~~
−
−	~~'''GEM 2008/2009 MODELING CHALLENGE DETAILS'''~~
−
−	~~Four events have been chosen:~~
−
−	*Event 1: October 29th, 2003 06:00 UT - October 30th, 0600 UT
−	*Event 2: December 14, 2006 12:00 UT - December 16, 00:00 UT
−	*Event 3: August 31, 2001 00:00 UT - September 1, 00:00 UT
−	*Event 4: August 31, 2005 10:00 UT - September 1, 12:00 UT
−
−	~~The Challenge involves the following model/data comparisons (metrics~~
−	~~studies):~~
−
−	*Metrics 1: Magnetic field at geosynchronous orbit (GOES)
−	*Metrics ~~2: Magnetopause crossings by geosynchronous satellite (GOES~~ and ~~LANL)~~
−	*Metrics 3: Plasma density/temperature at geosynchronous orbit (LANL)
−	*Metrics 4: Ground magnetic perturbations (~~ground based magnetometers)~~
−
−	GOES data for magnetic field at the geosynchronous orbit metrics were prepared by Howard Singer and Paul Loto'aniu. Stations for the ground magnetic perturbation metrics were selected by Terry Onsager. Michelle Thompsen indentified a list of times of the magnetopause crossings by geosynchronous satellites and analyzed Magnetospheric Plasma Analyzer (MPA) data quality for plasma density at the geosynchronous orbit metrics.
−
−	Satellite trajectories, coordinates of ground stations to be used for metrics studies and model output format can be downloaded from the Challenge Web Site at http://ccmc.gsfc.nasa.gov/support/GEM_metrics_08/index.php
−
−	~~Challenge participants can upload model results using CCMC Web interface at http://ccmc.gsfc.nasa.gov/support/GEM_metrics_08/challenge_registration.php.~~
−
−	Uploading the model results for one event simulated using certain model settings can be done in one submission. For each simulated event the modelers are invited to submit simulation results for one or more metrics studies (which can be selected during the submission procedure). For example, if your model calculates only magnetopause crossings or only ground magnetic perturbations, you can still participate.
−
−	Multiple submissions from the same participant for the same event and the same model but different model settings (e.g., for different model versions, different simulation grids, different ionosphere conductance models, different coupling options with inner magnetosphere, etc.) are possible. This will allow us to demonstrate what can be done in near-real-time and in a more science-~~grade production, as well as to demonstrate the effect of model coupling.~~
−
−	~~Please send questions, comments, and suggestions to: Masha Kuznetsova (Maria.M.Kuznetsova@nasa.gov) and Aaron Ridley (ridley@umich.edu~~).
−
−	~~You can also use the following link to submit your comments though the Web interface at http://ccmc.gsfc.nasa.gov/ComQues/submitFeedback.php~~.

@@ Line 14: / Line 14: @@
 '''GEM 2008/2009 MODELING  CHALLENGE'''
-Preparation for the GEM 2009 Summer Workshop.
+Preparation for the GEM 2009 Summer Workshop
 GGCM Metrics and Validation Focus Group is organizing modeling Challenge focusing on the inner magnetospheric dynamics and ground magnetic field perturbations. The goal of the Challenge is to evaluate the current state of the space physics modeling capability and to address the differences between various modeling approaches. Community Coordinating Modeling Center (CCMC) is supporting the Challenge.
@@ Line 30: / Line 30: @@
 For more details, go to the Challenge  Web site. Please send questions, comments and suggestions to: Masha Kuznetsova (Maria.M.Kuznetsova@nasa.gov) and Aaron Ridley (ridley@umich.edu).
-GEM 2008/2009 MODELING CHALLENGE DETAILS
+'''GEM 2008/2009 MODELING CHALLENGE DETAILS'''
 Four events have been chosen:

@@ Line 12: / Line 12: @@
 We will have a session at the GEM mini-workshop at Fall AGU to discuss preliminary results from the challenge, so please, if you are interested in participating, try to do some of the simulations before Fall AGU.
-'''GEM 2008 MODELING  CHALLENGE'''
+'''GEM 2008/2009 MODELING  CHALLENGE'''
-Following the discussion at the Metric and Validation Session during the GEM 2008 Workshop at Zermatt, the GGCM Metrics and Validation Focus Group is organizing Modeling Challenge focusing on the inner magnetospheric dynamics and ground magnetic perturbations.  Community Coordinating Modeling Center (CCMC) is supporting the Challenge.
+Preparation for the GEM 2009 Summer Workshop.
 Four events have been chosen:
@@ Line 31: / Line 47: @@
 *Metrics 4: Ground magnetic perturbations (ground based magnetometers)
-Details of the Challenge and instruction on how to participate can be found at the Community Coordinated Modeling Center (CCMC) web site: http://ccmc.gsfc.nasa.gov/
+GOES data for magnetic field at the geosynchronous orbit metrics were prepared  by Howard Singer and Paul Loto'aniu. Stations for the ground magnetic perturbation metrics were selected by Terry Onsager.  Michelle Thompsen indentified a list of times of the magnetopause crossings by geosynchronous satellites and analyzed Magnetospheric Plasma Analyzer (MPA) data quality for plasma density at the geosynchronous orbit metrics.
-Challenge participants can upload model results using CCMC Web interface at http://ccmc.gsfc.nasa.gov/support/GEM_metrics_08/.
+Satellite trajectories, coordinates of ground stations to be used for metrics studies and model output format can be downloaded from the Challenge Web Site  at http://ccmc.gsfc.nasa.gov/support/GEM_metrics_08/index.php
-The CCMC will perform the model/data comparison for submitted simulation output. CCMC will keep track of both the data and model results.
+Challenge participants can upload model results using CCMC Web interface at http://ccmc.gsfc.nasa.gov/support/GEM_metrics_08/challenge_registration.php.
 Uploading the model results for one event simulated using certain model settings can be done in one submission. For each simulated event the modelers are invited to submit simulation results for one or more metrics studies (which can be selected during the submission procedure). For example, if your model calculates only magnetopause crossings or only ground magnetic perturbations, you can still participate.
@@ Line 41: / Line 57: @@
 Multiple submissions from the same participant for the same event and the same model but different model settings (e.g., for different model versions, different simulation grids, different ionosphere conductance models, different coupling options with inner magnetosphere, etc.) are possible. This will allow us to demonstrate what can be done in near-real-time and in a more science-grade production, as well as to demonstrate the effect of model coupling.
-The first results of the Challenge will be discussed at the GEM mini-workshop at the Fall AGU. Using the experience of these preliminary metrics studies we will discuss what modifications to the challenge procedure should be made and whether we should modify the list of events selected for the comparison.
+Please send questions, comments, and suggestions to: Masha Kuznetsova (Maria.M.Kuznetsova@nasa.gov) and Aaron Ridley (ridley@umich.edu).
-Please send questions and comments to:
+You can also use the following link to submit your comments though the Web interface at http://ccmc.gsfc.nasa.gov/ComQues/submitFeedback.php.