6.0 DATA MANAGEMENT

Principal Investigator and GTE Project Office responsibilities for data handling, submittal and publication are defined in this section. The specifics of the data protocol and schedules for data submittal and publications were developed and agreed to by the TRACE-P Science Team.

6.1 Data Protocol

The purpose of the TRACE-P data protocol is to: (1) encourage an orderly and timely analysis, interpretation and publication of data obtained during integrated field expeditions in pursuit of the goals of the NASA Tropospheric Chemistry Program; (2) foster collaboration among investigator teams; and (3) establish a procedure to produce an integrated expedition archive that will serve as a central repository of data products to be released to the public domain. Participation in this data protocol by investigators from other collaborating investigating teams,  will be in accordance with agreements between the respective Science Teams and the TRACE-P Project.

Members of the TRACE-P Science Team and collaborating investigators receiving TRACE-P data have agreed to  this TRACE-P protocol:

(a) All measurements and/or data products acquired or developed as part of the TRACE-P mission by any member of the TRACE-P Science Team will be submitted to the TRACE-P Data Archive in the GTE Format described in Appendix E;

(b) Measurements acquired during the field deployment phase of the mission will be submitted to the GTE Data Manager within 24 hours after each flight, will constitute the TRACE-P Preliminary archive and may be used only by TRACE-P Science Team members until the final archive is available. Model and meteorological products will be submitted via ftp to the Science Team site, as they become available, and become part of the data archive;

(c) The final submission of the TRACE-P measurements and/or data products will be submitted to the GTE data archive in accordance with the Data Products Schedule given in Section 8.3;

(d) Appropriate results of modeling and analyses in support of the TRACE-P objectives will be provided to the GTE Data Archive.  Flight planning products, except for those derived from ECMWF data, will be available publicly as soon as they are available in the archive;

(e) All members of the TRACE-P Science Team will have free access to, and use of, all measurements and/or data products in the Preliminary and Final TRACE-P Data Archive, except as noted in this section;

(f) Neither measurements nor data products emerging from analysis of the measurements in the Preliminary archive may be published or used in any publication without the permission of the PI responsible for the measurements or data products;

(g) All measurements and/or data products used in presentations and publications shall be submitted to the GTE Data archive;

(h) The first publication of results from the TRACE-P mission shall be in a special issue or section of a scientific journal selected by the Science Team and will be in accordance with the Data Products Schedule in Section 8.3;

(i) Any TRACE-P Science Team member preparing a part for the special publication which uses measurements and/or data products submitted to the GTE archive by another PI (e. g. paragraph (h)) must obtain permission from the PI and offer the PI co-authorship on the publication;

(j) A member of the TRACE-P Science Team may present his or her own data during a seminar or presentation. Use of another PI’s data in a seminar requires the permission of the PI responsible for the subject data;

(k) Publication of special papers prior to the TRACE-P Special publication submission date may occur with the permission of the TRACE-P Science Team members;

(l) PIs’ may incorporate their own measurements and/or data products as well as analyses and preliminary texts in their own web sites so long as the material is password-protected for the TRACE-P Science Team members use prior to the special publication submission date;

(m) Pre-public release exchange of TRACE P archive products with other interested scientific groups is planned where that group offers their data which is of interest to the TRACE P Science Team in exchange.  Members of such groups will not make TRACE P products available to third parties.  Members of groups requesting TRACE P products will agree to abide by this protocol, as the TRACE P Science Team will agree to abide by their protocol, prior to receiving any TRACE P products.  The TRACE P PI will be informed when data is requested by a non-TRACE P collaborator, until the date when the TRACE P data becomes public.  This agreement will be in effect until each groups’ products are publicly available.  Agreements for data exchange are in various stages of negotiation with the groups indicated in Appendix N and others will be added as appropriate;

(n) The Data Protocol described in this section will be effective until the submission date for the first special publication for TRACE-P per the schedule in Section 8.3. Publication or presentation of TRACE-P measurements after this date is encouraged and are not subject to this protocol:

(o) The Data Protocol described in this section will be effective until the submission date for the first special publication for TRACE P per the schedule in Section 8.3.  Publication or presentation of TRACE P measurements after this date is encouraged and are not subject to this protocol;

6.1.1 TRACE-P Data Archive Format

All data submitted to the TRACE-P Preliminary Data Archive and to the Final Data Archive will be in the GTE Format described in Appendix E.

6.1.2 Archive Data Submittal

All data and data products submitted for the Preliminary and the Final Data Archive will be submitted to the GTE Data Manager. Submittal to the Preliminary Archive Data will be on 3.5-inch disk. Submittal to the Final Archive will be via FTP.

6.1.3 TRACE-P Data Archive

The TRACE-P Archive will consist of all measurements and data products that are acquired or generated as part of the TRACE-P mission. Tables 4.2-1, 4.2-24.7-1, and 4.8-1 define the instrumentation, modeling activities, and satellite data analysis activities that have been funded as part of the mission.  Measurements and products from the instrumentation and modeling investigations will comprise the TRACE-P Data Archive.  Data from the satellite data analyses will be available on the individual instrument web pages.

6.1.3.1 Preliminary Archive

During the field deployment phase of TRACE-P, results from measurements acquired during each DC-8 and P-3B-B flight will be submitted to the Data Manager in the standard archive format described in Appendix E, within 24 hours of completion of each flight. The Preliminary Data Archive will be comprised of these field submissions. Use of the Preliminary Archive will be governed by Data Protocol described in Section 6.1.

6.1.3.2 Final Archive

The Final TRACE-P Archive will be comprised of all measurements and data products emerging from the investigations listed in Tables 4.2-1, 4.2-2, and 4.7-1. Measurements and data products will be submitted to the GTE Project Office in the GTE Format described in Appendix E (published separately) per the data schedule given in Section 8.3.

6.1.4 Data Handling and Certification for Release to Archive

Investigators are responsible for acquiring, processing, certifying, and reducing the data from their instruments and providing required data products on schedule. Only certified data shall be submitted to the GTE Data Manager for inclusion in the Final Data Archive.

The GTE Data Manager will verify that all data files submitted to the Preliminary Archive and the Final Archive adheres to the GTE Archive format. Data files submitted to the Final Archive will be further examined for logical consistency with regard to the time sequence of the data entries, dates, position, etc. Submissions that do not adhere to the format specification and/or that have logical inconsistencies will be returned to the investigator for correction and resubmission.

The Preliminary Archive will be available to the TRACE-P Science Team at the conclusion of the field deployment phase of the expedition. These data are preliminary and should only be used by members of the TRACE-P Science Team per the restrictions noted in Section 6.1.

The Final Archive will be released to the TRACE-P Science Team via FTP per the data schedule in Section 8.3 to provide a period of 3 months for team validation of the measurements prior to release to the Langley DAAC and to the public via the GTE home page. GTE Data Archive CD-ROMs are also produced and can be obtained from the GTE Data Archive web site (http://www-gte.larc.nasa.gov/GTE_CD.html) or by email. Please specify the number of CD-ROMs you require.

6.1.5 Data Release to DAAC

The GTE Data Manager will produce an expedition archive of certified data for release to the Langley DAAC. The archive will include all final data as submitted by investigators. Public release of the final archive will be accomplished by submittal of the archive to the Langley DAAC, the GTE home page web site, the GTE anonymous FTP site, and through GTE Data Archive CD-ROM distribution (see section 6.1.4).

6.1.6 Data Retrieval from GTE and DAAC Archives

The Global Tropospheric Experiment (GTE) is among the projects supported by the NASA-Langley DAAC. The most current information about the GTE data sets archived can be found on the GTE Home Page, http://www-gte.larc.nasa.gov/ or on the Langley DAAC Home Page, http://eosweb.larc.nasa.gov/; follow "Projects Supported" link.

Please contact the Langley DAAC User Services staff with any questions about supported data sets, ordering instructions, or problems with ordering data:

Langley DAAC Science, User and Data Support Office
NASA-Langley Research Center
Mail Stop 157D
Hampton, VA 23681-2199
Phone: (757) 864-8656
FAX: (757) 864-8807
E-Mail: larc@eos.nasa.gov

Retrieval of data from the GTE Data Archive is described in Appendix E.

6.1.7 Presentations and Publications

There will be no TRACE-P Science Team member presentations or publications of TRACE-P data except by approval of the TRACE-P Science Team or as defined in Section 6.1. Use of another investigator's data should be accompanied by an offer for co-authorship and significant participation in the development of any resulting publication and/or presentations.

6.2 Airborne Data Systems

The GTE Project Office will provide the data acquisition, display, storage, distribution, and archival of housekeeping and ancillary data during the TRACE-P Expedition. Basic aircraft housekeeping data will be recorded and distributed to investigator stations on board the DC-8 aircraft via the Data Acquisition and Distribution System (DADS) as described in Appendix F and to investigator stations on board the P-3B via the Project Distribution System (PDS) as described in Appendix G. The capability for real-time displays of selected housekeeping, ancillary, and PI data sets during flight is provided on both aircraft via the respective video distribution system. The PDS and DADS will also provide the capability to record and display selected PI measurements (per agreement of the respective PI). Provisions for input of PI measurements to the PDS or DADS will be in analog format with a range of ± 10 Volts. This data will be used for real-time display purposes. A PI whose data is recorded by the PDS may notify the Project Office within 24 hours after the flight to retain the recorded data for submittal to the Preliminary Archive. Otherwise, the recorded data will be removed and the PI must provide a data file to the Preliminary Archive.

The GTE Project office will also produce preliminary tabular and graphical summaries of the housekeeping and ancillary data for each flight during the expedition. Final data analysis and submittal of the housekeeping and ancillary data in the GTE Archive will be in accordance with the data protocol schedule adopted by the TRACE-P Science Team.

6.2.1 DADS (DC-8)

Housekeeping, ancillary, and selected PI measurements will be recorded by DADS (Appendix F) and video cameras. DADS will record and distribute the aircraft navigational and meteorological data from the Navigational Management System (NMS), which combines GPS and ground-based location data. NMS is used by the DC-8 flight crew to incorporate GPS accuracy with flight profiles. In addition DADS creates and distributes a real time track map display with optional wind field data. NOAA polar orbiter AVHRR satellite images captured in flight on the Automatic Picture Transmission system (APT) are available on monitors at investigator stations. DADS updates recorded parameters at 1 Hz and distributes a serial data stream throughout the aircraft at transmission rates of 1200, 9600, and 19.2K baud. Tables F4 and F5 of Appendix F list the parameters and describe the DADS serial data stream format. All data parameters are in engineering units. Units are not included in the data stream. Additional information on the DADS is available in the DC-8 Airborne Laboratory Experimenters Handbook. Table F7 lists the ancillary measurements that are recorded by the DADS and information recorded by video cameras. DADS will provide tabulated data sets that can be selectively viewed on monitors located at PI instrument racks.

6.2.2 PDS (P-3B)

The GTE-PDS (Appendix G) is the primary data acquisition, display, and distribution system for housekeeping and ancillary measurements on board the P-3B aircraft. PDS system will record aircraft navigational and meteorological data, ancillary measurements, and selected PI measurements and distributes a serial data stream of these data at 1 Hz throughout the aircraft at a transmission rate of 19.2K baud. All data parameters are in engineering units. Units are not included in the data stream. PDS will provide tabulated data sets and plots that can be selectively viewed on monitors located at various locations in the aircraft.

6.2.3 Recording Analog Signals

The DADS/ICATS and PDS systems offer the capability to record analog signals from selected investigator instruments. The recorded data are merged with the housekeeping and ancillary data and displayed in tabular and graphical formats during each flight to assist the Mission Scientists in assessing the overall mission status. The measurements listed in Table 6.2.3-1 are recorded data for real-time display during flight.

Table 6.2.3-1: Measurements to be recorded displayed by DADS/ICATS and PDS

Principal Investigator

Organization

Measurement

Aircraft

Anderson

LaRC

CN

DC-8

Sachse

LaRC

CO, CH4

DC-8/P3-B

Sandholm

Ga. Tech.

NO

DC-8

Avery/Vay

LaRC

O3, CO2

DC-8/P-3B

Barrick

LaRC

H2O Vapor

DC-8/P-3B

Clark

U of Hawaii

CN, scattering coeff.

P-3B

Kondo

Nagoya U.

NO, NOy

P-3B

Weber

Ga. Tech.

UCN, aerosol ions

P-3B

6.3 Data Timing

Both aircraft will be using GPS signals to generate Universal Time (UT) to be used as the 1 Hz reference for data acquisition.

6.3.1 Time Reference

DADS and PDS will provide a standard IRIG B signal, which may be used by PIs when a timing accuracy better than 1 second is required. The IRIG B signal provides a timing pulse that is accurate to 1 ms.

6.3.2 Data Recording Frequency

DADS and PDS will record selected PIs signals along with housekeeping and ancillary data at 1 Hz. The mission data will be available to PIs after flight completion in electronic format as a field product. Time series and altitude summary plots of key parameters will also be provided.

PI recording system(s) should operate at a frequency appropriate to the phenomena being measured.

6.4 In-flight Data

The GTE Project Office is responsible for the acquisition, display, storage, distribution, and archival of housekeeping and ancillary data. DADS and PDS will provide data recorded from the aircraft systems, selected PIs signals, images from cloud videos and the Storm Scope. PIs are responsible for the acquisition, recording, and archiving of their measurements.

6.4.1 Availability

The data collected by DADS and PDS will be made available to PIs in visual tabular and graphical format via the video distribution system. Data are also transmitted to PIs via the serial distribution system in ASCII format (Section 6.4.2) on both aircraft.

6.4.2 Serial Data System (SDS)

6.4.2.1 DADS (DC-8) SDS

The SDS is supported on the DC-8 by DADS. Serial data parameters are transmitted via the SDS at 1200, 9600, and 19.2K baud rates. A parameter list and description of the serial data block formats for the various baud rates are listed in Appendix F (Tables F2-F5). Data records are 392 characters in length and in ASCII format.

6.4.2.2 PDS (P-3B) SDS

The SDS is supported on the P-3B by PDS. Serial data parameters are transmitted via the SDS at 19.2K baud rate. The parameter list and block format is described in Appendix G (Tables G1 and G2). Data records are 392 characters in length and in ASCII format.

6.4.3 Video Distribution System (VDS)

The VDS on the P-3B consists of flat-panel LCD monitors. Monitors will be distributed throughout the P-3B to provide visual access to all PIs. There will be four (4) displays available that can be independently selected by the PIs on each monitor. These displays include: (1) the primary alpha-numeric housekeeping data, (2) selected graphical plots, (3) forward cloud camera view, and (4) a quad-view of the storm scope display, nadir and forward cloud camera, and selected graphical data plots.

The VDS on the DC-8 consists of various type monitors located at PI instrument racks. There are several flight displays available which can be selected independently by PIs. These displays include: (1) alpha-numeric data, (2) graphical data, (3) track plot, (4) Weather Satellite APT Receiver, and (5) optional displays (e.g. LIDAR images). Further details are given in Appendix F.

6.5 Data Products

Data products for the TRACE-P mission will be comprised of all measurements and/or model generated parameters from PI or GTE Project measurements. The P-3B PDS and DC-8 DADS will convert all voltage signals to engineering units, where feasible, and display subsets of data to the video display system Section 6.4.3) on board the aircraft. Table F1 in Appendix F is an example of the tabular data, which will be displayed on the DC-8 VDS, and Figure G2 in Appendix G is the video screen, which will be displayed on the P-3B VDS.

Distribution of the data products will be in the form of a Preliminary Data Archive and the Final Data Archive. The Preliminary Data Archive will be assembled using the field data products available from PI's and Project measurements within 24 hours after each flight. The Final Data Archive will contain final data submission of all PI measurements, Project measurements, model-generated data products, and meteorological parameters acquired during the field deployment.

6.5.1 Field Products

The TRACE-P Science Team has committed to a free and open exchange of preliminary data in the field. Each investigator will provide to the GTE Data Manager preliminary data from each flight within 24 hours after flight completion. Preliminary data recorded by the DADS and the PDS will be made available to the Science Team within 24 hours following each flight. The field products provided by investigators and the Project Office is preliminary data. Use of this data shall be in accordance with Section 6.1.

The DC-8 DADS field data products include aircraft position and parameter plots, diskettes containing the archived DADS serial ASCII data stream, and printed copies of the Mission Director's log files.

The GTE Project Office will produce preliminary mission data summaries for each flight on both aircraft during the expedition and provide copies to each PI group. The mission summaries include the following:

1. One-minute averaged listings of key navigational/meteorological parameters. These parameters include time, day, latitude, longitude, altitude, cabin altitude, true air speed, ground speed, ground track, wind speed, wind direction, static pressure, static air temperature, dew/frost point, surface temperature, pitch, roll, and UV (zenith & nadir).

2. Time series summary plots for the flight. Plot types include position (latitude & longitude), and time series of altitude, static air temperature, and dew/frost points (ozone may also be included).

3. Altitude plots for each spiral or ramp flight segment. These plots show the vertical distribution of static air temperature and dew/frost points plotted vs. altitude with time as a secondary axis.

The Project Office will also produce 10-second averages of the housekeeping and ancillary data recorded during each flight formatted in GTE Data Archive Format, and recorded on 3.5" floppy disks. These may be copied and used by investigator groups. The original video recordings will be available for viewing in the field. Copies of these videotapes will be distributed upon request post mission.

6.5.2 Data Products Distribution

The DC-8 DADS data (Table F4, Appendix F) will be converted to the GTE Archive Format under the direction of the GTE Data Manager. The resulting data product will be distributed in concert with final meteorological products to the Science Team 60 days following the mission. Data recorded by the GTE PDS on board the P-3B aircraft will also be distributed to the Science Team 60 days following the mission.

Parameters to be included in these final data products are identified in the Data Products Tables.

6.5.3 Archival Products

The Project Office serves as a central repository and distribution center for all data products obtained during the TRACE-P mission. The mission archive consists of all measurements and/or model products developed as part of the TRACE-P mission. Each investigator is responsible for submitting preliminary field results to the GTE Data Manager, or his designee, within 24 hours after each flight for distribution to the Science Team during the mission. Final validated results from the mission must be submitted to the GTE Data Manager within 60 days following completion of the field deployment phase. The GTE Data Manager is responsible for submitting the TRACE-P data to the Langley Distributed Active Archive Center, which will be the repository for all the mission data.

The Project Office, with the Co-Mission Meteorologists, will arrange for the acquisition, and subsequent distribution to the Science Team, of meteorological data supporting the mission objectives. These data include meteorological products for flight planning and post mission products to support analysis and publication of results.

Data platforms, measurement techniques, species measured, and modeling activities are described in section 4.0. Measurements and products included in the archive are listed in Tables 4.2-1, 4.2-2, and 4.7-1. Meteorological data sources are discussed in Section 5.4 and meteorological products to be submitted to the archive are listed in Table 5.4-1. All data products should be submitted in the GTE Data Archive Format (Appendix E, published as a separate document). Schedules for submission of data to the archive and distribution of the archive are given in Table 8.3-1.

6.5.4 Expedition Archive

The final data submitted by the investigators will be scanned by the GTE Project Office to ensure that the data has been submitted in the proper format prior to release to the public domain. Public release of the expedition archive will be to the Langley DAAC (refer to Section 6.1.6).

6.6 Data Analysis/Publication Plan

Early and comprehensive publication of GTE TRACE-P results is a primary objective of the Science Team. Each PI is responsible for producing publication products in support of this objective. All published data must be submitted to the mission archive.

6.6.1 Data Workshops

Three data workshops are anticipated following the mission. Data Workshop 1 will provide the first opportunity for participants to discuss and review the complete set of field measurements. Data Workshop 2, following the submittal of model results, will focus on model/measurement results and initiation of outlines for journal papers. Data Workshop 3 will be scheduled at the first workshop and focus on review of draft manuscripts. The schedule for data workshops 1 and 2 are given in Section 8.3.

6.6.2 Conference Presentation

Oral presentations of selected results by investigators prior to manuscript submission to the selected journal may take place at a conference to be determined by the TRACE-P Science Team at the first workshop. Copies of presentation abstracts shall also be sent to the GTE Project Manager at the time of submittal to the conference. Presentation of results at other meetings before manuscript submission must be approved by the Science Team.

6.6.3 Journal Special Issue

Initial publication of results from the TRACE-P Expedition will be in a special issue of an appropriate journal to be determined by the Science Team at the first workshop. Copies of papers should be sent to the GTE Project Manager for inclusion in the mission archive and for summary in the overview paper of significant results.

6.6.4 Collaborating Science Team Usage of Measurements

The protocol for exchange of TRACE-P measurements and data products with other collaborating Science Teams will be governed by agreements between the respective Science Teams and signed by the GTE Project Office and the respective representative of the collaborating Science Team. Collaboration between all such Science Teams requires the approval of the GTE Program Manager.

 

Back to Expedition Plan Table of Contents