PRISM WP4a

Work package title Development of Data Generation, Diagnostic and Visualization Tools

Start date or starting event 1

Required input Definition of the common PRISM metadata and data formats. Definition of the interface to the output library. Description of operations required for the processing library.

Lead contractor for this package 4

Required resources 180 person-month (90 requested from EU)

Contributing partners 4 6 3 2 19 18 20 21

Person-months (inst/EU) 18/18 12/12 12/12 21/21 9/9 2/2 10/10 6/6

Objectives
To provide a library that can generate output from PRISM models in the supported PRISM data formats. To provide a flexible library of tools to facilitate processing and analysis of data in the common PRISM data format and to promote sharing of data and analysis programs. To provide high-end and low-end graphical interfaces to display the data.

Description of work
An output library meeting the requirements of the defined interface will be written and tested to evaluate its ability to write data from the model into files with the chosen data formats and the common metadata convention. The library will then be optimised for the various architectures on which the PRISM system will run. This task includes machine independent vectorization and parallelisation.

Data produced and needed by the various models will reside on different computers. To accelerate this exchange of data between the user and the model an efficient method needs to be implemented. Software allowing such a remote and partial access exists but an implementation is needed which makes best use of the common PRISM data format and which takes into account the diversity of hardware. In order to do this, utilities will be needed for conversion between the common data format and any of the local data formats, which the climate centres decide will continue to be used in the future. Such utilities will be the responsibility of those institutions to provide.

The template for the processing library will be implemented as a software library. The language used will be chosen according to the requirements that it can pipe its output into graphics packages, it can manipulate data and metadata together (e.g. using derived data types or objects), it can be compiled and run on any machine and preferably that it is widely used and non-proprietary. If possible, existing processing software will be built upon in producing the library. The library will be able to read and write data in the common data format. An analysis program will be written with this library to demonstrate its usefulness for data from any PRISM model in the common format.

Existing graphic packages will be surveyed to identify the operations, which are required to use them for the analysis programs developed in PRISM. A low-end graphical display of PRISM data will be demonstrated and a high-end graphical display system will be developed together with the vendors.

Deliverables
D4a1 A first version of the output library which can be used in models, thus validating the user interface

D4a2 An performance benchmark for the output library representative of PRISM

D4a3 An optimised version of the output library which takes into account the performance enhancement possible on the various hardware used by the PRISM system

D4a4 A remote data access system will be implemented which allows for the user remote access to model output and for the model to read in ancillary data sets.

D4a5 Review of existing graphics packages and definition of common requirements for graphics for ordinary analysis purposes (low-end) and high-quality presentational purposes (high-end).

D4a6 A developed processing library that meets the architectural requirements, delivers the functionality defined in D4a5 and agrees with the data formats of D4a2.

D4a7 Identification or provision of graphics packages which meet the low-end and high-end graphics requirements.

D4a8 A demonstration programme including high-end and low-end graphical display using the defined data formats.

D4a9 A final report providing advice to members on development of existing systems to allow continued integration and proposing future development areas.

Milestones

Month 12: Completion of D4a1, D4a2, D4a5

Month 24: Completion of D4a3, D4a4

Month 30: Completion of D4a6 and D4a7

Month 36: Completion of D4a8 and D4a9

Meetings	appointed day, agendas, minutes
Deliverables	WP4a Deliverables and Partner Responsibilities
Slides	Collection of slides, shown at the meetings
Data Analysis Questionnaire	WP4a Call for Input Questionnaire - Data Analysis
Display System Questionnaire	WP4a Call for Input Questionnaire - Display System
Processing Library	Documents relating to the data processing library

Low-End	miscellaneous informations, plots and scripts
High-End	miscellaneous informations

Drafts	Reports

Work package title	Development of Data Generation, Diagnostic and Visualization Tools
Start date or starting event	1
Required input	Definition of the common PRISM metadata and data formats. Definition of the interface to the output library. Description of operations required for the processing library.
Lead contractor for this package	4
Required resources	180 person-month (90 requested from EU)
Contributing partners	4	6	3	2	19	18	20	21
Person-months (inst/EU)	18/18	12/12	12/12	21/21	9/9	2/2	10/10	6/6
Objectives To provide a library that can generate output from PRISM models in the supported PRISM data formats. To provide a flexible library of tools to facilitate processing and analysis of data in the common PRISM data format and to promote sharing of data and analysis programs. To provide high-end and low-end graphical interfaces to display the data.
Description of work An output library meeting the requirements of the defined interface will be written and tested to evaluate its ability to write data from the model into files with the chosen data formats and the common metadata convention. The library will then be optimised for the various architectures on which the PRISM system will run. This task includes machine independent vectorization and parallelisation. Data produced and needed by the various models will reside on different computers. To accelerate this exchange of data between the user and the model an efficient method needs to be implemented. Software allowing such a remote and partial access exists but an implementation is needed which makes best use of the common PRISM data format and which takes into account the diversity of hardware. In order to do this, utilities will be needed for conversion between the common data format and any of the local data formats, which the climate centres decide will continue to be used in the future. Such utilities will be the responsibility of those institutions to provide. The template for the processing library will be implemented as a software library. The language used will be chosen according to the requirements that it can pipe its output into graphics packages, it can manipulate data and metadata together (e.g. using derived data types or objects), it can be compiled and run on any machine and preferably that it is widely used and non-proprietary. If possible, existing processing software will be built upon in producing the library. The library will be able to read and write data in the common data format. An analysis program will be written with this library to demonstrate its usefulness for data from any PRISM model in the common format. Existing graphic packages will be surveyed to identify the operations, which are required to use them for the analysis programs developed in PRISM. A low-end graphical display of PRISM data will be demonstrated and a high-end graphical display system will be developed together with the vendors.
Deliverables D4a1 A first version of the output library which can be used in models, thus validating the user interface D4a2 An performance benchmark for the output library representative of PRISM D4a3 An optimised version of the output library which takes into account the performance enhancement possible on the various hardware used by the PRISM system D4a4 A remote data access system will be implemented which allows for the user remote access to model output and for the model to read in ancillary data sets. D4a5 Review of existing graphics packages and definition of common requirements for graphics for ordinary analysis purposes (low-end) and high-quality presentational purposes (high-end). D4a6 A developed processing library that meets the architectural requirements, delivers the functionality defined in D4a5 and agrees with the data formats of D4a2. D4a7 Identification or provision of graphics packages which meet the low-end and high-end graphics requirements. D4a8 A demonstration programme including high-end and low-end graphical display using the defined data formats. D4a9 A final report providing advice to members on development of existing systems to allow continued integration and proposing future development areas.
Milestones Month 12: Completion of D4a1, D4a2, D4a5 Month 24: Completion of D4a3, D4a4 Month 30: Completion of D4a6 and D4a7 Month 36: Completion of D4a8 and D4a9

WP4a detailed description