SolarSoft Overview

The SolarSoft system (SSW) is a set of integrated software libraries, databases, and system utilities which provide a common programming and data analysis environment for solar physics. The SolarSoft environment provides a consistent look and feel at widely distributed co-investigator institutions to facilitate data exchange and to stimulate coordinated analysis. The use of common libraries, utilities, techniques and interfaces minimizes the learning curve for investigators who are analyzing new solar data sets, correlating results from multiple experiments or performing research away from their home institution.

A large and growing software resuse library is the heart of the SolarSoft system. Routines in this library are instrument and mission independent, and available to all users for analysis and application development. This library represents an evolutionary system, dating back to Solar Maximum Mission (SMM) analysis at the Solar Data Analysis Center (SDAC) at Goddard Spaceflight Center (GSFC). It has since evolved through the Yohkoh and SoHO missions, and now includes contributions from TRACE, HESSI, and many other orbital and ground based solar observatory PI groups.

SolarSoft Maintenance and Administration - Current Status and History

The master copy of SolarSoft and support utilities is maintained at the Solar Data Analysis Center at GSFC. This is also the master site for the general purpose SSW library. All additions and modifications are logged, and backup copies of modified modules are maintained by the SSW online utility. Additional protection is provided by the SDAC system facilities, which include multiple levels of automated backup and disk recovery.

Principle Investigator (PI) teams from each participating instrument define and control the master libraries and data bases for the individual instruments. These instrument and mission level master sites are widely distributed, and currently include institutes in Japan, England, France, Switzerland, and many locations within the United States.

SolarSoft utilities running on the SSW master site at GSFC mirror from the the various instrument master sites into the SSW master for centralized integration and distribution. Due to the very large number of contributing sites and routines, background utilities (written in SSW) monitor incoming additions and flag potential conflicts within the integrated system. Additional SSW utilities monitor modifications and sizes of software libraries and data bases to generate system files required by the installation and upgrade utilities.

In close coordination with scientists and programmers from the SDAC and various SoHO Co-I groups, the original design, implementation, and administration of SolarSoft was supported under NASA contracts to LMSAL for Yohkoh/SXT, SoHO/EIT and TRACE (NAS8-40108, NAS5-32966, and NAS5-38099). The use of MO&DA funding during the development and implentation phases of SSW evolution was clearly justified since each of those data analysis systems benefited from identification and use of common software and techniques. Moreover, the ability to have a single, common analysis environment was crucial for simplified and meaningful coordinated analysis. Likewise, integration of addtional ancillary solar data and software support provides contextual data for each of those instruments. SolarSoft also provides a single point system for remote installations and automated upgrades of all participating missions and instruments with an associated savings in manpower for all PI teams.

SolarSoft - Future Administration, Maintenance and Expansion

As the number of SSW contributors and PI participants has now expanded to include the data analysis systems from many additional orbital and ground based observatories, we propose that specific SolarSoft funding should replace the existing instrument specific contractual funding. Although one design goal of SSW was to make new instrument integration approach 'plug and play', each new branch still requires mulitple exchanges between the SSW administrator and the PI team members. We currently provide guidance to PI teams in the application of existing SSW setup utilities and conflicts identification to simplify integration. This is a fundamental process, since it assures that multiple instrument and coordinated data analysis is possible within a single SSW session.

One often cited problem with the current SSW system is that the software libraries are so extensive that it often difficult for a PI team to know what capabilities exist and which subset of SSW is most appropriate for a given instrument application. We propose to expand the current level of PI integration and documentation level support to include more detailed guidance in the applications of SolarSoft. It is quite common that many man-weeks of effort are wasted to reinvent an existing SSW capability or in struggling to implement something using the wrong utility. Not only does this waste PI group time which is better spent on detailed instrument calibration and software, but it short circuits the evolution of more powerful SSW capabilities. We can often head off these wasted efforts by a simple phone, email, or documentation exchange, if we know about the desired application.

With the help of several groups, including Mullard Space Sciences Laboratory (MSSL), the HESSI PI team, and several SSW contributors at the SDAC, we have made significant advances over the past year to document a subset of fundamental SSW capabilities. In addition to expanding and organizing the SSW documentation to increase its' utility, we propose to compile and post SSW FAQs and implement some method of threaded user exchange. In addition to responses from the SSW administrators, we would invite and encourage all participating PI groups and SSW users to contribute solutions and tips in addition to questions and suggestions.

Continuation of SoHO/EIT Support

We will continue to support and enhance the EIT data analysis system. In coordination with the EIT team at the SDAC, we will identify and prioritize open issues and areas of desired enhancement. We will extend SSW tools for coordinated access, analysis, and visualization of EIT in concert with contextual data from other SoHO and SSW instrument data sets. We will continue our developemnent of automated feature detection software and analysis of the EIT results. Originally developed under NAS5-32966 for the detection of EIT He304 limb features, we have recently expanded the capabilities to include on disk features for any SSW imager (using supplemental LMSAL IRAD funding). We will provide the mission long catalogs for all four EIT wavelengths in addition to a tutorial on the catalog contents and access, and WWW summaries of the catalog contents. We will also install SDAC jobs to automatically extend the feature catalogs as new EIT LZ data is added to the SDAC archive. It is expected that these feature parameter catalogs for EIT and other SSW instruments will have direct space weather implications and LWS applications.

SolarSoft - Proposed Activities for New Mission Integration

HESSI

During the past year, we have coordinated with the HESSI team to assure full integration of the HESSI analysis system with the rest of SSW. During this period, and with large contributions from the HESSI team, we have extended the SSW installation and remote upgrade capabilities for ALL SSW instruments to PCs running Windows (95,98,NT,2000). The UNIX and PC installations now use a common WWW FORM for remote customized installations.

During the pre and post HESSI launch phases, we expect increased activity and demands on the SolarSoft system, both from the HESSI Co-I teams and SSW users interested in HESSI analysis. We will coordinate with the SDAC and HESSI group in areas of HESSI quicklook catalog and event summaries which will be made available to remote sites from the SDAC using the automated SolarSoft data base distribution (SSWDB) system.

We have had preliminary discussions with the HESSI team about providing SSW data sets and WWW summaries which will assist in visualization of the HESSI image context. For example, we will provide automated composites of HESSI flare images embeded in full disk contextual SSW images, including EIT, SXT (and eventually SXI) for each flare in the HESSI event catalog. We will provide the HESSI team guidance on use of SSW WWW movie making capabilities as requested. We will provide a utility for automated cross reference between HESSI and TRACE to identify, extract and process TRACE contextual images for each HESSI event, an admittedly trivial task using existing SSW capabilities.

SXI-M

We have had some preliminary discussions with the SXI-M group at the SEC. Since they are generating the image data as standard FITS data and including the SSW suggested set of tags to describe observation time and field of view parameters, the images should plug into many existing SSW utilities, including feature tracking, movie making and Mapping package (Zarro) used for coordinated SSW image analysis. We will provide the SXI-M team with additional guidance in the application of existing SSW deconvolution capabilities. We will coordinate with the SDAC about maintaining a recent queue of SXI data online for integration into an SSW session. In coordination with the PI team, we will install the job which will Mirror from the SXI-M master at the SEC into the corresponding branch of the SSW master at the SDAC.

Future Missions

We will coordinate with and assist other PI teams from existing and future missions who wish to participate in SolarSoft during this contractual period. We project some level of interaction regarding future integration and application of existing SSW capabilities with the PI teams from SXI-N/O, Stereo, Solar-B, and Living With a Star investigators.

References

Freeland, S.L., and Handy, B.N., 1998, 
"Data Analysis with the SolarSoft System ", Solar Physics, 182, 497. 

Freeland, S.L. and Bentley, R.D., 2000, "SolarSoft", 
Encyclopedia of Astronomy and Astrophysics, Inst of Physics Publishing.

Freeland, S., http://www.lmsal.com/solarsoft/ SolarSoft description and 
links to SSW installation, analysis concepts, standards, and other 
related documents (World Wide Web) 

Svestka, Z., Uchida, Y., ed. 1991, The Yohkoh (Solar-A) Mission, 
(Dordrecht:Kluwer) 

Fleck, B., Domingo, V., Poland, A., ed. 1995, The SOHO Mission, 
(Dordrecht:Kluwer) 

Zarro, D.M., 2000, "Object-Based Methods for Analyzing Solar Images"
http://orpheus.nascom.nasa.gov/~zarro/idl/maps.html (World Wide Web)

------------------------------------------------------------------

freeland@sxt1.lmsal.com