Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Reanalysis data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Climate Analytics as a Service

Climate science is a big data domain that is experiencing unprecedented growth. In our efforts to address the big data challenges of climate science, we are moving toward a notion of Climate Analytics-as-a-Service (CAaaS). CAaaS combines high-performance computing and data-proximal analytics with scalable data management, cloud computing virtualization, the notion of adaptive analytics, and a domain-harmonized API to improve the accessibility and usability of large collections of climate data. MERRA Analytic Services (MERRA/AS) provides an example of CAaaS. MERRA/AS enables MapReduce analytics over NASA's Modern-Era Retrospective Analysis for Research and Applications (MERRA) data collection. The MERRA reanalysis integrates observational data with numerical models to produce a global temporally and spatially consistent synthesis of key climate variables. The effectiveness of MERRA/AS has been demonstrated in several applications. In our experience, CAaaS is providing the agility required to meet our customers' increasing and changing data management and data analysis needs.

big data↗

Non-Gaussian Ensemble Filtering and Adaptive Inflation for Soil Moisture Data Assimilation

The rank histogram filter (RHF) and the ensemble Kalman filter (EnKF) are assessed for soil moisture estimation using perfect model (identical twin) synthetic data assimilation experiments. The primary motivation is to gauge the impact on analysis quality attributable to the consideration of non-Gaussian forecast error distributions. Using the NASA Catchment land surface model, the two filters are compared at 18 globally-distributed single-catchment locations for a 10-year experiment period. It is shown that both filters yield adequate estimates of soil moisture, with the RHF having a small but significant performance advantage. Most notably, the RHF systematically increases the normalized information contribution (NIC) score of the mean absolute bias by 0.05 over that of the EnKF for surface, root-zone and profile soil moisture. The RHF also increases the NIC score for the anomaly correlation of surface soil moisture by 0.02 over that of the EnKF (at a 5% significance level). Results also demonstrate that the performance of both filters is somewhat improved when the ensemble priors are adaptively inflated to offset the negative effects of systematic errors.

Soil moisture↗

Cloud-Based Time Series Analysis of Extremes: Use Cases and Applications

"Extreme weather events, such as hurricanes, tornadoes, floods, droughts, heatwaves, and blizzards, can cause widespread damage, disrupting ecosystems, agricultural production, and economies. The frequency and intensity of these events have been increasing, likely due to climate change, raising concerns and the need for more accurate analysis and predictions. NASA's Goddard Earth Sciences Data and Information Services Center (GES DISC) has migrated its long-term historical datasets, including precipitation data from MERRA-2 reanalysis, GLDAS land data assimilation, and IMERG satellite observations, to the cloud. This cloud-stored data enables scientists and researchers to utilize cloud computing for advanced modeling and forecasting of extreme weather events, eliminating the need to download large datasets. In this presentation, we will provide an overview of the cloud-based data and services managed by GES DISC; demonstrate methods for accessing and analyzing time series data stored in the cloud; and compare results across various datasets to address critical questions related to extreme precipitation. We will present use cases including: 1. Determining the average total precipitation in California during January and February from 2000 to 2024, and identifying anomalous precipitation in 2021. 2. Calculating the 10, 20, 50, and 100-year return periods for maximum daily rainfall based on 25 years of historical precipitation data (2000-2024) for Maryland.

time series↗

Trends in sulfur dioxide over the Indian subcontinent during 2003–2019

Sulfur dioxide (SO2) and its oxidation products profoundly impact the air quality and climate. In recent decades, contrasting SO2 trends have been observed over different regions of the globe due to urbanization, energy generation and control measures. In this study, we have investigated the SO2 trends over the rapidly developing Indian subcontinent using model reanalysis, satellite data, and emission inventories during 2003–2019 period. Copernicus Atmosphere Monitoring Service (CAMS) reanalysis shows rapid SO2 growth up to 0.4 ppbv/yr during 2003–2009, particularly significant over the Indo-Gangetic Plain (IGP) and eastern India. However, the growth becomes slower after 2010 and is followed by a stabilization or slight reduction. The CAMS results agree with the satellite-based observations, however, the model underestimates enhancements over eastern India. The analysis of inventory datasets also suggests slower growths in SO2 emissions and coal-fired electricity generation in recent years. Besides the changes in regional emissions, the enhancements in water vapor and OH radical coinciding with SO2 stabilization indicate strengthening of the sink processes. Model simulation (Modern-Era Retrospective analysis for Research and Applications version 2―MERRA-2) with constant emissions shows reduction in SO2 which confirms the stronger chemical losses. Overall, the SO2 trends over the Indian subcontinent are found to be a manifestation of the combined effects of the regional emission change and chemistry. Our findings highlight the need for studies to assess the impacts of changing SO2 trends in India on the regional and global climate.

Lakhima Chutia↗

Multidecadal Changes in the UTLS Ozone from the MERRA-2 Reanalysis and the GMI Chemistry Model

Long-term changes of ozone in the UTLS (Upper Troposphere / Lower Stratosphere) reflect the response to decreases in the stratospheric concentrations of ozone-depleting substances as well as changes in the stratospheric circulation induced by climate change. To date, studies of UTLS ozone changes and variability have relied mainly on satellite and in-situ observations as well as chemistry-climate model simulations. By comparison, the potential of reanalysis ozone data remains relatively untapped. This is despite evidence from recent studies, including detailed analyses conducted under SPARC (Scalable Processor Architecture) Reanalysis Intercomparison Project (S-RIP), that demonstrate that stratospheric ozone fields from modern atmospheric reanalyses exhibit good agreement with independent data while delineating issues related to inhomogeneities in the assimilated observations. In this presentation, we will explore the possibility of inferring long-term geographically and vertically resolved behavior of the lower stratospheric (LS) ozone from NASA's MERRA-2 (Modern-Era Retrospective Analysis for Research and Applications -2) reanalysis after accounting for the few known discontinuities and gaps in its assimilated input data. This work builds upon previous studies that have documented excellent agreement between MERRA-2 ozone and ozonesonde observations in the LS. Of particular importance is a relatively good vertical resolution of MERRA-2 allowing precise separation of tropospheric and stratospheric ozone contents. We also compare the MERRA-2 LS ozone results with the recently completed 37-year simulation produced using Goddard Earth Observing System in "replay" mode coupled with the GMI (Global Modeling Initiative) chemistry mechanism. Replay mode dynamically constrains the model with the MERRA-2 reanalysis winds, temperature, and pressure. We will emphasize the areas of agreement of the reanalysis and replay and interpret differences between them in the context of our increasing understanding of model transport driven by assimilated winds.

Ozone↗

A Comparison of Pre‐Construction and Operational Wake Loss Estimates for Land‐Based Wind Plants

The overall bias between pre‐construction energy yield assessment (EYA) estimates of wind plant energy production and the achieved operational production is improving in the wind industry, but uncertainty remains high for individual wind plants. Wake effects within wind plants are one of the largest sources of energy loss considered in the EYA process, and previous work shows wake loss estimates to be a major source of disagreement among wind energy consultants who perform EYAs. To better understand the accuracy of wake loss predictions, we compare overall operational wake loss estimates based on supervisory control and data acquisition data to pre‐construction estimates provided by six wind energy consultants for five land‐based wind plants in North America. By augmenting existing approaches for quantifying operational wake losses, we estimate wake losses during the period of record for which operational data are available as well as the expected long‐term wake losses, based on historical reanalysis weather data, to which the EYA estimates are compared. To account for power variations at different turbine locations caused by terrain‐induced wind resource heterogeneity, we correct the operational wake loss estimates using predicted freestream wind speed variations from the Wind Systems Engineering Reynolds‐averaged Navier–Stokes (RANS) tool. We identify long‐term corrected operational wake losses between 1.9% and 6.4% for the five plants, with a mean loss of 4%. For the project deemed most acceptable for operational wake loss assessment, which is located in the simplest terrain and isolated from neighboring plants, the mean EYA wake loss estimate is within 0.7 percentage points of the operational value of 6.4%. For most of the remaining plants, results suggest that wake losses are generally overpredicted by 2.6–6.3 percentage points. However, operational wake losses may be underestimated for many of these projects because of spatial wind resource variations not captured by the RANS model, external wake effects that are unaccounted for in the estimation process, and wind plant blockage effects. To better understand factors that contribute to the observed wake losses, we investigate operational wake losses as a function of wind direction and wind speed. As expected, wake losses are generally concentrated near wind directions that are aligned with rows of closely spaced turbines and at below‐rated wind speeds; however, for some projects, the energy produced by the wind plant exceeds the estimated potential energy of the plant without wake interactions for certain wind directions and wind speeds, suggesting inaccurate assumptions in the wake loss estimation method for those plants. Lastly, we compare predicted and operational wake losses for individual wind turbines, finding that even when overall wake losses are predicted accurately, large uncertainty exists at the turbine level.

17 WIND ENERGY↗

Polar Vortex Outbreak Air Transport: Observation using Satellite IR Sounder Derived Ozone Product and Comparison with Model

The Single Field of View (SFOV) Sounder Atmospheric Products (SiFSAP) derived from Cross-track Infrared Sounder (CrIS) on SNPP and JPSS have a spatial resolution ( ~14.5 km) better than most global weather and climate models. Most recent significant improvement in the quality of these products enables us to use these high-resolution observation-based sounding data for weather studies and model evaluation. The aim of this study is to explore the value to use these SFOV products for studying the dynamic transport associated with polar vortex outbreak. In a few cases studies, we used SiFSAP products, especially ozone, as well as the data of wind, geopotential height (GPH) and potential velocity (PV) from the fifth-generation ECMWF reanalysis (ERA5) data, to analyze the variation of total ozone, relative humidity and ozone in different layers, as well as their correlation with GPH and PV. Some comparison of the retrieved temperature and water vapor with ERA5 data, and ozone with the Ozone Mapping and Profiler Suite (OMPS) measurements have also been made. It is found (1) the transport of O3-riched polar air accompanying the polar vortex breakup to lower latitude and lower atmosphere, and (2) the transport path of O3 agreeing well with the path of polar cold air (illustrated using the retrieved RH, wind fields and GPH). These results demonstrate the 3-D structure of O3 distribution as derived from CrIS measurements provides some insights of the cold air transport, and can be used to track the dynamic transport of polar cold air following the outbreak of polar vortex. The observed enhancement of O3 following the polar vortex outbreak also suggests some possible linkage between the tropospheric cold air advected with stratospheric air source.

Xiaozhen Xiong↗

Valence 1⁢𝑠−0⁢𝑑 proton vacancy of the 32 Si ground state

The 32 Si( 3 He,d) 33 P reaction was studied in inverse kinematics at 6.3 MeV/u. States in 33 P corresponding to the proton 1s-0d single-particle orbitals were identified up to ≈ 4.5 MeV in excitation energy. The ( 3 He,d) spectroscopic factors were determined from distorted-wave Born approximation calculations. When combined with complementary neutron-adding data, the 1s-0d proton vacancies in the 32 Si ground state were extracted. In conjunction with a reanalysis of data from previous single-particle measurements, the trends in proton and neutron vacancy were explored across the 28,30,32,34 Si isotopes. Both proton and neutron vacancy data show gradual changes in their occupancies. The proton 1s 1/2 orbitals in 32 Si and 34 Si are both consistent with being empty. In conclusion, the ground-state nucleon distributions are described by shell-model calculations constrained to the 1s-0d model space.

Watwood, N. [Argonne National Laboratory (ANL), Ar↗

Hot gas in the interstellar medium: A reanalysis of O VI absorption data

The Copernicus O(+5) column densities toward 72 stars provide a rare and valuable tracer of 10(exp 5.5) K gas in the interstellar medium. The original analysis of the data by Jenkins provided important clues about the distribution of interstellar O(+5) ions, but our understanding of the local interstellar medium has since grown substantially. We revisit that work, including the possibility that local hot gas may contribute a significant O(+5) column density to most lines of sight. Our reanalysis also includes slight improvements in the statistics and was found to be reliable when tested on simulated data sets. In the end, we come to conclusions about the distribution of interstellar O(+5) ions that differ considerably from those of the original analysis. With our reanalysis, some theoretical models now show promise. For example, our Local Bubble column density compares favorably with the estimated quantity of O(+5) within the remnant of an ancient local explosion. Similarly, our mean O(+5) column density per feature in more distant regions is like that found in models of hot interstellar bubbles from either stellar winds or ancient supernova explosions in a warm diffuse interstellar environment, suggesting that the hot gas in interstellar space may exist primarily within discrete regions of modest volume occupation rather than in a continuous and pervasive phase.

Shelton, R. L.↗

The Sensitivity of African Easterly Waves to Eastern Tropical Atlantic Sea-Surface Temperatures

The results of two regional atmospheric model simulations are compared to assess the influence of the eastern tropical Atlantic sea-surface temperature maximum on local precipitation, transient easterly waves and the West African summer monsoon. Both model simulations were initialized with reanalysis 2 data (US National Center for Environmental Prediction and Department of Energy) on 15 May 2006 and extended through 6 October 2006, forced by synchronous reanalysis 2 lateral boundary conditions introduced four times daily. One simulation uses 2006 reanalysis 2 sea-surface temperatures, also updated four times daily, while the second simulation considers ocean forcing absent the sea-surface temperature maximum, achieved here by subtracting 3 K at every ocean grid point between 0 and 15 N during the entire simulation. The simulation with 2006 sea-surface temperature forcing produces a realistic distribution of June-September mean precipitation and realistic westward propagating swaths of maximum rainfall, based on validation against Tropical Rainfall Measuring Mission (TRMM) estimates. The simulation without the sea-surface temperature maximum produces only 57% of the control June-September total precipitation over the eastern tropical Atlantic and about 83% of the Sahel precipitation. The simulation with warmer ocean temperatures generates generally stronger circulation, which in turn enhances precipitation by increasing moisture convergence. Some local precipitation enhancement is also attributed to lower vertical thermal stability above the warm water. The study shows that the eastern tropical Atlantic sea-surface temperature maximum enhances the strength of transient easterly waves and broadens the spatial extent of associated precipitation. However, large-scale circulation and its interaction with the African continent, and not sea-surface temperatures, control the timing and trajectories of the waves.

Druyan, Leonard M.↗

Parallel Grid Manipulations in Earth Science Calculations

The National Aeronautics and Space Administration (NASA) Data Assimilation Office (DAO) at the Goddard Space Flight Center is moving its data assimilation system to massively parallel computing platforms. This parallel implementation of GEOS DAS will be used in the DAO's normal activities, which include reanalysis of data, and operational support for flight missions. Key components of GEOS DAS, including the gridpoint-based general circulation model and a data analysis system, are currently being parallelized. The parallelization of GEOS DAS is also one of the HPCC Grand Challenge Projects. The GEOS-DAS software employs several distinct grids. Some examples are: an observation grid- an unstructured grid of points at which observed or measured physical quantities from instruments or satellites are associated- a highly-structured latitude-longitude grid of points spanning the earth at given latitude-longitude coordinates at which prognostic quantities are determined, and a computational lat-lon grid in which the pole has been moved to a different location to avoid computational instabilities. Each of these grids has a different structure and number of constituent points. In spite of that, there are numerous interactions between the grids, e.g., values on one grid must be interpolated to another, or, in other cases, grids need to be redistributed on the underlying parallel platform. The DAO has designed a parallel integrated library for grid manipulations (PILGRIM) to support the needed grid interactions with maximum efficiency. It offers a flexible interface to generate new grids, define transformations between grids and apply them. Basic communication is currently MPI, however the interfaces defined here could conceivably be implemented with other message-passing libraries, e.g., Cray SHMEM, or with shared-memory constructs. The library is written in Fortran 90. First performance results indicate that even difficult problems, such as above-mentioned pole rotation- a sparse interpolation with little data locality between the physical lat-lon grid and a pole rotated computational grid- can be solved efficiently and at the GFlop/s rates needed to solve tomorrow's high resolution earth science models. In the subsequent presentation we will discuss the design and implementation of PILGRIM as well as a number of the problems it is required to solve. Some conclusions will be drawn about the potential performance of the overall earth science models on the supercomputer platforms foreseen for these problems.

Sawyer, W.↗

Assimilating GCOM-W1 AMSR2 and TRMM TMI Radiance Data in GEOS Analysis and Reanalysis

The Tropical Rainfall Measurement Mission (TRMM) Microwave Imager (TMI) observed the Earth in lower latitudes between 1997 - 2015. Its conical-scan radiometer has nine channels and measured microwave radiances between 10 and 89 GHz. These data provide information on atmospheric temperature, humidity, clouds, precipitation, as well as sea surface temperature. Radiance data from other microwave radiometers such as Special Sensor Microwave Imager (SSM/I) and Special Sensor Microwave Imager Sounder (SSMIS) onboard various Defense Meteorological Satellite Program (DMSP) satellites are assimilated in clear-sky conditions in the Modern-Era Retrospective analysis for Research and Applications (MERRA) and its version 2 (MERRA-2) data sets at the Global Modeling and Assimilation Office (GMAO) at NASA Goddard Space Flight Center. The GMAO's Hybrid 4D-EnVar-based Atmospheric Data Assimilation System (ADAS) is enhanced with an all-sky microwave radiance data assimilation capability in the real-time GEOS-Forward Processing (FP) system. Currently, the FP system assimilates Global Precipitation Measurement (GPM) microwave imager (GMI) radiance data utilizing this all-sky capability, and is being extended to use more all-sky data from other microwave radiometers. In this presentation, we will focus on impacts of all-sky TMI radiance data on GEOS analyses of atmospheric moisture, precipitation and other fields, and discuss their applications for future GEOS reanalyses.

Jin, Jianjun↗

Characterizing climate pathways using feature importance on echo state networks

The 2022 National Defense Strategy of the United States listed climate change as a serious threat to national security. Climate intervention methods, such as stratospheric aerosol injection, have been proposed as mitigation strategies, but the downstream effects of such actions on a complex climate system are not well understood. The development of algorithmic techniques for quantifying relationships between source and impact variables related to a climate event (i.e., a climate pathway) would help inform policy decisions. Data-driven deep learning models have become powerful tools for modeling highly nonlinear relationships and may provide a route to characterize climate variable relationships. In this paper, we explore the use of an echo state network (ESN) for characterizing climate pathways. ESNs are a computationally efficient neural network variation designed for temporal data, and recent work proposes ESNs as a useful tool for forecasting spatiotemporal climate data. However, ESNs are noninterpretable black-box models along with other neural networks. The lack of model transparency poses a hurdle for understanding variable relationships. We address this issue by developing feature importance methods for ESNs in the context of spatiotemporal data to quantify variable relationships captured by the model. We conduct a simulation study to assess and compare the feature importance techniques, and we demonstrate the approach on reanalysis climate data. In the climate application, we consider a time period that includes the 1991 volcanic eruption of Mount Pinatubo. This event was a significant stratospheric aerosol injection, which acts as a proxy for an anthropogenic stratospheric aerosol injection. Furthermore, we are able to use the proposed approach to characterize relationships between pathway variables associated with this event that agree with relationships previously identified by climate scientists.

black-box models↗

A Study on the Potential Applications of Satellite Data in Air Quality Monitoring and Forecasting

In this study we explore the potential applications of MODIS (Moderate Resolution Imaging Spectroradiometer) -like satellite sensors in air quality research for some Asian regions. The MODIS aerosol optical thickness (AOT), NCEP global reanalysis meteorological data, and daily surface PM(sub 10) concentrations over China and Thailand from 2001 to 2009 were analyzed using simple and multiple regression models. The AOT-PM(sub 10) correlation demonstrates substantial seasonal and regional difference, likely reflecting variations in aerosol composition and atmospheric conditions, Meteorological factors, particularly relative humidity, were found to influence the AOT-PM(sub 10) relationship. Their inclusion in regression models leads to more accurate assessment of PM(sub 10) from space borne observations. We further introduced a simple method for employing the satellite data to empirically forecast surface particulate pollution, In general, AOT from the previous day (day 0) is used as a predicator variable, along with the forecasted meteorology for the following day (day 1), to predict the PM(sub 10) level for day 1. The contribution of regional transport is represented by backward trajectories combined with AOT. This method was evaluated through PM(sub 10) hindcasts for 2008-2009, using ohservations from 2005 to 2007 as a training data set to obtain model coefficients. For five big Chinese cities, over 50% of the hindcasts have percentage error less than or equal to 30%. Similar performance was achieved for cities in northern Thailand. The MODIS AOT data are responsible for at least part of the demonstrated forecasting skill. This method can be easily adapted for other regions, but is probably most useful for those having sparse ground monitoring networks or no access to sophisticated deterministic models. We also highlight several existing issues, including some inherent to a regression-based approach as exemplified by a case study for Beijing, Further studies will be necessa1Y before satellite data can see more extensive applications in the operational air quality monitoring and forecasting.

Li, Can↗

Intercomparison of Latent Heat Fluxes Over Global Oceans

Turbulent fluxes of momentum, moisture, and heat at the air-sea interface are essential for climate studies. Version 2 Goddard Satellite-based Surface Turbulent Fluxes (GSSTF2) has been derived from the Special Sensor Microwave/Imager (SSM/I) radiance measurements. This dataset, covering the period July 1987-December 2000 over global oceans, has a spatial resolution of 1 deg x 1 deg lat-long and a temporal resolution of 1 day. Turbulent fluxes are derived from the SSM/I surface winds and surface air humidity, as well as the 2-m air and sea surface temperatures (SST) of the NCEP/NCAR reanalysis, using a bulk aerodynamic algorithm based on the surface layer similarity theory. The GSSTF2 bulk flux model, and retrieved daily wind stress, latent heat flux, wind speed, and surface air humidity validate well with ship observations of ten field experiments over the tropical and midlatitude oceans during 1991-99. The global distributions of 1988-2000 annual- and seasonal-mean turbulent fluxes show reasonable patterns related to the atmospheric general circulation and seasonal variations. Latent heat fluxes and related input parameters over global oceans during 1992-93 have been compared among GSSTF1 (version 1), GSSTF2, HOAPS (Hamburg Ocean Atmosphere Parameters and Fluxes from Satellite Data), NCEP/NCAR reanalysis, and one based on COADS (Comprehensive Ocean-Atmosphere Data Set). Our analyses suggest that the GSSTF2 latent heat flux, surface air humidity, surface wind, and SST are quite realistic compared to the other four flux datasets examined. However, significant differences are found among these five flux datasets. The GSSTF2, available at http://daac.gsfc.nasa.gov/CAMPAIGN_DOCS/hydrology/hd_gsstf2.O.html, is useful for climate studies.

Chou, Shu-Hsien↗

Investigating Access Performance of Long Time Series with Restructured Big Model Data

Data sets generated by models are substantially increasing in volume, due to increases in spatial and temporal resolution, and the number of output variables. Many users wish to download subsetted data in preferred data formats and structures, as it is getting increasingly difficult to handle the original full-size data files. For example, application research users such as those involved with wind or solar energy, or extreme weather events are likely only interested in daily or hourly model data at a single point (or for a small area) for a long time period, and prefer to have the data downloaded in a single file. With native model file structures, such as hourly data from NASA Modern-Era Retrospective analysis for Research and Applications Version-2 (MERRA-2), it may take over 10 hours for the extraction of parameters-of-interest at a single point for 30 years. The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) is exploring methods to address this particular user need. One approach is to create value-added data by reconstructing the data files. Taking MERRA-2 data as an example, we have tested converting hourly data from one-day-per-file into different data cubes, such as one-month, or one-year. Performance is compared for reading local data files and accessing data through interoperable services, such as OPeNDAP. Results show that, compared to the original file structure, the new data cubes offer much better performance for accessing long time series. We have noticed that performance is associated with the cube size and structure, the compression method, and how the data are accessed. An optimized data cube structure will not only improve data access, but also may enable better online analysis services

reanalysis↗

GEOS-Carb III: Delivering Mature Carbon Flux and Concentration Datasets in Support of NASA's Carbon Monitoring System

The GEOS-Carb project seeks to make high quality, data-driven products that support NASA's Carbon Monitoring System Program. These include bottom-up land and ocean flux estimates along with fossil fuel emissions, all informed by satellite data and the MERRA-2 reanalysis. These flux data support atmospheric carbon products that include both simulations and data assimilation products. We show examples of this work and discuss applications to future mission planning.

Ott, L.↗

Data Mining for Science of the Sun-Earth Connection as a Single System

Establishing the Sun-Earth connection requires overcoming the challenges of exploring the data from past and current missions and leveraging tools and models (data mining) to create an efficient system treatment of the Sun and heliosphere. However, solar and heliospheric environment data constitute a vast source of information whose potential is far from being optimally exploited. In the next decade, the solar and heliospheric community will have to manage the increasing amount of information coming from new missions, improve reanalysis of data from past and current missions, and create new data products from the application of new methodologies. This complex task is further complicated by practical challenges such as different datasets and catalogs in different formats that may require different pre-processing and analysis tools, and the need for numerous analysis approaches that are not all fully optimized for large volumes of data. While several ongoing efforts aim at addressing these problems, the available datasets and tools are not always used to their full potential often due to lack of awareness of available resources. In this paper, we summarize the issues raised and goals discussed by members of the community during recent conference sessions focused on data mining for science.

Sun-Earth connection↗