Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “validation dataset”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,207 records · Page 67

Application of Sweeping Jet Actuators on the NASA Hump Model and Comparison with CFDVAL2004 Experiments

Flow separation control over a wall-mounted hump model was studied experimentally to assess the performance of sweeping jet actuators. Results were compared to that of the 2004 CFD validation experiment (CFDVAL2004), which examined flow separation control with steady suction and unsteady zero-net-mass-flow actuators. Comparisons were carried out at low and high amplitude excitations. In addition to the active flow control methods, a passive flow control method (i.e., vortex generator) was used to complement the dataset. Steady/unsteady surface pressure measurements and surface oilflow visualization were used in the performance assessment of the actuators. The results indicated that the sweeping jet actuators are more effective than the steady suction and unsteady zero-net-mass-flow actuators. For the same momentum coefficient, the sweeping jet actuators produced more flow acceleration upstream of separation, more pressure recovery downstream, and consistently a smaller separation bubble.

Koklu, Mehti↗

Quality-Controlled Meteorological Data from the Flood Control District of Maricopa County (FCDMC) Network, Phoenix, Arizona (1987-2024)

This dataset contains 15- or 30-minute interval meteorological data from the Flood Control District of Maricopa County (FCDMC), Arizona, USA, covering eight key variables across multiple sensor stations between 1987 and 2024. Each variable is stored as a separate CSV file, containing time-series data that have undergone rigorous quality control (QC) procedures and, where appropriate, short-gap interpolation for consistency. The quality control (QC) pipeline consisted of four sequential tests: (1) a range test to ensure all values fall within physically realistic limits, (2) a step test to identify abrupt and implausible changes between consecutive records, (3) a proximity test that validates flagged values from step test using data from nearby stations and exceedance probability thresholds, and (4) a persistence test to detect and remove periods of unrealistically constant readings. These thresholds were calibrated to Arizona’s environmental conditions and sensor specifications. After QC, short gaps (≤2 hours) were linearly interpolated to ensure consistent temporal resolution, except for wind variables. Due to a major upgrade in FCDMC’s data transmission system, only ALERT-2 protocol data (2016–2024) for wind variables are included; earlier ALERT-1 data were excluded because of irregular sampling and high missing rates. This dataset supports regional climate and infrastructure resilience studies by providing standardized, high-resolution meteorological data for the greater Phoenix metropolitan area.

54 ENVIRONMENTAL SCIENCES↗

Intercomparison of Latent Heat Fluxes Over Global Oceans

Turbulent fluxes of momentum, moisture, and heat at the air-sea interface are essential for climate studies. Version 2 Goddard Satellite-based Surface Turbulent Fluxes (GSSTF2) has been derived from the Special Sensor Microwave/Imager (SSM/I) radiance measurements. This dataset, covering the period July 1987-December 2000 over global oceans, has a spatial resolution of 1 deg x 1 deg lat-long and a temporal resolution of 1 day. Turbulent fluxes are derived from the SSM/I surface winds and surface air humidity, as well as the 2-m air and sea surface temperatures (SST) of the NCEP/NCAR reanalysis, using a bulk aerodynamic algorithm based on the surface layer similarity theory. The GSSTF2 bulk flux model, and retrieved daily wind stress, latent heat flux, wind speed, and surface air humidity validate well with ship observations of ten field experiments over the tropical and midlatitude oceans during 1991-99. The global distributions of 1988-2000 annual- and seasonal-mean turbulent fluxes show reasonable patterns related to the atmospheric general circulation and seasonal variations. Latent heat fluxes and related input parameters over global oceans during 1992-93 have been compared among GSSTF1 (version 1), GSSTF2, HOAPS (Hamburg Ocean Atmosphere Parameters and Fluxes from Satellite Data), NCEP/NCAR reanalysis, and one based on COADS (Comprehensive Ocean-Atmosphere Data Set). Our analyses suggest that the GSSTF2 latent heat flux, surface air humidity, surface wind, and SST are quite realistic compared to the other four flux datasets examined. However, significant differences are found among these five flux datasets. The GSSTF2, available at http://daac.gsfc.nasa.gov/CAMPAIGN_DOCS/hydrology/hd_gsstf2.O.html, is useful for climate studies.

Chou, Shu-Hsien↗

Calibrating uncertain parameters in melt pool simulations of additive manufacturing

Melt pool scale numerical modeling of additive manufacturing (AM) processes can provide predictive capabilities and theoretical insight into the process-property-structure-performance relationships for AM parts. Despite capabilities of numerical models to solve complex multi-physics problems, it is often important to consider a tradeoff between detailed physics and computational cost. Therefore, sources of uncertainty in both experimental conditions and the parameters needed for modeling require models to be validated against empirical evidence. Here, a method is proposed to calibrate uncertain parameters used in continuum-scale melt pool models for powder bed fusion (PBF) AM. Both a simplified heat transfer model and a heat transfer and fluid flow model were investigated. A surrogate model and Markov chain-based optimization algorithm calibrated melt pool geometry for models within experimental variation of the target melt pool width and depth from the NIST AM-Bench 2018-02 dataset. The melt pool temperature distributions, solidification parameters, and simulated multi-layer solidification microstructures were compared between the two models. Similar results from both models indicate that calibrated, lower fidelity numerical models may be used in place of higher fidelity models to generate melt pool solidification data. Finally, these calibrated models therefore enable lower computational cost melt pool simulations without a noticeable decrease in simulation accuracy for grain-scale microstructure simulations.

36 MATERIALS SCIENCE↗

High-throughput validation of phase formability and simulation accuracy of Cantor alloys

High-throughput methods enable accelerated discovery of novel materials in complex systems such as high-entropy alloys, which exhibit intricate phase stability across vast compositional spaces. Computational approaches, including Density Functional Theory (DFT) and calculation of phase diagrams (CALPHAD), facilitate screening of phase formability as a function of composition and temperature. However, the integration of computational predictions with experimental validation remains challenging in high-throughput studies. In this work, we introduce a quantitative confidence metric to assess the agreement between predictions and experimental observations, providing a quantitative measure of the confidence of machine learning models trained on either DFT or CALPHAD input in accounting for experimental evidence. The experimental dataset was generated via high-throughput in-situ synchrotron X-ray diffraction on compositionally varied FeNiMnCr alloy libraries, heated from room temperature to ~1000 °C. Agreement between the observed and predicted phases was evaluated using either temperature-independent phase classification or a model that incorporates a temperature-dependent probability of phase formation. This integrated approach demonstrates where strong overall agreement between computation and experiment exists, while also identifying key discrepancies, particularly in FCC/BCC predictions at Mn-rich regions to inform future model refinement.

36 - MATERIALS SCIENCE↗

Survey of Use Cases and Scenarios on the Open Energy Data Initiative Solar Systems Integration (OEDI SI) Platform

The Open Energy Data Initiative Solar Systems Integration (OEDI SI) Data and Modeling Platform offers a comprehensive set of use cases tailored for power systems analysis. Each use case is centered around a specific power system analysis problem, supported by composite input data and reference algorithms. These composite input datasets are meticulously assembled using OEDI SI's data preprocessing tools, which integrate raw data from various sources. The primary objectives of the OEDI SI Platform include facilitating access to composite input data through widely accepted input/output formats and verified results. This accessibility enables power system network researchers and developers to validate their algorithms and showcase their applications' capabilities to the broader community. Moreover, the platform strives to promote reproducible, robust, replicable, and generalizable solar systems integration research.

14 SOLAR ENERGY↗

Bayesian Fit to NOvA Data Subsamples for Three Flavor Oscillation Analysis

NOvA (NuMI Off-Axis $\nu_e$ Appearance) is a long baseline neutrino experiment designed to measure the oscillation of muon neutrinos to electron neutrinos over a distance of 810 km. NOvA uses a near and far detector to observe $\nu_\mu$ disappearance and $\nu_e$ appearance of neutrinos produced by the NuMI beam at Fermilab. NOvA uses a Bayesian analysis framework in addition to its Frequentist method to measure neutrino oscillation parameters such as the mixing angles, mass ordering, and CP-violating phase. We report preliminary results of Bayesian fits to representative NOvA datasets. Comparison of fits to $\nu_\mu$ disappearance and $\nu_e$ appearance enables a cross-check of NOvA results with reactor $\bar{\nu_e}$ disappearance measurements. NOvA also searches for violation of Lorentz invariance by analyzing fits of forward horn current (FHC) versus reverse horn current (RHC) samples. The results validate and advance NOvA's contributions to precision measurements of neutrino properties.

Zhao, Larry [Fermilab]↗

Effective Uncertainty Quantification for Multi-Angle Polarimetric Aerosol Remote Sensing Over Ocean

Multi-angle polarimetric (MAP) measurements can enable detailed characterization of aerosol microphysical and optical properties and improve atmospheric correction in ocean color remote sensing. Advanced retrieval algorithms have been developed to obtain multiple geophysical parameters in the atmosphere–ocean system. Theoretical pixel-wise retrieval uncertainties based on error propagation have been used to quantify retrieval performance and determine the quality of data products. However, standard error propagation techniques in high-dimensional retrievals may not always represent true retrieval errors well due to issues such as local minima and the nonlinear dependence of the forward model on the retrieved parameters near the solution. In this work, we analyze these theoretical uncertainty estimates and validate them using a flexible Monte Carlo approach. The Fast Multi-Angular Polarimetric Ocean coLor (FastMAPOL) retrieval algorithm, based on efficient neural network forward models, is used to conduct the retrievals and uncertainty quantification on both synthetic HARP2 (Hyper-Angular Rainbow Polarimeter 2) and AirHARP (airborne version of HARP2) datasets. In addition, for practical application of the uncertainty evaluation technique in operational data processing, we use the automatic differentiation method to calculate derivatives analytically based on the neural network models. Both the speed and accuracy associated with uncertainty quantification for MAP retrievals are addressed in this study. Pixel-wise retrieval uncertainties are further evaluated for the real AirHARP field campaign data. The uncertainty quantification methods and results can be used to evaluate the quality of data products, as well as guide MAP algorithm development for current and future satellite systems such as NASA’s Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mission.

PACE↗

Direct constraint on the Higgs–charm coupling from a search for Higgs boson decays into charm quarks with the ATLAS detector

A search for the Higgs boson decaying into a pair of charm quarks is presented. The analysis uses proton–proton collisions to target the production of a Higgs boson in association with a leptonically decaying W or Z boson. The dataset delivered by the LHC at a centre-of-mass energy of $\sqrt{s}$ = 13 TeV and recorded by the ATLAS detector corresponds to an integrated luminosity of 139 fb -1 . Flavour-tagging algorithms are used to identify jets originating from the hadronisation of charm quarks. The analysis method is validated with the simultaneous measurement of WW, WZ and ZZ production, with observed (expected) significances of 2.6 (2.2) standard deviations above the background-only prediction for the $(W/Z)Z( → c\bar{c})$ process and 3.8 (4.6) standard deviations for the $(W/Z)W(→cq)$ process. The $(W/Z)Z( → c\bar{c})$ search yields an observed (expected) upper limit of 26 (31) times the predicted Standard Model cross-section times branching fraction for a Higgs boson with a mass of 125 GeV, corresponding to an observed (expected) constraint on the charm Yukawa coupling modifier |$k_c$| < 8.5 (12.4), at the 95% confidence level. A combination with the ATLAS $(W/Z)H,H → b\bar{b}$ analysis is performed, allowing the ratio $k_c/k_b$ to be constrained to less than 4.5 at the 95% confidence level, smaller than the ratio of the b- and c-quark masses, and therefore determines the Higgs-charm coupling to be weaker than the Higgs-bottom coupling at the 95% confidence level.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Sodar - NREL Scintec MFAS Wind Profiler, Decker Ranch Airstrip - Raw Data

The dataset includes 15-minute average wind speed and direction records from 30 m to 330 m above ground level (AGL) in 10-m range gates. Data were collected by a Scintec MFAS wind profiler installed at the Decker Ranch in Oregon, about 4.4 km southeast of Kent, Ore., and are intended for validating WFIP2 model improvements.

17 WIND ENERGY↗

Sodar - NREL Scintec MFAS Wind Profiler, Decker Ranch Airstrip - Reviewed Data

The dataset includes 15-minute average wind speed and direction records from 30 m to 330 m above ground level (AGL) in 10-m range gates. Data were collected by a Scintec MFAS wind profiler installed at the Decker Ranch in Oregon, about 4.4 km southeast of Kent, Ore., and are intended for validating WFIP2 model improvements.

17 WIND ENERGY↗

Global polarization of hyperons and spin alignment of vector mesons in quark matters

Relativistic heavy ion collider (RHIC) as a dedicated nuclear facility has made a few major discoveries in physics. This year marks the 30th year STAR Collaboration formation and the 23th year of STAR detector operation and data collection at RHIC. In the last two decades, STAR has collected many datasets, exhibiting scientific versatility and flexibility of the RHIC facility. The total dataset in the first year is less than 1 million good events, and currently there are about 1 billion events per dataset. The Global Hyperon Polarization was proposed in 2004. This immediately prompted the STAR Collaboration to search for this phenomenon from the early datasets. The null results were presented at Quark Matter Conference in Shanghai in 2006 and subsequently published. Although there were peripheral and continuous efforts in the following decade, no positive result has been observed experimentally. This situation changed in the following decade with the upgrade of high data rate and time-of-flight (TOF) detector and the progress of the Beam Energy Scan Phase I (BES-I). The experimental discoveries of the global polarization of hyperons in 2017 and the spin alignment of vector mesons in 2023 at RHIC-STAR confirm the theory which was established nearly twenty years ago. The theory and these measurements open the way to studying the properties of the hot and dense nuclear matter created in high-energy heavy ion collisions from a new degree of freedom, spin. We briefly review these discoveries from the proposals of theory to the experimental measurements, and summarize the related measurements at the existing facilities and the theoretical explanations to the original proposal. The basic understanding and the original proposal are still valid and fundamental, that is, the angular momentum of system can transform into a spin effect observable in experiment. However, it appears that in each case a new model is needed to explain the new experimental observation. We need a more basic theory to help us unify all these spin related phenomena. Over the past five years, STAR has successfully installed 3 new detectors and we have begun to see the physical analysis results from datasets with those new functions. What makes the STAR detector viable after 20 years of operation is its continuous evolution through successful upgrades, with new scientific programs added year by year. The next big thing is to forward upgrade a tracking system (3 layers of silicon strips and 4 layers of sTGC chambers) and a calorimetry system (electromagnetic and hadronic calorimeters). In addition to studying the spin structure of protons by using the polarized proton beams at RHIC, the upgrades also provide a unique ability to investigate the origin of Λ Global Polarization as a function of rapidity and rapidity (de-)correlations in Au+Au collisions.

Physics↗

PRIMED for the Future: Purposing Raw Intake for Machine Learning-Enabled Detection (Final Report)

The COVID-19 pandemic demonstrated how a novel, elusive, and diffuse biological threat can engender uncertainty and misinformation, and it underscored the need for flexible analytical modalities agnostic to the identity of biological material. Yet even before the pandemic, recognition of the limitations of the current, list-based approach, which focuses on known pathogens and biotoxins, and of the importance of agent-agnostic biodetection was growing within the biosecurity community. In a 2018 report on “Biodefense in the Age of Synthetic Biology,” for example, the National Academy of Sciences stated that “an overreliance on the Select Agent List is a systematic weakness affecting many aspects of the United States’ current biodefense mitigation capability”. More recently, a group of biodefense researchers proposed the identification and adoption of “bioagent-agnostic signatures (BASs)” as a way of detecting and characterizing not only existing agents but also novel ones, an approach they believe will “enable a more flexible and resilient biodefense posture”. Indeed, the future of biodetection requires us to begin developing novel analytics that can identify anomalies and/or characteristics that indicate a potential threat, whether known or unknown, without looking for a specific signature that has been identified previously. To assess potential threats more rapidly, it is critical to develop agnostic artificial intelligence (AI)/machine learning (ML) systems that can be employed for real-time assessment of the nature and source of a perturbation. Such systems should be multi scale and multi-dimensional, integrating sensor data from a range of biological, chemical, and physical application spaces. Emerging deep learning (DL) models demonstrate exceptional promise for identification of discriminatory features within multi-dimensional datasets. DL models have the capacity to recognize and encode highly complex patterns in a wide range of input data modalities, including images, text, and biological/chemical/physical spectra. As such, they can execute a wide range of assessments and determinations that have traditionally required a human operator. The promise of advances in DL is apparent in the realm of human health and medicine. DL models have been validated for evaluating a variety of clinical threats to human health in a range of contexts, including infection and cancer, and they demonstrated improved performance in predicting stroke relative to human neurologists in some categories of data. Continuously evolving advances in AI/ML are expected to support more efficient evaluation of raw sequence, spectroscopy, and spectrometry data. For instance, recent advances and deployment of large language models (LLM) such as Generative Pre training Transformer (GPT) and Bidirectional Encoder Representations from Transformers (BERT) have already motivated application of these models for biological function prediction. As frameworks such as LLMs become larger and more complex in their representations, their capacity to serve as pre-trained models that can be fine-tuned for biological/biodetection purposes will similarly be amplified. While existing and emerging AI/ML have found broad applicability and use cases in the clinical sciences, development for environmental evaluation and biodetection has been limited. Functionalizing such capabilities for this purpose requires an understanding of the existing technical landscape and how the respective tools and algorithms are currently being employed. This landscape awareness then allows an assessment of the current practical capabilities of existing models and the anticipated requirements and development efforts that will be needed to adapt available algorithms for biodetection applications relevant to DHS. Leveraging expertise in biodetection, ML, and operational biodetection, the effort described in this report is comprised of a systematic landscape assessment (Subtask 2.1), comparative evaluation (Subtask 2.2), and formulation of a value proposition (Subtask 2.3) for the prospect of ML-enabled, agnostic biodetection from raw, or minimally-processed, datasets.

59 BASIC BIOLOGICAL SCIENCES↗

Emulation and detection of physical faults and cyber-attacks on building energy systems through real-time hardware-in-the-loop experiments

The increasing use of remote or mobile access, integrated wearable technologies, data exchange, and cloud-based data analytics in modern smart buildings is steering the building industry towards open communication technologies. The increased connectivity and accessibility could lead to more cyber-attacks in smart buildings. On the other hand, physical faults (e.g., HVAC -heating, ventilation, and air-conditioning faults) may have similar adverse impacts as those from the cyber-attacks on building energy systems, such as occupant discomfort, energy wastage, and equipment downtime. However, current physical behavior-based anomaly detection methods fail to differentiate between cyber-attacks and physical faults in building energy systems. Moreover, the challenge in collecting real-world threat data with ground truth has led researchers to rely on numerical models with user-defined assumptions, which may not accurately reflect real-world conditions due to the lack of in-situ experimental datasets. To address these challenges and gaps, this paper presents a flexible hardware-in-the-loop (HIL) testbed for generating cyber-attack and physical fault datasets and demonstrating threat detection algorithms in a real building automation system (BAS) environment. This testbed combines hardware (i.e., real BAS with local HVAC controllers and a physical network) with software (i.e., high-fidelity models to represent behaviors of building envelope and HVAC energy systems), enabling emulations of realistic threats. Five HIL experiments, including one baseline without any threats, two with physical faults, and two with cyber-attacks, were conducted to generate datasets containing detailed network traffic and system states. A joint classification framework, incorporating a network analyzer and a physical HVAC fault detector, was proposed to automatically detect cyber-physical abnormalities on BAS at both the network and the physical HVAC levels. The network analyzer comprises a conditional random fields (CRF) based command validator and a statistics-based detection strategy. The fault detector employs a weather and schedule-based pattern matching and feature-based principal component analysis (WPM-FPCA) method. Evaluation of the classification using four metrics from the multi-class confusion matrix revealed an average accuracy of 90.2%, recall of 89.7%, precision of 88.5% and F1-score of 89.2%. Finally, these results demonstrate that the proposed joint classification framework can effectively differentiate between specific types of cyber-attacks (e.g., device reinitialization attack, network Denial-of-Service attack) and physical faults (e.g., air handling unit operational fault, cooling coil valve stuck) in real time for improved building energy management.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Temperature-dependent complex dielectric permittivity: a simple measurement strategy for liquid-phase samples

Abstract Microwaves (MWs) are an emerging technology for intensified and electrified chemical manufacturing. MW heating is intimately linked to a material’s dielectric permittivity. These properties are highly dependent on temperature and pressure, but such datasets are not readily available due to the limited accessibility of the current methodologies to process-oriented laboratories. We introduce a simple, benchtop approach for producing these datasets near the 2.45 GHz industrial, medical, and scientific (ISM) frequency for liquid samples. By building upon a previously-demonstrated bireentrant microwave measurement cavity, we introduce larger pressure- and temperature-capable vials to deduce temperature-dependent permittivity quickly and accurately for vapor pressures up to 7 bar. Our methodology is validated using literature data, demonstrating broad applicability for materials with dielectric constant ε' ranging from 1 to 100. We provide new permittivity data for water, organic solvents, and hydrochloric acid solutions. Finally, we provide simple fits to our data for easy use.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Cross-Characterization of Aerosol Properties from Multiple Spaceborne Sensors Facilitated by Regional Ground-Based Observations

Aerosol observations from space have become a standard source for retrieval of aerosol properties on both regional and global scales. Indeed, the large number of currently operational spaceborne sensors provides for unprecedented access to the most complete set of complimentary aerosol measurements ever to be available. Nonetheless, this resource remains under-utilized, largely due to the discrepancies and differences existing between the sensors and their aerosol products. To characterize the inconsistencies and bridge the gap that exists between the sensors, we have designed and implemented an online Multi-sensor Aerosol Products Sampling System (MAPSS) that facilitates the joint sampling of aerosol data from multiple sensors. MAPSS consistently samples aerosol products from multiple spaceborne sensors using a unified spatial and temporal resolution, where each dataset is sampled over Aerosol Robotic Network (AERONET) locations together with coincident AERONET data samples. In this way, MAPSS enables a direct cross-characterization and data integration between aerosol products from multiple sensors. Moreover, the well-characterized co-located ground-based AERONET data provides the basis for the integrated validation of these products.

Petrenko, Maksym↗

Connecting Returned Apollo Soils and Remote Sensing: Application to the Diviner Lunar Radiometer

The Diviner Lunar Radiometer, onboard NASA's Lunar Reconnaissance Orbiter, has produced the first global, high resolution, thermal infrared observations of an airless body. The Moon, which is the most accessible member of this most abundant class of solar system objects, is also the only body for which we have extraterrestrial samples with known spatial context, returned Apollo samples. Here we present the results of a comprehensive study to reproduce an accurate simulated lunar environment, evaluate the most appropriate sample and measurement conditions, collect thermal infrared spectra of a representative suite of Apollo soils, and correlate them with Diviner observations of the lunar surface. It has been established previously that thermal infrared spectra measured in simulated lunar environment (SLE) are significantly altered from spectra measured under terrestrial or martian conditions. The data presented here were collected at the University of Oxford Simulated Lunar Environment Chamber (SLEC). In SLEC, we simulate the lunar environment by: (1) pumping the chamber to vacuum pressures (less than 10‐4 mbar) sufficient to simulate lunar heat transport processes within the sample, (2) cooling the chamber with liquid nitrogen to simulate radiation to the cold space environment, and (3) heating the samples with heaters and lamp to set‐up thermal gradients similar to those experienced in the upper hundreds of microns of the lunar surface. We then conducted a comprehensive suite of experiments using different sample preparation and heating conditions on Apollo soils 15071 (maria) and 67701 (highland) and compared the results to Diviner noontime data to select the optimal experimental conditions. This study includes thermal infrared SLE measurements of 10084 (A11 - LM), 12001 (A12 - LM), 14259 (A14 - LM), 15071 (A15 - S1), 15601 (A15 - S9a), 61141 (A16 - S1), 66031 (A16 - S6), 67701 (A16 - S11), and 70181 (A17 - LM). The Diviner dataset includes all six Apollo sites at approximately 200 m spatial resolution We find that analyses of Diviner observations of individual sampling stations and SLE measurements returned Apollo soils show good agreement, while comparisons to thermal infrared reflectance under ambient conditions do not agree well, which underscores the need for SLE measurements and validates the Diviner compositional measurement technique.

Greenhagen, B. T.↗

NASA EOSDIS 20 Years of Data Usage and User Assessment in Support of Open Science Initiative

NASA EOS Data and Information System (EOSDIS) has been distributing data to world-wide users free with open access. Since the launch of NASA’s Terra satellite in 1999, more than 10,000 distinct EOS data products have been archived and distributed by NASA-funded Earth Science data centers encompassed by the EOSDIS. As of September 30, 2022, more than 90 PB of data archived by EOSDIS have been made available to public users and during FY 2023 over 60 PB have been distributed to public users worldwide. Over these twenty and more years, it has shown significant increase in the distribution of various data products. This has been possible due to free and open access of the data thereby a step towards open science initiative. The purposes of this study are 1) to perform a comprehensive investigation of the archive and distribution patterns of EOSDIS data products for last 20 years, 2) to identify and characterize the global user community for those data, 3) analyze the increased demand for data products, 4) evaluate distribution of higher level products because those are the ones most frequently used in the studies of natural disasters by public users (those data requestors not involved directly in the production or validation of the data products.) and contribute globally to the advance scientific understanding of the Earth-Atmosphere Systems. Funded by the Earth Science Data and Information System (ESDIS) Project, the ESDIS Metrics System (EMS) collects archive, distribution, and user information from EOSDIS data centers. The information (comprising all data products including heritage datasets going back to the 1990s) is stored in a relational database from which it can be analyzed in many ways. We present several metrics analyses that include data distribution patterns for all, as well as the most frequently requested data products; and user characterizations by country, domain, and Earth Science discipline (e.g., Land, Ocean, Cryosphere) of the requested products. Due to the enormous quantity of data handled by EOSDIS data centers and requirements of future data systems to archive increasing amounts of Earth Science data from future and current Earth Science missions effectively, the results of this study can provide insight on how the user communities have accessed the data and provide guidance for open science initiative.

Lalit Wanchoo↗