Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “DATASETS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

Interpretable Convolutional Learning Classifier System (C-LCS) for Higher Dimensional Datasets

The purpose of this paper is to devise an interpretable hybrid classification model for Convolutional Neural Networks (CNN) and a Learning Classifier System (LCS). The presented hybrid system integrates the fundamental attributes from both types of these classifiers. In the proposed hybrid model CNN works as an automatic feature extractor, and LCS works to provide interpretable rule-based classification results. Although LCS has limitations working on higher dimensional datasets, we resolve this limitation by using CNN as a feature extractor. The other concept of the non-interpretability of CNN is addressed by using the LCS rule. Furthermore, our experiment with higher dimensional datasets like CIFAR-10 and Fashion-MNIST shows that extended LCS provides comparable performance to the standard neural network model while also providing interpretable results. We named this extended LCS method Convolutional Learning Classifier Cystem (C-LCS).

Jelani Owens↗

Quantifying radiation quality for space relevant radiation types: Fitting excess risk models to three combined HZE-irradiated mouse datasets

Radiation health risks are predominantly derived from low linear energy transfer (LET) terrestrial exposures; however, space radiation includes exposure to high-LET and high-charge, high-energy (HZE) particles. Accurately quantifying the differences in radiation quality between the space and terrestrial radiation environments is important for assessing and predicting health risks for astronauts. Weil et al. 2009 and 2014 used two different inbred mouse strains to study differences in hepatocellular carcinoma (HCC) tumorigenesis after exposures to low- and high- LET radiation[1-2]. More recently, Edmondson et al. 2020 provided valuable new tumor data in outbred mice that were exposed to low- and high-LET radiation[3]. The present study aims to rigorously investigate a relative biological effectiveness (RBE) factor by leveraging the HCC tumor data from the three datasets[1-3]. The three experiments were similarly designed, allowing the raw data to be combined into a pooled dataset to estimate excess relative risk (ERR) and excess absolute risk (EAR) models using Bayesian Poisson regression.

Lori J. Chappell↗

Development of the Ames Global Hyperspectral Synthetic Dataset

This study develops the surface BRDF (bidirectional reflectance distribution function) product of the Ames Global Hyperspectral Synthetic Dataset (AGHSD), based on the corresponding MODIS products, to support the NASA Surface Biology and Geology mission development. A main challenge in deriving a hyperspectral dataset from the multi-band satellite products is how to identify a succinct yet robust algorithm that allow us to infer BRDF at unobserved wavelengths based on the few observed bands. Using the theories of radiative transfer in vegetation canopies, we arrive at a simple equation that accurately approximates hyperspectral surface BRDF as the weighted sum of components from the soil and the vegetation. Each of the components is modeled by the product of the spectrally-dependent optical properties of a surface element (the spectra of the soil surface reflectance, the leaf single albedo, or the canopy scattering coefficient) and a spectrally-independent bidirectional scattering function. The optical properties of the soil and the vegetation can be obtained from existing spectral libraries or model simulations. The bidirectional scattering functions are represented by the Ross-Thick-Li-Sparse BRDF model, where the linear coefficients are estimated with regression analysis from the multi-band MODIS data. We validate the algorithm with simulations by Monte Carlo Ray Tracing model experiments, and the results are highly consistent with the theoretic derivation. We apply the algorithm to generate the AGHSD BRDF product at 1km and 8-day resolutions for the year of 2019. The results are biogeochemically and physically coherent and consistent, and thus serve the goal to support the science and application development of the SBG community.

Hyperspectral↗

Newly Released GPCP Version 3.2 Global Precipitation Datasets at NASA GES DISC

The Global Precipitation Climatology Project (GPCP) is the precipitation component of an internationally coordinated set of (mainly) satellite-based global products dealing with the Earth's water and energy cycles, under the auspices of the Global Water and Energy Experiment (GEWEX) Data and Assessment Panel (GDAP) of the World Climate Research Program. As the follow-on to the GPCP Version 2.X products, GPCP Version 3 (GPCP V3.2) seeks to continue the production of long, homogeneous precipitation record using modern input and calibration datasets. The GPCP V3.2 provides globally complete analyses of surface precipitation on a 0.5°x 0.5° latitude/longitude grid at both monthly and daily intervals, respectively covering 1983 to the present and June 2000 to the present. New data fields have been introduced to better characterize the precipitation, particularly including an estimate of the fraction of the precipitation that is liquid (rain) in both the Monthly and Daily, and a Quality Index for the Monthly. Compared to the operational GPCP V2.3 Monthly, the V3.2 Monthly provides a more reasonable climatology in the Southern Ocean, and increases the global average precipitation by about 4.46%, which is in line with recommendations of recent assessments. However, the two versions have comparable global and regional trends for 1983-2020. Compared to the operational One-Degree Daily (Version 1.3) product, the V3.2 Daily better represents the histogram of precipitation rates, particularly at high values. In this presentation, we will present the latest GPCP V3.2 daily and monthly datasets archived and distributed at NASA Goddard Earth Sciences (GES) Data and Information Services Center (DISC) along with examples from NASA Giovanni.

Precipitation↗

Spatially-Coordinated Airborne Data and Complementary Products for Aerosol, Gas, Cloud, and Meteorological Studies: the Nasa Activate Dataset

The NASA Aerosol Cloud meTeorology Interactions oVer the western ATlantic Experiment (ACTIVATE) produced a unique dataset for research into aerosol–cloud–meteorology interactions, with applications extending from process-based studies to multi-scale model intercomparison and improvement as well as to remote-sensing algorithm assessments and advancements. ACTIVATE used two NASA Langley Research Center aircraft, a HU-25 Falcon and King Air, to conduct systematic and spatially coordinated flights over the northwest Atlantic Ocean, resulting in 162 joint flights and 17 other single-aircraft flights between 2020 and 2022 across all seasons. Data cover 574 and 592 cumulative flights hours for the HU-25 Falcon and King Air, respectively. The HU-25 Falcon conducted profiling at different level legs below, in, and just above boundary layer clouds (< 3 km) and obtained in situ measurements of trace gases, aerosol particles, clouds, and atmospheric state parameters. Under cloud-free conditions, the HU-25 Falcon similarly conducted profiling at different level legs within and immediately above the boundary layer. The King Air (the high-flying aircraft) flew at approximately ∼ 9 km and conducted remote sensing with a lidar and polarimeter while also launching dropsondes (785 in total). Collectively, simultaneous data from both aircraft help to characterize the same vertical column of the atmosphere. In addition to individual instrument files, data from the HU-25 Falcon aircraft are combined into “merge files” on the publicly available data archive that are created at different time resolutions of interest (e.g., 1, 5, 10, 15, 30, 60 s, or matching an individual data product's start and stop times). This paper describes the ACTIVATE flight strategy, instrument and complementary dataset products, data access and usage details, and data application notes. The data are publicly accessible through https://doi.org/10.5067/SUBORBITAL/ACTIVATE/DATA001 (ACTIVATE Science Team, 2020).

Aerosol Cloud meTeorology Interactions oVer the we↗

GLORIA - A Globally Representative Hyperspectral In Situ Dataset for Optical Sensing of Water Quality

The development of algorithms for remote sensing of water quality (RSWQ) requires a large amount of in situ data to account for the bio-geo-optical diversity of inland and coastal waters. The GLObal Reflectance community dataset for Imaging and optical sensing of Aquatic environments (GLORIA) includes 7,572 curated hyperspectral remote sensing reflectance measurements at 1 nm intervals within the 350 to 900 nm wavelength range. In addition, at least one co-located water quality measurement of chlorophyll a , total suspended solids, absorption by dissolved substances, and Secchi depth, is provided. The data were contributed by researchers affiliated with 59 institutions worldwide and come from 450 different water bodies, making GLORIA the de-facto state of knowledge of in situ coastal and inland aquatic optical diversity. Each measurement is documented with comprehensive methodological details, allowing users to evaluate fitness-for-purpose, and providing a reference for practitioners planning similar measurements. We provide open and free access to this dataset with the goal of enabling scientific and technological advancement towards operational regional and global RSWQ monitoring.

remote sensing of water quality↗

A Machine Learning Ready Dataset of Acoustic Power Maps for Detection of Active Region Emergence

The development of an accurate forecast for solar eruptive activity has become increasingly important in order to prevent any potential impact on activities in space and the Earth's environment. It is therefore crucial to detect active regions before they appear on the solar surface and create early warning capabilities for upcoming Space Weather disturbances. In this work, 9TB of solar data (SDO/HMI dopplergrams, magnetograms and continuum intensity maps) involving the emergence of 61 NOAA solar active regions since 2010 were processed using the NASA HECC capabilities. An acoustic power maps time-series dataset was created (for four different frequency ranges and processed to take into account the solar sphere geometric effect ) which can be used for understanding the dynamics of the solar surface and train a variety of ML models. The calculated acoustic power maps carry precursor information associated with the decrease in continuum intensity on the solar surface, verifying older helioseismology research. Our results show that a Long Short-Term Memory (LSTMs) model, with a modest layer depth and the right hyperparameters tuned, when trained on this solar acoustic power maps dataset can predict without false negatives a drop in intensity (associated with the emergence of the active region), up to 18 hours in advance.

SMD↗

Cloud and Precipitation Analyses using Merged Datasets from Two Airborne Microwave Radiometers Covering 10–183 GHz

Microwave radiometers provide valuable insight into the structure and characteristics of clouds and precipitation. In NASA’s airborne remote-sensing arsenal, the Advanced Microwave Precipitation Radiometer (AMPR) and the Conical Scanning Millimeter-wave Imaging Radiometer (CoSMIR) have been used extensively in field campaigns throughout the world. AMPR operates with four channels between 10.7 and 85.5 GHz, while CoSMIR operates with nine channels ranging from 50.3 to 183.31 GHz. Although these datasets provide key information when used separately, the combination of these radiometers covers virtually the full range of frequencies used by the Global Precipitation Measurement (GPM) Microwave Imager (GMI), enabling suborbital observations to compare with GPM spaceborne measurements. This presentation will detail the merger of AMPR and CoSMIR data during two NASA airborne field campaigns: the Integrated Precipitation and Hydrology Experiment (IPHEx) and the Olympic Mountains Experiment / Radar Definition Experiment (OLYMPEX/RADEX). Other field campaigns, such as the Investigation of Microphysics and Precipitation for Atlantic Coast-Threatening Snowstorms (IMPACTS), may be included as well. Using the merged brightness temperature dataset, features of precipitating and non-precipitating clouds containing liquid and/or ice hydrometeors will be discussed from selected flight segments. Geophysical retrievals derived from these brightness temperatures using a one-dimensional variational (1DVAR) technique and/or multi-linear regression equations will also be employed in these analyses. Observed transitions between precipitating and non-precipitating systems will be explored in greater detail. Dropsonde data will be used to provide environmental contexts throughout each flight, and additional observations (e.g., from airborne and/or land-based radar) will be incorporated to supplement the radiometer-based results. The broader implications of these results and pathways for future work will also be discussed.

Corey G. Amiot↗

Unveiling the Transferability of PLSR Models for Leaf Trait Estimation: Lessons from a Comprehensive Analysis with a Novel Global Dataset

Leaf traits are essential for understanding many physiological and ecological processes. Partial least-squares regression (PLSR) models with leaf spectroscopy are widely applied for trait estimation, but their transferability across space, time and plant functional types (PFTs) remains unclear. We compiled a novel dataset of paired leaf traits and spectra, with 47,393 records for >700 species and eight PFTs at 101 globally-distributed locations across multiple seasons. Using this dataset, we conducted an unprecedented comprehensive analysis to assess the transferability of PLSR models in estimating leaf traits. While PLSR models demonstrate commendable performance in predicting chlorophyll content, carotenoid, leaf water and leaf mass per area prediction within their training data space, their efficacy diminishes when extrapolating to new contexts. Specifically, extrapolating to locations, seasons, and PFTs beyond the training data leads to reduced R 2 (0.12-0.49, 0.15-0.42, and 0.25-0.56) and increased NRMSE (3.58-18.24%, 6.27-11.55% and 7.0-33.12%) compared to nonspatial random cross-validation (NRCV). The results underscore the importance of incorporating greater spectral diversity in model training to boost its transferability. These findings highlight potential errors in estimating leaf traits across large spatial domains, diverse PFTs and time due to biased validation schemes and provide guidance for future field sampling strategies and remote sensing applications.

Leaf traits↗

Combining Large Datasets - Cancer Moonshot Task Group Final Summary

In February 2022, President Biden re-ignited the Cancer Moonshot with bold new goals: to reduce the cancer death rate by half within 25 years and improve the lives of people with cancer and cancer survivors. To achieve these ambitious goals, the White House convened the first-ever Cancer Cabinet, bringing together departments and agencies from across the federal government to end cancer as we know it.The Cancer Cabinet convened three task forces and supporting task groups, including the Data and Innovation Task Force, which supported the Cancer Moonshot priority to “Deliver innovation to patients and communities.” In early 2023, the “Combining Large Datasets” (CoLD) Task Group was created within the Data and Innovation Task Force. The scope of the CoLD Task Group was how federal agencies combine large datasets for broad applications across cancer prevention and control, including nutrition, epidemiology, and military/Veteran health. Within this scope, the group sought to better leverage the immense potential of data and power of data tools to increase our understanding of cancer incidence, causes, mortality, treatments, prevention, outcomes, costs, and all other aspects of the burden of cancer.

data integration↗

Nasa Genelab - Knowledge Graph Fabric Enables Deep Biomedical Analysis of Multi-Omics Datasets

The limited number of astronauts and human samples from long-duration space missions pose significant challenges for studying the health risks associated with spaceflight and developing new treatments. As a result, much of our understanding of the biological impact of space travel relies on samples from model organisms. NASA GeneLab, integrated into Open Science Data Repository (OSDR) is a centralized multi-omics resource containing almost 1000 datasets from over 500 space-related studies from human and model organism samples. Previous studies have demonstrated that human phenotypes and physiological changes caused by spaceflight can be identified by connecting gene expression data from model organisms flown in space to a biomedical knowledge graph (SPOKE). In this work, we present a data fabric connecting OSDR datasets to SPOKE that empowers biomedical analyses through the GeneLab visualization portal. This collaboration is funded by NSF’s Proto-OKN program.

data fabric↗

Accelerating Relative-error Bounded Lossy Compression for HPC datasets with Precomputation-Based Mechanisms

Scientific simulations in high-performance computing (HPC) environments are producing vast volume of data, which may cause a severe I/O bottleneck at runtime and a huge burden on storage space for post-analysis. Unlike the traditional data reduction schemes (such as deduplication or lossless compression), not only can error-controlled lossy compression significantly reduce the data size but it can also hold the promise to satisfy user demand on error control. Point-wise relative error bounds (i.e., compression errors depends on the data values) are widely used by many scientific applications in the lossy compression, since error control can adapt to the precision in the dataset automatically. Point-wise relative error bounded compression is complicated and time consuming. In this work, we develop efficient precomputation-based mechanisms in the SZ lossy compression framework. Our mechanisms can avoid costly logarithmic transformation and identify quantization factor values via a fast table lookup, greatly accelerating the relative-error bounded compression with excellent compression ratios. In addition, our mechanisms also help reduce traversing operations for Huffman decoding, and thus significantly accelerate the decompression process in SZ. Experiments with four well-known real-world scientific simulation datasets show that our solution can improve the compression rate by about 30% and decompression rate by about 70% in most of cases, making our designed lossy compression strategy the best choice in class in most cases.

compression rate↗

RuSentiment: An Enriched Sentiment Analysis Dataset for Social Media in Russian

This paper presents RuSentiment, a new dataset for sentiment analysis of social media posts in Russian, and a new set of comprehensive annotation guidelines that are extensible to other languages. RuSentiment is currently the largest in its class for Russian, with 30,521 posts annotated with Cohen’s kappa of 0.58 (3 annotations per post). To diversify the dataset, 6,749 posts were pre-selected with an active learning-style strategy. We report baseline classification results, and release the bestperforming embeddings trained on 3.2B tokens in Russian VKontakte posts.

data collection, sentiment analysis, machine learn↗

Sensing analytical instrument parameters, specimen characteristics, or both from sparse datasets

Disclosed are methods for sensing conditions of an electron microscope system and/or a specimen analyzed thereby. Also disclosed are sensor systems and electron microscope systems able to sense system conditions, and/or conditions of the specimen being analyzed by such systems. In one embodiment, a sparse dataset can be acquired from a random sub-sampling of the specimen by an electron beam probe of the electron microscope system. Instrument parameters, specimen characteristics, or both can be estimated from the sparse dataset.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

BOOSTR: A Dataset for Accelerator Control Systems

The Booster Operation Optimization Sequential Time-series for Regression (BOOSTR) dataset was created to provide a cycle-by-cycle time series of readings and settings from instruments and controllable devices of the Booster, Fermilab's Rapid-Cycling Synchrotron (RCS) operating at 15~Hz. BOOSTR provides a time series from 55 device readings and settings that pertain most directly to the high-precision regulation of the Booster's gradient magnet power supply (GMPS). To our knowledge, this is one of the first well-documented datasets of accelerator device parameters made publicly available. We are releasing it in the hopes that it can be used to demonstrate aspects of artificial intelligence for advanced control systems, such as reinforcement learning and autonomous anomaly detection.

43 PARTICLE ACCELERATORS↗

ES-FE Dataset Exploratory Tool Database Link

The Energy Storage - Fossil Energy (ES-FE) Dataset Explorer tool allows the user to take a deep dive into existing energy storage plant sites mapped to fossil generation sites. The tool also allows users to explore proposed energy storage sites. The explorer creates a dataset of all proposed and existing energy storage plant sites giving the user the ability to inspect various attributes of generation plants and storage plants, including but not limited to generating capacity, generating technology, and storage capacity.

Pena-Cabra, Ivonne A.↗

Evaluating Electric Vehicle Public Charging Utilization in the United States Using the EV WATTS Dataset: Preprint

The utilization of electric vehicle (EV) charging in the United States is a rapidly evolving puzzle further complicated by changes in travel habits brought on by the global COVID-19 pandemic. The EV WATTS dataset is the largest publicly available dataset on the utilization of EV charging in the United States and provides key insights into the changing patterns of public vehicle charging and vehicle use as EV range increases, commute patterns evolve, and more infrastructure becomes available.

ADVANCED PROPULSION SYSTEMS↗

Integrating Multiscale Datasets for Monitoring Air Dose Rates in Fukushima - 18437

Six years has passed since the radionuclide release occurred at the Fukushima Daiichi NPP. Measurements and monitoring of air dose rates (i.e., ambient dose equivalent rates) in the region around the Fukushima Daiichi NPP have been performed continuously since the accident. Such mapping efforts are essential to protect the public, to guide decontamination efforts, and to plan the return of evacuated residents. An extensive monitoring program has enabled to develop a data-driven environmental decay model for describing and predicting the decay of radiation air dose rates in the environment. However, it has been difficult to quantify the heterogeneity of environmental decay in the regional scale, since spatially extensive airborne survey datasets often have discrepancy with the ground-based measurements and have a larger uncertainty. Recently, a Bayesian hierarchical modeling approach was developed to integrate multiscale datasets (i.e., car, walk and airborne surveys), and also to estimate the spatial distribution of air dose rates in high resolution over space. The integrated air dose rate maps have been contributed to planning of the future decontamination and resident's return as well as associated cost. In this study, we aim to extend this approach and predict the area of the evacuation zone in the future. WE coupled the integrated map with the data-driven ecological decay model. Results show that the area of vacuation zone (i.e., the area above 3.8 micro-Sv/yr) will shrink significantly in the next twenty years, and it will be fully contained in the non-residential forested area by 2040. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗