Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Sparse Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 991 records · Page 55
All sourcesNASA NTRSDOE OSTI
NASA NTRS1986

Comparison of various techniques for calibration of AIS data

The Airborne Imaging Spectrometer (AIS) samples a region which is strongly influenced by decreasing solar irradiance at longer wavelengths and strong atmospheric absorptions. Four techniques, the Log Residual, the Least Upper Bound Residual, the Flat Field Correction and calibration using field reflectance measurements were investigated as a means for removing these two features. Of the four techniques field reflectance calibration proved to be superior in terms of noise and normalization. Of the other three techniques, the Log Residual was superior when applied to areas which did not contain one dominant cover type. In heavily vegetated areas, the Log Residual proved to be ineffective. After removing anomalously bright data values, the Least Upper Bound Residual proved to be almost as effective as the Log Residual in sparsely vegetated areas and much more effective in heavily vegetated areas. Of all the techniques, the Flat Field Correction was the noisest.

Dar A. Roberts↗
NASA NTRS1996

Solutocapillary Convection Effects on Polymeric Membrane Morphology

Macro voids are undesirable large pores in membranes used for purification. They form when membranes are cast as thin films on a smooth surface by evaporating solvent (acetone) from a polymer solution. There are two un-tested hypotheses explaining the growth of macro voids. One states that diffusion of the non-solvent (water) is solely responsible, while the other states that solutocapillary convection is the primary cause of macro void growth. Solutocapillary convection is flow-caused by a concentration induced surface-tension gradient. Macrovoid growth in the former hypothesis is gravity independent, while in the latter it is opposed by gravity. To distinguish between these two hypotheses, experiments were designed to cast membranes in zero-gravity. A semi-automated apparatus was designed and built for casting membranes during the 20 secs of zero-g time available in parabolic aircraft flight such as NASA's KC-135. The phase changes were monitored optically, and membrane morphology was evaluated by scanning electron microscopy (SEM). These studies appear to be the first quantitative studies of membrane casting in micro-gravity which incorporate real-time data acquisition. Morphological studies of membranes cast at 0, 1, and 1.8 g revealed the presence of numerous, sparse and no macrovoids respectively. These results are consistent with the predictions of the solutocapillary hypothesis of macrovoid growth.

Krantz, William B.↗
NASA NTRS1999

Object-Oriented Design for Sparse Direct Solvers

We discuss the object-oriented design of a software package for solving sparse, symmetric systems of equations (positive definite and indefinite) by direct methods. At the highest layers, we decouple data structure classes from algorithmic classes for flexibility. We describe the important structural and algorithmic classes in our design, and discuss the trade-offs we made for high performance. The kernels at the lower layers were optimized by hand. Our results show no performance loss from our object-oriented design, while providing flexibility, case of use, and extensibility over solvers using procedural design.

Dobrian, Florin↗
NASA NTRS2008

Comparison of GPCP Monthly and Daily Precipitation Estimates with High-Latitude Gauge Observations

It is very important to know how much rain and snow falls around the world for uses that range from crop forecasting to disaster response, drought monitoring to flood forecasting, and weather analysis to climate research. Precipitation is usually measured with rain gauges, but rain gauges don t exist in areas that are sparsely populated, which tends to be a good portion of the globe. To overcome this, meteorologists use satellite data to estimate global precipitation. However, it is difficult to estimate rain and especially snow in cold climates using most current satellites. The satellite sensors are often "confused" by a snowy or frozen surface and therefore cannot distinguish precipitation. One commonly used satellite-based precipitation data set, the Global Precipitation Climatology Project (GPCP) data, overcomes this frozen-surface problem through the innovative use of two sources of satellite data, the Television Infrared Observation Satellite Operational Vertical Sounder (TOVS) and the Atmospheric Infrared Sounder (AIRS). Though the GPCP estimates are generally considered a very reliable source of precipitation, it has been difficult to assess the quality of these estimates in cold climates due to the lack of gauges. Recently, the Finnish Meteorological Institute (FMI) has provided a 12-year span of high-quality daily rain gauge observations, covering all of Finland, that can be used to compare with the GPCP data to determine how well the satellites estimate cold-climate precipitation. Comparison of the monthly GPCP satellite-based estimates and the FMI gauge observations shows remarkably good agreement, with the GPCP estimates being 6% lower in the amount of precipitation than the FMI observations. Furthermore, the month-to-month correlation between the GPCP and FMI is very high at 0.95 (1.0 is perfect). The daily GPCP estimates replicate the FMI daily occurrences of precipitation with a correlation of 0.55 in the summer and 0.45 in the winter. The winter result indicates the GPCP estimates have skill in "seeing" snowfall, which is the most challenging situation. Thus, the GPCP data set successfully overcomes a current limitation in satellite meteorology, namely the estimation of cold-climate precipitation. The success of the GPCP data set bodes well for future missions, whose instrumentation is specifically designed to give even more information for addressing cold-climate precipitation.

Bolvin, David T.↗
NASA NTRSDate not supplied

Development of the Ames Global Hyperspectral Synthetic Dataset

This study develops the surface BRDF (bidirectional reflectance distribution function) product of the Ames Global Hyperspectral Synthetic Dataset (AGHSD), based on the corresponding MODIS products, to support the NASA Surface Biology and Geology mission development. A main challenge in deriving a hyperspectral dataset from the multi-band satellite products is how to identify a succinct yet robust algorithm that allow us to infer BRDF at unobserved wavelengths based on the few observed bands. Using the theories of radiative transfer in vegetation canopies, we arrive at a simple equation that accurately approximates hyperspectral surface BRDF as the weighted sum of components from the soil and the vegetation. Each of the components is modeled by the product of the spectrally-dependent optical properties of a surface element (the spectra of the soil surface reflectance, the leaf single albedo, or the canopy scattering coefficient) and a spectrally-independent bidirectional scattering function. The optical properties of the soil and the vegetation can be obtained from existing spectral libraries or model simulations. The bidirectional scattering functions are represented by the Ross-Thick-Li-Sparse BRDF model, where the linear coefficients are estimated with regression analysis from the multi-band MODIS data. We validate the algorithm with simulations by Monte Carlo Ray Tracing model experiments, and the results are highly consistent with the theoretic derivation. We apply the algorithm to generate the AGHSD BRDF product at 1km and 8-day resolutions for the year of 2019. The results are biogeochemically and physically coherent and consistent, and thus serve the goal to support the science and application development of the SBG community.

Hyperspectral↗
NASA NTRS2021

Missing the Reef for the Corals: Unexpected Trends Between Coral Reef Condition and the Environment at the Ecosystem Scale

It is incontrovertible that many coral reefs are in various stages of decline and may be unable to withstand the effects of global climate change, jeopardizing vital ecosystem goods and services to hundreds of millions of people around the world. An estimated 50% of the world's corals have already been lost, and those remaining may be lost by 2030 under the “business as usual” CO2 emissions scenario. However, the foundation of these predictions is a surprisingly sparse dataset, wherein ~0.01–0.1% of the world's reef area has been quantitatively surveyed. Further, the available data comprise observations at the 1–10 m scale, which are not evenly spaced across reefs, but often clustered in areas representing focused survey effort. This impedes modeling and predicting the impact of a changing environment at the ecosystem scale. Here we highlight deficiencies in our current understanding of the relationship between coral reefs and their environments. Specifically, we conduct a meta-analysis using estimates of coral cover from a variety of local surveys, quantitatively relating reef condition to a suite of biogeophysical forcing parameters. We find that readily available public data for coral cover exhibit unexpected trends (e.g., a positive correlation between coral cover and multi-year cumulative thermal stress), contrary to prevailing scientific expectations. We illustrate a significant gap in our current understanding, and thereby prediction, of coral reefs at the ecosystem scale that can only be remedied with uniform, high-density data across vast coral reef regions, such as that from remote sensing.

Eric J Hochberg↗
DOE OSTI2025

Data-Efficient Methods for Determining Flory–Huggins χ Parameters in Multicomponent Polymer Formulations

Polymer formulations are essential in diverse applications including personal care products, coatings, paints, adhesives, and plastic materials. Designing these formulations requires navigating large, complex design spaces, where phase and self-assembly behavior critically impact performance. The Flory–Huggins χ parameter, which quantifies segmental miscibility, is widely used to parametrize the excess free energy of mixing in formulation models. In this work, we introduce two data-efficient, top-down methods for estimating χ parameters using the Random Phase Approximation (RPA): (i) Boundary Nonlinear Regression (Boundary-NLR), which fits theoretical spinodal boundaries to experimental phase boundaries, and (ii) Surrogate Model Inverse Parameter Estimation (SMIPE), which uses a Gaussian Process Classifier to fit sparse phase maps via a surrogate model. Both methods allow rapid parametrization of polymer field-theoretic models without the need for additional experiments. We evaluate these approaches on data sets involving polymer–solvent–nonsolvent ternary mixtures and block copolymer–solvent systems, demonstrating their robustness to experimental noise and their relevance for real-world formulation design.

copolymers↗
DOE OSTI2021

Geo Thermal Cloud: Cloud Fusion of Big Data and Multi-Physics Models using Machine Learning for Discovery, Exploration, and Development of Hidden Geothermal Resources

The project is motivated by the challenges, risks, and costs associated with geothermal exploration and production. Many processes and parameters impacting geothermal conditions are poorly understood. Diverse datasets are available to help characterize subsurface geothermal conditions (public and proprietary; satellite, airborne surveys, vegetation/water sampling, geological, geophysical, etc.). Yet, it is not clear how to properly leverage these datasets for geothermal exploration due to an incomplete understanding of how physical processes impacting subsurface geothermal conditions are represented in these observations. Recent advancements in machine learning (ML) provide great promise to resolve these issues. The tremendous challenges and risks of geothermal exploration and production bring the demand for novel ML methods and tools that can (1) analyze large field datasets, (2) assimilate model simulations (large inputs and outputs), (3) process sparse datasets, (4) perform transfer learning (between sites with different exploratory levels), (5) extract hidden geothermal signatures in the field and simulation data, (6) label geothermal resources and processes, (7) identify high-value data acquisition targets, and (8) guide geothermal exploration and production by selecting optimal exploration, production, and drilling strategies. Our goals and work under Phases 1 and 2 (as proposed) of this project address all these needs.

15 GEOTHERMAL ENERGY↗
DOE OSTI2024

Multi-Level Structural Damage Characterization Using Sparse Acoustic Sensor Networks and Knowledge Transferred Deep Learning

Standard structural health monitoring techniques face well-known difficulties for comprehensive defect diagnosis in real-world structures that have structural, material, or geometric complexity. This motivates the exploration of machine-learning-based structural health monitoring methods in complex structures. However, creating sufficient training data sets with various defects is an ongoing challenge for data-driven machine (deep) learning algorithms. The ability to transfer the knowledge of a trained neural network from one component to another or to other sections of the same component would drastically reduce the required training data set. Also, it would facilitate computationally inexpensive machine learning based inspection systems. In this work, a machine-learning-based multi-level damage characterization is demonstrated with the ability to transfer trained knowledge within the sparse sensor network. A novel network spatial assistance and an adaptive convolution technique are proposed for efficient knowledge transfer within the deep learning algorithm. Proposed structural health monitoring method is experimentally evaluated on an aluminum plate with artificially induced defects. It was observed that the method improves the performance of knowledge transferred damage characterization by 50% during localization and 24% during severity assessment. Further, experiments using time windows with and without multiple edge reflections are studied. Results reveal that multiply scattered waves contain rich and deterministic defect signatures that can be mined using deep learning neural networks, improving the accuracy of both identification and quantification. In the case of a fixed sensor network, using multiply scattered waves shows 100% prediction accuracy at all levels of damage characterization.

36 MATERIALS SCIENCE↗
DOE OSTI2020

A Satellite-Derived Upper-Ocean Stratification Data Set for the Tropical North Atlantic With Potential Applications for Hurricane Intensity Prediction

Upper-ocean stratification strongly impacts vertical mixing and the heat flux between the ocean and atmosphere, especially under extreme conditions of tropical cyclones (TCs). Knowledge of prestorm stratification is important for accurate TC intensity prediction. In situ observations of the tropical ocean have significantly increased in the past decade. However, they are still too sparse to resolve ocean stratification variability in near-real time and on small spatial scales. Here, in this study, based on long-term observations and an ocean reanalysis data set from 2004–2017, we investigate the possibility of retrieving upper-ocean stratification from sea surface temperature (SST), sea surface salinity (SSS), and sea surface height (SSH) using a simple regression method. It is found that more than 90% of the mean seasonal cycle and about 30% to 80% of temperature and salinity stratification anomalies can be reconstructed using surface data from either observations or an ocean reanalysis. Simple regression can be used with satellite observations to create a high-resolution, near-real-time-gridded ocean stratification data set that successfully reproduces both the large and mesoscale variability of ocean stratification. When used in a simple expression for TC-induced SST cooling, the satellite-derived stratification shows improvements over an ocean analysis in terms of variance explained of SST cooling, offering promise as a near-real-time indicator of the ocean's impact on TC intensification.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2021

Validation of Soil Moisture Data Products from the NASA SMAP Mission

The National Aeronautics and Space Administration (NASA)Soil Moisture Active Passive(SMAP) mission has been validatingits soil moisture (SM) products since the start of data production onMarch 31, 2015. Prior to launch, the mission defined a set of criteria for core validation sites (CVS) that enable the testing of the key mission SM accuracy requirement(unbiased root-mean-square error <0.04 m3/m3). Thevalidation approach also includes other (“sparse network”) in situSM measurements, satellite SM products, model-based SM products, and field experiments. Over the past six years, the SMAP SM products have been analyzed with respect to thesereference data,and the analysis approaches themselves have been scrutinizedin an effort to best understand the products’ performance. Validation of themost recent SMAP Level 2 and 3 SMretrievalproducts (R17000) shows that the L-band (1.4 GHz) radiometer-based SM record continues to meet mission requirements. The products aregenerallyconsistentwith SM retrievals from the European Space Agency (ESA)Soil Moisture Ocean Salinity mission, althoughthere aredifferencesin some regions. The high-resolution (3-km) SM retrieval product,generated by combining Copernicus Sentinel-1 data with SMAP observations,performswithin expectations. Currently, however,there is limited availability of3-kmCVSdatato support extensive validation at this spatial scale. The most recent (version 5)SMAP Level4 SMdata assimilation productprovidingsurface and root-zone SM with complete spatio-temporal coverageat 9-km resolution also meets performance requirements. The SMAP SM validation program will continue throughout the mission life; futureplans include expanding ittoforestedand high-latituderegions

SMAP↗
NASA NTRS1996

AIRSAR Data for Geological and Geomorphological Mapping in the Great Sandy Desert and Pilbara Regions of Western Australia

Enhancements of AIRSAR data have demonstrated the benefits of synthetic aperture radar (SAR) for revealing an additional and mich higher level of information about the composition of the terrain than enhancements f either SPOT-PAN or Landsat TM data. With appropriate image processing techniques, surface and near surface geological structures, hydrological systems (both current and ancient) and landform features, have been evidenced in a diverse range of landscapes. In the Great Sandy Desert region where spectral variability is minimal, radar's sensitivity to the micromorphology of sparse exposures of subcrop and lag gravels has provided a new insight into the region's geological framework, its landforms, and their evolution. In the Pilbara region, advanced processing of AIRSAR data to unmix the backscatter between and within the three frequencies of data has highlighted subsurface extensions of greenstone lithologies below sand cover and morphological evidence of past flow conditions under former climate regimes. On the basis of these observations, it is recommend that radar remote sensing technology involving the use of high resolution, polarimetric data be seriously considered as a viable tool for exploration in erosional and depositional environments located within Australia's mineral and oil-prospective provinces.

Tapley, Ian J.↗
DOE OSTI2022

Model calibration of the liquid mercury spallation target using evolutionary neural networks and sparse polynomial expansions

The mercury constitutive model predicting the strain and stress in the target vessel plays a central role in improving the lifetime prediction and future target designs of the mercury targets at the Spallation Neutron Source. We leverage the experiment strain data collected over multiple years to improve the mercury constitutive model through a combination of large scale simulations of the target behavior and the use of machine learning tools for parameter estimation. We present two interdisciplinary approaches for surrogate-based model calibration of expensive simulations using evolutionary neural networks and sparse polynomial expansions. The newly calibrated simulations achieve 7% average improvement on the prediction accuracy and 8% reduction in mean absolute error compared to previously reported reference parameters, with some individual sensors experiencing up to 30% improvement. The calibrated simulations can aid in fatigue analysis to estimate the mercury target lifetime, which reduces abrupt failure and saves tremendous amount of costs.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

Uncovering multiscale structure-property correlations via active learning in scanning tunneling microscopy

Atomic arrangements and local sub-structures fundamentally influence emergent material functionalities. These structures are conventionally probed using spatially resolved studies and the property correlations are deciphered by a researcher based on sequential explorations, thereby limiting the efficiency and scope. Here we demonstrate a multi-scale Bayesian deep-learning based framework that automatically correlates material structure with its electronic properties using scanning tunneling microscopy (STM) measurements in real-time. Its predictions are used to autonomously direct exploration toward regions of the sample that optimize a given material property. This method is deployed on a low-temperature ultra-high vacuum STM to understand the structure-property relationship in a europium-based semimetal, EuZn 2 As 2 , a promising candidate relevant to magnetism-driven topological phenomena. The framework employs a sparse-sampling approach to efficiently construct the scalar-property space using minimal measurements, about 1–10% of the data required in standard hyperspectral methods. Moreover, we formulate the problem hierarchically across length scales, implementing autonomous workflow to locate mesoscopic and atomic structures that correspond to a target material property. This framework offers the choice to design scalar-property from the spectroscopic data to steer sample exploration. Our findings reveal correlations of the electronic properties unique to surface terminations, local defect density, and point defects.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2026

CORE-BFS: Communication-Optimized REctangular-partitioned BFS Achieving 160.845 TeraTEPS on Frontier Supercomputer

Distributed Breadth-First Search (BFS) is fundamental to many large-scale graph applications, but its performance on parallel systems is often limited by high communication overhead. This paper presents CORE-BFS, an extremely scalable GPU-based BFS implementation that introduces a unique rectangular 2D partitioning-based design for Frontier supercomputer. To further improve performance, we propose four key optimizations: (1) Rectangular 2D-partition specific data formats that use two compressed row and one compressed column status array bitmaps combined with a Double Compressed Sparse Row (DCSR) format per partition, reducing memory footprint and inter-rank traffic; (2) Adaptive frontier & communication strategy that unifies top-down and bottom-up traversal on the rectangular layout, uses lazy synchronization in top-down levels, and switches variants based on frontier size to minimize communication overhead; (3) Frontier-split degree-aware update that maps frontier vertices to thread-centric, wavefront-centric, and block-centric kernels based on their degree to improve GPU utilization and memory coalescing; (4) Row-reduction pipeline that overlaps bottom-up adjacency list processing with row-wise bitmap reduction to hide inter-rank latency. Together, these techniques increase parallelism while reducing memory and communication overhead. On the Graph500 benchmark, CORE - BFS scales up to 9,248 Frontier nodes with scale-42 graphs and reaches 160.845 TTEPS, delivering a 5.42 × speedup over our previous Frontier implementation.

Yang, Haoshen [Rutgers University]↗
DOE OSTI2021

AmeriFlux CA-HPC Havikpak Creek

This is the AmeriFlux version of the carbon flux data for the site CA-HPC Havikpak Creek. Site Description - Southern Arctic boreal woodland (Picea mariana) site with sparse needleleaf vegetation > 2m, continuous permafrost

Sonnentag, Oliver↗
DOE OSTI2025

AmeriFlux CA-RSB Resolute Bay Polar Desert

This is the AmeriFlux version of the carbon flux data for the site CA-RSB Resolute Bay Polar Desert. Site Description - Polar desert on a gentle slope. Sparse grases and forbs in lower lying areas between microtopography in ice wedge polygon formations.

Arndt, Kyle [Woodwell Climate Research Center]↗
DOE OSTI2020

Applying Waveform Correlation to Mining Blasts Using a Global Sparse Network

Agencies that monitor for underground nuclear tests are interested in techniques that automatically characterize mining blasts to reduce the human analyst effort required to produce high-quality event bulletins. Waveform correlation is effective in finding similar waveforms from repeating seismic events, including mining blasts. We report the results of an experiment that uses waveform templates recorded by multiple International Monitoring System stations of the Comprehensive Nuclear-Test-Ban Treaty for up to 10 years prior to detect and identify mining blasts that occur during single weeks of study. We discuss approaches for template selection, threshold setting, and event detection that are specialized for mining blasts and a sparse, global network. We apply the approaches to two different weeks of study for each of two geographic regions, Wyoming and Scandinavia, to evaluate the potential for establishing a set of standards for waveform correlation processing of mining blasts that can be effective for operational monitoring systems with a sparse network. We compare candidate events detected with our processing methods to the Reviewed Event Bulletin of the International Data Centre to develop an intuition about potential reduction in analyst workload.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗