Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “sparse data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
NASA NTRS1995

Partitioning of ocean and land uptake of CO2 as inferred by delta C-13 measurements from the NOAA Climate Monitoring and Diagnostics Laboratory Global Air Sampling Network

Using delta C-13 measurements in atmospheric CO2 from a cooperative global air sampling network, we determined the partitioning of the net uptake of CO2 between ocean and land as a function of latitude and time. The majority of delta C-13 measurements were made at the Institute of Arctic and Alpine Research (INSTAAR) of the University of Colorado. We perform an inverse deconvolution of both CO2 and delta C-13 observations, using a two-dimensional model of atmospheric transport. Also, the discrimination against C-13 by plant photosynthesis, as a function of latitude and time, is calculated from global runs of the simple biosphere (SiB) model. Uncertainty due to the longitudinal structure of the data, which is not represented by the model, is studied through a bootstrap analysis by adding and omitting measurement sites. The resulting error estimates for our inferred sources and sinks are of the order of 1 GTC (1 GTC = 10(exp 15) gC). Such error bars do not reflect potential systematic errors arising from our estimates of the isotopic disequilibria between the atmosphere and the oceans and biosphere, which are estimated in a separate sensitivity analysis. With respect to global totals for 1992 we found that 3.2 GTC of carbon dissolved into the ocean and that 1.5 GTC were sequestered by land ecosystems. Northern hemisphere ocean gyres north of 15 deg N absorbed 2.7 GTC. The equatorial oceans between 10 deg S and 10 deg N were a net source to the atmosphere of 0.9 GTC. We obtained a sink of 1.6 GTC in southern ocean gyres south of 20 deg S, although the deconvolution is poorly constrained by sparse data coverage at high southern latitudes. The seasonal uptake of CO2 in the northern gyres appears to be correlated with a bloom of phytoplankton in surface waters. On land, northern temperate and boreal ecosystems between 35 deg N and 65 deg N were found to be a major sink of CO2 in 1992, as large as 3.5 GTC. Northern tropical ecosystems (equator-30 deg N) appear to be a net source to the source to the atmosphere of 2 GTC which could reflect biomass burning. A small sink, 0.3 GTC, was inferred for southern tropical ecosystems (30 deg S-equator).

Ciais, Philippe↗
NASA NTRS2008

Comparison of Satellite-Derived and In-Situ Observations of Ice and Snow Surface Temperatures over Greenland

The most practical way to get a spatially broad and continuous measurements of the surface temperature in the data-sparse cryosphere is by satellite remote sensing. The uncertainties in satellite-derived LSTs must be understood to develop internally-consistent decade-scale land-surface temperature (LST) records needed for climate studies. In this work we assess satellite-derived "clear-sky" LST products from the Moderate Resolution Imaging Spectroradiometer (MODIS) and the Advanced Spaceborne Thermal Emission and Reflection Radiometer (ASTER), and LSTs derived from the Enhanced Thematic Mapper Plus (ETM+) over snow and ice on Greenland. When possible, we compare satellite-derived LSTs with in-situ air-temperature observations from Greenland Climate Network (GC-Net) automatic-weather stations (AWS). We find that MODIS, ASTER and ETM+ provide reliable and consistent LSTs under clear-sky conditions and relatively-flat terrain over snow and ice targets over a range of temperatures from -40 to 0 C. The satellite-derived LSTs agree within a relative RMS uncertainty of approx.0.5 C. The good agreement among the LSTs derived from the various satellite instruments is especially notable since different spectral channels and different retrieval algorithms are used to calculate LST from the raw satellite data. The AWS record in-situ data at a "point" while the satellite instruments record data over an area varying in size from: 57 X 57 m (ETM+), 90 X 90 m (ASTER), or to 1 X 1 km (MODIS). Surface topography and other factors contribute to variability of LST within a pixel, thus the AWS measurements may not be representative of the LST of the pixel. Without more information on the local spatial patterns of LST, the AWS LST cannot be considered valid ground truth for the satellite measurements, with RMS uncertainty approx.2 C. Despite the relatively large AWS-derived uncertainty, we find LST data are characterized by high accuracy but have uncertain absolute precision.

Hall, Dorothy K.↗
NASA NTRS2022

Global Landslide Forecasting System for Hazard Assessment and Situational Awareness

Landslides triggered by extreme rainfall can be devastating, resulting in loss of life, property, and infrastructure. Landslide forecasting systems provide an opportunity to build awareness of potential hazards and ultimately take preemptive measures. There is currently a dearth of forecasting systems that provide regional or global coverage, but these systems can offer important situational awareness in data-sparse, ungauged, or large-scale catchments. A near global, primarily satellite-based system calledthe Landslide Hazard Assessment for Situational Awareness (LHASA) provides near real-time estimates of potential landslide hazard and exposure around the world. In this work, a precipitation forecast module is introduced into LHASA to complement the existing LHASA framework and provide an estimate of landslide hazard up to three days in advanceat 1km resolution. The model-based Goddard Earth Observing System-Forward Processing (GEOS-FP) precipitation forecast product is used as the forcing input for the model in place of the satellite-based Integrated Multi-satellitE Retrievals for Global Precipitation Mission product. Soil moisture and snow depth from the GEOS-FP assimilated product are also incorporated. The study period January 2020–January 2021 is usedto test the model performance against the LHASA near real-time estimates at multiple spatiotemporal scales. Validation of the model is carried out using a collection of rainfall-triggered landslide inventories from around the world as case studies to demonstrate the potential utility and limitations of this system.The rescaling of the GEOS-FP precipitation product is a critical step in incorporating the forecasted precipitation data within LHASA-Forecast (LHASA-F). Combining different streams of forecasted data within the LHASA-F framework shows promise, particularly for larger events at the 1-and 2-day lead time for events. Results indicate that for the case studies evaluated, the LHASA-F is generally able to resolve major landslide events triggered by extreme rainfall, such as from tropical cyclones. The analysis shows that landslide forecast outputs may be represented differently depending on the user’s needs. This framework serves as a first milestone in providing a global predictive view of landslide hazard.

Landslide forecasting system↗
DOE OSTI2025

Quantifying spatial and vertical variations in soil C:N relationships in permafrost-affected landscapes

Permafrost regions are experiencing rapid changes that affect carbon (C) and nitrogen (N) cycles, with implications for vegetation dynamics and gas exchanges with the atmosphere. Soil C:N ratio is a key indicator of organic matter quality, yet spatial estimates of N stocks and C:N ratios lag behind those for C. We used quantile regression forests to compare direct and indirect digital soil mapping approaches for predicting soil C:N ratios at 0–30, 30–60, and 60–100 cm depths across a latitudinal transect in Alaska. The indirect approach – deriving C:N from separately predicted C and N stocks – outperformed direct mapping for the surface layer (0–30 cm), while direct mapping was marginally better at greater depths. However, prediction accuracy decreased with depth for both methods. Temperature and topography were the most important predictors. Both approaches overestimated low and underestimated high C:N ratios, with direct mapping showing greater bias. Our results underscore the challenges of modeling C:N ratios in heterogeneous, data-sparse permafrost soils, but also suggest that indirect mapping holds promise if supported by more extensive datasets.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Integrated top-down process and voxel-based microstructure modeling for Ti-6Al-4V in laser wire direct energy deposition process

Laser-wire metal additive manufacturing (AM) is one of the ideal direct energy deposition (DED) processes for creating large-scale parts with a medium level of complexity. However, the DED process involves complex thermal signatures and wide length scales making the fabrication of realistic AM components and part qualification often reliant on experimental trial-and-error optimization. While experimental measurements over the full volume of a part are valuable and necessary, measuring the entire area of a part is significantly laborious and practically infeasible, particularly for large parts in terms of cost and rapid qualification. Therefore, in this work, we developed an effective thermal and microstructure modeling framework based on the Johnson–Mehl-Avrami-Kolmogorov (JMAK) and Koistinen & Marburger (KM) models through a top-down approach that considers plate distortion-affected thermal profiles. A voxel-by-voxel simulation method is used to predict individual phase fractions of Ti-6Al-4 V. The predicted results were validated through detailed metallurgical measurements. A combined voxel-by-voxel approach with a sparse data reconstruction technique produced a near-perfect reconstruction of the original data. This approach anticipates a significant reduction in data points and computation time and resources. Lastly, we conclude with potential extensions of this work to other modeling efforts.

36 MATERIALS SCIENCE↗
DOE OSTI2025

GenAI4UQ: A software for forward and inverse uncertainty quantification using conditional generative AI

We introduce GenAI4UQ, a software package for forward and inverse uncertainty quantification in model calibration, parameter estimation, and ensemble forecasting. GenAI4UQ leverages a generative AI-based conditional modeling framework to address limitations of traditional inverse modeling techniques, such as Markov Chain Monte Carlo (MCMC) methods. By replacing computationally intensive iterative processes with a direct, learned mapping, GenAI4UQ enables efficient calibration of input parameters and generation of predictions directly from observations. The software supports rapid ensemble forecasting with robust uncertainty quantification while maintaining computational and storage efficiency. Built-in auto-tuning of hyperparameters simplifies model training, ensuring accessibility for users with varying expertise. Its versatile conditional generative framework is applicable across diverse scientific domains. While GenAI4UQ offers significant advantages in flexibility and efficiency, users should interpret its uncertainty estimates with caution in data-sparse scenarios, as the model may overestimate uncertainty—an effect common to all surrogate-based approaches including MCMC with surrogate models. Despite this, GenAI4UQ transforms inverse modeling by providing a fast, reliable, and user-friendly solution. It empowers researchers and practitioners to quickly estimate parameter distributions and generate model predictions for new observations, facilitating efficient decision-making and advancing the state of uncertainty quantification in computational modeling.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Selecting Appropriate Model Complexity: An Example of Tracer Inversion for Thermal Prediction in Enhanced Geothermal Systems

Abstract A major challenge in the inversion of subsurface parameters is the ill‐posedness issue caused by the inherent subsurface complexities and the generally spatially sparse data. Appropriate simplifications of inversion models are thus necessary to make the inversion process tractable and meanwhile preserve the predictive ability of the inversion results. In this study, we investigate the effect of model complexity on fracture aperture inversion and thermal performance prediction in a field‐scale EGS model. Principal component analysis was used to map the aperture field to a low‐dimensional latent space. The complexity of the inversion model was quantitatively represented by the percentage of total variance in the original aperture fields preserved by the latent space. Tracer, pressure and flow rate data were used to invert for fracture aperture through an ensemble‐based inversion method, and the inferred aperture field was used to predict thermal performance. With an over‐simplified aperture model, ensemble collapse occurred. The inverted aperture models failed to resolve necessary flow and transport features, leading to a biased thermal performance prediction. A complex aperture model involved excessive features and was prone to overinterpreting the inversion data. Both the tracer/pressure/flow rate data reproduction and thermal prediction showed significant uncertainties, making it difficult to properly estimate long‐term thermal performance. Fortunately, our results indicate that there exists an appropriate model complexity which can simultaneously match inversion data and predict thermal performance with an acceptable uncertainty. The quality of the fit of tracer data appears to be a useful indicator of such an appropriate model complexity.

15 GEOTHERMAL ENERGY↗
DOE OSTI2024

Deep learning with mixup augmentation for improved pore detection during additive manufacturing

In additive manufacturing (AM), process defects such as keyhole pores are difficult to anticipate, affecting the quality and integrity of the AM-produced materials. Hence, considerable efforts have aimed to predict these process defects by training machine learning (ML) models using passive measurements such as acoustic emissions. This work considered a dataset in which keyhole pores of a laser powder bed fusion (LPBF) experiment were identified using X-ray radiography and then registered both in space and time to acoustic measurements recorded during the LPBF experiment. Due to AM’s intrinsic process controls, where a pore-forming event is relatively rare, the acoustic datasets collected during monitoring include more non-pores than pores. In other words, the dataset for ML model development is imbalanced. Moreover, this imbalanced and sparse data phenomenon remains ubiquitous across many AM monitoring schemes since training data is nontrivial to collect. Hence, we propose a machine learning approach to improve this dataset imbalance and enhance the prediction accuracy of pore-labeled data. Specifically, we investigate how data augmentation helps predict pores and non-pores better. This imbalance is improved using recent advances in data augmentation called Mixup, a weak-supervised learning method. Convolutional neural networks (CNNs) are trained on original and augmented datasets, and an appreciable increase in performance is reported when testing on five different experimental trials. When ML models are trained on original and augmented datasets, they achieve an accuracy of 95% and 99% on test datasets, respectively. We also provide information on how dataset size affects model performance. Lastly, we investigate the optimal Mixup parameters for augmentation in the context of CNN performance.

36 MATERIALS SCIENCE↗
DOE OSTI2026

APSO-enhanced algebraic derivative estimation approach for real-time traffic flow prediction on critical road sections during wildfire evacuation

In rapid-onset disaster scenarios such as wildfires, evacuation traffic often significantly deviates from historical patterns, rendering conventional data-driven forecasting methods less effective. To address this challenge, we propose an improved algebraic derivative estimation (ADE) incorporating particle swarm optimization (PSO) for real-time traffic flow prediction. Our approach dynamically adjusts the ADE prediction time window at each step by minimizing a cost function based on the mean and variance of accumulated forecasting errors within the window, thereby balancing bias and variability. We evaluate the method using traffic data from the January 2025 California wildfires, focusing on key road segments critical for large-scale evacuations. The results demonstrate that our approach surpasses established machine learning and deep learning models—XGBoost, LSTM, and GRU—in predictive accuracy and maintains high computational efficiency. Notably, the proposed method eliminates the need for offline model training. Moreover, rapid PSO-based tuning enables real-time deployment, which provides a crucial advantage in scenarios where evacuation timings and road closures change dynamically. In conclusion, these findings highlight the benefits of the PSO-enhanced ADE framework for emergency traffic management, where rapid, data-sparse forecasts are essential for effective evacuation planning.

Algebraic derivative estimation↗
DOE OSTI2024

Deep learning with mixup augmentation for improved pore detection during additive manufacturing

In additive manufacturing (AM), process defects such as keyhole pores are difficult to anticipate, affecting the quality and integrity of the AM-produced materials. Hence, considerable efforts have aimed to predict these process defects by training machine learning (ML) models using passive measurements such as acoustic emissions. This work considered a dataset in which keyhole pores of a laser powder bed fusion (LPBF) experiment were identified using X-ray radiography and then registered both in space and time to acoustic measurements recorded during the LPBF experiment. Due to AM’s intrinsic process controls, where a pore-forming event is relatively rare, the acoustic datasets collected during monitoring include more non-pores than pores. In other words, the dataset for ML model development is imbalanced. Moreover, this imbalanced and sparse data phenomenon remains ubiquitous across many AM monitoring schemes since training data is nontrivial to collect. Hence, we propose a machine learning approach to improve this dataset imbalance and enhance the prediction accuracy of pore-labeled data. Specifically, we investigate how data augmentation helps predict pores and non-pores better. This imbalance is improved using recent advances in data augmentation called Mixup, a weak-supervised learning method. Convolutional neural networks (CNNs) are trained on original and augmented datasets, and an appreciable increase in performance is reported when testing on five different experimental trials. When ML models are trained on original and augmented datasets, they achieve an accuracy of 95% and 99% on test datasets, respectively. We also provide information on how dataset size affects model performance. Lastly, we investigate the optimal Mixup parameters for augmentation in the context of CNN performance.

42 ENGINEERING↗
DOE OSTI2024

Large spatiotemporal variability in aerosol properties over central Argentina during the CACTI field campaign

Abstract. Few field campaigns with extensive aerosol measurements have been conducted over continental areas in the Southern Hemisphere. To address this data gap and better understand the interactions of convective clouds and the surrounding environment, extensive in situ and remote sensing measurements were collected during the Cloud, Aerosol, and Complex Terrain Interactions (CACTI) field campaign conducted between October 2018 and April 2019 over the Sierras de Córdoba range of central Argentina. This study describes measurements of aerosol number, size, composition, mixing state, and cloud condensation nuclei (CCN) collected on the ground and from a research aircraft during 7 weeks of the campaign. Large spatial and multiday variations in aerosol number, size, composition, and CCN were observed due to transport from upwind sources controlled by mesoscale to synoptic-scale meteorological conditions. Large vertical wind shears, back trajectories, single-particle measurements, and chemical transport model predictions indicate that different types of emissions and source regions, including biogenic emissions and biomass burning from the Amazon and anthropogenic emissions from Chile and eastern Argentina, contribute to aerosols observed during CACTI. Repeated aircraft measurements near the boundary layer top reveal strong spatial and temporal variations in CCN and demonstrate that understanding the complex co-variability of aerosol properties and clouds is critical to quantify the impact of aerosol–cloud interactions. In addition to quantifying aerosol properties in this data-sparse region, these measurements will be valuable to evaluate predictions over the midlatitudes of South America and improve parameterized aerosol processes in local, regional, and global models.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1972

Improvement of synoptic scale moisture and wind field analyses using the Nimbus 4 THIR 6.7 micron observations

The Nimbus 4 temperature-humidity infrared radiometer (THIR) monitors radiation in the 6.5 to 7.2 micron water vapor absorption with a 23 kilometer spatial resolution at the sub-satellite point. Radiation monitored in this spectral region results primarily from emission in the 250 to 500 millibar region of the upper troposphere. The THIR 6.7 micron observations are readily available in photofacsimile imagery form which shows very distinctive patterns associated with spatial variations in atmospheric water vapor. These radiometric observations were combined in several instances with moisture values measured in the upper troposphere by the standard radiosonde network. In each instance, the result is a much more consistent analysis showing increased spatial detail that agrees with the radiometric observations and does not compromise the conventional data. The improved moisture analyses show relatively dry and moist tongues that are very difficult or impossible to infer from the conventional data alone. The patterns in the moisture fields can be tracked over 12 and 24 hour periods. In addition, by keeping in mind the advective properties of the moisture field, success was achieved in improving streamline analyses at the 400 mb level over data sparse regions on a global scale.

Steranko, J.↗
NASA NTRS1972

Improvement of synoptic scale moisture and wind field analyses using the Nimbus 4 THIR 6.7-micron observations.

Discussion of some examples demonstrating that water vapor channel imagery from meteorological satellites, particularly Nimbus 4, can be quite helpful in improving moisture and wind analyses. Satellite imagery is shown to make possible the extrapolation of conventional measurements into data-sparse regions and the introduction of considerably greater detail into analyses of meterological parameters. In addition, the wide-area synoptic coverage of satellites can shed light on the interconnections of tropical and midlatitude systems discernible in the upper troposphere.

Steranka, J.↗
NASA NTRS1978

Remote sensing of the atmosphere from environmental satellites

The paper outlines the basis of remote sensing in satellite meteorology, the evolution of remote sensors, examples of practical applications, and a prospectus of future developments. The meteorological satellites use instrumentation sensitive to different regions of the electromagnetic spectrum to observe and measure atmospheric and surface properties. In the ultraviolet, solar variability is measured and total atmospheric ozone determined. In the visible, imagery of cloud systems provides better location of storms in data-sparse areas, observes ice and snow boundaries, and monitors floods. Capabilities of microwave imagery are discussed along with successful uses of geosynchronous satellites. Future environmental satellite programs are discussed in some detail, including GARP, TIROS-N and CLIMSAT.

Allison, L. J.↗
NASA NTRS1980

A preliminary assessment of the accuracy of selected meteorological parameters determined from Nimbus 6 satellite profile data

Published rms errors in rawinsonde data and discrepancies between satellite and rawinsonde profile data for temperature, dewpoint temperature, mixing ratio, and wind speed. Satellite rms errors were found to be 2 to 3 times as large as those for rawinsonde data. Gradients of the preceding parameters were computed for both rawinsonde and satellite data and compared with means and near extreme values computed from the AVE 2 and AVE 4 experiments. In all cases, it was found that satellite data can be used to determine with relatively good accuracy the near extreme gradients but not those whose value does not exceed the average. Synoptic charts were prepared to show that patterns of temperature could be determined with relatively good accuracy, while those of dew point were not as good as those for temperature. Winds represented by cloud motion vectors (satellite winds) were compared with rawinsonde winds, and it was found that large gaps exist in satellite values for a given pressure level and that errors in the satellite determined concluded that satellite profile data are very useful in synoptic analysis, particularly in data sparse regions as well as regions where near extreme gradients exist in the measured parameters.

Scoggins, J. R.↗
NASA NTRS1979

Subjective evaluation of the combined influence of satellite temperature sounding data and increased model resolution on numerical weather forecasting

The present evaluation is concerned with (1) the significance of prognostic differences resulting from the inclusion of satellite-derived temperature soundings, (2) how specific differences between the SAT and NOSAT prognoses evolve, and (3) comparison of two experiments using the Goddard Laboratory for Atmospheric Sciences general circulation model. The subjective evaluation indicates that the beneficial impact of sounding data is enhanced with increased resolution. It is suggested that satellite sounding data posses valuable information content which at times can correct gross analysis errors in data sparse regions.

Atlas, R.↗
NASA NTRS1981

Sensitivity of wind analyses to barotropic energetics during summer

Three analysis schemes - the extended correction method of the University of Hawaii at Manoa (UHM), the National Meteorological Center (NMC) Hough analysis, and Sadler's subjective stream analysis (SUB) - were used to obtain grid-point winds using data for a five-day period in late summer, and barotropic energetics computations obtained using the three schemes for six limited regions in the Pacific and Indian Oceans were compared. Few differences were observed between UHM and NMC stream-function analyses, but significant differences were found in the wind fields and energetics obtained using the subjective method and the two objective methods in data-sparse regions. Major features in the local barotropic criteria field were found to be less sensitive to the analysis scheme used.

Sumi, A.↗
NASA NTRS1981

The state of the atmosphere as inferred from the FGGE satellite observing systems during SOP-1

The statistical properties, and coverage, of satellite temperature sounding data are described. Tropical regions are observed every two days, extratropics from one to four times a day. Oceans are covered two to three times a day. Asynoptic coverage is comparable to the U.S. rawinsonde network twice daily coverage. Lack of ground truth for data sparse areas makes accuracy difficult to assess. The rms differences of layer mean temperatures obtained from collocating rawinsonde observations with satellite temperature profiles in space and time differ from rms differences of layer mean satellite temperature soundings. The FGGE satellite systems can infer the three dimensional motion field and improve the representation of the large scale state of the atmosphere.

Halem, M.↗