Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “sparse data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,279 records · Page 71
All sourcesNASA NTRSDOE OSTI
DOE OSTI2016

The Improved Simple Corner Balance Method and Efforts to Enhance its Computational Performance

The diamond difference (DD) spatial discretization has long been a work horse of the neutron transport community. For nearly as long as DD has been used in neutron transport, it has been observed that DD produces undamped, non-physical angular fluxes in spatially under resolved problems and can fail in the thick diffusion limit. A long list of alternative spatial discretizations, all with better physics properties: accuracy, robustness, and/or preservation of the thick diffusion limit, have been proposed as alternatives to DD. Unfortunately, these alternative spatial discretizations also require significantly more floating point operations (FLOPs) per unknown compared to DD. Historically, neutron transport problems of interest have been able to be resolved sufficiently that DD is accurate enough and FLOPs have been the computational performance bottleneck controlling time to solution. Thus, in practice DD has been and remains a preferred spatial discretization for neutron transport simulations. Trends in computing architecture are leading to a new paradigm where data movement, not FLOPs will control time to solution. This presents an opportunity to improve neutron transport physics by reconsidering more FLOP intensive spatial discretization than DD without incurring a time to solution penalty. In this work, we consider the improved simple corner balance (ISCB) spatial discretization, a unique alternative to DD that has the same memory footprint as DD, and detail efforts to improve its computational performance. The ISCB spatial discretization is a more FLOP intensive spatial discretization than DD with the same memory footprint as DD. Though designed to maximize FLOP intensity, third party libraries such as LAPACK are not tuned for the unique, frequent, small linear algebra needs of neutron transport problems. While hand coding a sparse Gauss elimination is likely to be faster than a dense matrix solve (CM vs. HGE), were LAPACK suitable for small linear algebra problems, we would not have seen a performance increase with decreased numbers of LAPACK calls for the Schur complement solve (SC4 vs. SC1). Significant effort has reduced the relative compute time of ISCB to DD, but on current computer architectures DD is still faster than ISCB. Future work comparing the overall efficiency of ISCB to DD may reveal that while ISCB is slower than DD on current computers, ISCB is more accurate than DD by a factor greater than the compute time slowdown. As new computer architectures become available, we will test our hypothesis that neutron transport simulations will be bandwidth limited, ideally rendering the additional FLOPs required by ISCB to be 'free' [in terms of time to solution]. (authors)

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

Deep Learning Reconstruction of Daily Soil CO 2 Efflux Reveals Biogeochemical Insights and Reduces Annual Estimate Uncertainty Despite Limited Daily Predictability

Soil CO 2 efflux is commonly measured monthly or seasonally, leaving daily dynamics poorly resolved and contributing to global estimation uncertainty. We trained a single Long Short-Term Memory (LSTM) model to predict daily soil CO 2 efflux across 82 globally distributed sites in COSORE, with 0.2%–46.9% daily data coverage from 2003 to 2020. Despite using far fewer sites than are typically used to train a single deep learning model, with observations biased toward temperate mesic sites, the LSTM model performed well at approximately one-third of sites, reconstructed nearly 2 decades of daily efflux, and outperformed commonly used approaches for estimating daily efflux when applied to the same data set. Performance was weakest at pronounced peaks and troughs and at non-temperate sites with <1.5 years of observations and irregular data patterns. Nevertheless, annual efflux from reconstructed daily data had <40% error even at underperforming sites, substantially improving estimates derived from monthly and seasonal sampling (maximum errors of 95% and 136%, respectively). Temperature sensitivity (Q 10 ) estimated from reconstructed daily predictions closely matched estimates from daily observations, whereas Q 10 values derived from monthly or seasonal observations deviated substantially, suggesting that coarse temporal sampling may contribute to uncertainty in reported Q 10 values. Consistent daily reconstructions further enabled trend analyses for well-performing, predominantly temperate sites and showed increasing soil CO 2 efflux at most sites from 2003 to 2020, with more variable summer trends. Despite limitations, these results demonstrate the potential of LSTM models to reconstruct daily soil CO 2 efflux and reduce estimation uncertainties from sparse observations.

Smykalov, Valerie [Pennsylvania State University, ↗
DOE OSTI2021

Data-driven Distributed Learning of Multi-agent Systems: A Koopman Operator Approach

Koopman operator theory provides a model-free technique for studying nonlinear dynamical systems purely from data. Since the Koopman operator is infinite-dimensional, researchers have developed several methods that provide a finite-dimensional approximation of the Koopman operator so that it can be applied for practical use cases. One common thing with most of the methods is that their solutions are obtained by solving a centralized minimization problem. In this work, we treat the dynamical system to be a multi-agent system and propose an algorithm to compute the finite-dimensional approximation of the Koopman operator in a distributed manner using the knowledge of the topology of the underlying multi-agent system. The proposed distributed approach is shown to be equivalent to the centralized learning problem and results in a sparse Koopman whose block structure mimics the Laplacian of the multi-agent system. Extensive simulation studies illustrate the proposed framework on the network of oscillators and the IEEE 68 bus system.

Nandanoori, Sai Pushpak↗
DOE OSTI2016

AmeriFlux CA-SF3 Saskatchewan - Western Boreal, forest burned in 1998.

This is the AmeriFlux version of the carbon flux data for the site CA-SF3 Saskatchewan - Western Boreal, forest burned in 1998.. Site Description - The 1998 burn site (F98) was in the east part of Prince Albert National Park, Saskatchewan, in the Waskesiu Fire, ignited by lightning that burned about 1700 ha in July 1998. The pre-fire forest consisted of jack pine and black spruce stands, with some intermixed aspen. The fire was severe, consuming much of the top layer of organic soil and killing all trees. In 2001, much of the regenerating vegetation consisted of aspen saplings about 1 m tall and shorter jack pine and black spruce seedlings. An overstory of dead, leafless jack pine trees dominated at a height of 18 m. Sparse grass and herbs, such as fireweed (Epilobium angustifolium L.) covered the ground. There were a large number of fallen dead trees, mostly perched above the ground and not decomposing quickly.

Amiro, Brian↗
DOE OSTI2025

Solving high-dimensional inverse problems using amortized likelihood-free inference with noisy and incomplete data

Here, we present a likelihood-free probabilistic inversion method based on normalizing flows for high-dimensional inverse problems. The proposed method is composed of two complementary networks: a summary network for data compression and an inference network for parameter estimation. The summary network encodes raw observations into a fixed-size vector of summary features, while the inference network generates samples of the approximate posterior distribution of the model parameters based on these summary features. The posterior samples are produced in a deep generative fashion by sampling from a latent Gaussian distribution and passing these samples through an invertible transformation. We construct this invertible transformation by sequentially alternating conditional invertible neural network and conditional neural spline flow layers. The summary and inference networks are trained simultaneously. We apply the proposed method to an inversion problem in groundwater hydrology to estimate the posterior distribution of the log-conductivity field conditioned on spatially sparse time-series observations of the system’s hydraulic head responses. The conductivity field is represented with 706 degrees of freedom in the considered problem. Comparison with the likelihood-based iterative ensemble smoother PEST-IES method demonstrates that the proposed method accurately estimates the parameter posterior distribution and the observations’ predictive posterior distribution at a fraction of the inference time of PEST-IES.

conditional invertible neural network↗
DOE OSTI2021

Vinculin is required for neuronal mechanosensing but not for axon outgrowth

Integrin receptors are transmembrane proteins that bind to the extracellular matrix (ECM). In most animal cell types integrins cluster together with adaptor proteins at focal adhesions that sense and respond to external mechanical signals. In the central nervous system (CNS), ECM proteins are sparsely distributed, the tissue is comparatively soft and neurons do not form focal adhesions. Thus, how neurons sense tissue stiffness is currently poorly understood. Here, we found that integrins and the integrin-associated proteins talin and focal adhesion kinase (FAK) are required for the outgrowth of neuronal processes. Vinculin, however, whilst not required for neurite outgrowth was a key regulator of integrin-mediated mechanosensing of neurons. During growth, growth cones of axons of CNS derived cells exerted dynamic stresses of around 10–12 Pa on their environment, and axons grew significantly longer on soft (0.4 kPa) compared to stiff (8 kPa) substrates. Depletion of vinculin blocked this ability of growth cones to distinguish between soft and stiff substrates. These data suggest that vinculin in neurons acts as a key mechanosensor, involved in the regulation of growth cone motility.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2026

Advancing Asset Management in Water Infrastructure Systems

Aging water system infrastructure, including drinking water, wastewater, and stormwater, poses a growing challenge for utilities and municipalities. These water systems have well documented challenges with respect to their age, condition, and level of service. ASCE annual report cards consistently rate these infrastructure systems in the United States as underfunded, overcapacity, or past service life (ASCE 2025 Report Card). For example, Chini and Stillwell (2017) estimated that the mean water loss in drinking water systems, i.e., non-revenue water, is approximately 16% across the United States. These concerns are not just relegated to the United States, with Courtenay, British Columbia, identifying 17% of their water main pipes as in a ‘poor’ condition state, defined as a category condition 5 out of 5 (City of Courtenay, 2024). These cases illustrate the challenges utilities are facing to manage extensive networks of infrastructure to deliver a consistent and high level of service. For buried infrastructure such as water systems, studies suggest that preventative interventions can lead to lower maintenance costs and fewer service disruptions (Mazumder et al, 2018; Li et al, 2014). The demonstrated need and benefit of appropriately applied asset management is juxtaposed against the relatively sparse literature that evaluates water systems within an asset management construct. Since 2020, just 37 papers specifically reference asset management in the Journal of Water Resources Planning and Management. Of those, only a few specifically look to develop strategies for improved asset management. Therefore, we highlight four key research areas that represent opportunities for advancement of asset management research for water systems. First, advances in condition assessment and forecasting are needed to better estimate asset deterioration using diverse datasets. Second, machine learning (ML) and artificial intelligence (AI) hold promise for predictive maintenance and investment prioritization, though questions of generalizability and model transparency remain. Third, applying a value of information framework can guide utilities in making cost-effective sensor deployment and data collection decisions, to direct monitoring strategies towards data-informed asset management decisions. Finally, integrated infrastructure management is critical, requiring coordinated planning with other infrastructure systems and stakeholder engagement to reduce costs and enhance service delivery.

Chini, Christopher M.↗
DOE OSTI2024

AmeriFlux FLUXNET-1F CA-SCC Scotty Creek Landscape

This is the AmeriFlux Management Project (AMP) created FLUXNET-1F version of the carbon flux data for the site CA-SCC Scotty Creek Landscape. This is the FLUXNET version of the carbon flux data for the site CA-SCC Scotty Creek Landscape produced by applying the standard ONEFlux (1F) software. Site Description - The Scotty Creek flux tower is located in an organic-rich boreal forest-wetland landscape about 50 km south of Fort Simpson in the Taiga Plains of the Mackenzie watershed. The tower was installed in 2013 and operates an open-path EC system year-round running on solar power only. Flux footprints contain about 50 % forested peat plateaus and 50 % wetlands (i.e., collapse-scar bogs). The forests are underlain by permafrost, while the treeless wetlands are permafrost-free. The tower itself is located on a forested peat plateau. Black spruce tree density on plateaus is sparse and the mean canopy height is ca. 5 m.

Sonnentag, Oliver↗
DOE OSTI2016

PERIOD ESTIMATION FOR SPARSELY SAMPLED QUASI-PERIODIC LIGHT CURVES APPLIED TO MIRAS

We develop a nonlinear semi-parametric Gaussian process model to estimate periods of Miras with sparsely sampled light curves. The model uses a sinusoidal basis for the periodic variation and a Gaussian process for the stochastic changes. We use maximum likelihood to estimate the period and the parameters of the Gaussian process, while integrating out the effects of other nuisance parameters in the model with respect to a suitable prior distribution obtained from earlier studies. Since the likelihood is highly multimodal for period, we implement a hybrid method that applies the quasi-Newton algorithm for Gaussian process parameters and search the period/frequency parameter space over a dense grid. A large-scale, high-fidelity simulation is conducted to mimic the sampling quality of Mira light curves obtained by the M33 Synoptic Stellar Survey. The simulated data set is publicly available and can serve as a testbed for future evaluation of different period estimation methods. The semi-parametric model outperforms an existing algorithm on this simulated test data set as measured by period recovery rate and quality of the resulting period–luminosity relations.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Integration of Large-Scale Electrical Imaging into Geological Framework Development and Refinement

Geologic framework models (GFMs) are critical to the construction of reliable simulation models of groundwater flow and contaminant transport. To support GFM development, direct information (e.g., core samples, fluid samples, hydraulic testing) tends to be sparse and separated by large distances relative to the spatial scales of aquifer heterogeneity. There are additional challenges associated with highly contaminated legacy waste sites, where drilling is particularly costly, and invasive sampling requires specialized handling and disposal of hazardous materials. At these sites in particular, non-invasive geophysical imaging can play an important role in filling spatial gaps between boreholes and reducing characterization costs by optimizing and minimizing the number of necessary boreholes. Here this paper presents a case study demonstrating the use of large-scale (> 30 km 2 ) electrical mapping to identify hydrostratigraphy and potential paleochannels at the Hanford Site, located in Washington State, USA. In two field campaigns, over 36 line-kilometers of electrical resistivity tomography (ERT) data were collected along 14 transects. ERT surveys were sited and performed to image critical aspects (e.g., paleochannels, stratigraphic contacts) of the subsurface, demonstrating a general workflow for integrating ERT with GFM development. Inconsistencies between the GFM and ERT were catalogued to provide a basis for future site characterization using complementary geophysical methods and (or) direct sampling.

58 GEOSCIENCES↗
DOE OSTI2021

Modeling atmospheric data and identifying dynamics Temporal data-driven modeling of air pollutants

Atmospheric modelling has recently experienced a surge with the advent of deep learning. Most of these models, however, predict concentrations of pollutants following a data-driven approach in which the physical laws that govern their behaviors and relationships remain hidden. Furthermore, with the aid of real-world air quality data collected hourly in different stations throughout Madrid, we present a case study using a series of data-driven techniques with the following goals: (1) Find systems of ordinary differential equations that model the concentration of pollutants and their changes over time; (2) assess the performance and limitations of our model using stability analysis; (3) reconstruct the time series of chemical pollutants not measured in certain stations using delay coordinate embedding results.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

High-resolution national mapping of natural gas composition substantially updates methane leakage impacts

Methane is emitted from oil and gas operations alongside heavier hydrocarbons and non-hydrocarbon gases, shaping emissions management decision-making, including air quality impacts. Yet, most assessments assume fixed gas composition, overlooking significant spatial and temporal variations. Here, we generate a high-resolution, data-driven map of natural gas composition across the United States, reconstructing methane, heavier hydrocarbons, and non-hydrocarbon species using spatio-temporal interpolation and oil-and-gas production patterns. Our approach is able to reduce composition prediction errors by 39% in terms of Mean Absolute Error (MAE) compared to standard techniques and reveals that methane loss rates have been underestimated by more than 50% in some regions. Beyond methane, we uncover substantial variability in co-emitted gases, exposing blind spots in current emissions inventories and emissions management frameworks. Our work enables more accurate emissions assessments, guides targeted measurement strategies, and informs emissions management decision-making. It also provides a general framework for prediction in environmental applications that integrate sparse measurements with auxiliary variables.

03 NATURAL GAS↗
DOE OSTI2013

Application of adaptive hierarchical sparse grid collocation to the uncertainty quantification of nuclear reactor simulators

Recent efforts in the application of uncertainty quantification to nuclear systems have utilized methods based on generalized perturbation theory and stochastic sampling. While these methods have proven to be effective they both have major drawbacks that may impede further progress. A relatively new approach based on spectral elements for uncertainty quantification is applied in this paper to several problems in reactor simulation. Spectral methods based on collocation attempt to couple the approximation free nature of stochastic sampling methods with the determinism of generalized perturbation theory. The specific spectral method used in this paper employs both the Smolyak algorithm and adaptivity by using Newton-Cotes collocation points along with linear hat basis functions. Using this approach, a surrogate model for the outputs of a computer code is constructed hierarchically by adaptively refining the collocation grid until the interpolant is converged to a user-defined threshold. The method inherently fits into the framework of parallel computing and allows for the extraction of meaningful statistics and data that are not within reach of stochastic sampling and generalized perturbation theory. This paper aims to demonstrate the advantages of spectral methods-especially when compared to current methods used in reactor physics for uncertainty quantification-and to illustrate their full potential. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2015

Performance analysis of distributed symmetric sparse matrix vector multiplication algorithm for multi-core architectures

In this article, sparse matrix vector multiply (SpMVM) is an important kernel that frequently arises in high performance computing applications. Due to its low arithmetic intensity, several approaches have been proposed in literature to improve its scalability and efficiency in large scale computations. In this paper, our target systems are high end multi-core architectures and we use messaging passing interface + open multiprocessing hybrid programming model for parallelism. We analyze the performance of recently proposed implementation of the distributed symmetric SpMVM, originally developed for large sparse symmetric matrices arising in ab initio nuclear structure calculations. We also study important features of this implementation and compare with previously reported implementations that do not exploit underlying symmetry. Our SpMVM implementations leverage the hybrid paradigm to efficiently overlap expensive communications with computations. Our main comparison criterion is the "CPU core hours" metric, which is the main measure of resource usage on supercomputers. We analyze the effects of topology-aware mapping heuristic using simplified network load model. Furthermore, we have tested the different SpMVM implementations on two large clusters with 3D Torus and Dragonfly topology. Our results show that the distributed SpMVM implementation that exploits matrix symmetry and hides communication yields the best value for the "CPU core hours" metric and significantly reduces data movement overheads.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Verrucomicrobia are prevalent in north-temperate freshwater lakes and display class-level preferences between lake habitats

The bacterial phylum Verrucomicrobia was formally described two decades ago and originally believed to be a minor member of many ecosystems; however, it is now recognized as ubiquitous and abundant in both soil and aquatic systems. Nevertheless, knowledge of the drivers of its relative abundance and within-phylum habitat preferences remains sparse, especially in lake systems. Here, we documented the distribution of Verrucomicrobia in 12 inland lakes in Southeastern Michigan, a Laurentian Great Lake (Lake Michigan), and a freshwater estuary, which span a gradient in lake sizes, depths, residence times, and trophic states. A wide range of physical and geochemical parameters was covered by sampling seasonally from the surface and bottom of each lake, and by separating samples into particle-associated and free-living fractions. On average, Verrucomicrobia was the 4 th most abundant phylum (range 1.7–41.7%). Fraction, season, station, and depth explained up to 70% of the variance in Verrucomicrobia community composition and preference for these habitats was phylogenetically conserved at the class-level. When relative abundance was linearly modeled against environmental data, Verrucomicrobia and non-Verrucomicrobia bacterial community composition correlated to similar quantitative environmental parameters, although there were lake system-dependent differences and > 55% of the variance remained unexplained. A majority of the phylum exhibited preference for the particle-associated fraction and two classes (Opitutae and Verrucomicrobiae) were identified to be more abundant during the spring season. This study highlights the high relative abundance of Verrucomicrobia in north temperate lake systems and expands insights into drivers of within-phylum habitat preferences of the Verrucomicrobia.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

AmeriFlux FLUXNET-1F US-TLR Timberlake Observatory for Wetland Restoration (TOWeR)

This is the AmeriFlux Management Project (AMP) created FLUXNET-1F version of the carbon flux data for the site US-TLR Timberlake Observatory for Wetland Restoration (TOWeR). This is the FLUXNET version of the carbon flux data for the site US-TLR Timberlake Observatory for Wetland Restoration (TOWeR) produced by applying the standard ONEFlux (1F) software. Site Description - This tower is located in Timberlake Forest, a restored forested wetland located 4 km from Albermarle Sound on the North Carolina coast. The forest to the south of the tower had historically been ditched, drained and converted to agricultural land, and subsequently reforested with Black Gum and Cypress trees and naturally re-wetted in 2006. This southern region has a bottomland forest ecosystem which saw a large-scale succession event of pine trees following the reforestation efforts. The northern part of the forest had been ditched, but never drained or converted for other land uses. It is much wetter and more sparsely vegetated when compared to the southern region, and has a mixed bottomland forest and swamp ecosystem.

Rey-Sanchez, Camilo [North Carolina State Universi↗
DOE OSTI2026

AmeriFlux FLUXNET-1F CA-SF3 Saskatchewan - Western Boreal, forest burned in 1998

This is the AmeriFlux Management Project (AMP) created FLUXNET-1F version of the carbon flux data for the site CA-SF3 Saskatchewan - Western Boreal, forest burned in 1998. This is the FLUXNET version of the carbon flux data for the site CA-SF3 Saskatchewan - Western Boreal, forest burned in 1998 produced by applying the standard ONEFlux (1F) software. Site Description - The 1998 burn site (F98) was in the east part of Prince Albert National Park, Saskatchewan, in the Waskesiu Fire, ignited by lightning that burned about 1700 ha in July 1998. The pre-fire forest consisted of jack pine and black spruce stands, with some intermixed aspen. The fire was severe, consuming much of the top layer of organic soil and killing all trees. In 2001, much of the regenerating vegetation consisted of aspen saplings about 1 m tall and shorter jack pine and black spruce seedlings. An overstory of dead, leafless jack pine trees dominated at a height of 18 m. Sparse grass and herbs, such as fireweed (Epilobium angustifolium L.) covered the ground. There were a large number of fallen dead trees, mostly perched above the ground and not decomposing quickly.

Amiro, Brian [University of Manitoba; Canadian For↗
DOE OSTI2016

THE NUCLEAR ACTIVITIES OF NEARBY S0 GALAXIES

We present a study of nuclear activities in nearby S0 galaxies. After cross-matching the Sloan Digital Sky Survey Data Release 7 with the Third Reference Catalog of Bright Galaxies (RC3) and visually checking the SDSS images, we derive a sample of 583 S0 galaxies with the central spectrophotometric information. In order to separate nebular emission lines from the underlying stellar contribution, we fit the stellar population model to the SDSS spectra of these S0 galaxies. According to the BPT diagram, we find that 8% of S0 galaxies show central star-forming activity, while the fractions of Seyfert, Composite, and low-ionization nuclear emission-line regions (LINERs) are 2%, 8%, and 21.4%, respectively. We also find that star-forming S0s have the lowest stellar masses, over one magnitude lower than the others, and that the active S0s are mainly located in the sparse environment, while the normal S0s are located in the dense environment, which might suggest that the environment plays an important role in quenching star formation and/or AGN activity in S0 galaxies. By performing bulge-disk decomposition of 45 star-forming S0s in g - and r -bands with the 2D fitting software Galfit, as well as exploiting the catalog of 2D photometric decompositions of Meert et al., we find that the bulges of approximately one-third of star-forming S0 galaxies (16/45) are bluer than their disks, while for other types of S0s the bulge and disk components show similar color distributions. Besides, the Sérsic index of most star-forming S0s bulges is less than two, while for normal S0s, it is between two and six.

79 ASTRONOMY AND ASTROPHYSICS↗