Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “sparse sampling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15
All sourcesNASA NTRSDOE OSTI
DOE OSTI2014

A new estimate of the China temperature anomaly series and uncertainty assessment in 1900–2006

While global warming during the last century has been well recognized, the magnitude of the climate warming in regions such as China over the past 100 years still has some uncertainty due to limited observations during the early years. Several series of temperature anomalies for the 20th century in China have been independently developed by different groups. The uncertainty arises mainly from the sparse observations before 1950, where statistics are sensitive to the small and potentially biased sample. In this study, BSHADE–MSN (Biased Sentinel Hospitals Areal Disease Estimation and Means of Stratified Nonhomogeneous Surface), a combination of two novel distinct statistical methods that are applicable with different sample situations to a spatial heterogeneous surface, is applied to estimate annual mean temperature anomalies for China. This method takes into account prior knowledge of geographical spatial autocorrelation and nonhomogeneity of target domains, remedies the biased sample, and maximizes an objective function for the best linear unbiased estimation (BLUE) of the regional mean quantity. For the period 1900–1999, the overall trend estimated by BSHADE–MSN is 0.80°C with a 95% confidential interval between 0.41°C and 1.18°C. This is significantly lower than that calculated by Climate Anomaly Method (CAM) and Block Kriging. The new temperature anomaly series for China exhibits slightly warmer conditions for the period before 1950 than existing studies. All the methods applied so far agree well with each other for the period after 1950, when there are sufficient stations across the country for the estimation of temperature anomaly series. Cross validation shows that the new regional mean temperature anomaly series has smaller estimation error variance and higher accuracy than those based on the other methods assessed in this study.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Ultrasparse View X-ray Computed Tomography for 4D Imaging

X-ray computed tomography (CT) is a noninvasive, nondestructive approach to imaging materials, material systems, and engineered components in two and three dimensions. Acquisition of three-dimensional (3D) images requires the collection of hundreds or thousands of through-thickness X-ray radiographic images from different angles. Such 3D data acquisition strategies commonly involve suboptimal temporal sampling for in situ and operando studies (4D imaging). Herein, we introduce a sparse-view imaging approach, Tomo-NeRF, which is capable of reconstructing high-fidelity 3D images from <10 twodimensional radiographic images. Experimental 2D and 3D X-ray images were used to test the reconstruction capability in two-view, four-view, and six-view scenarios. Tomo-NeRF is capable of reconstructing 3D images with a structural similarity of 0.9971–0.9975 and a voxel-wise accuracy of 81.83–89.59% from 2D experimentally obtained images. Furthermore, the reconstruction accuracy for the experimentally obtained images is less than the synthetic structures. Experimentally obtained images demonstrate a similarity of 0.9973–0.9984 and a voxelwise accuracy of 84.31–95.77%.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Addressing APC Data Sparsity in Predicting Occupancy and Delay of Transit Buses: A Multitask Learning Approach

Public transit is a vital mode of transportation in urban areas, and its efficiency is crucial for the daily commute of millions of people. To improve the reliability and predictability of transit systems, researchers have developed separate single-task learning models to predict the occupancy and delay of buses at the stop or route level. However, these models provide a narrow view of delay and occupancy at each stop and do not account for the correlation between the two. We propose a novel approach that leverages broader generalizable patterns governing delay and occupancy for improved prediction. We introduce a multitask learning toolchain that takes into account General Transit Feed Specification feeds, Automatic Passenger Counter data, and contextual temporal and spatial information. The toolchain predicts transit delay and occupancy at the stop level, improving the accuracy of the predictions of these two features of a trip given sparse and noisy data. We also show that our toolchain can adapt to fewer samples of new transit data once it has been trained on previous routes/trips as compared to state-of-the-art methods. Finally, we use actual data from Chattanooga, Tennessee, to validate our approach. We compare our approach against the state-of-the-art methods and we show that treating occupancy and delay as related problems improves the accuracy of the predictions. We show that our approach improves delay prediction significantly by as much as 4% in F1 scores while producing equivalent or better results for occupancy.

Zulqarnain, Ammar Bin↗
DOE OSTI2015

Fast generation of sparse random kernel graphs

The development of kernel-based inhomogeneous random graphs has provided models that are flexible enough to capture many observed characteristics of real networks, and that are also mathematically tractable. We specify a class of inhomogeneous random graph models, called random kernel graphs, that produces sparse graphs with tunable graph properties, and we develop an efficient generation algorithm to sample random instances from this model. As real-world networks are usually large, it is essential that the run-time of generation algorithms scales better than quadratically in the number of vertices n. We show that for many practical kernels our algorithm runs in time at most ο(n(logn)²). As an example, we show how to generate samples of power-law degree distribution graphs with tunable assortativity.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Seismic Characterization of the Nevada National Security Site Using Joint Body Wave, Surface Wave, and Gravity Inversion

As a part of the series of Source Physics Experiments (SPE) conducted on the Nevada National Security Site in southern Nevada, we have developed a local–to–regional scale seismic velocity model of the site and surrounding area. Accurate earth models are critical for modeling sources like the SPE to investigate the role of earth structure on the propagation and scattering of seismic waves. We combine seismic body waves, surface waves, and gravity data in a joint inversion procedure to solve for the optimal 3D seismic compressional and shear–wave velocity structures and earthquake locations subject to model smoothness constraints. Earthquakes, which are relocated as part of the inversion, provide P – and S –body–wave absolute and differential travel times. Active source experiments in the region augment this dataset with P –body–wave absolute times and surface–wave dispersion data. Dense ground–based gravity observations and surface–wave dispersion derived from ambient noise in the region fill in many areas where body–wave data are sparse. In general, the top 1–2 km of the surface is relatively poorly sampled by the body waves alone. However, the addition of gravity and surface waves to the body–wave dataset greatly enhances structural resolvability in the near surface. Here, we discuss the methodology we developed for simultaneous inversion of these disparate data types and briefly describe results of the inversion in the context of previous work in the region.

58 GEOSCIENCES↗
DOE OSTI2024

Effect of Biomass Water Dynamics in Cosmic-Ray Neutron Sensor Observations: A Long-Term Analysis of Maize–Soybean Rotation in Nebraska

Precise soil water content (SWC) measurement is crucial for effective water resource management. This study utilizes the Cosmic-Ray Neutron Sensor (CRNS) for area-averaged SWC measurements, emphasizing the need to consider all hydrogen sources, including time-variable plant biomass and water content. Near Mead, Nebraska, three field sites (CSP1, CSP2, and CSP3) growing a maize–soybean rotation were monitored for 5 (CSP1 and CSP2) and 13 (CSP3) years. Data collection included destructive biomass water equivalent (BWE) biweekly sampling, epithermal neutron counts, atmospheric meteorological variables, and point-scale SWC from a sparse time domain reflectometry (TDR) network (four locations and five depths). In 2023, dense gravimetric SWC surveys were collected eight (CSP1 and CSP2) and nine (CSP3) times over the growing season (April to October). The N0 parameter exhibited a linear relationship with BWE, suggesting that a straightforward vegetation correction factor may be suitable (fb). Results from the 2023 gravimetric surveys and long-term TDR data indicated a neutron count rate reduction of about 1% for every 1 kg m−2 (or mm of water) increase in BWE. This reduction factor aligns with existing shorter-term row crop studies but nearly doubles the value previously reported for forests. This long-term study contributes insights into the vegetation correction factor for CRNS, helping resolve a long-standing issue within the CRNS community.

Chemistry↗
DOE OSTI2022

Pan-sharpening for microscopy

Techniques for generating full-spatial resolution, full spectral resolution image(s) from a 3D spectral-data cube for any spectral value within a given spectral range are provided without requiring the acquisition of all full-spatial resolution, full spectral resolution data by an instrument. The 3D spectral-data cube is generated from a limited number of full-spatial resolution, sparse spectral resolution data and a sparse-spatial resolution, full-spectral resolution data of the same area of the sample. The use of the 3D spectral-data cube reduces the data acquisition time.

Ovchinnikova, Olga S.↗
DOE OSTI2015

X-ray computed tomography using curvelet sparse regularization

Purpose: Reconstruction of x-ray computed tomography (CT) data remains a mathematically challenging problem in medical imaging. Complementing the standard analytical reconstruction methods, sparse regularization is growing in importance, as it allows inclusion of prior knowledge. The paper presents a method for sparse regularization based on the curvelet frame for the application to iterative reconstruction in x-ray computed tomography. Methods: In this work, the authors present an iterative reconstruction approach based on the alternating direction method of multipliers using curvelet sparse regularization. Results: Evaluation of the method is performed on a specifically crafted numerical phantom dataset to highlight the method’s strengths. Additional evaluation is performed on two real datasets from commercial scanners with different noise characteristics, a clinical bone sample acquired in a micro-CT and a human abdomen scanned in a diagnostic CT. The results clearly illustrate that curvelet sparse regularization has characteristic strengths. In particular, it improves the restoration and resolution of highly directional, high contrast features with smooth contrast variations. The authors also compare this approach to the popular technique of total variation and to traditional filtered backprojection. Conclusions: The authors conclude that curvelet sparse regularization is able to improve reconstruction quality by reducing noise while preserving highly directional features.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2016

Efficient Uncertainty Quantification in Stochastic Economic Dispatch

Stochastic economic dispatch models usually address uncertainties in forecasts of renewable generation output by considering a finite number of realizations drawn from a stochastic process model, typically via Monte Carlo sampling. Accurate evaluations of expectations or higher order moments for quantities of interest, e.g., generating cost, can require a prohibitively large number of samples. We propose an alternative to Monte Carlo sampling based on polynomial chaos expansions. These representations enable efficient and accurate propagation of uncertainties in model parameters, using sparse quadrature methods. Furthermore, we use Karhunen-Loève expansions for efficient representation of uncertain renewable energy generation that follows geographical and temporal correlations derived from historical data at each wind farm. Considering expected production cost, we show that the proposed approach can yield several orders of magnitude reduction in computational cost for solving stochastic economic dispatch relative to Monte Carlo sampling, for a given target error threshold.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

A dictionary learning algorithm for compression and reconstruction of streaming data in preset order

There has been an emerging interest in developing and applying dictionary learning (DL) to process massive datasets in the last decade. Many of these efforts, however, focus on employing DL to compress and extract a set of important features from data, while considering restoring the original data from this set a secondary goal. On the other hand, although several methods are able to process streaming data by updating the dictionary incrementally as new snapshots pass by, most of those algorithms are designed for the setting where the snapshots are randomly drawn from a probability distribution. In this paper, we present a new DL approach to compress and denoise massive dataset in real time, in which the data are streamed through in a preset order (instances are videos and temporal experimental data), so at any time, we can only observe a biased sample set of the whole data. Here, our approach incrementally builds up the dictionary in a relatively simple manner: if the new snapshot is adequately explained by the current dictionary, we perform a sparse coding to find its sparse representation; otherwise, we add the new snapshot to the dictionary, with a Gram-Schmidt process to maintain the orthogonality. To compress and denoise noisy datasets, we apply the denoising to the snapshot directly before sparse coding, which deviates from traditional dictionary learning approach that achieves denoising via sparse coding. Compared to full-batch matrix decomposition methods, where the whole data is kept in memory, and other mini-batch approaches, where unbiased sampling is often assumed, our approach has minimal requirement in data sampling and storage: i) each snapshot is only seen once then discarded, and ii) the snapshots are drawn in a preset order, so can be highly biased. Through experiments on climate simulations and scanning transmission electron microscopy (STEM) data, we demonstrate that the proposed approach performs competitively to those methods in data reconstruction and denoising.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

1-D coupled surface flow and transport equations revisited via the physics-informed neural network approach

The de Saint-Venant equation (SVE) and advection–diffusion equation (ADE) are commonly employed to solve solute transport problems in surface water. In this work, we propose a mesh-free method based on the physics-informed neural network (PINN) to solve the one dimensional (1-D) SVE, ADE, and the coupled SVE and ADE (SVE-ADE) under various initial and boundary conditions. The PINN model extends the architecture of deep neural networks (DNNs) with implementation of loss function, which are additionally subject to constraints imposed by the physical laws of SVE and ADE, along with their initial and boundary conditions. In such a manner, PINNs can be quickly steered to the true solution while obeying the physical laws. The results of PINN model are compared with the analytical and/or numerical solutions under various conditions to investigate its accuracy and efficiency in solving the SVE, ADE, and SVE-ADE. Our results indicate PINN can accurately simulate the shock wave morphology and avoid numerical dissipation in unsteady flow condition. The PINN method outweighed traditional numerical methods in several aspects, including its ability to function with small amounts of data, no grid discretization, and random selection of sampling points, etc. Additionally, the PINN method is also suitable for solving inverse problems with sparse and noisy data. With 1% noise and 2000 initial and boundary condition points (N u ), the errors of the estimated flow rate (v) and diffusion coefficient (D) are 0.003% and 0.105%, respectively, which indicate the accuracy and robustness of the proposed method. Finally, our results indicate the capability and robustness of the proposed PINN methodology for solving multi-physics problems, irrespective of the presence of sparse and noisy data in the training dataset.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Asymptotic consistency of the WSINDy algorithm in the limit of continuum data

In this work we study the asymptotic consistency of the weak-form sparse identification of nonlinear dynamics algorithm (WSINDy) in the identification of differential equations from noisy samples of solutions. We prove that the WSINDy estimator is unconditionally asymptotically consistent for a wide class of models that includes the Navier–Stokes, Kuramoto–Sivashinsky and Sine–Gordon equations. We thus provide a mathematically rigorous explanation for the observed robustness to noise of weak-form equation learning. Conversely, we also show that, in general, the WSINDy estimator is only conditionally asymptotically consistent, yielding discovery of spurious terms with probability one if the noise level exceeds a critical threshold σ c . We provide explicit bounds on σ c in the case of Gaussian white noise and we explicitly characterize the spurious terms that arise in the case of trigonometric and/or polynomial libraries. Furthermore, we show that, if the data is suitably denoised (a simple moving average filter is sufficient), then asymptotic consistency is recovered for models with locally-Lipschitz, polynomial-growth nonlinearities. Our results reveal important aspects of weak-form equation learning, which may be used to improve future algorithms. We demonstrate our findings numerically using the Lorenz system, the cubic oscillator, a viscous Burgers-growth model and a Kuramoto–Sivashinsky-type high-order PDE.

asymptotic consistency↗
DOE OSTI2021

Granick revisited: Synthesizing evolutionary and ecological evidence for the late origin of bacteriochlorophyll via ghost lineages and horizontal gene transfer

Photosynthesis—both oxygenic and more ancient anoxygenic forms—has fueled the bulk of primary productivity on Earth since it first evolved more than 3.4 billion years ago. However, the early evolutionary history of photosynthesis has been challenging to interpret due to the sparse, scattered distribution of metabolic pathways associated with photosynthesis, long timescales of evolution, and poor sampling of the true environmental diversity of photosynthetic bacteria. Here, we reconsider longstanding hypotheses for the evolutionary history of phototrophy by leveraging recent advances in metagenomic sequencing and phylogenetics to analyze relationships among phototrophic organisms and components of their photosynthesis pathways, including reaction centers and individual proteins and complexes involved in the multi-step synthesis of (bacterio)-chlorophyll pigments. We demonstrate that components of the photosynthetic apparatus have undergone extensive, independent histories of horizontal gene transfer. This suggests an evolutionary mode by which modular components of phototrophy are exchanged between diverse taxa in a piecemeal process that has led to biochemical innovation. We hypothesize that the evolution of extant anoxygenic photosynthetic bacteria has been spurred by ecological competition and restricted niches following the evolution of oxygenic Cyanobacteria and the accumulation of O 2 in the atmosphere, leading to the relatively late evolution of bacteriochlorophyll pigments and the radiation of diverse crown group anoxygenic phototrophs. This hypothesis expands on the classic “Granick hypothesis” for the stepwise evolution of biochemical pathways, synthesizing recent expansion in our understanding of the diversity of phototrophic organisms as well as their evolving ecological context through Earth history.

58 GEOSCIENCES↗
DOE OSTI2025

Seafloor Seismic Noise Patterns Across the Pacific Basin

Seismic hazard monitoring and global tomography efforts are improved by recording signals at a variety of distances and azimuths to maximize subsurface sampling. Although seismic networks provide good to excellent coverage on land, seafloor stations are still sparse. Inclusion of ocean-based data would greatly improve the global coverage of seismic networks, but the use of seafloor seismic data to complement land-based detection and characterization of events is complicated by the generally much higher ambient noise level in the ocean compared to that observed on land. This noise is driven primarily by sea surface waves and tides, but how seismic noise levels vary with location in the oceans is not well described. Here, in this work, we analyze the relationship between ocean surface wave height and seismic noise in the 0.4–4 Hz frequency band at ocean-bottom seismometer deployments across the Pacific basin. We find that a noise-to-responsiveness ratio (NRR)—the median noise level at a station divided by its sea surface wave height responsiveness—correlates negatively with detection success for large teleseismic earthquakes. Stations that are close to land, with relatively shallow ocean and low wind speed, often have lower NRR than open-ocean stations, but the connection between geographic location and earthquake detection success is imperfect.

58 GEOSCIENCES↗
DOE OSTI2021

Efficient Learning of Accurate Surrogates for Simulations of Complex Systems

Machine learning methods are increasingly deployed to construct surrogate models for complex physical systems at a reduced computational cost. However, the predictive capability of these surrogates degrades in the presence of noisy, sparse, or dynamic data. We introduce an online learning method empowered by optimizer-driven sampling that has two advantages over current approaches: it ensures that all local extrema (including endpoints) of the model response surface are included in the training data and it employs a continuous validation and update process in which surrogates undergo retraining when their performance falls below a validity threshold. We find, using benchmark functions, that optimizer-directed sampling generally outperforms traditional sampling methods in terms of accuracy around local extrema even when the scoring metric is biased towards assessing overall accuracy. Finally, the application to dense nuclear matter demonstrates that highly accurate surrogates for a nuclear equation of state model can be reliably auto-generated from expensive calculations using few model evaluations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Automatic Calibration and Health Monitoring of Infrastructure Sensors

Smart transportation infrastructure relies on networks of heterogeneous sensors - cameras, radars, and lidars - continuously monitoring traffic conditions. However, executing the initial spatial calibration of multiple sensors and the subsequent health monitoring presents significant operational challenges. Environmental factors, mechanical vibrations, and gradual drift cause spatial misalignment, degrading fusion performance and tracking accuracy. Traditional calibration approaches require manual intervention with specialized targets or survey equipment, resulting in service interruptions and high maintenance costs. This work presents an automated framework for initial calibration and continuous health monitoring without human intervention or service disruption. Our approach addresses two critical problems: (1) detecting when sensors become miscalibrated during operation, and (2) automatically re-establishing spatial alignment using only operational traffic data. The health monitoring component analyzes measurement innovations - differences between sensor observations and predicted object states - to detect systematic biases indicative of calibration drift. By computing bias magnitude, directional consistency, and rejection rates, the system identifies miscalibrations as small as 0.5 meters. Unlike traditional methods requiring known calibration targets, our diagnostic operates continuously on live traffic observations, enabling early detection before fusion quality degrades. The automatic recalibration algorithm leverages overlapping sensor fields-of-view and temporal correlation of vehicle observations. Using graph-based optimization, the system automatically discovers which sensor pairs observe common regions, estimates pairwise spatial transformations using RANSAC-based robust estimation, and jointly optimizes all sensor poses through bundle adjustment. The framework handles practical deployment challenges, including different sensor sampling rates (1-10 Hz), varying installation positions, unknown orientations, and limited overlap regions (>10%). When approximate sensor positions are available from installation surveys (+/-1m accuracy), the algorithm additionally estimates sensor orientations, refining both position and rotation to sub-meter and sub-degree accuracy. We validate the framework on multi-hour traffic datasets from six heterogeneous sensors with sampling rates ranging from 1 Hz to 10 Hz. Results demonstrate successful calibration even with sparse overlap (<20%) and automatic detection of miscalibrations exceeding 0.8 meters. This work enables a "deploy-and-forget" sensor infrastructure that maintains calibration autonomously, reducing maintenance costs while improving tracking accuracy. The techniques generalize beyond transportation to any multi-sensor monitoring application requiring robust spatial alignment, including smart cities, industrial monitoring, and surveillance systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

An Edge Alignment-Based Orientation Selection Method for Neutron Tomography

Neutron computed tomography (nCT) is a 3D char-acterization technique used to image the internal morphology or chemical composition of samples in biology and materials sciences. A typical workflow involves placing the sample in the path of a neutron beam, acquiring projection data at a predefined set of orientations, and processing the resulting data using an analytic reconstruction algorithm. Typical nCT scans require hours to days to complete and are then processed using conventional filtered back-projection (FBP), which performs poorly with sparse views or noisy data. Hence, the main methods in order to reduce overall acquisition time are the use of an improved sampling strategy combined with the use of advanced reconstruction methods such as model-based iterative reconstruction (MBIR). In this paper, we propose an adaptive orientation selection method in which an MBIR reconstruction on previously-acquired measurements is used to define an objective function on orientations that balances a data-fitting term promoting edge alignment and a regularization term promoting orientation diversity. Using simulated and experimental data, we demonstrate that our method produces high-quality reconstructions using significantly fewer total measurements than the conventional approach.

Yang, Diyu↗
DOE OSTI2020

Methodology for the development of empirical models relating 13C NMR spectral features to fuel properties

Effective formulation of new gasoline or diesel fuels for internal combustion engines would benefit from the development of reliable models for predicting key fuel properties based on a set of molecular descriptors obtained from a single measurement. This is particularly relevant in the case of renewable fuels, where the available fuel sample quantity may be limited. In this work, we present a statistically-based methodology for building empirical models to predict multiple properties from one-dimensional 13C nuclear magnetic resonance (NMR) spectra measured on around 200 microliters of a liquid fuel. NMR spectra contain information about the molecular composition of a sample and the carbon types and molecular substructures therein. Our approach uses this information to build sparse, interpretable models, where the predicted properties are linked to specific molecular features. The approach takes into consideration the constrained nature of the features making up the one-dimensional NMR spectrum, which, after standardization, represent a relative fuel composition. We point to the limitations in interpretability that arise when building this type of empirical predictive model and suggest how these limitations may be diminished. Among the many properties important for maximizing engine performance and minimizing emissions, we build models that predict derived cetane number and distillation temperatures as these are of particular interest because of their links to fuel economy, drivability, and engine-out emissions. Results suggest that the properties of interest may be impacted by only a few of the 27 13C NMR regions represented in the data, pointing to new directions for further testing in the development of improved fuels.

predictive models, biofuels., NMR Analysis↗