Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “sparse data set”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

Acoustic- and elastic-waveform inversion with total generalized p-variation regularization

Geophysical models usually contain both sharp interfaces and smooth variations, and it is difficult to accurately account for both of these two types of medium parameter variations using conventional full-waveform inversion methods. We develop a novel full-waveform inversion method for acoustic and elastic waves using a total generalized p-variation regularization scheme to address these challenging problems. We decompose the full-waveform inversion into two subproblems and solve these two minimization subproblems using an alternating-direction minimization strategy. One significant advantage of the total generalized p-variation regularization scheme is that it can simultaneously reconstruct sharp interfaces and smooth background variations of geophysical parameters. Such capability can also effectively suppress the noises in source-encoded inversion and sparse-data inversion, or inversion of noisy data. We demonstrate the advantages of our full-waveform inversion method using a checkerboard model, a modified elastic SEG/EAGE overthrust model, and a land field seismic data set. Our conclusions of synthetic and field seismic data demonstrate that our method reconstructs both smooth background variations and sharp interfaces of subsurface geophysical properties accurately, and provides a useful tool for accurate and reliable inversion of field seismic data.

58 GEOSCIENCES↗
DOE OSTI2025

Automatic Image Point Matching

Sparse Image Point Matching (SIPM) is a foundational technology for photo triangulation, structure from motion (SfM), Simultaneous Location and Mapping (SLAM), and data fusion. The goal of the matching is to automatically generate sets of image coordinates that identify the same feature across images. Ideally, the process should be robust to lighting, scale, perspective, and modality changes. The scope of the image matching topic in the field of remote sensing (RS) is enormous because of the variety of collection platforms, modalities, sensor types, applications, and subjects. In this work, we report the history of and assess the state of the art of visible-spectrum (panchromatic and color) image matching of the Earth’s surface. Work specific to large-format images (LFI) (e.g., metric aerial cameras and Earth-observing satellites) will be highlighted. However, the state of the art in this century will mostly be traced through machine vision research and benchmarks because research specific to LFI is rare.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1983

The impact of satellite soundings and their distribution on forecast accuracy

The impact of satellite data is found to vary considerably from one map to another and from one geographic region to another. However, the impact of satellite data is generally small in comparison with forecast error. On the average, over land areas (where good conventional data permit accurate verification), the impact of satellite data on 48-hr forecasts of 500-mb height is seen to be neutral. Indirect numerical evidence is found, however, that satellite data has a marked positive impact in the lower and middle troposphere in ocean regions, especially those regions where conventional data are sparse. The impact over oceans is found to be especially noticeable in maps depicting the mean differences between the satellite and the conventional-data-only maps averaged over the period of the data set (January 1-14, 1980), both for analyses and for forecasts to 48 hours.

Thomasell, A., Jr.↗
NASA NTRS2009

Synthesis and Assimilation Systems - Essential Adjuncts to the Observing System

Assimilation systems synthesize diverse in-situ and satellite data streams into full four-dimensional state estimates by combining the strengths of each data set and also of the model. The resulting analysis provides an integrated view of the information in the various observations as well as derived estimates of unobserved quantities. Assimilation systems are particularly important for the ocean where subsurface observations, even today, are sparse and intermittent compared with the scales needed to represent ocean variability and where satellites only sense the surface. Increasingly, models and assimilation systems are being used to provide information about the current observing system and to help in the design plans for new observations. Whether it is as a user of observations or a contributor to evaluation of the observing system, ocean synthesis and assimilation systems are now an integral part of the global ocean observing and information system. Major advances have been made over the last decade under the auspices of WCRP's Climate Variability and Predictability Project (CLIVAR) and the Global Ocean Data Assimilation Experiment (GODAE). In addition to advances in the assimilation systems, there have been major developments in the observing system, with satellite altimetry, the tropical moored buoy arrays in the Pacific and Atlantic, and more recently Argo. These developments have led to significant advances in our understanding and prediction of ocean variations at both mesoscale and climate scales. Many challenges remain. Some of these challenges lie in the observations themselves, some in the assimilation systems that, even in the more recent era of unprecedented observations from satellite altimetry and Argo, provide different views of climate variations. Yet there are many examples of successful applications from ocean assimilation products. Use of these systems for assessing the observing system helps identify the strengths of each observation type, and indicates that none of the current observations is redundant. Indeed, the indication is that the ocean remains under-sampled and that further improvements in the observing system are needed for both climate monitoring and prediction. Future developments will be increasingly towards consistent analyses across components of the Earth system using, e.g., coupled atmosphere-ocean models.

Rienecker, Michele M.↗
DOE OSTI2022

Equation‐Free Surrogate Modeling of Geophysical Flows at the Intersection of Machine Learning and Data Assimilation

Abstract There is a growing interest in developing data‐driven reduced‐order models for atmospheric and oceanic flows that are trained on data obtained either from high‐resolution simulations or satellite observations. The data‐driven models are non‐intrusive in nature and offer significant computational savings compared to large‐scale numerical models. These low‐dimensional models can be utilized to reduce the computational burden of generating forecasts and estimating model uncertainty without losing the key information needed for data assimilation (DA) to produce accurate state estimates. This paper aims at exploring an equation‐free surrogate modeling approach at the intersection of machine learning and DA in Earth system modeling. With this objective, we introduce an end‐to‐end non‐intrusive reduced‐order modeling (NIROM) framework equipped with contributions in modal decomposition, time series prediction, optimal sensor placement, and sequential DA. Specifically, we use proper orthogonal decomposition (POD) to identify the dominant structures of the flow, and a long short‐term memory network to model the dynamics of the POD modes. The NIROM is integrated within the deterministic ensemble Kalman filter (DEnKF) to incorporate sparse and noisy observations at optimal sensor locations obtained through QR pivoting. The feasibility and the benefit of the proposed framework are demonstrated for the NOAA Optimum Interpolation Sea Surface Temperature (SST) V2 data set. Our results indicate that the NIROM is stable for long‐term forecasting and can model dynamics of SST with a reasonable level of accuracy. Furthermore, the prediction accuracy of the NIROM gets improved by almost one order of magnitude by the DEnKF algorithm.

Pawar, Suraj↗
DOE OSTI2019

SPIND : a reference-based auto-indexing algorithm for sparse serial crystallography data

SPIND (sparse-pattern indexing) is an auto-indexing algorithm for sparse snapshot diffraction patterns (`stills') that requires the positions of only five Bragg peaks in a single pattern, when provided with unit-cell parameters. The capability of SPIND is demonstrated for the orientation determination of sparse diffraction patterns using simulated data from microcrystals of a small inorganic molecule containing three iodines, 5-amino-2,4,6-triiodoisophthalic acid monohydrate (I3C) [Beck & Sheldrick (2008), Acta Cryst. E 64 , o1286], which is challenging for commonly used indexing algorithms. SPIND , integrated with CrystFEL [White et al. (2012), J. Appl. Cryst. 45 , 335–341], is then shown to improve the indexing rate and quality of merged serial femtosecond crystallography data from two membrane proteins, the human δ-opioid receptor in complex with a bi-functional peptide ligand DIPP-NH 2 and the NTQ chloride-pumping rhodopsin (CIR). The study demonstrates the suitability of SPIND for indexing sparse inorganic crystal data with smaller unit cells, and for improving the quality of serial femtosecond protein crystallography data, significantly reducing the amount of sample and beam time required by making better use of limited data sets. SPIND is written in Python and is publicly available under the GNU General Public License from https://github.com/LiuLab-CSRC/SPIND.

36 MATERIALS SCIENCE↗
NASA NTRS2013

A Global Ozone Climatology from Ozone Soundings via Trajectory Mapping: A Stratospheric Perspective

This study explores a domain-filling trajectory approach to generate a global ozone climatology from sparse ozonesonde data. Global ozone soundings of 51,898 profiles at 116 stations over 44 years (1965-2008) are used, from which forward and backward trajectories are performed for 4 days, driven by a set of meteorological reanalysis data. Ozone mixing ratios of each sounding from the surface to 26 km altitude are assigned to the entire path along the trajectory. The resulting global ozone climatology is archived monthly for five decades from the 1960s to the 2000s with grids of 5 degree 5 degree 1 km (latitude, longitude, and altitude). It is also archived yearly from 1965 to 2008. This climatology is validated at 20 ozonesonde stations by comparing the actual ozone sounding profile with that found through the trajectories, using the ozone soundings at all the stations except one being tested. The two sets of profiles are in good agreement, both individually with correlation coefficients between 0.975 and 0.998 and root mean square (RMS) differences of 87 to 482 ppbv, and overall with a correlation coefficient of 0.991 and an RMS of 224 ppbv. The ozone climatology is also compared with two sets of satellite data, from the Satellite Aerosol and Gas Experiment (SAGE) and the Optical Spectrography and InfraRed Imager System (OSIRIS). Overall, the ozone climatology compares well with SAGE and OSIRIS data by both seasonal and zonal means. The mean difference is generally under 20 above 15 km. The comparison is better in the northern hemisphere, where there are more ozonesonde stations, than in the southern hemisphere; it is also better in the middle and high latitudes than in the tropics, where assimilated winds are imperfect in some regions. This ozone climatology can capture known features in the stratosphere, as well as seasonal and decadal variations of these features. Furthermore, it provides a wealth of detail about longitudinal variations in the stratosphere such as the spring ozone maximum over the Canadian Arctic. It also covers higher latitudes than current satellite data. The climatology shows clearly the depletion of ozone from the 1970s to the mid 1990s and ozone recovery in the 2000s. When this climatology is used as the upper boundary condition in an Environment Canada operational chemical forecast model, the forecast is improved in the vicinity of the upper tropospherelower stratosphere region. As this ozone climatology is neither dependent on a priori data or photochemical modeling, it provides independent information and insight that can supplement satellite data and model simulations and enhance our understanding of stratospheric ozone.

SAGE↗
DOE OSTI2025

Multi-physics Topology OPtimization and Additive Manufacturing for High-temperature Heat Exchangers

This research significantly advances the understanding of high-temperature heat exchanger design through an integrated approach that combines topology optimization (TO), triply periodic minimal surface (TPMS) structures, additive manufacturing (AM) and thermohydraulic testing. Each of these components contributes uniquely to a unified, high-performance design, fabrication and testing workflow. Topology optimization serves as the foundation of the design methodology by providing a systematic way to determine the most effective material layout for separating hot and cold fluids while maximizing thermal performance. The researchers introduced a novel three-material optimization framework using two density fields to represent hot fluid, cold fluid, and solid domains. This approach enables automated discovery of optimal shapes and flow paths that cannot be intuitively designed, especially under constraints imposed by manufacturing technologies. Furthermore, constraints such as minimal wall thickness and overhang angles were embedded into the optimization process, ensuring that resulting designs are not only thermally efficient but also manufacturable using modern additive techniques. In parallel, the study delves into the use of Gyroid-based TPMS geometries for constructing the core of the heat exchanger. TPMS structures are known for their high surface area, excellent fluid mixing capabilities, and minimal pressure drop characteristics. The researchers applied a data-driven modeling framework using Heteroscedastic Sparse Gaussian Process Regression (HSGPR) combined with genetic algorithms. This allowed for the rapid evaluation and optimization of key geometric parameters such as frequency, iso-value, and phase shift. The result was a set of Gyroid structures tailored for high heat transfer and low flow resistance, demonstrating clear improvements over conventional straight-channel designs. After the designing process, additive manufacturing played a critical role by turning these highly complex, optimized geometries into physical components. Utilizing Laser Powder Bed Fusion (LPBF) with Haynes 282, the study demonstrated the feasibility of fabricating these heat exchangers at high precision. Post-processing methods, including dilation-erosion operations, were applied to ensure local features adhered to self-supporting constraints. The fabricated structures were then subjected to thermohydraulic testing under conditions representative of supercritical CO 2 Brayton cycles, validating the predicted performance and confirming the viability of the full design-to-fabrication pipeline. Finally, thermohydraulic testing across the above studies served as a crucial experimental validation of advanced heat exchanger. Under consistent high-temperature and high-pressure conditions using supercritical CO 2 , the testing demonstrated that both TO and Gyroid-based TPMS designs significantly outperformed conventional straight-channel HXs. The TO design achieved a 115% increase in UA and NTU and a 27.6% boost in gravimetric power density, while the data-driven optimized Gyroid design delivered a 166% increase in UA and NTU and improved effectiveness from 68.7% to 86.1%. These results validate the simulation models, confirm the manufacturability of complex geometries under AM constraints, and provide key insights into design-performance trade-offs, thereby advancing the development of high-efficiency, compact heat exchangers for extreme environments.

36 MATERIALS SCIENCE↗
DOE OSTI2020

How Low Can You Go? Using Synthetic 3D Imagery to Drastically Reduce Real-World Training Data for Object Detection

Deep convolutional neural networks (DCNNs) currently provide state-of-the-art performance on image classification and object detection tasks, and there are many global security mission areas where such models could be extremely useful. Crucially, the success of these models is driven in large part by the widespread availability of high-quality open source data sets such as Image Net, Common Objects in Context (COCO), and KITTI, which contain millions of images with thousands of unique labels. However, global security relevant objects-of-interest can be difficult to obtain: relevant events are low frequency and high consequence; the content of relevant images is sensitive; and adversaries and proliferators seek to obscure their activities. For these cases where exemplar data is hard to come-by, even fine-tuning an existing model with available data can be effectively impossible. Recent work demonstrated that models can be trained using a combination of real-world and synthetic images generated from 3D representations; that such models can exceed the performance of models trained using real-world data alone; and that the generated images need not be perfectly realistic (Tremblay, et al., 2018). However, this approach still required hundreds to thousands of real-world images for training and fine tuning, which for sparse, global security-relevant datasets can be an unrealistic hurdle. In this research, we validate the performance and behavior of DCNN models as we drive the number of real-world images used for training object detection tasks down to a minimal set. We perform multiple experiments to identify the best approach to train DCNNs from an extremely small set of real-world images. In doing so, we: Develop state-of-the-art, parameterized 3D models based on real-world images and sample from their parameters to increase the variance in synthetic image training data; Use machine learning explainability techniques to highlight and correct through targeted training the biases that result from training using completely synthetic images; and Validate our results by comparing the performance of the models trained on synthetic data to one another, and to a control model created by fine-tuning an existing ImageNet-trained model with a limited number (hundreds) of real-world images.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Neural Networks to Find the Optimal Forcing for Offsetting the Anthropogenic Climate Change Effects

Abstract Of great relevance to climate engineering is the systematic relationship between the radiative forcing to the climate system and the response of the system, a relationship often represented by the linear response function (LRF) of the system. However, estimating the LRF often becomes an ill-posed inverse problem due to high-dimensionality and nonunique relationships between the forcing and response. Recent advances in machine learning make it possible to address the ill-posed inverse problem through regularization and sparse system fitting. Here, we develop a convolutional neural network (CNN) for regularized inversion. The CNN is trained using the surface temperature responses from a set of Green’s function perturbation experiments as imagery input data together with data sample densification. The resulting CNN model can infer the forcing pattern responsible for the temperature response from out-of-sample forcing scenarios. This promising proof of concept suggests a possible strategy for estimating the optimal forcing to negate certain undesirable effects of climate change. The limited success of this effort underscores the challenges of solving an inverse problem for a climate system with inherent nonlinearity. Significance Statement Predicting the climate response for a given climate forcing is a direct problem, while inferring the forcing for a given desired climate response is often an inverse, ill-posed, problem, posing a new challenge to the climate community. This study makes the first attempt to infer the radiative forcing for a given target pattern of global surface temperature response using a deep learning approach. The resulting deeply trained convolutional neural network inversion model shows promise in capturing the forcing pattern corresponding to a given surface temperature response, with a significant implication on the design of an optimal solar radiation management strategy for curbing global warming. This study also highlights the technical challenges that future research should prioritize in seeking feasible solutions to the inverse climate problem.

Ren, Huiying↗
DOE OSTI2023

3′ RNA-seq is superior to standard RNA-seq in cases of sparse data but inferior at identifying toxicity pathways in a model organism

The application of RNA-sequencing has led to numerous breakthroughs related to investigating gene expression levels in complex biological systems. Among these are knowledge of how organisms, such as the vertebrate model organism zebrafish (Danio rerio), respond to toxicant exposure. Recently, the development of 3' RNA-seq has allowed for the determination of gene expression levels with a fraction of the required reads compared to standard RNA-seq. While 3' RNA-seq has many advantages, a comparison to standard RNA-seq has not been performed in the context of whole organism toxicity and sparse data. Here, we examined samples from zebrafish exposed to perfluorobutane sulfonamide (FBSA) with either 3' or standard RNA-seq to determine the advantages of each with regards to the identification of functionally enriched pathways. We found that 3' and standard RNA-seq showed specific advantages when focusing on annotated or unannotated regions of the genome. We also found that standard RNA-seq identified more differentially expressed genes (DEGs), but that this advantage disappeared under conditions of sparse data. We also found that standard RNA-seq had a significant advantage in identifying functionally enriched pathways via analysis of DEG lists but that this advantage was minimal when identifying pathways via gene set enrichment analysis of all genes. These results show that each approach has experimental conditions where they may be advantageous. Our observations can help guide others in the choice of 3' RNA-seq vs standard RNA sequencing to query gene expression levels in a range of biological systems.

3’ RNA-seq↗
NASA NTRS2021

Weather Intelligent Navigation Data and Models for Aviation Planning (WINDMAP)

WINDMAP addresses the emerging needs in the aviation community of providing real-time weather forecasting to improve the safety of low altitude aircraft operations. This is accomplished through the integration of real-time observations from autonomous systems, such as drones and urban air taxis, with numerical weather prediction models and flight management and safety systems. To solve this problem, several technical challenges have been identified. These include (1) developing autonomous UAS capable of conducting observations accurately and reliably; (2) determining the number and frequency of required observations and the sensitivity of these observations in data sparse regions of the lower atmosphere;(3) assimilating dense observational data into models in real-time with sufficient resolution and accuracy; (4) developing novel physics-based reduced order models capable of incorporating diverse data sets; and (5)integrating real-time forecasting into UTM and DAA (detect-and-avoid) architectures for path planning and navigation. The goal of this proposed effort is to demonstrate the value of using small UAS to collect measurements of the dynamic and thermodynamic properties of the lower atmosphere at scales that match or exceed the spatio-temporal resolution of today’s best numerical weather prediction models

Koushik Datta↗
DOE OSTI2021

On the Strong Convergence of Forward-Backward Splitting in Reconstructing Jointly Sparse Signals

We consider the problem of reconstructing an infinite set of sparse, finite-dimensional vectors, that share a common sparsity pattern, from incomplete measurements. This is in contrast to the work (Daubechies et al., Pure Appl. Math. 57(11), 1413–1457, 2004), where the single vector signal can be infinite-dimensional, and (Fornasier and Rauhut, SIAM J. Numer. Anal. 46(2), 577613, 2008), which extends the aforementioned work to the joint sparse recovery of finite number of infinite-dimensional vectors. In our case, to take account of the joint sparsity and promote the coupling of nonvanishing components, we employ a convex relaxation approach with mixed norm penalty ℓ 2,1 . This paper discusses the computation of the solutions of linear inverse problems with such relaxation by a forward-backward splitting algorithm. However, since the solution matrix possesses infinitely many columns, the arguments of Daubechies et al. (Pure Appl. Math. 57(11), 1413–1457, 2004) no longer apply. As such, we establish new strong convergence results for the algorithm, in particular when the set of jointly sparse vectors is infinite.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

A score-based diffusion model approach for adaptive learning of stochastic partial differential equation solutions

In this paper, we propose a novel framework for adaptively learning the time-evolving solutions of stochastic partial differential equations (SPDEs) using score-based diffusion models within a recursive Bayesian inference setting. SPDEs play a central role in modeling complex physical systems under uncertainty, but their numerical solutions often suffer from model errors and reduced accuracy due to incomplete physical knowledge and environmental variability. To address these challenges, we encode the governing physics into the score function of a diffusion model using simulation data and incorporate observational information via a likelihood-based correction in a reverse-time stochastic differential equation. This enables adaptive learning through iterative refinement of the solution as new data becomes available. To improve computational efficiency in high-dimensional settings, we introduce the ensemble score filter, a training-free approximation of the score function designed for real-time inference. Numerical experiments on benchmark SPDEs demonstrate the accuracy and robustness of the proposed method under sparse and noisy observations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

An Edge Alignment-Based Orientation Selection Method for Neutron Tomography

Neutron computed tomography (nCT) is a 3D char-acterization technique used to image the internal morphology or chemical composition of samples in biology and materials sciences. A typical workflow involves placing the sample in the path of a neutron beam, acquiring projection data at a predefined set of orientations, and processing the resulting data using an analytic reconstruction algorithm. Typical nCT scans require hours to days to complete and are then processed using conventional filtered back-projection (FBP), which performs poorly with sparse views or noisy data. Hence, the main methods in order to reduce overall acquisition time are the use of an improved sampling strategy combined with the use of advanced reconstruction methods such as model-based iterative reconstruction (MBIR). In this paper, we propose an adaptive orientation selection method in which an MBIR reconstruction on previously-acquired measurements is used to define an objective function on orientations that balances a data-fitting term promoting edge alignment and a regularization term promoting orientation diversity. Using simulated and experimental data, we demonstrate that our method produces high-quality reconstructions using significantly fewer total measurements than the conventional approach.

Yang, Diyu↗
DOE OSTI2019

Applying Waveform Correlation to Aftershock Sequences Using a Global Sparse Network

Agencies that monitor for underground nuclear tests are interested in techniques that automatically characterize earthquake aftershock sequences to reduce the human analyst effort required to produce high-quality event bulletins. Waveform correlation is effective in detecting similar seismic waveforms from repeating earthquakes, including aftershock sequences. We report the results of an experiment that uses waveform templates recorded by multiple stations of the Comprehensive Nuclear-Test-Ban Treaty International Monitoring System during the first twelve hours after a mainshock to detect and identify aftershocks that occur during the subsequent week. We discuss approaches for station and template selection, threshold setting, and event detection that are specialized for aftershock processing for a sparse, global network. We apply the approaches to three aftershock sequences to evaluate the potential for establishing a set of standards for aftershock waveform correlation processing that can be effective for operational monitoring systems with a sparse network. We compare candidate events detected with our processing methods to the Reviewed Event Bulletin of the International Data Center to develop an intuition about potential reduction in analyst workload.

58 GEOSCIENCES↗
NASA NTRS1980

Korean coastal water depth/sediment and land cover mapping /1:25,000/ by computer analysis of Landsat imagery

Computer analysis was applied to single data Landsat MSS imagery of a coastal area near Seoul, Korea equivalent to a 1:50,000 topographic map, and featuring large dynamic sediment transport processes. Supervised image processing yielded a test classification map containing five water depth/sediment classes, two shoreline/tidal classes and five coastal land cover classes at a scale of 1:25,000 and with a training set accuracy of 76%; the training sets were selected by direct examination of the digitally displayed imagery. The unsupervised ISOCLAS (Senkus, 1976) clustering analysis was performed to assess the relative value of this approach to image classification in areas of sparse or nonexistent ground control. Results indicate that it is feasible to produce quantitative maps for detailed study of dynamic coastal processes given a Landsat image data base at sufficiently frequent time intervals.

Park, K. Y.↗