Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Noisy data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
NASA NTRS1981

The case of the noisy derivatives - Evidence for a spacecraft-plasma interaction

Data from the retarding potential analyzers on Atmosphere Explorers C and D indicate the existence of 2-m irregularities in the ion flux to the satellite. These irregularities are seen only occasionally, and usually very near the magnetic dip equator. They occur both in sunlight and eclipse and span at least two decades of ion concentration. They tend to be present when the spacecraft is moving nearly parallel to the magnetic field vector and are not seen at all from the low latitude AE-E orbit. It is believed that the irregularities, whose amplitude is of the order of 1% of the background ion flux, are the result of a spacecraft interaction with the ionospheric plasma. A mechanism for producing this interaction that utilizes a fast beam of ambient ions reflected upstream from the satellite to produce a two-stream instability is examined in some detail.

Hanson, W. B.↗
DOE OSTI2024

CryoSegNet: accurate cryo-EM protein particle picking by integrating the foundational AI image segmentation model and attention-gated U-Net

Picking protein particles in cryo-electron microscopy (cryo-EM) micrographs is a crucial step in the cryo-EM-based structure determination. However, existing methods trained on a limited amount of cryo-EM data still cannot accurately pick protein particles from noisy cryo-EM images. The general foundational artificial intelligence–based image segmentation model such as Meta’s Segment Anything Model (SAM) cannot segment protein particles well because their training data do not include cryo-EM images. Here, we present a novel approach (CryoSegNet) of integrating an attention-gated U-shape network (U-Net) specially designed and trained for cryo-EM particle picking and the SAM. The U-Net is first trained on a large cryo-EM image dataset and then used to generate input from original cryo-EM images for SAM to make particle pickings. CryoSegNet shows both high precision and recall in segmenting protein particles from cryo-EM micrographs, irrespective of protein type, shape and size. On several independent datasets of various protein types, CryoSegNet outperforms two top machine learning particle pickers crYOLO and Topaz as well as SAM itself. The average resolution of density maps reconstructed from the particles picked by CryoSegNet is 3.33 Å, 7% better than 3.58 Å of Topaz and 14% better than 3.87 Å of crYOLO. It is publicly available at https://github.com/jianlin-cheng/CryoSegNet

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Data Summarization and Inference at Scale

This is the final report for the DOE ASCR grant SC-0022260, Data Summarization and Inference at Scale, PI: Alex Pothen, Purdue University. The goal of the project was to solve data-intensive and compute-intensive problems in the physical sciences, engineering, information science, data science, etc. by designing and implementing new algorithms that could work with a subset of the data. The four subgoals were: (a) The solution of problems where the data is too large to be stored in the memory of a computer. In this streaming model of computation, the data arrives as a stream of elements to the computer, each element is processed as it arrives, and a decision is made to discard the data or to store it; only a small subset of the data proportional to the size of the output solution is stored, and when all the data has been streamed, a solution to the problem is computed from the stored subset. (b) The use of machine learning methods to compute solutions to data-intensive problems. The use of GPUs is critical to obtain high performance on machine learning tasks, but their memory sizes are smaller relative to that of CPUs. For large-scale problems, the data is sampled many times, and small samples are used with repetition, for robustness, to compute solutions to inference tasks. This sampling reduces the memory required to solve the problem, but attention is needed to avoid slow convergence to the solutions, and reduced accuracy of inference. We propose submodular optimization, Large Language Models, and physics-informed neural networks to enable GPU computations here. (c) Modeling and visualization of high-dimensional data using interpretable features. Clinical proteomic data sets from immunology for the detection of cancer and other diseases are temporal and high-dimensional, and algorithms for visualizing these data sets using clinically interpretable features are lacking. We propose methods that compute distances based on the optimal transportation problem and graph edit distances to address this problem. We also propose the use of optimal transport-based distances, spatial statistics, and network structure to classify image data sets, We apply these algorithms to electron micrographs of the peripheral nervous system in the digestive tract. (d) The design of data-intensive algorithms on emerging architectures, specifically, noisy, intermediate-scale quantum (NISQ) devices. Quantum computers offer the possibility of exploring large solution spaces due to the principle of superposition, but current quantum computers are limited by few qubits, short coherence times due to noise, poor interconections among the qubits, etc. We propose the use of the divide and conquer paradigm to solve large-scale problems, wherein collections of small subproblems are solved on the quantum devices, and the solutions to the subproblems are integrated into a solution for the original problem on a classical computer.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

DISSIDE: Dynamic In Silico Sample Identification for Discrete Evaluation

DISSIDE uses novel unsupervised learning to select samples that best represent the strongest a priori discrete pattern in a given data set. It further removes major outliers and "noisy" samples that do not fit discrete patterns well or represent outliers in groups below a defined n value. It then estimates the fit and strength of the a priori discrete pattern using both unconstrained and constrained methods for raw and cleaned data

LeBrun, Erick↗
DOE OSTI2022

Qubit noise deconvolution

We present a noise deconvolution technique to remove a wide class of noises when performing arbitrary measurements on qubit systems. In particular, we derive the inverse map of the most common single qubit noisy channels, and exploit it at the data processing step to obtain noise-free estimates of observables evaluated on a qubit system subject to known noise. We illustrate a self-consistency check to ensure that the noise characterization is accurate providing simulation results for the deconvolution of a generic Pauli channel, as well as experimental evidence of the deconvolution of decoherence noise occurring on Rigetti quantum hardware.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Flatfielding of hybrid pixel detectors in tender x-ray scattering

The ability of the soft matter interfaces beamline at National Synchrotron Light Source II to access x-ray energy in the tender x-ray regime, i.e., from 2.1 to 5 keV, enables new resonant x-ray scattering studies at the sulfur K-edge and others. We present a new approach to correct data acquired in the tender x-ray regime with a Pilatus3 detector in order to improve the data quality and to correct the various artifacts inherent to hybrid pixel detectors, such as variations in modules’ efficiency or noisy detector module junctions. Further, this new flatfielding significantly enhances the data quality and enables detection of weak scattering signals.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

A Denoising Autoencoder for Improved Kikuchi Pattern Quality and Indexing in Electron Backscatter Diffraction

The rapid collection and indexing of electron diffraction patterns as produced via electron backscatter diffraction (EBSD) has enabled crystallographic orientation and structural determination, as well as additional property-determining strain and dislocation density information with increasing speed, resolution, and efficiency. Pattern indexing quality is reliant on the noise of the collected electron diffraction patterns, which is often convoluted by sample preparation and data collection parameters. EBSD acquisition is sensitive to many factors and thus can result in low confidence index (CI), poor image quality (IQ), and improper minimization of fit, which can result in noisy datasets and misrepresent the microstructure. In an attempt to enable both higher speed EBSD data collection and enable greater orientation fit accuracy with noisy datasets, an image denoising autoencoder was implemented to improve pattern quality. Here, we show that EBSD data processed through the autoencoder results in a higher CI, IQ, and a more accurate degree of fit. In addition, using denoised datasets in HR-EBSD cross correlative strain analysis can result in reduced phantom strain from erroneous calculations due to the increased indexing accuracy and improved correspondence between collected and simulated patterns.

36 MATERIALS SCIENCE↗
NASA NTRS1985

Contribution of tonal components to the overall loudness, annoyance and noisiness of noise: Relation between single tones and noise spectral shape

A large scale laboratory investigation of loudness, annoyance, and noisiness produced by single-tone-noise complexes was undertaken to establish a broader data base for quanitification and prediction of perceived annoyance of sounds containing tonal components. Loudness, annoyance, and noisiness were distinguished as separate, distinct, attributes of sound. Three different spectral patterns of broadband noise with and without added tones were studied: broadband-flat, low-pass, and high-pass. Judgments were obtained by absolute magnitude estimation supplement by loudness matching. The data were examined and evaluated to determine the potential effects of (1) the overall sound pressure level (SPL) of the noise-tone complex, (2) tone SPL, (3) noise SPL, (4) tone-to-noise ratio, (5) the frequency of the added tone, (6) noise spectral shape, and (7) subjective attribute judged on absolute magnitude of annoyance. Results showed that, in contrast to noisiness, loudness and annoyance growth behavior depends on the relationship between the frequency of the added tone and the spectral shape of the noise. The close correspondence between the frequency of the added tone and the spectral shape of the noise. The close correspondence between loundness and annoyance suggests that, to better understand perceived annoyance of sound mixtures, it is necessary to relate the results to basic auditory mechanisms governing loudness and masking.

Hellman, R. P.↗
DOE OSTI2022

Performance Before and After Irradiation of Pixelated 3D Silicon Sensors for the HL-LHC CMS Tracker

The Large Hadron Collider (LHC) particle accelerator at European Center for Nuclear Research (CERN) will be shut down starting in 2026 to achieve the High Luminosity Large Hadron Collider (HL-LHC) upgrade. The upgrade will allow for higher fluences, in order to increase the probability of detecting increasingly rare particles, and to obtain higher precision measurements of known particles. To accommodate the new accelerator conditions, many aspects of the Compact Muon Solenoid (CMS) detector will be upgraded; of particular interest for this thesis are the silicon pixel detectors located in the inner tracker. These will be replaced and upgraded to accommodate the higher fluences of the HL-LHC upgrade, as well as to replace existing sensors which have sustained radiation damage. In order for the new sensors to operate under high luminosity conditions, they must be increasingly radiation hard, and in order to detect rare particles, they must be increasingly more precise. The performance of one Centro Nacional de Microelectronica (CNM) 3D silicon sensor before and after undergoing irradiation at fluences similar to those which will be observed at the HL-LHC was investigated to determine radiation hardness and precision. Data was collected at Fermi National Laboratory (Fermilab), in the Fermi National Laboratory Test Beam Facility (FTBF) silicon tracker telescope, which can be used to determine the number of particles, and tracks made by high energy protons passing through. The sensor was also irradiated at Fermilab in the Irradiation Test Area (ITA). Prior to data collection a tuning procedure is carried out to determine ideal bias voltage operating conditions, mask noisy and dead pixels, adjust to the ideal threshold, and map sensor gain. Data is then collected at the FTBF, where the sensor is installed in the center of the FTBF silicon telescope. Variables, including angle and bias voltage, are varied throughout data collection. Data is then processed using an alignment software to determine the exact telescope geometry, along with the tracks which were observed passing through the sensor and telescope. Sensor performance was found to be comparable before and after irradiation, with irradiated results showing slightly lower efficiencies and cluster sizes. Position resolution is comparable both before and after irradiation, and similar distributions of cluster shape are observed. After irradiation, the sensor shows increasing collected charge with bias, an indication of increased width of the depletion region. Peak charge pre-irradiation is higher than post-irradiation peak charge, indicating the irradiated results are not taken under fully-depleted conditions.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS1975

A method of using cluster analysis to study statistical dependence in multivariate data

A technique is presented that uses both cluster analysis and a Monte Carlo significance test of clusters to discover associations between variables in multidimensional data. The method is applied to an example of a noisy function in three-dimensional space, to a sample from a mixture of three bivariate normal distributions, and to the well-known Fisher's Iris data.

Borucki, W. J.↗
NASA NTRS1968

Digital data averager improves conventional measurement system performance

Multipurpose digital averager provides measurement improvement in noisy signal environments. It provides increased measurement accuracy and resolution to basic instrumentation devices by an arithmetical process in real time. It is used with standard conventional measurement equipment and digital data printers.

Naylor, T. K.↗
DOE OSTI2024

teemi: An open-source literate programming approach for iterative design-build-test-learn cycles in bioengineering

Synthetic biology dictates the data-driven engineering of biocatalysis, cellular functions, and organism behavior. Integral to synthetic biology is the aspiration to efficiently find, access, interoperate, and reuse high-quality data on genotype-phenotype relationships of native and engineered biosystems under FAIR principles, and from this facilitate forward-engineering strategies. However, biology is complex at the regulatory level, and noisy at the operational level, thus necessitating systematic and diligent data handling at all levels of the design, build, and test phases in order to maximize learning in the iterative design-build-test-learn engineering cycle. To enable user-friendly simulation, organization, and guidance for the engineering of biosystems, we have developed an open-source python-based computer-aided design and analysis platform operating under a literate programming user-interface hosted on Github. The platform is called teemi and is fully compliant with FAIR principles. In this study we apply teemi for i) designing and simulating bioengineering, ii) integrating and analyzing multivariate datasets, and iii) machine-learning for predictive engineering of metabolic pathway designs for production of a key precursor to medicinal alkaloids in yeast. The teemi platform is publicly available at PyPi and GitHub.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Latent Twins

Over the past decade, scientific machine learning has transformed the development of mathematical and computational frameworks for analyzing, modeling, and predicting complex systems. From inverse problems to numerical partial differential equations (PDEs), dynamical systems, and model reduction, these advances have pushed the boundaries of what can be simulated. Yet they have often progressed in parallel, with representation learning and algorithmic solution methods evolving largely as separate pipelines. With Latent Twins, we propose a unifying mathematical framework that creates a hidden surrogate in latent space for the underlying equations. Whereas digital twins mirror physical systems in the digital world, Latent Twins mirror mathematical systems in a learned latent space governed by operators. Through this lens, classical modeling, inversion, model reduction, and operator approximation all emerge as special cases of a single principle. We establish the fundamental approximation properties of Latent Twins for both ordinary differential equations (ODEs) and PDEs and demonstrate the framework across three representative settings: (i) canonical ODEs, capturing diverse dynamical regimes; (ii) a PDE benchmark using the shallow-water equations, contrasting Latent Twin simulations with deep operator network and forecasts with a four-dimensional variational method baseline; and (iii) a challenging real-data geopotential reanalysis dataset, reconstructing and forecasting from sparse, noisy observations. Latent Twins provide a compact, interpretable surrogate for solution operators that evaluate across arbitrary time gaps in a single-shot, while remaining compatible with scientific pipelines such as assimilation, control, and uncertainty quantification. Looking forward, this framework offers scalable, theory-grounded surrogates that bridge data-driven representation learning and classical scientific modeling across disciplines.

Latent Twins↗
DOE OSTI2020

Probabilistic neural networks for fluid flow surrogate modeling and data recovery

We consider the use of probabilistic neural networks for fluid flow surrogate modeling and data recovery. This framework is constructed by assuming that the target variables are sampled from a Gaussian distribution conditioned on the inputs. Consequently, the overall formulation sets up a procedure to predict the hyperparameters of this distribution which are then used to compute an objective function given training data. We demonstrate that this framework has the ability to provide for prediction confidence intervals based on the assumption of a probabilistic posterior, given an appropriate model architecture and adequate training data. The applicability of the present framework to cases with noisy measurements and limited observations is also assessed. To demonstrate the capabilities of this framework, we consider canonical regression problems of fluid dynamics from the viewpoint of reduced-order modeling and spatial data recovery for four canonical data sets. The examples considered in this study arise from (i) the shallow-water equations, (ii) a two-dimensional cylinder flow, (iii) the wake of a NACA0012 airfoil with a Gurney flap, and (iv) the NOAA sea surface temperature data set. Furthermore, the present results indicate that the probabilistic neural network not only produces a machine-learning-based fluid flow surrogate model but also systematically quantifies the uncertainty therein to assist with model interpretability.

42 ENGINEERING↗
DOE OSTI2026

Entropy Stable Conservative Flux Form Neural Networks

We propose an entropy-stable conservative flux form neural network (CFN) to predict the dynamics of unknown governing conservation laws. The design of the network is based on the entropy-stable, second-order, and non-oscillatory Kurganov-Tadmor (KT) scheme. The proposed entropy-stable CFN, hereafter referred to as ESCFN, uses slope limiting as a denoising mechanism, ensuring accurate predictions in both noisy and sparse observation environments, as well as in both smooth and discontinuous regions. Importantly, our method is designed to predict long term dynamics of the unknown conservation law exclusively from a short temporal window of observed data, that is, without oracle knowledge of the PDE or later-time solution profiles. Numerical experiments demonstrate that the ESCFN achieves both stability and conservation while maintaining accuracy over extended time domains, and successfully predicts shock propagation speeds in long-term simulations. Furthermore, it is also robust to both noisy and sparse data environments.

Hyperbolic conservation laws↗