Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “random sampling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Absence of Barren Plateaus and Scaling of Gradients in the Energy Optimization of Isometric Tensor Network States

Abstract Vanishing gradients can pose substantial obstacles for high-dimensional optimization problems. Here we consider energy minimization problems for quantum many-body systems with extensive Hamiltonians and finite-range interactions, which can be studied on classical computers or in the form of variational quantum eigensolvers on quantum computers. Barren plateaus correspond to scenarios where the average amplitude of the energy gradient decreases exponentially with increasing system size. This occurs, for example, for quantum neural networks and for brickwall quantum circuits when the depth increases polynomially in the system size. Here we prove that the variational optimization problems for matrix product states, tree tensor networks, and the multiscale entanglement renormalization ansatz are free of barren plateaus. The derived scaling properties for the gradient variance provide an analytical guarantee for the trainability of randomly initialized tensor network states (TNS) and motivate certain initialization schemes. In a suitable representation, unitary tensors that parametrize the TNS are sampled according to the uniform Haar measure. We employ a Riemannian formulation of the gradient based optimizations which simplifies the analytical evaluation.

Barthel, Thomas↗
DOE OSTI2020

Creation of discrete active site domains via mesoporous silica poly(styrene) composite materials for incompatible acid–base cascade reactions

This work highlights the design and synthesis of bifunctional mesoporous silicate – polymer composite dual acid–base supported cascade catalysts. Compartmentalization of the two incompatible active sites is sought by segregating acid sites on the silica surface, and base sites within polymer chains and/or polymer domains. The ability to isolate and segregate active sites via control of the mesoporous silica pore size and polymer molecular weight is probed with silica samples functionalized by a grafting-to process. Supplemental activator and reducing agent (SARA) atom transfer radical polymerization is used to synthesize random copolymers containing protected primary amines. Thiol–ene ‘click’ chemistry facilitates silica functionalization via a convergent approach, with the ene-functionalized polymer end group and silica-grafted thiols forming SBA/MCM-SH-poly(styrene-co-2-(4-vinylbenzyl)isoindoline-1,3-dione). Polymer deprotection and thiol oxidation produces primary amine/sulfonic acid containing composite catalysts. With the polymer supported Lewis base and silica grafted Brønsted acid, the two-step deacetalization – Knoevenagel condensation cascade is explored to assess the ability of these polymer/silica hybrids to segregate active sites, allowing both acid and base site accessibility. Six composite catalysts are synthesized and tested in individual and cascade reactions with kinetic results demonstrating that lower molecular weight SBA-15-P1 and MCM-41-P1 catalysts outperform (higher turnover frequencies and initial rates) their higher molecular weight analogues, as well as a polymer-free system containing molecular active sites dispersed on the silica surface. Higher molecular weight composite catalysts perform more poorly due to limited chain solubility, mass transfer limitations, and poor catalyst accessibility. In many cases, the polymer chains effectively thread into the mesopores, with higher molecular weight polymers leading to pore blockage and inhibited mass transfer.

36 MATERIALS SCIENCE↗
NASA NTRS1985

Statistical analysis of astronomical data containing upper bounds - General methods and examples drawn from X-ray astronomy

Statistical procedures taken from the field of survival analysis have been adapted to astronomical usage and have been applied to a sample of stars in the B-V color range between 0.1 and 0.5 with measured soft X-ray luminosities and projected equatorial velocities. The two-sample problem and linear regression problem with arbitrarily censored data were studied. A new method for determining the linear regression between two random variables in the presence of arbitrary censoring has been developed which can also be used for a likelihood-ratio test for the independence of two random variables and for principal-component analysis in the presence of arbitrary censoring. The required numerical computations can be carried out straightforwardly and rapidly.

Schmitt, J. H. M. M.↗
NASA NTRS1985

Planetary searches using optical astrometric interferometers

The detectability of planets is discussed, and observations made with an astrometric interferometer (AI) at Mount Wilson are presented. Planets are detectable as a result of their periodic perturbation of the position of a central observable star. This detection requires relative astrometric accuracies of about 3 x 10 to the -4th for Jovian planets and about 3 x 10 to the -7th arcsec for terrestrial planets. The principles governing astrometric interferometry are explained, and it is conjectured that a two-color optical AI on earth should be capable of about 0.0001 arcsec rms accuracy for stars brighter than magnitude 7-10; small one-color space systems should achieve at least 0.00001 arcsec. Owing to atmospheric turbulence, two-color systems permit correction every few milliseconds for the random wavefront tilt. A 3.4-meter baseline interferometer on Mount Wilson has demonstrated arcsec rms fluctuations of about 0.02 for 1-sec samples. Space-based optical astrometric interferometry is also discussed.

Staelin, D. H.↗
NASA NTRS1987

A space-time stochastic model of rainfall for satellite remote-sensing studies

A model of the spatial and temporal distribution of rainfall is described that produces random spatial rainfall patterns with these characteristics: (1) the model is defined on a grid with each grid point representing the average rain rate over the surrounding grid box, (2) rain occurs at any one grid point, on average, a specified percentage of the time and has a lognormal probability distribution, (3) spatial correlation of the rainfall can be arbitrarily prescribed, and (4) time stepping is carried out so that large-scale features persist longer than small-scale features. Rain is generated in the model from the portion of a correlated Gaussian random field that exceeds a threshold. The portion of the field above the threshold is rescaled to have a lognormal probability distribution. Sample output of the model designed to mimic radar observations of rainfall during the Global Atmospheric Research Program Atlantic Tropical Experiment (GATE), is shown. The model is intended for use in evaluating sampling strategies for satellite remote-sensing of rainfall and for development of algorithms for converting radiant intensity received by an instrument from its field of view into rainfall amount.

Bell, Thomas L.↗
NASA NTRS1989

Fatigue crack growth model RANDOM2 user manual. Appendix 1: Development of advanced methodologies for probabilistic constitutive relationships of material strength models

FORTRAN program RANDOM2 is presented in the form of a user's manual. RANDOM2 is based on fracture mechanics using a probabilistic fatigue crack growth model. It predicts the random lifetime of an engine component to reach a given crack size. Details of the theoretical background, input data instructions, and a sample problem illustrating the use of the program are included.

Boyce, Lola↗
NASA NTRS2006

Nadir Measurements of Carbon Monoxide Distributions by the Tropospheric Emission Spectrometer Instrument Onboard the Aura Spacecraft: Overview of Analysis Approach and Examples of Initial Results

We provide an overview of the nadir measurements of carbon monoxide (CO) obtained thus far by the Tropospheric Emission Spectrometer (TES). The instrument is a high resolution array Fourier transform spectrometer designed to measure infrared spectral radiances from low Earth orbit. It is one of four instruments successfully launched onboard the Aura platform into a sun synchronous orbit at an altitude of 705 km on July 15, 2004 from Vandenberg Air Force Base, California. Nadir spectra are recorded at 0.06/cm spectral resolution with a nadir footprint of 5 x 8 km. We describe the TES retrieval approach for the analysis of the nadir measurements, report averaging kernels for typical tropical and polar ocean locations, characterize random and systematic errors for those locations, and describe instrument performance changes in the CO spectral region as a function of time. Sample maps of retrieved CO for the middle and upper troposphere from global surveys during December 2005 and April 2006 highlight the potential of the results for measurement and tracking of global pollution and determining air quality from space.

carbon monoxide↗
DOE OSTI2024

Statistical and Neural Network for Real Sensor-Data-Driven Anomaly Detection in Nuclear Applications

Anomaly detection (AD) in sensor data is critical to ensure uninterrupted functionality of nuclear power plants (NPPs). Consequently, AD model validation through real-world sensor data is important for applications in nuclear facilities. In this paper, we propose an Autoencoder (AE)—a multi-layered neural network, for AD in sensor data from an operational NPP testbed. Since the dataset lacks labels for irregularities, we introduce random noise and label them to effectively train our model. The proposed AE model assigns a higher reconstruction error to the abnormal samples that deviate from those encountered during the training phase and uses the reconstruction loss to detect anomalies in a representative imbalanced dataset. We also introduce an analytical solution—seasonal trend decomposition (STD)—as another AD scheme for identifying irregularities withinthe same time-series dataset. In contrast to the AE model which relies on reconstruction loss, the STD scheme decomposes the entire dataset into its trend, seasonality, and residual components to pinpoint irregularities. Our findings indicate that the proposed AE and STD models individually achieve recall scores of 97% and 92%, respectively. We validate the performance of the two models on both balanced and imbalanced data. We further solidify the results by picking the combined selected anomalies of the two solutions with an "AND" operator for more reliable predictions.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Statistical and Neural Network for Real Sensor-Data-Driven Anomaly Detection in Nuclear Applications

Anomaly detection (AD) in sensor data is critical to ensure uninterrupted functionality of nuclear power plants (NPPs). Consequently, validation of AD models through real-world sensor data is important for their application in nuclear facilities. In this paper, we propose an Autoencoder (AE)— a multi-layered neural network, for AD in sensor data from an operational NPP testbed. Since the dataset lacks labels for irregularities, we introduce random noise and label them to effectively train our model. The proposed AE model assigns a higher reconstruction error to the abnormal samples that deviate from those encountered during the training phase and uses the reconstruction loss to detect anomalies in a representative imbalanced dataset. We also introduce an analytical solution—seasonal trend decomposition (STD) — as another AD scheme for identifying irregularities within the same time-series dataset. In contrast to the AE model which relies on reconstruction loss, the STD scheme decomposes the entire dataset into its trend, seasonality, and residual components to pinpoint irregularities. Our findings indicate that the proposed AE and STD models individually achieve recall scores of 97% and 92%, respectively. We also validate the performance of the two models on both balanced and imbalanced data. We further solidify the results by picking the combined selected anomalies of the two solutions with an "AND" operator for more reliable predictions.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Evidence of Skewness and Sub-Gaussian Character in Temperature-Dependent Distributions of One Million Electronic Excitation Energies in PbS Quantum Dots

Obtaining statistical distributions by sampling a large number of conformations is vital for an accurate description of temperature-dependent properties of chemical systems. However, constructing distributions with 105??106 samples is computationally challenging because of the prohibitively high computational cost of performing rst-principles quantum-mechanical calculations. In this work, we present a new technique called the Eective Stochastic Potential Conguration Interaction Singles (ESP-CIS) method to obtain excitation energies. The ESP-CIS method uses random matrix theory for the construction of an eective stochastic representation of the Fock operator and combines it with linear-response theory. Here, we perform excitation calculations on PbS quantum dots (0.75-1.75 nm) at temperatures of 200-400 K. Results from a total of 15 million excitation energy calculations (1 million samples for each of the three dots at ve dierent temperatures) revealed the distributions to be sub-Gaussian in nature with negative skewness. The distributions progressively became red-shifted with increasing temperature. The study shows that random distortions in structure from the minimum-energy geometry of these quantum dots are more likely to lower the excitation energies.

Scher, Jeremy A.↗
NASA NTRS1977

Optimal estimation for discrete time jump processes

Optimum estimates of nonobservable random variables or random processes which influence the rate functions of a discrete time jump process (DTJP) are obtained. The approach is based on the a posteriori probability of a nonobservable event expressed in terms of the a priori probability of that event and of the sample function probability of the DTJP. A general representation for optimum estimates and recursive equations for minimum mean squared error (MMSE) estimates are obtained. MMSE estimates are nonlinear functions of the observations. The problem of estimating the rate of a DTJP when the rate is a random variable with a probability density function of the form cx super K (l-x) super m and show that the MMSE estimates are linear in this case. This class of density functions explains why there are insignificant differences between optimum unconstrained and linear MMSE estimates in a variety of problems.

Vaca, M. V.↗
DOE OSTI2023

Analysis of an optical imaging system prototype for autonomously monitoring zooplankton in an aquaculture facility

Traditional approaches to biomonitoring in aquatic systems, such as sample collection, sorting, and identification, require significant time and effort, thereby limiting the spatiotemporal resolution of sample collection. Additionally, collection and preservation of samples for subsequent taxonomic identification and enumeration leads to mortality of organisms. Recent advances in technologies that utilize optical imaging and machine learning have provided new opportunities to expedite biomonitoring and lead to significant cost savings. These technologies can be advantageous to scientists or managers that conduct routine biomonitoring to inform operations, as in the case of aquaculture facilities. The Small Aquatic Organism optical imaging system (SAO) is a high-throughput optical imaging and classification prototype system that relies on computer vision and machine learning (Support Vector Machines, or SVMs) to autonomously identify and enumerate aquatic organisms. The SAO provides a more sustainable method of collecting large volumes of data and has the benefit of being used in situ. In this study, we tested the performance of the SAO in providing comparable results to manual zooplankton community monitoring in ten ponds at an aquaculture facility. We performed a side-by-side study comparing the sampling methods of plankton tow nets, where major zooplankton taxonomic classes were manually identified and enumerated, to sampling with the SAO. Vouchered samples were used to develop a training library for the SAO, where classes consisted of water boatman and zooplankton groups: cladocerans, copepod adults, copepod nauplii, and rotifers. SAO imagery was manually classified and compared with predicted results for validation. Accuracy for the SVM classifier of the SAO was 37.4 %. Convolutional Neural Networks (CNN) and Random Forest classifiers were also applied to SAO imagery and image features for comparison. The best CNN model and our Random Forest model had accuracies of 80.4 % and 46.6 % respectively. Challenges faced included the small size of copepod nauplii and rotifers and the limited resolution of the imaging camera, although there are tradeoffs between imaging resolution and the sample processing rate. Furthermore, our comparison shows that advancement in both optical imaging and ML are needed in order for the SAO prototype to yield comparable results to manual community monitoring in an aquaculture facility.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Landsat 8 monitoring of multi-depth suspended sediment concentrations in Lake Erie’s Maumee River using machine learning

Satellite remote sensing has been widely used to map suspended sediment concentration (SSC) in waterbodies. However, due to the complexity of sediment-water interactions, it has been difficult to derive linear and non-linear regression equations to reliably predict SSC, especially when trying to estimate depth of integrated sediment. Herein, this study uses Landsat 8 OLI (Operational Land Imager) sensor to map SSC within the Maumee River in Ohio, USA, at multiple depth intervals (15, 61, 91, and 182 cm). Simple linear least squares regression (LLSR), and three common machine learning models: random forest (RF), support vector regression (SVR), and model averaged neural network (MANN) were used to estimate SSC at the depth intervals. All machine learning models significantly outperformed LLSR while RF performed the best. In both RF and MANN, R2 (coefficient of determination) increases with depth with a maximum R2 of 0.89 and 0.83, respectively, at a depth of 0–182 cm. The results show that machine learning models can implement nonlinear relationships that produce better predictions than traditional linear regression methods in estimating depth integrated SSC, especially when samples are limited.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Data-driven Minimum Entropy Control for Stochastic Nonlinear Systems using the Cumulant-Generating Function

Here, we present a novel minimum entropy control algorithm for a class of stochastic nonlinear systems subjected to non-Gaussian noises. The entropy control can be considered as an optimization problem for the system randomness attenuation, but the mean value has to be considered separately. To overcome this disadvantage, a new representation of the system stochastic properties was given using the cumulant-generating function based on the moment-generating function, in which the mean value and the entropy was reflected by the shape of the cumulant-generating function. Based on the samples of the system output and control input, a time-variant linear model was identified, and the minimum entropy optimization was transformed to system stabilization. Then, an optimal control strategy was developed to achieve the randomness attenuation, and the boundedness of the controlled system output was analyzed. The effectiveness of the presented control algorithm was demonstrated by a numerical example. In this paper, a data-driven minimum entropy design is presented without pre-knowledge of the system model; entropy optimization is achieved by the system stabilization approach in which the stochastic distribution control and minimum entropy are unified using the same identified structure; and a potential framework is obtained since all the existing system stabilization methods can be adopted to achieve the minimum entropy objective.

42 ENGINEERING↗
DOE OSTI2023

Hierarchical reconstruction of 3D well-connected porous media from 2D exemplars using statistics-informed neural network

The relationships between porous microstructures and transport properties are of fundamental importance in various scientific and engineering applications. Due to the intricacy, stochasticity and heterogeneity of porous media, reliable characterization and modeling of transport properties often require a complete dataset of internal microstructure samples. However, it is often an unbearable cost to acquire sufficient 3D digital microstructures by purely using microscopic imaging systems. Herein this paper presents a machine learning-based technique to hierarchically reconstruct 3D well-connected porous microstructures from one isotropic or several anisotropic low-cost 2D exemplar(s). To compactly characterize the large-scale microstructural features, a Gaussian image pyramid is built for each 2D exemplar. Local morphology patterns are collected from the Gaussian image pyramids, and then they serve as the training data to embed the 2D morphological statistics into feed-forward neural networks at multiple length levels. By using a specially-developed morphology integration scheme, the 3D morphological statistics at different levels can be inferred from the statistics-informed neural networks. Gibbs sampling is adopted to hierarchically reconstruct 3D microstructures by using multi-level 3D morphological statistics, where the large-scale, regional and local morphological patterns are statistically generated and successively added to the same 3D random field. The proposed method is tested on a series of porous media with distinct morphologies, and the statistical equivalence between the reconstructed and the real microstructures is systematically evaluated by comparing morphological descriptors and transport properties. The results demonstrate that the proposed 2D-to-3D microstructure reconstruction method is a universal and efficient approach to generating morphologically and physically realistic samples of porous media.

42 ENGINEERING↗
DOE OSTI2023

Machine learning-based inversion for acoustic impedance with large synthetic training data: Workflow and data characterization

Where wells are sparse or training data are difficult to label with high-quality wireline-derived impedance logs, machine learning (ML)-based inversion of acoustic impedance typically depends on small training data sets, leading to biased prediction. We have advanced a novel workflow that applies large synthetic seismic training data to reduce facies-related bias. Using a geologically realistic model as the truth model, we randomly select sparse seed wells to perform sequential Gaussian simulation (SGS) for impedance models of the same geometry and simulate facies variability. We implement random forest regression on 30 features extracted from the synthetic volume. We observe that more seed wells tend to reduce facies-induced bias by sampling more types of facies, resulting in a better prediction. We then focus on the responses of SGS models to facies changes, the number of seed wells necessary for a useful synthetic model, and how much a synthetic model can help ML-based inversion. Here, we observe that the SGS synthetic training model outperforms well-direct training in general. For modeled clastic shore-zone systems in Miocene Gulf of Mexico, two or more seed wells are necessary for a significant reduction of root-mean-square error and outliners, and improvement of facies imaging. In a field-data test, we apply a similar workflow to quantitatively predict acoustic impedance, which is then converted to a sand-volume map at a high-frequency sequence (10–100 m), revealing detailed facies and sandstone patterns. Such results are valuable in many geologic and engineering applications, such as hydrocarbon and CO 2 reservoir prospecting, reserve estimation, simulation, etc.

3D seismic↗
DOE OSTI2023

Investigation of defect formation at the early stage of PVT-grown 4H-SiC crystals

Here, several 4° off-axis 4H-SiC wafers with several hundred microns of initial-stage growth by PVT method are investigated by Synchrotron Monochromatic Beam X-ray Topography (SMBXT). Defect behavior across the seed/newly grown layer interface are demonstrated. Comparison of early stage grown layers to seed sample indicates generation of threading edge dislocation (TED) and threading screw dislocation (TSD)/ threading mixed dislocation (TMD) pairs at the interface while most basal plane dislocations (BPDs) are deflected into TEDs. The (0001) facet of the crystal is already formed at early stage growth at the edge of the wafer and high nitrogen incorporation in facet leads to conditions favorable for nucleation and glide of Shockley/double Shockley faults with layers of 3C-SiC deposited on facet acting as nuclei. Unique-shaped dislocations are observed at early stage growth, which are caused by deflection of TSDs/TMDs and TEDs by macrosteps near the periphery of the sample and the subsequent glide of the a components. The effect of the quality of the seed surface before growth is manifested as randomly oriented arrays of pairs of TEDs and TSDs/TMDs on the as grown surface resulting from residual surface damage from scratches.

36 MATERIALS SCIENCE↗