Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Synthetic Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Automating neutron resonances classification with Machine Learning [Slides]

Team reported the following accomplishments: the development of a Machine-Learning method to properly assign spins to neutron resonances (automated, general, reproducible); full integration with evaluated resonances in the Atlas (automation of new editions); training and optimization in synthetic data; validation and deployment to real experimental resonances. Future perspectives include exploration of other classifiers and hyper-parameter combinations, further validation with well-known nucleus (e.g. 235 U), and publication pipeline.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Fluid-Kinetic Coupling: Advanced Discretizations for Simulations on Emerging Heterogeneous Architectures (LDRD FY20-0643)

Plasma physics simulations are vital for a host of Sandia mission concerns, for fundamental science, and for clean energy in the form of fusion power. Sandia's most mature plasma physics simulation capabilities come in the form of particle-in-cell (PIC) models and magnetohydrodynamics (MHD) models. MHD models for a plasma work well in denser plasma regimes when there is enough material that the plasma approximates a fluid. PIC models, on the other hand, work well in lower-density regimes, in which there is not too much to simulate; error in PIC scales as the square root of the number of particles, making high-accuracy simulations expensive. Real-world applications, however, almost always involve a transition region between the high-density regimes where MHD is appropriate, and the low-density regimes for PIC. In such a transition region, a direct discretization of Vlasov is appropriate. Such discretizations come with their own computational costs, however; the phase-space mesh for Vlasov can involve up to six dimensions (seven if time is included), and to apply appropriate homogeneous boundary conditions in velocity space requires meshing a substantial padding region to ensure that the distribution remains sufficiently close to zero at the velocity boundaries. Moreover, for collisional plasmas, the right-hand side of the Vlasov equation is a collision operator, which is non-local in velocity space, and which may dominate the cost of the Vlasov solver. The present LDRD project endeavors to develop modern, foundational tools for the development of continuum-kinetic Vlasov solvers, using the discontinuous Petrov-Galerkin (DPG) methodology, for discretization of Vlasov, and machine-learning (ML) models to enable efficient evaluation of collision operators. DPG affords several key advantages. First, it has a built-in, robust error indicator, allowing us to adapt the mesh in a very natural way, enabling a coarse velocity-space mesh near the homogeneous boundaries, and a fine mesh where the solution has fine features. Second, it is an inherently high-order, high-intensity method, requiring extra local computations to determine so-called optimal test functions, which makes it particularly suited to modern hardware in which floating-point throughput is increasing at a faster rate than memory bandwidth. Finally, DPG is a residual-minimizing method, which enables high-accuracy computation: in typical cases, the method delivers something very close to the $L^2$ projection of the exact solution. Meanwhile, the ML-based collision model we adopt affords a cost structure that scales as the square root of a standard direct evaluation. Moreover, we design our model to conserve mass, momentum, and energy by construction, and our approach to training is highly flexible, in that it can incorporate not only synthetic data from direct-simulation Monte Carlo (DSMC) codes, but also experimental data. We have developed two DPG formulations for Vlasov-Poisson: a time-marching, backward-Euler discretization and a space-time discretization. We have conducted a number of numerical experiments to verify the approach in a 1D1V setting. In this report, we detail these formulations and experiments. We also summarize some new theoretical results developed as part of this project (published as papers previously): some new analysis of DPG for the convection-reaction problem (of which the Vlasov equation is an instance), a new exponential integrator for DPG, and some numerical exploration of various DPG-based time-marching approaches to the heat equation. As part of this work, we have contributed extensively to the Camellia open-source library; we also describe the new capabilities and their usage. We have also developed a well-documented methodology for single-species collision operators, which we applied to argon and demonstrated with numerical experiments. We summarize those results here, as well as describing at a high level a design extending the methodology to multi-species operators. We have released a new open-source library, MLC, under a BSD license; we include a summary of its capabilities as well.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Emulation Modeling for Development of Cyber-Defense Capabilities for Satellite Systems

The objective of this project was to develop a novel capability to generate synthetic data sets for the purpose of training Machine Learning (ML) algorithms for the detection of malicious activities on satellite systems. The approach experimented with was to a) generate sparse data sets using emulation modeling and b) enlarge the sparse data using Generative Adversarial Networks (GANs). We based our emulation modeling on the Open Source NASA Operational Simulator for Small Satellites (NOS3) developed by the Katherine Johnson Independent Verification and Validation (IV&V) program in West Virginia. Significant new capabilities on NOS3 had to be developed for our data set generation needs. To expand these data sets for the purpose of training ML, we experimented with a) Extreme Learning Machines (ELMs) and b) Wasserstein-GANs (WGAN-GP).

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

NRAP-Open-IAM Multisegmented Wellbore Reduced-Order Model: Improvement and Quality Assurance

The multisegmented wellbore model (MSW) semi-analytically estimates the amount of CO 2 and brine leakage from a leaking legacy well by segmenting it into intervals to simulate site-specific stratigraphic and hydrogeologic properties. The model is a component of the National Risk Assessment Partnership Open-Source Integrated Assessment Model (NRAP-Open-IAM), which was developed to perform risk assessment for geologic CO 2 storage. The new wellbore leakage model, which uses deep learning networks for a caprock segment, was developed to enhance the analytical MSW. The model was trained and validated using a synthetic data set of Subsurface Transport Over Multiple Phases (STOMP) multiphase flow simulations from various geological, well attribute, and operational conditions to ensure its quality. The results demonstrate that the model is more accurate than the existing model in predicting the transport of two-phase fluids (brine and injected CO 2 ) through the well. This report provides a detailed explanation of the model development and quality assurance.

58 GEOSCIENCES↗

Source localization for neutron imaging systems using convolutional neural networks

The nuclear imaging system at the National Ignition Facility (NIF) is a crucial diagnostic for determining the geometry of inertial confinement fusion implosions. The geometry is reconstructed from a neutron aperture image via a set of reconstruction algorithms using an iterative Bayesian inference approach. An important step in these reconstruction algorithms is finding the fusion source location within the camera field-of-view. Currently, source localization is achieved via an iterative optimization algorithm. In this paper, we introduce a machine learning approach for source localization. Specifically, we train a convolutional neural network to predict source locations given a neutron aperture image. We show that this approach decreases computation time by several orders of magnitude compared to the current optimization-based source localization while achieving similar accuracy on both synthetic data and a collection of recent NIF deuterium–tritium shots.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Ultra-High-Speed X-ray Tomography: Bridging the Gaps to See the Unknown

Rapid, time-varying, three-dimensional physics underpin numerous engineering challenges. Often, these physics occur within opaque environments, internal to a component, severely limiting applicable diagnostics. Development of novel diagnostics is necessary to understand and predict transient three-dimensional (3D) phenomena within opaque environments. This report highlights progress in four key areas leading to advancements in high-speed X-ray radiography and tomography. The first area is enabling MHz-rate imaging of energetics at the Advanced Photon Source at Argonne National Laboratory. The second is modeling a high-flux, rotating-anode X-ray source to understand the heat loads on the anode. The third effort was to develop a novel reconstruction algorithm that is validated by ground experimental tomography data and synthetic tomography data. The fourth is the development of a novel approach to two-color X-ray imaging.

42 ENGINEERING↗

Hierarchical Bayesian Modeling for Cosmology: Can NPE reliably replace MCMC?

Hierarchical neural posterior estimation has its place Hierarchical Bayesian Modeling (HBM) combined with MCMC algorithms has been shown to provide more robust and accurate inference for real-world phenomena in which nature takes a nested form. However, MCMC-based inference can be computationally expensive, and its performance often suffers for complex posterior geometries. These costs are especially pertinent for HBM. Studies have recently demonstrated the potential for a flexible, expressive, and amortized hierarchical neural posterior estimator (HNPE) built on Normalizing Flows. These studies have mostly been performed on simple datasets, or they focus on a single parameter from each level of the hierarchy. A systematic study analyzing how both hierarchical methods compare for more complex and realistic datasets is necessary before applying HNPE for scientific measurements. Here, we re-explore the theory behind HNPE and conduct comparative numerical experiments of HNPE and MCMC-based HBM methods on real and synthetic data, including strong gravitational lensing simulations. In particular, we use a suite of diagnostics to show trade-offs in terms of accuracy, precision, time to train or sample, reproducibility, and the need for expert domain knowledge. Especially for higher dimensional and complex posteriors, HNPE is expected to drastically improve on time for inference, accuracy, and precision with an upfront training time cost.

Hur, Rachel [Chicago U.] (ORCID:000900089890445X)↗

Enhanced Multi-Dimensional Inversion Through Target-Specific Inversion Parameter Bounds With an Application to Crosswell Electromagnetic for Sequestration Monitoring

In geophysical inversions, lower and upper model parameter bounds are a means of solution stabilization. Further, constraints that intend to let only geologically plausible inverse solutions pass are amenable to lower and upper bounds. Reliable prior information is paramount to construct such bound constraints. It is common practice to narrow and widen bound intervals for regions of, respectively, more and less certain prior information. Contrary to this practice, we experiment with widened bound intervals in zones that are poorly resolved by a given survey configuration but where prior information would suggest structural anomalies of interest. The purpose of enlarged parameter bounds that correlate spatially with predefined targets is to let the inversion explore a larger solution space, thus increasing the potential to resolve otherwise hidden anomalies. Application of the method is based on a carbon-sequestration baseline (pre-injection) crosswell electromagnetic (EM) field survey at the Containment and Monitoring Institute Field Research Station (Alberta, Canada), where impeded measurements led to generally reduced sensitivities for the interwell region. Synthetic-data proofs of concept use augmented bounds designed to boost the resolution of artificial plume targets, indicating an enhanced illumination compared to constant bounds. Comparative field data inversions with spatially variable bounds constructed from prior resistivity and velocity information highlight non-horizontal baseline structures.

3-D electrical resistivity imaging↗

Towards the first plasma-electron screening experiment

The enhancement of fusion reaction rates in a thermonuclear plasma by electron screening of the Coulomb barrier is an important plasma-nuclear effect that is present in stellar models but has not been experimentally observed. Experiments using inertial confinement fusion (ICF) implosions may provide a unique opportunity to observe this important plasma-nuclear effect. Herein, we show that experiments at the National Ignition Facility (NIF) have reached the relevant physical regime, with respect to the density and temperature conditions, but the estimated impacts of plasma screening on nuclear reaction rates are currently too small and need to be increased to lower the expected measurement uncertainty. Detailed radiation hydrodynamics simulations show that practical target changes, like adding readily available high-Z gases, and significantly slowing the inflight implosion velocity, while maintaining inflight kinetic energy, might be able to push these conditions to those where plasma screening effects may be measurable. We also perform synthetic data exercises to help understand where the anticipated experimental uncertainties will become important. But challenges remain, such as the detectability of the reaction products, non-thermal plasma effects, species separation, and impacts of spatial and temporal gradients. This work lays the foundation for future efforts to develop an important platform capable of the first plasma electron screening observation.

inertial confinement fusion↗

Inference, Prediction, & Entropy-Rate Estimation of Continuous-Time, Discrete-Event Processes

Inferring models, predicting the future, and estimating the entropy rate of discrete-time, discrete-event processes is well-worn ground. However, a much broader class of discrete-event processes operates in continuous-time. Here, we provide new methods for inferring, predicting, and estimating them. The methods rely on an extension of Bayesian structural inference that takes advantage of neural network’s universal approximation power. Based on experiments with complex synthetic data, the methods are competitive with the state-of-the-art for prediction and entropy-rate estimation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Can Simple Machine Learning Tools Extend and Improve Temperature-Based Methods to Infer Streambed Flux?

Temperature-based methods have been developed to infer 1D vertical exchange flux between a stream and the subsurface. Current analyses rely on fitting physically based analytical and numerical models to temperature time series measured at multiple depths to infer daily average flux. These methods have seen wide use in hydrologic science despite strong simplifying assumptions including a lack of consideration of model structural error or the impacts of multidimensional flow or the impacts of transient streambed hydraulic properties. We performed a “perfect-model experiment” investigation to examine whether regression trees, with and without gradient boosting, can extract sufficient information from model-generated subsurface temperature time series, with and without added measurement error, to infer the corresponding exchange flux time series at the streambed surface. Using model-generated, synthetic data allowed us to assess the basic limitations to the use of machine learning; further examination of real data is only warranted if the method can be shown to perform well under these ideal conditions. We also examined whether the inherent feature importance analyses of tree-based machine learning methods can be used to optimize monitoring networks for exchange flux inference.

54 ENVIRONMENTAL SCIENCES↗

Red Noise–based False Alarm Thresholds for Astrophysical Periodograms via Whittle’s Approximation to the Likelihood

Astronomers who search for periodic signals using Lomb–Scargle periodograms rely on false alarm level (FAL) estimates to identify statistically significant peaks. Although FALs are often calculated from white noise models, many astronomical time series suffer from red noise. Prewhitening is a statistical technique in which a continuum model is subtracted from the log power spectrum estimate, after which the observer can proceed with a white-noise treatment. Here we present a prewhitening-based method of calculating frequency-dependent FALs. We fit power laws and autoregressive models of order 1 to each Lomb–Scargle periodogram by minimizing the Whittle approximation to the negative log-likelihood (NLL), then calculate FALs based on the best-fit model power spectrum. Our technique is a novel extension of the Whittle NLL to datasets with uneven time sampling. We demonstrate FAL calculations using observations of α Cen B, GJ 581, HD 192310, synthetic data from the radial velocity (RV) fitting challenge, and Kepler observations of a differential rotator. The Kepler data analysis shows that only true rotation signals are detected by red noise FALs, while white noise FALs suggest all spurious peaks in the low-frequency range are significant. A high-frequency sinusoid injected into α Cen B logR$'$ HK observations exceeds the 1% red noise FAL despite having only 8.9% of the power of the dominant rotation signal. In a periodogram of HD 192310 RVs, peaks associated with differential rotation and planets are detected against the 5% red noise FAL without iterative model fitting or subtraction. The software for calculating red noise–based FALs is available on GitHub.

Astrostatistics (1882)↗

Photometry on Structured Backgrounds: Local Pixel-wise Infilling by Regression

Photometric pipelines struggle to estimate both the flux and flux uncertainty for stars in the presence of structured backgrounds such as filaments or clouds. However, it is exactly stars in these complex regions that are critical to understanding star formation and the structure of the interstellar medium. We develop a method, similar to Gaussian process regression, which we term local pixel-wise infilling (LPI). Using a local covariance estimate, we predict the background behind each star and the uncertainty of that prediction in order to improve estimates of flux and flux uncertainty. We show the validity of our model on synthetic data and real dust fields. We further demonstrate that the method is stable even in the crowded field limit. While we focus on optical-IR photometry, this method is not restricted to those wavelengths. We apply this technique to the 34 billion detections in the second data release of the Dark Energy Camera Plane Survey. In addition to removing many >3σ outliers and improving uncertainty estimates by a factor of ~2–3 on nebulous fields, we also show that our method is well behaved on uncrowded fields. The entirely post-processing nature of our implementation of LPI photometry allows it to easily improve the flux and flux uncertainty estimates of past as well as future surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

A Kosloff/Basal method, 3D migration program implemented on the CYBER 205 supercomputer

Conventional finite difference migration has relied on approximations to the acoustic wave equation which allow energy to propagate only downwards. Although generally reliable, such approaches usually do not yield an accurate migration for geological structures with strong lateral velocity variations or with steeply dipping reflectors. An earlier study by D. Kosloff and E. Baysal (Migration with the Full Acoustic Wave Equation) examined an alternative approach based on the full acoustic wave equation. The 2D, Fourier type algorithm which was developed was tested by Kosloff and Baysal against synthetic data and against physical model data. The results indicated that such a scheme gives accurate migration for complicated structures. This paper describes the development and testing of a vectorized, 3D migration program for the CYBER 205 using the Kosloff/Baysal method. The program can accept as many as 65,536 zero offset (stacked) traces.

Pyle, L. D.↗

Lower atmospheric composition of Jupiter from Voyager infrared measurements

The observed spectrum of Jovian atmosphere exhibits spectral features of H2, CH4, C2H6, NH3, H2O, GeH4 and CH3D. Analytical programs were developed for radiative transfer calculations and for retrieval of lower atmospheric composition of Jupiter from the observed infrared spectrum. The program models developed are based line by line transmittance calculations with appropriate convolution of the instrument function. The constituent inversion programs were evaluated for accuracy by analyzing synthetic data for retrievals of NH3 profiles. The inversion programs were employed for retrieval of NH3 profiles from the Voyager infared data with results generally in agreement with the accepted values.

Abbas, M. M.↗

Adaptive Filtering for Large Space Structures: A Closed-Form Solution

In a previous paper Schaechter proposes using an extended Kalman filter to estimate adaptively the (slowly varying) frequencies and damping ratios of a large space structure. The time varying gains for estimating the frequencies and damping ratios can be determined in closed form so it is not necessary to integrate the matrix Riccati equations. After certain approximations, the time varying adaptive gain can be written as the product of a constant matrix times a matrix derived from the components of the estimated state vector. This is an important savings of computer resources and allows the adaptive filter to be implemented with approximately the same effort as the nonadaptive filter. The success of this new approach for adaptive filtering was demonstrated using synthetic data from a two mode system.

Rauch, H. E.↗

Spherical harmonic analysis of steady photospheric flows

A technique is presented in which full disk Doppler velocity measurements are analyzed using spherical harmonic functions to determine the characteristics of the spectrum of spherical harmonic modes and the nature of steady photospheric flows. Synthetic data are constructed in order to test the technique. In spite of the mode mixing due to the lack of information about the motions on the backside of the sun, solar rotation and differential rotation can be accurately measured and monitored for secular changes, and meridional circulations with small amplitudes can be measured. Furthermore, limb shift measurements can be accurately obtained, and supergranules can be fully resolved and separated from giant cells by their spatial characteristics.

Hathaway, David H.↗

A spherical harmonic decomposition technique for analysing steady photospheric flows

Steady flows in the photosphere, including differential rotation, meridional circulation and convection, can be represented by a spectrum of modes. A technique is described in which the spherical harmonic functions are used to determine the characteristics of this spectrum and the nature of these flows. Some information about the spectrum is lost because only one hemisphere is seen, only the line of sight velocity is measured and the measurements contain noise. This produces an apparent mixing between spectral modes. By analyzing synthetic data it is found that, in spite of this mixing, differential rotation can be accurately measured, meridional circulations with small amplitudes can be extracted from the data and giant cells might be separated from supergranules.

Hathaway, David H.↗