Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ensemble methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,135 records · Page 63

Ensemble approximate control variate estimators: Applications to multi-fidelity importance sampling.

The recent growth in multifidelity uncertainty quantification has given rise to a large set of variance reduction techniques that leverage information from model ensembles to provide variance reduction for estimates of the statistics of a high-fidelity model. In this paper we provide two contributions: (1) we utilize an ensemble estimator to account for uncertainties in the optimal weights of approximate control variate (ACV) approaches and derive lower bounds on the number of samples required to guarantee variance reduction; and (2) we extend an existing multifidelity importance sampling (MFIS) scheme to leverage control variates. Our approach directly addresses a limitation of many multifidelity sampling strategies that require the usage of pilot samples to estimate covariances. As such we make significant progress towards both increasing the practicality of approximate control variates—for instance, by accounting for the effect of pilot samples—and using multifidelity approaches more effectively for estimating low-probability events. The numerical results indicate our hybrid MFIS-ACV estimator achieves up to 50% improvement in variance reduction over the existing state-of-the-art MFIS estimator, which had already shown an outstanding convergence rate compared to the Monte Carlo method, on several problems of computational mechanics.

97 MATHEMATICS AND COMPUTING↗

Using Ensemble Data Assimilation to Estimate Transient Hydrologic Exchange Flow Under Highly Dynamic Flow Conditions

Abstract Quantifying dynamic hydrologic exchange flows (HEFs) within river corridors that experience high‐frequency flow variations caused by dam regulations is important for understanding the biogeochemical processes at the river water and groundwater interfaces. Heat has been widely used as a tracer to infer steady‐state flow velocities through analytical solutions of heat transport defined by the diurnal temperature signals. Under sub‐daily dynamic flow conditions, however, such analytical solutions are not applicable due to the violation of their fundamental assumptions. In this study, we developed a data assimilation‐based approach to estimate the sub‐daily flux under highly dynamic flow conditions using multi‐depth temperature observations at a 5‐min resolution. If the hydraulic gradient is measured, Darcy's law was used to calculate the flux with permeability estimated from temperature responses below the riverbed. Otherwise, flux was estimated directly by assimilating multi‐depth temperature data at 1‐ or 2‐hr time intervals assuming one‐dimensional flow and heat transport governing equation. By comparing estimated fluxes with model‐generated synthetic truth, we demonstrated that both schemes have robust performance in estimating fluxes under highly dynamic flow conditions. This data assimilation‐based flux estimation method was able to capture the vertical sub‐daily fluxes using multi‐depth high‐resolution temperature data alone, even in the presence of multi‐dimensional flow. This approach has been successfully applied to real field temperature data collected at the Hanford site, which experiences highly dynamic HEFs. Our study shows the promise of adopting distributed 1‐D temperature monitoring to capture spatial and temporal exchange dynamics in river corridors at a watershed scale or beyond.

54 ENVIRONMENTAL SCIENCES↗

Synthesis of Ocean Observations Using Data Assimilation for Operational, Real-Time and Reanalysis Systems: A More Complete Picture of the State of the Ocean

Ocean data assimilation is increasingly recognized as crucial for the accuracy of realtime ocean prediction systems and historical re-analyses. The current status of ocean data assimilation in support of the operational demands of analysis, forecasting and reanalysis is reviewed, focusing on methods currently adopted in operational and realtime prediction systems. Significant challenges associated with the most commonly employed approaches are identified and discussed. Overarching issues faced by ocean data assimilation are also addressed, and important future directions in response to scientific advances, evolving and forthcoming ocean observing systems and the needs of stakeholders and downstream applications are discussed.

modeling↗

Uncertainty quantification for high explosive reactant and product equations of state

Equations of state (EOSs) are typically represented as physics-informed models with tunable parameters that are adjusted to replicate calibration data as closely as possible. Uncertainty quantification (UQ) allows for the development of an ensemble of EOS parameters that are consistent with the calibration data instead of a single EOS. In this work, we perform UQ for the reactant and product EOSs for a variety of high explosives (HEs). In doing so, we demonstrate a strategy for dealing with heterogeneous (both experimental and calculated) data. We also use a statistical distance metric to quantify the differences between the various HEs using the UQ results.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A Task Based Approach for Co-Scheduling Ensemble Workloads on Heterogeneous Nodes

Scientific workflows consist of multiple, connected applications, with data and results flowing from one to another in a pipeline. Traditionally, such workflows are executed in sequential order, storing intermediate data in storage disks. Co-scheduling application workflows concurrently on the same compute nodes would greatly reduce the cost of moving data to/from storage and allow real-time analysis of intermediate results. Nevertheless, most parallel programming runtimes do not allow seamless integration of various applications in a scientific workflow, in part due to the complexity of managing data and resources. The situation is even more complicated for heterogeneous systems. In this work we extend the Minos Computing Library (MCL) runtime to accelerate pipe-lined and parallel workloads where multiple applications are running in the same system. MCL’s asynchronous task library and runtime dynamically manages resources to allow co-scheduling of multiple processes sharing heterogeneous resources. In addition, we design a custom ex- tension of the Open Compute Language (OpenCL) to enable multiple processes to share device memory. We enable MCL to coordinate these shared buffers to allow for easy, fast data sharing between applications. Using malleable micro-benchmarks and two application workflows that combine scientific simulation and AI-based analysis, we show that our method outperforms traditional approaches.

Index Terms—Parallel systems, Scheduling and Task ↗

Explosive Soot Challenge (Final Report)

This project assembled a broad ensemble of modeling and experimentation tools to study the morphological and optical properties of detonation soots in explosive fireballs. A gram-scale hemispherical high explosive was studied in a low-pressure controlled environment using in-situ experimentation with diffusely illuminated visible absorption spectroscopy, particle sizing through light scattering techniques, and post-test collections with subsequent morphological analysis. Hydrocode modeling was performed to replicate the detonation flow observations, and subsequent aerosol kinetics models provided particle size distributions and extinction coefficients from the hydrocode results. Experimentally observed soot morphologies agreed with expectation from the literature - a bimodal distribution was found, brought upon by the particles growing to a size where their inertia and fluid wakes are non-negligible. The aerosol kinetics model did not replicate the observed bimodal size distribution for lack of a coagulation kernel to represent the behavior. To recover particulate optical properties, a spectrally resolved absorption spectroscopy method termed Spectral diffuse back-illuminated extinction imaging (SBI-EI) was developed and implemented on two explosive types. Inverting the absorption spectra using a Kramers-Kronig consistent method yielded the complex index of refraction for the soots produced by the explosives. This method resulted in an unrealistic index of refraction for one of the two explosives, and this is suspected to be due to the model neglecting scattering brought upon by the large particle sizes observed. In addition to the core work, three additional studies were performed in parallel. These investigated the impact of scattering on diffuse absorption spectroscopy, studied how soots oxidate and sublimate in a well-controlled shock tube, and laid the theoretical groundwork for a new collision kernel to replicate the bimodal size distribution from the observations. Summaries of these efforts are included at the end of this report.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Development of an advanced rocket propellant handler's suit

Most launch vehicles and satellites in the US inventory rely upon the use of hypergolic rocket propellants, many of which are toxic to humans. These fuels and oxidizers, such as hydrazine and nitrogen tetroxide have threshold limit values as low as 0.01 PPM. It is essential to provide space workers handling these agents whole body protection as they are universally hazardous not only to the respiratory system, but the skin as well. This paper describes a new method for powering a whole body protective garment to assure the safety of ground servicing crews. A new technology has been developed through the small business innovative research program at the Kennedy Space Center. Currently, liquid air is used in the environmental control unit (ECU) that powers the propellant handlers suit (PHE). However, liquid air exhibits problems with attitude dependence, oxygen enrichment, and difficulty with reliable quantity measurement. The new technology employs the storage of the supply air as a supercritical gas. This method of air storage overcomes all of three problems above while maintaining high density storage at relatively low vessel pressures (<7000 kPa or approximately 1000 psi). A one hour prototype ECU was developed and tested to prove the feasibility of this concept. This was upgraded by the design of a larger supercritical dewar capable of holding 7 Kg of air, a supply which provides a 2 hour duration to the PHE. A third version is being developed to test the feasibility of replacing existing air cooling methodology with a liquid cooled garment for relief of heat stress in this warm Florida environment. Testing of the first one hour prototype yielded data comparable to the liquid air powered predecessor, but enjoyed advantages of attitude independence and oxygen level stability. Thermal data revealed heat stress relief at least as good as liquid air supplied units. The application of supercritical air technology to this whole body protective ensemble marked an advancement in the state-of-the-art in personal protective equipment. Not only was long duration environmental control provided, but it was done without a high pressure vessel. The unit met human performance needs for attitude independence, oxygen stability and relief of heat stress. This supercritical air (and oxygen) technology is suggested for microgravity applications in life support such as the Extravehicular Mobility Unit. c 2001. Elsevier Science Ltd. All rights reserved.

Hazardous Substances↗

DeepONet-Assisted Optimization of Surface Topography for Transition Delay in a Mach 4.5 Boundary Layer

We use deep learning, an ensemble variational technique (EnVar), and direct numerical simulations(DNS) to design an optimal topography for a two-dimensional roughness element that delays the on-set of laminar-turbulent transition in a Mach 4.5 flat-plate boundary layer. Deep operator networks (DeepONets), which have the known ability to learn complex nonlinear operators within dynamical systems, are used for machine learning. For the baseline configuration of a smooth flat plate, the second-mode waves at the DNS inflow cause a quick nonlinear breakdown of the high-speed boundary layer within the computational domain. Results reported in the present study validate the ability of DeepONets to model the transition delay via a given topography of the roughness element. The computing cost to optimize the rough-ness element for minimal skin-friction drag is substantially lowered by the DeepONets-based reduced-order model. In comparison to the baseline method of EnVar optimization based on DNS alone, the DeepONets-based EnVar optimizer is able to delay transition past the outflow boundary of the computational domain while utilizing almost 5–6 times fewer DNS.

Machine Learning↗

A Parametric, Data-Driven, Non-Intrusive Reduced-Order Model Framework for Crystal Plasticity Simulations of Voids

The influence of the internal structure at micrometer length scales on the deformation of polycrystalline materials can be effectively captured using crystal plasticity finite element methods (CPFEM). However, the complexity and nonlinearity of the deformation equations CPFEM solves demand significant computational power and resources to achieve accurate predictions, limiting its broader application. To address this challenge, we have identified a reduced-order representation of the complex data in order to establish a computationally efficient reduced-order models (ROM) and drastically reduce the computational expense of CPFEM. Specifically, in this work, we developed a parametric, data-driven, and non-intrusive ROM framework for CPFEM using proper orthogonal decomposition (POD) and sparse variational Gaussian process (SVGP) regression for single-crystal microstructures under tensile loading conditions. The developed protocol enables one to compress field into a latent/low-dimensional space described by principal component analysis (PCA) via the singular value decomposition (SVD) algorithm. As a result, the high-dimensional data are reduced to a significantly smaller amount of dimensions with POD bases and POD coefficients. Furthermore, we deployed an ensemble of SVGPs—extended from the classical Gaussian process (GP) regression for scalability and handling big data—in a massively parallel manner to train and predict latent POD coefficients using known POD bases from a set of previously obtained simulations results. Lastly, using the predicted POD coefficients, we reconstructed the full-field results and showed reasonable agreement compared with the true values obtained from running CPFEM. The developed framework is validated with a set of CPFEM simulations of a single embedded void in single-crystal aluminum alloy. While the framework is broadly applicable, this work specifically focuses on single-crystal microstructures, a single load case (e.g., tensile), and a specific void geometry (spherical).

Anisotropy↗

Dynamics of reconfigurable artificial spin ice: Toward magnonic functional materials

Over the past few years, the study of magnetization dynamics in artificial spin ices has become a vibrant field of study. Artificial spin ices are ensembles of geometrically arranged, interacting magnetic nanoislands, which display frustration by design. These were initially created to mimic the behavior in rare earth pyrochlore materials and to study emergent behavior and frustration using two-dimensional magnetic measurement techniques. Recently, it has become clear that it is possible to create artificial spin ices, which can potentially be used as functional materials. In this perspective, we review the resonant behavior of spin ices in the GHz frequency range, focusing on their potential application as magnonic crystals. In magnonic crystals, spin waves are functionalized for logic applications by means of band structure engineering. While it has been established that artificial spin ices can possess rich mode spectra, the applicability of spin ices to create magnonic crystals hinges upon their reconfigurability. Consequently, we describe recent work aiming to develop techniques and create geometries allowing full reconfigurability of the spin ice magnetic state. We also discuss experimental, theoretical, and numerical methods for determining the spectral response of artificial spin ices and give an outlook on new directions for reconfigurable spin ices.

36 MATERIALS SCIENCE↗

Spin-squeezed Gottesman-Kitaev-Preskill codes for quantum error correction in atomic ensembles

Gottesman-Kitaev-Preskill (GKP) codes encode a qubit in displaced phase-space combs of a continuous-variable (CV) quantum system and are useful for correcting a variety of high-weight photonic errors. Here we propose atomic ensemble analogs of the single-mode CV GKP code by using the quantum central limit theorem to pull back the phase-space structure of a CV system to the compact phase space of a quantum spin system. We study the optimal recovery performance of these codes under error channels described by stochastic relaxation and isotropic ballistic dephasing processes using the diversity combining approach for calculating channel fidelity. Additionally, we find that the spin GKP codes outperform other spin system codes such as cat codes or binomial codes. Our spin GKP codes based on the two-axis countertwisting interaction and superpositions of SU(2) coherent states are direct spin analogs of the finite-energy CV GKP codes, whereas our codes based on one-axis twisting do not yet have well-studied CV analogs. A state preparation scheme for the spin GKP codes is proposed which uses the linear-combination-of-unitaries method, applicable to both the CV and spin GKP settings. Finally, we discuss a fault-tolerant approximate gate set for quantum computing with spin-GKP-encoded qubits, obtained by translating gates from the CV GKP setting using the quantum central limit theorem.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Performance of Two Cloud-Radiation Parameterization Schemes in the Finite Volume General Circulation Model for Anomalously Wet May and June 2003 Over the Continental United States and Amazonia

An objective assessment of the impact of a new cloud scheme, called Microphysics of Clouds with Relaxed Arakawa-Schubert Scheme (McRAS) (together with its radiation modules), on the finite volume general circulation model (fvGCM) was made with a set of ensemble forecasts that invoke performance evaluation over both weather and climate timescales. The performance of McRAS (and its radiation modules) was compared with that of the National Center for Atmospheric Research Community Climate Model (NCAR CCM3) cloud scheme (with its NCAR physics radiation). We specifically chose the boreal summer months of May and June 2003, which were characterized by an anomalously wet eastern half of the continental United States as well as northern regions of Amazonia. The evaluation employed an ensemble of 70 daily 10-day forecasts covering the 61 days of the study period. Each forecast was started from the analyzed initial state of the atmosphere and spun-up soil moisture from the first-day forecasts with the model. Monthly statistics of these forecasts with up to 10-day lead time provided a robust estimate of the behavior of the simulated monthly rainfall anomalies. Patterns of simulated versus observed rainfall, 500-hPa heights, and top-of-the-atmosphere net radiation were recast into regional anomaly correlations. The correlations were compared among the simulations with each of the schemes. The results show that fvGCM with McRAS and its radiation package performed discernibly better than the original fvGCM with CCM3 cloud physics plus its radiation package. The McRAS cloud scheme also showed a reasonably positive response to the observed sea surface temperature on mean monthly rainfall fields at different time leads. This analysis represents a method for helpful systematic evaluation prior to selection of a new scheme in a global model.

Sud, Y. C.↗

Atomistic Studies of Individual Impurities and Impurity Complexes in III-V Semiconductors. Final report

The central hypothesis of our investigation is that reduced symmetries significantly influence the properties of individual impurities and impurity complexes in semiconductors. To disentangle the properties of the local environments of these impurities and impurity complexes from the behavior of an ensemble of impurities, at U. Iowa we performed theoretical calculations of specific local environments and developed the theoretical technology to calculate spin and charge transport through those local environments, in which the contact is a localized probe (scanning tunneling microscopy tip). These calculations were designed to be brought into comparison with experimental measurements made by Prof. Gupta’s group at Ohio State University. The principal environment that we focused on is the (110) surface of GaAs and other III-V semiconductors, because pristine surfaces can be revealed through a natural cleavage plane. We studied how the p-d hybridization of transition-metal dopants is influenced by the energetic location and the local environment’s symmetry-breaking of the d levels, and how the 4f-shell states of rare earth impurities couple to the surroundings. We calculated long-distance properties using tight-binding (linear combination of atomic orbitals, LCAO) Green’s function methods. The spin character of the dopants is often coherent on the time-scale of electronic transport through the region, and so correlations of the spin character of a dopant with that of a spinpolarized STM tip, or another dopant in the vicinity, can influence the measured conductivity from STM. We constructed a robust theory for these effects that can be used to describe quantitatively the measurements made by spin-polarized STM.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Maximum a posteriori classification of multifrequency, multilook, synthetic aperture radar intensity data

We present a maximum a posteriori (MAP) classifier for classifying multifrequency, multilook, single polarization SAR intensity data into regions or ensembles of pixels of homogeneous and similar radar backscatter characteristics. A model for the prior joint distribution of the multifrequency SAR intensity data is combined with a Markov random field for representing the interactions between region labels to obtain an expression for the posterior distribution of the region labels given the multifrequency SAR observations. The maximization of the posterior distribution yields Bayes's optimum region labeling or classification of the SAR data or its MAP estimate. The performance of the MAP classifier is evaluated by using computer-simulated multilook SAR intensity data as a function of the parameters in the classification process. Multilook SAR intensity data are shown to yield higher classification accuracies than one-look SAR complex amplitude data. The MAP classifier is extended to the case in which the radar backscatter from the remotely sensed surface varies within the SAR image because of incidence angle effects. The results obtained illustrate the practicality of the method for combining SAR intensity observations acquired at two different frequencies and for improving classification accuracy of SAR data.

Rignot, E.↗

Information-Guided Dynamic Nuclear Polarization

A spin ensemble in thermal equilibrium continuously undergoes random fluctuations analogous to those observed in Brownian motion, a process known as spin noise. Here, we investigate the dynamics of a system comprising a spin-1 paramagnetic center and a hyperfine-coupled spin-1/2 nucleus in the vicinity of a level crossing. We theoretically show that nuclear spins polarize efficiently under the combined action of thermal fluctuations and a closed-loop feedback protocol. The latter articulates periodic observations of the electronic magnetization and radio-frequency pulses connecting hybrid states with opposite nuclear spin alignment. Since nuclear polarization emerges from electronic spin fluctuations, not spin order, this microwave-free technique generically benefits from warmer, not colder, operation temperatures. Furthermore, because the spin dynamics at play near a level crossing is rather insensitive to the absolute value of the magnetic field, our work promises opportunities for high-field dynamic nuclear polarization, which is difficult to attain through present methods.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Regime-oriented causal model evaluation of Atlantic–Pacific teleconnections in CMIP6

The climate system and its spatio-temporal changes are strongly affected by modes of long-term internal variability, like the Pacific decadal variability (PDV) and the Atlantic multidecadal variability (AMV). As they alternate between warm and cold phases, the interplay between PDV and AMV varies over decadal to multidecadal timescales. Here, we use a causal discovery method to derive fingerprints in the Atlantic–Pacific interactions and to investigate their phase-dependent changes. Dependent on the phases of PDV and AMV, different regimes with characteristic causal fingerprints are identified in reanalyses in a first step. In a second step, a regime-oriented causal model evaluation is performed to evaluate the ability of models participating in the Coupled Model Intercomparison Project Phase 6 (CMIP6) in representing the observed changing interactions between PDV, AMV and their extra-tropical teleconnections. The causal graphs obtained from reanalyses detect a direct opposite-sign response from AMV to PDV when analyzing the complete 1900–2014 period and during several defined regimes within that period, for example, when AMV is going through its negative (cold) phase. Reanalyses also demonstrate a same-sign response from PDV to AMV during the cold phase of PDV. Historical CMIP6 simulations exhibit varying skill in simulating the observed causal patterns. Generally, large-ensemble (LE) simulations showed better network similarity when PDV and AMV were out of phase compared to other regimes. Also, the two largest ensembles (in terms of number of members) were found to contain realizations with similar causal fingerprints to observations. For most regimes, these same models showed higher network similarity when compared to each other. This work shows how causal discovery on LEs complements the available diagnostics and statistical metrics of climate variability to provide a powerful tool for climate model evaluation.

54 ENVIRONMENTAL SCIENCES↗

DeepONet-Assisted Optimization of Surface Topography for Transition Delay in A Mach 4.5 Boundary Layer

We use deep learning, an ensemble variationaltechnique (EnVar), and direct numerical simulations(DNS) to design an optimal topography for a two-dimensional roughness element that delays the on-set of laminar-turbulent transition in a Mach 4.5 flat-plate boundary layer. Deep operator networks (Deep-ONets), which have the known ability to learn com-plex nonlinear operators within dynamical systems,are used for machine learning. For the baseline config-uration of a smooth flat plate, the second-mode wavesat the DNS inflow cause a quick nonlinear breakdownof the high-speed boundary layer within the computa-tional domain. Results reported in the present studyvalidate the ability of DeepONets to model the tran-sition delay via a given topography of the roughnesselement. The computing cost to optimize the rough-ness element for minimal skin-friction drag is substan-tially lowered by the DeepONets-based reduced-ordermodel. In comparison to the baseline method of EnVaroptimization based on DNS alone, the DeepONets-based EnVar optimizer is able to delay transition pastthe outflow boundary of the computational domainwhile utilizing almost 5–6 times fewer DNS.

Machine Learning↗

Lectures on statistical mechanics

Presented here is a transcription of the lecture notes from Professor Allan N. Kaufman’s graduate statistical mechanics course Physics 212A and 212B at the University of California Berkeley from the 1972–1973 academic year. 212A addressed equilibrium statistical mechanics with topics: fundamentals (micro-canonical and sub-canonical ensembles, adiabatic law and action conservation, fluctuations, pressure, and virial theorem), classical fluids and other systems (equation of state, deviations from ideality, virial coefficients and van der Waals potential, canonical ensemble and partition function, quasistatic evolution, grand-canonical ensemble and partition function, chemical potential, simple model of a phase transition, quantum virial expansion, numerical simulation of equations of state, and phase transition), chemical equilibrium (systems with multiple species and chemical reactions, law of mass action, Saha equation, chemical equilibrium including ionization and excited states), and long-range interactions (including Coulomb, dipole, and gravitational interactions, Debye–Hückel theory, and shielding). 212B addressed nonequilibrium statistical mechanics with topics: fundamentals (definitions: realizations, moments, characteristic function, and discrete variables), Brownian motion (Langevin equation, fluctuation–dissipation theorem, spatial diffusion, Boltzmann’s H-theorem), Liouville and Klimontovich equations, Landau equation (derivation, elaboration, and H-theorem, and irreversibility), Markov processes and Fokker–Planck equation (derivations of the Fokker–Planck equation and a master equation), linear response and transport theory (linear Boltzmann equation, linear response theory of Kubo and Mori, relation of entropy production to electrical conductivity, transport relations and coefficients, normal mode solutions of the transport equations, sketch of a generalized Langevin equation method for transport theory), and an introduction to nonequilibrium quantum statistical mechanics.

plasma dynamics↗