Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ensemble methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Scalable Bayesian optimization with randomized prior networks

Several fundamental problems in science and engineering consist of global optimization tasks involving unknown high-dimensional (black-box) functions that map a set of controllable variables to the outcomes of an expensive experiment. Bayesian Optimization (BO) techniques are known to be effective in tackling global optimization problems using a relatively small number objective function evaluations, but their performance suffers when dealing with high-dimensional outputs. To overcome the major challenge of dimensionality, here we propose a deep learning framework for BO and sequential decision making based on bootstrapped ensembles of neural architectures with randomized priors. Using appropriate architecture choices, we show that the proposed framework can approximate functional relationships between design variables and quantities of interest, even in cases where the latter take values in high-dimensional vector spaces or even infinite-dimensional function spaces. In the context of BO, we augmented the proposed probabilistic surrogates with re-parameterized Monte Carlo approximations of multiple-point (parallel) acquisition functions, as well as methodological extensions for accommodating black-box constraints and multi-fidelity information sources. We test the proposed framework against state-of-the-art methods for BO and demonstrate superior performance across several challenging tasks with high-dimensional outputs, including a constrained multi-fidelity optimization task involving shape optimization of rotor blades in turbo-machinery.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Third moments of nucleon unpolarized, polarized, and transversity parton distribution functions from physical-point lattice QCD

Using forward matrix elements of local leading-twist operators, we present a determination of the isovector third Mellin moments ⟨𝑥 2 ⟩ of nucleon unpolarized, polarized, and transversity parton distribution functions. Two lattice QCD ensembles at the physical pion mass are used, which were generated using a tree-level Symanzik-improved gauge action and 2+1 flavor tree-level improved Wilson Clover fermions coupling via 2-level HEX-smearing. Leveraging a wide set of operators, two extraction methods for the matrix elements, and the automatic inclusion of model uncertainties via bootstrapped model averages, we extract values of the third Mellin moments. Furthermore, this is the first direct calculation of these observables performed at the physical pion mass.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Visual HPC Workflows for the Analysis of System Dynamics Models

Visual analytics supported by high performance computing (HPC) accelerates and enhances the discovery, exploration, and analysis of causal patterns in complex system dynamics (SD) models. We present a suite of visualization-assisted ensemble-based techniques for hypothesis generation and testing, and for sensitivity analysis. By employing HPC to provide parallel, on-demand simulation of SD models, one can “steer” an ensemble of simulated scenarios in real time as one first formulates and then informally tests those hypotheses: this provides rapid feedback for analysts to refine their understanding of the causal relationships emergent from a model. Such understandings can be followed and augmented by rigorous application of statistical methods, namely global variance-based sensitivity analysis, Monte-Carlo filtering, adaptive regional sensitivity analysis, and self-organized maps: here timely computation relies on HPC, while effective presentation emphasizes high-dimensional multivariate data visualization. Immersive visualization in virtual 3D environments provides an excellent adjunct to the traditional 2D graphics typically used for SD models, as it generates an embodied understanding of model behavior and facilitates an active, collaborative critique of model structure and output. Finally, we summarize prospects for HPC-enabled visual analytics applied to SD modeling.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2020

Realizable hyperuniform and nonhyperuniform particle configurations with targeted spectral functions via effective pair interactions

The capacity to identify realizable many-body configurations associated with targeted functional forms for the pair correlation function $g_2(r)$ or its corresponding structure factor $\textit{S(k)}$ is of great fundamental and practical importance. While there are obvious necessary conditions that a prescribed structure factor at number density ρ must satisfy to be configurationally realizable, sufficient conditions are generally not known due to the infinite degeneracy of configurations with different higher-order correlation functions. A major aim of this paper is to expand our theoretical knowledge of the class of pair correlation functions or structure factors that are realizable by classical disordered ensembles of particle configurations, including exotic “hyperuniform” varieties. We first introduce a theoretical formalism that provides a means to draw classical particle configurations from canonical ensembles with certain pairwise-additive potentials that could correspond to targeted analytical functional forms for the structure factor. This formulation enables us to devise an improved algorithm to construct systematically canonical-ensemble particle configurations with such targeted pair statistics, whenever realizable. As a proof of concept, we test the algorithm by targeting several different structure factors across dimensions that are known to be realizable and one hyperuniform target that is known to be nontrivially unrealizable. Our algorithm succeeds for all realizable targets and appropriately fails for the unrealizable target, demonstrating the accuracy and power of the method to numerically investigate the realizability problem. Subsequently, we also target several families of structure-factor functions that meet the known necessary realizability conditions but are not known to be realizable by disordered hyperuniform point configurations, including $\textit{d}$-dimensional Gaussian structure factors, $\textit{d}$-dimensional generalizations of the two-dimensional one-component plasma (OCP), and the $\textit{d}$-dimensional Fourier duals of the previous OCP cases. Moreover, we also explore unusual nonhyperuniform targets, including “hyposurficial” and “antihyperuniform” examples. In all of these instances, the targeted structure factors are achieved with high accuracy, suggesting that they are indeed realizable by equilibrium configurations with pairwise interactions at positive temperatures. Remarkably, we also show that the structure factor of nonequilibrium perfect glass, specified by two-, three-, and four-body interactions, can also be realized by equilibrium pair interactions at positive temperatures. In this work, our findings lead us to the conjecture that any realizable structure factor corresponding to either a translationally invariant equilibrium or nonequilibrium system can be attained by an equilibrium ensemble involving only effective pair interactions. Our investigation not only broadens our knowledge of analytical functional forms for $g_2(r)$ and $\textit{S(k)}$ associated with disordered point configurations across dimensions but also deepens our understanding of many-body physics. Moreover, our work can be applied to the design of materials with desirable physical properties that can be tuned by their pair statistics.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2026

Optical stochastic cooling at Fermilab’s IOTA ring

Stochastic cooling (SC) constitutes one of the greatest conceptual and technological achievements in particle beam cooling. Numerous SC systems have been built in the microwave regime and used to extend the science reach of accelerator facilities worldwide. The ability to sense and correct the particle ensemble using high-bandwidth feedback systems is at the core of the concept. Here, we describe the first realization of SC at optical frequencies and bandwidths. The demonstration was recently carried out at Fermilab’s integrable optics test accelerator (IOTA) storage ring using the transit-time method of optical stochastic cooling (OSC) and achieved an integrated system bandwidth of approximately 20 THz, which is more than 2000 times that of conventional SC systems. This demonstration establishes the foundation for more advanced OSC experiments with high-gain amplification, currently underway at Fermilab, and the eventual application of OSC to colliders and other accelerator facilities.

Jarvis, Jonathan D. [Fermilab]↗
DOE OSTI2023

Review of machine learning and deep learning models for toxicity prediction

The ever-increasing number of chemicals has raised public concerns due to their adverse effects on human health and the environment. To protect public health and the environment, it is critical to assess the toxicity of these chemicals. Traditional in vitro and in vivo toxicity assays are complicated, costly, and time-consuming and may face ethical issues. These constraints raise the need for alternative methods for assessing the toxicity of chemicals. Recently, due to the advancement of machine learning algorithms and the increase in computational power, many toxicity prediction models have been developed using various machine learning and deep learning algorithms such as support vector machine, random forest, k-nearest neighbors, ensemble learning, and deep neural network. This review summarizes the machine learning- and deep learning-based toxicity prediction models developed in recent years. Support vector machine and random forest are the most popular machine learning algorithms, and hepatotoxicity, cardiotoxicity, and carcinogenicity are the frequently modeled toxicity endpoints in predictive toxicology. It is known that datasets impact model performance. The quality of datasets used in the development of toxicity prediction models using machine learning and deep learning is vital to the performance of the developed models. The different toxicity assignments for the same chemicals among different datasets of the same type of toxicity have been observed, indicating benchmarking datasets is needed for developing reliable toxicity prediction models using machine learning and deep learning algorithms. This review provides insights into current machine learning models in predictive toxicology, which are expected to promote the development and application of toxicity prediction models in the future.

Research & Experimental Medicine↗
DOE OSTI2025

Event Classifications on DNE2 Main Experiment Data using a Convolutional Neural Network Ensemble

The Dynamic Networks (DN) Experiment for FY24 (DNE2) is an experiment within DN with the goal of quantitatively evaluating the effectiveness of solutions developed so far by various researchers under the Low Yield Nuclear Monitoring (LYNM) program using a shared set of metrics and datasets. A key component of this experiment is the mimicking of a signature processing pipeline, and comparing currently accepted and standard-use processing methods to more state-of-the-art processes developed under DN. In this work, we focus specifically on the Event Characterization (EC) Focus Area (FA) of the pipeline, where a seismic event’s magnitude, yield and class are identified. We use Deep Learning (DL) to classify the type of events being processed as either earthquakes (EQs) or explosions (EXs) for three iterations of experiment datasets. The model is noticeably more confident and accurate in classifying explosions than earthquakes, reflecting a known shortcoming of the model, that being of a bias towards predicting explosions over earthquakes in the west coast due to training data biases.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Automatisierte Generierung von Mikrokinetiken für heterogen katalysierte Reaktionen unter Berücksichtigung korrelierter Unsicherheiten**

Abstract Die Studie stellt eine ab initio basierte Methode für die automatische Konstruktion von detaillierten Mikrokinetiken vor, welche korrelierte Unsicherheiten in allen energetischen Parametern und Schätzroutinen berücksichtigt. Hierfür wurden innerhalb des Unsicherheitsraums des BEEF‐vdW Funktionals 2000 Mikrokinetiken für die Oxidationsreaktionen repräsentativer Abgasemissionen von stöchiometrischen Verbrennungsmotoren auf Pt(111) generiert und durch Multiskalenmodellierung mit Experimenten verglichen. Das Ensemble der Simulationsergebnisse unterstreicht die Bedeutung der Berücksichtigung von Unsicherheiten. Innerhalb dieses Ensembles ist es möglich, eine Mikrokinetik zu identifizieren, welche mit den experimentellen Daten übereinstimmt. Diese Mikrokinetik lässt sich auf ein einziges Austausch‐Korrelations‐Funktional zurückführen und legt nahe, dass Pt(111) das aktive Zentrum für die Oxidation leichter Kohlenwasserstoffe sein könnte. Die Studie bietet einen universellen Rahmen für die automatisierte Konstruktion von Reaktionsmechanismen unter Berücksichtigung korrelierter Unsicherheiten und ermöglicht eine DFT‐basierte Optimierung der Mikrokinetik auch für andere heterogen katalysierte Systeme.

Kreitz, Bjarne↗
DOE OSTI2022

Adaptive experimental design for multi-fidelity surrogate modeling of multi-disciplinary systems

We present an adaptive algorithm for constructing surrogate models of multi-disciplinary systems composed of a set of coupled components. With this goal we introduce “coupling” variables with a priori unknown distributions that allow surrogates of each component to be built independently. Once built, the surrogates of the components are combined to form an integrated-surrogate that can be used to predict system-level quantities of interest at a fraction of the cost of the original model. The error in the integrated-surrogate is greedily minimized using an experimental design procedure that allocates the amount of training data, used to construct each component-surrogate, based on the contribution of those surrogates to the error of the integrated-surrogate. Here, the multi-fidelity procedure presented is a generalization of multi-index stochastic collocation that can leverage ensembles of models of varying cost and accuracy, for one or more components, to reduce the computational cost of constructing the integrated-surrogate. Extensive numerical results demonstrate that, for a fixed computational budget, our algorithm is able to produce surrogates that are orders of magnitude more accurate than methods that treat the integrated system as a black-box.

42 ENGINEERING↗
DOE OSTI2022

Increases in Future AR Count and Size: Overview of the ARTMIP Tier 2 CMIP5/6 Experiment

Abstract The Atmospheric River (AR) Tracking Method Intercomparison Project (ARTMIP) is a community effort to systematically assess how the uncertainties from AR detectors (ARDTs) impact our scientific understanding of ARs. This study describes the ARTMIP Tier 2 experimental design and initial results using the Coupled Model Intercomparison Project (CMIP) Phases 5 and 6 multi‐model ensembles. We show that AR statistics from a given ARDT in CMIP5/6 historical simulations compare remarkably well with the MERRA‐2 reanalysis. In CMIP5/6 future simulations, most ARDTs project a global increase in AR frequency, counts, and sizes, especially along the western coastlines of the Pacific and Atlantic oceans. We find that the choice of ARDT is the dominant contributor to the uncertainty in projected AR frequency when compared with model choice. These results imply that new projects investigating future changes in ARs should explicitly consider ARDT uncertainty as a core part of the experimental design.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

A Large Ensemble Global Dataset for Climate Impact Assessments

We present a self-consistent, large ensemble, high-resolution global dataset of long-term future climate, which accounts for the uncertainty in climate system response to anthropogenic emissions of greenhouse gases and in geographical patterns of climate change. The dataset is developed by applying an integrated spatial disaggregation (SD) - bias-correction (BC) method to climate projections from the MIT Integrated Global System Model (IGSM). Four emission scenarios are considered that represent energy and environmental policies and commitments of potential future pathways, namely, Reference, Paris Forever, Paris 2 °C and Paris 1.5 °C. The dataset contains nine key meteorological variables on a monthly scale from 2021 to 2100 at a spatial resolution of 0.5°x 0.5°, including precipitation, air temperature (mean, minimum and maximum), near-surface wind speed, shortwave and longwave radiation, specific humidity, and relative humidity. We demonstrate the dataset’s ability to represent climate-change responses across various regions of the globe. This dataset can be used to support regional-scale climate-related impact assessments of risk across different applications that include hydropower, water resources, ecosystem, agriculture, and sustainable development.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Learning from many collider events at once

There have been a number of recent proposals to enhance the performance of machine learning strategies for collider physics by combining many distinct events into a single ensemble feature. To evaluate the efficacy of these proposals, we study the connection between single-event classifiers and multievent classifiers under the assumption that collider events are independent and identically distributed. We show how one can build optimal multievent classifiers from single-event classifiers, and we also show how to construct multievent classifiers such that they produce optimal single-event classifiers. This is illustrated for a Gaussian example as well as for classification tasks relevant for searches and measurements at the Large Hadron Collider. We extend our discussion to regression tasks by showing how they can be phrased in terms of parametrized classifiers. Empirically, we find that training a single-event (per-instance) classifier is more effective than training a multievent (per-ensemble) classifier, as least for the cases we studied, and we relate this fact to properties of the loss function gradient in the two cases. While we did not identify a clear benefit from using multievent classifiers in the collider context, we speculate on the potential value of these methods in cases involving only approximate independence, as relevant for jet substructure studies.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

CoSim: A Simulator for Co-Scheduling of Batch and On-Demand Jobs in HPC Datacenters

The increasing scale and complexity of scientific applications are rapidly transforming the ecosystem of tools, methods, and workflows adopted by the high-performance computing (HPC) community. Big data analytics and deep learning are gaining traction as essential components in this ecosystem in a variety of scenarios, such as, steering of experimental instruments , acceleration of high-fidelity simulations through surrogate computations, and guided ensemble searches. In this context, the batch job model traditionally adopted by the supercomputing in-frastructures needs to be complemented with support to schedule opportunistic on-demand analytics jobs, leading to the problem of efficient preemption of batch jobs with minimum loss of progress. In this paper, we design and implement a simulator, CoSim, that enables on-the-fly analysis of the trade-offs arising between delaying the start of opportunistic on-demand jobs, which leads to longer analytics latency, and loss of progress due to preemption of batch jobs, which is necessary to make room for on-demand jobs. To this end, we propose an algorithm based on dynamic programming with predictable performance and scalability that enables supercomputing infrastructure schedulers to analyze the aforementioned trade-off and take decisions in near real-time. Compared with other state-of-art approaches using traces of the Theta pre-Exascale machine, our approach is capable of finding the optimal solution, while achieving high performance and scalability.

batch job preemption↗
DOE OSTI2024

Bespoke Liquid/Liquid Interfaces (Final Technical Report)

The goal of DE-SC0001815 was to advance the basic science of liquid:liquid interface formation, to develop a deeper understanding of the mechanisms of phase separation and the essential relationships between solution composition, organization and dynamics that underlie the kinetic regime of solvent extraction. This included learning how interfacial organization and dynamics alters the properties of the primary coordination sphere of ions and the free energy of transport of ions complexes across a phase boundary. We relied primarily upon classical molecular dynamics studies to determine the equilibrium ensembles of these complex systems, but also utilized ab-initio MD and cluster-based density functional theory (DFT) calculations when more detailed investigation of the electronic structure was needed. We continued development of graph-theory based analyses to elucidate hierarchical correlations and expanded into geometric topology methods to quantify the collectively organized structures that can organize at a liquid/liquid interface during solute transport. One of the main conclusions was from the observation of two distinct mechanisms for solute transport - those that derive from amplifications of interfacial heterogeneity and surface roughness, and those wherein surface roughness has been dampened and instead collectively organized macrostructures work to bring solutes into the organic phase. It was our aim to create a concrete chemical model of the underlying driving forces behind interfacial primary and secondary structure formation and to map out the energetic features of solute transport so that tailored liquid/liquid can be developed that have characteristic kinetic features associated with mass transport.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

A Bayesian approach to strong lens finding in the era of wide-area surveys

ABSTRACT The arrival of the Vera C. Rubin Observatory’s Legacy Survey of Space and Time (LSST), Euclid-Wide and Roman wide-area sensitive surveys will herald a new era in strong lens science in which the number of strong lenses known is expected to rise from $\mathcal {O}(10^3)$ to $\mathcal {O}(10^5)$. However, current lens-finding methods still require time-consuming follow-up visual inspection by strong lens experts to remove false positives which is only set to increase with these surveys. In this work, we demonstrate a range of methods to produce calibrated probabilities to help determine the veracity of any given lens candidate. To do this we use the classifications from citizen science and multiple neural networks for galaxies selected from the Hyper Suprime-Cam survey. Our methodology is not restricted to particular classifier types and could be applied to any strong lens classifier which produces quantitative scores. Using these calibrated probabilities, we generate an ensemble classifier, combining citizen science, and neural network lens finders. We find such an ensemble can provide improved classification over the individual classifiers. We find a false-positive rate of 10−3 can be achieved with a completeness of 46 per cent, compared to 34 per cent for the best individual classifier. Given the large number of galaxy–galaxy strong lenses anticipated in LSST, such improvement would still produce significant numbers of false positives, in which case using calibrated probabilities will be essential for population analysis of large populations of lenses and to help prioritize candidates for follow-up.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Interpreting the Operando XANES of Surface-Supported Subnanometer Clusters: When Fluxionality, Oxidation State, and Size Effect Fight.

X-ray absorption near edge structure (XANES) spectroscopy is widely used for operando catalyst characterization. We show that, for highly fluxional supported nanoclusters, the customary extraction of the oxidation state of the metal from the XANES data by fitting to the bulk standards is highly questionable. The XANES signatures as well as the apparent oxidation state for such clusters arise from a complex combination of many factors, and not only from the chemical composition in reaction conditions (e.g., oxygen content in oxidizing atmosphere). The thermally accessible isomerization and population of several structurally distinct cluster forms, cluster-support interaction, and intrinsic size effects all impact the metal oxidation state and XANES signal. We demonstrate this on copper oxide clusters with different compositions, Cu4Ox(x = 2-5) and Cu5Oy (y = 3, 5), deposited on amorphous alumina and ultrananocrystalline diamond, for which we computed the XANES spectra and compare the results to the experiment. We show in addition that fitting the experimental spectrum to calculated spectra of supported clusters can, in contrast, provide good agreement and insight into the spectrum-composition-structure relation. Experimental XANES interpreted using the proposed fitting scheme shows the partial reduction of Cu oxide clusters at rising temperatures, and pinpoints the specific stoichiometries that dominate in the ensemble of cluster states as the temperature changes.

Zandkarimi, Borna↗
DOE OSTI2023

A Novel Partitioned Approach for Reduced Order Model—Finite Element Model (ROM-FEM) and ROM-ROM Coupling

Partitioned methods allow one to build a simulation capability for coupled problems by reusing existing single-component codes. In so doing, partitioned methods can shorten code development and validation times for multiphysics and multiscale applications. In this work, we consider a scenario in which one or more of the “codes” being coupled are projection-based reduced order models (ROMs), introduced to lower the computational cost associated with a particular component. We simulate this scenario by considering a model interface problem that is discretized independently on two non-overlapping subdomains. Here we then formulate a partitioned scheme for this problem that allows the coupling between a ROM “code” for one of the subdomains with a finite element model (FEM) or ROM “code” for the other subdomain. The ROM “codes” are constructed by performing proper orthogonal decomposition (POD) on a snapshot ensemble to obtain a low-dimensional reduced order basis, followed by a Galerkin projection onto this basis. The ROM and/or FEM “codes” on each subdomain are then coupled using a Lagrange multiplier representing the interface flux. To partition the resulting monolithic problem, we first eliminate the flux through a dual Schur complement. Application of an explicit time integration scheme to the transformed monolithic problem decouples the subdomain equations, allowing their independent solution for the next time step. We show numerical results that demonstrate the proposed method’s efficacy in achieving both ROM-FEM and ROM-ROM coupling.

de Castro, Amy↗
DOE OSTI2021

Modeling Liquid Water by Climbing up Jacob’s Ladder in Density Functional Theory Facilitated by Using Deep Neural Network Potentials

Within the framework of Kohn–Sham density functional theory (DFT), the ability to provide good predictions of water properties by employing a strongly constrained and appropriately normed (SCAN) functional has been extensively demonstrated in recent years. Here, we further advance the modeling of water by building a more accurate model on the fourth rung of Jacob’s ladder with the hybrid functional, SCAN0. In particular, we carry out both classical and Feynman path-integral molecular dynamics calculations of water with the SCAN0 functional and the isobaric–isothermal ensemble. To generate the equilibrated structure of water, a deep neural network potential is trained from the atomic potential energy surface based on ab initio data obtained from SCAN0 DFT calculations. For the electronic properties of water, a separate deep neural network potential is trained by using the Deep Wannier method based on the maximally localized Wannier functions of the equilibrated trajectory at the SCAN0 level. The structural, dynamic, and electric properties of water were analyzed. The hydrogen-bond structures, density, infrared spectra, diffusion coefficients, and dielectric constants of water, in the electronic ground state, are computed by using a large simulation box and long simulation time. For the properties involving electronic excitations, we apply the GW approximation within many-body perturbation theory to calculate the quasiparticle density of states and bandgap of water. Compared to the SCAN functional, mixing exact exchange mitigates the self-interaction error in the meta-generalized-gradient approximation and further softens liquid water toward the experimental direction. For most of the water properties, the SCAN0 functional shows a systematic improvement over the SCAN functional. However, some important discrepancies remain. The H-bond network predicted by the SCAN0 functional is still slightly overstructured compared to the experimental results.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗