Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ensemble methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Primordial non-Gaussianity with angular correlation function: integral constraint and validation for DES

ABSTRACT Local primordial non-Gaussianity (PNG) is a promising observable of the underlying physics of inflation, characterized by $f_{\rm NL}^{\rm loc}$. We present the methodology to measure $f_{\rm NL}^{\rm loc}$ from the Dark Energy Survey (DES) data using the two-point angular correlation function (ACF) with scale-dependent bias. One of the focuses of the work is the integral constraint (IC). This condition appears when estimating the mean number density of galaxies from the data and is key in obtaining unbiased $f_{\rm NL}^{\rm loc}$ constraints. The methods are analysed for two types of simulations: ∼246 goliat-png N-body small area simulations with fNL equal to −100 and 100, and 1952 Gaussian ice-cola mocks with fNL = 0 that follow the DES angular and redshift distribution. We use the ensemble of goliat-png mocks to show the importance of the IC when measuring PNG, where we recover the fiducial values of fNL within the 1σ when including the IC. In contrast, we found a bias of ΔfNL ∼ 100 when not including it. For a DES-like scenario, we forecast a bias of ΔfNL ∼ 23, equivalent to 1.8σ, when not using the IC for a fiducial value of fNL = 100. We use the ice-cola mocks to validate our analysis in a realistic DES-like set-up finding it robust to different analysis choices: best-fitting estimator, the effect of IC, BAO damping, covariance, and scale choices. We forecast a measurement of fNL within σ(fNL) = 31 when using the DES-Y3 BAO sample, with the ACF in the 1 deg < θ < 20 deg range.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Toward a resolution of the NN controversy

Lattice QCD calculations of two-nucleon interactions have been underway for about a decade, but still haven't reached the pion mass regime necessary for matching onto effective field theories and extrapolating to the physical point. Furthermore, results from different methods, including the use of the Lüscher formalism with different types of operators, as well as the HALQCD potential method, do not agree even qualitatively at very heavy pion mass. We investigate the role that different operators employed in the literature may play on the extraction of spectra for use within the Lüscher method. We first explore expectations from Effective Field Theory solved within a finite volume, for which the exact spectrum may be computed given different physical scenarios. We then present preliminary lattice QCD results for two-nucleon spectra calculated using different operators on a common lattice ensemble.

Nicholson, A↗
DOE OSTI2024

Diurnal evolution of non-precipitating marine stratocumuli in a large-eddy simulation ensemble

Abstract. We explore the cloud system evolution of non-precipitating marine stratocumuli with a focus on the impacts of the diurnal cycle and free-tropospheric (FT) humidity based on an ensemble of 244 large-eddy simulations generated by perturbing initial thermodynamic profiles and aerosol conditions. Cases are categorized based on their degree of decoupling and the cloud liquid water path (LWPc, based on model columns with cloud optical depths greater than one). A budget analysis method is proposed to analyze the evolution of cloud water in both coupled and decoupled boundary layers. More coupled clouds start with a relatively low LWPc and cloud fraction (fc) but experience the least decrease in LWPc and fc during the daytime. More decoupled clouds undergo greater daytime reduction in LWPc and fc, especially those with higher LWPc at sunrise because they suffer from faster weakening of net radiative cooling. During the nighttime, a positive correlation between FT humidity and the LWPc emerges, consistent with higher FT humidity reducing both radiative cooling and the humidity jump, both of which reduce entrainment and increase LWPc. The LWPc is more likely to decrease during the nighttime for a larger LWPc and greater inversion base height (zi), conditions under which entrainment dominates as turbulence develops. In the morning, the rate of the LWPc reduction depends on the LWPc at sunrise, zi, and the degree of decoupling, with distinct contributions from subsidence and radiation.

Chen, Yao-Sheng (ORCID:0000000208354132)↗
DOE OSTI2023

Scalable Bayesian optimization with randomized prior networks

Several fundamental problems in science and engineering consist of global optimization tasks involving unknown high-dimensional (black-box) functions that map a set of controllable variables to the outcomes of an expensive experiment. Bayesian Optimization (BO) techniques are known to be effective in tackling global optimization problems using a relatively small number objective function evaluations, but their performance suffers when dealing with high-dimensional outputs. To overcome the major challenge of dimensionality, here we propose a deep learning framework for BO and sequential decision making based on bootstrapped ensembles of neural architectures with randomized priors. Using appropriate architecture choices, we show that the proposed framework can approximate functional relationships between design variables and quantities of interest, even in cases where the latter take values in high-dimensional vector spaces or even infinite-dimensional function spaces. In the context of BO, we augmented the proposed probabilistic surrogates with re-parameterized Monte Carlo approximations of multiple-point (parallel) acquisition functions, as well as methodological extensions for accommodating black-box constraints and multi-fidelity information sources. We test the proposed framework against state-of-the-art methods for BO and demonstrate superior performance across several challenging tasks with high-dimensional outputs, including a constrained multi-fidelity optimization task involving shape optimization of rotor blades in turbo-machinery.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1989

Determination of longitudinal aerodynamic derivatives using flight data from an icing research aircraft

A flight test was performed with the NASA Lewis Research Center's DH-6 icing research aircraft. The purpose was to employ a flight test procedure and data analysis method, to determine the accuracy with which the effects of ice on aircraft stability and control could be measured. For simplicity, flight testing was restricted to the short period longitudinal mode. Two flights were flown in a clean (baseline) configuration, and two flights were flown with simulated horizontal tail ice. Forty-five repeat doublet maneuvers were performed in each of four test configurations, at a given trim speed, to determine the ensemble variation of the estimated stability and control derivatives. Additional maneuvers were also performed in each configuration, to determine the variation in the longitudinal derivative estimates over a wide range of trim speeds. Stability and control derivatives were estimated by a Modified Stepwise Regression (MSR) technique. A measure of the confidence in the derivative estimates was obtained by comparing the standard error for the ensemble of repeat maneuvers, to the average of the estimated standard errors predicted by the MSR program. A multiplicative relationship was determined between the ensemble standard error, and the averaged program standard errors. In addition, a 95 percent confidence interval analysis was performed for the elevator effectiveness estimates, C sub m sub delta e. This analysis identified the speed range where changes in C sub m sub delta e could be attributed to icing effects. The magnitude of icing effects on the derivative estimates were strongly dependent on flight speed and aircraft wing flap configuration. With wing flaps up, the estimated derivatives were degraded most at lower speeds corresponding to that configuration. With wing flaps extended to 10 degrees, the estimated derivatives were degraded most at the higher corresponding speeds. The effects of icing on the changes in longitudinal stability and control derivatives were adequately determined by the flight test procedure and the MSR analysis method discussed herein.

Ranaudo, R. J.↗
DOE OSTI2026

Third moments of nucleon unpolarized, polarized, and transversity parton distribution functions from physical-point lattice QCD

Using forward matrix elements of local leading-twist operators, we present a determination of the isovector third Mellin moments ⟨𝑥 2 ⟩ of nucleon unpolarized, polarized, and transversity parton distribution functions. Two lattice QCD ensembles at the physical pion mass are used, which were generated using a tree-level Symanzik-improved gauge action and 2+1 flavor tree-level improved Wilson Clover fermions coupling via 2-level HEX-smearing. Leveraging a wide set of operators, two extraction methods for the matrix elements, and the automatic inclusion of model uncertainties via bootstrapped model averages, we extract values of the third Mellin moments. Furthermore, this is the first direct calculation of these observables performed at the physical pion mass.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS1981

Application of Monte Carlo techniques to transient thermal modeling of cavity radiometers having diffuse-specular surfaces

A viable alternative to the net exchange method of radiative analysis which is equally applicable to diffuse and diffuse-specular enclosures is presented. It is particularly more advantageous to use than the net exchange method in the case of a transient thermal analysis involving conduction and storage of energy as well as radiative exchange. A new quantity, called the distribution factor is defined which replaces the angle factor and the configuration factor. Once obtained, the array of distribution factors for an ensemble of surface elements which define an enclosure permits the instantaneous net radiative heat fluxes to all of the surfaces to be computed directly in terms of the known surface temperatures at that instant. The formulation of the thermal model is described, as is the determination of distribution factors by application of a Monte Carlo analysis. The results show that when fewer than 10,000 packets are emitted, an unsatisfactory approximation for the distribution factors is obtained, but that 10,000 packets is sufficient.

Mahan, J. R.↗
NASA NTRS2012

A Reconciled Estimate of Ice-Sheet Mass Balance

We combined an ensemble of satellite altimetry, interferometry, and gravimetry data sets using common geographical regions, time intervals, and models of surface mass balance and glacial isostatic adjustment to estimate the mass balance of Earth's polar ice sheets. We find that there is good agreement between different satellite methods-especially in Greenland and West Antarctica-and that combining satellite data sets leads to greater certainty. Between 1992 and 2011, the ice sheets of Greenland, East Antarctica, West Antarctica, and the Antarctic Peninsula changed in mass by -142 plus or minus 49, +14 plus or minus 43, -65 plus or minus 26, and -20 plus or minus 14 gigatonnes year(sup −1), respectively. Since 1992, the polar ice sheets have contributed, on average, 0.59 plus or minus 0.20 millimeter year(sup −1) to the rate of global sea-level rise.

mass balance↗
DOE OSTI2021

Visual HPC Workflows for the Analysis of System Dynamics Models

Visual analytics supported by high performance computing (HPC) accelerates and enhances the discovery, exploration, and analysis of causal patterns in complex system dynamics (SD) models. We present a suite of visualization-assisted ensemble-based techniques for hypothesis generation and testing, and for sensitivity analysis. By employing HPC to provide parallel, on-demand simulation of SD models, one can “steer” an ensemble of simulated scenarios in real time as one first formulates and then informally tests those hypotheses: this provides rapid feedback for analysts to refine their understanding of the causal relationships emergent from a model. Such understandings can be followed and augmented by rigorous application of statistical methods, namely global variance-based sensitivity analysis, Monte-Carlo filtering, adaptive regional sensitivity analysis, and self-organized maps: here timely computation relies on HPC, while effective presentation emphasizes high-dimensional multivariate data visualization. Immersive visualization in virtual 3D environments provides an excellent adjunct to the traditional 2D graphics typically used for SD models, as it generates an embodied understanding of model behavior and facilitates an active, collaborative critique of model structure and output. Finally, we summarize prospects for HPC-enabled visual analytics applied to SD modeling.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2020

Realizable hyperuniform and nonhyperuniform particle configurations with targeted spectral functions via effective pair interactions

The capacity to identify realizable many-body configurations associated with targeted functional forms for the pair correlation function $g_2(r)$ or its corresponding structure factor $\textit{S(k)}$ is of great fundamental and practical importance. While there are obvious necessary conditions that a prescribed structure factor at number density ρ must satisfy to be configurationally realizable, sufficient conditions are generally not known due to the infinite degeneracy of configurations with different higher-order correlation functions. A major aim of this paper is to expand our theoretical knowledge of the class of pair correlation functions or structure factors that are realizable by classical disordered ensembles of particle configurations, including exotic “hyperuniform” varieties. We first introduce a theoretical formalism that provides a means to draw classical particle configurations from canonical ensembles with certain pairwise-additive potentials that could correspond to targeted analytical functional forms for the structure factor. This formulation enables us to devise an improved algorithm to construct systematically canonical-ensemble particle configurations with such targeted pair statistics, whenever realizable. As a proof of concept, we test the algorithm by targeting several different structure factors across dimensions that are known to be realizable and one hyperuniform target that is known to be nontrivially unrealizable. Our algorithm succeeds for all realizable targets and appropriately fails for the unrealizable target, demonstrating the accuracy and power of the method to numerically investigate the realizability problem. Subsequently, we also target several families of structure-factor functions that meet the known necessary realizability conditions but are not known to be realizable by disordered hyperuniform point configurations, including $\textit{d}$-dimensional Gaussian structure factors, $\textit{d}$-dimensional generalizations of the two-dimensional one-component plasma (OCP), and the $\textit{d}$-dimensional Fourier duals of the previous OCP cases. Moreover, we also explore unusual nonhyperuniform targets, including “hyposurficial” and “antihyperuniform” examples. In all of these instances, the targeted structure factors are achieved with high accuracy, suggesting that they are indeed realizable by equilibrium configurations with pairwise interactions at positive temperatures. Remarkably, we also show that the structure factor of nonequilibrium perfect glass, specified by two-, three-, and four-body interactions, can also be realized by equilibrium pair interactions at positive temperatures. In this work, our findings lead us to the conjecture that any realizable structure factor corresponding to either a translationally invariant equilibrium or nonequilibrium system can be attained by an equilibrium ensemble involving only effective pair interactions. Our investigation not only broadens our knowledge of analytical functional forms for $g_2(r)$ and $\textit{S(k)}$ associated with disordered point configurations across dimensions but also deepens our understanding of many-body physics. Moreover, our work can be applied to the design of materials with desirable physical properties that can be tuned by their pair statistics.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2026

Optical stochastic cooling at Fermilab’s IOTA ring

Stochastic cooling (SC) constitutes one of the greatest conceptual and technological achievements in particle beam cooling. Numerous SC systems have been built in the microwave regime and used to extend the science reach of accelerator facilities worldwide. The ability to sense and correct the particle ensemble using high-bandwidth feedback systems is at the core of the concept. Here, we describe the first realization of SC at optical frequencies and bandwidths. The demonstration was recently carried out at Fermilab’s integrable optics test accelerator (IOTA) storage ring using the transit-time method of optical stochastic cooling (OSC) and achieved an integrated system bandwidth of approximately 20 THz, which is more than 2000 times that of conventional SC systems. This demonstration establishes the foundation for more advanced OSC experiments with high-gain amplification, currently underway at Fermilab, and the eventual application of OSC to colliders and other accelerator facilities.

Jarvis, Jonathan D. [Fermilab]↗
DOE OSTI2023

Review of machine learning and deep learning models for toxicity prediction

The ever-increasing number of chemicals has raised public concerns due to their adverse effects on human health and the environment. To protect public health and the environment, it is critical to assess the toxicity of these chemicals. Traditional in vitro and in vivo toxicity assays are complicated, costly, and time-consuming and may face ethical issues. These constraints raise the need for alternative methods for assessing the toxicity of chemicals. Recently, due to the advancement of machine learning algorithms and the increase in computational power, many toxicity prediction models have been developed using various machine learning and deep learning algorithms such as support vector machine, random forest, k-nearest neighbors, ensemble learning, and deep neural network. This review summarizes the machine learning- and deep learning-based toxicity prediction models developed in recent years. Support vector machine and random forest are the most popular machine learning algorithms, and hepatotoxicity, cardiotoxicity, and carcinogenicity are the frequently modeled toxicity endpoints in predictive toxicology. It is known that datasets impact model performance. The quality of datasets used in the development of toxicity prediction models using machine learning and deep learning is vital to the performance of the developed models. The different toxicity assignments for the same chemicals among different datasets of the same type of toxicity have been observed, indicating benchmarking datasets is needed for developing reliable toxicity prediction models using machine learning and deep learning algorithms. This review provides insights into current machine learning models in predictive toxicology, which are expected to promote the development and application of toxicity prediction models in the future.

Research & Experimental Medicine↗
NASA NTRS1992

Direct simulation of particle dispersion in a decaying isotropic turbulence

Results of a numerical investigation of the dispersion of solid particles in decaying isotropic turbulence are presented. The 3D time-dependent velocity field of a homogeneous nonstationary turbulence is computed using the method of direct numerical simulation (DNS). The dispersion characteristics of three different solid particles (corn, copper, and glass) injected in the flow are obtained by integrating the complete equation of particle motion along the instantaneous trajectories of 22-cubed particles for each particle type, and then by performing ensemble averaging. Good agreement was achieved between the present DNS results and the measured time development of the mean-square displacement of the particles. Questions of how and why the dispersion statistics of a solid particle differ from those of its corresponding fluid point and surrounding fluid and what influences inertia and gravity have on these statistics are also discussed.

Elghobashi, S.↗
NASA NTRSDate not supplied

Using Federated Learning to Overcome Data Gravity in Space

Humans intend to take longer missions to outer space. Understanding the impact that space has on human health is paramount to the success of these missions. Controlled experiments with model organisms are run to infer the impact of space conditions on human health, but the data these experiments generate are too large to transfer to Earth for building models. The same is true for space-relevant data generated on Earth. Ideally, these datasets should be combined to improve statistical power and model accuracy without having to transfer data. Federated learning is such a method which trains an algorithm across decentralized computing systems, each of which has their own local copy of training and testing data. In this research, made possible by NASA@Work, the AI for Life in Space group at NASA demonstrates the use of federated learning to train an ensemble of causality inference models on a combination of data residing on the International Space Station (ISS) and in the cloud. Our work leverages CRISP, a causal inference platform developed during the 2020 Frontier Development Lab’s “Astronaut Health Challenge.” We also leverage the OpenFL federated learning library which was collaboratively developed at Intel and UPenn. We used publicly available data from the NASA Ames Life Sciences Data Archive to identify features in ionizing radiation experiments as causal of changes in cardiac blood velocity. This research demonstrates, for the first time, the possibility of running machine learning algorithms on datasets separated by astronomical distances. In this experiment, all the data were generated in terra, half of which were transferred to the ISS and analyzed on the Spaceborne Computer. In the future, our research will leverage federated learning on data generated in situ on the ISS with data generated terrestrially to predict the impact of spaceflight on mammalian female reproductive capacity.

James Casaletto↗
DOE OSTI2025

Event Classifications on DNE2 Main Experiment Data using a Convolutional Neural Network Ensemble

The Dynamic Networks (DN) Experiment for FY24 (DNE2) is an experiment within DN with the goal of quantitatively evaluating the effectiveness of solutions developed so far by various researchers under the Low Yield Nuclear Monitoring (LYNM) program using a shared set of metrics and datasets. A key component of this experiment is the mimicking of a signature processing pipeline, and comparing currently accepted and standard-use processing methods to more state-of-the-art processes developed under DN. In this work, we focus specifically on the Event Characterization (EC) Focus Area (FA) of the pipeline, where a seismic event’s magnitude, yield and class are identified. We use Deep Learning (DL) to classify the type of events being processed as either earthquakes (EQs) or explosions (EXs) for three iterations of experiment datasets. The model is noticeably more confident and accurate in classifying explosions than earthquakes, reflecting a known shortcoming of the model, that being of a bias towards predicting explosions over earthquakes in the west coast due to training data biases.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Automatisierte Generierung von Mikrokinetiken für heterogen katalysierte Reaktionen unter Berücksichtigung korrelierter Unsicherheiten**

Abstract Die Studie stellt eine ab initio basierte Methode für die automatische Konstruktion von detaillierten Mikrokinetiken vor, welche korrelierte Unsicherheiten in allen energetischen Parametern und Schätzroutinen berücksichtigt. Hierfür wurden innerhalb des Unsicherheitsraums des BEEF‐vdW Funktionals 2000 Mikrokinetiken für die Oxidationsreaktionen repräsentativer Abgasemissionen von stöchiometrischen Verbrennungsmotoren auf Pt(111) generiert und durch Multiskalenmodellierung mit Experimenten verglichen. Das Ensemble der Simulationsergebnisse unterstreicht die Bedeutung der Berücksichtigung von Unsicherheiten. Innerhalb dieses Ensembles ist es möglich, eine Mikrokinetik zu identifizieren, welche mit den experimentellen Daten übereinstimmt. Diese Mikrokinetik lässt sich auf ein einziges Austausch‐Korrelations‐Funktional zurückführen und legt nahe, dass Pt(111) das aktive Zentrum für die Oxidation leichter Kohlenwasserstoffe sein könnte. Die Studie bietet einen universellen Rahmen für die automatisierte Konstruktion von Reaktionsmechanismen unter Berücksichtigung korrelierter Unsicherheiten und ermöglicht eine DFT‐basierte Optimierung der Mikrokinetik auch für andere heterogen katalysierte Systeme.

Kreitz, Bjarne↗
DOE OSTI2022

Adaptive experimental design for multi-fidelity surrogate modeling of multi-disciplinary systems

We present an adaptive algorithm for constructing surrogate models of multi-disciplinary systems composed of a set of coupled components. With this goal we introduce “coupling” variables with a priori unknown distributions that allow surrogates of each component to be built independently. Once built, the surrogates of the components are combined to form an integrated-surrogate that can be used to predict system-level quantities of interest at a fraction of the cost of the original model. The error in the integrated-surrogate is greedily minimized using an experimental design procedure that allocates the amount of training data, used to construct each component-surrogate, based on the contribution of those surrogates to the error of the integrated-surrogate. Here, the multi-fidelity procedure presented is a generalization of multi-index stochastic collocation that can leverage ensembles of models of varying cost and accuracy, for one or more components, to reduce the computational cost of constructing the integrated-surrogate. Extensive numerical results demonstrate that, for a fixed computational budget, our algorithm is able to produce surrogates that are orders of magnitude more accurate than methods that treat the integrated system as a black-box.

42 ENGINEERING↗
DOE OSTI2022

Increases in Future AR Count and Size: Overview of the ARTMIP Tier 2 CMIP5/6 Experiment

Abstract The Atmospheric River (AR) Tracking Method Intercomparison Project (ARTMIP) is a community effort to systematically assess how the uncertainties from AR detectors (ARDTs) impact our scientific understanding of ARs. This study describes the ARTMIP Tier 2 experimental design and initial results using the Coupled Model Intercomparison Project (CMIP) Phases 5 and 6 multi‐model ensembles. We show that AR statistics from a given ARDT in CMIP5/6 historical simulations compare remarkably well with the MERRA‐2 reanalysis. In CMIP5/6 future simulations, most ARDTs project a global increase in AR frequency, counts, and sizes, especially along the western coastlines of the Pacific and Atlantic oceans. We find that the choice of ARDT is the dominant contributor to the uncertainty in projected AR frequency when compared with model choice. These results imply that new projects investigating future changes in ARs should explicitly consider ARDT uncertainty as a core part of the experimental design.

54 ENVIRONMENTAL SCIENCES↗