Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Stochastic modelling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,603 records · Page 89
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Tensor decompositions for count data that leverage stochastic and deterministic optimization

There is growing interest to extend low-rank matrix decompositions to multi-way arrays, or tensors. One fundamental low-rank tensor decomposition is the canonical polyadic decomposition (CPD). The challenge of fitting a low-rank, nonnegative CPD model to Poisson-distributed count data is of particular interest. Several popular algorithms use local search methods to approximate the maximum likelihood estimator (MLE) of the Poisson CPD model. Here, this work presents two new algorithms that extend state-of-the-art local methods for Poisson CPD. Hybrid GCP-CPAPR combines Generalized Canonical Decomposition (GCP) with stochastic optimization and CP Alternating Poisson Regression (CPAPR), a deterministic algorithm, to increase the probability of converging to the MLE over either method used alone. Restarted CPAPR with SVDrop uses a heuristic based on the singular values of the CPD model unfoldings to identify convergence toward optimizers that are not the MLE and restarts within the feasible domain of the optimization problem, thus reducing overall computational cost when using a multi-start strategy. We provide empirical evidence that indicates our approaches outperform existing methods with respect to converging to the Poisson CPD MLE.

CPAPR↗
DOE OSTI2025

Evaluation of Seismic Artificial Intelligence with Uncertainty

Artificial intelligence has transformed the seismic community with deep learning models (DLMs) that are trained to complete specific tasks within workflows. However, there is still a lack of robust evaluation frameworks for evaluating and comparing DLMs. Here, we address this gap by designing an evaluation framework that jointly incorporates two crucial aspects: performance uncertainty and learning efficiency. To target these aspects, we meticulously construct the training, validation, and test splits using a clustering method tailored to seismic data and enact an expansive training design to segregate performance uncertainty arising from stochastic training processes and random data sampling. The framework’s ability to guard against misleading declarations of model superiority is demonstrated through the evaluation of PhaseNet (Zhu and Beroza, 2018), a popular seismic phase picking DLM, under three training approaches. Our framework helps practitioners choose the best model for their problem and set performance expectations by explicitly analyzing model performance with uncertainty at varying budgets of training data.

58 GEOSCIENCES↗
DOE OSTI2023

Search for Resonant WZ Production in the Fully Leptonic Final State at 13 TeV With the CMS Detector

A search for an electrically charged, narrow-width diboson (WZ) resonance in the fully leptonic final state using 137:65 fb?1 of data collected by the CMS experiment during the 2016-2018 run period, at the LHC and a center of mass energy of p s = 13 TeV is presented. The search focuses on a channel where the resonance decays to a pair of standard model vector bosons: W and Z. The Z boson subsequently decays to a pair of leptons, either electrons (e) or muons (?). While the W boson decays to a lepton and a neutrino (?). As ? escapes undetected, the neutrino is reconstructed from the missing transverse momentum (Pmisst ) of the event. The analysis is based on a bump-hunt search strategy with background estimation based on stochastically generated simulation events. No significant excess of events is observed above the expected background from the Standard Model and limits are set on the production cross-section of the diboson resonance as a function of the resonance mass at 95% confidence level. Results are interpreted in the context of the Heavy Vector Triplet (HVT) framework.

Hernandez, Andres Vargas↗
NASA NTRS1989

Numerical study of the current sheet and PSBL in a magnetotail model

The current sheet and plasma sheet boundary layer (PSBL) in a magnetotail model are discussed. A test particle code is used to study the response of ensembles of particles to a two-dimensional, time-dependent model of the geomagnetic tail, and test the proposition (Coroniti, 1985a, b; Buchner and Zelenyi, 1986; Chen and Palmadesso, 1986; Martin, 1986) that the stochasticity of the particle orbits in these fields is an important part of the physical mechanism for magnetospheric substorms. The realistic results obtained for the fluid moments of the particle distribution with this simple model, and their insensitivity to initial conditions, is consistent with this hypothesis.

Doxas, I.↗
DOE OSTI2026

Development of an ab initio learned model of electron deposition range in deuterium-tritium plasmas through time-dependent density functional theory calculations and machine learning

Accurate hydrodynamic modeling for laser-direct-drive (LDD) inertial-confinement-fusion (ICF) relies on precise calculations of the electron thermal conduction in all target materials. The nonlocal stopping range of electrons in ICF plasmas directly influences thermal conduction; yet, no first principles model exists for the electron mean free path in the conduction-zone regime. This work utilized time-dependent stochastic density-functional theory (TD-sDFT) to calculate the electron stopping power in deuterium-tritium (DT) plasmas at (ρ, T) conditions relevant to the conduction zone and the compressed shell in ICF. Using a combination of our TD-sDFT data and already established analytical models, we developed and trained an artificial neural network to create a global model for the nonlocal electron deposition range, λ E . We compared our machine-learning (ML) based model for λ E to the currently-used modified-Lee-More model in LDD radiation-hydrodynamic codes, such as lilac, and saw an overall decrease in the deposition range. To understand the effects of λ E on LDD ICF implosion dynamics, we implemented the ML-based model into lilac; specifically, we looked at designs consistent with a current experiment on the OMEGA laser and for a newly designed LDD-ICF target for the future OMEGA-Next facility. In both cases, we saw an overall drop in predicted ablation pressure, peak areal density, and neutron yield due to the reduced thermal conduction (smaller λ E ) in DT plasmas. Comparisons with the experiment on OMEGA are also made.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Neutrino-driven Winds in Three-dimensional Core-collapse Supernova Simulations

Abstract In this paper, we analyze the neutrino-driven winds that emerge in 12 unprecedentedly long-duration 3D core-collapse supernova simulations done using the code F ornax . The 12 models cover progenitors with zero-age main-sequence mass between 9 and 60 solar masses. In all our models, we see transonic outflows that are at least 2 times as fast as the surrounding ejecta and that originate generically from a proto−neutron star surface atmosphere that is turbulent and rotating. We find that winds are common features of 3D simulations, even if there is anisotropic early infall. We find that the basic dynamical properties of 3D winds behave qualitatively similarly to those inferred in the past using simpler 1D models, but that the shape of the emergent wind can be deformed, very aspherical, and channeled by its environment. The thermal properties of winds for less massive progenitors very approximately recapitulate the 1D stationary solutions, while for more massive progenitors they deviate significantly owing to aspherical accretion. The Y e temporal evolution in winds is stochastic, and there can be some neutron-rich phases. Though no strong r -process is seen in any model, a weak r -process can be produced, and isotopes up to 90 Zr are synthesized in some models. Finally, we find that there is at most a few percent of a solar mass in the integrated wind component, while the energy carried by the wind itself can be as much as 10%–20% of the total explosion energy.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Baryogenesis from a dark first-order phase transition

We present a very minimal model for baryogenesis by a dark first-order phase transition. It employs a new dark SU(2) D gauge group with two doublet Higgs bosons, two lepton doublets, and two singlets. The singlets act as a neutrino portal that transfer the generated asymmetry to the Standard Model. The model predicts ΔN eff = 0.09–0.13 detectable by future experiments as well as possible signals from exotic decays of the Higgs and Z bosons and stochastic gravitational waves.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

On-the-fly response function generation method for composite coarse mesh

The hybrid stochastic deterministic transport code COMET, based on the incident response expansion theory, is used to model reactor cores with high fidelity and formidable computational speed. COMET models a reactor core using a library of incident flux response expansion coefficients that are pre computed for all the unique lattice cells (e.g., fuel assemblies, reflector blocks, etc.) in the core. In order to further improve its computational efficiency in pre-calculating the response library a new response function generation method is developed to compute the response functions for the composite coarse meshes made of a smaller set of unique lattices on the fly within the COMET's deterministic transport core sweep. The efficiency is achieved by eliminating a number of unique lattices that can be made up from the reduced set of unique meshes on the fly. The numerical process consists of the following steps. First, the boundary condition on composite coarse mesh boundaries is projected onto the expansion basis to compute the incident flux moments on external surfaces of all the basic (reduced set of unique) coarse meshes. Secondly, the deterministic sweeping solver in COMET is used to converge on the outgoing/incoming flux expansion moments crossing interfaces between the basic coarse meshes. Thirdly, the response functions for the composite coarse meshes are constructed as a superposition on the fly. The new response function generation method was tested on 88 composite coarse meshes consisting of CANDU fuel bundles and moderator blocks. It was found that response functions generated by the new method agree very well with those generated by direct Monte Carlo calculations. The average and maximum relative differences in the surface-to-surface response coefficients computed by the two methods are 0.10% and 0.20%, respectively. Similarly, the average and maximum relative differences in the response fission densities are 0.13% and 0.43%, respectively. These discrepancies are within one standard deviation of the stochastic uncertainties. The new method is five times faster than the original direct Monte Carlo method. The size of the response function library for the new method is five times smaller than that for the original method, leading to significantly less requirement for the computer hard drive space and memory. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2020

A Hybrid Stochastic-Interval Operation Strategy for Multi-Energy Microgrids

Increasing deployment of distributed energy resources intensifies interactions among electric, gas, heating, and cooling systems. Inherent uncertainties ranging from internal parameters to external inputs also impose significant challenges on system operation. A coordinated scheduling method is, therefore, desired for facilitating efficient operation of multi-energy microgrids under multiple uncertainties. In this paper, a deterministic coordinated scheduling model is developed first with detailed modeling of system dynamics and device parameters to fully characterize complex interactions among multi-energy carriers. Then, a hybrid stochastic-interval method is proposed to account for heterogeneous uncertainties in decisions of operational strategies. Specifically, performance and efficiency uncertainties of distributed energy resources, and injection uncertainty of renewable sources and multienergy demands are characterized by interval-based uncertain operation regions and probability distributions, respectively. A scenario-based two-stage algorithm is developed to solve the problem so that multiple uncertainties are preserved in the entire decision-making process. Moreover, adjustable operational strategies are determined to hedge uncertainty by considering operators’ risk preferences. The validity of the proposed method is verified by comprehensive case studies on a test system.

hybrid stochastic-interval approach↗
NASA NTRS1999

Dynamical Signatures of Living Systems

One of the main challenges in modeling living systems is to distinguish a random walk of physical origin (for instance, Brownian motions) from those of biological origin and that will constitute the starting point of the proposed approach. As conjectured, the biological random walk must be nonlinear. Indeed, any stochastic Markov process can be described by linear Fokker-Planck equation (or its discretized version), only that type of process has been observed in the inanimate world. However, all such processes always converge to a stable (ergodic or periodic) state, i.e., to the states of a lower complexity and high entropy. At the same time, the evolution of living systems directed toward a higher level of complexity if complexity is associated with a number of structural variations. The simplest way to mimic such a tendency is to incorporate a nonlinearity into the random walk; then the probability evolution will attain the features of diffusion equation: the formation and dissipation of shock waves initiated by small shallow wave disturbances. As a result, the evolution never "dies:" it produces new different configurations which are accompanied by an increase or decrease of entropy (the decrease takes place during formation of shock waves, the increase-during their dissipation). In other words, the evolution can be directed "against the second law of thermodynamics" by forming patterns outside of equilibrium in the probability space. Due to that, a specie is not locked up in a certain pattern of behavior: it still can perform a variety of motions, and only the statistics of these motions is constrained by this pattern. It should be emphasized that such a "twist" is based upon the concept of reflection, i.e., the existence of the self-image (adopted from psychology). The model consists of a generator of stochastic processes which represents the motor dynamics in the form of nonlinear random walks, and a simulator of the nonlinear version of the diffusion equation which represents the mental dynamics. It has been demonstrated that coupled mental-motor dynamics can simulate emerging self-organization, prey-predator games, collaboration and competition, "collective brain," etc.

Zak, M.↗
DOE OSTI2021

Gravitational Waves and Proton Decay: Complementary Windows into Grand Unified Theories

Proton decay is a smoking gun signature of grand unified theories (GUTs). Searches by Super-Kamiokande have resulted in stringent limits on the GUT symmetry-breaking scale. The large-scale multipurpose neutrino experiments DUNE, Hyper-Kamiokande, and JUNO will either discover proton decay or further push the symmetry-breaking scale above 10 16 GeV. Another possible observational consequence of GUTs is the formation of a cosmic string network produced during the breaking of the GUT to the standard model gauge group. The evolution of such a string network in the expanding Universe produces a stochastic background of gravitational waves which will be tested by a number of gravitational wave detectors over a wide frequency range. We demonstrate the nontrivial complementarity between the observation of proton decay and gravitational waves produced from cosmic strings in determining SO(10) GUT-breaking chains. We show that such observations could exclude SO(10) breaking via flipped SU(5) × U(1) or standard SU(5), while breaking via a Pati-Salam intermediate symmetry, or standard SU(5) × U(1), may be favored if a large separation of energy scales associated with proton decay and cosmic strings is indicated. We note that recent results by the NANOGrav experiment have been interpreted as evidence for cosmic strings at a scale of ~10 14 GeV. This would strongly point toward the existence of GUTs, with SO(10) being the prime candidate. We show that the combination with already available constraints from proton decay allows us to identify preferred symmetry-breaking routes to the standard model.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Scalable computations for nonstationary Gaussian processes

Nonstationary Gaussian process models can capture complex spatially varying dependence structures in spatial datasets. However, the large number of observations in modern datasets makes fitting such models computationally intractable with conventional dense linear algebra. In addition, derivative-free or even first-order optimization methods can be very slow to converge when estimating many spatially varying parameters. In this paper, we present a computational framework which couples an algebraic block diagonal plus low-rank covariance matrix approximation with stochastic trace estimation to facilitate the efficient use of second-order solvers for maximum likelihood estimation of Gaussian process models with many parameters. We demonstrate the effectiveness of these methods by simultaneously fitting 192 parameters in the popular nonstationary model of Paciorek and Schervish using 107,600 sea surface temperature anomaly measurements.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Machine learning unifies flexibility and efficiency of spinodal structure generation for stochastic biomaterial design

Abstract Porous biomaterials design for bone repair is still largely limited to regular structures (e.g. rod-based lattices), due to their easy parameterization and high controllability. The capability of designing stochastic structure can redefine the boundary of our explorable structure–property space for synthesizing next-generation biomaterials. We hereby propose a convolutional neural network (CNN) approach for efficient generation and design of spinodal structure—an intriguing structure with stochastic yet interconnected, smooth, and constant pore channel conducive to bio-transport. Our CNN-based approach simultaneously possesses the tremendous flexibility of physics-based model in generating various spinodal structures (e.g. periodic, anisotropic, gradient, and arbitrarily large ones) and comparable computational efficiency to mathematical approximation model. We thus successfully design spinodal bone structures with target anisotropic elasticity via high-throughput screening, and directly generate large spinodal orthopedic implants with desired gradient porosity. This work significantly advances stochastic biomaterials development by offering an optimal solution to spinodal structure generation and design.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Towards real-time forecasting of natural gas production by harnessing graph theory for stochastic discrete fracture networks

In this work, we compare hydrocarbon production curves obtained from a graph-based reduced-order model with the high-fidelity Discrete Fracture Network (DFN) predictions for a fracture network created using data from a real shale site. We observe that the bounds for the high fidelity DFN model lie within the bounds for the reduced order model, implying that the reduced-order model provides a conservative estimate. Moreover, we found that except for first-passage times and late arriving mass, the production curves from the reduced-order model predict transport accurately. However, it is to be noted that the results are inspite of trading a three-dimensional geometry for a reduced system in the form of a graph, one that is 500–1000 times faster in terms of computational efficiency (for this particular application). In addition, we also compare the production curves for large drawdown and small drawdown using our graph approach. The reduced-order model is successful in showing that the long term productivity is higher in case of small drawdown although the initial productivity is higher for large drawdown. Thus, this reduced-order model offers great potential in uncertainty quantification for production, as well as in providing operators with information to make real-time decisions for optimal production.

03 NATURAL GAS↗
NASA NTRS1989

A new adaptive control approach for aerospace vehicles with parameter uncertainties

A new stochastic adaptive control structure is developed for the problem of combined parameter estimation and control of aerospace vehicles with changing parameters. Parameter uncertainties are modeled as first-order Gauss-Markov processes, and are introduced to the system dynamics through a small parameter. It is assumed that an accurate inertial measurement unit gives perfect measurements of the state variables. Since the stochastic system is assumed to be Gauss-Markov, the density function of the parameters given these measurements is conditionally Gaussian. Based on this conditionally Gaussian density, the problem of minimizing a quadratic cost over an infinite time horizon can be set up within the framework of stochastic optimal control theory. The optimal feedback control law is derived from a straightforward expansion of the Hamilton-Jacobi-Bellman equation, based on the LQG solution. The resulting nonlinear controller is applied to the pitch axis control of a space platform with uncertain moments of inertia and is shown to produce marked improvement over a fixed controller.

Hahn, Yungsun↗
NASA NTRS2009

Alternative Representations of Convective Processes in the NASA GEOS-5 AGCM

The gap in explicit resolution of phenomena between global climate models and cloud resolving models is shrinking at a steady pace with global integrations of several km in resolution now practical for at least some time scales. In moving toward finer resolution the long standing problem of convective parameterization is being examined along with the assumption of convective quasi-equilibrium and how this can be reconciled with the stochastic and intermittent nature of convection. In this context we examine the nature of parameterized convection in the NASA Goddard Earth Observing System (GEOS-5) Atmospheric General Circulation Model. Our analysis uses both coarse (2.5 degree) and fine scale 0.25 degree spatial resolution integrations. Two basic formulations are compared: the default option is the Relaxed Arakawa-Schubert (RAS) scheme which invokes a sequence of linearly entraining plumes and quasi-equilibrium closure. An optional modification of this method (the "Stochastic Tokioka" constraint) places a random lower limit on plume entrainment. An alternative representation is the Kain-Fritsch parameterization which was originally developed for mesoscale numerical modeling strategies. Here entrainment is determined by a crude buoyancy sorting approach that allows the plume spectrum to be more responsive to ambient vertical stratification of moisture. Diagnostics of the model behavior are referenced to recent observational evidence of continuous phase transition behavior. In particular we examine the relationship between column water vapor and probablility of convective presence and intensity. Sensitivity of the statistics of convective behavior to parcel mixing/entrainment formulations and parcel initial thermodynamics are considered. Observational statistics from A-Train and TRMM sensors provide validation of the model integrations.

Robertson, Franklin↗
DOE OSTI2022

Coffee supply chain planning under climate change

The growing demand but uncertain supply makes the sustainability of the coffee industry a shared concern for all participants along the coffee supply chain. This study proposed a decision-making model that comprises the cultivation management, including shade management and annual agriculture management, and the supply chain logistics. A two-stage stochastic program is presented and used within a rolling horizon scheme that periodically updates input data information to deal with uncertainty associated with future climate scenarios. The program minimizes the total expected cost of the entire supply chain of arabica coffee. The study applied the model to the real case study of arabica coffee bean supply to the U.S. market, trying to answer whether arabica coffee supply can meet the U.S. demand from 2022 to 2050 and how to best mitigate any shortage through corporate-farmer partnerships. The results show that the coffee supply will have a 3% shortage in the future; medium-level shade management and more irrigation and fertilization are possible mitigation strategies. These results demonstrate the need for all participants to adopt suitable technologies for the sustainability of global coffee supply chains together.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Embedded training of neural-network subgrid-scale turbulence models

We report that the weights of a deep neural-network model are optimized in conjunction with the governing flow equations to provide a model for subgrid-scale stresses in a temporally developing plane turbulent jet at Reynolds number Re 0 = 6000 . The objective function for training is first based on the instantaneous filtered velocity fields from a corresponding direct numerical simulation, and the training is by a stochastic gradient descent method, which uses the adjoint Navier-Stokes equations to provide the end-to-end sensitivities of the model weights to the velocity fields. In-sample and out-of-sample testing on multiple dual-jet configurations show that its required mesh density in each coordinate direction for prediction of mean flow, Reynolds stresses, and spectra is half that needed by the dynamic Smagorinsky model for comparable accuracy. The same neural-network model trained directly to match filtered subgrid-scale stresses, without the constraint of being embedded within the flow equations during the training, fails to provide a qualitatively correct prediction. The coupled formulation is generalized to train based only on mean-flow and Reynolds stresses, which are more readily available in experiments. The mean-flow training provides a robust model, which is important, though a somewhat less accurate prediction for the same coarse meshes, as might be anticipated due to the reduced information available for training in this case. The anticipated advantage of the formulation is that the inclusion of resolved physics in the training increases its capacity to extrapolate. This is assessed for the case of passive scalar transport, for which it outperforms established models due to improved mixing predictions.

42 ENGINEERING↗