Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Randomized methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Efficient Subset Simulation using Hamiltonian Neural Network enhanced Markov Chain Monte Carlo Methods

The Monte Carlo method delivers an unbiased estimate of the probability of failure. However, the variance of the estimate depends on the number of evaluated samples. This number must be very large for estimations of a low probability of failure. If the evaluation of each sample is computationally expensive, the crude Monte Carlo simulation strategy is impracticable. Therefore, subset simulations are used to reduce the required number of evaluations. Subset simulations require a Markov Chain Monte Carlo sampler, such as the random walk Metropolis-Hastings algorithm. The algorithm, however, struggles with sampling in low-probability regions, especially if they are narrow. As a consequence, advanced Markov Chain Monte Carlo simulations have been developed. In particular, the Hamiltonian Monte Carlo method explores the target distribution rapidly. Driven by the idea of Hamiltonian dynamics, this sampler provides a non-random walk through the target distribution. The incorporation of subset simulation and Hamiltonian Monte Carlo methods has shown promising results for reliability analysis. One downside of the Hamiltonian Monte Carlo method is that gradient evaluations are computationally expensive, especially when dealing with high-dimensional problems and evaluating long trajectories. We show that integrating Hamiltonian neural networks in Hamiltonian Monte Carlo simulations significantly speeds up the sampling task. Furthermore, the enhancement of adaptive trajectory length within the Hamiltonian Monte Carlo results in the efficient proposal of the following states. Based on this recent enhancement, we provide a fast sampling strategy for subset simulations using Hamiltonian neural networks to replace the evaluation of the gradient and significantly speed up the Hamiltonian Monte Carlo simulation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Improving the accuracy of freight mode choice models: A case study using the 2017 CFS PUF data set and ensemble learning techniques

Here, the US Census Bureau has collected two rounds of experimental data from the Commodity Flow Survey, providing shipment-level characteristics of nationwide commodity movements, published in 2012 (i.e., Public Use Microdata) and in 2017 (i.e., Public Use File). With this information, data-driven methods have become increasingly valuable for understanding detailed patterns in freight logistics. In this study, we used the 2017 Commodity Flow Survey Public Use File data set to explore building a high-performance freight mode choice model, considering three main improvements: (1) constructing local models for each separate commodity/industry category; (2) extracting useful geographical features, particularly the derived distance of each freight mode between origin/destination zones; and (3) applying additional ensemble learning methods such as stacking or voting to combine results from local and unified models for improved performance. The proposed method achieved over 92% accuracy without incorporating external information, an over 19% increase compared to directly fitting Random Forests models over 10,000 samples. Furthermore, SHAP (Shapely Additive Explanations) values were computed to explain the outputs and major patterns obtained from the proposed model. The model framework could enhance the performance and interpretability of existing freight mode choice models.

42 ENGINEERING↗
DOE OSTI2024

Probabilistic Assessment of Structural Integrity

A probability-based approach, combining deterministic and probabilistic methods, was developed for analyzing building and component failures, which are especially crucial for complex structures like nuclear power plants. This method links finite element and probabilistic software to assess structural integrity under static and dynamic loads. This study uses NEPTUNE software, which is validated, for a deterministic transient analysis and ProFES software for probabilistic models. In a case study, deterministic analyses with varied random variables were transferred to ProFES for probabilistic analyses of piping failure and wall damage. A Monte Carlo Simulation, First-Order Reliability Method, and combined methods were employed for probabilistic analyses under severe transient loading, focusing on a postulated accident at the Ignalina Nuclear Power Plant. The study considered uncertainties in material properties, component geometry, and loads. The results showed the Monte Carlo Simulation method to be conservative for high failure probabilities but less so for low probabilities. The Response Surface/Monte Carlo Simulation method explored the impact load–failure probability relationship. Given the uncertainties in material properties and loads in complex structures, a deterministic analysis alone is insufficient. Probabilistic analysis is imperative for extreme loading events and credible structural safety evaluations.

Mathematics↗
DOE OSTI2021

Mechanistic verification of empirical UO 2 fuel fracture models

Standard UO 2 fuel pellets used in light-water reactors fracture during irradiation due to the large thermal gradient in the radial direction. Over the decades, numerous researchers have explored fuel cracking from experimental and modeling points of view. To date, there have been both empirical and mechanistic approaches to predict the number of fragments that form in UO 2 . The empirical models only consider maximum power and burnup as inputs. Existing mechanistic approaches for normal operation have not accounted for irradiation effects. Here, this work employs a mechanistic fuel cracking model using the extended finite element method to explore radial crack formation while including a sensitivity analysis that accounts for the randomization of tensile strength within the fuel, the strength randomization criteria (uniform or volume-weighted Weibull), power ramping rates, computational mesh density, maximum power level, and irradiation (burnup) effects. The results indicate that the uncertainty in this mechanistic modeling approach envelopes the predicted values from three different empirical correlations in almost all cases. This means that, for computationally intensive analyses involving UO 2 fragmentation, the empirical correlations can be used. However, since the mechanistic calculations bound those of the empirical correlations, there is confidence in the applicability of the mechanistic approach developed in this work to generate a correlation for fuel types where limited data exists (e.g., doped-UO 2 , U 3 Si 2 ).

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2025

Uncertainty propagation in feed-forward neural network models

We develop new uncertainty propagation methods for feed-forward neural network architectures with leaky ReLU activation functions subject to random perturbations in the input vectors. In particular, we derive analytical expressions for the probability density function (PDF) of the neural network output and its statistical moments as a function of the input uncertainty and the parameters of the network, i.e., weights and biases. A key finding is that an appropriate linearization of the leaky ReLU activation function yields accurate statistical results even for large perturbations in the input vectors. This can be attributed to the way information propagates through the network. We also propose new analytically tractable Gaussian copula surrogate models to approximate the full joint PDF of the neural network output. To validate our theoretical results, we conduct Monte Carlo simulations and a thorough error analysis on a multi-layer neural network representing a nonlinear integro-differential operator between two polynomial function spaces. Our findings demonstrate excellent agreement between the theoretical predictions and Monte Carlo simulations.

MLP networks↗
DOE OSTI2024

The influence of the shock-to-reshock time on the Richtmyer–Meshkov instability in reshock

Experiments on the Richtmyer–Meshkov instability (RMI) in a dual driver vertical shock tube (DDVST) are described. An initially planar, stably stratified membraneless interface is formed by flowing air from above and sulfur hexafluoride from below the interface location using the method of Jones & Jacobs ( Phys. Fluids , vol. 9, issue 1997, 1997, pp. 3078–3085). A random three-dimensional, multi-modal initial perturbation is imposed by vertically oscillating the gas column to produce Faraday waves. The DDVST design generates two shock waves, one originating above and one below the interface, with these shocks having independently controllable strengths and interface arrival times. The shock waves have nominal strengths of $M_L=1.17$ and $M_H=1.18$ for the shock wave originating in the light and heavy gas, respectively, with these strengths chosen to result in arrested bulk interface motion following reshock. The influence of the length of the shock-to-reshock time, as well as the order of shock arrival, on the post-reshock RMI is examined. The mixing layer width grows according to $h\propto t^\theta$ , where $\theta _H=0.36\pm 0.018$ (95 %) and $\theta _L=0.38\pm 0.02$ (95 %) for heavy and light shock first experiments, respectively, indicating no strong dependence on the order of shock wave arrival. Volume integrated specific turbulent kinetic energy (TKE) in the mixing layer versus time is found to decay according to $E_{tot}/\bar {\rho }\propto t^p$ with $p_H=-0.823\pm 0.06$ (95 %) and $p_L=-1.061\pm 0.032$ (95 %) for heavy and light shock first experiments, respectively. Notably, the 95 % confidence intervals do not overlap. Analysis on the influence of the shock-to-reshock time on turbulent length scales, transition criteria, spectra and mixing layer anisotropy are also presented.

Ferguson, Kevin (ORCID:0000000166537482)↗
DOE OSTI2021

New, improved analysis of correlation ECE data to accurately determine turbulent electron temperature spectra and magnitudes (invited)

Turbulent electron temperature fluctuation measurement using a correlation electron cyclotron emission (CECE) radiometer has become an important diagnostic for studying energy transport in fusion plasmas, and its use is widespread in tokamaks (DIII-D, ASDEX Upgrade, Alcator C-Mod, Tore Supra, EAST, TCV, HL-2A, etc.). The CECE diagnostic typically performs correlation analysis between two closely spaced (within the turbulent correlation length) ECE channels that are dominated by uncorrelated thermal noise emission. This allows electron temperature fluctuations embedded in the thermal noise to be revealed and fluctuation level and spectra determined. We have demonstrated a new, improved CECE coherency-based analysis for calculating the temperature fluctuation frequency spectrum and level, which has been verified both numerically through the simulation of synthetic ECE radiometer data and through analysis of experimental data from the CECE system on DIII-D. The new formulation places coherency-based analysis on a firm foundational footing and corrects some currently published methodologies. This new method accurately accounts for bias error in the coherence function and correctly calculates noise levels for a fixed data record length. It provides excellent accuracy in determining temperature fluctuation level (e.g., <10% error) even for a small realization number in the ensemble average. The method also has a smaller uncertainty (i.e., error bar) in the power spectrum when compared to the more standard cross-power method when evaluated at low coherency. Direct calculation of system noise level using correlation between randomized intermediate frequency signals is recommended.

Wang, G. (ORCID:0000000225739827)↗
DOE OSTI2022

Noniterative finite amplitude methods for E 1 and M 1 giant resonances

The finite amplitude method (FAM) is a very efficient approach for solving the fully self-consistent random-phase approximation (RPA) equations. We use FAM to rederive the RPA matrices for Skyrme functionals, calculate the electric dipole ( E 1) and the magnetic dipole ( M 1) giant resonances, and compare the results with available experimental and evaluated data. For the E 1 transitions in heavy nuclei, the calculations reproduce well the resonance energy of the photoabsorption cross sections. In the case of M 1 transitions, we show that the residual interaction does not affect the transition strength of double-magic nuclei, which suggests that the spin terms in the Skyrme force currently neglected in the present computation could improve the agreement between FAM and experimental data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Efficient Estimation of Pauli Observables by Derandomization

In this work, we consider the problem of jointly estimating expectation values of many Pauli observables, a crucial subroutine in variational quantum algorithms. Starting with randomized measurements, we propose an efficient derandomization procedure that iteratively replaces random single-qubit measurements by fixed Pauli measurements; the resulting deterministic measurement procedure is guaranteed to perform at least as well as the randomized one. In particular, for estimating any L low-weight Pauli observables, a deterministic measurement on only of order log(L) copies of a quantum state suffices. In some cases, for example, when some of the Pauli observables have high weight, the derandomized procedure is substantially better than the randomized one. Specifically, numerical experiments highlight the advantages of our derandomized protocol over various previous methods for estimating the ground-state energies of small molecules.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Explaining Neural Spike Activity for Simulated Bio-plausible Network through Deep Sequence Learning

With significant improvements in large-scale simulations of brain models, there is a growing need to develop tools for rapid analysis and interpreting the simulation results. In this work, we explore the potential of sequential deep learning models to understand and explain the network dynamics among the neurons extracted from a large-scale neural simulation in STACS (Simulation Tool for Asynchronous Cortical Stream). Our method employs a representative neuroscience model that abstracts the cortical dynamics with a reservoir of randomly connected spiking neurons with a low stable spike firing rate throughout the simulation duration. We subsequently analyze the spike dynamics of the simulated spiking neural network through an autoencoder model and an attention-based mechanism.

Kulkarni, Shruti↗
DOE OSTI2022

Multirobot Collaborative Pursuit Target Robot by Improved MADDPG

Policy formulation is one of the main problems in multirobot systems, especially in multirobot pursuit-evasion scenarios, where both sparse rewards and random environment changes bring great difficulties to find better strategy. Existing multirobot decision-making methods mostly use environmental rewards to promote robots to complete the target task that cannot achieve good results. This paper proposes a multirobot pursuit method based on improved multiagent deep deterministic policy gradient (MADDPG), which solves the problem of sparse rewards in multirobot pursuit-evasion scenarios by combining the intrinsic reward and the external environment. The state similarity module based on the threshold constraint is as a part of the intrinsic reward signal output by the intrinsic curiosity module, which is used to balance overexploration and insufficient exploration, so that the agent can use the intrinsic reward more effectively to learn better strategies. The simulation experiment results show that the proposed method can improve the reward value of robots and the success rate of the pursuit task significantly. The intuitive change is obviously reflected in the real-time distance between the pursuer and the escapee, the pursuer using the improved algorithm for training can get closer to the escapee more quickly, and the average following distance also decreases.

Zhou, Xiao↗
DOE OSTI2025

Advancing Multiscale Simulation of Plasma-Surface Interfaces

We report the development of an atomistic-informed, surface-state-dependent predictive model for particle exchange in a carbon-tungsten plasma-surface interface. The predictive model uses machine learning (ML) techniques to learn the energy and angular distributions for particle exchange and rate functions for surface state evolution from molecular dynamics simulations of cumulative bombardment of tungsten by energetic carbon ions. Each predictive component is sensitive to the energy and trajectory of incident plasma species and the surface state. The surface state is represented by a set of surface state descriptors, which were derived from the atomistic surface state for each independent carbon bombardment event. These descriptors are representative of the composition and degree of amorphization of the outermost angstrom of surface material and were chosen to optimize predictive performance for particle exchange at the interface. The distributions for particle exchange (reflection/sputtering) are demonstrated to vary with each surface state descriptor, motivating the development of surface-state-dependent particle exchange models for plasma simulations. The performance of various ML methods was compared, including polynomial quantile regression, artificial neural networks, k-nearest neighbors, and random forest algorithms, with polynomial regression performing the best for interpolation and extrapolation of learned relationships. In addition to the particle exchange model, a neutral network was developed and used to identify data sufficiency throughout surface descriptor space, which will enable real-time feedback during future data production to ensure data is produced where it is most needed, and we provide commentary on improvements to the data production workflow for future endeavors.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Toward Drilling the Perfect Geothermal Well: An International Research Coordination Network for Geothermal Drilling Optimization Supported by Deep Machine Learning and Cloud Based Data Aggregation

The EDGE project, supported by the U.S. Department of Energy Geothermal Technologies Office under award DE-EE0008793, established a data-driven framework for improving the efficiency, cost-effectiveness, and reliability of geothermal well drilling. The project focused on developing scalable data infrastructure, advanced machine learning and probabilistic models, and integrated analytics tools to support continuous drilling optimization. A central objective was to reduce geothermal drilling costs by up to seventy percent while minimizing the risk of well failure through predictive diagnostics and adaptive planning. Over the project period, a comprehensive data repository was designed and deployed, incorporating records from over one hundred geothermal wells across varied geological settings. This repository supported both structured and unstructured data and adhered to FAIR data principles, enabling provenance tracking, quality control, and standardized metadata. The project introduced automated ingestion pipelines and a cloud-hosted platform that facilitated access to raw, processed, and derived datasets. This infrastructure served as the foundation for model development and analysis. Machine learning workflows were developed to predict key drilling metrics including rate of penetration, non-productive time, and total drilling costs. Self-organizing maps and dimensionality reduction methods were used to uncover operational patterns and outliers, while supervised learning algorithms such as random forests and deep neural networks were applied to forecast performance outcomes. The models were validated on heterogeneous datasets from both U.S. and Icelandic fields, demonstrating variable but significant predictive accuracy. The results indicated that finer temporal resolution, inclusion of lithological data, and consistency in operational annotations could substantially improve model performance. The project also implemented process mining techniques to reconstruct state-transition models from drilling event logs. These models enabled the identification of deviations from optimal workflows and provided insights into recurring failure modes. Analysis of non-productive time highlighted the impact of equipment failures, geological challenges, and human factors, offering opportunities for targeted mitigation strategies. The EDGE Dashboard was developed as a web-based expert system integrating data visualization, model outputs, and user-driven queries. It provided an accessible interface for operators to explore historical data, evaluate predicted outcomes, and compare drilling scenarios. Initial feedback from project partners suggested that the dashboard could serve as a foundation for more advanced advisory and optimization tools. Overall, the EDGE project demonstrated the feasibility and value of applying modern data science techniques to geothermal drilling. It delivered a set of interoperable tools and models that can support more efficient, lower-risk well development. The findings point toward a viable path for transitioning from advisory analytics to semi-autonomous drilling systems, contingent on continued collaboration, expanded datasets, and field validation. The project results have immediate relevance for drilling operations, data management practices, and future geothermal R&D efforts aimed at achieving reliable, cost-competitive geothermal energy at scale.

15 GEOTHERMAL ENERGY↗
DOE OSTI2026

Feature-Based PMU Event Classification under Variable PMU Participation and Overlapping Events

Danovo Energy Solution's presented its paper named: Feature-Based PMU Event Classification under Variable PMU Participation and Overlapping Events at the 2026 Georgia Tech Fault & Disturbance Analysis Conference. The full paper can be found at OSTI ID# 3169150 Paper Abstract—Phasor Measurement Units (PMUs) stream time synchronized, high-resolution measurements from the grid, enabling data-driven techniques for event detection and classification. Accurate event classification improves grid reliability and stability. Events can be detected by varying numbers of PMUs and exhibit different durations depending on the event type. This variability challenges standard classifiers that require uniform input sizes. Moreover, multiple events may coincide, which increases classification complexity. Standard classifiers assign each instance to the class with the highest predicted probability, whereas overlapping events may exhibit comparable probabilities across multiple classes. In this study, to handle data size variability, we extract a wide range of time–frequency domain features from all available PMUs for each event into a fixed-length vector, facilitating the application of standard machine learning classifiers, including Random Forest, XGBoost, LightGBM, Support Vector Machine, and Multilayer Perceptron. To account for overlapping events, a probabilistic post-processing step is applied. For a given data instance, if multiple predicted class probabilities exceed 30% and the differences between them are less than 10%, the event is assigned to multiple classes. Experiments using real-world PMU data demonstrate that the Random Forest and XGBoost models achieve the highest accuracy, while the proposed post-processing method yields perfect classification performance on external unseen test sets.

Nematirad, Reza [Danova Energy Solutions]↗
DOE OSTI2024

Incidence and predictors of loss to follow-up among adult patients receiving antiretroviral therapy in Central Ethiopia: a multi-center retrospective cohort study

Background: Globally, loss to follow-up (LTFU) remains a significant public health concern despite the rapid expansion of antiretroviral medication programs. It is a significant cause of treatment failure and threatens the enhancement of HIV treatment outcomes among patients on antiretroviral therapy (ART). However, there is a paucity of evidence on its incidence and predictors in Ethiopia. Thus, this study aimed to examine the incidence and predictors of LTFU among adult HIV patients receiving ART at hospitals in Central Ethiopia. Methods: A multi-centered facility-based retrospective cohort study was conducted among 432 randomly selected adult patients who received antiretroviral therapy. Data were entered into EpiData version 3.1 and exported to Stata version 14 for analysis. The Kaplan–Meier failure function was employed to determine the overall failure estimates, and the log-rank test was used to compare the probability of failure among the different categories of variables. The Cox proportional hazard model was used to identify independent predictors of LTFU. Results: Overall, 172 (39.8%) study participants were lost to follow-up over the 10-year follow-up period with an incidence rate of 8.12 (95% CI: 7.11, 9.09) per 1,000 person-months. Undisclosed HIV status (AHR: 1.96, 95% CI: 1.14, 3.36), not able to work (AHR: 1.84, 95% CI: 1.13, 2.22), opportunistic infections (AHR: 3.13, 95% CI: 2.17, 4.52), CD4 < 200 cell/mL (AHR: 1.95, 95% CI: 1.18, 3.21), not receiving isoniazid preventive therapy (IPT) (AHR: 2.57, 95% CI: 1.62, 4.06), not participating in clubs (AHR: 1.68, 95% CI: 1.10, 2.22), side effects of drugs (AHR: 1.44, 95% CI: 1.02, 2.04), and high viral load (AHR: 3.15, 95% CI: 1.81, 5.47) were identified as significant predictors of loss to follow-up. Conclusion: In this study, the incidence of LTFU was high. The focus should be on creating awareness and prevention programs that aim to reduce loss to follow-up by continuing counseling, especially on the negative effects of loss to follow-up and the benefits of ART care.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Methods of designing programmable inducible promoters

Described herein is a method for identifying synthetic inducible promoters that have specified induction and/or repression for DNA binding proteins such as an allosteric transcription factor and an inducer molecule. The method includes an in vitro selection from an unselected polynucleotide library comprising a plurality of random degeneracies, and an in vivo selection to produce an induced promoter library. Produced is an induction table, which allows the selection of a promoter with specific induction and/or repression properties. Also included are biosensors containing the synthetic inducible promoters.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Micromagnet PUF readout using a quantum diamond microscope

A physically unclonable function (PUF) and a method of reading it are provided. The PUF is constituted by a microfabricated array of randomly polarized micromagnets disposed on a substrate. The PUF can be read by creating a magnetization map of the PUF from the signal output of a quantum diamond microscope (QDM) and converting the magnetization map to a numerical sequence.

Kehayias, Pauli Mark↗
DOE OSTI2026

Feature-Based PMU Event Classification under Variable PMU Participation and Overlapping Events

This paper is the basis for a presentation help at the 2026 Georgia Tech Fault & Disturbance Analysis Conference, which can be found at OSTI # 3168287 Paper Abstract—Phasor Measurement Units (PMUs) stream time synchronized, high-resolution measurements from the grid, enabling data-driven techniques for event detection and classification. Accurate event classification improves grid reliability and stability. Events can be detected by varying numbers of PMUs and exhibit different durations depending on the event type. This variability challenges standard classifiers that require uniform input sizes. Moreover, multiple events may coincide, which increases classification complexity. Standard classifiers assign each instance to the class with the highest predicted probability, whereas overlapping events may exhibit comparable probabilities across multiple classes. In this study, to handle data size variability, we extract a wide range of time–frequency domain features from all available PMUs for each event into a fixed-length vector, facilitating the application of standard machine learning classifiers, including Random Forest, XGBoost, LightGBM, Support Vector Machine, and Multilayer Perceptron. To account for overlapping events, a probabilistic post-processing step is applied. For a given data instance, if multiple predicted class probabilities exceed 30% and the differences between them are less than 10%, the event is assigned to multiple classes. Experiments using real-world PMU data demonstrate that the Random Forest and XGBoost models achieve the highest accuracy, while the proposed post-processing method yields perfect classification performance on external unseen test sets.

Nematirad, Reza [Danovo Energy Solutions]↗