Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model selection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Determination of latent dimensionality in international trade flow

Currently, high-dimensional data is ubiquitous in data science, which necessitates the development of techniques to decompose and interpret such multidimensional (aka tensor) datasets. Finding a low dimensional representation of the data, that is, its inherent structure, is one of the approaches that can serve to understand the dynamics of low dimensional latent features hidden in the data. Moreover, decomposition methods with non-negative constraints are shown to extract more insightful factors. Nonnegative RESCAL is one such technique, particularly well suited to analyze self-relational data, such as dynamic networks found in international trade flows. Particularly, non-negative RESCAL computes a low dimensional tensor representation by finding the latent space containing multiple modalities. Furthermore, estimating the dimensionality of this latent space is crucial for extracting meaningful latent features. Here, to determine the dimensionality of the latent space with non-negative RESCAL, we propose a latent dimension determination method which is based on clustering of the solutions of multiple realizations of non-negative RESCAL decompositions. We demonstrate the performance of our model selection method on synthetic data. We then apply our method to decompose a network of international trade flows data from International Monetary Fund and shows that with a correct latent dimension determination, the resulting features are able to capture relevant empirical facts from economic literature.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

A deep, multi-epoch Chandra HETG study of the ionized outflow from NGC 4051

Actively accreting supermassive black holes significantly impact the evolution of their host galaxies, truncating further star formation by expelling large fractions of gas with wide-angle outflows. The X-ray band is key to understanding how these black hole winds affect their environment, as the outflows have high temperatures ~10 5–8 K). We have developed a Bayesian framework for characterizing active galactic nucleus outflows with an improved ability to explore parameter space and perform robust model selection. We applied this framework to a new 700 ks and an archival 315 ks Chandra High Energy Transmission Gratings observation of the Seyfert galaxy NGC 4051. We have detected six absorbers intrinsic to NGC 4051. These wind components span velocities from 400 to 30000 km s -1 . We have determined that the most statistically significant wind component is purely collisionally ionized, which is the first detection of such an absorber. This wind has T ≈ 10 7 K and v ≈ 880 km s -1 and remains remarkably stable between the two epochs. Other slow components also remain stable across time. Fast outflow components change their properties between 2008 and 2016, suggesting either physical changes or clouds moving in and out of the line of sight. For one of the fast components, we obtain one of the tightest wind density measurements to date, log n/(cm -3 ) = 13.0$^{+0.01}_{-0.02}$, and determine that it is located at ~240 gravitational radii. The estimated total outflow power surpasses 5 percent of the bolometric luminosity (albeit with large uncertainties) making it important in the context of galaxy–black hole interactions.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Photometric redshift uncertainties in weak gravitational lensing shear analysis: models and marginalization

ABSTRACT Recovering credible cosmological parameter constraints in a weak lensing shear analysis requires an accurate model that can be used to marginalize over nuisance parameters describing potential sources of systematic uncertainty, such as the uncertainties on the sample redshift distribution n(z). Due to the challenge of running Markov chain Monte Carlo (MCMC) in the high-dimensional parameter spaces in which the n(z) uncertainties may be parametrized, it is common practice to simplify the n(z) parametrization or combine MCMC chains that each have a fixed n(z) resampled from the n(z) uncertainties. In this work, we propose a statistically principled Bayesian resampling approach for marginalizing over the n(z) uncertainty using multiple MCMC chains. We self-consistently compare the new method to existing ones from the literature in the context of a forecasted cosmic shear analysis for the HSC three-year shape catalogue, and find that these methods recover statistically consistent error bars for the cosmological parameter constraints for predicted HSC three-year analysis, implying that using the most computationally efficient of the approaches is appropriate. However, we find that for data sets with the constraining power of the full HSC survey data set (and, by implication, those upcoming surveys with even tighter constraints), the choice of method for marginalizing over n(z) uncertainty among the several methods from the literature may modify the 1σ uncertainties on Ωm–S8 constraints by ∼4 per cent, and a careful model selection is needed to ensure credible parameter intervals.

Zhang, Tianqing (ORCID:000000025596198X)↗
DOE OSTI2024

Application of deep learning methods for beam size control during user operation at the Advanced Light Source

Past research at the Advanced Light Source (ALS) provided a proof-of-principle demonstration that deep learning methods could be effectively employed to compensate for the significant perturbations to the transverse electron beam size induced by user-controlled adjustments of the insertion devices. However, incorporating these methods into the ALS’ daily operations has faced notable challenges. The complexity of the system’s operational requirements and the significant upkeep demands has restricted their sustained application during user operation. Here, we introduce the development of a more robust neural network (NN)-based algorithm that utilizes a novel online fine-tuning approach and its systematic integration into the day-to-day machine operations. Our analysis emphasizes the process of NN model selection, demonstrates the superior performance of the NN-based method over traditional feedback methods, and examines the effectiveness and resilience of the new algorithm during user-operation scenarios. Published by the American Physical Society 2024

43 PARTICLE ACCELERATORS↗
DOE OSTI2023

Fast and accurate simulations of calorimeter showers with normalizing flows

In this study, we introduce caloflow, a fast detector simulation framework based on normalizing flows. For the first time, we demonstrate that normalizing flows can reproduce many-channel calorimeter showers with extremely high fidelity, providing a fresh alternative to computationally expensive geant4 simulations, as well as other state-of-the-art fast simulation frameworks based on generative adversarial networks (GANs) or variational autoencoders (VAEs). In addition to the usual histograms of physical features and images of calorimeter showers, we introduce a new metric for judging the quality of generative modeling: the performance of a classifier trained to differentiate real from generated images. We show that GAN-generated images can be identified by the classifier with nearly 100% accuracy, while images generated from caloflow are better able to fool the classifier. More broadly, normalizing flows offer several advantages compared to other state-of-the-art approaches (GANs and VAEs), including tractable likelihoods, stable and convergent training, and principled model selection. Normalizing flows also provide a bijective mapping between data and the latent space, which could have other applications beyond simulation, for example, to detector unfolding.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Footprints of the QCD Crossover on Cosmological Gravitational Waves at Pulsar Timing Arrays

Pulsar timing arrays (PTAs) have reported evidence for a stochastic gravitational wave (GW) background at nanohertz frequencies, possibly originating in the early Universe. We show that the spectral shape of the low-frequency (causality) tail of GW signals sourced at temperatures around T ≳ 1 GeV is distinctively affected by confinement of strong interactions (QCD), due to the corresponding sharp decrease in the number of relativistic species, and significantly deviates from ∼ f 3 commonly adopted in the literature. Bayesian analyses in the NANOGrav 15 years and the previous international PTA datasets reveal a significant improvement in the fit with respect to cubic power-law spectra, previously employed for the causality tail. While no conclusion on the nature of the signal can be drawn at the moment, our results show that the inclusion of standard model effects on cosmological GWs can have a decisive impact on model selection. Published by the American Physical Society 2024

Franciolini, Gabriele (ORCID:0000000268929145)↗
DOE OSTI2026

A Physics-Aligned Multi-Domain Machine Learning Framework for Time-Localised Diagnosis of Power Electronics Faults

This paper presents a physics-aligned framework for fault diagnosis in multi-phase power-electronic systems using cycle-synchronous windowing and multi-domain features derived from Fourier, wavelet, and Hilbert–Huang representations. While both logistic regression and multilayer perceptron (MLP) models achieve perfect performance under standard evaluation, blind unseen testing reveals a critical failure in a baseline MLP. This is shown to arise from model selection based on validation accuracy. Using validation-loss-based selection restores correct unseen performance and improves confidence. Feature ablation shows that Fourier and wavelet features dominate, while computational analysis indicates that feature extraction, particularly HHT, governs runtime.

Kumar, Praveen [ORNL] (ORCID:0000000291877857)↗
DOE OSTI2024

Event Detection and Classification Using Machine Learning Applied to PMU Data for the Western US Power System

Smart grid technology enhances our comprehension and reliability of the power grid, leveraging Phasor Measurement Unit (PMU) data—time-synchronized, high-frequency measurements gathered across the US power grid. This paper employs machine learning techniques to effectively analyze the vast PMU data in Wide Area Monitoring Systems (WAMS) for power grid event detection and classification. Analyzing several months of real-world PMU data, the paper focuses on machine learning for fast, precise event detection and classification, corroborated by utility event logs. Practical challenges like feature extraction, dimensionality reduction, and model selection are addressed. A novel feature yielding improved results is discovered, and a supplementary algorithm for detecting small power grid faults is developed. The final algorithm is validated using a month-long real PMU data set, demonstrating its capability in accurately identifying power grid events in near real-time.

machine learning, event detection, PMU↗
DOE OSTI2021

Comparison of Radiation Models for a Turbulent Piloted Methane/Air Jet Flame: A Frozen-Field Study

Numerical modeling of radiative transfer in nongray reacting media is a challenging problem in computational science and engineering. The choice of radiation models is important for accurate and efficient high-fidelity combustion simulations. Different applications usually involve different degrees of complexity, so there is yet no consensus in the community. In this paper, the performance of different radiative transfer equation (RTE) solvers and spectral models for a turbulent piloted methane/air jet flame are studied. The flame is scaled from the Sandia Flame D with a Reynolds number of 22,400. Three classes of RTE solvers, namely the discrete ordinates method, spherical harmonics method, and Monte Carlo method, are examined. The spectral models include the Planck-mean model, the full-spectrum k-distribution (FSK) method, and the line-by-line (LBL) calculation. The performances of different radiation models in terms of accuracy and computational cost are benchmarked. The results have shown that both RTE solvers and spectral models are critical in the prediction of radiative heat source terms for this jet flame. The trade-offs between the accuracy, the computational cost, and the implementation difficulty are discussed in detail. The results can be used as a reference for radiation model selection in combustor simulations.

David, Chloe↗
DOE OSTI2022

A Variational Inference Approach to Inverse Problems with Gamma Hyperpriors

Hierarchical models with gamma hyperpriors provide a flexible, sparse-promoting framework to bridge L 1 and L 2 regularizations in Bayesian formulations to inverse problems. Despite the Bayesian motivation for these models, existing methodologies are limited to maximum a posteriori estimation. The potential to perform uncertainty quantification has not yet been realized. This paper introduces a variational iterative alternating scheme for hierarchical inverse problems with gamma hyperpriors. The proposed variational inference approach yields accurate reconstruction, provides meaningful uncertainty quantification, and is easy to implement. In addition, it lends itself naturally to conduct model selection for the choice of hyperparameters. Here, we illustrate the performance of our methodology in several computed examples, including a deconvolution problem and sparse identification of dynamical systems from time series data.

Bayesian shrinkage↗
DOE OSTI2020

SISSO (Sure-independence-screening sparsifying-operator regressor)

Implementation of the SISSO regression algorithm in MATLAB. The SISSO regression algorithm iteratively selects model features from candidates, converging even when the number of possible features is much greater than the number of available data points. Includes a test script that validates the algorithm by replicating the results using data and procedure from https://analytics-toolkit.nomad-coe.eu/hub/user-redirect/notebooks/tutorials/compressed_sensing.ipynb. Python code from the SISSO regressor in 'sisso.py', from the link above, was used as the basis for developing the MATLAB implementation. The SISSO regression algorithm is detailed by the original authors in R. Ouyang, S. Curtarolo, E. Ahmetcik et al., Phys. Rev. Mater. 2, 083802 (2018), R. Ouyang, E. Ahmetcik, C. Carbogno, M. Scheffler, and L. M. Ghiringhelli, J. Phys.: Mater. 2, 024002 (2019).

Gasper, Paul↗
DOE OSTI2025

Metal additive manufacturing simulation across length, time, and computing scales

Metal additive manufacturing (AM) offers a unique opportunity for production of advanced materials and complex geometries. However, variability in microstructure and properties challenges conventional approaches to design, process optimization, qualification, and materials selection. Modeling and simulation can improve understanding of AM processing and materials, but also poses major challenges for existing computational methods. Simultaneously, modern scientific computing hardware has become increasingly complex, most notably with the adoption of hybrid architectures such as Graphical Processing Units (GPUs). If appropriately utilized, emerging computational capabilities provide an opportunity to reveal new insight into AM processing and the resulting material structure and properties. In this review we describe the computational AM landscape, identify critical gaps, and highlight opportunities to impact the development and application of AM. First, the requirements and challenges of representative AM problem statements will be defined. Here, these problems range from scientific studies to industrial applications and are designed to capture the breadth of challenges facing the AM community. Next, the current state of AM modeling and simulation is evaluated, broken down by enabling hardware and software, process simulation, microstructure simulation, and property simulation. Each section describes the diversity of simulation approaches and associated trade-offs in physical fidelity and computational expense. Each area is then assessed based on their suitability and readiness for current and developing computational architectures. Lastly, the greatest opportunities for future research and application are highlighted, including gaps in modeling capabilities, opportunities for near-term application, and key scientific challenges.

additive manufacturing↗
DOE OSTI2023

Steptoe Valley NV Data Compilation: Understanding a Stratigraphic Hydrothermal Resource through Geophysical Imaging

Sandia National Laboratories partnered with a multi-disciplinary group of subject matter experts to evaluate a stratigraphic geothermal resource in Steptoe Valley, Nevada using both established and novel geophysical imaging techniques. Provided here are a compilation of newly acquired data over the area and select modeling efforts. This encompasses a 3D geological model (inclusive of full Leapfrog files, Leapfrog viewer files, and XYZ data for faults and stratigraphy) with embedded geophysical modeling, controlled-source electromagnetic (CSEM) and magnetotelluric (MT) data packages, aqueous spring geochemistry data, seismic reflection interpretations, and a gravity data package. The stratigraphic reservoir in Steptoe Valley was previously discovered during oil and gas exploration. Subsequent studies, such as the Nevada Play Fairway Analysis, added data which further highlighted potential resource targets in the basin. Geophysical surveys, complimented with refined geologic mapping and geochemical sampling, were deployed to further characterize the resource. The resulting 3D geologic interpretation, conceptual model refinements, and reservoir simulations suggest that a power-capable reservoir is economically accessible in the Paleozoic carbonates of the deep/central basin. Additional geophysical characterization and exploration drilling efforts are recommended to calibrate interpretation and determine where/how to potentially develop the Steptoe resource. The geophysical tools, interpretations, lessons learned, and publicly available data generated by this study establish an exploration methodology to inform decisions for successful development of stratigraphic reservoirs.

15 GEOTHERMAL ENERGY↗
DOE OSTI2020

Identifying Entangled Physics Relationships through Sparse Matrix Decomposition to Inform Plasma Fusion Design [Slides]

The National Ignition Facility (NIF), is a large laser-based inertial confinement fusion (ICF) research device and various input variables in the experimental data are described. The overview included sections on: high-dimensional experimental dataset; surrogate model selection; ML to interpret complex coupling between inputs; importance of variables; Surrogate performance; and, future work.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

AI to Automate ModEx for Optimal Predictive Improvement and Scientific Discovery

Focal Areas: Data acquisition and assimilation enabled by machine learning, AI, advanced experimental optimization, unsupervised learning, and hardware-related AI efforts; Predictive modeling through AI techniques and AI-derived model components; Using AI to design a hierarchical model prediction system consisting and model selection; and, Interrogating complex data (observed and simulated) using AI, big data analytics, and other advanced methods such as explainable AI and physics- or knowledge-guided AI.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Hydrogen Risk Assessment Models (HyRAM) (V.3.1) (Technical Reference Manual)

The HyRAM software toolkit provides a basis for conducting quantitative risk assessment and consequence modeling for hydrogen infrastructure and transportation systems. HyRAM is designed to facilitate the use of state-of-the-art science and engineering models to conduct robust, repeatable assessments of hydrogen safety, hazards, and risk. HyRAM includes generic probabilities for hydrogen equipment failures, probabilistic models for the impact of heat flux on humans and structures, and experimentally validated first-order models of hydrogen release and flame physics. HyRAM integrates deterministic and probabilistic models for quantifying accident scenarios, predicting physical effects, and characterizing hydrogen hazards (thermal effects from jet res, overpressure effects from deflagrations), and assessing impact on people and structures. HyRAM is developed at Sandia National Laboratories for the U.S. Department of Energy to increase access to technical data about hydrogen safety and to enable the use of that data to support development and revision of national and international codes and standards. HyRAM is a research software in active development and thus the models and data may change. This report will be updated at appropriate developmental intervals. This document provides a description of the methodology and models contained in HyRAM version 3.1. There have been several impactful updates since version 3.0. HyRAM 3.1 contains a correction to use the volume fraction for two-phase speed of sound calculations; this only affects cryogenic releases in which two-phase ow (vapor and liquid) is predicted in the orifice. Other changes include clarifications that inputs for tank pressure should be given in absolute pressure, not gauge pressure. Additionally, the interface now rejects invalid inputs to probability distributions, and the less accurate single-point radiative source model selection was removed from the interface.

08 HYDROGEN↗
DOE OSTI2022

Production of Fischer-Tropsch Synfuels at Nuclear Plants

A case study analysis was performed to evaluate nuclear-powered synthetic fuel production in the midwestern United States (U.S.). A Fischer-Tropsch (FT) fuel synthesis plant design was used as the basis for the analysis. The FT plant design was configured to produce a product slate consisting of diesel fuel, jet fuel, and motor gasoline blend stocks from carbon dioxide (CO 2 ) and hydrogen (H 2 ) feedstocks. The CO 2 feedstock for the FT plant was assumed to be sourced from biorefineries in the region around a Midwest light water reactor (LWR) nuclear power plant (NPP). The analysis specifies that power from the LWR is used to produce H 2 via high-temperature steam electrolysis and to operate the FT synfuel production plant. Capital costs were estimated for the FT plant while capital costs for the electrolysis plant were based on previous Idaho National Laboratory (INL) studies. In addition to labor and maintenance costs for the FT and electrolysis plants, operating costs also include the costs for CO 2 feedstock transport. An analysis was performed to determine the cost of transporting CO 2 from the distributed biorefinery sources to the centralized fuel synthesis plant as a function of the synfuel plant capacity and corresponding CO 2 demand. The primary revenue streams are associated with sales of the synthetic fuel products. The synthetic fuel products will likely follow the same market trends as the conventional fuel products. The synfuel price data was thus based on projections made by the U.S. Energy Information Administration (EIA) 2021 Annual Energy Outlook (AEO) for conventional fuel products minus federal and state taxes, as well as marketing and distribution costs. The economic analysis also considered cases that included and excluded revenues from the 2022 Inflation Reduction Act (IRA) clean hydrogen production tax credit (PTC) of $\$ $3.00/kg for the first ten years of operation. The economic analysis calculated the net present value (NPV) for cases involving steady-state synfuel production for comparison with the NPV for a business-as-usual case in which NPP continues to sell only electric power to the grid. A synfuel production “Reference Case” was considered in addition to sensitivity cases in which the plant capacity, electricity price, and synthetic fuel product prices were perturbed. The synfuel production Reference Case considered a scenario in which the electrolysis and synfuel plants utilized a combined electrical load of 1000 megawatt electrical (MWe) from the LWR with the balance of the LWR power output being sold to the electric grid. The economic analysis suggests that the synfuel production Reference Case evaluated in this analysis would lead to considerable economic potential for near-term deployment of a nuclear-based synfuel production plant. Specifically, the economic analysis suggests that the deployment of a 1000 megawatt (MW) nuclear-powered synfuel plant could result in a NPV increase of approximately $\$ $1.7 billion for a case with no clean synfuel price premium relative to conventional petroleum fuels when accounting for the additional revenues from the 2022 IRA clean hydrogen PTCs of $\$ $3/kg. Sensitivity analysis was performed to evaluate the effect of perturbation of selected model input parameters on the NPV for the synfuel production Reference Case. The sensitivity analysis indicates that the plant capacity has the largest impact on the differential NPV, with a smaller synfuel production capacity resulting in a decrease in revenue when a larger fraction of the power from the NPP is sold to the grid and a smaller fraction of the power is used to produce synthetic fuel products. The synfuel product pricing has the next largest impact on the differential NPV, with lower synfuel prices resulting in decreased NPV from decreased synfuel sales revenue while higher synfuel prices result in increased NPV from increased synfuel sales revenue. Electricity pricing has a smaller effect on the NPV than the fuel sales price since, in the Reference Case, most of the energy from the NPP is used for synfuel production and a smaller amount of the system revenues are associated with electrical power sales. However, the electricity price sensitivity does indicate that the Synfuel Integrated Energy System (IES) would have a greater NPV than the business-as-usual case (e.g., grid power sales only) when electricity market prices are low, suggesting that synfuel production could provide a strategy for decreasing the economic risks to NPPs posed by a loss of revenues attributed to falling electricity market prices.

10 SYNTHETIC FUELS↗