Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “simulation modeling training analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Extreme Precipitation in the Southern US Great Plains in the Spring of 2015: Mechanisms and Prediction

During May of 2015, the southern US Great Plains and adjacent Gulf Coast region experienced more than twice the long-term mean precipitation, making it the wettest May since 1895. We investigate the physical mechanisms associated with this event using a suite of large-ensemble regional replay AGCM simulations from the NASA-GEOS model. In these simulations, certain regions of the globe are constrained to closely follow observations while the remainder of the domain is free running, allowing for the isolation of the remote regions that were important for the event. Preliminary analysis provides evidence that the extreme southern US precipitation was linked in part to positive precipitation anomalies in the central and eastern tropical Pacific via a wave train, which ultimately caused anomalous moisture flux from the Gulf of Mexico. An analysis of Subseasonal Experiment (SubX) model output was conducted to explore the subseasonal prediction skill of the event. Several models are able the predict the presence of positive precipitation anomalies in or near the southern US at lead times exceeding 10 days, albeit with errors in the locations and magnitude of the heaviest precipitation anomalies. A more thorough investigation with version 2 of NASA’s GEOS-S2S model shows that the prediction skill stems from the model’s ability to reasonably predict the positive tropical Pacific precipitation anomalies and the initiation of the Rossby wave train that is believed to be linked to the event. The potential causes for limitations in the prediction skill of this event will be explored.

Great Plains↗
DOE OSTI2024

Domain-Adaptive Neural Posterior Estimation for Strong Gravitational Lens Analysis

Modeling strong gravitational lenses is prohibitively expensive for modern and next-generation cosmic survey data. Neural posterior estimation (NPE), a simulation-based inference (SBI) approach, has been studied as an avenue for efficient analysis of strong lensing data. However, NPE has not been demonstrated to perform well on out-of-domain target data -- e.g., when trained on simulated data and then applied to real, observational data. In this work, we perform the first study of the efficacy of NPE in combination with unsupervised domain adaptation (UDA). The source domain is noiseless, and the target domain has noise mimicking modern cosmology surveys. We find that combining UDA and NPE improves the accuracy of the inference by 1-2 orders of magnitude and significantly improves the posterior coverage over an NPE model without UDA. We anticipate that this combination of approaches will help enable future applications of NPE models to real observational data.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

A Generative Model for Realistic Galaxy Cluster X-Ray Morphologies

Abstract The X-ray morphologies of clusters of galaxies display significant variations, reflecting their dynamical histories and the nonlinear dependence of X-ray emissivity on the density of the intracluster gas. Qualitative and quantitative assessments of X-ray morphology have long been considered a proxy for determining whether clusters are dynamically active or “relaxed.” Conversely, the use of circularly or elliptically symmetric models for cluster emission can be complicated by the variety of complex features realized in nature, spanning scales from megaparsecs down to the resolution limit of current X-ray observatories. In this work, we use mock X-ray images from simulated clusters from The Three Hundred project to define a basis set of cluster image features. We take advantage of the clusters’ approximate self-similarity to minimize the differences between images before encoding the remaining diversity through a distribution of high-order polynomial coefficients. Principal component analysis then provides an orthogonal basis for this distribution, corresponding to natural perturbations from an average model. This representation allows novel, realistically complex X-ray cluster images to be easily generated, and we provide code to do so. The approach provides a simple way to generate training data for cluster image analysis algorithms and could be straightforwardly adapted to generate clusters displaying specific types of features or selected by physical characteristics available in the original simulations.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2019

Frankenstein’s ROMster: Avoiding pitfalls of reduced-order model development

Reduced-order models (ROMs) are a widely used and powerful approach to reducing the complexity of predictive physics-based numerical simulations for a wide range of applications, including electronics and fluid mechanics such as geologic CO 2 sequestration (GCS). ROMs are critical for optimization, sensitivity analysis, model calibration and uncertainty quantification where full-order models cannot be feasibly executed many times. Traditional approaches generate a single ROM for each simulated response (e.g., CO 2 injection rates, pH changes) based on a set of training simulations. Here, we demonstrate that a single ROM can display excellent overall predictive statistics, but have predictions that dramatically and unacceptably deviate from simulator responses especially when the response variable has a large range (i.e., vary over multiple orders of magnitude). For example, we show that a traditional statistically-high-performing GCS ROM (coefficient of determination R 2 of 0.99) can have average absolute relative errors of over 200%. To address this, we propose a new and novel approach where a set of sub-ROMs are generated to overcome the potential pitfalls in traditional single ROM development. The effectiveness of the proposed approach—the ROMster framework—is demonstrated using a case study of predicted CO 2 injection rates for GCS. We find our approach is a robust and general framework for ROM development, reducing the average “error” from 200% to only 4% in our case study.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2016

System and Method for Outlier Detection via Estimating Clusters

An efficient method and system for real-time or offline analysis of multivariate sensor data for use in anomaly detection, fault detection, and system health monitoring is provided. Models automatically derived from training data, typically nominal system data acquired from sensors in normally operating conditions or from detailed simulations, are used to identify unusual, out of family data samples (outliers) that indicate possible system failure or degradation. Outliers are determined through analyzing a degree of deviation of current system behavior from the models formed from the nominal system data. The deviation of current system behavior is presented as an easy to interpret numerical score along with a measure of the relative contribution of each system parameter to any off-nominal deviation. The techniques described herein may also be used to "clean" the training data.

Iverson, David J.↗
DOE OSTI2024

Blueprints for Training Information Bottlenecks for Collider Analyses

Dimensionality reduction is a crucial aspect of data analysis in high energy physics, even if accompanied by information loss. Several methods, including histogram- and kernel-based analyses, are only computationally feasible for low-dimensional data. Furthermore, simulation models used in HEP can often only be validated for low-dimensional data. We provide several blueprints for using machine learning to create low-dimensional data representations (continuous event variables and discrete classification labels) for use in signal discovery and parameter estimation tasks. We also describe how to design the learned representation to facilitate a) searches with unknown model parameters and b) validation of simulation models in data control regions.

43 PARTICLE ACCELERATORS↗
DOE OSTI2025

TPCpp-10M: Simulated proton-proton collisions in a time projection chamber for AI foundation models

Scientific foundation models hold great promise for advancing nuclear and particle physics by improving analysis precision and accelerating discovery. Yet, progress in this field is often limited by the lack of openly available large scale datasets, as well as standardized evaluation tasks and metrics. Furthermore, the specialized knowledge and software typically required to process particle physics data pose significant barriers to interdisciplinary collaboration with the broader machine learning community. This work introduces a large, openly accessible dataset of 10 million simulated proton-proton collisions, designed to support self-supervised training of foundation models. To facilitate ease of use, the dataset is provided in a common NumPy format. In addition, it includes 70,000 labeled examples spanning three well defined downstream tasks: track finding, particle identification, and noise tagging, to enable systematic evaluation of the foundation model's adaptability. The simulated data are generated using the Pythia Monte Carlo event generator at a center of mass energy of $\sqrt{s}$ = 200 GeV and processed with Geant4 to include realistic detector conditions and signal emulation in the sPHENIX Time Projection Chamber at the Relativistic Heavy Ion Collider, located at Brookhaven National Laboratory. This dataset resource establishes a common ground for interdisciplinary research, enabling machine learning scientists and physicists alike to explore scaling behaviors, assess transferability, and accelerate progress toward foundation models in nuclear and high energy physics. The complete simulation and reconstruction chain is reproducible with the sPHENIX software stack. All data and code locations are provided under Data Accessibility.

Data Analysis, Statistics and Probability (physics↗
DOE OSTI2014

TU-C-17A-04: BEST IN PHYSICS (THERAPY) - A Supervised Framework for Automatic Contour Assessment for Radiotherapy Planning of Head- Neck Cancer

Purpose: Precise contour delineation of tumor targets and critical structures from CT simulations is essential for accurate radiotherapy (RT) treatment planning. However, manual and automatic delineation processes can be error prone due to limitations in imaging techniques and individual anatomic variability. Tedious and laborious manual verification is hence needed. This study develops a general framework for automatically assessing RT contours for head-neck cancer patients using geometric attribute distribution models (GADMs). Methods: Geometric attributes (centroid and volume) were computed from physician-approved RT contours of 29 head-neck patients. Considering anatomical correlation between neighboring structures, the GADM for each attribute was trained to characterize intra- and interpatient structure variations using principal component analysis. Each trained GADM was scalable and deformable, but constrained by the principal attribute variations of the training contours. A new hierarchical model adaptation algorithm was utilized to assess the RT contour correctness for a given patient. Receiver operating characteristic (ROC) curves were employed to evaluate and tune system parameters for the training models. Results: Experiments utilizing training and non-training data sets with simulated contouring errors were conducted to validate the framework performance. Promising assessment results of contour normality/abnormality for the training contour-based data were achieved with excellent accuracy (0.99), precision (0.99), recall (0.83), and F-score (0.97), while corresponding values of 0.84, 0.96, 0.83, and 0.9 were achieved for the non-training data. Furthermore, the areas under the ROC curves were above 0.9, validating the accuracy of this test. Conclusion: The proposed framework can reliably identify contour normality/abnormality based upon intra- and inter-structure constraints derived from clinically-approved contours. It also allows physicians to analytically determine the system parameters to fit various clinic requirements (e.g. as-low-as-possible false positives). It has great potential for improving RT work flow. More geometric attributes and training sets will be investigated to improve framework performance in the future.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

MADLens, a python package for fast and differentiable non-Gaussian lensing simulations

Here, we present MADLens a python package for producing non-Gaussian lensing convergence maps at arbitrary source redshifts with unprecedented precision. MADLens is designed to achieve high accuracy while keeping computational costs as low as possible. A MADLens simulation with only particles produces convergence maps whose power agrees with theoretical lensing power spectra up to within the accuracy limits of HaloFit. This is made possible by a combination of a highly parallelizable particle-mesh algorithm, a sub-evolution scheme in the lensing projection, and a machine-learning inspired sharpening step. Further, MADLens is fully differentiable with respect to the initial conditions of the underlying particle-mesh simulations and a number of cosmological parameters. These properties allow MADLens to be used as a forward model in Bayesian inference algorithms that require optimization or derivative-aided sampling. Another use case for MADLens is the production of large, high resolution simulation sets as they are required for training novel deep-learning-based lensing analysis tools. We make the MADLens package publicly available under a Creative Commons License

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

The Artificial Scientist: in-Transit Machine Learning of Plasma Simulations

Large-scale simulations or scientific experiments produce petabytes of data per run. This poses massive challenges for I/O and storage when scientific analysis workflows are run manually offline. Unsupervised deep learning-based techniques to extract patterns and non-linear relations from these large amounts of data provide a way to build scientific understanding from raw data, reducing the need for manual pre-selection of analysis steps, but require exascale compute and memory to process the full dataset available. In this paper, we demonstrate a heterogeneous streaming workflow in which plasma simulation data is streamed directly to a Machine Learning (ML) application training a model on the simulation data in-transit, completely circumventing the capacity-constrained filesystem bottleneck. This workflow employs openPMD to provide a high level interface to describe scientific data and also uses ADIOS2, to transfer volumes of data that exceed the capabilities of the filesystem. We employ experience replay to avoid catastrophic forgetting in learning from this non-steady state process in a continual manner and adapt it to improve model convergence while learning in-transit. As a proof-of-concept, we approach the ill-posed inverse problem of predicting particle dynamics from radiation in a particle-incell (PIConGPU) simulation of the Kelvin-Helmholtz instability (KHI). We detail hardware-software co-design challenges as we scale PIConGPU to full Frontier, the Top-1 system as of June 2024 Top500 list.

Kelling, Jeffrey [Helmholtz-Zentrum Dresden Rossen↗
DOE OSTI2024

Reinforcement Learning-Based Approach for EMT Automation of Large-Scale PV Plants

In the pursuit of efficient and precise modeling of large-scale power systems, particularly utility-scale photovoltaic (PV) plants, Electromagnetic Transient (EMT) simulations play a crucial role. As utility-scale PV plants increase in size and complexity, traditional computational methods become inadequate, necessitating more advanced techniques. This paper highlights the progressive efforts made to accelerate EMT simulations. A novel continuous reinforcement learning (RL) strategy is explored to automate the differentiation and categorization of stiff and non-stiff differential algebraic equations (DAEs). The use of stiff and non-stiff integration methods applied to relevant parts of the DAEs assists with the speed-up of the simulations. The paper details the data acquisition, development and offline training of the RL model, leading to its validation that demonstrates a high precision in optimizing simulation methods. The proposed RL promises to significantly enhance the efficacy of EMT simulations, offering a robust framework for the future of power system analysis.

Xia, Qianxue↗
DOE OSTI2021

TRUST Contact Thermal Conductance (CTC) Report

The objective of the Delivery Environments (DE) Testbeds to Reduce Uncertainties in Simulations and Tests (TRUST) work package is to quantify and help increase confidence in specific areas of computational and experimental capabilities that are applicable to current and future delivery environments. More complete quantification of confidence in experimental and computational capabilities and the sufficient increase of confidence in those capabilities is critical to improving weapons engineering design, qualification, and assessment efforts that are critical to the current and future stockpile. Staff development will include cross-discipline training to provide engineers with experience in both numerical simulations and experimental methods. This work will use and provide feedback on analysis tools and experimental results databases for efficient and responsive engineering which are currently under development: engineering common model framework (ECMF), engineering quantification of margins and uncertainties (EQMU), and the test information management system (TIMS).

42 ENGINEERING↗
DOE OSTI2021

TRUST End-of-Year Report

The objective of the Delivery Environments (DE) Testbeds to Reduce Uncertainties in Simulations and Tests (TRUST) work package is to quantify and help increase confidence in specific areas of computational and experimental capabilities that are applicable to current and future delivery environments. More complete quantification of confidence in experimental and computational capabilities and the sufficient increase of confidence in those capabilities is critical to improving weapons engineering design, qualification, and assessment efforts that are critical to the current and future stockpile. Staff development will include cross-discipline training to provide engineers with experience in both numerical simulations and experimental methods. This work will use and provide feedback on analysis tools and experimental results databases for efficient and responsive engineering which are currently under development: engineering common model framework (ECMF), engineering quantification of margins and uncertainties (EQMU), and the test information management system (TIMS). TRUST includes four testbeds and their associated engineering analysis baseline models (EABMs): 1. contact thermal conductivity (CTC); 2. nonlinear dynamics (ND); 3. sensors in environments for accelerometers (SEA); 4. sensors in environments for fiber optic displacement gages (SEFOD).

42 ENGINEERING↗
DOE OSTI2021

TRUST Nonlinear Dynamics (ND) Report

The objective of the Delivery Environments (DE) Testbeds to Reduce Uncertainties in Simulations and Tests (TRUST) work package is to quantify and help increase confidence in specific areas of computational and experimental capabilities that are applicable to current and future delivery environments. More complete quantification of confidence in experimental and computational capabilities and the sufficient increase of confidence in those capabilities is critical to improving weapons engineering design, qualification, and assessment efforts that are critical to the current and future stockpile. Staff development will include cross-discipline training to provide engineers with experience in both numerical simulations and experimental methods. This work will use and provide feedback on analysis tools and experimental results databases for efficient and responsive engineering which are currently under development: engineering common model framework (ECMF), engineering quantification of margins and uncertainties (EQMU), and the test information management system (TIMS).

42 ENGINEERING↗
DOE OSTI2022

TRUST Contact Thermal Conductance (TRUST-CTC) Report: FY2022

The objective of the Delivery Environments (DE) Testbeds to Reduce Uncertainties in Simulations and Tests (TRUST) work package is to quantify and help increase confidence in specific areas of computational and experimental capabilities that are applicable to current and future delivery environments. More complete quantification of confidence in experimental and computational capabilities and the sufficient increase of confidence in those capabilities is critical to improving weapons engineering design, qualification, and assessment efforts that are critical to the current and future stockpile. Staff development will include cross-discipline training to provide engineers with experience in both numerical simulations and experimental methods. This work will use and provide feedback on analysis tools and experimental results databases for efficient and responsive engineering which are currently under development: engineering common model framework (ECMF), engineering quantification of margins and uncertainties (EQMU), test information management system (TIMS), and [WAVES] Analysis for Verified Engineering Simulation (WAVES).

42 ENGINEERING↗
DOE OSTI2023

TRUST Contact Thermal Conductance (TRUST-CTC) Report: FY23

The objective of the Delivery Environments (DE) Testbeds to Reduce Uncertainties in Simulations and Tests (TRUST) work package is to quantify and help increase confidence in specific areas of computational and experimental capabilities that are applicable to current and future delivery environments. More complete quantification of confidence in experimental and computational capabilities and the sufficient increase of confidence in those capabilities is critical to improving weapons engineering design, qualification, and assessment efforts that are critical to the current and future stockpile. Staff development will include cross-discipline training to provide engineers with experience in both numerical simulations and experimental methods. This work will use and provide feedback on analysis tools and experimental results databases for efficient and responsive engineering which are currently under development: engineering common model framework (ECMF), engineering quantification of margins and uncertainties (EQMU), test information management system (TIMS), and [WAVES] Analysis for Verified Engineering Simulation (WAVES).

42 ENGINEERING↗
DOE OSTI2024

Population-level Dark Energy Constraints from Strong Gravitational Lensing using Simulation-Based Inference

In this work, we present a scalable approach for inferring the dark energy equation-of-state parameter ($w$) from a population of strong gravitational lens images using Simulation-Based Inference (SBI). Strong gravitational lensing offers crucial insights into cosmology, but traditional Monte Carlo methods for cosmological inference are computationally prohibitive and inadequate for processing the thousands of lenses anticipated from future cosmic surveys. New tools for inference, such as SBI using Neural Ratio Estimation (NRE), address this challenge effectively. By training a machine learning model on simulated data of strong lenses, we can learn the likelihood-to-evidence ratio for robust inference. Our scalable approach enables more constrained population-level inference of $w$ compared to individual lens analysis, constraining $w$ to within $1\sigma$.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS1998

Neural Networks for Rapid Design and Analysis

Artificial neural networks have been employed for rapid and efficient dynamics and control analysis of flexible systems. Specifically, feedforward neural networks are designed to approximate nonlinear dynamic components over prescribed input ranges, and are used in simulations as a means to speed up the overall time response analysis process. To capture the recursive nature of dynamic components with artificial neural networks, recurrent networks, which use state feedback with the appropriate number of time delays, as inputs to the networks, are employed. Once properly trained, neural networks can give very good approximations to nonlinear dynamic components, and by their judicious use in simulations, allow the analyst the potential to speed up the analysis process considerably. To illustrate this potential speed up, an existing simulation model of a spacecraft reaction wheel system is executed, first conventionally, and then with an artificial neural network in place.

Sparks, Dean W., Jr.↗