SEARCH · Engineering Papers

Results for “deep generative models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Hybrid geological modeling: Combining machine learning and multiple-point statistics

Accurately modeling and constructing a geologically realistic subsurface model remains an outstanding problem as the morphology controls the flow behaviors. Particularly, one of the pattern-based methods, namely cross-correlation based simulation, has been proved to be an effective way to reconstruct a realistic model, at both small and large scales. However, conditioning to point data in the large-scale problems is still a crucial issue in these algorithms, since there is always a trade-off between the quality of the realizations and the degree of point data reproduction. Specifically, it is not practical to build a training image (TI) which includes all the possibilities and variabilities. Therefore, finding a pattern that can represent the point data and, at the same time, preserving the connectivities is difficult. This leads to producing highly-connected realizations with a significant mismatch or poor models with a reasonable degree of point data reproduction. To accurately reproduce the densely distributed hard data, pixel-based methods can also produce some unrealistic artifacts around the hard data. In this paper, to overcome this challenge, however, we use pattern-based methods as they often produce more disconnected geobodies when dealing with dense hard data, and proposed a hybrid algorithm using the pattern-based methods and convolutional neural network (CNN). The trained CNN model is utilized to improve the quality of conditioning to point data for the original realizations generated by the pattern-based algorithm. As such, the mismatch locations are identified, and the same regions are used in the training of CNN to mimic the procedure through which a missing region can be filled. To evaluate the performance of the proposed hybrid algorithm, it is tested on cases with different dimensions and different numbers of facies. Then, the newly improved realizations are compared with the initial realizations generated by the pattern-based algorithm. The comparison is also conducted by the flow simulation test. And it indicates that the proposed hybrid algorithm can better reproduce the point data, while the connectivities are better preserved.

58 GEOSCIENCES↗

DOE OSTI2023

Deep Learning for Multigroup Cross-Section Representation in Two-Step Core Calculations

Here we investigate using deep learning, a type of machine-learning algorithm employing multiple layers of artificial neurons, for the mathematical representation of multigroup cross sections for use in the Griffin reactor multiphysics code for two-step deterministic neutronics calculations. A three-dimensional fuel element typical of a high-temperature gas reactor as well as a two-dimensional sodium-cooled fast reactor lattice are modeled using the Serpent Monte Carlo code, and multigroup macroscopic cross sections are generated for various state parameters to produce a training data set and a separate validation data set. A fully connected, feedforward neural network is trained using the open-source PyTorch machine-learning framework, and its accuracy is compared against the standard piecewise linear interpolation model. Additionally, we provide in this work a generic technique for propagating the cross-section model errors up to the k eff using sensitivity coefficients with the first-order uncertainty propagation rule. Quantifying the eigenvalue error due to the cross-section regression errors is especially practical for appropriately selecting the mathematical representation of the cross sections. We demonstrate that the artificial neural network model produces lower errors and therefore enables better accuracy relative to the piecewise linear model when the cross sections exhibit nonlinear dependencies; especially when a coarse grid is employed, where the errors can be halved by the artificial neural network. However, for linearly dependent multigroup cross sections as found for the sodium-cooled fast reactor case, a simpler linear regression outperforms deeper networks.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2024

Calibrating Bayesian generative machine learning for Bayesiamplification

Recently, combinations of generative and Bayesian deep learning have been introduced in particle physics for both fast detector simulation and inference tasks. These neural networks aim to quantify the uncertainty on the generated distribution originating from limited training statistics. The interpretation of a distribution-wide uncertainty however remains ill-defined. We show a clear scheme for quantifying the calibration of Bayesian generative machine learning models. For a Continuous Normalizing Flow applied to a low-dimensional toy example, we evaluate the calibration of Bayesian uncertainties from either a mean-field Gaussian weight posterior, or Monte Carlo sampling network weights, to gauge their behaviour on unsteady distribution edges. Well calibrated uncertainties can then be used to roughly estimate the number of uncorrelated truth samples that are equivalent to the generated sample and clearly indicate data amplification for smooth features of the distribution.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

A non-cooperative meta-modeling game for automated third-party calibrating, validating and falsifying constitutive laws with parallelized adversarial attacks

The evaluation of constitutive models, especially for high-risk and high-regret engineering applications, requires efficient and rigorous third-party calibration, validation and falsification. While there are numerous efforts to develop paradigms and standard procedures to validate models, difficulties may arise due to the sequential, manual, and often biased nature of the commonly adopted calibration and validation processes, thus slowing down data collections, hampering the progress towards discovering new physics, increasing expenses and possibly leading to misinterpretations of the credibility and application ranges of proposed models. This work attempts to introduce concepts from game theory and machine learning techniques to overcome many of these existing difficulties. Here, we introduce an automated meta-modeling game where two competing AI agents systematically generate experimental data to calibrate a given constitutive model and to explore its weakness such that the experiment design and model robustness can be improved through competitions. The two agents automatically search for the Nash equilibrium of the meta-modeling game in an adversarial reinforcement learning framework without human intervention. In particular, a protagonist agent seeks to find the more effective ways to generate data for model calibrations, while an adversary agent tries to find the most devastating test scenarios that expose the weaknesses of the constitutive model calibrated by the protagonist. By capturing all possible design options of the laboratory experiments into a single decision tree, we recast the design of experiments as a game of combinatorial moves that can be resolved through deep reinforcement learning by the two competing players. Our adversarial framework emulates idealized scientific collaborations and competitions among researchers to achieve a better understanding of the application range of the learned material laws and prevent misinterpretations caused by conventional AI-based third-party validation. Numerical examples are given to demonstrate the wide applicability of the proposed meta-modeling game with adversarial attacks on both human-crafted constitutive models and machine learning models.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

GLAD-M35: a joint P and S global tomographic model with uncertainty quantification

We present our third and final generation joint P and S global adjoint tomography (GLAD) model, GLAD-M35, and quantify its uncertainty based on a low-rank approximation of the inverse Hessian. Starting from our second-generation model, GLAD-M25, we added 680 new earthquakes to the database for a total of 2160 events. New P-wave categories are included to compensate for the imbalance between P- and S-wave measurements, and we enhanced the window selection algorithm to include more major-arc phases, providing better constraints on the structure of the deep mantle and more than doubling the number of measurement windows to 40 million. Two stages of a Broyden–Fletcher–Goldfarb–Shanno (BFGS) quasi-Newton inversion were performed, each comprising five iterations. With this BFGS update history, we determine the model’s standard deviation and resolution length through randomized singular value decomposition.

58 GEOSCIENCES↗

DOE OSTI2026

Dataset for Top Model Decision Tree: Selecting Segmentation Models for Reliable Quantitative Analysis in Low- and Ultralow-Dose CryoEM

Motivation Multiple deep learning model architectures can be used to segment bacterial membranes in cryoEM images. However, an AI-based tool advancement is often presented with only a single segmentation model for broad use, and this single model may show inconsistent results across datasets from different users. Here, we present the Top Model Decision Tree, a model screening framework to screen for the best model to generate bacterial inner and outer membrane masks based on user priorities. We use pre-trained segmentation models from YOLOv11, YOLO26, U-Net, Detectron2 and SAM3 fine-tuned on bacterial inner and outer membranes imaged with cryoEM. Run the Framework This notebook must be opened in Google Colab. Mount Google Drive and run with a GPU-based runtime. Open the notebook and follow steps to git clone in folders and files within this repository. There will be a repeating top_model_decision_tree.ipynb (notebook clone) that will not be used. Save your .png binary mask files and .csv table outputs within your Google Drive or download before closing the notebook. The models and all analysis/training scripts are available at [GitHub: https://github.com/Lynnicia/CryoEM_membranes_top_model_decision_tree and https://github.com/Sireesiru/Semantic-Segmentation-of-bacterial-cell-envelope-using-U-Nets.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2025

Snowmass 2021 cross frontier report: Dark matter complementarity

The fundamental nature of Dark Matter is a central theme of the Snowmass 2021 process, extending across all frontiers. In the last decade, advances in detector technology, analysis techniques and theoretical modeling have enabled a new generation of experiments and searches while broadening the types of candidates we can pursue. Over the next decade, there is great potential for discoveries that would transform our understanding of dark matter. In the following, we outline a road map for discovery developed in collaboration among the frontiers. A strong portfolio of experiments that delves deep, searches wide, and harnesses the complementarity between techniques is key to tackling this complicated problem, requiring expertise, results, and planning from all Frontiers of the Snowmass 2021 process.

Boveia, Antonio [The Ohio State Univ., Columbus, O↗

DOE OSTI2022

Dark Matter Complementarity (Snowmass 2021 Cross Frontier Report: Extended Version)

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

NASA NTRS2002

Shear Instabilities as a Probe of Jupiter's Atmosphere

Linear wave patterns in Jupiter clouds with wavelengths strongly clustered around 300 km are commonly observed in the planet's equatorial atmosphere. We propose that the preferred wavelength is related to the thickness of an unstable shear layer within the clouds. We numerically analyze the linear stability of wavelike disturbances that have nonzero horizontal phase speeds in Jupiter's atmosphere and find that. if the static stability in the strongly clustered around 300 km are commonly observed in the planet's equatorial atmosphere. We propose that the preferred wavelength is related to the thickness of an unstable shear layer within the clouds. We numerically analyze the linear stability of wavelike disturbances that have nonzero horizontal phase speeds in Jupiter's atmosphere and find that. if the static stability in the shear layer is very low (but still nonnegative), a deep vertical shear layer like the one measured by the Galileo probe can generate the instabilities. The fastest growing waves grow exponentially within an hour, and their wavelengths match the observations. Close to zero values of static stability that permit the growth of instabilities are within the range of values measured by the Galileo probe in a hot spot. Our model probes Jupiter's equatorial atmosphere below the cloud deck and suggests that thick regions of wind shear and low static stability exist outside hot spots.

Bosak, Tanja↗

NASA NTRS2002

Hot HB Stars in Globular Clusters - Physical Parameters and Consequences for Theory. VI. The Second Parameter Pair M3 and M13

We present the results of spectroscopic analyses of hot horizontal branch (HB) stars in M13 and M3, which form a famous second parameter pair. From the spectra we derived - for the first time in M13 - atmospheric parameters (effective temperature and surface gravity) as well as abundances of helium, magnesium, and iron. Consistent with analyses of hot HB stars in other globular clusters we find evidence for helium depletion and iron enrichment in stars hotter than about 12,000 K in both M3 and M13. Accounting for the iron enrichment substantially improves the agreement with canonical evolutionary models, although the derived gravities and masses are still somewhat too low. This remaining discrepancy may be an indication that scaled-solar metal-rich model atmospheres do not adequately represent the highly non-solar abundance ratios found in blue HB stars with radiative levitation. We discuss the effects of an enhancement in the envelope helium abundance on the atmospheric parameters of the blue HB stars, as might be caused by deep mixing on the red giant branch or primordial pollution from an earlier generation of intermediate mass asymptotic giant branch stars.

Moehler, S.↗

NASA NTRS2003

Hot HB Stars in Globular Clusters: Physical Parameters and Consequences for Theory: The Second Parameter Pair M 3 and M 13 - VI

We present the results of spectroscopic analyses of hot horizontal branch (HB) stars in M 13 and M 3, which form a famous "second parameter" pair. F rom the spectra and Stromgren photometry we derived - for the first time in M 13 - atmospheric parameters (effective temperature and surface gravity). For stars with Stromgren temperatures between 10,000 and 12,000 K we found excellent agreement between the atmospheric parameters derived from Stromgren photometry and those derived from Balmer line profile fits. However, for cooler stars there is a disagreement in the parameters derived by the two methods, for which we have no satisfactory explanation. Stars hotter than 12,000 K show evidence for helium depletion and iron enrichment, both in M 3 and M 13. Accounting for the iron enrichment substantially improves the agreement with canonical evolutionary models, although the derived gravities and masses are still somewhat too low. This remaining discrepancy may be an indication that scaled-solar metal-rich model atmospheres do not adequately represent the highly non-solar abundance ratios found in blue HB stars affected by diffusion. We discuss the effects of an enhancement in the envelope helium abundance on the atmospheric parameters of the blue HB stars, as might be caused by deep mixing on the red giant branch or primordial pollution from an earlier generation of intermediate mass asymptotic giant branch stars. Key words. Stars: atmospheres - Stars: evolution - Stars: horizontal branch - Globular clusters: individual: M 3 - Globular clusters: individual: M 13

Moehler, S.↗

NASA NTRS2022

Evolution of Biological Satellites: From Low Earth Orbit to NASA’s BioSentinel Deep Space Mission

NASA has set its sights on human exploration in deep space with the Artemis missions, with an ambitious plan to put astronauts back on the Moon and to eventually land human missions on Mars. Such missions will require significant countermeasures, likely both technological and biomedical, to protect biology from chronic radiation exposure. Small satellites like CubeSats can inform these countermeasures by querying relevant space environments with model organisms over relevant durations. NASA has launched five biological CubeSats into low Earth orbit (LEO) from GeneSat in 2006 to EcAMSat in 2017. Each one of these missions increased our understanding of the effects of spaceflight, while refining technologies and imparting valuable lessons to the next generation of CubeSats. The Artemis I rocket will carry ten CubeSats, each of them with its own objective. One in particular, BioSentinel, will conduct the first study of the biological response to interplanetary space radiation beyond LEO since Apollo 17. Once it reaches its heliocentric orbit – after a short lunar fly-by – BioSentinel will measure the DNA damage response to ambient radiation in a model organism, the budding yeast Saccharomyces cerevisiae, which will be compared to information provided by an onboard radiation sensor and to data obtained in LEO (on ISS) and on Earth. Once in interplanetary space, fluidic cards containing desiccated yeast cells will be activated by growth medium addition at different time points throughout the mission. Growth and metabolic activity will be tracked continuously via optical density. BioSentinel is a complete, autonomous spacecraft capable of conducting experiments in deep space. Its 4U BioSensor payload is a fully automated and adaptable platform that can perform biological measurements with a range of microorganisms in multiple space environments, including the ISS, free flyers, and other platforms like the Lunar Gateway and lander vehicles.

Sergio R Santa Maria↗

DOE OSTI2022

Autoencoders for semivisible jet detection

The production of dark matter particles from confining dark sectors may lead to many novel experimental signatures. Depending on the details of the theory, dark quark production in proton-proton collisions could result in semivisible jets of particles: collimated sprays of dark hadrons of which only some are detectable by particle collider experiments. The experimental signature is characterised by the presence of reconstructed missing momentum collinear with the visible components of the jets. This complex topology is sensitive to detector inefficiencies and mis-reconstruction that generate artificial missing momentum. With this work, we propose a signal-agnostic strategy to reject ordinary jets and identify semivisible jets via anomaly detection techniques. A deep neural autoencoder network with jet substructure variables as input proves highly useful for analyzing anomalous jets. The study focuses on the semivisible jet signature; however, the technique can apply to any new physics model that predicts signatures with anomalous jets from non-SM particles.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2021

Evaluation of the PhaseNet Model Applied to the IMS Seismic Network

Producing a complete and accurate set of signal detections is essential for automatically building and characterizing seismic events of interest for nuclear explosion monitoring. Signal detection algorithms have been an area of research for decades, but still produce large quantities of false detections and misidentify real signals that must be detected to produce a complete global catalog of events of interest. Deep learning methods have shown promising capabilities in effectively characterizing seismic signals for complex tasks such as identifying phase arrival times. We use the PhaseNet model, a UNet-based Neural Network, trained on local distance data from northern California to predict seismic arrivals on data from the International Monitoring System (IMS) global network. We use an analyst-curated bulletin generated from this data set to compare the performance of PhaseNet to that of the Short-Term Average/Long-Term Average (STA/LTA) algorithm. We find that PhaseNet has the potential of outperforming traditional processing methods and recommend the training of a new model with the IMS data to achieve optimal performance.

58 GEOSCIENCES↗

DOE OSTI2022

Combinatorial Evaluation of Physical Feature Engineering, Classical Machine Learning, and Deep Learning Models for Synchrophasor Data at Scale

A major objective of the project was to train and evaluate the effectiveness of multiple event and anomaly detection, identification and classification deep temporal learning models for processing of real-time phasor measurement unit (PMU) data streams. A vast dataset, consisting of two years of phasor measurements from all three U.S. Interconnections, was curated and released by the Department of Energy (DOE) through Pacific Northwest National Laboratory (PNNL). The dataset also included an event log that provided event times and types (e.g. generator trips, line trips, planned service events, transformer operations, etc.). Our analysis of this dataset addressed six (6) of the eleven (11) research priorities identified in Funding Opportunity Announcement (FOA) DE-FOA-0001861 “Big Data Analysis of Synchrophasor Data” (FOA 1861). Rather than being limited to pre-determined specific algorithms, this project relied on the uniquely structured, highly performant underlying time series database capabilities of the PredictiveGrid platform to assess the vast dataset utilizing a wide variety of algorithms.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2024

FY24 Progress Report: SRNL Analysis of ICCWR LCM and WAMS data for Corrosion and Cracking

Algorithms for Machine Learning (ML) and data analysis for the 3013 Surveillance Program have been developed in an ongoing collaborative effort by the Savannah River National Laboratory (SRNL) and the University of South Carolina (USC). The objective of the algorithms is to automate the identification of corrosion and crack formation in the Inner Container Closure Weld Region (ICCWR) of the canister system used to store Pu-bearing material. Data for corrosion and cracking is collected from large binary files generated by a Laser Confocal Microscope (LCM), the Wide Area 3D Measurement System (WAMS), or,in a recent proposal, by a Scanning Electron Microscope (SEM). The ML software uses the physical attributes in the data files (e.g., one or more of: height, color, and 16-bit grayscale values as functions of position in a plane projection) to detect signs of surface corrosion and cracking after being trained on similar data, with the features to be detected. Although the initial scope included screening for broader indicators of corrosion, e.g., pitting, identification of potential cracks was prioritized for the past several years at the request of program leadership. Labeled training data is essential to developing the ML algorithm, and enhancements to data labeling capability have been developed to address this essential precursor to application of ML routines. Efficient labeling is particularly important in view of the large volume of data required to train ML algorithms and the relative rarity of cracks in the ICCWR data set. The updated program will read binary data from either LCM, WAMS or SEM files, interrogate data attributes, facilitate user labeling of data for training ML algorithms, execute ML algorithms, output parameters from trained ML algorithms, report ML model accuracy with respect to labeled data, and generate graphical representations for various analyses. In FY24, hourglass neural networks (HNNs) that were initiated in FY22 were further developed and tested using available LCM data, and their performance was tested against that of the alternative U-Net Neural Network algorithm structure. HNNs along with previously developed Convolutional Neural Networks (CNNs) and Deep Neural Networks (DNNs) comprise a suite of ML tools for identification of cracks in the ICCWR

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

NASA NTRS1991

The formation of antipodal-impact terrains on Mars

The regions antipodal to Mars' three largest impact basins, Hellas, Isidis, and Argyre, were assessed for evidence of impact induced seismically disrupted terrains. Photogeology and preliminary computer modeling using the Simplified Arbitrary Lagrangian-Eulerian computer program suggest such terrain could have been formed by the Hellas and Isidis impacts. Previously, the only assessment of potential surface disruptions on Mars antipodal to large impacts was by Peterson (1978). Herein, the results give credence to Peterson's assertions. For Hellas, the computer model clearly suggests that antipodal pressures were probably strong enough to have fractured the crust and disrupted the surface, and may account for aspects of volcanism at Alba Patera. It is suggested that the Hellas impact produced sufficient focused energy at its antipode to produce deep fracture in the Martian crust centered below the current caldera for Alba Petera. With the generation and evolution of magma in the Tharsis area, the fracture system provided a ready conduit for early stage eruptions of Martians lavas derived from deep in the crust and/or upper mantle, perhaps of komatiitic composition.

Williams, D. A.↗

NASA NTRS2019

NASA’s Galactic Cosmic Ray Simulator at Brookhaven National Laboratory: Enabling Human Exploration Missions to the Moon and Mars

With exciting new Agency plans for a sustainable return to the moon, astronauts will once again leave earth’s protective magnetosphere only to endure higher levels of radiation from galactic cosmic rays (GCR) and the possibility of a large solar particle event (SPE). Gateway, lunar landers, and surface habitats will be designed to protect crew against SPE’s with vehicle optimization, storm shelter concepts, and/or active dosimetry; however, the ever-penetrating GCR will continue to pose the most significant health risks especially as lunar missions increase in duration and as NASA sets its aspirations on Mars. The primary risks of concern include epithelial carcinogenesis and leukemia, central nervous system effects resulting in potential in-mission cognitive or behavioral impairment and/or late neurological disorders, degenerative tissue effects including cataracts, circulatory and heart disease, as well as, potential immune system decrements impacting multiple aspects of crew health. Characterization and mitigation of these risks requires a significant reduction in the large biological uncertainties of chronic (low-dose rate) heavy ion exposures and the validation of countermeasures in a relevant space environment. NASA has developed the “GCR Simulator” at Brookhaven National Laboratory to generate a spectrum of ion beams that approximates the primary and secondary GCR field experienced at human organ locations within a deep-space vehicle. The majority of the dose is delivered from protons (~65-75%) and alpha particles (~10-20%) with heavier ions (Z≤3) contributing the remainder. The “GCR Simulator” exposes state-of-the art cellular and animal model systems to 33 sequential beams including 4 proton energies plus degrader, 4 helium energies plus degrader, and the five heavy ions of C, O, Si, Ti, and Fe. A polyethylene degrader is used with the 100 MeV/n H and He beams to provide a nearly continuous distribution of low energy particles. A 500 mGy exposure, delivering doses from each of the 33 beams, requires 75-90 minutes. To more closely simulate the low dose rates found in space, sequential field exposures can be divided into daily fractions over 2-4 weeks, with individual fractions as low as 0.1-0.2 mGy. In the large beam configuration (60 x 60 cm(exp 2)), 54 special housing cages can accommodate 2-3 mice each for a 70-75 min duration or ~15 individually housed rats. Emerging research results from our 2018 runs utilizing mixed heavy ion fields and protracted space exposures are forthcoming and deepen our understanding of the numerous health risks faced by our astronauts. This paper discusses NASA’s innovative technology solution for a ground-based GCR simulator at the NASA Space Radiation Laboratory to enable future exploration missions.

Lisa C Simonsen↗