Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “deep generative models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Machine Learning Tools Set for Natural Gas Fuel Cell System Design

This study is focusing on leveraging the system design tools set for the next-generation solid oxide fuel cell (SOFC) based natural gas fuel cell (NGFC) system. Conventionally, system design and optimization of NGFC systems rely heavily on traditional reduced order model (ROM) techniques and designers’ experience level. For overcoming the technical barriers of system design, multiple multi-physics models and machine learning (ML) tools have been utilized to automate the conceptual design process and enhance the reliability of solutions for the NGFC system. The proposed tools set includes a physics-informed ML tool for automated ROM construction that leverages advances in deep neural networks to significantly reduce ROM prediction error for the NGFC power island compared to traditional approaches. The constructed physics-informed ML ROM can be used in system design, and optimization tools set Institute for the Design of Advanced Energy Systems (IDAES) Process Systems Engineering (PSE) framework. The tools set also provides a user-friendly graphic user interface built within Jupyter Notebooks, and the complete tools set is open-source public available.

Wang, Dewei↗
DOE OSTI2021

Learning to Correct Climate Projection Biases

The fidelity of climate projections is often undermined by biases in climate models due to their simplification or misrepresentation of unresolved climate processes. While various bias correction methods have been developed to post-process model outputs to match observations, existing approaches usually focus on limited, low-order statistics, or break either the spatiotemporal consistency of the target variable, or its dependency upon model resolved dynamics. We develop a Regularized Adversarial Domain Adaptation (RADA) methodology to overcome these deficiencies, and enhance efficient identification and correction of climate model biases. Instead of pre-assuming the spatiotemporal characteristics of model biases, we apply discriminative neural networks to distinguish historical climate simulation samples and observation samples. The evidences based on which the discriminative neural networks make distinctions are applied to train the domain adaptation neural networks to bias correct climate simulations. We regularize the domain adaptation neural networks using cycle-consistent statistical and dynamical constraints. An application to daily precipitation projection over the contiguous United States shows that our methodology can correct all the considered moments of daily precipitation at approximately $1^\circ$ resolution, ensures spatiotemporal consistency and inter-field correlations, and can discriminate between different dynamical conditions. Our methodology offers a powerful tool for disentangling model parameterization biases from their interactions with the chaotic evolution of climate dynamics, opening a novel avenue toward big-data enhanced climate predictions.

58 GEOSCIENCES↗
DOE OSTI2025

The role of the droplet interface in controlling the multiphase oxidation of thiosulfate by ozone

Predicting reaction kinetics in aqueous microdroplets, including aerosols and cloud droplets, is challenging due to the probability that the underlying reaction mechanism can occur both at the surface and in the interior of the droplet. Additionally, few studies directly measure the surface activities of doubly charged anions, despite their prevalence in the atmosphere. Here, deep-UV second harmonic generation spectroscopy is used to probe surface affinities of the doubly charged anions thiosulfate, sulfate, and sulfite, key species in the thiosulfate ozonation reaction mechanism. Thiosulfate has an appreciable surface affinity with a measured Gibbs free energy of adsorption of -7.3 ± 2.5 kJ mol -1 in neutral solution, while sulfate and sulfite exhibit negligible surface propensity. The Gibbs free energy is combined with data from liquid flat jet ambient pressure X-ray photoelectron spectroscopy to constrain the concentration of thiosulfate at the surface in our model. Stochastic kinetic simulations leveraging these novel measurements show that the primary reaction between thiosulfate and ozone occurs at the interface and in the bulk, with the contribution of the interface decreasing from ~65% at pH 5 to ~45% at pH 13. Additionally, sulfate, the major product of thiosulfate ozonation and an important species in atmospheric processes, can be produced by two different pathways at pH 5, one with a contribution from the interface of >70% and the other occurring predominantly in the bulk (>98%). The observations in this work have implications for mining wastewater remediation, atmospheric chemistry, and understanding other complex reaction mechanisms in multiphase environments. Future interfacial or microdroplet/aerosol chemistry studies should carefully consider the role of both surface and bulk chemistry.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Atomic protein structure refinement using all-atom graph representations and SE(3)-equivariant graph transformer

Abstract Motivation The state-of-art protein structure prediction methods such as AlphaFold are being widely used to predict structures of uncharacterized proteins in biomedical research. There is a significant need to further improve the quality and nativeness of the predicted structures to enhance their usability. In this work, we develop ATOMRefine, a deep learning-based, end-to-end, all-atom protein structural model refinement method. It uses a SE(3)-equivariant graph transformer network to directly refine protein atomic coordinates in a predicted tertiary structure represented as a molecular graph. Results The method is first trained and tested on the structural models in AlphaFoldDB whose experimental structures are known, and then blindly tested on 69 CASP14 regular targets and 7 CASP14 refinement targets. ATOMRefine improves the quality of both backbone atoms and all-atom conformation of the initial structural models generated by AlphaFold. It also performs better than two state-of-the-art refinement methods in multiple evaluation metrics including an all-atom model quality score—the MolProbity score based on the analysis of all-atom contacts, bond length, atom clashes, torsion angles, and side-chain rotamers. As ATOMRefine can refine a protein structure quickly, it provides a viable, fast solution for improving protein geometry and fixing structural errors of predicted structures through direct coordinate refinement. Availability and implementation The source code of ATOMRefine is available in the GitHub repository (https://github.com/BioinfoMachineLearning/ATOMRefine). All the required data for training and testing are available at https://doi.org/10.5281/zenodo.6944368.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Turbulence model reduction by deep learning

A defining problem of turbulence theory is to produce a predictive model for turbulent fluxes. These have profound implications for virtually all aspects of the turbulence dynamics. In magnetic confinement devices, drift-wave turbulence produces anomalous fluxes via cross-correlations between fluctuations. In this work, we introduce an alternative, data-driven method for parametrizing these fluxes. The method uses deep supervised learning to infer a reduced mean-field model from a set of numerical simulations. We apply the method to a simple drift-wave turbulence system and find a significant new effect which couples the particle flux to the local gradient of vorticity. Notably, here, this effect is much stronger than the oft-invoked shear suppression effect. We also recover the result via a simple calculation. The vorticity gradient effect tends to modulate the density profile. In addition, our method recovers a model for spontaneous zonal flow generation by negative viscosity, stabilized by nonlinear and hyperviscous terms. We highlight the important role of symmetry to implementation of the new method.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Calorimetry with deep learning: particle simulation and reconstruction for collider physics

Using detailed simulations of calorimeter showers as training data, we investigate the use of deep learning algorithms for the simulation and reconstruction of single isolated particles produced in high-energy physics collisions. We train neural networks on single-particle shower data at the calorimeter-cell level, and show significant improvements for simulation and reconstruction when using these networks compared to methods which rely on currently-used state-of-the-art algorithms. We define two models: an end-to-end reconstruction network which performs simultaneous particle identification and energy regression of particles when given calorimeter shower data, and a generative network which can provide reasonable modeling of calorimeter showers for different particle types at specified angles and energies. We investigate the optimization of our models with hyperparameter scans. Furthermore, we demonstrate the applicability of the reconstruction model to shower inputs from other detector geometries, specifically ATLAS-like and CMS-like geometries. These networks can serve as fast and computationally light methods for particle shower simulation and reconstruction for current and future experiments at particle colliders.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

An evaluation of GPT models for phenotype concept recognition

Clinical deep phenotyping and phenotype annotation play a critical role in both the diagnosis of patients with rare disorders as well as in building computationally-tractable knowledge in the rare disorders field. These processes rely on using ontology concepts, often from the Human Phenotype Ontology, in conjunction with a phenotype concept recognition task (supported usually by machine learning methods) to curate patient profiles or existing scientific literature. With the significant shift in the use of large language models (LLMs) for most NLP tasks, we examine the performance of the latest Generative Pre-trained Transformer (GPT) models underpinning ChatGPT as a foundation for the tasks of clinical phenotyping and phenotype annotation. The experimental setup of the study included seven prompts of various levels of specificity, two GPT models (gpt-3.5-turbo and gpt-4.0) and two established gold standard corpora for phenotype recognition, one consisting of publication abstracts and the other clinical observations. The best run, using in-context learning, achieved 0.58 document-level F1 score on publication abstracts and 0.75 document-level F1 score on clinical observations, as well as a mention-level F1 score of 0.7, which surpasses the current best in class tool. Without in-context learning, however, performance is significantly below the existing approaches. Our experiments show that gpt-4.0 surpasses the state of the art performance if the task is constrained to a subset of the target ontology where there is prior knowledge of the terms that are expected to be matched. While the results are promising, the non-deterministic nature of the outcomes, the high cost and the lack of concordance between different runs using the same prompt and input make the use of these LLMs challenging for this particular task.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1999

On Orbit Measurement of Response vs. Scan Angle for the Infrared Bands on TRMM/VIRS

The Visible and Infrared Scanner on the Tropical Rainfall Measuring Mission (TRMM/VIRS) is a whiskbroom imaging radiometer with two reflected solar bands and three emissive infrared bands. All five detectors are on a single cooled focal plane. This configuration necessitated the use of a paddlewheel scan mirror to avoid the effects of focal plane rotation that arise when using a scan mirror that is inclined to its axis of rotation. System radiometric requirements led to the need for protected silver as the mirror surface. Unfortunately, the SiO(x) coatings currently used to protect silver from oxidation introduce a change in reflectance with angle of incidence (AOI). This AOI dependence results in a modulation of system level response with scan angle. Measurement of system response vs. scan angle (RVS) was not difficult for the VIRS reflected solar bands, but attaining the required accuracy for the IR bands in the laboratory was not possible without a large vacuum chamber and a considerable amount of custom designed testing apparatus. Therefore, the decision was made to conduct the measurement on-orbit. On three separate occasions, the TRMM spacecraft was rotated about its pitch axis and, after the nadir view passed over the Earth's limb, the VIRS performed several thousand scans while viewing deep space. The resulting data has been analyzed and the RVS curves generated for the three IR bands are being used in the VIRS radiometric calibration algorithm. This, to our knowledge, the first time this measurement has been made on-orbit. Similar measurements are planned for the EOS-AM and EOS-PM MODIS sensors and are being considered for several systems under development. The VIRS on-orbit results will be compared to VIRS and MODIS system level laboratory measurements, MODIS scan mirror witness sample measurements and modeled data.

Barnes, William L.↗
NASA NTRS2000

Long-Term Durability Analysis of a 100,000+ Hr Stirling Power Convertor Heater Head

DOE and NASA have identified Stirling Radioisotope Power Systems (SRPS) as the power supply for deep space exploration missions the Europa Orbiter and Solar Probe. As a part of this effort, NASA has initiated a long-term durability project for critical hot section components of the Stirling power convertor to qualify flight hardware. This project will develop a life prediction methodology that utilizes short-term (t < 20,000 hr) test data to verify long-term (t > 100,000 hr) design life. The project consists of generating a materials database for the specific heat of alloy, evaluation of critical hermetic sealed joints, life model characterization, and model verification. This paper will describe the qualification methodology being developed and provide a status for this effort.

Bartolotta, Paul A.↗
NASA NTRS2020

Interannual variations in meltwater input to the Southern Ocean from Antarctic ice shelves

Ocean-driven basal melting of Antarctica’s floating ice shelves accounts for about half of their mass loss in steady state, where gains in ice-shelf mass are balanced by losses. Ice-shelf thickness changes driven by varying basal melt rates modulate mass loss from the grounded ice sheet and its contribution to sea level, and the changing meltwater fluxes influence climate processes in the Southern Ocean. Existing continent-wide melt-rate datasets have no temporal variability, introducing uncertainties in sea level and climate projections. Here, we combine surface height data from satellite radar altimeters with satellite-derived ice velocities and a new model of firn-layer evolution to generate a high-resolution map of time-averaged (2010–2018) basal melt rates and time series (1994–2018) of meltwater fluxes for most ice shelves. Total basal meltwater flux in 1994 (1,090 ± 150 Gt/yr) was similar to the steady-state value (1,100 ± 60 Gt/yr), but increased to 1,570 ± 140 Gt/yr in 2009, followed by a decline to 1,160 ± 150 Gt/yr in 2018. For the four largest ‘cold-water’ ice shelves, we partition meltwater fluxes into deep and shallow sources to reveal distinct signatures of temporal variability, providing insights into climate forcing of basal melting and the impact of this melting on the Southern Ocean.

Susheel Adusumilli↗
DOE OSTI2025

Micropolar deep material network

This study extends the Deep Material Network (DMN), a physics-informed machine learning framework, to predict the homogenized mechanical response of composite materials with micropolar (Cosserat-type) constitutive behavior. This extension incorporates microstructure-dependent size effects, enabling accurate, efficient, and size-aware predictions for composites with complex internal architectures. While traditional, direct numerical simulation micropolar models effectively capture size effects by introducing extra local degrees of freedom, they bring significant computational challenges, particularly for multiscale analyses relevant to engineering applications. The micropolar DMN developed in this paper achieves high accuracy while significantly reducing computation time compared to micropolar direct numerical simulations. This advancement enables multiscale analyses and parameter studies that were previously impractical, such as high-cycle fatigue simulations and comprehensive investigations of internal length scale effects notably in size-dependent plastic response and the optimization of lattice structures. By uniting microstructure-sensitive modeling, physics-driven learning, and scalable surrogate modeling, the micropolar DMN paves the way for accelerated material design, large-scale parametric studies, and the reliable incorporation of size-dependent effects across a wide range of engineering applications, including optimization and next-generation composite design.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Network of epistatic interactions in an enzyme active site revealed by large-scale deep mutational scanning

Cooperative interactions between amino acids are critical for protein function. A genetic reflection of cooperativity is epistasis, which is when a change in the amino acid at one position changes the sequence requirements at another position. To assess epistasis within an enzyme active site, we utilized CTX-M β-lactamase as a model system. CTX-M hydrolyzes β-lactam antibiotics to provide antibiotic resistance, allowing a simple functional selection for rapid sorting of modified enzymes. We created all pairwise mutations across 17 active site positions in the β-lactamase enzyme and quantitated the function of variants against two β-lactam antibiotics using next-generation sequencing. Context-dependent sequence requirements were determined by comparing the antibiotic resistance function of double mutations across the CTX-M active site to their predicted function based on the constituent single mutations, revealing both positive epistasis (synergistic interactions) and negative epistasis (antagonistic interactions) between amino acid substitutions. The resulting trends demonstrate that positive epistasis is present throughout the active site, that epistasis between residues is mediated through substrate interactions, and that residues more tolerant to substitutions serve as generic compensators which are responsible for many cases of positive epistasis. Additionally, we show that a key catalytic residue (Glu166) is amenable to compensatory mutations, and we characterize one such double mutant (E166Y/N170G) that acts by an altered catalytic mechanism. These findings shed light on the unique biochemical factors that drive epistasis within an enzyme active site and will inform enzyme engineering efforts by bridging the gap between amino acid sequence and catalytic function.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1983

Planning in time - Windows and durations for activities and goals

The present general purpose automated planner/scheduler generates parallel plans aimed at the achievement of goals having imposed time constraints, with both durations and start time windows being specifiable for sets of goal conditions. Deterministic durations of such parallel plan activities as actions, events triggered by circumstances, inferences, and scheduled events entirely outside the actor's control, are explicitly modeled and may be any computable function of the activity variables. The final plan network resembles a PERT chart. Examples are given from the traditional 'blocksworld', and from a realistic 'Spaceworld' in which an autonomous spacecraft photographs objects in deep space and transmits the information to earth.

Vere, S. A.↗
NASA NTRS1986

Eddy processes in the general circulation of the Jovian atmospheres

Two fundamentally different views of the general circulation of Jovian atmospheres have emerged. According to one view, the observed jet streams at the cloud tops are controlled by the vorticity transfers of small scale eddies generated by planetary wave instabilities within a shallow atmospheric layer. According to the alternate point of view, the zonal jets are surface manifestations of deep interior convection organized into cylindrical motion with axes parallel to the planetary rotation axis. Both approaches may be considered in the context of the very different roles assumed by the potential vorticity. A possible reconciliation of the two kinds of dynamical systems is considered in which the interior motion is overlaid with a statically stable cappling layer driven by turbulent energy injection from below. A simple model for the eddy driving of quasi-geostrophic dynamics in the capping layer is presented which is consistent with the tentative evidence for up-gradient momentum flux on Jupiter and IRIS observations of thermal contrast correlations with cyclonic and anticyclonic shear zones. Certain synoptic-scale cloud features in Jupiter's atmosphere are interpreted as breaking waves, which may also influence the lateral mixing of tracers such as the ortho-para hydrogen ratio.

Leovy, Conway↗
DOE OSTI2021

Exploring QCD Factorization at Moderate Energy Scales

Asymptotic freedom in QCD facilitates the use of partonic degrees of freedom over short distances, but physical processes are sensitive to a wide range of scales. Thus, it is necessary in QCD calculations to utilize a factorization scheme to separate a process into perturbative and non-perturbative factors. This separation relies on an assumption that one energy scale is infinitely larger than the other scales involved in the process. However, much experimental research in areas such as nucleon structure and quark-hadron duality occur at more moderate energy scales where that basic assumption may not be true but perturbative calculations should still be useful. Thus, an exploration of the limits of factorization at more moderate energy scales is needed. This dissertation examines various aspects of factorization at these energy scales first by applying the necessary approximations to a simple model where exact calculations are possible and so the effects of these approximations can be quantified. This is followed by examining areas where corrections are known to be needed. First is an exploration of target mass corrections (TMCs) in the case of deep inelastic scattering (DIS), including a discussion of what large corrections imply about the target structure. Second, is a general examination of PDFs and FFs at moderate scales. Third, I will discuss how this fits into the long-term effort to study the transition between small transverse momentum (generated non-perturbatively) and large transverse momentum (generated in the hard process)

Moffat, Eric↗
NASA NTRSDate not supplied

Growth Curve Parameterization of Metabolic Activity of Yeast Cells for BioSentinel

The goal of the BioSentinel small satellite payload is to measure the effect of deep space radiation on the growth and metabolic activity of yeast cells. Raw test data is generated by fluidics cards containing yeast cells rehydrated at different periods, with metabolic activity measured by the reduction of alamarBlue. Each card well has a sensor array that measures the amount of red, green, and infrared light transmitted through the yeast culture. This illumination data is then converted to absorbance values, which are further converted into concentrations. The ultimate objective is to convert these concentrations into biologically-relevant metrics that can be compared against one another to determine changes due to differential radiation exposure. Beginning with IR absorbance data (corresponding to cell density) from ground studies, three parameters from a sigmoidal growth curve were extracted and analyzed: 𝜆 (lag phase), 𝜇 (max growth rate), and A (max cell growth). The data was fit to the Gompertz model of microbial growth using non-linear regression (Minitab), as the fit error was reduced compared to the simpler logistic growth curve. Graphs showed that the data contained a discrepancy (drift) in the lag phase that is attributable to a slow, constant loss of moisture. Correcting this discrepancy by fitting the first 25 hours of the data to a power function and subtracting these values from the absorbance readings obtained a better statistical fit to the growth curve in the lag phase. A power fit was selected over a linear fit because it reflected the effects of constant volume loss. This correction to the BioSentinel data analysis pipeline will enable quantitative statistical analysis of the effect of different levels of deep space radiation on yeast cells. Future work includes automation of drift correction and curve modeling to extract these parameters directly from data.

Growth Curve↗
DOE OSTI2023

Estimating the Meridional Extent of Adiabatic Mixing in the Stratosphere Using Age-Of-Air

Wave-induced adiabatic mixing in the winter midlatitudes is one of the key processes impacting stratospheric transport. Understanding its strength and structure is vital to understanding the distribution of trace gases and their modulation under a changing climate. Age-of-air is often used to understand stratospheric transport, and this study proposes refinements to the vertical age gradient theory of Linz et al. (2021), https://doi.org/10.1029/2021JD035199. The theory assumes exchange of air between a well-mixed tropics and a well-mixed extratropics, separated by a transport barrier, quantifying the adiabatic mixing flux across the interface using age-based measures. These assumptions are re-evaluated and a refined framework that includes the effects of meridional tracer gradients is established to quantify the mixing flux. This is achieved, in part, by computing a circulation streamfunction in age-potential temperature coordinates to generate a complete distribution of parcel ages being mixed in the midlatitudes. The streamfunction quantifies the “true” age of parcels mixed between the tropics and the extratropics. Applying the revised theory to an idealized and a comprehensive climate model reveals that ignoring the meridional gradients in age leads to an underestimation of the wave-driven mixing flux. Stronger, and qualitatively similar fluxes are obtained in both models, especially in the lower-to-middle stratosphere. While the meridional span of adiabatic mixing in the two models exhibits some differences, they show that the deep tropical pipe, that is, latitudes equatorward of 15° barely mix with older midlatitude air. The novel age-potential temperature circulation can be used to quantify additional aspects of stratospheric transport.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Manifestation of postcollision interaction in Krypton LMN Auger spectra following K-shell photoionization

In this work, we report on an experimental and theoretical study of post-collision interaction (PCI) effects on L 2 -M 4,5 N 2,3 Auger electrons measured above the Kr K-edge in which L 2 vacancies are primarily generated by KL 2 x-ray emission. Such cascade processes, in which a deep inner-shell vacancy decays first by x-ray emission followed by Auger electron emission, is a strong decay mode in heavy atoms. The L 2 -M 4,5 N 2,3 Auger electron peak is observed to become increasingly asymmetric with a shifting peak maximum as the absorbed x-ray energy approaches the K-shell ionization threshold. This is attributed to PCI energy exchanges of the Auger electron with the 1s photoelectron. To model the PCI effects, we have applied a semiclassical approach modified to account for the combined lifetimes of the K and L 2 hole states. In addition, our analysis treats several closely spaced Auger transitions with final ionic states having different terms and angular momenta.

74 ATOMIC AND MOLECULAR PHYSICS↗