Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “machine learning models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,153 records · Page 64

An adaptive, data-driven multiscale approach for dense granular flows

The accuracy of coarse-grained continuum models of dense granular flows is limited by the lack of high-fidelity closure models for granular rheology. One approach to addressing this issue, referred to as the hierarchical multiscale method, is to use a high-fidelity fine-grained model to compute the closure terms needed by the coarse-grained model. The difficulty with this approach is that the overall model can become computationally intractable due to the high computational cost of the high-fidelity model. In this work, we describe a multiscale modeling approach for dense granular flows that utilizes neural networks trained using high-fidelity discrete element method (DEM) simulations to approximate the constitutive granular rheology for a continuum incompressible flow model. Our approach leverages an ensemble of neural networks to estimate predictive uncertainty that allows us to determine whether the rheology at a given point is accurately represented by the neural network model. Additional DEM simulations are only performed when needed, minimizing the number of additional DEM simulations required when updating the rheology. This adaptive coupling significantly reduces the overall computational cost of the approach while controlling the error. In addition, the neural networks are customized to learn regularized rheological behavior to ensure well-posedness of the continuum solution. We first validate the approach using two-dimensional steady-state and decelerating inclined flows. We then demonstrate the efficiency of our approach by modeling three-dimensional sub-aerial granular column collapse for varying initial column aspect ratios, where our multiscale method compares well with the computationally expensive computational fluid dynamics (CFD)-DEM simulation.

Dense granular flows↗

Computationally efficient models for aqueous organic redox flow batteries

The rising usage of intermittent energy has garnered the need for large scale energy storage systems. Redox flow batteries (RFB) based energy storage system shows promising potential. Numerical simulations and machine learning approaches have been widely used to study RFB performance. The development of autonomous material discovery framework and digital twin of energy storage system usually needs to query cell performance through fast response models. In this study, two computationally efficient models are introduced: a physics-based analytical flow battery model (EZBattery), and a machine learning operator model (Deep Operator Network, denoted by DeepONet). Both models can provide cell performance near instantly, and prediction accuracy was systematically examined on an application of evaluating the performances of a 780 cm 2 aqueous organic redox flow battery (AORFB), using potential anolyte candidates in dihydroxyphenazine (DHP)-based family of organic materials. A validated computationally expansive 3-dimensional multi-physics finite element model by COMSOL was used as the ground truth and provided the training data set for the DeepONet. 1280 samples were generated with 10 properties to mimic the different possible anolyte candidates, and the cell performances were evaluated under 10 different combined operating conditions. The accuracy comparisons for the two computationally efficient models show that both models can provide comparable accuracy in predicting cell charging/discharging voltage curves. DeepONet can provide slightly higher overall accuracy than EZBattery with faster calculation speed, but highly relies on the training dataset. EZBattery does not need a training dataset and can provide interpretable physics-based explanations of the results, while being more flexible to adjust to adapt any different cell designs, flow battery architectures, and electrolyte materials.

Analytical model↗

Confinement performance predictions for a high field axisymmetric tandem mirror

This paper presents a Hammir tandem mirror confinement performance analysis based on Realta Fusion’s first-of-a-kind model for axisymmetric magnetic mirror fusion performance. This model uses an integrated end plug simulation model including, heating, equilibrium and transport combined with a new formulation of the plasma operation contours (POPCONs) technique for the tandem mirror central cell. Using this model in concert with machine learning optimization techniques, it is shown that an end plug utilizing high temperature superconducting magnets and modern neutral beams enables a classical tandem mirror pilot plant producing a fusion gain Q > 5. The approach here represents an important advance in tandem mirror design. The high-fidelity end plug model enables calculations of heating and transport in the highly non-Maxwellian end plug to be made more accurately. The detailed end plug modelling performed in this work has highlighted the importance of classical radial transport and neutral beam absorption efficiency on end plug viability. The central cell POPCON technique allows consideration of a wide range of parameters in the relatively simple near-Maxwellian central cell, facilitating the selection of more optimal central cell plasmas. These advances make it possible to find more conservative classical tandem mirror fusion pilot plant operating points with lower temperatures, neutral beam energies and end plug performance requirements than designs in the literature. Despite being more conservative, it is shown that these operating points have sufficient confinement performance to serve as the basis of a viable fusion pilot plant provided that they can be stabilized against magnetohydrodynamic and trapped particle modes.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Scalability Analysis of Quantum Models for Stress and Emotion Detection

Stress and emotion detection from high-dimensional physiological signals is a challenging task, particularly when aiming for accurate classification across diverse behavioral states. Quantum machine learning (QML) is promising for modeling such high-dimensional data, but scalability is limited by qubit resources and the exponential cost of classical statevector simulation. This work studies the scalability of quantum support vector machines (QSVMs) for binary stress detection and three-class emotion recognition (Negative/Neutral/Positive) under varying qubit counts and angle-encoding strategies. We also present a comparison study with one-feature-per-qubit (1:1) and two-features-per-qubit (2:1) mappings. Experiments are executed on HPC infrastructure using NVIDIA CUDA-Q to evaluate performance, variance, and class-dependent separability at higher-qubit setups. Results show that larger Hilbert spaces can improve peak accuracy but may increase instability. At the same time, dense 2:1 encoding yields more consistent stress detection performance. For emotion recognition, scaling improves discrimination for classes like Negative and Positive more than Neutral. We find that effective QML scaling is task-dependent and benefits more from encoding design than simply increasing qubit count.

Onim, Md. Saif Hassan [University of Tennessee, Kn↗

Outlook towards deployable continual learning for particle accelerators

Particle accelerators are high power complex machines. To ensure uninterrupted operation of these machines, thousands of pieces of equipment need to be synchronized, which requires addressing many challenges including design, optimization and control, anomaly detection and machine protection. With recent advancements, machine learning (ML) holds promise to assist in more advance prognostics, optimization, and control. While ML based solutions have been developed for several applications in particle accelerators, only few have reached deployment and even fewer to long term usage, due to particle accelerator data distribution drifts caused by changes in both measurable and non-measurable parameters. In this paper, we identify some of the key areas within particle accelerators where continual learning can allow maintenance of ML model performance with distribution drifts. Particularly, we first discuss existing applications of ML in particle accelerators, and their limitations due to distribution drift. Next, we review existing continual learning techniques and investigate their potential applications to address data distribution drifts in accelerators. By identifying the opportunities and challenges in applying continual learning, this paper seeks to open up the new field and inspire more research efforts towards deployable continual learning for particle accelerators.

43 PARTICLE ACCELERATORS↗

A New Reduced Order Model For The Mechanistic Creep Behavior Of UO 2

This manuscript describes an ongoing NEAMS effort to better determine the performance of advanced nuclear fuels, in particular the creep behavior of doped UO$_2$ for light water reactors. In our previous work, we outlined a method to utilize data generated from lower length scale simulations and implement it into the engineering scale fuel performance analysis. This process has been further refined, and in addition, new data has been used to train the surrogate model which has also been substantially improved since the previous iteration. The new model is compared against the current empirical model used in BISON using both scoping calculations to define the performance over the parameter space and using integral instrumented fuel assessment cases to determine the impact of these models on the overall fuel performance. Suggestions and guidance for future improvements to this method are provided to ensure the model covers relevant parameter space and phenomena.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

NASA Software Cost Estimation Model: An Analogy Based Estimation Model

The cost estimation of software development activities is increasingly critical for large scale integrated projects such as those at DOD and NASA especially as the software systems become larger and more complex. As an example MSL (Mars Scientific Laboratory) developed at the Jet Propulsion Laboratory launched with over 2 million lines of code making it the largest robotic spacecraft ever flown (Based on the size of the software). Software development activities are also notorious for their cost growth, with NASA flight software averaging over 50% cost growth. All across the agency, estimators and analysts are increasingly being tasked to develop reliable cost estimates in support of program planning and execution. While there has been extensive work on improving parametric methods there is very little focus on the use of models based on analogy and clustering algorithms. In this paper we summarize our findings on effort/cost model estimation and model development based on ten years of software effort estimation research using data mining and machine learning methods to develop estimation models based on analogy and clustering. The NASA Software Cost Model performance is evaluated by comparing it to COCOMO II, linear regression, and K-­ nearest neighbor prediction model performance on the same data set.

Hihn, Jairus↗

Development of Digital Twin Technologies for Climate Projections

Climate projections are increasingly needed for adaptation, climate resilience and related decision making. However, existing projections have systematic biases, are limited in scope, and are not readily available for most potential users. While the ideal of an observational data-driven ‘digital twin’ for climate is initially attractive, there is only a very limited set of climate data available with which to train such a tool. Nonetheless, we are confident that there is a role for ‘digital twin technologies’ in removing biases, increasing computational efficiency, expanding scenarios and data accessibility.

digital twins↗

Barium stars as tracers of s -process nucleosynthesis in AGB stars

Barium (Ba) stars help to verify asymptotic giant branch (AGB) star nucleosynthesis models since they experienced pollution from an AGB binary companion and thus their spectra carry the signatures of the slow neutron capture process (s process). For a large number (180) of Ba stars, we searched for AGB stellar models that match the observed abundance patterns. We aim to uncover any systematic deviations of the sample abundances from the predictions of the nucleosynthesis models. We employed three machine learning algorithms as classifiers: a Random Forest method, developed for this work, and the two classifiers used in our previous study. Compared to that work, we also expanded our observational sample with 11 Ba stars available in the supersolar metallicity range. We studied the statistical behaviour of the different s-process elements in the observational sample to investigate if the AGB models systematically under- or overpredict the abundances observed in the Ba stars and show the results in the form of violin plots of the residuals between spectroscopic abundances and model predictions. We inspected the correlations between the observed [Fe/H], the s-process elemental abundances, and the residuals. We employed the [Zr/Fe] and [Nb/Fe] abundances as a thermometer to constrain the operational temperature that rules the production of these elements in the sample stars, assuming a steady-state s process. We also investigated the mass distribution of the identified polluter AGB stars and the behaviour of the δ parameter, which describes the fraction of accreted AGB material relative to the Ba star envelope. We find a significant trend in the residuals that implies an underproduction of the elements just after the first s-process peak (Nb, Mo, and Ru) in the models relative to the observations. This may originate from a neutron-capture process (e.g. the intermediate neutron-capture process, i process) not yet included in the AGB models of metallicity from solar to roughly 1/5 solar, corresponding to the range of the Ba stars. Correlations are found between the residuals of these peculiar elements, suggesting a common origin for the deviations from the models. In addition, there is a weak metallicity dependence of the residuals of these elements. The s-process temperatures derived with the [Zr/Fe] – [Nb/Fe] thermometer have an unrealistic value for the majority of our stars. The most likely explanation is that at least a fraction of these elements are not produced in a steady-state s process, and instead may be due to processes not included in the AGB models. The mass distribution of the identified models confirms that our sample of Ba stars was polluted by low-mass AGB stars (< 4 M ⊙ ). Most of the matching AGB models require low accreted mass, but a few systems with high accreted mass are needed to explain the observations.

79 ASTRONOMY AND ASTROPHYSICS↗

Solidification cracking of refractory alloys: a computational and machine learning study to investigate composition-dependence for improved weldability and additive manufacturability

Large-batch numerical, CALculation of PHAse Diagrams (CALPHAD)-based solidification cracking calculations are performed and then analyzed with machine learning methods to generate models that relate chemistry of refractory alloys to cracking susceptibility. Kou’s solidification cracking index is used to study the refractory alloys including O, N, C binary mixtures with Mo, Ta, Nb, and W, the molybdenum-based TZM, Niobium-based C103, and Tantalum-based T111 and Ta-10 W, as well as hypothetical refractory ternary alloys. Findings strongly validate Kou’s Crack Susceptibility Index (CSI) against Varestraint test data for Nb- and Ta-based alloys, establishing CSI thresholds where refractory alloys with CSI < 15,000 K are likely weldable, CSI > 15,000 K are prone to cracking, and CSI > 25,000 K are likely unweldable (or unprintable). Furthermore, interstitial elements C, N, and O significantly increase crack susceptibility, with some existing material specifications coinciding with peak cracking susceptibility concentrations. Finally, machine learning-derived elemental potency factors enable rapid prediction of CSI from alloy chemistry for C103, TZM, Ta-10 W, and T-111 alloys. These results provide practical guidance for feedstock selection, powder reuse limits, and alloy specification amendments for welding and additive manufacturing applications.

36 MATERIALS SCIENCE↗

The HHV-6B U20 glycoprotein binds ULBP1, masking it from recognition by NKG2D and interfering with natural killer cell activation

Human Herpesvirus 6B (HHV-6B) impedes host immune responses by downregulating class I MHC molecules (MHC-I), hindering antigen presentation to CD8+ T cells. Downregulation of MHC-I disengages inhibitory receptors on natural killer (NK) cells, resulting in activation and killing of the target cell if NK cell activating receptors such as NKG2D have engaged stress ligands upregulated on the target cells. Previous work has shown that HHV-6B downregulates three MHC-like stress ligands MICB, ULBP1, and ULBP3, which are recognized by NKG2D. The U20 glycoprotein of the related virus HHV-6A has been implicated in the downregulation of ULBP1, but the precise mechanism remains undetermined. We set out to investigate the role of HHV-6B U20 in modulating NK cell activity. We used HHV-6B U20 expressed as a recombinant protein or transduced into target cells, as well as HHV-6B infection, to investigate binding interactions with NK cell ligands and receptors and to assess effects on NK cell activation. Small-angle X-ray scattering was used to align molecular models derived from machine-learning approaches. We demonstrate that U20 binds directly to ULBP1 with sub-micromolar affinity. Transduction of U20 decreases NKG2D binding to ULBP1 at the cell surface but does not decrease ULBP1 protein levels, either at the cell surface or in toto. HHV-6B infection and soluble U20 have the same effect. Transduction of U20 blocks NK cell activation in response to cell-surface ULBP1. Structural modeling of the U20 – ULBP1 complex indicates some similarities to the m152-RAE1γ complex.

60 APPLIED LIFE SCIENCES↗

Creep and Creep Fracture Modeling with Surrogate Creep Models and the Extended Finite Element Method

Alloy components in advanced nuclear reactors will be subjected to environmental conditions that could include high temperatures, irradiation, and exposure to corrosive salts. These conditions could lead to the formation of crack-like defects, which could grow over time in a mechanism known as creep crack growth (CCG). Predicting growth rates of these defects is important for assessing the safe operating life of advanced reactors. This project documents progress toward developing and testing next-generation data-driven constitutive models for deformation creep. It also documents the application of the extended finite element method in conjunction with surrogate creep models to predict CCG parameters under a variety of conditions. These important incremental developments contribute to the longer-term objective of developing microstructure-aware constitutive models that can be used for predicting creep deformation and CCG at the component scale with improved accuracy.

36 MATERIALS SCIENCE↗

Innovations in underground hydrogen storage with multiphysics simulations, optimization, and monitoring: A review

Underground Hydrogen Storage (UHS) is a promising solution for large-scale energy storage and a critical component in advancing low-carbon energy system. Ensuring the safety and efficiency of UHS necessitates a comprehensive understanding of multiphysical interactions driven by cyclic pore fluid pressure fluctuations and coupled physicochemical processes. Here, this review examines the key geomechanical responses in UHS, including rock property variations under cyclic loading, fracture evolution and propagation, reservoir stress sensitivity, and fault stability. It also explores the impact of geochemical and microbial reactions on geomechanical characteristics. We provide an in-depth analysis of Thermal-Hydraulic-Mechanical-Chemical (THMC) coupled numerical simulations, highlighting their potential for future multi-scale modeling. Limitations of current machine learning (ML) approaches in addressing UHS challenges are highlighted, emphasizing the need for innovative ML-based methodologies. Operational strategies for hydrogen injection and production are reviewed, focusing on safety, efficiency, and economic viability. The necessity for multi-objective optimization (MOO) to balance storage efficiency, risk mitigation, and cost-effectiveness is also discussed. Current monitoring technologies are evaluated to ensure safe and efficient UHS operations. Finally, this review identifies critical knowledge gaps and underscores the importance of advancing geomechanical understanding under multiphysics-coupling. We highlight the need for ML-driven multiphysics theories, enhanced modeling techniques, and robust optimization strategies to improve UHS performance. This study serves as a comprehensive reference for future research and the large-scale implementation of UHS systems.

25 ENERGY STORAGE↗

The Artificial Intelligence Ontology: LLM-Assisted Construction of AI Concept Hierarchies

The Artificial Intelligence Ontology (AIO) is a systematization of artificial intelligence (AI) concepts, methodologies, and their interrelations. Developed via manual curation, with the additional assistance of large language models (LLMs), AIO aims to address the rapidly evolving landscape of AI by providing a comprehensive framework that encompasses both technical and ethical aspects of AI technologies. The primary audience for AIO includes AI researchers, developers, and educators seeking standardized terminology and concepts within the AI domain. We use the term “branches” for classes, and their subclasses, in our ontology that are subclasses of owl:Thing. AIO contains eight branches: Bias, Layer, Machine Learning Task, Mathematical Function, Model, Network, Preprocessing, and Training Strategy, each designed to support the modular composition of AI methods and facilitate a deeper understanding of deep learning architectures and ethical considerations in AI. AIO uses the Ontology Development Kit (ODK) for its creation and maintenance, with its content being more easily updated through AI-driven curation support. This approach not only ensures the ontology's relevance amidst the fast-paced advancements in AI but also significantly enhances its utility for researchers, developers, and educators by simplifying the integration of new AI concepts and methodologies. The ontology's utility is demonstrated through the annotation of AI methods data in a catalog of AI research publications and the integration into the BioPortal ontology resource, highlighting its potential for cross-disciplinary research. The AIO ontology is open source and is available on GitHub ( https://w3id.org/aio/ ) and BioPortal ( https://bioportal.bioontology.org/ontologies/AIO ).

Joachimiak, Marcin P. [Biosystems Data Science Dep↗

Digital bead modeling for wire-arc directed energy deposition

Prediction of 2D cross-section and full 3D geometry for stacked weld beads is critical for the outcome of wire-arc directed energy deposition (DED) parts; however, most additive path planning software packages model beads as extrusions of a rectangle. Weld beads are not rectangular, and the resulting shape is dependent upon physics effects at the moment of deposition. Physics phenomena such as the geometry of the underlying surface, the heat input of the welding mode, and the direction of gravity contribute to bead shape. Here, this paper presents a novel implicit modeling method that discretizes a 2D area or 3D volume of space into pixels or voxels and constructs fields based on these physics phenomena. The fields are combined using a weighting scheme trained on 3D scan measurements of welds and wire-arc DED prints. Pixels or voxels are added until the known amount of deposited volume has been achieved. Thereby, a strong conservation of mass principle is applied to the process. Utilizing machine learning techniques, the present model can be trained on a database of scans allowing for the representation of a wide variety of prints. Results show that this method can produce predictions with realistic bead morphology and sub-millimeter form error.

Bead geometry modeling↗

Effect of Solvent on the Local Structure, Dynamics, and Vibrational Density of States in Sn-BEA Zeolite

Lewis acid zeolites are attractive catalysts for epoxidation and biomass valorization, as they are highly active and selective in the liquid phase and can operate at or near ambient conditions. While a rich experimental literature exists on liquid-phase Lewis acid zeolite catalysis, our understanding of the molecular organization and solvent dynamics in the vicinity of Lewis acid sites with differing metal site speciation remains limited. In this work, we investigate the molecular coordination and diffusion of two common solvents (methanol and water) around the closed and open Sn-BEA zeolite active sites using molecular dynamics simulations with a machine-learned interatomic potential trained on ab initio molecular dynamics trajectories. Molecular dynamics simulations reveal that introducing active sites significantly enhances local order in the first and second solvation shells compared to the pure silica case. For methanol, both closed and open active sites are singly coordinated, while more than two water molecules coordinate the open site. In contrast to methanol, we observed that water molecules dissociate, leading to the formation of additional Sn-OH and silanol groups away from the active site. The diffusion coefficients of water and methanol are functions of the solvent population in the pore. Here, our work provides insights into how active site speciation in Lewis acid zeolites affects solvent coordination, diffusion, and vibrational signature. This information is foundational for catalyst design and optimization of liquid-phase catalytic processes in zeolites. It also demonstrates the suitability of machine-learned interatomic potentials for modeling reactive systems, enabling sufficiently long trajectories for appropriate statistical averaging.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

NASA’s Prototype Spectral Water Inversion Processor and Emulator (SWIPE): Towards Global Coastal and Inland Water Quality and Algal Biodiversity Monitoring

Degradation of Earth’s inland water resources due to anthropogenic perturbations and climate anomalies at both local and global scales continues to place human health at substantial risk. There is now a growing necessity to develop pragmatic approaches that allow timely and effective extrapolation of local processes, to spatially resolved global products, and to promote operational and sustainable resource policy management. This presentation will provide updates on NASA’s prototype open-source aquatic modeling platform, Spectral Water Inversion Processor and Emulator (SWIPE), which is a comprehensive, multi-faceted modeling platform for both forward and inverse modeling of diverse aquatic ecosystems from the benthos to top-of-atmosphere (TOA). SWIPE provides a cohesive application which leverages recent advancements in particle modeling, Big Data analytics, and machine learning to develop a high-fidelity synthetic training ground for sensitivity studies and algorithm development for multispectral or upcoming hyperspectral missions. Some of the prominent features of SWIPE to be discussed include: 1. Advanced hyperspectral modeling of globally diverse algal and non-algal particles using a novel two-layer coated sphere scattering model and radiative transfer modeling, 2. Massive, highly detailed synthetic spectral libraries of Analysis-Ready-Data (ARD) which include spectral libraries of particle microphysics, water biogeophysical and optical properties, as well as surface and TOA reflectances at 1 nm resolution, 3. An ensemble of pre-built analytic, machine learning, and deep learning inversion algorithms for various water quality and biodiversity related retrieval parameters and uncertainty quantification, 4. Sensor-agnostic water quality inversion at wide ranging spatial and spectral resolutions including a codebase for seamless application in the Google Earth Engine and NASA Earth Exchange (NEX) for planetary scale analysis. SWIPE will be a fully open-source platform based in python with comprehensive documentation, tutorials, and options for distributed computing on high performance computing clusters or on single, local machines. Further, we will discuss how we envision SWIPE contributing towards a global analysis of coastal and inland water quality dynamics.

top-of-atmosphere (TOA)↗

Machine learning reveals strong grid-scale dependence in the satellite N d –LWP relationship

The relationship between cloud droplet number concentration ( N d ) and liquid water path (LWP) is highly uncertain yet crucial for determining the impact of aerosol-cloud interactions (ACI) on Earth's radiation budget. The N d -LWP relationship is examined using a machine learning (ML) random forest model applied to five years of satellite data at grid resolutions ranging from 10° to 0.05° in 12 distinct regions. In the subtropics, the shape of the N d -LWP relationship switches from an inverted-V at 1° grid-resolution to an “M” shape at 0.1° resolution with decreased $\frac{\textrm{dln⁡LWP}}{\textrm{dln⁡}N_d}$ sensitivity. Tropical and midlatitude regions generally show a more positive sensitivity. Cloud sampling and filtering also influence this slope, wherein the exclusion of thin clouds, as commonly performed to reduce retrieval uncertainty, leads to strongly negative sensitivity across all regions. Precipitation is primarily responsible for driving the strength of the sensitivity, with strong positive slopes in raining clouds and negative and/or neutral responses found in non-raining clouds. A new method to compute radiative forcing from the ML model shows a robust Twomey radiative forcing across all regions and grid resolutions. However, LWP and cloud fraction adjustments to the radiative forcing, which are ∼50 % or smaller than the Twomey effect, decrease to negligible values with higher spatial resolution data. As Earth system models move toward higher spatial resolutions in the future, evaluating the LWP and CF adjustment contributions to the radiative forcing budget at these finer resolutions will be essential for evaluation and model development.

Aerosol-Cloud Interactions↗