SEARCH · Engineering Papers

Results for “forward modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Approaching hydro-equivalent ignition in laser direct-drive via target design optimization using novel statistical modeling

Laser direct-drive offers significant advantages in terms of target simplicity, improved energy coupling, and large fuel masses over indirect drive. However, performance degradations from hydrodynamic and laser-plasma instabilities seeded and driven by the direct illumination pose limitations on the parameter space available for achieving ignition. In this paper, new design improvements are identified to forge a path forward for a hydro-equivalent ignition demonstration. The first is related to a new formulation of the statistical model (SM) used to accurately predict target performance directly from input parameters such as laser pulse shape and target specifications. This new SM formulation provides direct guidance on target dimensions and laser beam-to-target radius to achieve the highest fusion yield on the OMEGA laser. The second improvement comes from cooling the deuterium–tritium (DT) ice layer below the triple point right before shot time leading to lower DT vapor densities and higher convergence. Guided by these design improvements, a Bayesian optimization algorithm was used to design an implosion that is predicted to closely approach a Lawson triple product that hydrodynamically scales to ignition if equivalent laser–target coupling is achieved at laser energies typical of the National Ignition Facility.

Deuterium↗

DOE OSTI2024

Accurate data-driven surrogates of dynamical systems for forward propagation of uncertainty

Stochastic collocation (SC) is a well-known non-intrusive method of constructing surrogate models for uncertainty quantification. In dynamical systems, SC is especially suited for full-field uncertainty propagation that characterizes the distributions of the high-dimensional solution fields of a model with stochastic input parameters. However, due to the highly nonlinear nature of the parameter-to-solution map in even the simplest dynamical systems, the constructed SC surrogates are often inaccurate. Here, this work presents an alternative approach, where we apply the SC approximation over the dynamics of the model, rather than the solution. By combining the data-driven sparse identification of nonlinear dynamics framework with SC, we construct dynamics surrogates and integrate them through time to construct the surrogate solutions. We demonstrate that the SC-over-dynamics framework leads to smaller errors, both in terms of the approximated system trajectories as well as the model state distributions, when compared against full-field SC applied to the solutions directly. We present numerical evidence of this improvement using three test problems: a chaotic ordinary differential equation, and two partial differential equations from solid mechanics.

42 ENGINEERING↗

DOE OSTI2023

A Prototype Thick-Target Bremsstrahlung Model with Angularly-Dependent Emission in the MCNP6 ® Code

This document summarizes the current thick-target bremsstrahlung (TTB) model in MCNP and provides test results for an alternative implementation to improve the accuracy with reduced cost compared to full electron transport. It has been observed that the current TTB model produces inaccurate results in problems where the medium is thick with respect to electrons, but the photon distribution in the problem has a strong directionality. An example of such a simulation is detectors surrounding a metal target irradiated with a radiographic beam of high energy photons. The primary cause of this discrepancy is the current TTB method emits all bremsstrahlung photons in the same direction as the primary electron produced from each (γ, e ± ) interaction, leading to artificially forward peaked photon distributions for intermediate to high-energy incident photons. To improve the TTB model, we have implemented an angularly-dependent TTB model in a developer version of the MCNP6 ® code; for developers, this was done on the branch prototype/angular_ttb in the mcnp6 repo on bitbucket. The angularly-dependent TTB model accounts for the energy and scattering of electrons as they slow down in the current material, but does not sample the computationally expensive energy straggling, secondary electron events, and tracking electrons; this approach is significantly less computationally expensive than full electron transport and can be comparable to the original TTB method for problems with sufficiently complex materials and geometry. To evaluate the method, we have modeled a simple problem of a beam of 5 MeV photons incident on a sphere of plutonium surrounded by detectors at different deflection angles. For this problem, the angularly-dependent TTB produces a photon flux within 8.0% for a 90 degree deflection angle and 0.8% along the beam axis, as compared to the electron transport solution. This is an improvement compared to a 43% and 81% discrepancy with the original TTB method, respectively. The rest of this work includes the following: the first section details the current TTB treatment in MCNP, which has not been well documented elsewhere. Then, the modified TTB algorithm is detailed and the approximations compared to the condensed history algorithm are compared. Results are given comparing the two TTB methods to the condensed history transport algorithm. The appendix includes details for code developers on relevant electron transport implementation details and potential code improvements for future work.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2024

AEOLUS: Advances in Experimental Design, Optimal Control, and Learning for Uncertain Complex Systems

Sustained advances in the mathematics of modeling and simulation have resulted in the capability today for routine simulation of a number of large scale complex DOE-relevant systems. As remarkable as this capability for solving the so-called forward problem is, it is typically only the first step-an inner loop within an outer loop that explores the simulation model's parameter space and decision space to characterize uncertainty in the model's predictions, learn unknown model parameters from data, design the most informative experiments, determine optimal control strategies, and create optimal designs. Broadly, what unifies all of these outer loop problems is that they are, in one form or another, optimization problems over parameter/control/design space that are constrained by complex uncertain models. To fully realize the power of scientific simulation as a basis for scientific discovery, technological innovation, and rational decision-making, it is imperative to move beyond simulation to tackle the outer loop of optimization for learning from data, experimental design, and control with complex uncertain models. When the models under consideration are large-scale and complex, and when the optimization variable and uncertain parameter spaces are high (or infinite) dimensional, this constitutes a grand challenge of the highest order, and is intractable with conventional methods. To overcome these challenges, the AEOLUS Center was established to develop a unified mathematical, computational, and statistical framework for (1) Learning predictive models from complex data via Bayesian inference and optimization, and (2) Optimizing experiments, processes, and designs using the resulting uncertain models. These problems are intractable with conventional methods, for several reasons: (1) The simulation problems that govern the inner loops of the optimization problems are expensive to execute (due to severe nonlinearity, heterogeneity, multiphysics/multiscale coupling); (2) The optimization variable and uncertain parameter spaces are high dimensional, often stemming from discretizations of infinite dimensional fields such as initial conditions, sources, or material properties. We argue that the key to overcoming these challenges is to develop new mathematical, computational, and statistical methods that exploit the structure of the Bayesian inference and optimization problems mediated by their underlying complex uncertain models. This structure includes the regularity, sparsity, geometry, low intrinsic dimensionality, and multifidelity nature of the maps from uncertain parameter/optimization variable spaces to the specific objectives targeted: Bayesian inference, optimal experimental design, and optimal control design. Black box methods developed as generic tools are incapable of exploiting this structure. To be successful, we must create, integrate, and cross-fertilize ideas across multiple areas of applied math--including approximation theory, Bayesian inference, data science, experimental design, information theory, machine learning, model reduction, optimal control theory, parallel algorithms, PDE-constrained optimization, randomized algorithms, stochastic optimization, and uncertainty quantification--all while exploiting the structure of the problems at hand. With this goal in mind, we have marshaled a team of leading authorities in these areas. While the methods we develop will be broadly applicable across a wide spectrum of DOE problems in which experiments inform models and the systems those models describe must be optimized under uncertainty, we have chosen a specific area, advanced manufacturing and materials, to drive our work. AMM is characterized by complex models across multiple scales, and is a rich source of challenging problems in inference, experimental design, and optimal control, requiring multifaceted and integrated advances in applied mathematics. As such, AMM serves as an excellent vehicle to motivate and demonstrate the advances in applied mathematics developed by our center.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Deep Generative Models that Solve PDEs: Distributed Computing for Training Large Data-Free Models

Recent progress in scientific machine learning (SciML) has opened up the possibility of training novel neural network architectures that solve complex partial differential equations (PDEs). Several (nearly data free) approaches have been recently reported that successfully solve PDEs, with examples including deep feed forward networks, generative networks, and deep encoder-decoder networks. However, practical adoption of these approaches is limited by the difficulty in training these models, especially to make predictions at large output resolutions (≥1024×1024). Here we report on a software framework for data parallel distributed deep learning that resolves the twin challenges of training these large SciML models - training in reasonable time as well as distributing the storage requirements. Our framework provides several out of the box functionality including (a) loss integrity independent of number of processes, (b) synchronized batch normalization, and (c) distributed higher-order optimization methods. We show excellent scalability of this framework on both cloud as well as HPC clusters, and report on the interplay between bandwidth, network topology and bare metal vs cloud. We deploy this approach to train generative models of sizes hitherto not possible, showing that neural PDE solvers can be viably trained for practical applications. We also demonstrate that distributed higher-order optimization methods are 2-3× faster than stochastic gradient-based methods and provide minimal convergence drift with higher batch-size.

PDEs↗

DOE OSTI2023

Blackout Diffusion: Generative Diffusion Models in Discrete-State Spaces

Typical generative diffusion models rely on a Gaussian diffusion process for training the backward transformations, which can then be used to generate samples from Gaussian noise. However, real world data often takes place in discrete-state spaces, including many scientific applications. Here, we develop a theoretical formulation for arbitrary discrete-state Markov processes in the forward diffusion process using exact (as opposed to variational) analysis. We relate the theory to the existing continuous-state Gaussian diffusion as well as other approaches to discrete diffusion, and identify the corresponding reverse-time stochastic process and score function in the continuous-time setting, and the reverse-time mapping in the discrete-time setting. As an example of this framework, we introduce “Blackout Diffusion”, which learns to produce samples from an empty image instead of from noise. Numerical experiments on the CIFAR-10, Binarized MNIST, and CelebA datasets confirm the feasibility of our approach. Generalizing from specific (Gaussian) forward processes to discrete-state processes without a variational approximation sheds light on how to interpret diffusion models, which we discuss.

Santos, Javier E.↗

DOE OSTI2022

Tracing and Forecasting Metabolic Indices of Cancer Patients Using Patient-Specific Deep Learning Models

We develop a patient-specific dynamical system model from the time series data of the cancer patient’s metabolic panel taken during the period of cancer treatment and recovery. The model consists of a pair of stacked long short-term memory (LSTM) recurrent neural networks and a fully connected neural network in each unit. It is intended to be used by physicians to trace back and look forward at the patient’s metabolic indices, to identify potential adverse events, and to make short-term predictions. When the model is used in making short-term predictions, the relative error in every index is less than 10% in the L ∞ norm and less than 6.3% in the L 1 norm in the validation process. Once a master model is built, the patient-specific model can be calibrated through transfer learning. As an example, we obtain patient-specific models for four more cancer patients through transfer learning, which all exhibit reduced training time and a comparable level of accuracy. This study demonstrates that this modeling approach is reliable and can deliver clinically acceptable physiological models for tracking and forecasting patients’ metabolic indices.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2023

Code for the manuscript titled "Blackout Diffusion: Generative Diffusion Models in Discrete-State Spaces"

We would like to disclose two scripts, written in Jupyter notebook, in which we implement the "Blackout Diffusion Process" described in the manuscript "Blackout Diffusion: Generative Diffusion Models in Discrete-State Spaces" (LA-UR-23-20509), to be submitted to the International Conference of Machine Learning (ICML). The abstract of the manuscript is append below. == Typical generative diffusion models rely on a Gaussian diffusion process for training the backward transformations, which can then be used generate samples from Gaussian noise. However, real world data often takes place in discrete-state spaces, which occur in many scientific applications. Here, we develop a theoretical formulation for arbitrary discrete-state Markov processes in the forward diffusion process. We relate the theory to the existing continuous-state Gaussian diffusion and identify the corresponding reverse-time stochastic process and score function in the continuous-time setting, and the reverse-time mapping in the discrete-time setting. As an example of this framework, we introduce "Blackout Diffusion", which learns to produce samples from an empty image instead of from noise. Numerical experiments on the CIFAR-10 dataset confirm the feasibility of generative diffusion modeling in a discrete space. Generalizing from specific (Gaussian) forward processes to a more general framework also sheds light on how to interpret generative diffusion models and their mathematical structure, which we comment on.

Lin, Yen Ting↗

DOE OSTI2026

Instabilities and phase transitions in architected metamaterials: a gradient-enhanced continuum approach

Architected metamaterials such as foams and lattices exhibit a wide range of properties governed by microstructural instabilities and emerging phase transitions. Their macroscopic response–including energy dissipation during impact, large recoverable deformations, morphing between configurations, and auxetic behavior–remains difficult to capture with conventional continuum models, which often rely on discrete approaches that limit scalability. In this work, we propose a nonlocal continuum formulation that captures both stable and unstable responses of elastic architected metamaterials. The framework extends anisotropic hyperelasticity by introducing nonlocal variables and internal length scales reflective of microstructural features. Local polyconvex free-energy models are systematically augmented with two families of non-(poly)convex energies, enabling both metastable and bistable responses. Implementation in a finite element framework enables solution using a hybrid monolithic–staggered strategy. Simulations capture densification fronts, forward and reverse transitions, hysteresis loops, imperfection sensitivity, and globally coordinated auxetic modes. Overall, this framework provides a robust foundation for accelerated modeling of instability-driven phenomena in architected metamaterials, while enabling extensions to anisotropic, dissipative, and active systems as well as integration with data-driven and machine learning approaches.

42 ENGINEERING↗

DOE OSTI2022

Spanning the Gap From Bulk to Bin: A Novel Spectral Microphysics Method

Microphysics methods for climate models and numerical weather prediction typically track one, two, or three moments of a droplet size distribution for various categories of liquid, ice, and aerosol. Such methods rely on conversion parameters between these categories, which introduces uncertainty into predictions. While higher-fidelity options such as bin and Lagrangian schemes exist, they require too many degrees of freedom for climate modeling applications and introduce numerical challenges. Here we introduce a flexible spectral microphysics method based on collocation of basis functions. This method generalizes to a linear bulk scheme when using few basis functions and to a smoothed bin scheme with more degrees of freedom. Tested in an idealized box setting, the method improves spectral accuracy for droplet collision-coalescence and may eliminate the need for precipitation autoconversion rates required by bulk methods; furthermore, it generalizes well to multimodal distributions with less complexity than a bin method. The potential to extend this collocation representation to multiple hydrometeor classes suggests a path forward to unify liquid, ice, and aerosol microphysics in a single, flexible, computational framework for climate modeling.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Calibration of elastoplastic constitutive model parameters from full-field data with automatic differentiation-based sensitivities

Here, we present a framework for calibration of parameters in elastoplastic constitutive models that is based on the use of automatic differentiation (AD). The model calibration problem is posed as a partial differential equation-constrained optimization problem where a finite element (FE) model of the coupled equilibrium equation and constitutive model evolution equations serves as the constraint. The objective function quantifies the mismatch between the displacement predicted by the FE model and full-field digital image correlation data, and the optimization problem is solved using gradient-based optimization algorithms. Forward and adjoint sensitivities are used to compute the gradient at considerably less cost than its calculation from finite difference approximations. Through the use of AD, we need only to write the constraints in terms of AD objects, where all of the derivatives required for the forward and inverse problems are obtained by appropriately seeding and evaluating these quantities. We present three numerical examples that verify the correctness of the gradient, demonstrate the AD approach's parallel computation capabilities via application to a large-scale FE model, and highlight the formulation's ease of extensibility to other classes of constitutive models.

42 ENGINEERING↗

DOE OSTI2022

Physics-Informed Neural Network Modeling of Li-Ion Batteries: Preprint

Li-ion batteries (LIB) are a promising solution to enable storage of intermittent energy sources due to their high energy density. However, LIBs are known to significantly degrade after about 1000 charge-discharge cycles. LIBs degrade following different degradation modes and at a rate that depends on the operating conditions (external temperature, load). To plan the installation of batteries, appropriate understanding and prediction capabilities of their lifecycle is needed. High-fidelity numerical models of LIBs such as the pseudo-two-dimensional (P2D) model have been shown to accurately represent the charge-discharge-cycle of an LIB given ac- curate choice of the physical parameters. Given the large number of P2D parameters, adjusting them using forward runs is intractable. This work describes the development of a physics-informed neural network (PINN) as a surrogate substitute of the P2D model that captures parameter dependence. The PINN is advantageous as it needs little to no data, and can naturally encode the dependence of every model parameter. Here, a specific training procedure is adopted to efficiently cover parameter space, handle model stiffness and enforce boundary conditions. The trained PINN is validated against numerical solutions of the P2D model, and its applicability to battery degradation modeling is discussed.

battery degradation↗

DOE OSTI2023

Direct Estimation of Parameters in ODE Models Using WENDy: Weak-Form Estimation of Nonlinear Dynamics

Abstract We introduce the Weak-form Estimation of Nonlinear Dynamics (WENDy) method for estimating model parameters for non-linear systems of ODEs. Without relying on any numerical differential equation solvers, WENDy computes accurate estimates and is robust to large (biologically relevant) levels of measurement noise. For low dimensional systems with modest amounts of data, WENDy is competitive with conventional forward solver-based nonlinear least squares methods in terms of speed and accuracy. For both higher dimensional systems and stiff systems, WENDy is typically both faster (often by orders of magnitude) and more accurate than forward solver-based approaches. The core mathematical idea involves an efficient conversion of the strong form representation of a model to its weak form, and then solving a regression problem to perform parameter inference. The core statistical idea rests on the Errors-In-Variables framework, which necessitates the use of the iteratively reweighted least squares algorithm. Further improvements are obtained by using orthonormal test functions, created from a set of $$C^{\infty }$$ C ∞ bump functions of varying support sizes.We demonstrate the high robustness and computational efficiency by applying WENDy to estimate parameters in some common models from population biology, neuroscience, and biochemistry, including logistic growth, Lotka-Volterra, FitzHugh-Nagumo, Hindmarsh-Rose, and a Protein Transduction Benchmark model. Software and code for reproducing the examples is available at https://github.com/MathBioCU/WENDy .

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Unblocking Oxygen Charge Compensation for Stabilized High‐Voltage Structure in P2‐Type Sodium‐Ion Cathode

Abstract Layered transition‐metal (TM) oxides are ideal hosts for Li + charge carriers largely due to the occurrence of oxygen charge compensation that stabilizes the layered structure at high voltage. Hence, enabling charge compensation in sodium layered oxides is a fascinating task for extending the cycle life of sodium‐ion batteries. Herein a Ti/Mg co‐doping strategy for a model P2‐Na 2/3 Ni 1/3 Mn 2/3 O 2 cathode material is put forward to activate charge compensation through highly hybridized O 2 p TM 3 d covalent bonds. In this way, the interlayer OO electrostatic repulsion is weakened upon deeply charging, which strongly affects the systematic total energy that transforms the striking P2–O2 interlayer contraction into a moderate solid‐solution‐type evolution. Accordingly, the cycling stability of the codoped cathode material is improved superiorly over the pristine sample. This study starts a perspective way of optimizing the sodium layered cathodes by rational structural design coupling electrochemical reactions, which can be extended to widespread battery researches.

25 ENERGY STORAGE↗

DOE OSTI2026

Understanding and mitigating degradation in amine-based sorbents for CO 2 direct air capture

The success of direct air capture (DAC) of CO 2 depends on sorbents that combine high capacity, low energy requirements, and long-term durability. Amine-based sorbents-including solid-supported aminopolymers, grafted amines, and amine-functionalized resins-remain the leading candidates, but their limited lifetimes drive up costs and constrain deployment. In this review, we outline the current understanding of amine-based sorbent degradation with an emphasis on clearly identifying what is known about structure-property-performance relationships, as well as important knowledge gaps. More specifically, we discuss how polymer chemistry, sorbent design variables, and environmental and process conditions contribute to performance loss. In parallel, we outline how advances in spectroscopy, modeling, and accelerated testing are beginning to illuminate chemical and physical degradation mechanisms. Looking forward, we identify future research directions that will be critical for gaining a deeper understanding of degradation, as well as opportunities for developing innovative mitigation strategies for improving the lifetime of amine-based sorbents.

organic↗

DOE OSTI2020

Deep learning of free boundary and Stefan problems

Free boundary problems appear naturally in numerous areas of mathematics, science and engineering. These problems present a great computational challenge because they necessitate numerical methods that can yield an accurate approximation of free boundaries and complex dynamic interfaces. In this work, we propose a multi-network model based on physics-informed neural networks to tackle a general class of forward and inverse free boundary problems called Stefan problems. Specifically, we approximate the unknown solution as well as any moving boundaries by two deep neural networks. Besides, we formulate a new type of inverse Stefan problems that aim to reconstruct the solution and free boundaries directly from sparse and noisy measurements. We demonstrate the effectiveness of our approach in a series of benchmarks spanning different types of Stefan problems, and illustrate how the proposed framework can accurately recover solutions of partial differential equations with moving boundaries and dynamic interfaces. All code and data accompanying this manuscript are publicly available at https://github.com/PredictiveIntelligenceLab/DeepStefan.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2021

Enhanced medium chain length-polyhydroxyalkanoate production by co-fermentation of lignin and holocellulose hydrolysates

Biological lignin conversion to medium chain length-polyhydroxyalkanoates (mcl-PHA) has recently emerged as an attractive alternative to petroleum-based plastics due to the renewable nature of lignin and the value-added applications of mcl-PHA. Previous reports suggested that addition of limited glucose can improve mcl-PHA accumulation in Pseudomonas putida KT2440 grown in lignin substrates. Herein, we propose a biorefinery process to systematically release lignin and sugars from lignocellulosic biomass and evaluate the potential of co-utilization of all biomass components for conversion to mcl-PHA. Our results indicate that a sequential treatment composed of acid pretreatment, enzymatic hydrolysis and alkaline treatment produces a suitable lignin stream for mcl-PHA production in engineered P. putida. In addition, the PHA titer could be increased by 71% when the lignin stream (AH) was combined with the enzymatic hydrolysate (EH) at a ratio of 75 : 25. Higher ratios of EH : AH negatively affect mcl-PHA accumulation as well as mixtures with sugars from the acid hydrolysate. The optimization of the fermentation conditions, including the inoculum (OD 600 ) and substrate (soluble solid content (SSC)), was carried out by a central composite design. The optimal conditions were achieved at OD 600 = 2.17 and SSC = 68.28 g L –1 . Under these conditions, the titer increased 4.3 fold, achieving a mcl-PHA production of 1.38 g L –1 . Lignin characterization before and after fermentation by nuclear magnetic resonance and gas chromatography showed that p-coumarates were mainly consumed during the fermentation for mcl-PHA production. Overall, this biorefinery strategy allowed us to increase mcl-PHA production by utilizing the different lignocellulosic fractions. Unlike previous studies, no model substrates were utilized at any stage of the fermentation process, representing a step forward towards process feasibility.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2025

Resolving discrepancies in bang-time predictions for indirect-drive ICF experiments on the NIF: Insights from the Build-A-Hohlraum campaign

This study investigated discrepancies between measured and simulated x-ray drive in Indirect-Drive Inertial Confinement Fusion (ID-ICF) hohlraums at the National Ignition Facility. Despite advances in radiation-hydrodynamic simulations, a consistent “drive deficit” remains. Experimentally measured ID-ICF capsule bang-times are systematically 400–700 ps later than simulations predict. The Build-A-Hohlraum (BAH) campaign explored potential causes for this discrepancy by systematically varying hohlraum features, including laser entrance hole (LEH) windows, capsules, and gas fills. Overall, the agreement between simulated and experimental x-ray drive was found to be largely unaffected by these changes. The data allow us to exclude some hypotheses put forward to potentially explain the discrepancy. Errors in the local thermodynamic equilibrium (LTE) atomic modeling, errors in the modeling of LEH closure, and errors due to a lack of plasma species mix physics in simulations are shown to be inconsistent with our measurements. Instead, the data support the hypothesis that errors in NLTE emission modeling are a significant contributor to the discrepancy. X-ray emission in the 2–4 keV range is found to be approximately 30% lower than in simulations. This is accompanied by higher than predicted electron temperatures in the gold bubble region, pointing to errors in non-LTE modeling. Introducing an opacity multiplier of 0.87 on energy groups above 1.8 keV improves agreement with experimental data, reducing the bang-time discrepancy from 300 to 100 ps. These results underscore the need for refined NLTE opacity models to enhance the predictive power of hohlraum simulations.

Band emission↗