Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Forward Modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,765 records · Page 98

Comparison of the Forward and Reverse Photocycle Dynamics of Two Highly Similar Canonical Red/Green Cyanobacteriochromes Reveals Unexpected Differences

Cyanobacteriochromes (CBCRs) are cyanobacterial photoreceptors that exhibit photochromism between two states: a thermally stable dark-adapted state and a metastable light-adapted state with bound linear tetrapyrrole (bilin) chromophores possessing 15Z and 15E configurations, respectively. The photodynamics of canonical red/green CBCRs have been extensively studied; however, the time scales of their excited-state lifetimes and subsequent ground-state evolution rates widely differ and, at present, remain difficult to predict. Here, we compare the photodynamics of two closely related red/green CBCRs that have substantial sequence identity (~68%) and similar chromophore environments: AnPixJg2 from Anabaena sp. PCC 7120 and NpR6012g4 from Nostoc punctiforme. Using broadband transient absorption spectroscopy on the primary (125 fs to 7 ns) and secondary (7 ns to 10 ms) time scales together with global analysis modeling, our studies revealed that AnPixJg2 and NpR6012g4 have comparable quantum yields for initiating the forward ( 15Z P r → 15E P g ) and reverse ( 15E P g → 15Z P r ) reactions, which proceed through monotonic and nonmonotonic mechanisms, respectively. In addition to small discrepancies in the kinetics, the secondary reverse dynamics resolved unique features for each domain: intermediate shunts in NpR6012g4 and a Meta-Gf intermediate red-shifted from the 15Z P r photoproduct in AnPixJg2. Altogether, this study supports the conclusion that sequence similarity is a useful criterion for predicting pathways of the light-induced evolution and quantum yield of generating primary intermediate Φ p within subfamilies of CBCRs, but more studies are still needed to develop a comprehensive molecular level understanding of these processes.

59 BASIC BIOLOGICAL SCIENCES↗

Opening the Door to Grid-Interactive Efficient Buildings with Energy Codes

Building codes represent standard design practice in the construction industry and must continually evolve to account for advancing technologies and innovative practices. Energy codes have historically focused on energy efficiency within buildings and across their systems. However, many of tomorrow's technologies go beyond efficiency and target increased flexibility. These demand flexibility (DF) measures can postpone or reduce building electric load based on price or other grid signals, and include smart appliances, connected lighting, and connected mechanical systems. Expanding codes to enable such grid-interactive efficient building (GEB) has the potential to influence their realization at scale, which will support renewable-energy grid-integration and building-sector decarbonization. However, considering DF measures in code development creates a new set of challenges for codes and the practices contained therein. This paper considers the role of building energy codes in enabling GEB. Specifically, it reviews the status of demand flexibility (DF) measures in current commercial building energy code. It examines the national model code development process and identifies components barring the consideration and inclusion of DF measures - including code scope, characterization and analysis of proposed new prescriptive measures, and accounting for time-of-day and geographic differences in their benefits. The paper presents findings from code development analyses that indicate the cost benefit of DF measures and the limitations associated with current code development conventions. To encourage building flexibility and improved energy resilience moving forward, recommendations are made for removing code development barriers and sanctioning DF measure consideration in future model codes.

Building Energy Codes and Standards, Grid-Interact↗

β + Gamow-Teller Strengths from Unstable 14 O via the (d, 2 He) Reaction in Inverse Kinematics

For the first time, the (d, 2 He) reaction was successfully used in inverse kinematics to extract the Gamow-Teller transition strength in the β + direction from an unstable nucleus. The new technique was made possible by the use of an active-target time-projection chamber and a magnetic spectrometer, and opens a path to addressing a range of scientific challenges, including in astrophysics and neutrino physics. Here, in this Letter, the nucleus studied was 14 O, and the Gamow-Teller transition strength to 14 N was extracted up to an excitation energy of 22 MeV. The data were compared to shell-model and state-of-the-art coupled-cluster calculations. Shell-model calculations reproduce the measured Gamow-Teller strength distribution up to about 15 MeV reasonably well, after the application of a phenomenological quenching factor. In a significant step forward to better understand this quenching, the coupled-cluster calculation reproduces the full strength distribution well without such quenching, owing to the large model space, the inclusion of strong correlations, and the coupling of the weak interaction to two nucleons through two-body currents.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

The Digital Astronaut Project Computational Bone Remodeling Model (Beta Version) Bone Summit Summary Report

Under the conditions of microgravity, astronauts lose bone mass at a rate of 1% to 2% a month, particularly in the lower extremities such as the proximal femur [1-3]. The most commonly used countermeasure against bone loss in microgravity has been prescribed exercise [4]. However, data has shown that existing exercise countermeasures are not as effective as desired for preventing bone loss in long duration, 4 to 6 months, spaceflight [1,3,5,6]. This spaceflight related bone loss may cause early onset of osteoporosis to place the astronauts at greater risk of fracture later in their lives. Consequently, NASA seeks to have improved understanding of the mechanisms of bone demineralization in microgravity in order to appropriately quantify this risk, and to establish appropriate countermeasures [7]. In this light, NASA's Digital Astronaut Project (DAP) is working with the NASA Bone Discipline Lead to implement well-validated computational models to help predict and assess bone loss during spaceflight, and enhance exercise countermeasure development. More specifically, computational modeling is proposed as a way to augment bone research and exercise countermeasure development to target weight-bearing skeletal sites that are most susceptible to bone loss in microgravity, and thus at higher risk for fracture. Given that hip fractures can be debilitating, the initial model development focused on the femoral neck. Future efforts will focus on including other key load bearing bone sites such as the greater trochanter, lower lumbar, proximal femur and calcaneus. The DAP has currently established an initial model (Beta Version) of bone loss due to skeletal unloading in femoral neck region. The model calculates changes in mineralized volume fraction of bone in this segment and relates it to changes in bone mineral density (vBMD) measured by Quantitative Computed Tomography (QCT). The model is governed by equations describing changes in bone volume fraction (BVF), and rates of changes in bone cell populations that remove and replace bone in packets within the bone region. The DAP bone model is unique in several respects. In particular in takes former models of volume fraction changes one step higher in fidelity and separates BVF into separate equations for mineralized and osteoid volume fractions governed by a mineralization rate. This more closely follows the physiology of the remodeling unit cycles where bone is first resorbed and then followed by the action of osteoblasts to lay down collagen matrix which eventually becomes mineralized. In another respect, the modules allow the functional description of the time rate of change of other parameters and variables in the model during a computational simulation. More detailed description of the model, preliminary validation results, current limitation and caveats, and planned advancements are provided in sections 2 through 5. The DAP bone model is being developed primarily as a research tool, and not as a clinical tool like QCT. Even if it transitions to a clinical tool, it is not intended to replace QCT or any other clinical tool. Moreover, the DAP bone model does not predict bone fracture. Its purpose is to provide valuable additional data via "forward prediction" simulations for during and after spaceflight missions to gain insight on, (1) mechanisms of bone demineralization in microgravity, and (2) the volumetric changes at the various bone sites in response to in-flight and post-flight exercise countermeasures. This data can then be used as input to the Keyak [8] (or equivalent) FE analysis method to gain insight on how bone strength may change during and after flight. This information can also be useful to help optimize exercise countermeasure protocols to minimize changes in bone strength during flight, and improve regain of bone strength post-flight. To achieve this goal, the bone model will be integrated with DAP's exercise countermeasure models to simulate the effect of exercise prescriptions on preserving bone. More specifically, the model will accept loading history due to muscle and joint force on bone and produce quantified remodeling within the bone region under influence of the applied stress. Furthermore, because they tend to respond differently, the bone remodeling model includes both trabecular bone and cortical bone.

Pennline, James↗

Many-body expansion based machine learning models for octahedral transition metal complexes

Abstract Graph-based machine learning (ML) models for material properties show great potential to accelerate virtual high-throughput screening of large chemical spaces. However, in their simplest forms, graph-based models do not include any 3D information and are unable to distinguish stereoisomers such as those arising from different orderings of ligands around a metal center in coordination complexes. In this work we present a modification to revised autocorrelation descriptors, a molecular graph featurization method, for predicting spin state dependent properties of octahedral transition metal complexes (TMCs). Inspired by analytical semi-empirical models for TMCs, the new modeling strategy is based on the many-body expansion (MBE) and allows one to tune the captured stereoisomer information by changing the truncation order of the MBE. We present the necessary modifications to include this approach in two commonly used ML methods, kernel ridge regression and feed-forward neural networks. On a test set composed of all possible isomers of binary TMCs, the best MBE models achieve mean absolute errors (MAEs) of 2.75 kcal mol −1 on spin-splitting energies and 0.26 eV on frontier orbital energy gaps, a 30%–40% reduction in error compared to models based on our previous approach. We also observe improved generalization to previously unseen ligands where the best-performing models exhibit MAEs of 4.00 kcal mol −1 (i.e. a 0.73 kcal mol −1 reduction) on the spin-splitting energies and 0.53 eV (i.e. a 0.10 eV reduction) on the frontier orbital energy gaps. Because the new approach incorporates insights from electronic structure theory, such as ligand additivity relationships, these models exhibit systematic generalization from homoleptic to heteroleptic complexes, allowing for efficient screening of TMC search spaces.

Meyer, Ralf (ORCID:0000000322360261)↗

Quasi-steady solar wind dynamics

Progress in understanding the large scale dynamics of quasisteady, corotating solar wind structure was reviewed. The nature of the solar wind at large heliocentric distances preliminary calculations from a 2-D MHD model are used to demonstrate theoretical expectations of corotating structure out to 30 AU. It is found that the forward and reverse shocks from adjacent CIR's begin to interact at about 10 AU, producing new shock pairs flanking secondary CIR's. These sawtooth secondary CIR's interact again at about 20 AU and survive as visible entities to 30 AU. The model predicts the velocity jumps at the leading edge of the secondary CIR's at 30 AU should be very small but there should still be sizable variations in the thermodynamic and magnetic parameters. The driving dynamic mechanism in the distant solar wind is the relaxation of pressure gradients. The second topic is the influence of weak, nonimpulsive time dependence in quasisteady dynamics. It is suggested that modest large scale variations in the coronal flow speed on periods of several hours to a day may be responsible for many of the remaining discrepancies between theory and observation. Effects offer a ready explanation for the apparent rounding of stream fronts between 0.3 and 1.0 AU discovered by Helios.

Pizzo, V. J.↗

VCE early acoustic test results of General Electric's high-radius ratio coannular plug nozzle

Results of variable cycle engine (VCE) early acoustic engine and model scale tests are presented. A summary of an extensive series of far field acoustic, advanced acoustic, and exhaust plume velocity measurements with a laser velocimeter of inverted velocity and temperature profile, high radius ratio coannular plug nozzles on a YJ101 VCE static engine test vehicle are reviewed. Select model scale simulated flight acoustic measurements for an unsuppressed and a mechanical suppressed coannular plug nozzle are also discussed. The engine acoustic nozzle tests verify previous model scale noise reduction measurements. The engine measurements show 4 to 6 PNdB aft quadrant jet noise reduction and up to 7 PNdB forward quadrant shock noise reduction relative to a fully mixed conical nozzle at the same specific thrust and mixed pressure ratio. The influences of outer nozzle radius ratio, inner stream velocity ratio, and area ratio are discussed. Also, laser velocimeter measurements of mean velocity and turbulent velocity of the YJ101 engine are illustrated. Select model scale static and simulated flight acoustic measurements are shown which corroborate that coannular suppression is maintained in forward speed.

Knott, P. R.↗

Approaching hydro-equivalent ignition in laser direct-drive via target design optimization using novel statistical modeling

Laser direct-drive offers significant advantages in terms of target simplicity, improved energy coupling, and large fuel masses over indirect drive. However, performance degradations from hydrodynamic and laser-plasma instabilities seeded and driven by the direct illumination pose limitations on the parameter space available for achieving ignition. In this paper, new design improvements are identified to forge a path forward for a hydro-equivalent ignition demonstration. The first is related to a new formulation of the statistical model (SM) used to accurately predict target performance directly from input parameters such as laser pulse shape and target specifications. This new SM formulation provides direct guidance on target dimensions and laser beam-to-target radius to achieve the highest fusion yield on the OMEGA laser. The second improvement comes from cooling the deuterium–tritium (DT) ice layer below the triple point right before shot time leading to lower DT vapor densities and higher convergence. Guided by these design improvements, a Bayesian optimization algorithm was used to design an implosion that is predicted to closely approach a Lawson triple product that hydrodynamically scales to ignition if equivalent laser–target coupling is achieved at laser energies typical of the National Ignition Facility.

Deuterium↗

The Three-Dimensional Expansion of the Ejecta from Tycho's Supernova Remnant

We present the first 3D measurements of the velocity of various ejecta knots in Tycho's supernova remnant, known to result from a Type Ia explosion. Chandra X-ray observations over a 12 yr baseline from 2003 to 2015 allow us to measure the proper motion of nearly 60 tufts of Si-rich ejecta, giving us the velocity in the plane of the sky. For the line-of-sight velocity, we use two different methods: a nonequilibrium ionization model fit to the strong Si and S lines in the 1.22.8 keV regime, and a fit consisting of a series of Gaussian lines. These methods give consistent results, allowing us to determine the redshift or blueshift of each of the knots. Assuming a distance of 3.5 kpc, we find total velocities that range from 2400 to 6600 km/s, with a mean of 4430 km/s. We find several regions where the ejecta knots have overtaken the forward shock. These regions have proper motions in excess of 6000 km/s. Some SN Ia explosion models predict a velocity asymmetry in the ejecta. We find no such velocity asymmetries in Tycho, and we discuss our findings in light of various explosion models, favoring those delayed-detonation models with relatively vigorous and symmetrical deflagrations. Finally, we compare measurements with models of the remnant's evolution that include both smooth and clumpy ejecta profiles, finding that both ejecta profiles can be accommodated by the observations.

ISM: individual objects (Tycho’s SNR) – ISM: s↗

Model-data comparisons of moments of nonbreaking shoaling surface gravity waves

The predictions of linear and nonlinear (Boussinesq) shoaling wave models for nonbreaking unidirectional surface gravity waves are compared to field observations, with particular emphasis on quantities that may be important for cross-shore sediment transport. The extensive data sets were obtained on two natural beaches, span water depths between 1 and 10 m, and include incident wave power spectra with narrow, broad, and bimodal shapes. Significant wave heights varied between approximately 30 and 100 cm, and peak periods between approximately 8 and 18 s. The evolution of total variances of sea surface elevation, cross-shore velocity, and horizontal acceleration is modeled at least qualitatively well by both linear and nonlinear theories. Only the nonlinear theory predicts the increasingly asymmetric sea surface elevations and horizontal velocities (pitched-forward wave shapes) and the weaker variation of skewness (difference between crest and trough profiles) which are observed to occur during shoaling. The nonlinear theory also models qualitatively well the large skewed accelerations which occur during the passage of asymmetric waves.

Elgar, Steve↗

Accurate data-driven surrogates of dynamical systems for forward propagation of uncertainty

Stochastic collocation (SC) is a well-known non-intrusive method of constructing surrogate models for uncertainty quantification. In dynamical systems, SC is especially suited for full-field uncertainty propagation that characterizes the distributions of the high-dimensional solution fields of a model with stochastic input parameters. However, due to the highly nonlinear nature of the parameter-to-solution map in even the simplest dynamical systems, the constructed SC surrogates are often inaccurate. Here, this work presents an alternative approach, where we apply the SC approximation over the dynamics of the model, rather than the solution. By combining the data-driven sparse identification of nonlinear dynamics framework with SC, we construct dynamics surrogates and integrate them through time to construct the surrogate solutions. We demonstrate that the SC-over-dynamics framework leads to smaller errors, both in terms of the approximated system trajectories as well as the model state distributions, when compared against full-field SC applied to the solutions directly. We present numerical evidence of this improvement using three test problems: a chaotic ordinary differential equation, and two partial differential equations from solid mechanics.

42 ENGINEERING↗

A Prototype Thick-Target Bremsstrahlung Model with Angularly-Dependent Emission in the MCNP6 ® Code

This document summarizes the current thick-target bremsstrahlung (TTB) model in MCNP and provides test results for an alternative implementation to improve the accuracy with reduced cost compared to full electron transport. It has been observed that the current TTB model produces inaccurate results in problems where the medium is thick with respect to electrons, but the photon distribution in the problem has a strong directionality. An example of such a simulation is detectors surrounding a metal target irradiated with a radiographic beam of high energy photons. The primary cause of this discrepancy is the current TTB method emits all bremsstrahlung photons in the same direction as the primary electron produced from each (γ, e ± ) interaction, leading to artificially forward peaked photon distributions for intermediate to high-energy incident photons. To improve the TTB model, we have implemented an angularly-dependent TTB model in a developer version of the MCNP6 ® code; for developers, this was done on the branch prototype/angular_ttb in the mcnp6 repo on bitbucket. The angularly-dependent TTB model accounts for the energy and scattering of electrons as they slow down in the current material, but does not sample the computationally expensive energy straggling, secondary electron events, and tracking electrons; this approach is significantly less computationally expensive than full electron transport and can be comparable to the original TTB method for problems with sufficiently complex materials and geometry. To evaluate the method, we have modeled a simple problem of a beam of 5 MeV photons incident on a sphere of plutonium surrounded by detectors at different deflection angles. For this problem, the angularly-dependent TTB produces a photon flux within 8.0% for a 90 degree deflection angle and 0.8% along the beam axis, as compared to the electron transport solution. This is an improvement compared to a 43% and 81% discrepancy with the original TTB method, respectively. The rest of this work includes the following: the first section details the current TTB treatment in MCNP, which has not been well documented elsewhere. Then, the modified TTB algorithm is detailed and the approximations compared to the condensed history algorithm are compared. Results are given comparing the two TTB methods to the condensed history transport algorithm. The appendix includes details for code developers on relevant electron transport implementation details and potential code improvements for future work.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

AEOLUS: Advances in Experimental Design, Optimal Control, and Learning for Uncertain Complex Systems

Sustained advances in the mathematics of modeling and simulation have resulted in the capability today for routine simulation of a number of large scale complex DOE-relevant systems. As remarkable as this capability for solving the so-called forward problem is, it is typically only the first step-an inner loop within an outer loop that explores the simulation model's parameter space and decision space to characterize uncertainty in the model's predictions, learn unknown model parameters from data, design the most informative experiments, determine optimal control strategies, and create optimal designs. Broadly, what unifies all of these outer loop problems is that they are, in one form or another, optimization problems over parameter/control/design space that are constrained by complex uncertain models. To fully realize the power of scientific simulation as a basis for scientific discovery, technological innovation, and rational decision-making, it is imperative to move beyond simulation to tackle the outer loop of optimization for learning from data, experimental design, and control with complex uncertain models. When the models under consideration are large-scale and complex, and when the optimization variable and uncertain parameter spaces are high (or infinite) dimensional, this constitutes a grand challenge of the highest order, and is intractable with conventional methods. To overcome these challenges, the AEOLUS Center was established to develop a unified mathematical, computational, and statistical framework for (1) Learning predictive models from complex data via Bayesian inference and optimization, and (2) Optimizing experiments, processes, and designs using the resulting uncertain models. These problems are intractable with conventional methods, for several reasons: (1) The simulation problems that govern the inner loops of the optimization problems are expensive to execute (due to severe nonlinearity, heterogeneity, multiphysics/multiscale coupling); (2) The optimization variable and uncertain parameter spaces are high dimensional, often stemming from discretizations of infinite dimensional fields such as initial conditions, sources, or material properties. We argue that the key to overcoming these challenges is to develop new mathematical, computational, and statistical methods that exploit the structure of the Bayesian inference and optimization problems mediated by their underlying complex uncertain models. This structure includes the regularity, sparsity, geometry, low intrinsic dimensionality, and multifidelity nature of the maps from uncertain parameter/optimization variable spaces to the specific objectives targeted: Bayesian inference, optimal experimental design, and optimal control design. Black box methods developed as generic tools are incapable of exploiting this structure. To be successful, we must create, integrate, and cross-fertilize ideas across multiple areas of applied math--including approximation theory, Bayesian inference, data science, experimental design, information theory, machine learning, model reduction, optimal control theory, parallel algorithms, PDE-constrained optimization, randomized algorithms, stochastic optimization, and uncertainty quantification--all while exploiting the structure of the problems at hand. With this goal in mind, we have marshaled a team of leading authorities in these areas. While the methods we develop will be broadly applicable across a wide spectrum of DOE problems in which experiments inform models and the systems those models describe must be optimized under uncertainty, we have chosen a specific area, advanced manufacturing and materials, to drive our work. AMM is characterized by complex models across multiple scales, and is a rich source of challenging problems in inference, experimental design, and optimal control, requiring multifaceted and integrated advances in applied mathematics. As such, AMM serves as an excellent vehicle to motivate and demonstrate the advances in applied mathematics developed by our center.

97 MATHEMATICS AND COMPUTING↗

Space Radiation Transport Code Development: 3DHZETRN

The space radiation transport code, HZETRN, has been used extensively for research, vehicle design optimization, risk analysis, and related applications. One of the simplifying features of the HZETRN transport formalism is the straight-ahead approximation, wherein all particles are assumed to travel along a common axis. This reduces the governing equation to one spatial dimension allowing enormous simplification and highly efficient computational procedures to be implemented. Despite the physical simplifications, the HZETRN code is widely used for space applications and has been found to agree well with fully 3D Monte Carlo simulations in many circumstances. Recent work has focused on the development of 3D transport corrections for neutrons and light ions (Z < 2) for which the straight-ahead approximation is known to be less accurate. Within the development of 3D corrections, well-defined convergence criteria have been considered, allowing approximation errors at each stage in model development to be quantified. The present level of development assumes the neutron cross sections have an isotropic component treated within N explicit angular directions and a forward component represented by the straight-ahead approximation. The N = 1 solution refers to the straight-ahead treatment, while N = 2 represents the bi-directional model in current use for engineering design. The figure below shows neutrons, protons, and alphas for various values of N at locations in an aluminum sphere exposed to a solar particle event (SPE) spectrum. The neutron fluence converges quickly in simple geometry with N > 14 directions. The improved code, 3DHZETRN, transports neutrons, light ions, and heavy ions under space-like boundary conditions through general geometry while maintaining a high degree of computational efficiency. A brief overview of the 3D transport formalism for neutrons and light ions is given, and extensive benchmarking results with the Monte Carlo codes Geant4, FLUKA, and PHITS are provided for a variety of boundary conditions and geometries. Improvements provided by the 3D corrections are made clear in the comparisons. Developments needed to connect 3DHZETRN to vehicle design and optimization studies will be discussed. Future theoretical development will relax the forward plus isotropic interaction assumption to more general angular dependence.

Wilson, John W.↗

Theoretical and experimental research in aeroelastic stability of an advanced bearingless rotor for future helicopters

The aeroelastic stability of a shaft-fixed bearingless rotor is analyzed in wind-tunnel tests for a wide range of operating conditions in order to determine whether such a system could be made aeroelastically stable without incorporating auxiliary dampers. The model rotor and blade properties are determined and used as an input to a bearingless-rotor analysis. Theoretical predictions are compared with experimental results in hover and forward flights. The analysis predicts the lag mode damping satisfactorily for collective pitch between 5 deg and 10 deg; however, the quasi-steady linear aerodynamic modeling overpredicts the damping values for higher collective pitch settings. It is noted that soft blade pitch links improve aeroelastic stability in hover and at low advance ratio.

Wang, James M.↗

Deep Generative Models that Solve PDEs: Distributed Computing for Training Large Data-Free Models

Recent progress in scientific machine learning (SciML) has opened up the possibility of training novel neural network architectures that solve complex partial differential equations (PDEs). Several (nearly data free) approaches have been recently reported that successfully solve PDEs, with examples including deep feed forward networks, generative networks, and deep encoder-decoder networks. However, practical adoption of these approaches is limited by the difficulty in training these models, especially to make predictions at large output resolutions (≥1024×1024). Here we report on a software framework for data parallel distributed deep learning that resolves the twin challenges of training these large SciML models - training in reasonable time as well as distributing the storage requirements. Our framework provides several out of the box functionality including (a) loss integrity independent of number of processes, (b) synchronized batch normalization, and (c) distributed higher-order optimization methods. We show excellent scalability of this framework on both cloud as well as HPC clusters, and report on the interplay between bandwidth, network topology and bare metal vs cloud. We deploy this approach to train generative models of sizes hitherto not possible, showing that neural PDE solvers can be viably trained for practical applications. We also demonstrate that distributed higher-order optimization methods are 2-3× faster than stochastic gradient-based methods and provide minimal convergence drift with higher batch-size.

PDEs↗

Blackout Diffusion: Generative Diffusion Models in Discrete-State Spaces

Typical generative diffusion models rely on a Gaussian diffusion process for training the backward transformations, which can then be used to generate samples from Gaussian noise. However, real world data often takes place in discrete-state spaces, including many scientific applications. Here, we develop a theoretical formulation for arbitrary discrete-state Markov processes in the forward diffusion process using exact (as opposed to variational) analysis. We relate the theory to the existing continuous-state Gaussian diffusion as well as other approaches to discrete diffusion, and identify the corresponding reverse-time stochastic process and score function in the continuous-time setting, and the reverse-time mapping in the discrete-time setting. As an example of this framework, we introduce “Blackout Diffusion”, which learns to produce samples from an empty image instead of from noise. Numerical experiments on the CIFAR-10, Binarized MNIST, and CelebA datasets confirm the feasibility of our approach. Generalizing from specific (Gaussian) forward processes to discrete-state processes without a variational approximation sheds light on how to interpret diffusion models, which we discuss.

Santos, Javier E.↗

Tracing and Forecasting Metabolic Indices of Cancer Patients Using Patient-Specific Deep Learning Models

We develop a patient-specific dynamical system model from the time series data of the cancer patient’s metabolic panel taken during the period of cancer treatment and recovery. The model consists of a pair of stacked long short-term memory (LSTM) recurrent neural networks and a fully connected neural network in each unit. It is intended to be used by physicians to trace back and look forward at the patient’s metabolic indices, to identify potential adverse events, and to make short-term predictions. When the model is used in making short-term predictions, the relative error in every index is less than 10% in the L ∞ norm and less than 6.3% in the L 1 norm in the validation process. Once a master model is built, the patient-specific model can be calibrated through transfer learning. As an example, we obtain patient-specific models for four more cancer patients through transfer learning, which all exhibit reduced training time and a comparable level of accuracy. This study demonstrates that this modeling approach is reliable and can deliver clinically acceptable physiological models for tracking and forecasting patients’ metabolic indices.

60 APPLIED LIFE SCIENCES↗