Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “train”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,459 records · Page 81

Respecting causality for training physics-informed neural networks

While the popularity of physics-informed neural networks (PINNs) is steadily rising, to this date PINNs have not been successful in simulating dynamical systems whose solution exhibits multi-scale, chaotic or turbulent behavior. In this work we attribute this shortcoming to the inability of existing PINNs formulations to respect the spatio-temporal causal structure that is inherent to the evolution of physical systems. We argue that this is a fundamental limitation and a key source of error that can ultimately steer PINN models to converge towards erroneous solutions. We address this pathology by proposing a simple re-formulation of PINNs loss functions that can explicitly account for physical causality during model training. We demonstrate that this simple modification alone is enough to introduce significant accuracy improvements, as well as a practical quantitative mechanism for assessing the convergence of a PINNs model. Here we provide state-of-the-art numerical results across a series of benchmarks for which existing PINNs formulations fail, including the chaotic Lorenz system, the Kuramoto–Sivashinsky equation in the chaotic regime, and the Navier–Stokes equations. To the best of our knowledge, this is the first time that PINNs have been successful in simulating such systems, introducing new opportunities for their applicability to problems of industrial complexity.

97 MATHEMATICS AND COMPUTING↗

A systematic method for selecting molecular descriptors as features when training models for predicting physiochemical properties

Machine learning has proven to be a powerful tool for accelerating biofuel development. Although numerous models are available to predict a range of properties using chemical descriptors, there is a trade-off between interpretability and performance. Neural networks provide predictive models with high accuracy at the expense of some interpretability, while simpler models such as linear regression often lack in accuracy. In addition to model architecture, feature selection is also critical for developing interpretable and accurate predictive models. We present a method for systematically selecting molecular descriptor features and developing interpretable machine learning models without sacrificing accuracy. Our method simplifies the process of selecting features by reducing feature multicollinearity and enables discoveries of new relationships between global properties and molecular descriptors. To demonstrate our approach, we developed models for predicting melting point, boiling point, flash point, yield sooting index, and net heat of combustion with the help of the Tree-based Pipeline Optimization Tool (TPOT). For training, we used publicly available experimental data for up to 8351 molecules. Our models accurately predict various molecular properties for organic molecules (mean absolute percent error (MAPE) ranges from 3.3% to 10.5%) and provide a set of features that are well-correlated to the property. This method enables researchers to explore sets of features that significantly contribute to the prediction of the property, offering new scientific insights. To help accelerate early stage biofuel research and development, we also integrated the data and models into a open-source, interactive web tool.

09 BIOMASS FUELS↗

Solving the master equation without kinetic Monte Carlo: Tensor train approximations for a CO oxidation model

In multiscale modeling of heterogeneous catalytic processes, one crucial point is the solution of a Markovian master equation describing the stochastic reaction kinetics. Usually, this is too high-dimensional to be solved with standard numerical techniques and one has to rely on sampling approaches based on the kinetic Monte Carlo method. In this study we break the curse of dimensionality for the direct solution of the Markovian master equation by exploiting the Tensor Train Format for this purpose. The performance of the approach is demonstrated on a first principles based, reduced model for the CO oxidation on the RuO{sub 2}(110) surface. We investigate the complexity for increasing system size and for various reaction conditions. The advantage over the stochastic simulation approach is illustrated by a problem with increased stiffness.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Gradient-based optimization for regression in the functional tensor-train format

Predictive analysis of complex computational models, such as uncertainty quantification (UQ), must often rely on using an existing database of simulation runs. In this paper we consider the task of performing low-multilinear-rank regression on such a database. Specifically we develop and analyze an efficient gradient computation that enables gradient-based optimization procedures, including stochastic gradient descent and quasi-Newton methods, for learning the parameters of a functional tensor-train (FT). We compare our algorithms with 22 other nonparametric and parametric regression methods on 10 real-world data sets and show that for many physical systems, exploiting low-rank structure facilitates efficient construction of surrogate models. Here, we use a number of synthetic functions to build insight into behavior of our algorithms, including the rank adaptation and group-sparsity regularization procedures that we developed to reduce overfitting. Finally we conclude the paper by building a surrogate of a physical model of a propulsion plant on a naval vessel.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Radiation Therapy Patient Education Review and a Case Study Using the Virtual Environment for Radiotherapy Training System

The emergence of modern learning environments for radiation therapy (RT) education offers innovative opportunities for RT patients. This article presents a descriptive review of the current state of practice for two recently available tools, the “Virtual Environment for Radiotherapy Training” (VERT) and the “Patient Education And Radiotherapy Learning” (PEARL) systems. Subsequently, a case study summarizes the instructional design and development of an RT breast cancer patient education program, with the intention of providing a blueprint for further patient education initiatives that incorporate VERT.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Verification and validation of atmospheric transport models with the UF Training Reactor

The University of Florida Training Reactor (UFTR) is a 100-kW ARGONAUT type reactor with a unique design such that a large volume of air passes through the core, producing and releasing significant quantities of 41 Ar. Once released, the radioargon is dispersed throughout the atmosphere and decays by a 1294 keV gamma ray emission. This quantified, validated, and controlled 41 Ar plume can be utilized to verify and validate atmospheric transport models (ATMs). This is accomplished by coupling an ATM with MCNP and comparing the results to experimental measurements. For this study, an in-house developed Gaussian dispersion model and the EPA approved Gaussian model AERMOD were coupled with MCNP to simulate the results of a six hour measurement taken on May 8th, 2018. For the measurements and simulations, a grid of seven NaI detectors were placed in four different rooftop locations near the UFTR plume stack. With easterly winds dominating during the morning and early afternoon, both the measurement results and simulations displayed a higher 41 Ar photon count rate on the detectors west of the plume stack throughout the day. Overall, the AERMOD simulations produced better results when compared to the in-house model, particularly for the detectors placed east and west of the plume stack. While some of the AERMOD data showed a strong correlation with the measurements, the results remain inconsistent. Here, due to the varying accuracy of the simulation results, it is theorized that the relationship between measurement results and simulations will improve with the use of localized weather information or the utilization of non-Gaussian dispersion models.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Characterization of transverse electron pulse trains using RF powered traveling wave metallic comb striplines

Advancements in ultrafast electron microscopy have allowed elucidation of spatially selective structural dynamics. However, as the spatial resolution and imaging capabilities have made progress, quantitative characterization of the electron pulse trains has not been reported at the same rate. In fact, inexperienced users have difficulty replicating the technique because only a few dedicated microscopes have been characterized thoroughly. Systems replacing laser driven photoexcitation with electrically driven deflectors especially suffer from a lack of quantified characterization because of the limited quantity. The primary advantages to electrically driven systems are broader frequency ranges, ease of use and simple synchronization to electrical pumping. Here, we characterize the technical parameters for electrically driven UEM including the shape, size and duration of the electron pulses using low and high frequency chopping methods. At high frequencies, pulses are generated by sweeping the electron beam across a chopping aperture. For low frequencies, the beam is continuously forced off the optic axis by a DC potential, then momentarily aligned by a countering pulse. Using both methods, we present examples that measure probe durations of 2 ns and 10 ps for the low and high frequency techniques, respectively. Here, we also discuss how the implementation of a pulsed probe affects STEM imaging conditions by adjusting the first condenser lens.

36 MATERIALS SCIENCE↗

Beryllium-10 dating of the Foothills Erratics Train in Alberta, Canada, indicates detachment of the Laurentide Ice Sheet from the Rocky Mountains at ~15 ka

The Foothills Erratics Train consists of large quartzite blocks of Rocky Mountains origin deposited on the eastern slopes of the Rocky Mountain Foothills in Alberta between ~53.5°N and 49°N. The blocks were deposited in their present locations when the western margin of the Laurentide Ice Sheet (LIS) detached from the local ice masses of the Rocky Mountains, which initiated the opening of the southern end of the ice-free corridor between the Cordilleran Ice Sheet and the LIS. In this study, we use 10 Be exposure dating to constrain the beginning of this decoupling. Based on a group of 12 samples well-clustered in time, we date the detachment of the western LIS margin from the Rocky Mountain front to ~14.9 ± 0.9 ka. This is ~1000 years later than previously assumed, but a lack of a latitudinal trend in the ages over a distance of ~500 km is consistent with the rapid opening of a long wedge of unglaciated terrain portrayed in existing ice-retreat reconstructions. Finally, a later separation of the western LIS margin from the mountain front implies higher ice margin–retreat rates in order to meet the Younger Dryas ice margin position near the boundary of the Canadian Shield ~2000 years later.

10Be exposure dating↗

ff19SB: Amino-acid specific protein backbone parameters trained against quantum mechanics energy surfaces in solution

Molecular dynamics (MD) simulations have become increasingly popular in studying the motions and functions of biomolecules. The accuracy of the simulation, however, is highly determined by the molecular mechanics (MM) force field (FF), a set of functions with adjustable parameters to compute the potential energies from atomic positions. However, the overall quality of the FF, such as our previously published ff99SB and ff14SB, can be limited by assumptions that were made years ago. In the updated model presented here (ff19SB), we have significantly improved the backbone profiles for all 20 amino acids. We fit coupled Φ/ψ parameters using 2D Φ/ψ conformational scans for multiple amino acids, using as reference data the entire 2D quantum mechanics (QM) energy surface. We address the polarization inconsistency during dihedral parameter fitting by using both QM and MM in solution. Finally, we examine possible dependency of the backbone fitting on side chain rotamer. To extensively validate ff19SB parameters, we have performed a total of ~5 milliseconds MD simulations in explicit solvent. Here, our results show that after amino-acid specific training against QM data with solvent polarization, ff19SB not only reproduces the differences in amino acid specific Protein Data Bank (PDB) Ramachandran maps better, but also shows significantly improved capability to differentiate amino acid dependent properties such as helical propensities. We also conclude that an inherent underestimation of helicity is present in ff14SB, which is (inexactly) compensated by an increase in helical content driven by the TIP3P bias toward overly compact structures. In summary, ff19SB, when combined with a more accurate water model such as OPC, should have better predictive power for modeling sequence-specific behavior, protein mutations, and also rational protein design.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Computational Seismology Workshop Trains Early-Career Scientists

The Computational Infrastructure for Geodynamics (CIG), in collaboration with Lawrence Livermore National Laboratory (LLNL), held a workshop last year that focused on computational seismology. The workshop provided training in seismic waveform processing, visualization, and high-performance computing (HPC) waveform simulation. Fifty-five predominantly early-career participants—graduate students and postdocs—from the United States and 16 other countries attended. The workshop was the first of its kind to feature full access to HPC resources for research-grade example problems.

58 GEOSCIENCES↗

An Observationally Trained Markov Model for MJO Propagation

A Markovian stochastic model is developed for studying the propagation of the Madden-Julian Oscillation (MJO). This model represents the daily changes in real time multivariate MJO (RMM) indices as random functions of their current state and background conditions. The probability distribution function of the RMM changes is obtained using a machine learning algorithm trained to maximize MJO forecast skills using observed daily indices of RMM and different modes of variability. Skillful forecasts are obtained for lead times between 8 and 27 days. Large ensemble simulations by the stochastic model show that with monsoonal changes in the background state, MJO propagation across the Maritime Continent (MC) is most likely to be disrupted in boreal spring and summer when MJO events propagate from favorable conditions over the Indian Ocean to unfavorable ones over the MC, and predictability is higher during spring and summer when MJO activity is away from the MC region.

54 ENVIRONMENTAL SCIENCES↗

Monitoring Seismic Velocity Changes Across the San Jacinto Fault Using Train‐Generated Seismic Tremors

Abstract Microseismic noise has been used for seismic velocity monitoring. However, such signals are dominated by low‐frequency surface waves that are not ideal for detecting changes associated with small tectonic processes. Here we show that it is possible to extract stable, high‐frequency body waves using seismic tremors generated by freight trains. Such body waves allow us to focus on small velocity perturbations in the crust with high spatial resolution. We report on 10 years of seismic velocity temporal changes at the San Jacinto Fault. We observe and map a two‐month‐long episode of velocity changes with complex spatial distribution and interpret the velocity perturbation as produced by a previously undocumented slow‐slip event. We verify the hypothesis through numerical simulations and locate this event along a fault segment believed to be locked. Such a slow‐slip event stresses its surroundings and may trigger a major earthquake on a fault section approaching failure.

58 GEOSCIENCES↗

Accelerating phase-field-based microstructure evolution predictions via surrogate models trained by machine learning methods

Abstract The phase-field method is a powerful and versatile computational approach for modeling the evolution of microstructures and associated properties for a wide variety of physical, chemical, and biological systems. However, existing high-fidelity phase-field models are inherently computationally expensive, requiring high-performance computing resources and sophisticated numerical integration schemes to achieve a useful degree of accuracy. In this paper, we present a computationally inexpensive, accurate, data-driven surrogate model that directly learns the microstructural evolution of targeted systems by combining phase-field and history-dependent machine-learning techniques. We integrate a statistically representative, low-dimensional description of the microstructure, obtained directly from phase-field simulations, with either a time-series multivariate adaptive regression splines autoregressive algorithm or a long short-term memory neural network. The neural-network-trained surrogate model shows the best performance and accurately predicts the nonlinear microstructure evolution of a two-phase mixture during spinodal decomposition in seconds, without the need for “on-the-fly” solutions of the phase-field equations of motion. We also show that the predictions from our machine-learned surrogate model can be fed directly as an input into a classical high-fidelity phase-field model in order to accelerate the high-fidelity phase-field simulations by leaping in time. Such machine-learned phase-field framework opens a promising path forward to use accelerated phase-field simulations for discovering, understanding, and predicting processing–microstructure–performance relationships.

36 MATERIALS SCIENCE↗

Data for training and testing radiation detection algorithms in an urban environment

The detection, identification, and localization of illicit nuclear materials in urban environments is of utmost importance for national security. Most often, the process of performing these operations consists of a team of trained individuals equipped with radiation detection devices that have built-in algorithms to alert the user to the presence nuclear material and, if possible, to identify the type of nuclear material present. To encourage the development of new detection, radioisotope identification, and source localization algorithms, a dataset consisting of realistic Monte Carlo-simulated radiation detection data from a 2 in. × 4 in. × 16 in. NaI(Tl) scintillation detector moving through a simulated urban environment based on Knoxville, Tennessee, was developed and made public in the form of a Topcoder competition. The methodology used to create this dataset has been verified using experimental data collected at the Fort Indiantown Gap National Guard facility. Realistic signals from special nuclear material and industrial and medical sources are included in the data for developing and testing algorithms in a dynamic real-world background.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Training calibration-based counterfactual explainers for deep learning models in medical image analysis

The rapid adoption of artificial intelligence methods in healthcare is coupled with the critical need for techniques to rigorously introspect models and thereby ensure that they behave reliably. This has led to the design of explainable AI techniques that uncover the relationships between discernible data signatures and model predictions. In this context, counterfactual explanations that synthesize small, interpretable changes to a given query while producing desired changes in model predictions have become popular. This under-constrained, inverse problem is vulnerable to introducing irrelevant feature manipulations, particularly when the model’s predictions are not well-calibrated. Hence, in this paper, we propose the TraCE (training calibration-based explainers) technique, which utilizes a novel uncertainty-based interval calibration strategy for reliably synthesizing counterfactuals. Given the wide-spread adoption of machine-learned solutions in radiology, our study focuses on deep models used for identifying anomalies in chest X-ray images. Using rigorous empirical studies, we demonstrate the superiority of TraCE explanations over several state-of-the-art baseline approaches, in terms of several widely adopted evaluation metrics. Our findings show that TraCE can be used to obtain a holistic understanding of deep models by enabling progressive exploration of decision boundaries, to detect shortcuts, and to infer relationships between patient attributes and disease severity.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

JWST’s PEARLS: A z ≃ 6 quasar in a train-wreck galaxy merger system

We present JWST NIRSpec integral field spectroscopy observations of the z = 5.89 quasar NDWFS J1425+3254 from 0.6–5.3 μm, covering the rest-frame ultraviolet and optical at a spectral resolution of R ∼ 100. The quasar has a black hole mass of M BH = (1.4 +3.1 −1.0 ) × 10 9 M ⊙ and an Eddington ratio of L Bol /L Edd = 0.3 +0.6 −0.2 , as implied from the broad Balmer Hα and Hβ lines. The quasar host has significant ongoing obscured star formation, as well as a quasar-driven outflow with velocity 6050 +460 −630 km s −1 and ionised outflow rate of 1650 +130 −1230 M ⊙ yr −1 . This is possibly one of the most extreme outflows in the early Universe. The data also reveal that two companion galaxies are merging with the quasar host. The north-eastern companion galaxy is relatively old and very massive, with a luminosity-weighted stellar age of 65 +9 −4 Myr, stellar mass of (3.6 +0.6 −0.3 #x00D7; 10 11 M ⊙ , and star-formation rate (SFR) of ∼15–30 M ⊙ yr −1 . A bridge of gas connects this companion galaxy and the host, confirming their ongoing interaction. A second merger is occurring between the quasar host and a much younger companion galaxy to the south, with a stellar age of 6.7 ± 1.8 Myr, stellar mass of (1.9 ± 0.4)×10 10 M ⊙ , and SFR of ∼40–65 M ⊙ yr −1 . There is also another galaxy in the field, likely in the foreground at z = 1.135, which could be gravitationally lensing the quasar with a magnification of 1 < μ < 2 and, thus, < 0.75 mag. Overall, the system is a ‘train-wreck’ merger of three galaxies, with star formation and extreme quasar activity that were likely triggered by these ongoing interactions.

79 ASTRONOMY AND ASTROPHYSICS↗