Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,621 records · Page 90

Accelerating phase-field-based microstructure evolution predictions via surrogate models trained by machine learning methods

Abstract The phase-field method is a powerful and versatile computational approach for modeling the evolution of microstructures and associated properties for a wide variety of physical, chemical, and biological systems. However, existing high-fidelity phase-field models are inherently computationally expensive, requiring high-performance computing resources and sophisticated numerical integration schemes to achieve a useful degree of accuracy. In this paper, we present a computationally inexpensive, accurate, data-driven surrogate model that directly learns the microstructural evolution of targeted systems by combining phase-field and history-dependent machine-learning techniques. We integrate a statistically representative, low-dimensional description of the microstructure, obtained directly from phase-field simulations, with either a time-series multivariate adaptive regression splines autoregressive algorithm or a long short-term memory neural network. The neural-network-trained surrogate model shows the best performance and accurately predicts the nonlinear microstructure evolution of a two-phase mixture during spinodal decomposition in seconds, without the need for “on-the-fly” solutions of the phase-field equations of motion. We also show that the predictions from our machine-learned surrogate model can be fed directly as an input into a classical high-fidelity phase-field model in order to accelerate the high-fidelity phase-field simulations by leaping in time. Such machine-learned phase-field framework opens a promising path forward to use accelerated phase-field simulations for discovering, understanding, and predicting processing–microstructure–performance relationships.

36 MATERIALS SCIENCE↗

Data for training and testing radiation detection algorithms in an urban environment

The detection, identification, and localization of illicit nuclear materials in urban environments is of utmost importance for national security. Most often, the process of performing these operations consists of a team of trained individuals equipped with radiation detection devices that have built-in algorithms to alert the user to the presence nuclear material and, if possible, to identify the type of nuclear material present. To encourage the development of new detection, radioisotope identification, and source localization algorithms, a dataset consisting of realistic Monte Carlo-simulated radiation detection data from a 2 in. × 4 in. × 16 in. NaI(Tl) scintillation detector moving through a simulated urban environment based on Knoxville, Tennessee, was developed and made public in the form of a Topcoder competition. The methodology used to create this dataset has been verified using experimental data collected at the Fort Indiantown Gap National Guard facility. Realistic signals from special nuclear material and industrial and medical sources are included in the data for developing and testing algorithms in a dynamic real-world background.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Training calibration-based counterfactual explainers for deep learning models in medical image analysis

The rapid adoption of artificial intelligence methods in healthcare is coupled with the critical need for techniques to rigorously introspect models and thereby ensure that they behave reliably. This has led to the design of explainable AI techniques that uncover the relationships between discernible data signatures and model predictions. In this context, counterfactual explanations that synthesize small, interpretable changes to a given query while producing desired changes in model predictions have become popular. This under-constrained, inverse problem is vulnerable to introducing irrelevant feature manipulations, particularly when the model’s predictions are not well-calibrated. Hence, in this paper, we propose the TraCE (training calibration-based explainers) technique, which utilizes a novel uncertainty-based interval calibration strategy for reliably synthesizing counterfactuals. Given the wide-spread adoption of machine-learned solutions in radiology, our study focuses on deep models used for identifying anomalies in chest X-ray images. Using rigorous empirical studies, we demonstrate the superiority of TraCE explanations over several state-of-the-art baseline approaches, in terms of several widely adopted evaluation metrics. Our findings show that TraCE can be used to obtain a holistic understanding of deep models by enabling progressive exploration of decision boundaries, to detect shortcuts, and to infer relationships between patient attributes and disease severity.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

JWST’s PEARLS: A z ≃ 6 quasar in a train-wreck galaxy merger system

We present JWST NIRSpec integral field spectroscopy observations of the z = 5.89 quasar NDWFS J1425+3254 from 0.6–5.3 μm, covering the rest-frame ultraviolet and optical at a spectral resolution of R ∼ 100. The quasar has a black hole mass of M BH = (1.4 +3.1 −1.0 ) × 10 9 M ⊙ and an Eddington ratio of L Bol /L Edd = 0.3 +0.6 −0.2 , as implied from the broad Balmer Hα and Hβ lines. The quasar host has significant ongoing obscured star formation, as well as a quasar-driven outflow with velocity 6050 +460 −630 km s −1 and ionised outflow rate of 1650 +130 −1230 M ⊙ yr −1 . This is possibly one of the most extreme outflows in the early Universe. The data also reveal that two companion galaxies are merging with the quasar host. The north-eastern companion galaxy is relatively old and very massive, with a luminosity-weighted stellar age of 65 +9 −4 Myr, stellar mass of (3.6 +0.6 −0.3 #x00D7; 10 11 M ⊙ , and star-formation rate (SFR) of ∼15–30 M ⊙ yr −1 . A bridge of gas connects this companion galaxy and the host, confirming their ongoing interaction. A second merger is occurring between the quasar host and a much younger companion galaxy to the south, with a stellar age of 6.7 ± 1.8 Myr, stellar mass of (1.9 ± 0.4)×10 10 M ⊙ , and SFR of ∼40–65 M ⊙ yr −1 . There is also another galaxy in the field, likely in the foreground at z = 1.135, which could be gravitationally lensing the quasar with a magnification of 1 < μ < 2 and, thus, < 0.75 mag. Overall, the system is a ‘train-wreck’ merger of three galaxies, with star formation and extreme quasar activity that were likely triggered by these ongoing interactions.

79 ASTRONOMY AND ASTROPHYSICS↗

A domain wall-magnetic tunnel junction artificial synapse with notched geometry for accurate and efficient training of deep neural networks

Inspired by the parallelism and efficiency of the brain, several candidates for artificial synapse devices have been developed for neuromorphic computing, yet a nonlinear and asymmetric synaptic response curve precludes their use for backpropagation, the foundation of modern supervised learning. Spintronic devices—which benefit from high endurance, low power consumption, low latency, and CMOS compatibility—are a promising technology for memory, and domain-wall magnetic tunnel junction (DW-MTJ) devices have been shown to implement synaptic functions such as long-term potentiation and spike-timing dependent plasticity. In this work, we propose a notched DW-MTJ synapse as a candidate for supervised learning. Using micromagnetic simulations at room temperature, we show that notched synapses ensure the non-volatility of the synaptic weight and allow for highly linear, symmetric, and reproducible weight updates using either spin transfer torque (STT) or spin–orbit torque (SOT) mechanisms of DW propagation. We use lookup tables constructed from micromagnetics simulations to model the training of neural networks built with DW-MTJ synapses on both the MNIST and Fashion-MNIST image classification tasks. Accounting for thermal noise and realistic process variations, the DW-MTJ devices achieve classification accuracy close to ideal floating-point updates using both STT and SOT devices at room temperature and at 400 K. Our work establishes the basis for a magnetic artificial synapse that can eventually lead to hardware neural networks with fully spintronic matrix operations implementing machine learning.

42 ENGINEERING↗

Training self-learning circuits for power-efficient solutions

As the size and ubiquity of artificial intelligence and computational machine learning models grow, the energy required to train and use them is rapidly becoming economically and environmentally unsustainable. Recent laboratory prototypes of self-learning electronic circuits, such as “physical learning machines,” open the door to analog hardware that directly employs physics to learn desired functions from examples at a low energy cost. In this work, we show that this hardware platform allows for an even further reduction in energy consumption by using good initial conditions and a new learning algorithm. Using analytical calculations, simulations, and experiments, we show that a trade-off emerges when learning dynamics attempt to minimize both the error and the power consumption of the solution—greater power reductions can be achieved at the cost of decreasing solution accuracy. Finally, we demonstrate a practical procedure to weigh the relative importance of error and power minimization, improving the power efficiency given a specific tolerance to error.

Stern, Menachem (ORCID:0000000302158082)↗

Periodic training of creeping solids

Significance It is well appreciated that many disordered materials deform their shape irreversibly (plastically) under an external load (e.g., memory foam). Here, we show that this plasticity can be exploited to train materials to develop novel elastic responses by straining them periodically. By applying different periodic strains to a common viscoelastic material, we are able to design a number of different responses. These include a maximally negative Poisson’s ratio, bistable behavior, and nonlocal bond-specific responses. In contrast to computer-aided design, we rely on plasticity to self-organize the system in response to local stresses. This approach shows promise to achieve an unprecedented control over behavior at large strains well beyond the linear-response regime.

36 MATERIALS SCIENCE↗

Learning to learn by using nonequilibrium training protocols for adaptable materials

Evolution in time-varying environments naturally leads to adaptable biological systems that can easily switch functionalities. Advances in the synthesis of environmentally responsive materials therefore open up the possibility of creating a wide range of synthetic materials which can also be trained for adaptability. We consider high-dimensional inverse problems for materials where any particular functionality can be realized by numerous equivalent choices of design parameters. By periodically switching targets in a given design algorithm, we can teach a material to perform incompatible functionalities with minimal changes in design parameters. We exhibit this learning strategy for adaptability in two simulated settings: elastic networks that are designed to switch deformation modes with minimal bond changes and heteropolymers whose folding pathway selections are controlled by a minimal set of monomer affinities. The resulting designs can reveal physical principles, such as nucleation-controlled folding, that enable such adaptability.

Science & Technology - Other Topics↗

Statistical mentoring at early training and career stages

At Los Alamos National Laboratory (LANL), statistical scientists develop solutions for a variety of national security challenges through scientific excellence, typically as members of interdisciplinary teams. At LANL, mentoring is actively encouraged and practiced to develop statistical skills and positive career-building behaviors. Mentoring activities targeted at different career phases from student to junior staff are an important catalyst for both short and long term career development. This article discusses mentoring strategies for undergraduate and graduate students through internships as well as for postdoctoral research associates and junior staff. Topics addressed include project selection, progress, and outcome; intellectual and social activities that complement the student internship experience; key skills/knowledge not typically obtained in academic training; and the impact of such internships on students’ careers. Experiences and strategies from a number of successful mentorships are presented. Feedback from former mentees obtained via a questionnaire is incorporated. As a result, these responses address some of the benefits the respondents received from mentoring, helpful contributions and advice from their mentors, key skills learned, and how mentoring impacted their later careers.

97 MATHEMATICS AND COMPUTING↗

Trains of electron micro-bunches in plasma wake-field acceleration

Plasma-based charged particle accelerators have been intensively investigated in the past three decades due to their capability to open up new horizons in accelerator science and particle physics yielding electric field accelerating gradient more than three orders of magnitudes higher than in conventional devices. At the current stage the most advanced and reliable mechanism for accelerating electrons is based on the propagation of an intense laser pulse or a relativistic electron beam in a low density gaseous target. In this paper we concentrate on the electron beam-driven plasma wake-field acceleration and demonstrate using 3D PiC simulations that a train of electron micro-bunches with ~10 fs period can be generated behind the driving beam propagating in a density down-ramp. We will discuss the conditions and properties of the micro-bunches generated aiming at understanding and study of multi-bunch mechanism of injection. It is show that the periodicity and duration of micro-bunches can be controlled by adjusting the plasma density gradient and driving beam charge.

Physics↗

Training models using forces computed by stochastic electronic structure methods

Abstract Quantum Monte Carlo (QMC) can play a very important role in generating accurate data needed for constructing potential energy surfaces. We argue that QMC has advantages in terms of a smaller systematic bias and an ability to cover phase space more completely. The stochastic noise can ease the training of the machine learning model. We discuss how stochastic errors affect the generation of effective models by analyzing the errors within a linear least squares procedure, finding that there is an advantage to having many relatively imprecise data points for constructing models. We then analyze the effect of noise on a model of many-body silicon finding that noise in some situations improves the resulting model. We then study the effect of QMC noise on two machine learning models of dense hydrogen used in a recent study of its phase diagram. The noise enables us to estimate the errors in the model. We conclude with a discussion of future research problems.

Ceperley, David M. (ORCID:0000000150826271)↗

Evaluation of the Radioactive Material Released in the Harborview Research and Training Building and Some Implications for Emergency Response

On 2 May 2019, during the 137 Cs source recovery operation, a source capsule in a research irradiator containing approximately 77.1 TBq was breached. Based on a geometric reconstruction analysis of the damage to the capsule, approximately 46.3 GBq (0.04%) was impacted by the chop saw (grinder) inside a mobile hot cell on the loading dock at the University of Washington Harborview Research and Training (HRT) Building. A very small fraction of the material impacted, less than 1%, was released from the mobile hot cell and then to the rest of the HRT Building. The objectives of this project were to assess the accidental release of 137 CsCl and its implications related to emergency response methods and the ramifications of 137 CsCl transport. The phenomenology of this event was also compared with past alkali halide dispersal events. The vast number of measurements and samples collected by the remediation contractors, the Department of Energy’s Nuclear Emergency Support Team, and the small number of retrospective samples collected by the authors informed the analysis. The techniques included (1) autoradiography and electron microscopy of samples collected from the HRT Building and the irradiator, (2) 3D visualization of deposition on surfaces and within the ventilation system, and (3) a study of the damage to the source capsule to evaluate the Cs particle size and particle composition due to the grinding accident. Subsequently, the cesium contaminant transport through the numerous pathways in the building was reconstructed to assess the deposition on surfaces as a function of particle size. Furthermore, the implications for emergency response are relevant to data quality and management. A Data Quality Objective guides data collection methods so that they have appropriate accuracy and precision for the intended application. Recommendations were made with respect to the sample collection protocols and archiving of samples.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

Differential-phase-shift quantum key distribution with segmented pulse trains

We present a modified scheme of differential-phase-shift (DPS) quantum key distribution (QKD) for improving its performance. A transmitter sends a weak coherent pulse train segmented with vacant pulses. Then, a receiver can find eavesdropping by monitoring the photon detection rate at particular time slots. Simulations show that the proposed scheme is robust against a sequential attack and a general individual attack.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Quantum control of electron wave packets in bound molecules by trains of half-cycle pulses

We investigate protocols for transient localization of electrons in homodiatomic molecules, as well as permanent localization via population inversion in polar molecules. By examining three different model systems with one electronic and one nuclear degree of freedom, we identify mechanisms leading to control over the localization of the electronic wave packets. We show that electronic states dressed by the quasi-dc component of the train of half-cycle pulses steer the combined electronic and nuclear motion toward the targeted state.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Optimizing temperature distributions for training neural quantum states using parallel tempering

Parametrized artificial neural networks (ANNs) can be very expressive ansatzes for variational algorithms, reaching state-of-the-art energies on many quantum many-body Hamiltonians. Nevertheless, the training of the ANN can be slow and stymied by the presence of local minima in the parameter landscape. One approach to mitigate this issue is to use parallel tempering methods, and in this work, we focus on the role played by the temperature distribution of the parallel tempering replicas. Using an adaptive method that adjusts the temperatures in order to equate the exchange probability between neighboring replicas, we show that this temperature optimization can significantly increase the success rate of the variational algorithm with negligible computational cost by eliminating bottlenecks in the replicas' random walk. Furthermore, we demonstrate this using two different neural networks, a restricted Boltzmann machine and a feedforward network, which we use to study a toy problem based on a permutation invariant Hamiltonian with a pernicious local minimum and the 𝐽 1 −𝐽 2 model on a rectangular lattice.

Neural network simulations↗

Generation of Dark-Bright Soliton Trains in Superfluid-Superfluid Counterflow

The dynamics of two penetrating superfluids exhibit an intriguing variety of nonlinear effects. Using two distinguishable components of a Bose-Einstein condensate, we investigate the counterflow of two superfluids in a narrow channel. We present the first experimental observation of trains of dark-bright solitons generated by the counterflow. Our observations are theoretically interpreted by three-dimensional numerical simulations for the coupled Gross-Pitaevskii equations and the analysis of a jump in the two relatively flowing components' densities. Counterflow-induced modulational instability for this miscible system is identified as the central process in the dynamics.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗