Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “TRAINS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

3D Virtual Simulation for Radiation Safety and Survey Training

3D virtual technologies have been widely used in remote training. Training integrated with 3D visualization technologies can enhance students’ engagement and reduce cost. The Applied Visualization Lab collaborates with College of Eastern Idaho on creating a 3D desktop application that simulate a pipe environment for radiation safety and survey training. Students can learn to perform radiation and contamination surveys remotely on their desktop. This simulation provides random scenarios, guided instructions, user interactions, and visual and sound feedback. It will promote utilizing virtual training for education outreach and minimize radiation and contamination exposure during the training.

3D↗

A Subcritical Assembly for Training and Education Use at the Oak Ridge National Laboratory

A near-final design has been completed for a new subcritical assembly at Oak Ridge National Laboratory (ORNL). This subcritical assembly will support the Nuclear Criticality Safety Program (NCSP) training and education program to augment current subcritical assembly capabilities at Sandia National Laboratories (SNL) and at the National Criticality Experiments Research Center (NCERC). Other collaborations have been proposed with the Sunrise Consortium and others. This proposed subcritical assembly uses legacy AGN-201M research reactor fuel plates that are available from the Y-12 National Security Complex. This subcritical assembly contains approximately 620 grams of 235 U as UO 2 particulates distributed homogeneously in radiation-stabilized polyethylene. The fuel plates will have a graphite neutron reflector to obtain a core multiplication, M, from 10 to 50, corresponding to a k eff of 0.9 to 0.95, respectively. The subcritical assembly will be able to support at least four experiments for the training courses: (1) the addition of fissile material to increase neutron multiplication (mass), (2) a core separation experiment (interaction), (3) the effect of adding moderators to the core (moderation), and (4) the effect of adding neutron absorbers to the core (poison/absorption). The proposed ORNL subcritical assembly will provide additional student bandwidth to support NCSP training courses and to provide for some backup capacity if nuclear facility operations are disrupted at SNL or NCERC due to some unforeseen issue. The subcritical assembly will be designed to be an inherently safe subcritical assembly—subcritical under all normal and abnormal conditions—and it will provide the capability to conduct hands-on training to support NCSP and general nuclear criticality safety (NCS) staff training and qualification goals.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Offshore Wind Workforce Safety Standards and Training Resource

The standardization of safety training requirements for people working at sea to build and operate offshore wind energy projects, adoption of those standards, and alignment with offshore safety training curriculum development was identified as a high-priority workforce gap in the U.S. Offshore Wind Workforce Assessment (Stefek, 2022). Safety is a top priority for the offshore wind industry; however, there has been uncertainty surrounding what unique safety standards and training will be needed and how various offshore wind safety stakeholders will be involved. The scope of safety training for this resource includes workers who build and operate offshore wind energy projects at sea and defines the stakeholders in the complex ecosystem. This fact sheet aims to help reduce these uncertainties by: 1) Delineating jurisdictional lines, while clarifying roles and responsibilities amongst stakeholders; 2) Identifying key actions or partnerships that can encourage further success with safety training and workforce development.

offshore wind↗

Contributions of the SCK.CEN Academy to education and training in nuclear science and technology

Thanks to its thorough experience in the field of nuclear science and technology, its innovative research and the availability of large and unique nuclear installations, SCK.CEN is not only a renowned nuclear research institution, but also an important partner for nuclear education and training in Belgium as well as at international level. Within the SCK.CEN Academy, more than 60 years of nuclear expertise and experience gained from our different research projects is collected and transferred. In the interest of maintaining a competent workforce in industry, Healthcare, research, and policy, and of transferring nuclear knowledge and skills to the next generations, the SCK.CEN Academy takes it as its mission to: - provide guidance for students and early-stage researchers; - organize academic courses and customized training for professionals; - offer policy support with regard to education and training matters; - care for critical-intellectual capacities for society. Specifically in the domain of nuclear instrumentation the SCK.CEN Academy provides an opportunity to students at Bachelor, Master and PhD level to make use of the SCK.CEN infrastructure to support their thesis research or to perform an internship with the aim to improve and extend their knowledge and skills in a specific research or technical domain. Further, they can contribute to new findings in the field of nuclear instrumentation. The students are guided by our scientists, engineers and technicians who have years of experience in the relevant field. In addition, the SCK.CEN Academy contributes to traditional university education programs and delivers courses in several nuclear topics such as dosimetry. We also coordinate the Belgian Nuclear higher Engineering Network (BNEN), a one year (60 ECTS) master-after-master specialization in nuclear engineering in which 6 Belgian universities and SCK.CEN are involved. Beyond the contributions to academic education, we also provide several customized training programs tailored to the needs of the learners in terms of content, duration, level, language, location, etc. Complementary to the theoretical classes, ample attention is given to practical sessions and technical visits are foreseen which enable trainees to enrich and illustrate their acquired knowledge with the practice of real-life situations. In this poster presentation an overview will be given of the activities in the domains described above. Moreover it will be shown how these initiatives are embedded in the most recent European approaches to nuclear education and training via collaboration in several EU projects and networks. (authors)

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

3D Virtual Simulation for Radiation Safety and Survey Training

3D virtual technologies have been widely used in remote training. Training integrated with 3D visualization technologies can enhance students’ engagement and reduce cost. The Applied Visualization Lab collaborates with College of Eastern Idaho on creating a 3D desktop application that simulate a pipe environment for radiation safety and survey training. Students can learn to perform radiation and contamination surveys remotely on their desktop. This simulation provides random scenarios, guided instructions, user interactions, and visual and sound feedback. It will promote utilizing virtual training for education outreach and minimize radiation and contamination exposure during the training.

3D↗

Training Strategies to Mitigate Expectancy-Induced Response Bias in Combat Identification: A Research Agenda

Historical assessments of combat fratricide reveal principal contributing factors in the effects of stress, continuous operations or sleep deprivation, poor situational awareness, emotions, and lack of training. This paper discusses what and how improvements in combat identification (CID) may be achieved through training. In addition to skill-based training, CID training must focus on countering the negative effects of expectancy in the face of heightened anxiety and stressors of continuous operations that lead to combat errors or fratricide. The paper examines possible approaches to training for overcoming erroneous expectancies and emotional factors that may distort or limit accurate "blue force" identification.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Scalable balanced training of conditional generative adversarial neural networks on image data

Here, we propose a distributed approach to train deep convolutional generative adversarial neural network (DC-CGANs) models. Our method reduces the imbalance between generator and discriminator by partitioning the training data according to data labels, and enhances scalability by performing a parallel training where multiple generators are concurrently trained, each one of them focusing on a single data label. Performance is assessed in terms of inception score, Fréchet inception distance, and image quality on MNIST, CIFAR10, CIFAR100, and ImageNet1k datasets, showing a significant improvement in comparison to state-of-the-art techniques to training DC-CGANs. Weak scaling is attained on all the four datasets using up to 1000 processes and 2000 NVIDIA V100 GPUs on the OLCF supercomputer Summit.

97 MATHEMATICS AND COMPUTING↗

Machine Learning Potentials with the Iterative Boltzmann Inversion: Training to Experiment

Methodologies for training machine learning potentials (MLPs) with quantum-mechanical simulation data have recently seen tremendous progress. Experimental data have a very different character than simulated data, and most MLP training procedures cannot be easily adapted to incorporate both types of data into the training process. Here, we investigate a training procedure based on iterative Boltzmann inversion that produces a pair potential correction to an existing MLP using equilibrium radial distribution function data. By applying these corrections to an MLP for pure aluminum based on density functional theory, we observe that the resulting model largely addresses previous overstructuring in the melt phase. Interestingly, the corrected MLP also exhibits improved performance in predicting experimental diffusion constants, which are not included in the training procedure. The presented method does not require autodifferentiating through a molecular dynamics solver and does not make assumptions about the MLP architecture. Our results suggest a practical framework for incorporating experimental data into machine learning models to improve the accuracy of molecular dynamics simulations.

36 MATERIALS SCIENCE↗

Deep material network via a quilting strategy: visualization for explainability and recursive training for improved accuracy

Recent developments integrating micromechanics and neural networks offer promising paths for rapid predictions of the response of heterogeneous materials with similar accuracy as direct numerical simulations. The deep material network is one such approaches, featuring a multi-layer network and micromechanics building blocks trained on anisotropic linear elastic properties. Once trained, the network acts as a reduced-order model, which can extrapolate the material’s behavior to more general constitutive laws, including nonlinear behaviors, without the need to be retrained. However, current training methods initialize network parameters randomly, incurring inevitable training and calibration errors. Here, we introduce a way to visualize the network parameters as an analogous unit cell and use this visualization to “quilt” patches of shallower networks to initialize deeper networks for a recursive training strategy. The result is an improvement in the accuracy and calibration performance of the network and an intuitive visual representation of the network for better explainability.

97 MATHEMATICS AND COMPUTING↗

QUBO formulations for training machine learning models

Abstract Training machine learning models on classical computers is usually a time and compute intensive process. With Moore’s law nearing its inevitable end and an ever-increasing demand for large-scale data analysis using machine learning, we must leverage non-conventional computing paradigms like quantum computing to train machine learning models efficiently. Adiabatic quantum computers can approximately solve NP-hard problems, such as the quadratic unconstrained binary optimization (QUBO), faster than classical computers. Since many machine learning problems are also NP-hard, we believe adiabatic quantum computers might be instrumental in training machine learning models efficiently in the post Moore’s law era. In order to solve problems on adiabatic quantum computers, they must be formulated as QUBO problems, which is very challenging. In this paper, we formulate the training problems of three machine learning models—linear regression, support vector machine (SVM) and balanced k-means clustering—as QUBO problems, making them conducive to be trained on adiabatic quantum computers. We also analyze the computational complexities of our formulations and compare them to corresponding state-of-the-art classical approaches. We show that the time and space complexities of our formulations are better (in case of SVM and balanced k-means clustering) or equivalent (in case of linear regression) to their classical counterparts.

97 MATHEMATICS AND COMPUTING↗

Biologically-informed excitatory and inhibitory ratio for robust spiking neural network training

Spiking neural networks drawing inspiration from biological constraints of the brain promise an energy-efficient paradigm for artificial intelligence. However, challenges exist in identifying guiding principles to train these networks in a robust fashion. In addition, training becomes an even more difficult problem when incorporating biological constraints of excitatory and inhibitory connections. In this work, we identify several key factors, such as low initial firing rates and diverse inhibitory spiking patterns, that determine the overall ability to train in the context of spiking networks with various ratios of excitatory to inhibitory neurons. The results indicate networks with biologically-realistic excitatory:inhibitory ratios can reliably train at low activity levels and in noisy environments. Additionally, the Van Rossum distance, a measure of spike train synchrony, provides insight into the importance of inhibitory neurons to increase network robustness to noise. This work supports further biologically-informed large-scale networks and energy efficient hardware implementations.

bio-inspired computing↗

Pulse-train control of branching processes: Elimination of background and intruder state population

The authors introduce and describe pulse train control (PTC) of population branching in strongly coupled processes as a novel control tool for the separation of competing multiphoton processes. Control strategies are presented based on the different responses of processes with different photonicities and/or different frequency detunings to the pulse-to-pulse time delay and the pulse-to-pulse phase shift in pulse trains. The control efficiency is further enhanced by the property of pulse trains that complete population transfer can be obtained over an extended frequency range that replaces the resonance frequency of simple pulses. The possibility to freely tune the frequency assists the separation of the competing processes and reduces the number of subpulses required for full control. As a sample application, PTC of leaking multiphoton resonances is demonstrated by numerical simulations. In model systems exhibiting sizable background (intruder) state population if excited with single pulses, PTC leading to complete accumulation of population in the target state and elimination of background population is readily achieved. The analysis of the results reveals different mechanisms of control and provides clues on the mechanisms of the leaking process itself. In an alternative setup, pulse trains can be used as a phase-sensitive tool for level switching. By changing only the pulse-to-pulse phase shift of a train with otherwise unchanged parameters, population can be transferred to any of two different target states in a near-quantitative manner.

74 ATOMIC AND MOLECULAR PHYSICS↗

Accurate modeling of switched reluctance machine based on hybrid trained WNN

According to the strong nonlinear electromagnetic characteristics of switched reluctance machine (SRM), a novel accurate modeling method is proposed based on hybrid trained wavelet neural network (WNN) which combines improved genetic algorithm (GA) with gradient descent (GD) method to train the network. In the novel method, WNN is trained by GD method based on the initial weights obtained per improved GA optimization, and the global parallel searching capability of stochastic algorithm and local convergence speed of deterministic algorithm are combined to enhance the training accuracy, stability and speed. Based on the measured electromagnetic characteristics of a 3-phase 12/8-pole SRM, the nonlinear simulation model is built by hybrid trained WNN in Matlab. The phase current and mechanical characteristics from simulation under different working conditions meet well with those from experiments, which indicates the accuracy of the model for dynamic and static performance evaluation of SRM and verifies the effectiveness of the proposed modeling method.

97 MATHEMATICS AND COMPUTING↗

Training neural networks using Metropolis Monte Carlo and an adaptive variant

Abstract We examine the zero-temperature Metropolis Monte Carlo (MC) algorithm as a tool for training a neural network by minimizing a loss function. We find that, as expected on theoretical grounds and shown empirically by other authors, Metropolis MC can train a neural net with an accuracy comparable to that of gradient descent (GD), if not necessarily as quickly. The Metropolis algorithm does not fail automatically when the number of parameters of a neural network is large. It can fail when a neural network’s structure or neuron activations are strongly heterogenous, and we introduce an adaptive Monte Carlo algorithm (aMC) to overcome these limitations. The intrinsic stochasticity and numerical stability of the MC method allow aMC to train deep neural networks and recurrent neural networks in which the gradient is too small or too large to allow training by GD. MC methods offer a complement to gradient-based methods for training neural networks, allowing access to a distinct set of network architectures and principles.

97 MATHEMATICS AND COMPUTING↗

Coarse-to-Fine Multi-Task Training of Convolutional Neural Networks for Automated Information Extraction from Cancer Pathology Reports

Information extraction and coding of free-text pathology reports is an important activity for cancer registries to support national cancer surveillance. Cancer registrars must process high volumes of pathology reports on an annual basis. In this study, we investigated an automated approach using a coarse-to-fine training of convolutional neural networks (CNNs) for extracting the primary site, histological grade and laterality from unstructured cancer pathology text reports. Our proposed training scheme consists of two stages. In the first stage, the multi-task learning (MTL) with hard parameter sharing approach is used to train a multi-task MT-CNN model for all the tasks. Then, the TM-CNN parameters are used to initialize a CNN model for each task to be fine trained individually using its corresponding dataset. The performance of our proposed model was compared against a state-of-the-art CNN and the commonly used SVM classifier. We observed that the proposed model consistently outperformed the base line models, especially for the less prevalent classes. Specifically, the proposed training approach achieved a micro-F score of 0.7749 over 12 ICD- O-3 topography codes which is a significant improvement as compared with state-of-the-art CNN (0.7101) and the SVM (0.6019) classifiers. Also, the results demonstrate the potential of the proposed method for handling class imbalance within each task. It significantly improves macro-F score by 24% and 12% of the primary site and histology grade tasks, respectively.

Alawad, Mohammed↗

Training Spiking Neural Networks Using Combined Learning Approaches

Spiking neural networks (SNNs), the class of neural networks used in neuromorphic computing, are difficult to train using traditional back-propagation techniques. Spike timingdependent plasticity (STDP) is a biologically inspired learning mechanism that can be used to train SNNs. Evolutionary algorithms have also been demonstrated as a method for training SNNs. In this work, we explore the relationship between these two training methodologies. We evaluate STDP and evolutionary optimization as standalone methods for training networks, and also evaluate a combined approach where STDP weight updates are applied within an evolutionary algorithm. We also apply Bayesian hyperparameter optimization as a meta learner for each of the algorithms. We find that STDP by itself is not an ideal learning rule for randomly connected networks, while the inclusion of STDP within an evolutionary algorithm leads to similar performance, with a few interesting differences. This study suggests future work in understanding the relationship between network topology and learning rules.

Elbrecht, Daniel↗

Layer-Parallel Training of Deep Residual Neural Networks

Residual neural networks (ResNets) are a promising class of deep neural networks that have shown excellent performance for a number of learning tasks, e.g., image classification and recognition. Mathematically, ResNet architectures can be interpreted as forward Euler discretizations of a nonlinear initial value problem whose time-dependent control variables represent the weights of the neural network. Hence, training a ResNet can be cast as an optimal control problem of the associated dynamical system. For similar time-dependent optimal control problems arising in engineering applications, parallel-in-time methods have shown notable improvements in scalability. This paper demonstrates the use of those techniques for efficient and effective training of ResNets. The proposed algorithms replace the classical (sequential) forward and backward propagation through the network layers with a parallel nonlinear multigrid iteration applied to the layer domain. This adds a new dimension of parallelism across layers that is attractive when training very deep networks. From this basic idea, we derive multiple layer-parallel methods. The most efficient version employs a simultaneous optimization approach where updates to the network parameters are based on inexact gradient information in order to speed up the training process. Finally, using numerical examples from supervised classification, we demonstrate that the new approach achieves a training performance similar to that of traditional methods, but enables layer-parallelism and thus provides speedup over layer-serial methods through greater concurrency.

97 MATHEMATICS AND COMPUTING↗

3D-ReG: A 3D ReRAM-based Heterogeneous Architecture for Training Deep Neural Networks

Deep neural network (DNN) models are being expanded to a broader range of applications. The computational capability of traditional hardware platforms cannot accommodate the growth of model complexity. Among recent technologies to accelerate DNN, resistive memory (ReRAM)-based processing-in-memory (PIM) emerged as a promising solution for DNN inference due to its high efficiency for matrix-based computation. We face two major technical challenges in extending the use of ReRAM-based accelerators for training: (1) full-precision data is essential in back-propagation; (2) the need to support both feed-forward and back-propagation aggravates the data-movement burden. We propose a heterogeneous architecture named as 3D-ReG, which leverages full-precision GPU to ensure training accuracy and low-overhead 3D integration to provide low-cost data movements. Moreover, we introduce conservative and aggressive task-mapping schemes, which partition the computation phases in different ways to balance execution efficiency and training accuracy. We evaluate 3D-ReG implemented with two 3D integration technologies, through-silicon vias (TSVs) and monolithic inter-tier vias (MIVs), and compare them with GPU-only and PIM-only counterparts. Various GPU-only platforms using two main-memory technologies (DRAM, ReRAM) and three interconnect technologies (2D, TSV, MIV) are evaluated as well. Experimental results show that 3D-ReG can achieve on average 5.64× training speedup and 3.56× higher energy efficiency compared with the GPU with DRAM as main memory, at the cost of 0.05%–3.39% accuracy drop. We define a new metric, gain-loss ratio (GLR), which quantitatively evaluates the capability of a DNN training hardware in terms of the model accuracy and hardware efficiency. The results of our comparison show that the aggressive task-mapping scheme on MIV-based 3D-ReG outperforms the other methods.

Computer Science↗