Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “train”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Development of the Suited Injury Modes and Effects Analysis for Identification of Top Injury Risks in Lunar Missions and Training

A new Exploration Extravehicular Activity Suit (xEVAS) is being designed to replace the current Extravehicular Mobility Unit (EMU) for the National Aeronautics and Space Administration’s (NASA’s) Artemis program to return astronauts to the lunar surface. This new suit will allow for increased range of motion compared the current EMU and Apollo era suits and will have additional features that will enhance the health and safety of exploration. With the design of lunar missions and the xEVAS progressing, it is important to consider possible injuries and injury mechanisms that could occur in the suit. To address these concerns, the suited Injury Modes and Effects Analysis (IMEA) was developed to outline suited injury scenarios and rank them based on risk score. The IMEA documents possible scenarios and underlying mechanisms of injury while wearing an extravehicular activity (EVA) suit. Tasks during lunar surface EVA as well as training events to prepare for lunar missions were considered as history has shown that more suit injuries occur during training than in flight. Each scenario is ranked with a consequence and likelihood scoring based on our current understanding of the suit and Artemis design reference missions to identify high-risk cases that will drive further work in suited injury. Injuries, mechanisms of injury, and mitigation strategies are evaluated within each scenario. The Suited Injury Summit was held on January 5, 2022, to vet the IMEA with external experts. This was an all-day virtual meeting with the suited injury team, ergonomists, suit engineers, safety engineers, the flight operations directorate, flight doctors, astronauts, astronaut strength, conditioning, and rehabilitation specialists (ASCRS), and external subject matter experts (SMEs). External SMEs consisted of surgeons with varying specialties. The intent of this meeting was to walk through the top injury risks identified in the analysis, identify any gaps that were not captured, and discuss mitigations. With participation from all groups, countless lessons-learned came from the Summit meeting. Using the lessons-learned and discussion from the Summit, the top 10 risks have been identified: neutral buoyancy laboratory training, hand/glove injuries, poor suit fit, field training, specific EVA tasks/design of task, boots/ankle injuries, falls from heights, background radiation, repetitive contact, and ambulation/long-distance ambulation. Mitigation steps have also been determined for each of the top risks. The IMEA and documentation of top risks is a living document. Yearly meetings are planned to update the analysis and reevaluate top risks and mitigations. The IMEA is being used to drive work in suited injury, and this work will continue to evolve with IMEA and lunar mission updates.

Tessa Reiber↗
NASA NTRSDate not supplied

Artificial Neural Network (ANN) Surface Longwave and Shortwave Fluxes Trained on CERES Observations

The Clouds and Earth’s Radiant Energy System (CERES) project provides satellite-based observations of the radiative fluxes and clouds systems. CERES climate quality data products typically take several months of calibration and validation before release to the public. The Fast Longwave and Shortwave Radiative Flux (FLASHFlux) data product was developed to provide key data for the applied sciences and educational users within a week of observation. FLASHFlux achieves this by using simplified calibration, an operational meteorological product from Global Modeling and Assimilation Office (GMAO), and its own surface parameterizations model. The CERES FLASHFlux provides two data products: 1) an hourly Level 2 Single Scanner Footprint (SSF) data separately for Terra and NOAA-20 observations, and 2) a daily Level 3 Time Interpolated and Spatially Averaged (TISA) 1o x 1o gridded data that combines Terra and NOAA-20 observations. Currently, FLASHFlux uses the Langley Parameterized Shortwave Algorithm (LPSA) and Langley Parameterized Longwave Algorithm (LPLA) to derive its surface fluxes (Kratz et al., 2010; Gupta et al, 2001). A new Machine Learning (ML) based approach using Artificial Neural Networks to derive Surface Longwave (LW) & Shortwave (SW) fluxes based on training data from the CERES Clouds Radiative Swath (CRS) product is being investigated to replace LPSA and LPLA in the SSF surface flux products. One of the biggest hurdles in training ML model is model fitting. To overcome the problem of overfitting we use feature engineering that helps in finding the important feature and remove features that are irrelevant to the model. In our training we employed the Leave-One-Feature-Out Importance (LOFO) to evaluate the significance of each feature in our training. We intercompare ANN fluxes against surface fluxes produced from the Fu-Liou model in CRS and the LPSA/LPLA in FLASHFlux SSF. Furthermore, we validated ANN derived fluxes to the Baseline Surface Radiation Network (BSRN).

P C Sawaengphokhai↗
DOE OSTI2017

Industrial Energy Training and Certification

Compressed air systems, ammonia refrigeration systems, chilled water systems, steam systems, process heating systems, combined heat and power systems, pump systems and fan systems are major industrial energy systems commonly found in manufacturing facilities. Efficiency of these systems contributes significantly to whole facilities' energy performance. On the national, even international level, well-structured training and highly recognized certification programs help develop a highly-skilled and qualified workforce to maintain and improve facilities' energy performance, particularly as technologies within these systems become more advanced. The purpose of this paper is to review currently available training and certification programs focusing on these systems and to identify the gap between market's needs and currently available programs. Three major conclusions are: first, most training programs focus on operations, maintenance, safety and design although some briefly touch the energy performance aspect; second, except CRES by RETA and PSA Certificate and PSAP Master Certification by HI, no other certifications had been found emphasizing on knowledge and skills for improving and maintaining these systems' energy performance; third, developing energy efficiency focused training and ANSI accredited certification programs on these energy systems will fill the gap between market's needs and currently available programs.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2017

Industrial Energy Training and Certification

We present compressed air systems, ammonia refrigeration systems, chilled water systems, steam systems, process heating systems, combined heat and power systems, pump systems and fan systems are major industrial energy systems commonly found in manufacturing facilities. Efficiency of these systems contributes significantly to whole facilities' energy performance. On the national, even international level, well-structured training and highly recognized certification programs help develop a highly-skilled and qualified workforce to maintain and improve facilities' energy performance, particularly as technologies within these systems become more advanced. The purpose of this paper is to review currently available training and certification programs focusing on these systems and to identify the gap between market's needs and currently available programs. Three major conclusions are: first, most training programs focus on operations, maintenance, safety and design although some briefly touch the energy performance aspect; second, except CRES by RETA and PSA Certificate and PSAP Master Certification by HI, no other certifications had been found emphasizing on knowledge and skills for improving and maintaining these systems' energy performance; third, developing energy efficiency focused training and ANSI accredited certification programs on these energy systems will fill the gap between market's needs and currently available programs.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2019

US DOE In-Plant Trainings to Develop Expertise and Replicate Success

In-Plant Trainings (INPLTs) offered by the US Department of Energy Better Buildings, Better Plants (Better Plants) program are multi-day workshops performed by industry-recognized experts. INPLTs include both classroom- and field-based sessions that train attendees to identify energy conservation opportunities, quantify savings from these opportunities, and implement projects to realize the savings. These training workshops enhance the attendees’ understanding of working principles, knowledge of best practices, and capability to analyze the energy performance of industrial energy systems. INPLTs are competitively awarded and focus on a wide range of topics, including traditional industrial systems such as steam, process heating and motor-driven systems, and processes such as energy treasure hunts and municipal water and wastewater treatment. Partners that are awarded INPLTs can invite external stakeholders, such as employees of other manufacturers, utility representatives, and vendors. The Better Plants program had delivered 123 INPLTs as of spring 2019, trained more than 2,000 participants, and identified more than $37 million in energy cost savings. This paper provides an overview of INPLTs, some key statistics, the top identified energy savings opportunities, and success stories from INPLTs delivered from 2011 to 2018. Finally, the vision for future INPLTs is discussed based on participants’ feedback and the long-term and strategic goals of the Better Plants program.

Guo, Wei↗
DOE OSTI2022

Accelerating Collective Communication in Data Parallel Training across Deep Learning Frameworks

This work develops new techniques within Horovod, a generic communication library supporting data parallel training across deep learning frameworks. In particular, we improve the Horovod control plane by implementing a new coordination scheme that takes advantage of the characteristics of the typical data parallel training paradigm, namely the repeated execution of collectives on the gradients of a fixed set of tensors. Using a caching strategy, we execute Horovod’s existing coordinator-worker logic only once during a typical training run, replacing it with a more efficient decentralized orchestration strategy using the cached data and a global intersection of a bitvector for the remaining training duration. Next, we introduce a feature for end users to explicitly group collective operations, enabling finer grained control over the communication buffer sizes. To evaluate our proposed strategies, we conduct experiments on a world-class supercomputer — Summit. We compare our proposals to Horovod’s original design and observe 2x performance improvement at a scale of 6000 GPUs; we also compare them against tf.distribute and torch.DDP and achieve 12% better and comparable performance, respectively, using up to 1536 GPUs; we compare our solution against BytePS in typical HPC settings and achieve about 20% better performance on a scale of 768 GPUs. Finally, we test our strategies on a scientific application (STEMDL) using up to 27,600 GPUs (the entire Summit) and show that we achieve a near-linear scaling of 0.93 with a sustained performance of 1.54 exaflops (with standard error +- 0.02) in FP16 precision.

Romero, Joshua↗
DOE OSTI2021

Stable Parallel Training of Wasserstein Conditional Generative Adversarial Neural Networks : *Full/Regular Research Paper submission for the symposium CSCI-ISAI: Artificial Intelligence

We use a stable parallel approach to train Wasserstein Conditional Generative Adversarial Neural Networks (W-CGANs). The parallel training reduces the risk of mode collapse and enhances scalability by using multiple generators that are concurrently trained, each one of them focusing on a single data label. The use of the Wasserstein metric reduces the risk of cycling by stabilizing the training of each generator. We apply the approach on the CIFAR10 and the CIFAR100 datasets, two standard benchmark datasets with images of the same resolution, but different number of classes. Performance is assessed using the inception score, the Fréchet inception distance, and image quality. An improvement in inception score and Fréchet inception distance is shown in comparison to previous results obtained by performing the parallel approach on deep convolutional conditional generative adversarial neural networks (DC-CGANs). Weak scaling is attained on both datasets using up to 100 NVIDIA V100 GPUs on the OLCF supercomputer Summit.

Lupo Pasini, Massimiliano↗
DOE OSTI2024

Geometry-aware training of factorized layers in tensor Tucker format

Reducing parameter redundancies in neural network architectures is crucial for achieving feasible computational and memory requirements during train and inference of large networks. Given its easy implementation and flexibility, one promising approach is layer factorization, which reshapes weight tensors into a matrix format and parameterizes it as the product of two rank-r matrices. However, this family of approaches often requires an initial full-model warm-up phase, prior knowledge of a feasible rank, and it is sensitive to parameter initialization.In this work, we introduce a novel approach to train the factors of a Tucker decomposition of the weight tensors. Our training proposal proves to be optimal in locally approximating the original unfactorized dynamics and stable for the initialization. Furthermore, the rank of each mode is dynamically updated during training.We provide a theoretical analysis of the algorithm, showing convergence, approximation and local descent guarantees. The method's performance is further illustrated through a variety of experiments, showing remarkable training compression rates and comparable or even better performance than the full baseline and alternative layer factorization strategies.

Zangrando, Emanuele [Gran Sasso Science Institute ↗
DOE OSTI2020

Developing Subgrantee Administrative Training for the Weatherization Assistance Program

During Fiscal Years (FY) 2019 and 2020, the National Renewable Energy Laboratory (NREL) developed a series of online trainings for the U.S. Department of Energy (DOE) Weatherization Assistance Program (WAP) to support Subgrantee administrative professionals. NREL and its subcontractor developed a series of online administrative trainings for WAP Subgrantees. In total, 29 administrative training courses were developed for WAP Subgrantees, focused on the following job roles: Weatherization Director, Fiscal Manage, Quality Assurance Manager. As of September 8, 2020, 2,840 users in nearly all WAP Grantee jurisdictions had registered with the learning management system and completed over 23,000 courses. This report provides a summary of the development process, rollout, and outreach to the WAP network, user response, and lessons learned.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Multilevel-in-width training for deep neural network regression

A common challenge in regression is that for many problems, the degrees of freedom required for a high-quality solution also allows for overfitting. Regularization is a class of strategies that seek to restrict the range of possible solutions so as to discourage overfitting while still enabling good solutions, and different regularization strategies impose different types of restrictions. In this paper, we present a multilevel regularization strategy that constructs and trains a hierarchy of neural networks, each of which has layers that are wider versions of the previous network's layers. Here, we draw intuition and techniques from the field of Algebraic Multigrid (AMG), traditionally used for solving linear and nonlinear systems of equations, and specifically adapt the Full Approximation Scheme (FAS) for nonlinear systems of equations to the problem of deep learning. Training through V-cycles then encourage the neural networks to build a hierarchical understanding of the problem. We refer to this approach as multilevel-in-width to distinguish from prior multilevel works which hierarchically alter the depth of neural networks. The resulting approach is a highly flexible framework that can be applied to a variety of layer types, which we demonstrate with both fully connected and convolutional layers. We experimentally show with PDE regression problems that our multilevel training approach is an effective regularizer, improving the generalize performance of the neural networks studied.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

A continuous analogue of the tensor-train decomposition

We develop new approximation algorithms and data structures for representing and computing with multivariate functions using the functional tensor-train (FT), a continuous extension of the tensor-train (TT) decomposition. The FT represents functions using a tensor-train ansatz by replacing the three-dimensional TT cores with univariate matrix-valued functions. The main contribution of this paper is a framework to compute the FT that employs adaptive approximations of univariate fibers, and that is not connected to any tensorized discretization. The algorithm can be coupled with any univariate linear or nonlinear approximation procedure. We demonstrate that this approach can generate multivariate function approximations that are several orders of magnitude more accurate, for the same cost, than those based on the conventional approach of compressing the coefficient tensor of a tensor-product basis. Our approach is in the spirit of other continuous computation packages such as Chebfun, and yields an algorithm which requires the computation of “continuous” matrix factorizations such as the LU and QR decompositions of vector-valued functions. To support these developments, we describe continuous versions of an approximate maximum-volume cross approximation algorithm and of a rounding algorithm that re-approximates an FT by one of lower ranks. We demonstrate that our technique improves accuracy and robustness, compared to TT and quantics-TT approaches with fixed parameterizations, of high-dimensional integration, differentiation, and approximation of functions with local features such as discontinuities and other nonlinearities.

42 ENGINEERING↗
DOE OSTI2025

The tensor-train stochastic finite volume method for uncertainty quantification

The stochastic finite volume method offers an efficient one-pass approach for assessing uncertainty in hyperbolic conservation laws. Still, it struggles with the curse of dimensionality when dealing with multiple stochastic variables. Here, we introduce the stochastic finite volume method within the tensor-train framework to counteract this limitation. This integration, however, comes with its own set of difficulties, mainly due to the propensity for shock formation in hyperbolic systems. To overcome these issues, we have developed a tensor-train-adapted stochastic finite volume method that employs a global WENO reconstruction, making it suitable for such complex systems. This approach represents the first step in designing tensor-train techniques for hyperbolic systems and conservation laws involving shocks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Fast neural network training on a cluster of GPUs for action recognition with high accuracy

In this work, we propose algorithms and techniques to accelerate training of deep neural networks for action recognition on a cluster of GPUs. The convergence analysis of our algorithm shows it is possible to reduce communication cost and at the same time minimize the number of iterations needed for convergence. We customize the Adam optimizer for our distributed algorithm to improve efficiency. In addition, we employ transfer-learning to further reduce training time while improving validation accuracy. For the UCF101 and HMDB51 datasets, the validation accuracies achieved are 93.1% and 67.9% respectively. With an additional end-to-end trained temporal stream, the validation accuracies achieved for UCF101 and HMDB51 are 93.47% and 81.24% respectively. As far as we know, these are the highest accuracies achieved with the two-stream approach using ResNet that does not involve computationally expensive 3D convolutions or pretraining on much larger datasets.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Longitudinal train dynamics model for a rail transit simulation system

The paper develops a longitudinal train dynamics model in support of microscopic railway transportation simulation. The model can be calibrated without any mechanical data making it ideal for implementation in transportation simulators. The calibration and validation work is based on data collected from the Portland light rail train fleet. The calibration procedure is mathematically formulated as a constrained non-linear optimization problem. The validity of the model is assessed by comparing instantaneous model predictions against field observations, and also evaluated in the domains of acceleration/deceleration versus speed and acceleration/deceleration versus distance. A test is conducted to investigate the adequacy of the model in simulation implementation. The results demonstrate that the proposed model can adequately capture instantaneous train dynamics, and provides good performance in the simulation test. Thus, the model provides a simple theoretical foundation for microscopic simulators and will significantly support the planning, management and control of railway transportation systems.

42 ENGINEERING↗
DOE OSTI2024

MedNAS: Multiscale Training-Free Neural Architecture Search for Medical Image Analysis

Deep neural networks have demonstrated impressive results in medical image analysis, but designing suitable architectures for each specific task is expertise dependent and time consuming. Neural architecture search (NAS) offers an effective means of discovering architectures. It has been highly successful in numerous applications, particularly in natural image classification. Yet, medical images possess unique characteristics, such as small regions and a wide variety of lesion sizes, that differentiate them from natural images. Furthermore, most current NAS methods struggle with high computational costs, especially when dealing with high-resolution image datasets. In this article, we present a novel evolutionary NAS method called multiscale training-free neural architecture search (MSTF-NAS) to address these challenges. Specifically, to accommodate the broad range of lesion region sizes in disease diagnosis, we develop a new reduction cell search space that enables the search algorithm to explicitly identify the optimal scale combination for multiscale feature extraction. Further, to overcome the issue of high computational costs, we utilize training-free indicators as performance measures for candidate architectures, which allows us to search for the optimal architecture more efficiently. More specifically, by considering the capability and simplicity of various networks, we formulate a multiobjective optimization problem that involves two training-free indicators and model complexity for candidate architectures. Extensive experiments on a large medical image benchmark and a publicly available breast cancer detection dataset are conducted. The empirical results demonstrate that our MSTF-NAS outperforms both human-designed architectures and current state-of-the-art NAS algorithms on both datasets, indicating the effectiveness of our proposed method.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2018

The MidAmerica Regional Microgrid Education and Training (MARMET) Consortium

The primary goal of this project was to integrate cutting-edge research and advanced instructional methods to create a flexible, evolving approach to microgrid and distributed energy resources training for all levels of student. This goal entailed the rapid development of modular material to capture and reflect the newest trends in electric power microgrid engineering and to make it available in traditional and non-traditional settings. It was our goal to develop course material that can be readily integrated into either existing courses or organized into new courses. The target audiences include technicians, contractors and consultants, inspectors, policy makers, supervisors, and engineers and undergraduate and graduate students. The main project objectives were to: 1) Perform a gap analysis to identify the research/educational/training needs and define specific implementation plans for these activities in distributed technology and Smart Grid power engineering by working with Department of Energy, the National Network Administrator (NNA) and other Distributed Technology Training Consortia (DTTC). 2) Develop learning content related to, and driven by, microgrid research, consisting of one or more multimedia-based modules. Over the life of the project MARMET provided training to 11,012 students and developed 154,432 contact hours of material (see the IREC NNA, DE-EE0006342, final project report for added details on MARMET evaluation and assessment metrics, as well as an overview of the entire GEARED network. 3) Provide a variety of delivery mechanisms and venues for face-to-face and on-line instruction in power system engineering and related smart grid operations, including university-based courses, short courses, and workshops. 4) Assemble and engage highly-qualified advisory and steering committees of experts from utilities, universities, national laboratories, and product suppliers for this DTTC, to guide and advise the activities of the DTTC, and to assist in creating student internships, coops, research projects and academic competitions for GEARED students within the DTTC and nationally. 5) Convene regular meetings of Consortia partners to disseminate research results among the participants (universities, utilities, and industry). 6) Develop recruitment mechanisms to publicize GEARED student opportunities and highlight the educational benefits of GEARED participation to assure long-term sustainability of student recruitment and retention. 7) Participate in GEARED National Network activities to identify and adopt best practices across all GEARED consortia. 8) Organize, host and manage at least one annual Student-Centered Research Conference on behalf of the GEARED Network during the period of performance; participate in each annual national Student-Centered Research Conference.

14 SOLAR ENERGY↗
DOE OSTI2020

Tribal Renewable Energy: Bishop Paiute Tribe Youth Solar Job Training Development (Final Report)

This Project provided workshops and hands on opportunities for young tribal adults to gain education,training,and employment in the solar industry; including 1 youth to meet the eligibility requirements for the NABCEP Solar Installer Exam. 10 tribal youth, ages 16-24, attended workshops focused on learning solar fundamentals and then applied those learned skills to hands on training, installing solar on 2 tribal homes. GRID provided certificates authenticating their volunteer hours and skills learned. This program of youth training really excited the tribal leadership as well as the tribal youth. This opportunity was in alignment with the tribe’s Strategic Energy Plan, and supported tribal self-sufficiency, a path to economic development and for the youth it also represented the environmental stewardship the tribe believes in.

14 SOLAR ENERGY↗
DOE OSTI2022

NCSP Training and Education Program [Slides]

The mission of the Nuclear Criticality Safety Program is to provide sustainable expert leadership, direction and the technical infrastructure necessary to develop, maintain, and disseminate the essential technical tools, training, and data required to support safe, efficient fissionable material operations within DOE; the vision of the program is a Continually improving, adaptable, and transparent program that communicates and collaborates globally to incorporate technology, practices, and programs to be responsive to the essential technical needs of those responsible for developing, implementing, and maintaining nuclear criticality safety. Training and education topics for the program include a 1-week Manager/Criticality Safety Officer Course and a 2-week NCS Engineer Hands-on Training Course.

42 ENGINEERING↗