SEARCH · Engineering Papers

Results for “Trains”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Stable Parallel Training of Wasserstein Conditional Generative Adversarial Neural Networks : *Full/Regular Research Paper submission for the symposium CSCI-ISAI: Artificial Intelligence

We use a stable parallel approach to train Wasserstein Conditional Generative Adversarial Neural Networks (W-CGANs). The parallel training reduces the risk of mode collapse and enhances scalability by using multiple generators that are concurrently trained, each one of them focusing on a single data label. The use of the Wasserstein metric reduces the risk of cycling by stabilizing the training of each generator. We apply the approach on the CIFAR10 and the CIFAR100 datasets, two standard benchmark datasets with images of the same resolution, but different number of classes. Performance is assessed using the inception score, the Fréchet inception distance, and image quality. An improvement in inception score and Fréchet inception distance is shown in comparison to previous results obtained by performing the parallel approach on deep convolutional conditional generative adversarial neural networks (DC-CGANs). Weak scaling is attained on both datasets using up to 100 NVIDIA V100 GPUs on the OLCF supercomputer Summit.

Lupo Pasini, Massimiliano↗

DOE OSTI2024

Geometry-aware training of factorized layers in tensor Tucker format

Reducing parameter redundancies in neural network architectures is crucial for achieving feasible computational and memory requirements during train and inference of large networks. Given its easy implementation and flexibility, one promising approach is layer factorization, which reshapes weight tensors into a matrix format and parameterizes it as the product of two rank-r matrices. However, this family of approaches often requires an initial full-model warm-up phase, prior knowledge of a feasible rank, and it is sensitive to parameter initialization.In this work, we introduce a novel approach to train the factors of a Tucker decomposition of the weight tensors. Our training proposal proves to be optimal in locally approximating the original unfactorized dynamics and stable for the initialization. Furthermore, the rank of each mode is dynamically updated during training.We provide a theoretical analysis of the algorithm, showing convergence, approximation and local descent guarantees. The method's performance is further illustrated through a variety of experiments, showing remarkable training compression rates and comparable or even better performance than the full baseline and alternative layer factorization strategies.

Zangrando, Emanuele [Gran Sasso Science Institute ↗

DOE OSTI2020

Developing Subgrantee Administrative Training for the Weatherization Assistance Program

During Fiscal Years (FY) 2019 and 2020, the National Renewable Energy Laboratory (NREL) developed a series of online trainings for the U.S. Department of Energy (DOE) Weatherization Assistance Program (WAP) to support Subgrantee administrative professionals. NREL and its subcontractor developed a series of online administrative trainings for WAP Subgrantees. In total, 29 administrative training courses were developed for WAP Subgrantees, focused on the following job roles: Weatherization Director, Fiscal Manage, Quality Assurance Manager. As of September 8, 2020, 2,840 users in nearly all WAP Grantee jurisdictions had registered with the learning management system and completed over 23,000 courses. This report provides a summary of the development process, rollout, and outreach to the WAP network, user response, and lessons learned.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2023

Multilevel-in-width training for deep neural network regression

A common challenge in regression is that for many problems, the degrees of freedom required for a high-quality solution also allows for overfitting. Regularization is a class of strategies that seek to restrict the range of possible solutions so as to discourage overfitting while still enabling good solutions, and different regularization strategies impose different types of restrictions. In this paper, we present a multilevel regularization strategy that constructs and trains a hierarchy of neural networks, each of which has layers that are wider versions of the previous network's layers. Here, we draw intuition and techniques from the field of Algebraic Multigrid (AMG), traditionally used for solving linear and nonlinear systems of equations, and specifically adapt the Full Approximation Scheme (FAS) for nonlinear systems of equations to the problem of deep learning. Training through V-cycles then encourage the neural networks to build a hierarchical understanding of the problem. We refer to this approach as multilevel-in-width to distinguish from prior multilevel works which hierarchically alter the depth of neural networks. The resulting approach is a highly flexible framework that can be applied to a variety of layer types, which we demonstrate with both fully connected and convolutional layers. We experimentally show with PDE regression problems that our multilevel training approach is an effective regularizer, improving the generalize performance of the neural networks studied.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

The tensor-train stochastic finite volume method for uncertainty quantification

The stochastic finite volume method offers an efficient one-pass approach for assessing uncertainty in hyperbolic conservation laws. Still, it struggles with the curse of dimensionality when dealing with multiple stochastic variables. Here, we introduce the stochastic finite volume method within the tensor-train framework to counteract this limitation. This integration, however, comes with its own set of difficulties, mainly due to the propensity for shock formation in hyperbolic systems. To overcome these issues, we have developed a tensor-train-adapted stochastic finite volume method that employs a global WENO reconstruction, making it suitable for such complex systems. This approach represents the first step in designing tensor-train techniques for hyperbolic systems and conservation laws involving shocks.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

MedNAS: Multiscale Training-Free Neural Architecture Search for Medical Image Analysis

Deep neural networks have demonstrated impressive results in medical image analysis, but designing suitable architectures for each specific task is expertise dependent and time consuming. Neural architecture search (NAS) offers an effective means of discovering architectures. It has been highly successful in numerous applications, particularly in natural image classification. Yet, medical images possess unique characteristics, such as small regions and a wide variety of lesion sizes, that differentiate them from natural images. Furthermore, most current NAS methods struggle with high computational costs, especially when dealing with high-resolution image datasets. In this article, we present a novel evolutionary NAS method called multiscale training-free neural architecture search (MSTF-NAS) to address these challenges. Specifically, to accommodate the broad range of lesion region sizes in disease diagnosis, we develop a new reduction cell search space that enables the search algorithm to explicitly identify the optimal scale combination for multiscale feature extraction. Further, to overcome the issue of high computational costs, we utilize training-free indicators as performance measures for candidate architectures, which allows us to search for the optimal architecture more efficiently. More specifically, by considering the capability and simplicity of various networks, we formulate a multiobjective optimization problem that involves two training-free indicators and model complexity for candidate architectures. Extensive experiments on a large medical image benchmark and a publicly available breast cancer detection dataset are conducted. The empirical results demonstrate that our MSTF-NAS outperforms both human-designed architectures and current state-of-the-art NAS algorithms on both datasets, indicating the effectiveness of our proposed method.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2020

Tribal Renewable Energy: Bishop Paiute Tribe Youth Solar Job Training Development (Final Report)

This Project provided workshops and hands on opportunities for young tribal adults to gain education,training,and employment in the solar industry; including 1 youth to meet the eligibility requirements for the NABCEP Solar Installer Exam. 10 tribal youth, ages 16-24, attended workshops focused on learning solar fundamentals and then applied those learned skills to hands on training, installing solar on 2 tribal homes. GRID provided certificates authenticating their volunteer hours and skills learned. This program of youth training really excited the tribal leadership as well as the tribal youth. This opportunity was in alignment with the tribe’s Strategic Energy Plan, and supported tribal self-sufficiency, a path to economic development and for the youth it also represented the environmental stewardship the tribe believes in.

14 SOLAR ENERGY↗

DOE OSTI2022

NCSP Training and Education Program [Slides]

The mission of the Nuclear Criticality Safety Program is to provide sustainable expert leadership, direction and the technical infrastructure necessary to develop, maintain, and disseminate the essential technical tools, training, and data required to support safe, efficient fissionable material operations within DOE; the vision of the program is a Continually improving, adaptable, and transparent program that communicates and collaborates globally to incorporate technology, practices, and programs to be responsive to the essential technical needs of those responsible for developing, implementing, and maintaining nuclear criticality safety. Training and education topics for the program include a 1-week Manager/Criticality Safety Officer Course and a 2-week NCS Engineer Hands-on Training Course.

42 ENGINEERING↗

DOE OSTI2023

USAID Colombia Young Leaders Workforce Training Program Action Plans: Regulatory Road Map for Distributed Energy Resource (DER) Interconnection and Interoperability

As part of the U.S. Agency for International Development (USAID)-National Renewable Energy Laboratory (NREL) Young Leaders Workforce Training Program in Colombia, participants from Colombia's Energy and Gas Regulatory Commission (CREG) leveraged their training and professional experience to develop a regulatory roadmap for the interconnection and interoperability of increasing integration of distributed energy resources (DERs). CREG was one of four teams selected by the training program development team to receive continued technical assistance and strategic advisory support from the USAID-NREL Partnership for action plan development and implementation. This case study provides an overview of the key activities and outcomes of the technical assistance provided by NREL on the CREG Action Plan, and key next steps for implementation of Colombia's DER Integration Regulatory Roadmap.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2023

ORNL NCSP Training and Education Support for FY2022 [Slides]

This presentation is on Oak Ridge National Labatory (ORNL) Nuclear Criticality Safety Program (NCSP) training and education support for Fiscal Year 2022. This lecture explains the approved training and education tasks for fiscal year 2022. Additional training developments for 2022 are covered.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

DOE OSTI2023

Community College Energy Code Training Program

The U.S. Department of Energy (DOE) Office of Energy Efficiency and Renewable Energy (EERE) funded a series of research and training programs under the Advanced Building Construction with Energy Efficient Technologies and Practices (ABC) initiative. The aim is to develop new training programs to support the development of a skilled workforce in the building energy efficiency industry. In response, the University of Illinois Smart Energy Design Assistance Center (SEDAC), in collaboration with State Energy Offices in Illinois, Hawaii, and Nevada, developed the Community College Energy Code Training Program. The program is designed to prepare a new generation of energy-literate professionals that understand energy efficiency and its relation to energy codes for new construction and existing buildings through: a) the development of a curriculum and innovative pedagogical materials, b) dissemination through a national network of state energy offices: c) outreach targeting Community College students and instructors.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2026

When and Why Hiring and Training Occur: A Survey of Building Efficiency Contractors

As state and local governments, along with homeowners, work to enhance building energy performance, a sufficiently skilled energy-efficiency workforce is essential for implementing solutions at scale. In recent years, employers in the energy efficiency sector, including building performance contractors, have frequently reported challenges finding qualified workers. Additionally, as building performance technologies evolve and become more sophisticated, current workers need to acquire new skills and practices to maintain high-quality work. This study surveyed 209 contractors involved in building energy performance projects across 37 U.S. states, Washington, D.C., Guam, and the Marshall Islands. The survey aimed to understand their experiences in the labor market, their business practices, and their decision-making processes when hiring new workers and training existing employees. The findings highlight contractors' motivations and considerations in hiring and training, as well as the most significant challenges they face in the labor market. These insights can help workforce development practitioners design training programs that are aligned with workforce needs and responsive to employer concerns.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2026

DOE Enhancement and Innovation: Toledo Healthy Homes Training Center

The initial goal of the Toledo Healthy Homes Training Center initiative was to provide weatherization instruction opportunities in Northwest Ohio. The focus of the search for a suitable location was centered on Toledo. Toledo Is the largest population center of the 19 counties that make up that region of the state. During the DOE funded grant period, a total of 103 individuals attended 121 separate training events hosted by the Toledo Healthy Homes Training Center.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI1991

Pressure Safety Training (Rev. 8)

This is the workbook for the Pressure Safety Training Course. It is intended as a reference manual and guide for all work with pressurized liquids or gases. This workbook contains basic references to make work with pressure safer. It is intended to supplement classroom instruction, rather than serve as a definitive text on pressure. Earlier versions of the manual were intended specifically for training at Lawrence Livermore National Laboratory. This revision is a generic version intended for training at all DOE facilities. The information in the Standards chapter is from the LLNL Health and Safety Manual. It is included here as a convenient reference and guide for developing similar standards at your own facility.

42 ENGINEERING↗

DOE OSTI2020

Training for Decommissioning and Waste Management - Competence in the Field of Nuclear Engineering - 20137

Due to the phase-out of nuclear power and the reorganization of the participating organizations in Germany, the demand for qualified personnel has increased. But the number of nuclear study programs has rapidly decreased in Germany, although qualified employees are needed for the upcoming tasks in nuclear decommissioning. The solution for those challenging tasks can only be achieved through a strategic approach, involving all stakeholders. AiNT supports this process by offering a tailor-made Education and Training (E and T) program in cooperation with a wide range of partners and initiating the project BEAST (Building competence - Expert knowledge - Applied techniques - Safe decommissioning - Train fellows) as part of the OECD NEA framework Nuclear Education, Skills and Technology (NEST) program. This paper describes the current situation in Germany, provides insight into the education and training program of AiNT, and presents the project BEAST. We are currently looking for international partner institutions that would like to cooperate with us within the framework of the BEAST project and expand the range of topics. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2023

3D Virtual Simulation for Radiation Safety and Hazards Identification Training

This presentation will be presented at CAES codebreaker session on May 4th. The slides include two projects that demonstrate how virtual training can benefit from visualization technology. One is a collaboration project between the Applied Visualization Laboratory and College of Eastern Idaho for radiation safety and survey training. The other one is Idaho National Laboratory's hazards identification online training that utilized LiDAR technology.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2023

Iterative sampling of expensive simulations for faster deep surrogate training

Deep neural network (DNN) surrogates of expensive physics simulations are enabling a rapid change in the way that common experimental design and analysis tasks are approached. Surrogate models allow simulations to be performed in parallel and separately from downstream tasks, thereby enabling analyses that would be impossible with the simulation in-the-loop; surrogates based on DNNs can effectively emulate diverse non-scalar data of the types collected in fusion and laboratory-astrophysics experiments. The challenge is in training the surrogate model, for which large ensembles of physics simulations must be run, preferably without wasting computational effort on uninteresting simulations. Here, in this paper, we present an iterative sampling scheme that can preferentially propose simulations in interesting regions of parameter space without neglecting unexplored regions, allowing high-quality and wide-ranging surrogate models to be trained using 2–3 times fewer simulations compare to space-filling designs. Our approach uses an explicit importance function defined on the simulation output space, balanced against a measure of simulation density which serves as a proxy for surrogate accuracy. It is easy to implement and can be tuned to find interesting simulations early in the study, allowing surrogates to be trained quickly and refined as new simulations become available; this represents an important step towards the routine generation of deep surrogate models quickly enough to be truly relevant to experimental work.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2026

Multi-task Parallelism for Robust Pre-training of Graph Foundation Models on Multi-source, Multi-fidelity Atomistic Modeling Data

Graph foundation models using graph neural networks promise sustainable, efficient atomistic modeling. To tackle challenges of processing multi-source, multi-fidelity data during pre-training, recent studies employ multi-task learning, in which shared message passing layers initially process input atomistic structures regardless of source, then route them to multiple decoding heads that predict data-specific outputs. This approach stabilizes pre-training and enhances a model’s transferability to unexplored chemical regions. Preliminary results on approximately four million structures are encouraging, yet questions remain about generalizability to larger, more diverse datasets and scalability on supercomputers. We propose a multi-task parallelism method that distributes each head across computing resources with GPU acceleration. Implemented in the open-source HydraGNN architecture, our method was trained on over 24 million structures from five datasets and tested on the Perlmutter, Aurora, and Frontier supercomputers, demonstrating efficient scaling on all three highly heterogeneous super-computing architectures.

Lupo Pasini, Massimiliano [ORNL] (ORCID:0000000249↗