Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “TRAINS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Current Status of the DOE/NNSA Nuclear Criticality Safety Program Hands-On Criticality Safety Training

The U.S. Department of Energy/National Nuclear Security Administration (DOE/NNSA) Nuclear Criticality Safety Program (NCSP) has conducted two-week Nuclear Criticality Safety (NCS) Practitioner courses since 2011 to support the training and qualification of new NCS staff. The course was developed in accordance with the American National Standard Institute/American Nuclear Society (ANSI/ANS) standard for NCS training and qualifications (ANSI/ANS-8.26-2007). In 2013, an NCS Manager’s course was developed for process supervisors, managers, regulators, and other professionals with NCS-related responsibilities. This course was revised in 2019 for Criticality Safety Officers (CSOs) based on an NCSP Criticality Safety Support Group tasking (2018-01). This course was piloted at the Nevada Field Office and the National Criticality Experiments Research Center (NCERC) in June 2021. These courses consist of the following training components: classroom education, facility training, and hands-on subcritical and critical experiments training. The two-week Practitioner course offers a week of classroom training, with practical workshops and exercises focused on teaching students how to perform an NCS evaluation. The second week of training involves hands-on critical and subcritical experiments and measurements. The first week is offered in Las Vegas, Nevada, at the DOE Nevada Field Office or the National Atomic Testing Museum. Depending on the student’s clearance level, the second week is offered at Sandia National Laboratory (SNL) (uncleared and L-cleared students) or at the National Criticality Experiments Research Center (Q-cleared students). The one-week Manager’s course is offered at SNL or NCERC, depending on clearance or interest, and includes classroom and hands- on critical and subcritical experiments and measurements. This paper provides an overview and status report for the DOE/NNSA NCSP training courses in NCS and to provide information about future course offerings. This paper discusses the challenges associated with executing the training courses during the COVID-19 pandemic. The 2-week Practitioner and 1-week manager courses are currently offered twice per year and adjustments are made based upon demand.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Current Status of the DOE/NNSA Nuclear Criticality Safety Program Hands-On Criticality Safety Training [Abstract]

The U.S. Department of Energy/National Nuclear Security Administration (DOE/NNSA) Nuclear Criticality Safety Program (NCSP) has conducted two-week Nuclear Criticality Safety (NCS) Practitioner courses since 2011 to support the training and qualification of new NCS staff. The course was developed in accordance with the American National Standard Institute/American Nuclear Society (ANSI/ANS) standard for NCS training and qualifications (ANSI/ANS-8.26-2007). In 2013, an NCS Manager’s course was developed for process supervisors, managers, regulators, and other professionals with NCS-related responsibilities. This course was revised in 2019 for Criticality Safety Officers (CSOs) based on an NCSP Criticality Safety Support Group tasking (2018-01). This course was piloted at the Nevada Field Office and the National Criticality Experiments Research Center (NCERC) in June 2021. These courses consist of the following training components: classroom education, facility training, and hands-on subcritical and critical experiments training. The two-week Practitioner course offers a week of classroom training, with practical workshops and exercises focused on teaching students how to perform an NCS evaluation. The second week of training involves hands-on critical and subcritical experiments and measurements. The first week is offered in Las Vegas, Nevada, at the DOE Nevada Field Office or the National Atomic Testing Museum. Depending on the student’s clearance level, the second week is offered at Sandia National Laboratory (SNL) (uncleared and L-cleared students) or at the National Criticality Experiments Research Center (Q-cleared students). The one-week Manager’s course is offered at SNL or NCERC, depending on clearance or interest, and includes classroom and hands-on critical and subcritical experiments and measurements. This paper provides an overview and status report for the DOE/NNSA NCSP training courses in NCS and to provide information about future course offerings. This paper will also discuss the challenges associated with executing the training courses during the COVID-19 pandemic. The 2-week Practitioner and 1-week manager courses are currently offered twice per year and adjustments are made based upon demand.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2024

On the Training and Generalization of Deep Operator Networks

Here, we present a novel training method for deep operator networks (DeepONets), one of the most popular neural network models for operators. DeepONets are constructed by two subnetworks, namely the branch and trunk networks. Typically, the two subnetworks are trained simultaneously, which amounts to solving a complex optimization problem in a high dimensional space. In addition, the nonconvex and nonlinear nature makes training very challenging. To tackle such a challenge, we propose a two-step training method that trains the trunk network first and then sequentially trains the branch network. The core mechanism is motivated by the divide-and-conquer paradigm and is the decomposition of the entire complex training task into two subtasks with reduced complexity. Therein the Gram–Schmidt orthonormalization process is introduced which significantly improves stability and generalization ability. On the theoretical side, we establish a generalization error estimate in terms of the number of training data, the width of DeepONets, and the number of input and output sensors. Numerical examples are presented to demonstrate the effectiveness of the two-step training method, including Darcy flow in heterogeneous porous media.

deep operator networks↗
DOE OSTI2013

Alaska Native Weatherization Training and Jobs Program. First Steps Toward Tribal Weatherization – Human Capacity Development (Final Report)

The Alaska Native Weatherization Training and Jobs Project expanded weatherization services for tribal members’ homes in southeast Alaska while providing weatherization training and on the job training (OJT) for tribal citizens that lead to jobs and most probably careers in weatherization-related occupations. The program resulted in; (a) 80 Alaska Native citizens provided with skills training in five weatherization training units that were delivered in cooperation with University of Alaska Southeast, in accordance with the U.S. Department of Energy Core Competencies for Weatherization Training that prepared participants for employment in three weatherization-related occupations: Installer, Crew Chief, and Auditor; (b) 25 paid OJT training opportunities for trainees who successfully completed the training course; and (c) employed trained personnel that have begun to rehab on over 1,000 housing units for weatherization.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

NFPA Distributed Energy Resources Safety Training (DERST) For Emergency Responders

The National Fire Protection Association, with support from the Department of Energy, executed a multi-year initiative to develop, enhance, and disseminate Distributed Energy Resources Safety Training (DERST) tools for U.S. emergency responders. As Distributed Energy Resources (DER)—such as solar photovoltaics, battery energy storage systems (ESS), electric vehicles (EVs), and associated infrastructure—become increasingly prevalent, the NFPA identified a critical need for up-to-date standardized, accessible, and effective safety training tailored for the fire service and related public safety professionals. The project delivered a comprehensive suite of educational resources to improve responders’ abilities to safely manage DER-related incidents. This included: • Revised Modular Training Courses: Updated classroom-based DER safety courses, now modular and accessible nationwide through fire academies and the North American Fire Training Directors (NAFTD) network. • Live Burn Testing & Research: A full-scale controlled burn of a DER-equipped residential structure provided real-world data and insights, forming the basis for updated best practices. • A Gamified Simulation Tool – Firefighters Incident Response Simulation Tool (FIRST): A first-of-its-kind, multiplayer, scenario-based simulation using the Unreal Engine 5.0 to train responders in a realistic virtual, multi-DER incident environment. • Field Familiarization Software Tools & Prop Guide: Digital DER field familiarization evolutions software guide and a prop development manual to support field-based DER training exercises, enhancing responders' hands-on familiarity with DER infrastructure and collaboration on virtual incident responses. • National Dissemination Strategy: Strategic partnerships with NAFTD, Vector Solutions, and others enabled wide-scale distribution, with over 5,000 departments accessing resources and 1,100+ departments adopting the simulator in the first seven months. Also provided a web portal for easy access to all training and simulation programs developed under this grant for the U.S. responder community. Key findings from the project—particularly from the burn test—led to paradigm shifts in fire response tactics. For example, traditional approaches to garage fires may be hazardous if DERs are present, due to explosive off gassing and thermal runaway risks. The new training emphasizes scene assessment, stand-off approaches, thermal imaging verification, and careful post-incident cooling of DER components to prevent reignition. This initiative has had a significant national impact, raising awareness, enhancing preparedness, and supporting safer DER incident response practices. Significant engagement from the media, public safety organizations, and PBS coverage has further amplified the reach and adoption of NFPA’s DER safety training, tools, and simulations.

14 SOLAR ENERGY↗
NASA NTRSDate not supplied

Training Artemis Astronauts to Explore the Moon

To prepare for human exploration of the Moon in the mid-2020s, NASA is developing a program to provide geoscience and planetary science classroom training and geologic eld training to astronauts and other mission personnel. The Artemis geoscience training plan builds on a long legacy: NASA has trained astronauts in geology, planetary science, and geological eld work for more than 50 years. From ~1965-1972, the geology focus for astronauts included orbital Earth observations during the early NASA missions, but the endgame was preparation for the Apollo missions to the Lunar surface [see Phinney (2015), NASA-SP-2015-626; Lofgren et al.(2011);Schmitt, et al. (2011); and El Baz (2011), all from GSA SP483]. From the mid 1970s through2017, the primary purpose for geoscience training was to prepare astronauts to observe theEarth and document a wide variety of Earth processes from orbital platforms (Skylab, SpaceShuttle and International Space Station). Astronaut observations of Earth from the InternationalSpace Station remain an important activity today, but the prospect of exploration of the lunar surface through the Artemis Program lends additional purpose to the geoscience content and eld experiences that we provide the astronauts. We recently completed the geology and eld training with Astronaut Class 22 and are now planning both focused eld exercises and simulations for future Artemis crews, as well as the accompanying classroom lessons on lunar and planetary sciences. The training we offer extends beyond the astronaut office – we partner across operational and engineering organizations at NASA and provide eld work exercises and opportunities to personnel in the Flight Operations Directorate (responsible for the overall training and certification), as well as the exploration Extravehicular Activity Oce (developing spacewalk suits and tools). These partnerships contribute to building a common language and sense of purpose, and also help to ensure that NASA’s geoscience training and science operations are fully integrated with the teams and systems responsible for getting the next generation of astronauts to the surface of the Moon.

Artemis↗
NASA NTRSDate not supplied

Physics and Modeling of Quasi-Steady and Forced Shock Trains

The dual-mode scramjet is a propulsive concept for contemporary hypersonic vehicles promising flight cruise speeds upwards of Mach 5. Despite decades of development and a recent resurgence in interest, such engines are not routinely deployed for commercial or military purposes. Instead, they have been confined to the realm of ground-test research and limited one-off flight test missions. One of the key stumbling blocks on the critical path to deployment of a dual-mode scramjet is the optimal design and stable operation of the isolator, a typically constant area duct that separates the scramjet inlet from the combustor. During ramjet mode at Mach numbers from 3 to 5 and during the transition to scramjet mode at higher Mach numbers, the isolator contains the pseudo-shock. Necessary to meet the back-pressure in the combustor, the pseudo-shock is typically divided into a shock dominated shock train region followed by a turbulence driven mixing region. Fluctuations in combustor pressure due to vehicle maneuvering, throttling, or combustion instabilities drive the shock train to shift streamwise within the isolator. In response to sharp pressure fluctuations, the shock train is unable to stabilize within the isolator, and the scramjet unstarts by ejecting the shock train out the inlet. This work addresses three key gaps in understanding of the isolator pseudo-shock. The phenomenon is studied in three experimental facilities to investigate the quasi-steady and unsteady fluid dynamics of the shock train in fueled and un-fueled test conditions. The strong link between boundary layer morphology and shock train structure is studied in detail and used as a tool to evaluate the state-of-the-art definitions and models of the pseudo-shock. Identifying the limitations of these models, a new process driven flux-conserved pseudo-shock model is proposed. This provides a computationally efficient model grounded in the fluid dynamic mechanisms of the pseudo-shock with better predictive capability than the current state-of-the-art across all facilities tested. The unsteady behavior of the shock train is further investigated to identify and understand two distinct forced dynamic modes: mechanically induced, low-rate forcing and high-rate combustion driven unsteadiness that sheds upstream propagating shocks. The proposed process driven model is found to be effective in the the limiting case of high-rate combustion driven unsteadiness by evaluating the model in a shock stationary reference frame. Further analysis identifies the approximately rigid chain motion of the shock train structure to mechanically induced forcing. The time delay between the onset of forced dynamics is found to saturate to a constant value and maximum shock train speed along the isolator with respect to the perturbation rate of change. The result of this work provides dual-mode scramjet designers with improved tools and physical understanding to develop more efficient, robust, and capable propulsion systems for hypersonic vehicles.

JAXA↗
DOE OSTI2017

Development of a utility computer-based training program on setpoint methodology for nuclear power plants - 129

The purpose of this paper is to provide an overview of the development of the Computer- Based Training (CBT) Program for utility engineers on Setpoint Methodology for nuclear power plants. This computer based training module was prepared by the Advanced Engineering Training initiative. The Advanced Engineering Training initiative is a nuclear industry effort to develop technical computer-based training modules for targeted areas of engineering expertise. The target audience is engineers at commercial nuclear power facilities in the U. S. These modules are being developed using the systematic approach to training and are being designed to maintain industry engineering expertise and to facilitate engineering knowledge transfer. The objective of this training effort is to support the development of the next generation of site technical experts for specific topic areas. The training is one part of three key components that would facilitate knowledge transfer to the future site Subject Matter Expert (SME). The following are the major focus areas covered in the Setpoint Methodology CBT: Chapter 1 provides an overview of the role instrument setpoints perform in the defense-in-depth safety analysis for the plant as well introducing key definitions related to setpoints. Chapter 2 provides the history and current regulatory requirements related to setpoint control including the laws and guidance provided by the U.S. NRC. Chapter 3 provides describes the setpoint methodology including terms, formulae, methods of combination, graded approach and methods for drift analysis. This is a major part of the training module in covering the incremental uncertainty terms that need to be considered and how they are combined. Chapter 4 provides and overview of the role of setpoints in Technical Specifications and associated documents. Chapter 5 describes how the regulatory process, related to setpoint control, has been implemented in NRC inspections and how the major elements of the 10 CFR 50.59 reviews apply to the performance of a new or revised setpoint calculation. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Best Practices for NERSC Training

The National Energy Research Supercomputing Center (NERSC) at Lawrence Berkeley National Laboratory (LBNL) organizes approximately 20 training events per year for its 8,000 users from 800 projects, who have varying levels of High Performance Computing (HPC) knowledge and familiarity with NERSC's HPC resources. Due to the novel circumstances of the pandemic, NERSC began transforming our traditional smaller-scale, on-site training events to larger-scale, fully virtual sessions in March 2020. We treated this as an opportunity to try new approaches and improve our training best practices. This paper describes the key practices we have developed since the start of this transformation, including considerations for organizing events; collaboration with other HPC centers and the DOE ECP Program to increase reach and impact of events; targeted emails to users to increase attendance; efficient management of user accounts for computational resource access; strategies for preventing Zoombombing; streamlining the publication of professional-quality, closed-captioned videos on the NERSC YouTube channel for accessibility; effective communication channels for Q&A; tailoring training contents to NERSC user needs via close collaboration with vendors and presenters; standardized training procedures and publishing of training materials; and considerations for planning HPC training topics. Additionally, most of these practices will be continued after the pandemic as effective norms for training.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2015

FAST MAGNETOACOUSTIC WAVE TRAINS OF SAUSAGE SYMMETRY IN CYLINDRICAL WAVEGUIDES OF THE SOLAR CORONA

Fast magnetoacoustic waves guided along the magnetic field by plasma non-uniformities, in particular coronal loops, fibrils, and plumes, are known to be highly dispersive, which lead to the formation of quasi-periodic wave trains excited by a broadband impulsive driver, e.g., a solar flare. We investigated the effects of cylindrical geometry on the fast sausage wave train formation. We performed magnetohydrodynamic numerical simulations of fast magnetoacoustic perturbations of a sausage symmetry, propagating from a localized impulsive source along a field-aligned plasma cylinder with a smooth radial profile of the fast speed. The wave trains are found to have pronounced period modulation, with the longer instant period seen in the beginning of the wave train. The wave trains also have a pronounced amplitude modulation. Wavelet spectra of the wave trains have characteristic tadpole features, with the broadband large-amplitude heads preceding low-amplitude quasi-monochromatic tails. The mean period of the wave train is about the transverse fast magnetoacoustic transit time across the cylinder. The mean parallel wavelength is about the diameter of the wave-guiding plasma cylinder. Instant periods are longer than the sausage wave cutoff period. The wave train characteristics depend on the fast magnetoacoustic speed in both the internal and external media, the smoothness of the transverse profile of the equilibrium quantities, and also the spatial size of the initial perturbation. If the initial perturbation is localized at the axis of the cylinder, the wave trains contain higher radial harmonics that have shorter periods.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Fair Concurrent Training of Multiple Models in Federated Learning

Federated learning (FL) enables collaborative learning across multiple clients. In most FL work, all clients train a single learning task. However, the recent proliferation of FL applications may increasingly require multiple FL tasks to be trained simultaneously, sharing clients’ computing resources, which we call Multiple-Model Federated Learning (MMFL). Current MMFL algorithms use naïve average-based client-task allocation schemes that often lead to unfair performance when FL tasks have heterogeneous difficulty levels, as the more difficult tasks may need more client participation to train effectively. Furthermore, in the MMFL setting, we face a further challenge that some clients may prefer training specific tasks to others, and may not even be willing to train other tasks, e.g., due to high computational costs, which may exacerbate unfairness in training outcomes across tasks. We address both challenges by firstly designing FedFairMMFL, a difficulty-aware algorithm that dynamically allocates clients to tasks in each training round, based on the tasks’ current performance levels. We provide guarantees on the resulting task fairness and FedFairMMFL’s convergence rate. We then propose novel auction designs that incentivizes clients to train multiple tasks, so as to fairly distribute clients’ training efforts across the tasks, and extend our convergence guarantees to this setting. Here, we finally evaluate our algorithm with multiple sets of learning tasks on real world datasets, showing that our algorithm improves fairness by improving the final model accuracy and convergence speed of the worst performing tasks, while maintaining the average accuracy across tasks.

Federated learning↗
DOE OSTI2022

Training data selection for event classification in a highly variable environment

A problem of interest for nuclear nonproliferation is monitoring activities at nuclear facilities, where proliferation events may only take place a few times and often under variable conditions. Machine learning has revolutionized data analytics by enabling the use of measurable signatures to generate predictive models of facility operations. However, traditional methods for training these models require large, reliable data sets with labeled observations, a challenge for nonproliferation. Highly variable conditions further complicate this as events from training data may have occurred in conditions quite different from the event of interest. Our hypothesis is that when events occur in a highly variable environment, careful training data selection for each test event could outperform the standard approach of using all available training data. We developed a method to optimize training data selection for the given test event and applied it to predicting the power level of the High Flux Isotope Reactor (HFIR) at Oak Ridge National Laboratory. In this study, the reactor startup exhibits variability between occurrences due to natural variability in environmental conditions and operational procedures. Using a combination of analysis techniques, a similitude assessment was performed on data collected from HFIR to isolate clusters that were optimal for training a predictive model. Concepts such as dynamic time warping and Jaccard similarity were used in conjunction with clustering analysis. In order to validate this approach, the model was trained on every combination of unique training events and the predictive performance was compared to the performance using a subset of the training data selected by isolated clusters found through the similitude assessment.

Iyer, A↗
DOE OSTI2018

How Good is Good Enough?: Quantifying the Effects of Training Set Quality

There is a general consensus in the neural network community that noise in training data has a negative impact on model output; however, efforts to quantify the impact of varying levels have been limited, particularly for semantic segmentation tasks. This is a question of particular importance for remote sensing applications where the cost of producing a large training set can lead to reliance on publicly available data with varying degrees of noise. This work explores the effects of different degrees and types of training label noise on a pre-trained building extraction deep learner. Quantitative and qualitative evaluations of these effects can help inform decisions about trade-offs between the cost of producing training data and the quality of model outputs. We found that, relative to the base model, models trained with small amounts of noise showed little change in precision but achieved considerable increases in recall. Conversely, as noise levels increased, both precision and recall decreased. Precision and recall both lagged behind a model trained with pristine data. These exploratory results indicate the importance of quality control for training and, more broadly, that the relationship between degrees and types of training data noise and model performance is more complex than trade-offs between precision and recall.

Swan, Benjamin↗
DOE OSTI2014

FINAL SCIENTIFIC REPORT Southwest United States of America – Distributed Technology Training Consortia (SWUSA-DTTC) Contract Number: DE-EE0006339

The Southwest United States of America – Distributed Technology Training Consortia (SWUSA-DTTC) leveraged the highest concentration of renewable resources in the U.S. as well as operation of the leading independent microgrid installations and other distributed technologies to collect and analyze real-time data streams, advance power system simulations and analysis, identify educational and training gaps and develop solutions-focused curricula. The SWUSA-DTTC consortium posed a unique collaboration between universities and utilities to ensure that classes were focused on subjects and topics of interest to the utilities and ones that had practical benefit related to the preparedness for accommodating high penetration of solar and other distributed energy technologies. This approach to have a close collaboration and shared effort to develop the course content and curriculum is unique and a significant departure from conventional course development. This coursework and training was intended to endure over a long time horizon (10-20 year time frame), and include professionals over the entire Southwest region and the rest of the US, and even outreach into foreign countries. Project Objectives In order to support the increase in power systems research, development, and analytical capacity, the SWUSA-DTTC brought together respected professors in Power Systems education, student/professor research and development, and valuable industry and utility experience. Through this program, the partnered universities created and/or modified existing curricula available to students and professionals in the form of university courses, short courses, videos, consortia-led training, and online materials. During this time, the supporting vendors and utilities provided the SWUSA-DTTC with technical advisory roles as well as providing input and feedback in terms of utility and related energy industry needs. The goals were to create power and energy systems training, curricula, and workforce preparedness through the inclusion of data collection and analysis, power systems expertise, and application-specific training activities which build on fundamental principles, modeling and simulation tools, field-immersed training and methods of performance validation. The outcome of the program was to result in better prepared and greater number of graduates ready to contribute to the field of power systems which depend upon the safe, reliable and efficient generation sources which make up an increasingly diverse mix of renewable power. Additionally, the program was to deliver critical training modules which are intended to support mid-career professionals and be woven into utility training programs used all over the country. Discontinuation Summary On September 29, 2014, Electricore received notice of discontinuation of federal funding under subject Award DE-EE0006339. DOE’s notice of discontinuation was the first indication provided to Electricore that the work completed against Task 1 - Program Planning and Evaluation during Budget Period 1 was inadequate. Significantly, the discontinuation was based in large part on the erroneous assertion that many of the tasks were incomplete as indicated in the Continuation Application. However, the Continuation Application was submitted July 29, 2014, while the period of performance for this last quarter in Budget Period 1 did not end until September 30, 2014. Accordingly, the performance for this last quarter in Budget Period 1 will be reported in the upcoming Quarterly Report which is not due until October 30, 2014. Nevertheless, in response to DOE’s letter and in further support of Electricore’s Continuation Application, we are providing a detailed status demonstrating adherence to all program requirements for each Task 1, Budget Period 1 SOPO activity and milestones in response to the DOE review.

14 SOLAR ENERGY↗
DOE OSTI2020

Final Evaluation Report for the Sandia National Laboratories Recorded Information Management Training Program

The Recorded Information Management (RIM) training and guidance materials were originally evaluated to determine the current status of the training program. Specifically, how and where are training materials implemented and are members of the workforce (MOWs) regularly accessing them. The evaluation highlighted that there is a breadth of training materials and guidance available; however, the materials are often outdated, point to old Sandia Policies, and/or are in outdated templates. Additionally, there is currently no single-entry point for training, meaning that training is available via the RIM homepage, TEDs, etc. This means that MOWs must search in various webpages or systems for training. To ensure RIM training materials are regularly updated and are accessible for MOWs it is recommended to assign one staff member to manage the program training materials.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2024

Optimizing Distributed Training on Frontier for Large Language Models

Large language models (LLMs) have demonstrated remarkable success as foundational models, benefiting various downstream applications through fine-tuning. Loss scaling studies have demonstrated the superior performance of larger LLMs compared to their smaller counterparts. Nevertheless, training LLMs with billions of parameters poses significant challenges and requires considerable computational resources. For example, training a one trillion parameter GPT-style model on 20 trillion tokens requires a staggering 120 million exaflops. This research explores efficient distributed training strategies to extract this computation from Frontier, the world's first exascale supercomputer. We enable and investigate various model and data parallel training techniques, such as tensor parallelism, pipeline parallelism, and sharded data parallelism, to facilitate training a trillion-parameter model on Frontier. We empirically assess these techniques and their associated parameters to determine their impact on memory footprint, communication latency, and GPU's computational efficiency. We analyze the complex interplay among these techniques and find a strategy to combine them to achieve high throughput through hyperparameter tuning. We have identified efficient strategies for training large LLMs of varying sizes through empirical analysis and hyperparameter tuning. For 22 Billion, 175 Billion, and 1 Trillion parameters, we achieved GPU throughputs of 38.38%, 36.14%, and 31.96%, respectively. For the training of the 175 Billion parameter model and the 1 Trillion parameter model, we achieved 100% weak scaling efficiency on 1024 and 3072 Mi250X GPUs, respectively. We also achieved strong scaling efficiencies of 89% and 87% for these two models. We trained these models only tens of iterations instead of training till completion.

Yin, Junqi↗
NASA NTRS1989

The flights before the flight - An overview of shuttle astronaut training

Space shuttle astronaut training is centered at NASA's Johnson Space Center in Houston, Texas. Each astronaut receives many different types of training from many sources. This training includes simulator training in the Shuttle Mission Simulator, in-flight simulator training in the Shuttle Training Aircraft, Extravehicular Activity training in the Weightless Environment Training Facility and a variety of lectures and briefings. Once the training program is completed each shuttle flight crew is well-prepared to perform the normal operations required for their flight and deal with any shuttle system malfunctions that might occur.

Sims, John T.↗
NASA NTRS1990

Elevated central venous pressure: A consequence of exercise training-induced hypervolemia

Resting plasma volumes, and arterial and central venous pressures (CVP) were measured in 16 men before and after exercise training to determine if training-induced hypervolemia could be explained by a change in total vascular capacitance. In addition, resting levels of plasma vasopressin (AVP), atrial natriuretic peptide (ANP), aldosterone (ALD), and norepinephrine (NE) were measured before and after training. The same measurements of vacular volume, pressures, and plasma hormones were measured in 8 subjects who did not undergo exercise and acted as controls. The exercise training program consisted of 10 weeks of controlled cycle exercise for 30 min/d, 4 d/wk at 75 to 80 percent of maximal oxygen uptake (VO2max). A training effect was verified by a 20 percent increase in VO2max, a resting bradycardia, and a 370 ml (9 percent) increase in blood volume. Mean arterial blood pressure was unaltered by exercise training, but resting CVP increased. The percent change in blood volume from before to after training was linearly related to the percent change in CVP. As a consequence of elevations in both blood volume and CVP, the volume-to-pressure ratio was essentially unchanged following exercise training. Plasma AVP, ANP, ALD, and NE were unaltered. Results indicate that elevated CVP is a consequence of training-induced hypervolemia without alteration in total effective venous capacitance. This may represent a resetting of the pressure-volume stimulus-response relation for regulation of blood volume.

Convertino, Victor A.↗