Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Continual learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Measurement and applications: Exploring the challenges and opportunities of hierarchical federated learning in sensor applications

Sensor applications have become ubiquitous in modern society as the digital age continues to advance. AI-based techniques (e.g., machine learning) are effective at extracting actionable information from large amounts of data. An example would be an automated water irrigation system that uses AI-based techniques on soil quality data to decide how to best distribute water. However, these AI-based techniques are costly in terms of hardware resources, and Internet-of-Things (IoT) sensors are resource-constrained with respect to processing power, energy, and storage capacity. These limitations can compromise the security, performance, and reliability of sensor-driven applications. To address these concerns, cloud computing services can be used by sensor applications for data storage and processing. Unfortunately, cloud-based sensor applications that require real-time processing, such as medical applications (e.g., fall detection and stroke prediction), are vulnerable to issues such as network latency due to the sparse and unreliable networks between the sensor nodes and the cloud server [1]. As users approach the edge of the communications network, latency issues become more severe and frequent. A promising alternative is edge computing, which provides cloud-like capabilities at the edge of the network by pushing storage and processing capabilities from centralized nodes to edge devices that are closer to where the data are gathered, resulting in reduced network delays [2], [3].

Po-Leen Ooi, Melanie↗

Reinforcement learning based hybrid bond-order coarse-grained interatomic potentials for exploring mesoscale aggregation in liquid–liquid mixtures

Exploring mesoscopic physical phenomena has always been a challenge for brute-force all-atom molecular dynamics simulations. Although recent advances in computing hardware have improved the accessible length scales, reaching mesoscopic timescales is still a significant bottleneck. Coarse-graining of all-atom models allows robust investigation of mesoscale physics with a reduced spatial and temporal resolution but preserves desired structural features of molecules, unlike continuum-based methods. Here, we present a hybrid bond-order coarse-grained forcefield (HyCG) for modeling mesoscale aggregation phenomena in liquid–liquid mixtures. The intuitive hybrid functional form of the potential offers interpretability to our model, unlike many machine learning based interatomic potentials. We parameterize the potential with the continuous action Monte Carlo Tree Search (cMCTS) algorithm, a reinforcement learning (RL) based global optimizing scheme, using training data from all-atom simulations. The resulting RL-HyCG correctly describes mesoscale critical fluctuations in binary liquid–liquid extraction systems. cMCTS, the RL algorithm, accurately captures the mean behavior of various geometrical properties of the molecule of interest, which were excluded from the training set. The developed potential model along with the RL-based training workflow could be applied to explore a variety of other mesoscale physical phenomena that are typically inaccessible to all-atom molecular dynamics simulations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

The Artificial Scientist: in-Transit Machine Learning of Plasma Simulations

Large-scale simulations or scientific experiments produce petabytes of data per run. This poses massive challenges for I/O and storage when scientific analysis workflows are run manually offline. Unsupervised deep learning-based techniques to extract patterns and non-linear relations from these large amounts of data provide a way to build scientific understanding from raw data, reducing the need for manual pre-selection of analysis steps, but require exascale compute and memory to process the full dataset available. In this paper, we demonstrate a heterogeneous streaming workflow in which plasma simulation data is streamed directly to a Machine Learning (ML) application training a model on the simulation data in-transit, completely circumventing the capacity-constrained filesystem bottleneck. This workflow employs openPMD to provide a high level interface to describe scientific data and also uses ADIOS2, to transfer volumes of data that exceed the capabilities of the filesystem. We employ experience replay to avoid catastrophic forgetting in learning from this non-steady state process in a continual manner and adapt it to improve model convergence while learning in-transit. As a proof-of-concept, we approach the ill-posed inverse problem of predicting particle dynamics from radiation in a particle-incell (PIConGPU) simulation of the Kelvin-Helmholtz instability (KHI). We detail hardware-software co-design challenges as we scale PIConGPU to full Frontier, the Top-1 system as of June 2024 Top500 list.

Kelling, Jeffrey [Helmholtz-Zentrum Dresden Rossen↗

ECP libraries and tools: An overview

The Exascale Computing Project (ECP) Software Technology and Co-Design teams addressed the growing complexities in high-performance computing (HPC) by developing scalable software libraries and tools that leverage exascale system capabilities. As we enter the exascale era, the need for reusable, optimized software solutions that can handle the unique challenges posed by these systems becomes increasingly important. The primary challenges the ECP teams faced were to create software libraries and tools that are performant on exascale architectures and portable and usable across diverse hardware platforms. Efforts addressed issues related to concurrent execution, memory management, and the integration of heterogeneous computing resources, such as GPUs from multiple vendors. The ECP’s strategy involved a structured development process encompassing the creation, optimization, and deployment of software in collaboration with industry, academia, and national laboratories. The project was organized into several technical areas: co-design of domain-specific suites with target applications, programming models and runtimes, development tools, mathematical libraries, data and visualization tools, and software ecosystem and delivery mechanisms. ECP has successfully developed a large portfolio of software libraries and tools that demonstrate significant improvements in performance and scalability on exascale systems. These products have been integrated into the Department of Energy’s computing facilities, supporting various scientific applications and ensuring robust performance across different hardware setups. ECP advancements in software development for exascale computing highlight the importance of a collaborative and adaptive approach to handling next-generation HPC systems complexities. The lessons learned emphasize the need for continuous engagement with end-users and vendors, and the importance of maintaining a balance between innovation and practical implementation. Future efforts will focus on ensuring scalability, keeping pace with rapid hardware advancements, and further enhancing the interoperability and usability of the software ecosystem. In conclusion, subsequent articles in this special issue provide in-depth discussions and case studies into specific library and tool efforts.

97 MATHEMATICS AND COMPUTING↗

Proposed Plutonium-Nickel Critical Experiment

The Los Alamos Critical Experiments Facility (LACEF) and subsequently its descendant, the National Criticality Experiments Research Center (NCERC) located at the Nevada National Security Site, have been performing critical experiments for over 75 years. The work done continues to build upon lessons learned from the past. It also builds upon knowledge gained from past experiments. The LACEF and NCERC experiments “provide nuclear criticality benchmark data for a wide variety of fissile and non-fissile materials in all neutron energy spectra systems”. In 2014, a subcritical benchmark with plutonium surrounded by nickel was issued in the International Criticality Safety Benchmark Evaluation Project (ICSBEP). Two years later, a new benchmark experiment was performed, commonly known as Subcritical Copper Reflected $\mathcal{a}$-Phase Plutonium SCR$\mathcal{a}$P. The uncertainties in the SCR$\mathcal{a}$P experiment were significantly reduced from the Pu-Ni experiment and the methods were refined. Additionally, a Pu-lead critical experiment was performed in 2017 which followed different methods and with different objectives. Now, an experiment is proposed that builds on both the subcritical nickel experiment and the critical lead experiment. The proposed experiment has interleaved nickel and plutonium, in a thermal arrangement. This particular experiment would support criticality safety at the Hanford Tank Farms, whose tanks contain a significant amount of nickel credited as a neutron absorber in the criticality safety evaluation.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A Review of Underground Coal Gasification Field Tests Sponsored by the U.S. Department of Energy

The United States Department of Energy (DOE)and its predecessors funded and managed an Underground Coal Gasification (UCG) research and development program during the 1970’s and 1980’s. The centerpiece was a series of UCG field tests run by several major institutions over two decades. This field-test program provided the main players who ran these tests the time and continuity to move up the learning curve and develop experience, knowledge, understanding, capabilities, and improved technologies.

01 COAL, LIGNITE, AND PEAT↗

Current Status of the DOE/NNSA Nuclear Criticality Safety Program Hands-on Criticality Safety Training Courses [Slides]

The NCSP training and education program has been conducted since 2011 and has trained over 591 students. 388 students have been trained in the 2-week hands-on course for practitioners and 203 students have been trained in the 1-week manager courses. The course is continuously improved using lessons-learned from the prior year, and new course content is added as necessary. Special courses are developed and offered periodically at the discretion of the NCSP manager. The updated manager course for CSOs was successfully piloted at NCERC in June 2020 and was successfully piloted at Sandia in April 2022. Students interested in taking the courses should visit the DOE NCSP website for additional information about all course offerings and for information about course registration.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Thermopile Energy Harvesting for Subsurface Wellbore Sensors (Final Report)

Robust in situ power harvesting underlies all efforts to enable downhole autonomous sensors for real-time and long-term monitoring of CO 2 plume movement and permeance, wellbore health, and induced seismicity. This project evaluated the potential use of downhole thermopile arrays, known as thermoelectric generators (TEGs), as power sources to charge sensors for in situ real-time, long-term data capture and transmission. Real-time downhole monitoring will enable “Big Data” techniques and machine learning, using massive amounts of continuous data from embedded sensors, to quantify short- and long-term stability and safety of enhanced oil recovery and/or commercial-scale geologic CO 2 storage. This project evaluated possible placement of the TEGs at two different wellbore locations: on the outside of the casing; or on the production tubing. TEGs convert heat flux to electrical power, and in the borehole environment, would convert heat flux into or out of the borehole into power for downhole sensors. Such heat flux would be driven by pumping of cold or hot fluids into the borehole—for instance, injecting supercritical CO 2 —creating a thermal pulse that could power the downhole sensors. Hence, wireless power generation could be accomplished with in situ TEG energy harvesting. This final report summarizes the project’s efforts that accomplished the creation of a fully operational thermopile field unit, including selection of materials, laboratory benchtop experiments and thermal-hydrologic modeling for design and optimization of the field-scale power generation test unit. Finally, the report describes the field unit that has been built and presents results of performance and survivability testing. The performance and survivability testing evaluated the following: 1) downhole power generation in response to a thermal gradient produced by pumping a heated fluid down a borehole and through the field unit; and 2) component survivability and operation at elevated temperature and pressure conditions representative of field conditions. The performance and survivability testing show that TEG arrays are viable for generating ample energy to power downhole sensors, although it is important to note that developing or connecting to sensors was beyond the scope of this project. This project’s accomplishments thus traversed from a low Technical Readiness Level (TRL) on fundamental concepts of the application and modeling to TRL-5 via testing of the fully integrated field unit for power generation in relevant environments. A fully issued United States Patent covers the wellbore power harvesting technology and applications developed by this project.

47 OTHER INSTRUMENTATION↗

DECAL MDN Resolution Calibration

The simulated pixelated calorimeter uses 0.1 mm × 0.1 mm silicon pixels (0.0001 cm²) silicon pixels as active layers — far finer than current concepts like HGCAL (~0.5 cm²) — improving energy resolution through much finer segmentation. While the standard resolution formalism fits three numbers to a handful of discrete test-beam energies, this work is a first try at a more data-efficient alternative: learning the full response shape continuously in energy with a mixture density network. This continuous, differentiable surrogate is a natural building block for fast simulation of extremely complex calorimeters.

Wang, Peter [U. Chicago (main)]↗

A Parametric Geometry Computational Fluid Dynamics (CFD) Study Utilizing Design of Experiments (DOE)

Design of Experiments (DOE) was applied to the LAS geometric parameter study to efficiently identify and rank primary contributors to integrated drag over the vehicles ascent trajectory in an order of magnitude fewer CFD configurations thereby reducing computational resources and solution time. SME s were able to gain a better understanding on the underlying flowphysics of different geometric parameter configurations through the identification of interaction effects. An interaction effect, which describes how the effect of one factor changes with respect to the levels of other factors, is often the key to product optimization. A DOE approach emphasizes a sequential approach to learning through successive experimentation to continuously build on previous knowledge. These studies represent a starting point for expanded experimental activities that will eventually cover the entire design space of the vehicle and flight trajectory.

Rhew, Ray D.↗

Space Telecommunications Radio System (STRS) Application Repository Design and Analysis

The Space Telecommunications Radio System (STRS) Application Repository Design and Analysis document describes the STRS application repository for software-defined radio (SDR) applications intended to be compliant to the STRS Architecture Standard. The document provides information about the submission of artifacts to the STRS application repository, to provide information to the potential users of that information, and for the systems engineer to understand the requirements, concepts, and approach to the STRS application repository. The STRS application repository is intended to capture knowledge, documents, and other artifacts for each waveform application or other application outside of its project so that when the project ends, the knowledge is retained. The document describes the transmission of technology from mission to mission capturing lessons learned that are used for continuous improvement across projects and supporting NASA Procedural Requirements (NPRs) for performing software engineering projects and NASAs release process.

information retrieval↗

The Challenges of Human-Autonomy Teaming

Machine intelligence is improving rapidly based on advances in big data analytics, deep learning algorithms, networked operations, and continuing exponential growth in computing power (Moores Law). This growth in the power and applicability of increasingly intelligent systems will change the roles humans, shifting them to tasks where adaptive problem solving, reasoning and decision-making is required. This talk will address the challenges involved in engineering autonomous systems that function effectively with humans in aeronautics domains.

artificial intelligence↗

The Challenges of Human-Autonomy Teaming

Machine intelligence is improving rapidly based on advances in big data analytics, deep learning algorithms, networked operations, and continuing exponential growth in computing power (Moores Law). This growth in the power and applicability of increasingly intelligent systems will change the roles humans, shifting them to tasks where adaptive problem solving, reasoning and decision-making is required. This talk will address the challenges involved in engineering autonomous systems that function effectively with humans in aeronautics domains.

Human-Autonomy teaming↗

Medics: Medical Decision Support System for Long-Duration Space Exploration

The Autonomous Medical Operations (AMO) group at NASA Ames is developing a “medical decision support system” to enable astronauts on long-duration exploration missions to operate autonomously. The system will support clinical actions by providing medical interpretation advice and procedural recommendations during emergent care and clinical work performed by crew. The current state of development of the system, called MedICS (Medical Interpretation Classification and Segmentation) includes two separate aspects: a set of machine learning diagnostic models trained to analyze organ images and patient health records, and an interface to ultrasound diagnostic hardware and to medical repositories. Three sets of images of different organs and medical records were utilized for training machine learning models for various analyses, as follows: 1. Pneumothorax condition (collapsed lung). The trained model provides a positive or negative diagnosis of the condition. 2. Carotid artery occlusion. The trained model produces a diagnosis of 5 different occlusion levels (including “normal”). 3. Ocular retinal images. The model extracts optic disc pixels (image segmentation). This is a precursor step for advanced autonomous fundus clinical evaluation algorithms to be implemented in FY20. 4. Medical health records. The model produces a differential diagnosis for any particular individual, based on symptoms and other health and demographic information. A probability is calculated for each of 25 most common conditions. The same model provides the likelihood of survival. All results are provided with a confidence level. Item 1 images were provided by the US Army and were part of a data set for the clinical treatment of injured battlefield soldiers. This condition is relevant to possible space mishaps, due to pressure management issues. Item 2 images were provided by Houston Methodist Hospital, and item 3 health records were acquired from the MIT laboratory of computational physiology. The machine learning technology utilized is deep multilayer networks (Deep Learning), and new models will continue to be produced, as relevant data is made available and specific health needs of astronaut crews are identified. The interfacing aspects of the system include a GUI for running the different models, and retrieving and storing data, as well as support for integration with an augmented reality (AR) system deployed at JSC by Tietronix Software Inc. (HoloLens). The AR system provides guidance for the placement of an ultrasound transducer that captures images to be sent to the MedICS system for diagnosis. The image captured and the associated diagnosis appear in the technician’s AR visual display.

Colombano, Silvano↗

Pendulum Shifts, Context, Error, and Personal Accountability

This paper describes a series of tools that were developed to achieve a balance in under-standing LOWs and the human component of events (including accountability) as the INL continues its shift to a learning culture where people report, are accountable and interested in making a positive difference - and want to report because information is handled correctly and the result benefits both the reporting individual and the organization. We present our model for understanding these interrelationships; the initiatives that were undertaken to improve overall performance.

99 GENERAL AND MISCELLANEOUS↗

Feedback from Reactor Internals Segmentation Projects in Europe - 19141

Westinghouse has accumulated significant know-how in the reactor dismantling activities. The approach to internals segmentation and packaging has been continuously enhanced by incorporating lessons learned and best practices into each successive project. Building on the most recent successful experience at Jose Cabrera in Spain, Westinghouse has won several major awards with 13 reactors currently under contract at Chooz A (France), Barsebaeck 1-2 (Sweden), Bohunice V1 (two units in Slovakia), Neckarwestheim I, Philippsburg 1, and more recently at Unterweser, Grafenrheinfeld, Grohnde, Isar 1, Isar 2, Brokdorf (Germany). The primary challenges of a segmentation and packaging project are to separate the highly activated materials from the less-activated materials and package them into appropriate containers for disposal. The choice of the optimum cutting technology is important for a successful project implementation and depends on some specific constraints like disposal costs, project schedule, available work areas or safety. The selected technology for all recent Westinghouse projects is mechanical cutting with different types of designed cutting equipment (hydraulic shears, band saw, disc saw). All segmentation tools are remotely controlled due to the high radiation levels and ALARA and personal safety is the number one priority during the challenging site work. Training on mock-ups in the Westinghouse facility before going to the site is a very important step in order to optimize all procedures and thereby maximize the efficiency on site in order to finalize the project on time or before. The work covers the segmentation of reactor internals but also, in some cases, some replaced components during plant operation that were stored in the spent fuel pool. The cutting equipment proved to be reliable and flexible which is very valuable for the execution of such a challenging project. The Barsebaeck Unit 2 site work has been finished end of October 2017 and its lessons learned are taken into consideration for future activities. Site work is currently on-going simultaneously at Chooz A, Barsebaeck 1, Neckarwestheim I and Philippsburg 1. This paper will provide an overview of all these on-going segmentation projects and will focus on feedback from the first projects executed on site. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Using Digital and Web-Based Platforms to Enhance Nuclear Power Plant Knowledge Transfer - 20203

As the workforce ages, the loss of experienced personnel can result in a loss of important knowledge. Updating Electric Power Research Institute (EPRI) research and guidance with the latest technology developments and operating experience is an important method to transfer knowledge between the retiring and incoming workforce. Studies suggest that the incoming workforce is accustomed to using digital and/or internet-based platforms to find information and may have a higher comfort with these types of platforms than they have with static, written reports. Additionally, the ease and speed of updating and delivering content through digital formats may offer an effective method for knowledge transfer and combining information from multiple reports into a single access point. EPRI has recently produced an online Decommissioning Hub available to members and is working on replicating the effort in the area of radioactive waste management called the Radwaste Web References. EPRI has extensive guidance in both disciplines. The Decommissioning Hub uses a wiki format to provide a platform that allows for both the updating of that guidance resulting from new research and new operating experiences, and combining related topical information from multiple reports. It also allows users to access the information based on key words and topical searches, and can be a tool for users to input experience to share with others. The Decommissioning Hub is accessed via a web-based portal and includes topical pages; experience summaries; a question and answer capability; and a smart search function of all EPRI decommissioning reports. Use of a wiki format allows users to input new experiences or modify existing experience summaries to add additional detail. EPRI moderates all content. The experience data base has been initially populated with information available in published EPRI reports and unpublished information currently available within EPRI. Moving forward, population of the database will continue with information available within the open literature, new information developed from current decommissioning projects, and user inputs. The web site became active in late 2017, and a major update will be issued in early 2020. Larger scale updates are planned biannually, and smaller-scale updates will occur continuously. Capturing and applying lessons learned from industry experiences is a hallmark of the global nuclear industry. This is even more important in the decommissioning technology area since very few plant staff have relevant experience and thus there is a steep learning curve. Moreover, decommissioning involves a number of complex, non-routine and specialized tasks. The web-accessible and searchable experience database provides an easy-to-use resource for capturing and disseminating practical experiences from completed and ongoing decommissioning projects. The EPRI Radwaste Web References will build upon the philosophy and objectives of the Radwaste Desk References that were published in the 1990's. The purpose of the original Radwaste Desk References was to provide nuclear power plant professionals with a how-to manual for managing radioactive waste. The Radwaste Web References will adopt this original purpose and will be a wiki type web site that provide fundamental practical and theoretical information, operating experience (OE), and information about advanced technologies and methods. As much as practicable, features that allow for interaction between users to share OE, best practices, and benchmarking will be added. Where they exist and are appropriate, the various EPRI Guidelines documents on radwaste topics will be updated and incorporated into the Radwaste Web References. The first Radwaste Web Reference will be on Low Level Waste Characterization and will build upon the EPRI Low Level Waste Characterization Guidelines (EPRI Report TR-107201, 1996) and will be available in 2020. The next Radwaste Web Reference will be on the topic of liquid radioactive waste processing and management, tentatively set for unveiling in 2021. This paper summarizes the EPRI's previous experiences with web-based platforms and future plans in this area. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

LENS: Learning Enabled Network Synthesis

RTRC and UMD have developed novel machine learning based methods under the ARPA-E DIFFERENTIATE program for rapid acceleration of hypothesis generation in complex architecture design spaces involving both discrete choices of component inclusion and interconnection and continuous parametric decisions. The project named Learning Enabled Network Synthesis (LENS) further demonstrated the developed methods on challenging electrical power converter design problems by identifying the most suitable circuit topologies and simultaneously selecting the most appropriate components to achieve optimized design of power converter with improved performances. We demonstrated that LENS could enable exploration of very large design space of circuit topologies and components by addressing the limitations of conventional design process in non-linear, high switching speed, multi-dimensional power converter design and optimization. The key innovation developed in LENS is the seamless integration of statistical learning and logical reasoning techniques and building on the individual strengths of these techniques for rapid hypothesis discovery. The main component of LENS comprises of: 1) Graph Reasoning Engine (GRE) to enforce composition rules that rapidly reject all discrete architectures that are composed incorrectly and generates an adaptive database of feasible designs which can be used by ML modules, 2) Graph Generative Learning module which is a deep neural network based generative model for graph architectures which can enable design space exploration beyond the dataset generated by the GRE, 3) Graph Reduced Order Model (ROM) for graph domains for accelerating computation of output metrics, and 4) Active learning and Rule Discovery module for sample efficient learning and extracting logical rules from the learned ML models which will be integrated in the GRE to enhance the filtering effectiveness. LENS approach can be applied to any design domains where designs can be represented as multi-attribute graphs. The LENS team integrated the various technical innovations listed above into an optimization pipeline and exercised the optimization pipeline on the converter design problem. The LENS project demonstrated that the developed AI/ML technologies can be used to generate novel converter circuits >45x faster than experts on chosen use-cases. This can enable faster design space exploration and identification of new designs which are not considered by experts due to the increasing design space complexity. This has significant potential impact on the public and energy needs of the country. It is currently estimated that 30% of all electrical powers generated passes through power converters. The future estimate is that 80% of all power generated would be passing through converters. LENS fills a critical gap in this space since by accelerating the design process the designers would be able to generate more efficient converters which can lead to significant energy savings for the country.

42 ENGINEERING↗