Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “online training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

A Privacy-Aware Federated Learning Framework for Distributed Energy Resource Analytics in Constrained Environments

To be resilient against extreme weather events, the rural communities in Puerto Rico are leveraging distributed energy resources (DER). However, computing frameworks sup-porting the grid in critical decision-making are still largely centralized. Sensitive consumer data are transmitted over the Internet or cellular networks to a secondary or tertiary node. It guarantees better situational awareness at the cost of a wider attack surface, jeopardizing user privacy, as more DER come online. Cloud, Edge, and Fog computing all require data aggregation at some level. This paper introduces a privacy-aware federated learning framework that leverages the Fog model by pushing analytics all the way to the DER and load assets. These local models train on individual asset data and transmit only learned parameters (such as weights) over secure communications to a global decision-maker. By abstracting personally identifiable consumer data without impacting decision optimality, this framework better aligns with distributed power generation paradigm.

Sundararajan, Aditya↗

Shuttle Case Study Collection Website Development

As a continuation from summer 2012, the Shuttle Case Study Collection has been developed using lessons learned documented by NASA engineers, analysts, and contractors. Decades of information related to processing and launching the Space Shuttle is gathered into a single database to provide educators with an alternative means to teach real-world engineering processes. The goal is to provide additional engineering materials that enhance critical thinking, decision making, and problem solving skills. During this second phase of the project, the Shuttle Case Study Collection website was developed. Extensive HTML coding to link downloadable documents, videos, and images was required, as was training to learn NASA's Content Management System (CMS) for website design. As the final stage of the collection development, the website is designed to allow for distribution of information to the public as well as for case study report submissions from other educators online.

Ransom, Khadijah S.↗

Growing Beyond Earth; Students Exploring Plant Varieties for Future Space Exploration

Future space exploration and long duration space flight will pose an array of challenges to the health and wellbeing of astronauts. Since 2015, Fairchild Tropical Botanic Garden (FTBG), in partnership with NASA's Veggie team, has been testing edible crops for space flight potential through a series of citizen science experiments. FTBG's interest in classroom-based science projects, along with NASA's successful operation of the Veggie system aboard the International Space Station (ISS), led to a NASA-FTBG partnership that gave rise to the Growing Beyond Earth STEM Initiative (GBE). Established in 2015, GBE now involves 131 middle and high school classrooms in South Florida, all conducting simultaneous plant science experiments. The results of those experiments (both numeric and visual) are directly shared with the space food production researchers at KSC. Through this session, we will explore the successful classroom implementation and integration into the curriculum, how the data is being used and the impact of the project on participating researchers, teachers, and students. Participating schools were supplied with specialized LED-lit growth chambers, mimicking the Veggie system on ISS, for growing edible plants under similar physical and environmental constraints. Research protocols were provided by KSC scientists, while edible plant varieties were selected mainly by the botanists at FTBG. In a jointly-led professional development workshop, participating teachers were trained to conduct GBE experiments in their classrooms. Teachers were instructed to not only teach basic botany concepts, but to also demonstrate practical applications of math, physics and chemistry. As experiments were underway, students shared data on plant germination, growth, and health in an online spreadsheet. Results from the students research show a promising selection of new plant candidates for possible further testing. Over a two year period, more than 5000 South Florida students, ages 11 to 18, participated in GBE. Evaluation of the program shows an increased knowledge of and interest in science and science careers among students. The program has also boosted the demand for summer high school internships at FTBG, further developing expertise in plant research and science related to space exploration. Supported by a grant from NASA (NNX16AM32G) to Fairchild Tropical Botanic Garden.

Veggie↗

Maximizing Spaceflight Biological Data with Omics Analytics: The NASA GeneLab Database

NASA’s GeneLab includes an open-access repository of some 250+ omics datasets generated by biological experiments relevant to spaceflight including simulated cosmic radiation and microgravity. In order to maximize the intelligibility of these data, particularly for users with limited bioinformatics background, GeneLab has become a knowledgebase platform converting raw genetic and proteomic signatures found in flight samples into biological and physiological meanings. A large community of more than 100 scientists has rallied behind GeneLab and organized into four Analysis Working Groups (AWGs: Animal, Plant, Microbe, and Multi-Omics). Together, the AWGs have gained scientific recognition worldwide by establishing a consortium in charge of adopting new complex standards for data analysis workflows and omics sample processing in a rapidly evolving field. We will demonstrate the usage of the repository with smart search capability, an online controlled-access toolshed "Galaxy" to process user data with vetted standard workflows, a workspace for data sharing and a data submission portal with ontology control for better metadata curation. The GeneLab visualization portal will also be demonstrated, showing how anyone without formal training in bioinformatics can now browse the space biology omics data to discover new biology and potential solutions to improve life in space.

Sylvain Vincent Costes↗

GeneLab: The NASA System Biology Platform for Space Omics Repository, Analysis and Visualization

NASA’s GeneLab includes an open-access repository of some 250+ omics datasets generated by biological experiments relevant to spaceflight including simulated cosmic radiation and microgravity. In order to maximize the intelligibility of these data, particularly for users with limited bioinformatics background, GeneLab has become a knowledgebase platform converting raw genetic and proteomic signatures found in flight samples into biological and physiological meanings. A large community of more than 100 scientists has rallied behind GeneLab and organized into four Analysis Working Groups (AWGs: Animal, Plant, Microbe, and Multi-Omics). Together, the AWGs have gained scientific recognition worldwide by establishing a consortium in charge of adopting new complex standards for data analysis workflows and omics sample processing in a rapidly evolving field. We will demonstrate the usage of the repository with smart search capability, an online controlled-access toolshed "Galaxy" to process user data with vetted standard workflows, a workspace for data sharing and a data submission portal with ontology control for better metadata curation. The GeneLab visualization portal will also be demonstrated, showing how anyone without formal training in bioinformatics can now browse the space biology omics data to discover new biology and potential solutions to improve life in space.

GeneLab↗

Model fusion with physics-guided machine learning: Projection-based reduced-order modeling

The unprecedented amount of data generated from experiments, field observations, and large-scale numerical simulations at a wide range of spatiotemporal scales has enabled the rapid advancement of data-driven and especially deep learning models in the field of fluid mechanics. Although these methods are proven successful for many applications, there is a grand challenge of improving their generalizability. This is particularly essential when data-driven models are employed within outer-loop applications like optimization. In this work, we put forth a physics-guided machine learning (PGML) framework that leverages the interpretable physics-based model with a deep learning model. Leveraging a concatenated neural network design from multi-modal data sources, the PGML framework is capable of enhancing the generalizability of data-driven models and effectively protects against or inform about the inaccurate predictions resulting from extrapolation. We apply the PGML framework as a novel model fusion approach combining the physics-based Galerkin projection model and long- to short-term memory (LSTM) network for parametric model order reduction of fluid flows. We demonstrate the improved generalizability of the PGML framework against a purely data-driven approach through the injection of physics features into intermediate LSTM layers. Our quantitative analysis shows that the overall model uncertainty can be reduced through the PGML approach, especially for test data coming from a distribution different than the training data. Moreover, we demonstrate that our approach can be used as an inverse diagnostic tool providing a confidence score associated with models and observations. The proposed framework also allows for multi-fidelity computing by making use of low-fidelity models in the online deployment of quantified data-driven models.

42 ENGINEERING↗

Central Asia Seismic Hazard Assessment (CASHA): A Probabilistic Seismic Hazard Assessment for Kazakhstan, Kyrgyzstan and Tajikistan

Probabilistic seismic hazard assessments (PSHA) underpin the calculation of earthquake loads in most building codes around the world. In Central Asia, the building codes are slowly being updated to incorporate some of the contemporary concepts of seismic hazard representation. There is also a regional desire to coordinate hazard assessments and building code modernization. However, some challenges remain. Expertise in the region related to seismic hazard assessments is still largely compartmentalised, requiring a significant amount of training and capacity building in seismic hazard assessment related topics. In addition, there are vast amounts of seismic data (bulletin and waveforms), both from analogue and digital eras, that the region’s countries stored but until recently did not use or share among themselves or with the broader seismological community around the world. Finally, after the collapse of the Soviet Union in the 1990s, many of the countries’ seismic networks suffered a major setback with the lack of attention and budget to update existing equipment and installation of new instruments. In order to address these issues, the United States Department of Energy through Lawrence Livermore National Laboratory (LLNL) initiated a project in 2016 to engage and train local scientists in Central Asia to install new equipment, to enhance the quality of seismic monitoring and reporting, to improve and harmonise the regional earthquake catalogue, and to conduct national probabilistic seismic hazard assessments using the new and improved datasets. To achieve the seismic hazard assessment related goals, a series of workshops were held in Almaty, Kazakhstan; Bishkek, Kyrgyzstan; and Dushanbe, Tajikistan from 2016 until 2020. During the time that the COVID-19 pandemic restricted travel, workshops continued online (22 online workshops were hosted in two years). Finally, in May 2022, an in-person workshop in Istanbul, Turkey brought together all project participants along with civil engineers engaged with building code activities in their respective countries, providing a platform to discuss the implementation of the hazard models into updates of building codes in each country, as well as to discuss model parameters, sensitivity analyses and model results in terms of hazard maps, uniform hazard spectra and hazard deaggregations. The workshops were a combination of lectures and hands-on exercises, and included international participation as well as local scientists and engineers. The workshops served several purposes, including training, coordination of data collection, interactions between local earth scientists and engineers, and brainstorming and knowledge exchange among local and international experts. This report outlines the new earthquake catalogue compilation effort and the PSHA project undertaken in Kyrgyzstan, Tajikistan, and Kazakhstan as part of this initiative. The southern part of this region is tectonically active with moderate to high levels of both shallow crustal seismic activity and occurrence of deeper earthquakes under the Hindu Kush and Pamir mountain ranges. Deeper earthquakes also occur near southwestern Kazakhstan, under the eastern Greater Caucasus and Caspian Sea. Large portions of central and northern Kazakhstan, on the other hand, are in stable continental regions with low levels of seismic activity. This study systematically compiles and improves all available data on local seismicity, active faults, and ground motion attenuation characteristics of the region; and builds a framework to enable a contemporary PSHA to be carried out with the engagement of local scientists. While the project was regional, the seismic hazard assessments are primarily driven by the countries’ own national preferences and understanding of data collection, interpretation, and validation of results.

58 GEOSCIENCES↗

Curriculum-based Reinforcement Learning for Distribution System Critical Load Restoration

This paper focuses on the critical load restoration problem in distribution systems following major outages. To provide fast online response and optimal sequential decision-making support, a reinforcement learning (RL) based approach is proposed to optimize the restoration. Due to the complexities stemming from the large policy search space, renewable uncertainty, and nonlinearity in a complex grid control problem, directly applying RL algorithms to train a satisfactory policy requires extensive tuning to be successful. To address this challenge, this paper leverages the curriculum learning (CL) technique to design a training curriculum involving a simpler steppingstone problem that guides the RL agent to learn to solve the original hard problem in a progressive and more effective manner. We demonstrate that compared with direct learning, CL facilitates controller training to achieve better performance. To study realistic scenarios where renewable forecasts used for decision-making are in general imperfect, the experiments compare the trained RL controllers against two model predictive controllers (MPCs) using renewable forecasts with different error levels and observe how these controllers can hedge against the uncertainty. Results show that RL controllers are less susceptible to forecast errors than the baseline MPCs and can provide a more reliable restoration process.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Reduced-order modeling for efficient cross section library development in high-temperature gas reactor pebble-bed depletion analysis

Accurate modeling of running-in and equilibrium conditions in pebble-bed reactors (PBRs) requires precise microscopic multigroup neutron cross sections. In Griffin, deterministic neutronics calculations rely on multivariate interpolation over large cross section libraries, resulting in significant memory usage and performance bottlenecks. This work, together with a companion paper on Griffin integration, explores reduced-order models (ROMs) to replace interpolation with lightweight surrogates. Several ROM techniques are benchmarked, with deep neural networks (DNNs) demonstrating superior memory efficiency, scalability, and predictive accuracy. A total of 295 DNNs were trained to build a comprehensive isotope library, integrated into Griffin through a custom LibTorch interface for depletion analysis. Initial results demonstrate that DNN-based ROMs drastically reduce memory demands while preserving accuracy, enabling finer tabulations and additional state variables without overhead. In conclusion, the framework also supports online cross section generation and real-time DNN updates through transfer learning, improving fidelity by capturing self-shielding and evolving nuclide compositions during burnup.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Selection of Sampling and Surrogate Modeling Methods for State-Point Evaluations of an AGN-201M Reactor

Nuclear reactor digital twins (DTs) have been proposed for use as a safeguards technology to efficiently monitor new and novel reactors as they come online. A safeguards DT needs to be capable of detecting misuse and diversion as they occur, requiring physics models to be accurate and efficient. Mathematical surrogate models are capable of achieving the necessary efficiency and can largely maintain the accuracy of higher-order models given a quality training sample. The Multiphysics Object-Oriented Simulation Environment (MOOSE) code framework is specifically equipped to generate training samples and create surrogate models using full-order reactor physics models. Utilizing an operational AGN-201M reactor’s specifications, two surrogate types were trained on samples of variable size, and using Cartesian products, Latin hypercube sampling, and quadrature sampling, each was compared and evaluated on accuracy when compared to a full-order Monte Carlo model. Both surrogate types were able to capture reactivity changes within 0.05 $ of the Monte Carlo model while reducing the computation costs by eight orders of magnitude.

MOOSE↗

Heliostat Consortium: Update on Resource, Training, and Education Development and Women+ in Concentrating Solar

One of the major barriers to Concentrating Solar Power (CSP) industry growth in the U.S. is the lack of accessibility of expert knowledge, a lack of a stable workforce pipeline, and little public awareness of the technology area. Improved Resource, Training, and Education (RTE) is needed to address these gaps, to draw workers into the field from diverse technology areas and backgrounds, and to reduce the learning curves of newcomers into the industry. As part of the RTE topic under the NREL-led Heliostat Consortium (HelioCon), a public online resource database has been created to support information sharing across the heliostat and CSP community. Here, information will be presented on the existing and planned database resources, including introductory information about CSP and heliostats, a reference library of texts and publications, educational videos, a CSP power tower plant database and case studies, a contact list of component suppliers and developers, and a list of available software/metrology tools. Women+ in Concentrating Solar is a newly created organization to promote the education, professional development, and advancement of underrepresented genders in the Concentrating Solar Power (CSP) community in a way that includes diverse backgrounds, attitudes, and perspectives. The main objectives of the groups are to provide the following opportunities for underrepresented genders: 1) organize events to provide networking opportunities and community building, 2) boost partnerships and scientific collaboration, 3) create resources to facilitate knowledge and experience sharing, 4) provide mentorship programs to support those new to the industry, 5) bring visibility to underrepresented genders and attract more to the field, and 6) promote Diversity, Equity, and Inclusion (DEI) and engage minorities and underrepresented groups. Initial activities being pursued by the group include creating an expert database to support event organizers in recruiting speakers with representation of all gender identities, hosting online networking and webinar events, organizing conference events including seminars and networking/social events, and establishing a mentorship program to connect members in the CSP community across the globe. The group is open to all genders and has grown to over 60 members in its first few months.

concentrating solar↗

WinnowML: Stable feature selection for maximizing prediction accuracy of time-based system modeling

Online deep learning (ODL) has become an important methodology for modeling time-based performance of computer systems. An open problem is the intelligent selection of features from raw workload traces of computer systems. The best methods are overly sensitive to noisy data, causing frequent feature changes and re-training. Using all available features inflates training time and introduces model artifacts if some features should have been dropped. We present WinnowML, a method for automatically determining the most relevant feature subset for a predictive time-series model. WinnowML combines existing feature ranking algorithms and a history of each feature's ranking to iteratively rank a feature set to lower prediction error and maximize long term relevance. From this ranked feature set, the most relevant and stable subset is selected to train a model. Experimentally, we show how WinnowML can lower a model's mean absolute relative error up to 42% on average compared to the closest performing approach. Additionally, we lower the fluctuation in feature ranking and selection up to 65%. We also demonstrate how to combine WinnowML and a model search tool to provide improvements in performance of up to 14.5% when compared to using all the feature available.

Bel, Oceane MS↗

Semi-Supervised Eigenbasis Novelty Detection

Recent discoveries in high-time-resolution radio astronomy data have focused attention on a new class of events. Fast transients are rare pulses of radio frequency energy lasting from microseconds to seconds that might be produced by a variety of exotic astrophysical phenomena. For example, X-ray bursts, neutron stars, and active galactic nuclei are all possible sources of short-duration, transient radio signals. It is difficult to anticipate where such signals might appear, and they are most commonly discovered through analysis of high-time- resolution data that had been collected for other purposes. Transients are often faint and difficult to detect, so improved detection algorithms can directly benefit the science yield of all such commensal monitoring. A new detection algorithm learns a low-dimensional linear manifold for describing the normal data. High reconstruction error indicates a novel signal that does not match the patterns of normal data. One unsupervised portion of the manifold model adapts its representation in response to recent data. A second supervised portion of the model is made of a basis trained in advance using labeled examples of RFI; this prevents false positives due to these events. For a linear model, an orthonormalization operation is used to combine these bases prior to the anomaly detection decision. Another novel aspect of the approach lies in combining basis vectors learned in an unsupervised, online fashion from the data stream with supervised basis vectors learned in advance from known examples of false alarms. Adaptive, data-driven detection is achieved that is also informed by existing domain knowledge about signals that may be statistically anomalous, but are not interesting and should therefore be ignored. The method was evaluated using data from the Parkes Multibeam Survey. This data set was originally collected to search for pulsars, which are astronomical sources that emit radio pulses at regular periods. However, several non-pulsar anomalies have recently been discovered in this dataset, making it a compelling test case. By explicitly filtering known false alarm patterns, the approach yields significantly better performance than current transient detection methods.

Wagstaff, Kiri L.↗

Spectroscopic Online Monitoring: Using a Multi-Track Visible Spectrometer to Facilitate a Mass Balance Study in a Simulated TALSPEAK Process

Nuclear energy is a promising low-carbon energy candidate to meet the increased demand for green energy, where the integration of fuel recycling can have significant benefits for material usage and waste reduction. Utilizing in situ monitoring tools can provide ample opportunities to better control and safeguard nuclear material recycle processes while also offering knowledge and insight into real-time solution properties. The simultaneous measurement of analytical targets in multiple process locations can enable real-time mass balance and material accountancy calculations. This is demonstrated here with a mass balance study of Nd 3+ on countercurrent aqueous/organic metal extraction within a single centrifugal contactor. The Nd 3+ concentration was simultaneously monitored at the inlets and outlets of both aqueous and organic phases using a visible absorbance detector that allowed for the simultaneous measurement of up to six locations. The Nd 3+ concentration was calculated by using chemical data science algorithms, where model training sets were collected on a single track of the detector. The discussion includes addressing the challenges of using a model collected on a single track and applying it as a model across the other tracks on the detector. Each track of the detector corresponds to one measurement location on the contactor. The difference in the integrated moles of Nd 3+ between the inlet and outlet at the end of the experiment was near zero, indicating that the mass balance of this experiment was maintained. Overall, the online spectroscopic monitoring was able to follow changing solution conditions and accurately measure the concentration of Nd 3+ in different locations within the contactor system.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Learning-Accelerated ADMM for Distributed DC Optimal Power Flow

We suggest a novel data-driven method to accelerate the convergence of Alternating Direction Method of Multipliers (ADMM) for solving distributed DC optimal power flow (DC-OPF) where lines are shared between independent network partitions. Using previous observations of ADMM trajectories for a given system under varying load, the method trains a recurrent neural network (RNN) to predict the converged values of dual and consensus variables. Given a new realization of system load, a small number of initial ADMM iterations is taken as input to infer the converged values and directly inject them into the iteration. We empirically demonstrate that the online injection of these values into the ADMM iteration accelerates convergence by a significant factor for partitioned 14-, 118-and 2848-bus test systems under differing load scenarios. The proposed method has several advantages: it maintains the security of private decision variables inherent in consensus ADMM; inference is fast and so may be used in online settings; RNN-generated predictions can dramatically improve time to convergence but, by construction, can never result in infeasible ADMM subproblems; it can be easily integrated into existing software implementations. While we focus on the ADMM formulation of distributed DC-OPF in this paper, the ideas presented are naturally extended to other distributed optimization problems.

24 POWER TRANSMISSION AND DISTRIBUTION↗

IMS Rapid Response 2024 Summary Report: A Machine Learning Potential for the Periodic Table

Stockpile stewardship and nuclear waste remediation are inherently chemically complex, involving practically the full diversity of the periodic table, but existing methods are too expensive or not functional for a large diversity of atom types. Overall, the field of machine learning interatomic potentials (MLIPs) has advanced dramatically in 2024 with large high-accuracy datasets existing for bulk, surface, and organic chemical systems and new online leaderboards for diverse chemistry. To participate in, and bring LANL interests into this ecosystem, here, we have built upon existing technologies created by LANL to create a framework capable of creating machine learning interatomic potentials (MLIPs) for over 90 atom types. Our results have created a massively diverse coordination complex training dataset more than 3 times the size of existing datasets, parallelized MLIP training over multiple GPUs, enabling the training of an MLIP spanning the periodic table at 20 times the speed of prior training on 32 GPUs. These advances are substantial towards creation on foundational MLIPs for LANL-specific application areas.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Learning-Accelerated ADMM for Distributed DC Optimal Power Flow

We propose a novel data-driven method to accelerate the convergence of Alternating Direction Method of Multipliers (ADMM) for solving distributed DC optimal power flow (DC-OPF) where lines are shared between independent network partitions. Using previous observations of ADMM trajectories for a given system under varying load, the method trains a recurrent neural network (RNN) to predict the converged values of dual and consensus variables. Given a new realization of system load, a small number of initial ADMM iterations is taken as input to infer the converged values and directly inject them into the iteration. We empirically demonstrate that the online injection of these values into the ADMM iteration accelerates convergence by a significant factor for partitioned 14-, 118- and 2848-bus test systems under differing load scenarios. The proposed method has several advantages: it maintains the security of private decision variables inherent in consensus ADMM; inference is fast and so may be used in online settings; RNN-generated predictions can dramatically improve time to convergence but, by construction, can never result in infeasible ADMM subproblems; it can be easily integrated into existing software implementations. While we focus on the ADMM formulation of distributed DC-OPF in this paper, the ideas presented are naturally extended to other distributed optimization problems.

alternating direction method of multipliers↗

Deep-Learning-Based Koopman Modeling for Online Control Synthesis of Nonlinear Power System Transient Dynamics

Power system stability and control have become more challenging due to the increasing uncertainty associated with renewable generation. Here, the performance of conventional control is highly driven by the physics-based offline-developed dynamic models that can deviate from the actual system characteristics under different operating conditions and/or configurations. Data-driven approaches based on online measurements can be a better solution to addressing these issues by capturing real-time operation conditions. This article describes a novel fully data-driven probabilistic framework to derive a linear representation of postcontingency grid dynamics and online prescribe control based on the derived model to enhance transient stability. The complex nonlinear power system dynamics is approximated by a linear model by using multiple neural network modules that infer distributions of the observations and introducing a Koopman layer to sample possible Koopman linear models from the inferred distributions. The trained model features linearity that can be easily incorporated into the existing linear control design paradigm and ease the controller design process. The effectiveness of Koopman-based control designs is validated through comparative case studies, which demonstrate increased prediction accuracy and control performance when applied to a power system with heterogeneous generator dynamics.

24 POWER TRANSMISSION AND DISTRIBUTION↗