Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Continual learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49

Evaluation of Extreme Weather Impacts on Utility-scale Photovoltaic Plant Performance in the United States

The global energy system is undergoing significant changes, including a shift in energy generating technologies to more renewable energy sources. However, the dependence of renewable energy sources on local environmental conditions could also increase disruptions in service through exposures to compound, extreme weather events. By fusing three diverse datasets (operations and maintenance tickets, weather data, and production data), this analysis presents a novel methodology to identify and evaluate performance impacts arising from extreme weather events across diverse geographical regions. Text analysis of maintenance tickets identified snow, hurricanes, and storms as the leading extreme weather events affecting photovoltaic plants in the United States. Statistical techniques and machine learning were then implemented to identify the magnitude and variability of these extreme weather impacts on site performance. Impacts varied between event and non-event days, with snow events causing the greatest reductions in performance (54.5%), followed by hurricanes (12.6%) and storms (1.1%). Machine learning analysis identified key features in determining if a day is categorized as low performing, such as low irradiance, geographic location, weather features, and site size. The analysis improves our understanding of compound, extreme weather event impacts on photovoltaic systems, which can inform planning activities, especially as the industry continues to expand into new geographic and climatic regions around the world.

14 SOLAR ENERGY↗

Predictive Data Analytics Framework Using Advanced Test Reactor Acoustic Data

Although a nuclear reactor is a hostile environment for sensing and electrical communications, the reactor core is amenable to acoustic communication. An acoustic measurement infrastructure (AMI) has been installed at the Advanced Test Reactor (ATR) nozzle trench area to record acoustic signals that has the ability to capture different operating regime of the reactor. This AMI includes ATR in-pile structural components, coolant, acoustic receivers, primary coolant pumps (PCP) as signal sources, a data acquisition system, and signal-processing algorithms, enabling real-time. This report will discusses development of recursive Fast Fourier Transform approach to process in real-time acoustic signals, application of short time Fast Fourier Transform to the ATR brush data to understand the vibration level and to develop spectrograms for different primary coolant pump combinations. The combination of primary coolant pumps for normal and power axial locator mechanism of ATR are different and generates different signatures. These acoustic signatures were used to develop machine learning approaches to automatically classify different operating regimes. This lay the foundation for predictive analytic framework that can be leverage by ATR to optimize their operation and maintenance. The path forward involves continued engagement with ATR and expanded implementation of AMI and predictive framework at ATR and other facilities within INL and at other experimental reactors.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Operating advanced scientific instruments with AI agents that learn on the job

Advanced scientific user facilities, such as next generation X-ray light sources and self-driving laboratories, are revolutionizing scientific discovery by automating routine tasks and enabling rapid experimentation and characterizations. However, these facilities must continuously evolve to support new experimental workflows, adapt to diverse user projects, and meet growing demands for more intricate instruments and experiments. This continuous development introduces significant operational complexity, necessitating a focus on usability, reproducibility, and intuitive human-instrument interaction. In this work, we explore the integration of agentic AI, powered by Large Language Models (LLMs), as a transformative tool to achieve this goal. We present our approach to developing a human-in-the-loop pipeline for operating advanced instruments including an X-ray nanoprobe beamline and an autonomous robotic station dedicated to the design and characterization of materials. Specifically, we evaluate the potential of various LLMs as trainable scientific assistants for orchestrating complex, multi-task workflows, which also include multimodal data, optimizing their performance through optional human input and iterative learning. We demonstrate the ability of AI agents to bridge the gap between advanced automation and user-friendly operation, paving the way for more adaptable and intelligent scientific facilities.

Large Language Models↗

The Evolution of Medical Countermeasures for Ebola Virus Disease: Lessons Learned and Next Steps

The Ebola virus disease outbreak that occurred in Western Africa from 2013–2016, and subsequent smaller but increasingly frequent outbreaks of Ebola virus disease in recent years, spurred an unprecedented effort to develop and deploy effective vaccines, therapeutics, and diagnostics. This effort led to the U.S. regulatory approval of a diagnostic test, two vaccines, and two therapeutics for Ebola virus disease indications. Moreover, the establishment of fieldable diagnostic tests improved the speed with which patients can be diagnosed and public health resources mobilized. The United States government has played and continues to play a key role in funding and coordinating these medical countermeasure efforts. Here, we describe the coordinated U.S. government response to develop medical countermeasures for Ebola virus disease and we identify lessons learned that may improve future efforts to develop and deploy effective countermeasures against other filoviruses, such as Sudan virus and Marburg virus.

59 BASIC BIOLOGICAL SCIENCES↗

LCLS-II Cryomodules Production Experience and Lessons Learned Towards LCLS-II-HE Project

LCLS-II is an upgrade project for the linear coherent light source (LCLS) at SLAC. The LCLS-II linac consists of thirty-five 1.3 GHz and two 3.9 GHz superconducting RF (SRF) continuous wave (CW) cryomodules with high quality factor cavities. Cryomodules were produced at Fermilab and at Jefferson Lab in collaboration with SLAC. Fermilab successfully completed the assembly, testing and delivery of seventeen 1.3 GHz and three 3.9 GHz cryomodules. LCLS-II-HE is a planned upgrade project to LCLS-II. The LCLS-II-HE linac will consist of twenty-three 1.3 GHz cryomodules with high gradient and high quality factor cavities. This paper presents LCLS-II-HE cryomodule production plans, emphasizing the improvements done based on the challenges, mitigations, and lessons learned from LCLS-II.

43 PARTICLE ACCELERATORS↗

Learning stochastic dynamics and predicting emergent behavior using transformers

We show that a neural network originally designed for language processing can learn the dynamical rules of a stochastic system by observation of a single dynamical trajectory of the system, and can accurately predict its emergent behavior under conditions not observed during training. We consider a lattice model of active matter undergoing continuous-time Monte Carlo dynamics, simulated at a density at which its steady state comprises small, dispersed clusters. We train a neural network called a transformer on a single trajectory of the model. The transformer, which we show has the capacity to represent dynamical rules that are numerous and nonlocal, learns that the dynamics of this model consists of a small number of processes. Forward-propagated trajectories of the trained transformer, at densities not encountered during training, exhibit motility-induced phase separation and so predict the existence of a nonequilibrium phase transition. Transformers have the flexibility to learn dynamical rules from observation without explicit enumeration of rates or coarse-graining of configuration space, and so the procedure used here can be applied to a wide range of physical systems, including those with large and complex dynamical generators.

97 MATHEMATICS AND COMPUTING↗

Use Machine Learning to Improve Burnup Measurement in Pebble Bed Reactors

Advanced pebble bed reactor (PBR) designs post new challenges in material control and accountancy (MC&A) because the fuel materials, distributed in many discrete pebbles, are continuously circulated through the reactor core and the refueling path compared to the bulk fuel assembly design in conventional reactors, e.g., light water reactors. In pebble bed reactors, there are hundreds of thousands of fuel pebbles in the reactor core during the normal operation, and the burnup of each pebble is measured when ejected from the core. Accurate burnup measurement is an important step in material control and spent fuel disposition. The measurement is usually based on detection of radiation signatures of fission products accumulated in the pebble fuel over irradiation in the core. Previous research has shown that height of photopeaks of fission products, such as 134 Cs, 137 Cs, 154 Eu, etc., can be used independently or in combination to infer or predict the level of burnup in the fuel. However, it remains challenging to measure such complex sources due to self-shielding effects, strong radiation background and intervening materials. Another operational challenge is the required high throughput of pebbles undergoing burnup measurement, which necessitates limited measurement time and thus impacts quality of measured gamma-ray spectra. Hence, advanced spectral analysis methods are needed to analyze the noisy gamma spectra and predict the burnup values.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Melting curves of ice polymorphs in the vicinity of the liquid–liquid critical point

The possible existence of a liquid–liquid critical point in deeply supercooled water has been a subject of debate due to the challenges associated with providing definitive experimental evidence. The pioneering work by Mishima and Stanley [Nature 392, 164–168 (1998)] sought to shed light on this problem by studying the melting curves of different ice polymorphs and their metastable continuation in the vicinity of the expected liquid–liquid transition and its associated critical point. Based on the continuous or discontinuous changes in the slope of the melting curves, Mishima [Phys. Rev. Lett. 85, 334 (2000)] suggested that the liquid–liquid critical point lies between the melting curves of ice III and ice V. Herein we explore this conjecture using molecular dynamics simulations with a machine learning model based on ab initio quantum-mechanical calculations. We study the melting curves of ices III, IV, V, VI, and XIII and find that all of them are supercritical and do not intersect the liquid–liquid transition locus. We also find a pronounced, yet continuous, change in the slope of the melting lines upon crossing of the liquid locus of maximum compressibility. Finally, we analyze the literature in light of our findings and conclude that the scenario in which the melting curves are supercritical is favored by the most recent computational and experimental evidence. Although the preponderance of evidence is consistent with the existence of a second critical point in water, the behavior of ice polymorph melting lines does not provide strong evidence in support of this viewpoint, according to our calculations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A robust estimator of mutual information for deep learning interpretability

Abstract We develop the use of mutual information (MI), a well-established metric in information theory, to interpret the inner workings of deep learning (DL) models. To accurately estimate MI from a finite number of samples, we present GMM-MI (pronounced ‘Jimmie’), an algorithm based on Gaussian mixture models that can be applied to both discrete and continuous settings. GMM-MI is computationally efficient, robust to the choice of hyperparameters and provides the uncertainty on the MI estimate due to the finite sample size. We extensively validate GMM-MI on toy data for which the ground truth MI is known, comparing its performance against established MI estimators. We then demonstrate the use of our MI estimator in the context of representation learning, working with synthetic data and physical datasets describing highly non-linear processes. We train DL models to encode high-dimensional data within a meaningful compressed (latent) representation, and use GMM-MI to quantify both the level of disentanglement between the latent variables, and their association with relevant physical quantities, thus unlocking the interpretability of the latent representation. We make GMM-MI publicly available in this GitHub repository.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Machine Learning-Based Technique for Automated Sensor Characterization

The development of novel instrumentation requires an iterative cycle with three stages: design, prototyping, and testing. Recent advancements in simulation and nanofabrication techniques have significantly accelerated the design and prototyping phases. Nonetheless, detector characterization continues to be a major bottleneck in device development. During the testing phase, a significant time investment is required to characterize the device in different operating conditions and find optimal operating parameters. The total effort spent on characterization and parameter optimization can occupy a year or more of an expert s time. In this work, we present a novel technique for automated sensor calibration that aims to accelerate the testing stage of the development cycle. This technique leverages closed-loop Bayesian optimization (BO), using real-time measurements to guide parameter selection and identify optimal operating states. We demonstrate the method with a novel low-noise CCD, showing that the machine learning-driven tool can efficiently characterize and optimize operation of the sensor in a couple of days without supervision of a device expert.

Zepeda, Cuevas [Chicago U., KICP]↗

Development of Ultrasonic and Fabry-Perot Interferometer for Non-Destruction Inspection of Aging Aircraft

Fabry-Perot Interferometer (FPI) sensor detection system was continued and refined modifications were made in the data acquisition and evaluation process during the last year. The ultrasonic and FPI detection system was improved from one to multiple sensor detectors. Physical models were developed to understand the physical phenomenon of this work. Multilayered flawed samples were fabricated for inspection by a prototype ultrasonic and FPI detection. Experimental data was verified with simulated results. Undergraduate students that were associated with this research gained valuable knowledge from this experience. This was a learning process helping students to understand the importance of research and its application to solve important technological problems. As a result of our students exposure to this research two and planning to continue this type of research work in graduate school. A prototype instrument package was laboratory tested an actual airframe structure for documentation purposes.

Smith, Alphonso C.↗

A machine learning approach for clinker quality prediction and nonlinear model predictive control design for a rotary cement kiln

Abstract Cement manufacturing is energy‐intensive (5Gj/t) and comprises a significant portion of the energy footprint of concrete systems. Incorporating modern monitoring, simulation and control systems will allow lower energy use, lower environmental impact, and lower costs of this widely used construction material. One of the goals of the CESMII roadmap project on the Smart Manufacturing of Cement included developing an analytical process model for clinker quality that includes the chemistry of the kiln feed and accounts for critical process variables. This predictive model will be used in nonlinear model predictive control system designed to significantly reduce process energy use while maintaining or improving product quality. In the cement manufacturing plant used in this study, the kiln feed (meal) is tested every 12 h and used to estimate the mineral composition of the cement kiln output (clinker) using the stoichiometry‐based Bogue's model and the expertise of the plant operators. During kiln operation, kiln output (clinker) is sampled and tested every 2 h to measure its chemical and mineral composition. The predicted and measured values of the clinker composition are used by the plant operators to adjust the kiln input stream and the production process characteristics to maintain stable operation and uniform product quality. However, the time delay between prediction and testing, along with inaccuracies inherent in the Bogue's model have made any process changes designed to minimize energy use problematic, especially in‐light of potential clinker quality issues that process changes often pose. A new analytical model that integrates quality information and process operation information has been developed from data collected from 2 years of production from an operating cement facility. To make the model fuel‐type‐independent, consumed heat energy was computed in the model instead of fuel type and amount. A Feedforward Network was trained and tailored from collected data. Many data‐based simulations were conducted to quantitatively evaluate the proposed model and the 5‐fold cross‐validation procedure was used to test the models. The resulting predictive model was shown to have a low root mean square error (MSE) with respect to the estimated clinker mineral composition compared to that using the industry standard “Bogue’ model”. The end goal of this work was to develop a single machine learning tool that allows the use of quality control data and process control variables to improve energy efficiency of the process in a continuous fashion. The proposed nonlinear model predictive control system (NMPC) can generate predicted kiln production characteristics based on manipulated variables in manner that accurately follows the target product quality values. Simulation results also show that the proposed model produced accurate predictions of kiln outputs that fell within the required constraints, while manipulating control variables within typical operational ranges.

Ali, Asem M.↗

HP-LSP: A reference of land surface phenology from fused Harmonized Landsat and Sentinel-2 with PhenoCam data

Abstract Land surface phenology (LSP) products are currently of large uncertainties due to cloud contaminations and other impacts in temporal satellite observations and they have been poorly validated because of the lack of spatially comparable ground measurements. This study provided a reference dataset of gap-free time series and phenological dates by fusing the Harmonized Landsat 8 and Sentinel-2 (HLS) observations with near-surface PhenoCam time series for 78 regions of 10 × 10 km 2 across ecosystems in North America during 2019 and 2020. The HLS-PhenoCam LSP (HP-LSP) reference dataset at 30 m pixels is composed of: (1) 3-day synthetic gap-free EVI2 (two-band Enhanced Vegetation Index) time series that are physically meaningful to monitor the vegetation development across heterogeneous levels, train models (e.g., machine learning) for land surface mapping, and extract phenometrics from various methods; and (2) four key phenological dates (accuracy ≤5 days) that are spatially continuous and scalable, which are applicable to validate various satellite-based phenology products (e.g., global MODIS/VIIRS LSP), develop phenological models, and analyze climate impacts on terrestrial ecosystems.

Science & Technology - Other Topics↗

Optimal Coordination of Distributed Energy Resources Using Deep Deterministic Policy Gradient

Recent studies showed that reinforcement learning (RL) is a promising approach for coordination and control of distributed energy resources (DER) under uncertainties. Many existing RL approaches, including Q-learning and approximate dynamic programming, are based on lookup table methods, which become inefficient when the problem size is large and infeasible when continuous states and actions are involved. In addition, when modeling battery energy storage system (BESS), the loss of life is not reasonably considered into the decision-making process. This paper proposes an innovative deep RL method for DER coordination considering BESS degradation. The proposed deep RL is designed based on an adaptive actor-critic architecture and employs an off-policy deterministic policy gradient method for determining the dispatch operation that minimizes the operation cost and BESS life loss. Case studies were performed to validate the proposed method and demonstrate the effects of incorporating degradation models into control design.

Das, Avijit↗

Lessons Learned from Bacterial Transport Experiments at the South Oyster Site

This paper provides a high-level review of bacterial transport experiments conducted by a multi-investigator, multi-institution, multi-disciplinary team of researchers under the auspices of the U. S. Department of Energy. The experiments considered were conducted during the time period 1999-2001 at a field site near the town of Oyster, Virginia known as the South Oyster Site, and included four major experimental campaigns aimed at understanding and quantifying bacterial transport in the subsurface environment. Several key elements of the research are discussed here: 1) Quantification of bacterial transport in physically and biogeochemically heterogeneous aquifers, 2) evaluation of the efficacy of conventional colloid filtration theory, 3) scale effects in bacterial transport, 4) development of new methods for microbial enumeration and screening for low adhesion strains, 5) application of novel hydrogeophysical techniques for aquifer characterization, and 6) experiences regarding management of a large field research effort.

54 ENVIRONMENTAL SCIENCES↗

COVID-19-Related Experiences and Perspectives of Peruvian College Students: A Descriptive Study

The COVID-19 pandemic drastically affected higher education and higher education students around the world, but few studies of college students’ experiences during the COVID-19 pandemic have been conducted in Latin America. This study describes the COVID-19-related experiences and perspectives of Peruvian college students. We surveyed 3,427 full-time college students (average age: 23 years) attending a multi-campus Peruvian university in fall 2020. Participants were recruited through the digital platform of the learning management system at their university, email, and social media. We asked participants how they were managing risks related to COVID-19; the continuity of social, educational, and work activities; and the psychological and economic impacts of the pandemic on their lives. Since March 2020, 73.0% of participants reported COVID-19-related symptoms, but only 33.9% were tested for COVID-19. During the national quarantine imposed by the Peruvian government (March 15–June 30, 2020), 64.3% of participants remained in their house. Furthermore, while 44.0% of participants were working in February 2020 (95% CI: [41.7%, 46.4%]), only 23.6% (95% CI: [21.7%, 25.7%]) were working immediately after the pandemic began (i.e., at the end of April 2020). Participants were more stressed about the health and educational implications of COVID-19 for Peruvian society and their families than about themselves. The public health, economic, and educational implications of COVID-19 on college students are continuing to unfold. This study informed Peruvian higher education institutions’ continued response to the COVID-19 pandemic, the progressive return to postpandemic activities, as well as other future pandemics and other crises.

Bazo-Alvarez, Juan Carlos↗

Integration of Solar Training into Allied Professional Development Platforms - Final Technical Report

The Interstate Renewable Energy Council (IREC) designed the “Integration of Solar Training into Allied Professional Development Platforms” project to surmount barriers to the expansion of solar technology caused by gaps in knowledge impacting on-the-job performance of allied professionals. At project start, questionnaires deployed nationally indicated that only 9% of firefighters felt certain they could shut down a PV system to the extent possible, and only a third of code officials thought they could even discern the difference between a PV and solar thermal system. Therefore, the project objective was to measurably and significantly increase the number of code officials and fire service professionals with solar knowledge directly applicable to their job function. IREC identified specific gaps in current knowledge, and integrated research-proven adult learning principles and technology solutions to enable a cost-effect but impactful reach. The project design ensured that solar training is a continuing component of the targeted sector professional development toolkit. To this end, the key partners recruited and cultivated were existing, trusted training partners in the targeted sectors: International Code Council Solar Rating and Certification Corporation (ICC-SRCC), International Association of Electrical Inspectors (IAEI), International Association of Fire Fighters (IAFF) and National Association of State Fire Marshals (NASFM). During the project, IREC held 79 courses in 25 states that trained 4,156 people, offered a PV in the 2017 National Electric Code webinar attended by 787 people, developed on-line training for code officials with 2,298 on-line learners, and developed an on-line training for firefighters with 4,930 on-line learners. In addition, the project participated in 28 conferences and reached over 537,000 professionals with solar information.

14 SOLAR ENERGY↗

Vitrification of Hanford Tank 241-AP-105 Waste at 7 M Na and Equivalent Simulant

Hanford Site nuclear waste is to be vitrified at the Waste Treatment and Immobilization Plant (WTP), which is a part of the safe and efficient retrieval, treatment, and disposal mission of the U.S. Department of Energy Office of River Protection. Hanford tank 241-AP-105 (referred to herein as AP-105) is one of the initial Hanford radioactive tank wastes planned to be processed and vitrified. A portion of AP-105 waste was retrieved by Washington River Protection Solutions, LLC (WRPS) and transferred to Pacific Northwest National Laboratory (PNNL). The waste went through dilution by Columbia River water to reach a target sodium (Na) concentration of 7 M, solids filtration, and cesium removal by ion exchange. A glass composition was calculated from the Kim et al. glass models to satisfy the WTP baseline requirements based on the as-received sample and the target dilution to 7 M, from which a simulant was calculated and glass forming chemical (GFC) additions were determined to form a liquid/solids mixture called melter feed. To prepare for the processing of the 7 M Na AP-105 waste melter feed and learn about the production expectations, the melter feed simulant of 7 M Na AP-105 waste was processed in a non-radioactive, continuous laboratory-scale melter (CLSM) system.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗