Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “human systems performance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

ChatGPT and Other Large Language Models for Cybersecurity of Smart Grid Applications

Cybersecurity breaches targeting electrical substations constitute a significant threat to the integrity of the power grid, necessitating comprehensive defense and mitigation strategies. Any anomaly in information and communication technology (ICT) should be detected for secure communications between devices in digital substations. This paper proposes large language models (LLMs), e.g., ChatGPT, for the cybersecurity of IEC 61850-based communications. Multi-cast messages such as generic object oriented system events (GOOSE) and sampled values (SV) are used for case studies. The proposed LLM-based cybersecurity framework includes, for the first time, data pre-processing of communication systems and human-in-the-loop (HITL) training (considering the cybersecurity guidelines recommended by humans). The results show a comparative analysis of detected anomaly data carried out based on the performance evaluation metrics for different LLMs. A hardware-in-the-loop (HIL) testbed is used to generate and extract a dataset of IEC 61850 communications.

ChatGPT↗

Ecosystems for Scientific Computing in the Age of AI

Scientific computing is at an inflection point. Artificial intelligence (AI) is reshaping how scientific software is developed, how teams collaborate, how projects are governed, and how the next generation is trained. Drawing on insights from a 2025 workshop report, this article argues that the future of discovery will depend on agile, robust ecosystems built through socio-technical co-design—the intentional integration of technical and human systems. This perspective is essential for ensuring that future scientific computing remains trustworthy, sustainable, and scalable. It combines advances in AI, high-performance computing, and software with new models for cross-disciplinary collaboration, education, and workforce development. Key recommendations include building modular, trustworthy AI-enabled software ecosystems; enabling teams to integrate AI into scientific workflows while preserving human creativity, integrity, and rigor; and developing adaptive training pathways that keep pace with rapid technological change. By sharing these perspectives, we hope to stimulate broader community dialogue and encourage coordinated action.

AI↗

Leveraging Prior Concept Learning Improves Generalization From Few Examples in Computational Models of Human Object Recognition

Humans quickly and accurately learn new visual concepts from sparse data, sometimes just a single example. The impressive performance of artificial neural networks which hierarchically pool afferents across scales and positions suggests that the hierarchical organization of the human visual system is critical to its accuracy. These approaches, however, require magnitudes of order more examples than human learners. We used a benchmark deep learning model to show that the hierarchy can also be leveraged to vastly improve the speed of learning. We specifically show how previously learned but broadly tuned conceptual representations can be used to learn visual concepts from as few as two positive examples; reusing visual representations from earlier in the visual hierarchy, as in prior approaches, requires significantly more examples to perform comparably. These results suggest techniques for learning even more efficiently and provide a biologically plausible way to learn new visual concepts from few examples.

Rule, Joshua S.↗

The value of human data annotation for machine learning based anomaly detection in environmental systems

Anomaly detection is the process of identifying unexpected data samples in datasets. Automated anomaly detection is either performed using supervised machine learning models, which require a labelled dataset for their calibration, or unsupervised models, which do not require labels. While academic research has produced a vast array of tools and machine learning models for automated anomaly detection, the research community focused on environmental systems still lacks a comparative analysis that is simultaneously comprehensive, objective, and systematic. This knowledge gap is addressed for the first time in this study, where 15 different supervised and unsupervised anomaly detection models are evaluated on 5 different environmental datasets from engineered and natural aquatic systems. To this end, anomaly detection performance, labelling efforts, as well as the impact of model and algorithm tuning are taken into account. As a result, our analysis reveals the relative strengths and weaknesses of the different approaches in an objective manner without bias for any particular paradigm in machine learning. Most importantly, our results show that expert-based data annotation is extremely valuable for anomaly detection based on machine learning.

54 ENVIRONMENTAL SCIENCES↗

Scaled-up Neuromorphic Array Communications Controller (SNACC) for Large-scale Neural Networks

Neuromorphic computing is one promising post-Moore’s law era technology, which takes inspiration from biological brains to perform computing tasks. The human brain contains billions of neurons with trillions of synapses and as neuromorphic hardware systems scale to larger and larger sizes, the communication system used to transfer information between neuromorphic elements and traditional computers must scale to keep up. In prior work, we describe the use of a separate neuromorphic array communications controller to support low-latency, high-throughput communication between our neuromorphic systems and a traditional computer. In this work, the neuromorphic array communications controller is used to support the scaling of a neuromorphic development system which uses multiple neuromorphic processors arranged in a two-dimensional array. The neuromorphic array communications controller, along with scalable local connections, is used to create a scalable neuromorphic platform to enable the development and testing of large neuromorphic network arrays.

Young, Aaron↗

Beyond microbial abundance: metadata integration enhances disease prediction in human microbiome studies

Multiple studies have highlighted the interaction of the human microbiome with physiological systems such as the gut, immune, liver, and skin, via key axes. Advances in sequencing technologies and high-performance computing have enabled the analysis of large-scale metagenomic data, facilitating the use of machine learning to predict disease likelihood from microbiome profiles. However, challenges such as compositionality, high dimensionality, sparsity, and limited sample sizes have hindered the development of actionable models. One strategy to improve these models is by incorporating key metadata from both the human host and sample collection/processing protocols. This remains challenging due to sparsity and inconsistency in metadata annotation and availability. In this paper, we introduce a machine learning-based pipeline for predicting human disease states by integrating host and protocol metadata with microbiome abundance profiles from 68 different studies, processed through a consistent pipeline. Our findings indicate that metadata can enhance machine learning predictions, particularly at higher taxonomic ranks like Kingdom and Phylum, though this effect diminishes at lower ranks. Our study leverages a large collection of microbiome datasets comprising 11,208 samples, therefore enhancing the robustness and statistical confidence of our findings. This work is a critical step toward utilizing microbiome and metadata for predicting diseases such as gastrointestinal infections, diabetes, cancer, and neurological disorders.

Mathematics and Computing↗

Trustworthiness and Trust: Identifying Factors that Drive Successful Human-AI Interaction in Nuclear Power Plant Applications

Emerging technologies such as artificial intelligence (AI) and machine learning (ML) are rapidly evolving and considered a promising tool for efficient and continued safe operations of the U.S. nuclear power plants (NPPs). Emerging AI techniques like large language models (LLMs) are one such technology that may support personnel at existing NPPs perform work more efficiently. For example, operators may query the current operational status of a power plant via a chat interface leveraging LLMs to access plant-related information in an interactive manner rather than manually collecting various sensor data for tasks such as surveillances or completing work orders. This is a fundamental shift in the way operators currently perform their tasks today. The literature of human-automation interaction indicates that trust is a crucial factor that drives successful interaction between a human operator and an automated system, like an AI-infused NPP application. This work presents the results of a literature review on key factors that relate to trust in AI/LLM technologies for NPP applications. The relevant literature of human factors and cognitive engineering has identified various factors related to trust including trustworthiness, performance characteristics, operator skill and perceived risk. This preliminary literature review will guide development and evaluation of models involving the identified factors influencing trust in AI and develop a framework for human-centered design for interface between humans and AI. By addressing trust, this work supports developing a technical basis for designing key characteristics of AI/LLM to support calibrated trust, which will ultimately support wide-scale adoption of AI/LLM technologies, as well as ensure safe, effective, and reliable use.

99 - GENERAL AND MISCELLANEOUS↗

Uncertainty quantification of a physics-informed model based on sparse identification of a Thermal Energy Distribution System

Integrated energy systems (IES)s are crucial for enhancing the economy and efficiency of power generation sources (e.g., nuclear energy) necessary to unleash American energy dominance. These systems can be integrated with thermal energy storage (TES) and intermittent renewable energies to optimize overall energy use, peak-load regulation, and demand-side responses. However, the stabilization of energy generation, transport, and utilization introduces operational complexities that exceed the challenges of managing each sub-component individually. Currently, though IESs rely on human operators for efficiency and stability, reducing human error risk and enhancing performance through automation is highly desirable. Recent advances at Idaho National Laboratory have demonstrated successful control of the Thermal Energy Distributed System (TEDS). However, the automatic control system depends on a deterministic Sparse Identification of Nonlinear Dynamics with Control (SINDyC) model, which are trained based on simulation data from physics-based simulations. Because of uncertainties in physics-based simulation, SINDyC model results in large discrepancies against experimental data and cannot be reliably used in automatic control. In this paper, we present an innovative approach to address these discrepancies by quantifying uncertainties and developing a more robust model. We first generated trajectories by using first-principles physics codes to encapsulate the experiment. Next, we trained thousands of models by randomly sampling these trajectories. We then collapsed all those models into one probabilistic SINDyC by fitting a multivariate Gaussian distribution onto the resulting coefficient’s distribution. Despite its simplicity, our approach successfully produced 95% confidence intervals that captured the experimental trajectories. It even did so with a higher probability and better U-pooling score across six of the seven relevant quantities of interest (QoIs), as compared to other classical approaches. In conclusion, ongoing research is focusing on generating new experimental trajectories to validate this approach, and on employing Bayesian calibration to refine parametric uncertainties and guide future model development efforts.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

An Integrated Energy Systems Prototype Human-System Interface for a Steam Extraction Loop System to Support Joint Electricity-Hydrogen Flexible Operations

Due to increasing economic competition from renewables and combined-cycle natural gas plants, nuclear power plants are looking toward flexible operations to enhance their cost competitiveness. The Integrated Energy Systems project under the Light Water Reactor Sustainability program of the U.S. Department of Energy focuses on joint electricity-hydrogen flexible operations. Joint electricity-hydrogen flexible operations entail the nuclear power plant diverting thermal energy via main steam to a hydrogen production plant located nearby. The steam serves to enhance the efficiency of the hydrogen production. Furthermore, high temperature electrolysis requires a large amount of electricity, which the plant can also provide. The plant provides steam and electricity to the hydrogen plant throughout the day, but during peak demand hours the nuclear power plant returns to solely providing electricity to meet the high demand. Through this flexible concept of operations, the plant can optimize the thermal energy it produces without having to maneuver the power of the plant. This report documents the human factors process to design and develop a prototype human-system interface for the steam extraction loop that serves as the conduit between the nuclear power plant and the adjacent hydrogen plant. The design process followed the human factors guidelines set by NUREG-0711, Human Factors Engineering Program Review Model (O’Hara, Higgins, & Fleger, 2012), and expanded upon by the Guideline for Operational Nuclear Usability and Knowledge Elicitation (GONUKE; Boring, Ulrich, Joe, & Lew, 2015; Boring, Lew, & Ulrich, 2016). The design process entailed operator interviews to determine the concept of operations for the steam extraction loop, a review and adaptation of digital interface design concepts developed by the team in prior projects, an iterative design process, and reviews conducted by both operators and human factors experts. Several versions of the prototype human-system interface were developed. Operators were interviewed to determine what design features they found useful and would like to see in the interface. The design underwent a review by human factors experts against NUREG-0700, Human Interface Design Review Guidelines (U.S. Nuclear Regulatory Commission, 2019), to ensure compliance with the latest human factors standards for digital interfaces in nuclear applications. The design was then prototyped as a functional windows-based application integrated with the Generic Pressurized Water Reactor simulator modified to include the steam extraction loop. The simulation is supported by the Human Systems Simulation Laboratory at Idaho National Laboratory, which supports operator-in-the-loop testing. This is an ongoing project and the next phase of the project entails performing an operator-in-the-loop usability study to evaluate the interface and examine the proposed concept of operations to extraction steam from the nuclear power plant for delivery to the coupled hydrogen production plant.

99 GENERAL AND MISCELLANEOUS↗

Distribution Development for Residual Inventory at the New York West Valley Site - 20400

The New York State Energy Research and Development Authority (NYSERDA) is the owner of the Western New York Nuclear Service Center (WNYNSC), a 1,351 ha site located approximately 48 km south of Buffalo, New York. In 1962, Nuclear Fuel Services, Inc. (NFS) entered into Agreements with the Atomic Energy Commission and New York State to construct the first commercial reprocessing plant of nuclear fuel in the United States. NFS, a private company, built and operated the spent fuel reprocessing plant and waste disposal facilities, processing 640 Mg of spent nuclear fuel from 1966 to 1972 under an Atomic Energy Commission license. Nuclear fuel reprocessing operations ended in 1972 and never reopened, leaving behind radioactive and chemical wastes. Operations led to contamination in a number of facilities and locations. Some of that contamination has migrated from waste disposal zones to other layers, formations, and features on and off the WNYNSC. Phase I decommissioning activities are ongoing and involve the removal of a number of areas and structures that have been associated with contamination. The purpose of this work is to outline the approach for characterizing contamination not associated with disposed wastes, contaminated structures, or specific releases. In this work, the term, residual radiological activity, is used to describe environmental contamination that exists subsequent to the completion of Phase I decommissioning activities, that is not associated with disposed wastes, contaminated structures, or specific releases. Contamination from the Site was quantified relative to data that characterize the concentrations of radionuclides that exist in background. Background concentrations are those present in the area but having no influence from Site related activities. The existence of residual radiological activity that is elevated relative to background has the potential to contribute to future risks to human health and the environment. As a consequence, the residual inventory information is used to inform the West Valley Probabilistic Performance Assessment (PPA) model to characterize potential future risks to human health and the environment. The centralized West Valley Data Management System (DMS) was the source of information for the data assembled in this analysis. The DMS is a fairly large compilation consisting of thousands of records from investigation studies, with sample dates ranging from 1990 to present. Samples from monitoring wells, boreholes, geoprobe studies, surface water, surface soils, storm water outfalls, ventilation stack filters, plant and animal tissues, and more are included in the DMS. Results are typically reported in units of activity per unit volume. For the purpose of the analyses presented here, all results were converted into consistent units of pCi per unit volume. Since 1990, data have been collected from various locations across the WNYNSC at different times with varying frequency over the course of several decades. As a consequence, a number of potential issues can arise with respect to the assembly of a dataset that is deemed adequate for the characterization of residual radiological activity. These issues were assessed and resolved to the extent possible through careful consideration of the properties of the distributions. The intent was to use data which characterize the current state of the Site. Radionuclides can be designated to one of several groups depending on their origin. In this work the groups considered were 1) Naturally Occurring Radioactive Material (NORM), 2) fallout, and 3) Other (including power plant, medical research, etc). This grouping is a useful construct with respect to the interpretation of fixed laboratory results. For example, NORM radionuclides that exist within a decay chain should have approximately equivalent distributions of concentrations if they are representative of background conditions. Insights such as these can be used as a check to identify sample results that need to be further investigated or omitted due to issues associated with reported results from fixed laboratory analyses. This type of analysis provided a foundation for the assessment of the adequacy of sample results for use in subsequent components of an assessment. The general process for the assessment of residual radiological contamination at the Site consists of a sequence of several steps. First, for each analyte, several statistical tests were performed to assess the weight of evidence against the null hypothesis that the mean of the distribution of concentrations was equal to zero. If the mean of the distribution of concentrations for a given radionuclide was not found to be greater than zero, then it was removed from consideration as a component of the residual radiological contamination. If there was significant evidence to reject the hypothesis of the mean being equal to zero, the second step was to compare the distribution of the data from the Site to that of the corresponding background. A suite of tests was used to compare the distributions of the site and background data. The results of these tests were collectively used to determine if site data are elevated relative to background. The third step was to develop distributions using a Bayesian framework to characterize the distribution of mean of the increment present above background for each of the radionuclides. The Bayesian model implemented allowed for the comparison of site-specific records to background concentrations to better approximate contamination attributed to the Site. A final screening step was employed for radionuclides that exceed background. This screening step compared 95% upper confidence limits (UCLs) from the increment distribution developed in the previous step to the risk screening levels. This approach yields a list of analytes that were determined to be elevated relative to background.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

EXTRACTING HUMAN RELIABILITY FINDINGS FROM HUMAN FACTORS STUDIES IN THE HUMAN SYSTEMS SIMULATION LABORATORY

Modernization of U.S. nuclear power plants (NPPs) is widespread, with most plants currently replacing and transitioning equipment, control systems, and human system interfaces (HSI)s from analog to digital displays. This conversion remedies the obsolescence of analog parts along with needs for increased intuitiveness of design, safety, and capabilities. The Human Factors and Reliability team at Idaho National Laboratory (INL) carried out twelve control room modernization studies in the newly designed Human Systems Simulation Laboratory (HSSL) over nine years. The HSSL was constructed as a testbed for evaluating human factors techniques and performance measures, HSI frameworks, and cutting-edge operational concepts in NPPs. Installing a full-scope training simulator enabled direct design and evaluation work on the same instrumentation and control (I&C) and HSIs located at U.S. plants. The subsequent addition of glass top bays afforded crews opportunities to implement operations via the simulator using full-scale representations of their home NPP. Additionally, functional HSI prototypes were created, providing an environment for operator-in-the-loop benchmark studies. The HSSL has assisted in upgrades of six commercial NPP control rooms and served as an invaluable proving ground for new NPP operations technology. Human reliability analysis (HRA) was not originally the focus of the studies; however, data relating to HRA such as type and frequency of human errors can be extracted from the studies. INL is currently extracting data from the HSSL study reports to apprise how information gathered from simulation, HSI, and other related studies can create a broad look across different data sources to help inform HRA methods.

99 GENERAL AND MISCELLANEOUS↗

Generative AI for Grid Operations [Slides]

In the last few years, the development and use of generative artificial intelligence (AI) and large-language models (LLMs) have changed the landscape of how AI and machine learning (ML) are being used in power systems. LLMs are built on foundational models based on large data sets that can be trained to provide information rapidly and through simple natural language prompts. Generative AI can then perform human-like tasks using ML models to identify and mimic pattens in the data sets. This presentation explores how generative AI can enhance grid operations by improving forecasts, enabling rapid contingency analyses, and offering real-time operational suggestions. By providing grid operators with valuable insights, generative AI will empower them to manage power systems more effectively.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Model-based Hierarchical Reinforcement Learning for Improved Physical Security Design: A Prototype

Prior work in FY24 developed an adversarial AI agent aid in path analysis of physical protection systems. This agent, trained using a model-based reinforcement learning algorithm, was able to successfully learn the most vulnerable path in facilities. It was able to extend the current state of practice for physical protection design by exhibiting dynamic behavior based on current environmental conditions. Whereas PathTrace largely performs a static, graph-based analysis, the AI agent was able to make decisions based on relative position in the facility, current conditions (was the adversarial agnet discovered?), and proximity to secondary targets. The agent demonstrated some novel capabilities, but had limitations that need to be resolved before it can be used for production purposes. For example, the adversarial agent generalizes poorly and takes a relatively long time to train. Nonetheless, there is still considerable promise for developing the adversarial agent further in order to explore even richer, more dynamic behaviors (e.g., adversary motivations, environmental debris, and more). This work considers a complementary idea; development of a planning agent. The planning agent is envisioned as an auto-complete-like tool that can help accelerate security system design by human experts. The agent would respect existing barriers and sensors placed by a human expert while offering cost-effective suggestions (i.e., implicitly balancing effectiveness with cost) to improve the design. The goal is for this agent to be part of an expert’s toolbox, not to totally upend the current state-of-practice, or to displace human experts. The ultimate goal would be concurrent training of both the adversarial and planning agent together, to learn entirely through self-play. This would represent an entirely new way of performing system deign. We selected a hierarchical, model-based reinforcement learning algorithm to serve as the planning agent. This is an extension of concepts used in the prior FY24 adversarial agent work. There, we had a single agent acting an environment. Here, we have two different sub-agents (policies), working together, to form a complete agent. There is a manager policy, which can select abstract goals on slower time scales, and a worker, which performs primitive actions to reach goals selected by the manager. It is worth noting that this class of algorithm is challenging to work with. From our understanding, our work is one of the first successful uses of model-based reinforcement learning (MBRL) in nuclear energy1 , and likely the first hierarchical model-based reinforcement learning application in nuclear energy. Further, this work is one of the first known attempts to apply AI to perform a design tasks in nuclear energy. Consequently, there were significant implementation challenges and the bulk of the work was focused on successful implementation and algorithm design. The results presented here are very low technology readiness level as a consequence of the lack of related literature, but still represent a significant step forward in the pursuit of applied AI for design.

42 ENGINEERING↗

Human-Building Collaboration: Toward lighting enabled collaborative system design

The profession of lighting design is evolving as contemporary lighting systems increasingly rely on cutting-edge computational technologies, sensors, and IOT systems. This trend requires designers to incorporate ideas of automation, dynamic controls, and user-system interaction into their design logic. However, real-time lighting simulations are constrained by inherent limitations arising from the reductive assumptions inevitably introduced in simulated lighting environments. This raises the question of how can designers account for the discrepancies between simulated and real lighting environments, and how can collaboration between humans and autonomous lighting systems bridge this gap. To address this question, we propose a protocol for designing collaborative interactions between humans and systems. Furthermore, this protocol builds on the Human-Lighting System Interaction Framework and demonstrates how human and system intelligence can be combined to fine-tune lighting qualities in a given space. Our paper shows how interactive lighting systems can customize lighting based on user preferences in real-time and how global lighting configurations can be adjusted over time. Specifically, we demonstrate: a) Human-system collaboration assumptions and goals, as well as how the protocol can be integrated into digitally programmable lighting systems. b) Implementations of collaboration that reveal how system autonomy, performance, and user experience are improved over short and long-term timeframes. c) How lighting design can be enhanced beyond simulation-driven design optimization capacities. The associated affordances and limitations are discussed with respect to existing lighting simulation design frameworks.

autonomous systems↗

Preliminary Evaluation of Joint Electricity-Hydrogen Concept of Operations

An initial thermal power dispatch (TPD) concept of operations was evaluated that couples a nuclear power plant to a nearby hydrogen production plant. GSE Systems’ generic pressurized water reactor full-scope simulator was modified with a TPD model comprised of a thermal power extraction and delivery system. A prototype human-system interface (HSI) was developed to interact with the TPD model and allow participants to execute the basic operating scenarios for normal operations. Four retired operators performed the evaluation, and due to COVID-19 travel restrictions, the original in-person experimental design was restructured to support a remote participator evaluation using a web meeting platform. Data from operator feedback, observations from the research team, and quantitative survey responses revealed that the initial TPD concept of operations is feasible. The operators were comfortable with the engineered system and HSI and could manage it without adverse impacts to reactor power, plant safety, or equipment. Findings are discussed in terms of both the TPD system design and HSI performance.

human factors↗

Measuring 3D Profilometry of SAVY-4000 Nuclear Material Storage Containers: Novacam TubeInspect Capabilities Report

The SAVY-4000 container series is a general-purpose interim storage container for nuclear materials, developed and maintained by Los Alamos National Laboratory (LANL). It is the first vented, general-use nuclear material container to be demonstrated as meeting the requirements outlined in DOE M 441.1-1, the Nuclear Material Packaging Manual. Due to the challenging radiation, thermal, and corrosive storage conditions that the SAVY containers must endure, continuous surveillance techniques are employed to ensure the containers meet all safety standards and specifications. These inspections are typically performed by human operators, who check for issues such as corrosion, O-ring deterioration, corrosion, filter integrity, and potential manufacturing defects. However, human inspections alone are not sufficient, and automated inspection technologies, such as the ATIS system, as well as other automated systems are also utilized. The MicroCam TubeInspect, developed by Novacam Technologies Inc., is designed to address the challenges of understanding how manufacturing variations in the SAVY-4000 container series may affect performance. It is a 3D profilometry measurement system that enables detailed analysis of surface features, including defects, surface roughness, and manufacturing variations. This advanced tool significantly enhances rapid surveillance techniques for both pristine and used containers. In this study, container properties such as surface roughness, thickness, and geometric attributes like circularity are measured for SAVY-4000 containers. Artificially corroded or dented containers are examined to demonstrate the MicroCam's ability to quantify defects. A sensitivity analysis is also conducted, comparing the MicroCam results to those obtained using more precise instruments such as confocal microscopy. This comparison aims to provide valuable insights into container quality, durability, and potential improvements in manufacturing processes.

42 ENGINEERING↗