Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “trustworthy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Trust Model Measurements for the Energy Grid of Things

Information security is essential for the reliable operation of an Energy Grid of Things (EGoT). In addition to basic information security protocols as defined by published standards, there is a need for a monitoring function that measures the trustworthiness of the various actors participating in an EGoT. We describe in this paper the implementation and evaluation of a Distributed Trust Model that was developed specifically for monitoring communication within an EGoT. We then show how the model parameters are set using statistical measures for hypothesis testing.

Energy Grid of Things, EGoT, Smart Grid Security, ↗

Generic Multi-Frequency Modelling of Converter-Connected Renewable Energy Generators Considering Frequency and Sequence Couplings

Frequency and sequence couplings can compromise the trustworthiness of multi-frequency models for converter-based systems. There have been effective attempts to address the couplings mainly by linearized averaged models. Only a few studies have been conducted on practical optimization of such models with enormous matrices and experimental results. This paper provides a generic theory for coupling patterns and proposes a multi-frequency modelling method to detect and address only the main couplings in the sequence domain for converter-connected renewable energy generators. The proposed generic model is based on empirical tests using small-signal perturbations and adopting Fourier transform on the switching converter response. The proposed theory and modelling methodology are verified using a 7MVA grid emulator for voltage perturbation tests on a 2MVA photo-voltaic converter. Accordingly, the couplings can exist in more generic forms, including multiples of perturbation and fundamental frequencies. To the best of our knowledge, the patterns with the multiples of the perturbation frequency have been overlooked in the literature. Furthermore, the mirror frequency concept is valid for all coupling patterns and is included in the proposed model. Besides, the proposed patterns and the environment noise levels have been practical criteria for selecting the main couplings.

frequency and sequence couplings↗

A Blockchain-Enabled Sustainable Safety Management Framework for Connected Vehicles

The notion of an intelligent transportation system (ITS) aims to boost the performance of transportation networks, which has gained more and more traction in both academic and commercial circles. ITS is a constantly evolving vision that combines cutting-edge transportation approaches with new information, communication, computers, and other technology. ITS should discover consequence routes to enhance the sustainability, safety, and trustworthiness of the entire transportation system utilizing emerging technologies. In this paper, a sustainable safety management framework for connected vehicles is proposed by integrating blockchain. It introduces smart transportation equipment called an AI-enabled vehicle smart device (AVSD) for vehicular communications. AVSD can reduce energy consumption by decreasing the computational costs in vehicular communications. Smart contracts are used to identify vehicles automatically and establish secure communication among vehicles and emergency service stations (ESSs) like hospitals, police stations, and fire stations. The experiment results show that the proposed framework provides a communication environment for sustainable safety and security using the introduced smart transportation device. In conclusion, the proposed blockchain-enabled sustainable safety management framework has the potential to improve safety and sustainability in the transportation industry by creating a secure, decentralized, and transparent platform for managing safety data and promoting safe and sustainable driving behaviors.

42 ENGINEERING↗

Uncertainty Quantification of Capacitor Switching Transient Location using Machine Learning

Identification of capacitor switching transient location provides valuable insight into the state of the associated equipment. Machine learning (ML) models, and convolutional neural networks (CNNs) in particular, have demonstrated remarkable performance in signal location. However, ML models are data driven whose predictions are affected by noise in data and may also suffer from large extrapolation errors when applied to new conditions. Uncertainty quantification (UQ) is necessary to ensure model trustworthiness and avoid overconfident predictions in extrapolation. Here, in this work, we propose a novel UQ method, called PI3NN, to quantify prediction uncertainty of ML models and integrate the method with CNNs for transient source location. PI3NN calculates Prediction Intervals by training 3 Neural Networks and uses root-finding methods to determine the interval precisely. Additionally, PI3NN can identify out-of-distribution (OOD) data in a nonstationary condition to avoid overconfident prediction. Results indicate that with PI3NN, transient signals are not only correctly identified, but when said signals are subject to corruptions characteristic of an actual power monitoring system (e.g. non-ideal sensors), the model recognizes when it is uncertain about its predictions, effectively letting the user know when to accept or discard the results.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Uncertainty-Informed Volume Visualization using Implicit Neural Representation

The increasing adoption of Deep Neural Networks (DNNs) has led to their application in many challenging scientific visualization tasks. While advanced DNNs offer impressive generalization capabilities, understanding factors such as model prediction quality, robustness, and uncertainty is crucial. These insights can enable domain scientists to make informed decisions about their data. However, DNNs inherently lack ability to estimate prediction uncertainty, necessitating new research to construct robust uncertainty-aware visualization techniques tailored for various visualization tasks. In this work, we propose uncertainty-aware implicit neural representations to model scalar field data sets effectively and comprehensively study the efficacy and benefits of estimated uncertainty information for volume visualization tasks. We evaluate the effectiveness of two principled deep uncertainty estimation techniques: (1) Deep Ensemble and (2) Monte Carlo Dropout (MC-Dropout). These techniques enable uncertainty-informed volume visualization in scalar field data sets. Our extensive exploration across multiple data sets demonstrates that uncertainty-aware models produce informative volume visualization results. Moreover, integrating prediction uncertainty enhances the trustworthiness of our DNN model, making it suitable for robustly analyzing and visualizing real-world scientific volumetric data sets.

Saklani, Shanu↗

ROS-Ethereum: A Convenient Tool to Bridge ROS and Blockchain (Ethereum)

Robot Operating System (ROS) has received widespread utilization with the development of robotics, self-driving, etc., recently. Meanwhile, the other technology blockchain is frequently applied to various fields with its trustworthy characteristics and immutability in data storage. However, ROS has no ability to interact with the blockchain, which hinders research in related fields. Therefore, we wonder if we can develop a convenient tool to bridge ROS and blockchain. Inspired by this, we propose ROS-Ethereum. It bridges ROS and Ethereum, a widely used blockchain platform. ROS-Ethereum is based on the User Datagram Protocol (UDP) communication mechanism and the SM algorithm family along with Ethereum technology. Simply put, ROS-Ethereum allows users to invoke the contract when interacting with the blockchain, which makes this process easier and safer. We conduct experiments in real robots to verify the effectiveness of ROS-Ethereum and evaluate it from the following metrics: (1) the encryption efficiency and stability of the algorithm and (2) ROS-Ethereum transaction response time and packet loss rate.

Zhang, Shenhui↗

V-HAMSTeR v1.0.0

V-HAMSTeR is a bioinformatics software tool designed to predict the hosts of viruses directly from genomic sequences. It can be used by researchers to predict animal, prokaryotic, plant, protist or fungal viral hosts including viruses that may be fragmented or discovered in environmental metagenomic datasets. Features & Uses: The software employs a novel dual-stream deep learning architecture that dynamically fuses implicit sequence embeddings from a genomic foundation model with 13 explicit, handcrafted biological features (e.g., coding density and strand switch rates). To ensure maximum reliability, V=HAMSTeR deploys a 5-fold deep ensemble calibrated via Joint Temperature Scaling, providing users with statistically rigorous confidence probabilities. It also features an automated sequence chunking and mean-pooling module to seamlessly process variable-length contigs. Advantages Over Similar Technologies: Existing tools (e.g., IPEV, RNAVirHost) typically rely on either basic k-mers or isolated neural networks. V-HAMSTeR's hybrid architecture captures both broad genomic context and specific biological motifs that standalone foundation models often miss. Furthermore, unlike competitor tools that struggle with incomplete data or exhibit extreme overconfidence, V-HAMSTeR is explicitly benchmarked and mathematically calibrated for fragmented assemblies (1kb–10kb). This makes it uniquely robust, accurate, and trustworthy for the messy reality of real-world environmental viromics.

Grigson, Susie [Lawrence Berkeley National Laborat↗

Human Factors Evaluation of Energy Visualization Dashboards

Energy visualization systems provide information about use in real-time to assist users with energy efficiency. In this study, three energy visualization dashboards for small businesses were developed and tested. Performance measurement, NASA Task Load Index (TLX) workload assessment, and posttest survey were used to conduct the usability testing. Compared with the dashboards that were designed using line charts and tables, a dashboard designed using visuals (e.g., gauges, pie charts, and flashing lights) produced quicker response time, lower mental and temporal demand and effort ratings, and higher ratings of engagement, interest, and trustworthiness.

Nimbarte, Ashish D. (ORCID:0000000210599112)↗

A holistic cyber-physical security protocol for authenticating the provenance and integrity of structural health monitoring imagery data

Modern infrastructure systems, such as bridges, dams, power generation stations, and buildings increasingly have an intrinsic cyber-physical nature to them. Infrastructure now commonly, includes actuators, network connections, sensors, control systems, and computational resources. It is of increasing concern that modern infrastructure is vulnerable to cyber-attacks that can damage both the cyber and physical nature of the infrastructure. To date, the physical and cyber health of infrastructure has been considered separately. However, the increasing concerns associated with the cyber-physical security of infrastructure coupled with the emergence of 5G networks made using components that are not universally considered trustworthy, and the emergence of techniques for creating deepfakes and adversarial examples suggests the time has come to begin considering cyber health and structural health with a more holistic approach. In this work, a protocol is developed for ensuring the imagery data captured by a structural health monitoring system can be unambiguously attributed to legitimate sensors associated with the structural health monitoring system. A computer vision approach based on the idea of mutual information is then presented to detect damage in an image. This work presents the protocol for authenticating the provenance of imager data and demonstrates that this protocol does not have overly adverse effects when used with the mutual information-based technique for detecting damage in the resulting imagery data.

Jung, HweeKwon↗

Knowledge-Informed Uncertainty-Aware Machine Learning for Time Series Forecasting of Dynamical Engineered Systems

The high complexity and multiscale nature of many engineered systems—such as those in nuclear power plants—make representing and forecasting their dynamic behavior challenging. Physics-based models can be overly complex and computationally intractable, whereas machine learning (ML) tools are often data-hungry and prone to unphysical solutions. This study proposes a knowledge-informed ML-aided hybrid residual modeling approach that offers accurate and efficient time series forecasting for the operation of dynamical engineered systems. Hybrid residual modeling entails a baseline solution from domain knowledge and known physics expressions about the system dynamics integrated with an ML model to capture undiscovered information from the mismatch (i.e., residuals) between true states from measurements and baseline-predicted outputs. This study further quantifies the ML model uncertainty to provide trustworthy solutions. Real-time operational data from thermal-hydraulic flow loops of the cryogenic moderator system in Oak Ridge National Laboratory’s Spallation Neutron Source facility were used to demonstrate the potential of knowledge-informed uncertainty-aware ML in real-world applications. The state variables of the cryogenic helium loop were modeled with (1) first principles–based system identification (sysID), (2) long short-term memory (LSTM) neural network, and (3) hybrid sysID (baseline) + LSTM (residual). The superior predictive capability of the sysID+LSTM model versus stand-alone sysID and LSTM is confirmed by average performance metrics and individual data points across different prediction horizons. By creating a robust representation of the underlying physical system, the widely applicable hybrid residual modeling approach will enable the future development of digital twins for performance prediction, prognostics, and operation control.

Zhao, Xingang↗

Preliminary Design of Critical Experiments Involving Commercially Available B 4 C Neutron Absorber Plates with Low-Enriched UO 2 Fuel

The International Criticality Safety Benchmark Evaluation Project (ICSBEP) is an initiative to provide high-quality benchmark data in a standardized format for criticality safety analysts to use to validate calculational tools and nuclear data. In the last released 2022 version, the ICSBEP handbook contains over 5,000 critical experiment descriptions, results, and associated models. This paper describes the critical configurations proposed and calculations performed as part of the conceptual design phase of Integral Experiment Request (IER) 554 (IER-554). The goal of IER-554 is to add to the benchmark experiments available to the criticality safety community by designing critical experiments that can analyze how adding commercially available Boralcan plates to an assembly of low-enriched UO2 fuel rods affects the effective neutron multiplication factor (k eff ). Boralcan, a neutron absorber product developed by Rio Tinto, is made of B4C in an Al 1100 matrix and is commonly used for criticality suppression in fuel storage pools. In the current version of the ICSBEP handbook, only a few dated critical experiments involve B4C materials, and none involve Boralcan in a thin plate shape. The experiments designed as part of IER-554 are intended to be performed at the Sandia Pulsed Reactor Facility/Critical Experiments (SPRF/CX) apparatus at Sandia National Laboratories. SPRF/CX is a well-characterized assembly considered trustworthy by the benchmarking community because of the numerous high-quality evaluations with very low experimental uncertainties included in the ICSBEP handbook. Figure 1 illustrates the assembly for a particular configuration from LCT-078, one of the published benchmarks in the ICSBEP handbook. The experiments will be moderated and reflected by light water at ambient atmospheric pressure. Before the plates are inserted in the critical assembly, they will be characterized with x-ray computed tomography (XCT) to identify the sizes and distribution of the B 4 C powder particles inside the plates. The preliminary design calculations were performed with SCALE 6.3.0 using the KENO V.a sequence for the criticality calculations, the CE-TSUNAMI-3D sequence for the sensitivity and uncertainty studies, and the ENDF/B-VII.1 Continuous Energy cross section library. All the calculation results presented have 10 pcm statistical uncertainties. A set of critical experiments with Boralcan plates could increase the confidence of the criticality safety community in its modeling methods when using this type of neutron absorber material. Experiments would also help validate k eff calculations, and the industry could use these validations to change the B loading credit limits from the US Nuclear Regulatory Commission standard review plan for dry cask storage of spent nuclear fuel. This paper summarizes only part of the analysis documented in the preliminary design report.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

A Spatiotemporal-Aware Weighting Scheme for Improving Climate Model Ensemble Predictions

Multimodel ensembling has been widely used to improve climate model predictions, and the improvement strongly depends on the ensembling scheme. In this work, we propose a Bayesian neural network (BNN) ensembling method, which combines climate models within a Bayesian model averaging framework, to improve the predictive capability of model ensembles. Our proposed BNN approach calculates spatiotemporally varying model weights and biases by leveraging individual models' simulation skill, calibrates the ensemble prediction against observations by considering observation data uncertainty, and quantifies epistemic uncertainty when extrapolating to new conditions. More importantly, the BNN method provides interpretability about which climate model contributes more to the ensemble prediction at which locations and times. Thus, beyond its predictive capability, the method also brings insights and understanding of the models to guide further model and data development. In this study, we design experiments using an ensemble of CMIP6 climate model simulations to illustrate the BNN ensembling method's capability with respect to prediction accuracy, interpretability, and uncertainty quantification (UQ). We demonstrate that BNN can correctly assign larger weights to the regions and seasons where the individual model fits the observation better. Moreover, its offered interpretability is consistent with our understanding of localized climate model performance. Additionally, BNN shows an increasing uncertainty when the prediction is farther away from the period with constrained data, which appropriately reflects our trustworthiness of the models in the changing climate.

54 ENVIRONMENTAL SCIENCES↗

Exploring Data Set Bias and Decision Support with Predictive Uncertainty Through Bayesian Approximations and Convolutional Neural Networks

Individual seismic catalogs can contain multiscale observations from fault level to global scales and associated waveforms from discrete events reflect crustal structure across many different scales and locations. Seismic network aperture, geographic location, and observation distance may not provide informative guidance or intuition on how different catalogs will behave across models trained under different conditions. We rely on uncertainty to provide guardrails for when to trust model decisions, but understanding when our uncertainty is trustworthy is an open challenge. Here, in this work, we explore Bayesian approximation methods for assigning predictive uncertainty in seismic event classification problems. We find that computationally expensive Bayesian approximations do not outperform simple ensemble methods. We also find that when exploiting multiple seismic event catalogs, joint training with data from all the catalogs combined with Bayesian approximations and supervised training for classification can obscure bias and result in less robust uncertainty while also not providing substantial performance benefits compared to training individual models for each catalog.

58 GEOSCIENCES↗

Assessing convergence in global sensitivity analysis: a review of methods for assessing and monitoring convergence

In global sensitivity analysis (GSA) of a model, a proper convergence analysis of metrics is essential for ensuring a level of confidence or trustworthiness in sensitivity results obtained, yet is somewhat deficient in practice. The level of confidence in sensitivity measures, particularly in relation to their influence and support for decisions from scientific, social and policy perspectives, is heavily reliant on the convergence of GSA. We review the literature and summarize the available methods for monitoring and assessing convergence of sensitivity measures based on application purposes. The aim is to expose the various choices for convergence assessment and encourage further testing of available methods to clarify their level of robustness. Furthermore, the review identifies a pressing need for comparative studies on convergence assessment methods to establish a clear hierarchy of effectiveness and encourages the adoption of systematic approaches for enhanced robustness in sensitivity analysis.

54 ENVIRONMENTAL SCIENCES↗

Evaluating Deception Detection Model Robustness To Linguistic Variation

With the increasing use of automated, machine learning-driven tools and the downstream impact that algorithmic judgements can have, it is critical to develop models that are robust to evolving or manipulated inputs. Evaluating the reliability of multimodal models across linguistic variations to understand model susceptibility to intentional linguistic adversarial attacks as well as natural linguistic variations is essential in this pursuit. We present extensive analysis of model robustness and susceptibility to linguistic variations in the setting of deceptive news detection, a difficult classification task that is an increasingly important problem to solve with the impact of misinformation spread online. We evaluate the effectiveness of incorporating adversarial defense strategies and measure model susceptibility to state-of-the-art adversarial attacks using two types of linguistic attacks — character and word perturbations. We consider two multiclass prediction tasks — a 3-way classification of tweets as trustworthy, propaganda, or disinformation; and a 4-way classification as clickbait, hoax, satire, or conspiracy — and compare the performance of three embeddings that have been state-of-the-art for several NLP tasks — GloVe, ELMo, and BERT — to highlight consistent trends in susceptibility, high confidence misclassifications, and high impact failures. We find that character or mixed ensemble models are the most effective defense mechanisms and that character perturbations are a more effective attack than word perturbations for deception classification.

adversarial evaluation↗

ORCHID: Orchestrated Retrieval-Augmented Classification of High-Risk Property with Intelligent Decision-Making

High-Risk Property (HRP) classification is critical at U.S. Department of Energy (DOE) sites, where inventories include sensitive and often dual-use equipment. Compliance must track evolving rules designated by various export control policies to make transparent and auditable decisions. Traditional expert-only workflows are time-consuming, backlog-prone, and struggle to keep pace with shifting regulatory boundaries. We propose ORCHID, a modular agentic framework for HRP classification that pairs retrieval-augmented generation (RAG) with human oversight to produce policy based outputs that can be audited. Small cooperating agents—retrieval, description refiner, classifier, validator, and feedback logger—coordinate via agent-to-agent messaging and invoke tools through the Model Context Protocol (MCP) for model-agnostic on-premise operation. The interface follows an "Item to Evidence to Decision" loop with step-by-step reasoning, on-policy citations, and append-only audit bundles (run-cards, prompts, evidence). In preliminary tests on real HRP cases, ORCHID improves accuracy and traceability over a non-agentic baseline while deferring uncertain items to Subject Matter Experts (SMEs). The demonstration shows single item submission, grounded citations, SME feedback capture, and exportable audit artifacts—illustrating a practical path to trustworthy LLM assistance in sensitive DOE compliance workflows.

Das, Sanjay [ORNL] (ORCID:0009000542591915)↗

Establishing a sustainable regulatory framework for the security of radioactive sources through harmonization with a safety regulatory framework

In order to establish and maintain sustainable nuclear security regulatory infrastructures for radioactive sources, it is important for States to develop nuclear security regulations with regulatory requirements and relevant criteria for security, which are consistent and well integrated with those for radiation safety. In establishing national regulations, experts worldwide follow the international recommendations on safety and security of radioactive sources published by the International Atomic Energy Agency (IAEA). Within the IAEA publications on safety and security of radioactive sources, some international recommendations are identical or very similar for both safety and security, for example, the requirement for the establishment of a national registry of radioactive sources. However, some other international recommendations are unique to the security area, such as the recommendation to examine the trustworthiness of employees, or to the safety area, such as the need to establish public exposure controls. Additionally, many international recommendations fall somewhere in between, such as the need for effective authorization of facilities and activities, a regulatory inspection and enforcement regime and the graded approach to establish and apply regulatory requirements. This paper examines how the IAEA international recommendations for establishing regulatory frameworks for safety and security relate to one another.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗