Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “trustworthiness”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

A Spatiotemporal-Aware Weighting Scheme for Improving Climate Model Ensemble Predictions

Multimodel ensembling has been widely used to improve climate model predictions, and the improvement strongly depends on the ensembling scheme. In this work, we propose a Bayesian neural network (BNN) ensembling method, which combines climate models within a Bayesian model averaging framework, to improve the predictive capability of model ensembles. Our proposed BNN approach calculates spatiotemporally varying model weights and biases by leveraging individual models' simulation skill, calibrates the ensemble prediction against observations by considering observation data uncertainty, and quantifies epistemic uncertainty when extrapolating to new conditions. More importantly, the BNN method provides interpretability about which climate model contributes more to the ensemble prediction at which locations and times. Thus, beyond its predictive capability, the method also brings insights and understanding of the models to guide further model and data development. In this study, we design experiments using an ensemble of CMIP6 climate model simulations to illustrate the BNN ensembling method's capability with respect to prediction accuracy, interpretability, and uncertainty quantification (UQ). We demonstrate that BNN can correctly assign larger weights to the regions and seasons where the individual model fits the observation better. Moreover, its offered interpretability is consistent with our understanding of localized climate model performance. Additionally, BNN shows an increasing uncertainty when the prediction is farther away from the period with constrained data, which appropriately reflects our trustworthiness of the models in the changing climate.

54 ENVIRONMENTAL SCIENCES↗

Exploring Data Set Bias and Decision Support with Predictive Uncertainty Through Bayesian Approximations and Convolutional Neural Networks

Individual seismic catalogs can contain multiscale observations from fault level to global scales and associated waveforms from discrete events reflect crustal structure across many different scales and locations. Seismic network aperture, geographic location, and observation distance may not provide informative guidance or intuition on how different catalogs will behave across models trained under different conditions. We rely on uncertainty to provide guardrails for when to trust model decisions, but understanding when our uncertainty is trustworthy is an open challenge. Here, in this work, we explore Bayesian approximation methods for assigning predictive uncertainty in seismic event classification problems. We find that computationally expensive Bayesian approximations do not outperform simple ensemble methods. We also find that when exploiting multiple seismic event catalogs, joint training with data from all the catalogs combined with Bayesian approximations and supervised training for classification can obscure bias and result in less robust uncertainty while also not providing substantial performance benefits compared to training individual models for each catalog.

58 GEOSCIENCES↗

Assessing convergence in global sensitivity analysis: a review of methods for assessing and monitoring convergence

In global sensitivity analysis (GSA) of a model, a proper convergence analysis of metrics is essential for ensuring a level of confidence or trustworthiness in sensitivity results obtained, yet is somewhat deficient in practice. The level of confidence in sensitivity measures, particularly in relation to their influence and support for decisions from scientific, social and policy perspectives, is heavily reliant on the convergence of GSA. We review the literature and summarize the available methods for monitoring and assessing convergence of sensitivity measures based on application purposes. The aim is to expose the various choices for convergence assessment and encourage further testing of available methods to clarify their level of robustness. Furthermore, the review identifies a pressing need for comparative studies on convergence assessment methods to establish a clear hierarchy of effectiveness and encourages the adoption of systematic approaches for enhanced robustness in sensitivity analysis.

54 ENVIRONMENTAL SCIENCES↗

Evaluating Deception Detection Model Robustness To Linguistic Variation

With the increasing use of automated, machine learning-driven tools and the downstream impact that algorithmic judgements can have, it is critical to develop models that are robust to evolving or manipulated inputs. Evaluating the reliability of multimodal models across linguistic variations to understand model susceptibility to intentional linguistic adversarial attacks as well as natural linguistic variations is essential in this pursuit. We present extensive analysis of model robustness and susceptibility to linguistic variations in the setting of deceptive news detection, a difficult classification task that is an increasingly important problem to solve with the impact of misinformation spread online. We evaluate the effectiveness of incorporating adversarial defense strategies and measure model susceptibility to state-of-the-art adversarial attacks using two types of linguistic attacks — character and word perturbations. We consider two multiclass prediction tasks — a 3-way classification of tweets as trustworthy, propaganda, or disinformation; and a 4-way classification as clickbait, hoax, satire, or conspiracy — and compare the performance of three embeddings that have been state-of-the-art for several NLP tasks — GloVe, ELMo, and BERT — to highlight consistent trends in susceptibility, high confidence misclassifications, and high impact failures. We find that character or mixed ensemble models are the most effective defense mechanisms and that character perturbations are a more effective attack than word perturbations for deception classification.

adversarial evaluation↗

ORCHID: Orchestrated Retrieval-Augmented Classification of High-Risk Property with Intelligent Decision-Making

High-Risk Property (HRP) classification is critical at U.S. Department of Energy (DOE) sites, where inventories include sensitive and often dual-use equipment. Compliance must track evolving rules designated by various export control policies to make transparent and auditable decisions. Traditional expert-only workflows are time-consuming, backlog-prone, and struggle to keep pace with shifting regulatory boundaries. We propose ORCHID, a modular agentic framework for HRP classification that pairs retrieval-augmented generation (RAG) with human oversight to produce policy based outputs that can be audited. Small cooperating agents—retrieval, description refiner, classifier, validator, and feedback logger—coordinate via agent-to-agent messaging and invoke tools through the Model Context Protocol (MCP) for model-agnostic on-premise operation. The interface follows an "Item to Evidence to Decision" loop with step-by-step reasoning, on-policy citations, and append-only audit bundles (run-cards, prompts, evidence). In preliminary tests on real HRP cases, ORCHID improves accuracy and traceability over a non-agentic baseline while deferring uncertain items to Subject Matter Experts (SMEs). The demonstration shows single item submission, grounded citations, SME feedback capture, and exportable audit artifacts—illustrating a practical path to trustworthy LLM assistance in sensitive DOE compliance workflows.

Das, Sanjay [ORNL] (ORCID:0009000542591915)↗

Raman investigation of the uranium compounds U 3 O 8 , UF 4 , UH 3 and UO 3 under pressure at room temperature

Our current state-of-the-art X-ray diffraction experiments are primarily sensitive to the position of the uranium atom. While the uranium - low-Z element bond (such as U-H or U-F) changes under pressure and temperature the X-ray diffraction investigations do not reveal information about the bonding or the stoichiometry. Questions that can be answered by Raman spectroscopy are (i) whether the bonding strength changes under pressure, as observed by either blue- or red-shifted peaks of the Raman active bands in the spectrum and (ii) whether the low-Z element will eventually be liberated and leave the host lattice, i.e. do the fluorine, oxygen, or hydrogen atoms form dimers after breaking the bond to the uranium atom. Therefore Raman spectra were also collected in the range where those decomposition products would appear. Raman is particularly well suited to these types of investigations due to its sensitivity to trace amounts of materials. One challenge for Raman investigations of the uranium compounds is that they are opaque to visible light. They absorb the incoming radiation and quickly heat up to the point of decomposition. This has been dealt with in the past by keeping the incoming laser power to very low levels on the tens of milliWatt range consequently affecting signal to noise. Recent modern investigations also used very small laser spot sizes (micrometer range) but ran again into the problem of heating and chemical sensitivity to the environment. In the studies presented here (in contrast to all other studies that were performed at ambient conditions only) we employ micro-Raman spectroscopy of samples situated in a diamond anvil cell. This increases the trustworthiness of the obtained data in several key-aspects: (a) We surrounded the samples in the DAC with neon as a pressure transmitting medium, a noble gas that is absolutely chemically inert. (b) Through the medium the sample is thermally heat sunk to the diamond anvils, diamond of course possessing the very best heat conductivity of any material. Therefore local heating and decomposition are avoided, a big challenge with other approaches casting doubts on their results. (c) This in turn benefits the signal/noise ratio tremendously since the Raman features of uranium-compounds are very small. The placement of the samples in DACs allows for higher laser powers to impinge on the sample spot while keeping the spot-size larger than in previous studies and keep the samples from heating up. Raman spectroscopy is a very sensitive non-invasive technique and we will show that it is even possible to distinguish the materials by their origin / manufacturer as we have studied samples from Cameco (Canada) and IBI-Labs (US-Florida) and can compare with ambient literature data for samples from Strem (US-MA) and Areva (Pierrelatte, France).

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

A new time-dependent analytic model for radiation-induced photocurrent in finite 1D epitaxial diodes

Photocurrent generated by ionizing radiation represents a threat to microelectronics in radiation environments. Circuit simulation tools such as SPICE can be used to analyze these threats, and typically rely on compact models for individual electrical components such as transistors and diodes. Compact models consist of a handful of differential and/or algebraic equations, and are derived by making simplifying assumptions to any of the many semiconductor transport equations. Historically, many photocurrent compact models have suffered from accuracy issues due to the use of qualitative approximation, rather than mathematically correct solutions to the ambipolar diffusion equation. A practical consequence of this inaccuracy is that a given model calibration is trustworthy over only a narrow range of operating conditions. This report describes work to produce improved compact models for photocurrent. Specifically, an analytic model is developed for epitaxial diode structures that have a highly doped subcollector. The analytic model is compared with both numerical TCAD calculations, as well as the compact model described in reference. The new analytic model compares well against TCAD over a wide range of operating conditions, and is shown to be superior to the compact model from reference.

99 GENERAL AND MISCELLANEOUS↗

The Structure of Jets at Hadron Colliders

Particle physics seeks to understand the interactions and properties of the fundamental particles. To gain understanding, there is an interplay between theory and experiment. Models are proposed to explain how particles behave and interact. These models make precise predictions that can be tested. Experiments are built and executed to measure the properties of these particles, providing necessary tests for the theories that attempt to explain the realm of fundamental particles. However, there is also another level of interaction between theory and experiment; the development of new experiments demands the study of how particles will behave with respect to the measured observables toward the goal of understanding the details and idiosyncrasies of the measurements very well. Only once these are well-modeled and understood can one be con dent that the data that are measured is trustworthy. The modeling and interpretation of the physics of a proton collider, such as the LHC, is the main topic of this thesis.

43 PARTICLE ACCELERATORS↗

Roadmap to a Sustainable Structured Trusted Employee Program

Organizations (facility, regulatory agency, or country) have a compelling interest in ensuring that individuals who occupy sensitive positions affording access to chemical biological, radiological and nuclear (CBRN) materials facilities and programs are functioning at their highest level of reliability. Human reliability and human performance relate not only to security but also focus on safety. Reliability has a logical and direct relationship to trustworthiness for the organization is placing trust in their employees to conduct themselves in a secure, safe, and dependable manner. This document focuses on providing an organization with a roadmap to implementing a successful and sustainable Structured Trusted Employee Program (STEP).

Coates, Cameron W.↗

Electronic Safety Resource Tools -- Supporting Hydrogen and Fuel Cell Commercialization

The Pacific Northwest National Laboratory (PNNL) Hydrogen Safety Program conducted a planning session in Los Angeles, CA on April 1, 2014 to consider what electronic safety tools would benefit the next phase of hydrogen and fuel cell commercialization. A diverse, 20-person team led by an experienced facilitator considered the question as it applied to the eight most relevant user groups. The results and subsequent evaluation activities revealed several possible resource tools that could greatly benefit users. The tool identified as having the greatest potential for impact is a hydrogen safety portal, which can be the central location for integrating and disseminating safety information (including most of the tools identified in this report). Such a tool can provide credible and reliable information from a trustworthy source. Other impactful tools identified include a codes and standards wizard to guide users through a series of questions relating to application and specific features of the requirements; a scenario-based virtual reality training for first responders; peer networking tools to bring users from focused groups together to discuss and collaborate on hydrogen safety issues; and a focused tool for training inspectors. Table ES.1 provides results of the planning session, including proposed new tools and changes to existing tools.

08 HYDROGEN↗

ASCR Cybersecurity for Scientific Computing Integrity - Research Pathways and Ideas Workshop

At the request of the U.S. Department of Energy's (DOE) Office of Science (SC) Advanced Scientific Computing Research (ASCR) program office, a workshop was held June 2-3, 2015, in Gaithersburg, MD, to identify potential long term (10 to +20 year) cybersecurity fundamental basic research and development challenges, strategies and roadmap facing future high performance computing (HPC), networks, data centers, and extreme-scale scientific user facilities. This workshop was a follow-on to the workshop held January 7-9, 2015, in Rockville, MD, that examined higher level ideas about scientific computing integrity specific to the mission of the DOE Office of Science. Issues included research computation and simulation that takes place on ASCR computing facilities and networks, as well as network-connected scientific instruments, such as those run by various DOE Office of Science programs. Workshop participants included researchers and operational staff from DOE national laboratories, as well as academic researchers and industry experts. Participants were selected based on the submission of abstracts relating to the topics discussed in the previous workshop report [1] and also from other ASCR reports, including "Abstract Machine Models and Proxy Architectures for Exascale Computing" [27], the DOE "Preliminary Conceptual Design for an Exascale Computing Initiative" [28], and the January 2015 machine learning workshop [29]. The workshop was also attended by several observers from DOE and other government agencies. The workshop was divided into three topic areas: (1) Trustworthy Supercomputing, (2) Extreme-Scale Data, Knowledge, and Analytics for Understanding and Improving Cybersecurity, and (3) Trust within High-end Networking and Data Centers. Participants were divided into three corresponding teams based on the category of their abstracts. The workshop began with a series of talks from the program manager and workshop chair, followed by the leaders for each of the three topics and a representative of each of the four major DOE Office of Science Advanced Scientific Computing Research Facilities: the Argonne Leadership Computing Facility (ALCF), the Energy Sciences Network (ESnet), the National Energy Research Scientific Computing Center (NERSC), and the Oak Ridge Leadership Computing Facility (OLCF). The rest of the workshop consisted of topical breakout discussions and focused writing periods that produced much of this report.

97 MATHEMATICS AND COMPUTING↗

Benchmarking Current and Emerging Approaches to Infrasound Signal Classification

Low frequency sound ≤ 20 Hz, known as infrasound, is generated by a variety of natural and anthropogenic sources. Following an event, infrasonic waves travel through a dynamic atmosphere that can change on the order of minutes. This makes infrasound event classification a difficult problem as waveforms from the same source type can look drastically different. Event classification usually requires ground truth information from seismic or other methods. This is time consuming, inefficient, and does not allow for a classification if the event locates somewhere other than a known source, the location accuracy is poor, or ground truth from seismic data is lacking. Here we compare the performance of the state of the art for infrasound event classification, support vector machine (SVM), to the performance of a convolutional neural network (CNN), a method that has been proven in tangential fields such as seismology. For a 1-class catalog consisting of only volcanic activity and earthquake events, the 4-fold average SVM classification accuracy is 75%, while it is 74% when using a CNN. Classification accuracies from the 4-class catalog consisting of the most common infrasound events detected at the global scale are 55% and 56% for the SVM and CNN architectures, respectively. These results demonstrate that using a CNN does not increase performance for infrasound event classification. This suggests that SVM should be the preferred classification method as it is a simpler and more trustworthy architecture and can be tied to the physical properties of the waveforms. The SVM and CNN algorithms described in this paper are not yet generalizable to other infrasound event catalogs. We anticipate this study to be a starting point for the development of large and comprehensive, systematically labeled, infrasound event catalogs as such catalogs will be necessary to provide an increase in the value of deep learning on event classification.

47 OTHER INSTRUMENTATION↗

Blockchain Smart Contracts for Transactive Energy Systems

This report demonstrates the impact of blockchain technology underlying a transactive energy system and articulates details and principle components of each of five stages in a transactive energy system. This report depicts the engineering requirements of a sample market system, blockchain features, and the relationship between those requirements and features (Section 2.2). Clear value propositions of blockchain features for transactive energy systems are: identity management, security of data, resiliency, decentralization and smart contract trustworthiness, performance, integrity in a trustless environment and access control. Due to the immutability afforded by blockchain architecture, increased data fidelity could potentially help detect targeted cyber-attacks and increase resiliency of grid integration. A distributed system can be more fault tolerant and enable transactive energy by supporting machine-to-machine transactions that can be integrated directly into complex grid operations without the need of trust in a third party. Energy auctions, and potentially registration processes, can be carried out according to transparent rules implemented as smart contracts (Section 4.0). In this current experiment, we ran a use-case/table-top exercise that imitated a real-time 5-min double auction market. The objective of this demonstration is to investigate the applicability of blockchain with transactive energy systems (Section 3.0).

24 POWER TRANSMISSION AND DISTRIBUTION↗

Establishing a sustainable regulatory framework for the security of radioactive sources through harmonization with a safety regulatory framework

In order to establish and maintain sustainable nuclear security regulatory infrastructures for radioactive sources, it is important for States to develop nuclear security regulations with regulatory requirements and relevant criteria for security, which are consistent and well integrated with those for radiation safety. In establishing national regulations, experts worldwide follow the international recommendations on safety and security of radioactive sources published by the International Atomic Energy Agency (IAEA). Within the IAEA publications on safety and security of radioactive sources, some international recommendations are identical or very similar for both safety and security, for example, the requirement for the establishment of a national registry of radioactive sources. However, some other international recommendations are unique to the security area, such as the recommendation to examine the trustworthiness of employees, or to the safety area, such as the need to establish public exposure controls. Additionally, many international recommendations fall somewhere in between, such as the need for effective authorization of facilities and activities, a regulatory inspection and enforcement regime and the graded approach to establish and apply regulatory requirements. This paper examines how the IAEA international recommendations for establishing regulatory frameworks for safety and security relate to one another.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Lights, camera, commitment: Mick Greenbank’s 25 years as a Lab photographer

Mick Greenbank flips through a 3-ring binder as he sits in a TA-55 conference room, reminiscing about the nearly 25 years he’s spent working as a LANL photographer. Paging through certificates, noteworthy letters and emails, and old lists of goals and tasks, he explains that he’s stayed a TA-55 photographer for a quarter of a century because he “just wants to shoot.” Over that time, he became known as a trustworthy and committed team player who’s always ready to lend a camera-filled hand.

99 GENERAL AND MISCELLANEOUS↗

Keyless Infrastructure Security Solution (KISS): VOLTTRON™ KSI ® Blockchain Design and Specification

This document provides the technical design specifications that are required for Keyless Infrastructure Security Solution (KISS) development, including, definitions and roles of the new KISS-related products—GridAware and LinkLite—an overview of the DNP3 communications the VOLTTRON™ DNP3 agent is using for distribution control, data flow, historian processing, setup, and installation. These technical specifications provide step-by-step instructions for configuration, implementation, and deployment of the KISS subsystem, docket creation, and verification using the GridAware dashboard. Based on this document and the KISS specification requirements and device risk assessment documents, KISS will be developed by integrating keyless signature infrastructure (KSI) blockchain to increase the cybersecurity, integrity, and trustworthiness of critical energy delivery systems (EDSs). The KISS architecture consists of a VOLTTRON™ agent-based distribution control system platform and GridAware (KSI blockchain capability) for secure energy exchanges in a decentralized electrical network.

42 ENGINEERING↗

Position Papers for the ASCR Workshop on Cybersecurity and Privacy for Scientific Computing Ecosystems

At the request of the Department of Energy's (DOE) Office of Advanced Scientific Computing Research (ASCR), this program committee has been tasked with organizing a workshop to identify basic research needs in cybersecurity and privacy to better support DOE's science and energy mission. As part of the process, the program committee is soliciting community input in the form of position papers to help identify significant use cases, facility issues, and other barriers to enabling verifiably trustworthy computational science while preserving data confidentiality as appropriate for scientific workflows of interest to DOE. The program committee will review these position papers and based on the fit of their area of expertise and interest, selected contributors will have the opportunity to participate in the workshop currently planned as a virtual event November 3-5th, 2021. The thrust areas that will be explored by this workshop are the following: (1) Algorithms for secure, scalable, privacy-enhancing technologies and frameworks, including: Federated AI/ML, Differential privacy, Randomized algorithms, Adversarial modeling & simulation, Graph algorithms, and Formal methods; (2) Platforms to support the entire scientific-computing ecosystem, including edge computing for large-scale experiments, focusing on heterogeneous systems and distributed systems, including: Heterogeneous computing systems, Distributed computing systems, and Secure data architectures; and (3) Data workflows to allow agile use of data while preserving integrity and privacy, making the important properties verifiable either at runtime or post-computation, including: Integrity and provenance and Data management infrastructure. Topics that are out-of-scope for the workshop include discussing specific proposed solutions or areas that are clearly out of DOE's fundamental and applied-sciences mission scope, e.g., cryptography, enterprise security, and general-operations technology.

97 MATHEMATICS AND COMPUTING↗