Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “usability studies”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Systematization of Password Manager Use Cases and Design Paradigms

Despite efforts to replace them, passwords remain the primary form of authentication on the web. Password managers seek to address many of the problems with passwords by helping users generate, store, and fill strong and unique passwords. Even though experts frequently recommend password managers, there is limited information regarding their usability. To aid in designing such usability studies, we systematize password manager use cases, identifying ten essential use cases, three recommended use cases, and four extended use cases. We also systematize the system designs employed to satisfy these use cases, designs that should be examined in usability studies to understand their relative strengths and weaknesses. Finally, we describe observations from 136 cognitive walkthroughs exploring the identified essential use cases in eight popular managers. Ultimately, we expect that this work will serve as the foundation for an explosion of new research into the usability of password managers.

Simmons, James↗

Replication Package for "Union-Find and Usability: A Case Study and Analysis of Rust Formal Verifier

This replication package is a case study on automated deductive verification for Rust for practical programs. It is a companion artifact to a corresponding usability study on verification titled "Union-Find and Usability: A Case Study and Analysis of Rust Formal Verifiers". It seeks to answer the question "Can Rust developers today use Rust verifiers to verify their code?". To answer this question, the study contrasts the verification experience of two mature Rust verifiers, Creusot and Prusti, by using the tools to develop a verified implementation of union-find in Rust. The union-find implementation is based on real-world code as used in the popular egg E-graph library. The artifact consists of two different verified libraries, one using Creusot and one using Prusti. The libraries have similar Rust interfaces and high-level proofs but differ in their details: Creusot and Prusti have different annotation languages and support different proof styles. Each implementation can be verified with its respective tool and compiles as a traditional Rust development.

Sarracino, John↗

Data Collection and Analysis Challenges and Mitigation Strategies for Quantitative Human Factors Research Studies in Nuclear Power Plant Modernization

The United States (U.S.) Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) program Plant Modernization Pathway is conducting targeted research and development (R&D) to address aging and reliability concerns with the legacy instrumentation and control and related information systems of the U.S. LWR fleet. In this effort, the application of human factors engineering (HFE) provides an important role in ensuring new digital plant technologies enable broad innovation and business improvement with continued operational safety. Evaluation is a key activity in HFE, which often occurs iteratively through the system design lifecycle. While qualitative methods are important in collecting information of how users perform tasks through observations, quantitative methods are equally important in assessing system design based on performance. In collecting and analyzing this quantitative data, there are notable challenges in the nuclear HFE domain that may threaten the validity and reliability of the inferences made in these studies. Notable challenges include small sample size and limited resources, large error variance and small effect size, an “adding test features to losing degrees of freedom” dilemma, non-normal distribution, and heterogeneity of variance. The results in control room usability studies are often statistically non-significant, which makes it hard to interpret. This work discusses these challenges across different scientific viewpoints and provides real-world examples of these challenges in practice. Collectively, the objective of this work is to position these challenges to the larger data science community as a means of identifying future opportunities to address these issues.

99 GENERAL AND MISCELLANEOUS↗

An Integrated Energy Systems Prototype Human-System Interface for a Steam Extraction Loop System to Support Joint Electricity-Hydrogen Flexible Operations

Due to increasing economic competition from renewables and combined-cycle natural gas plants, nuclear power plants are looking toward flexible operations to enhance their cost competitiveness. The Integrated Energy Systems project under the Light Water Reactor Sustainability program of the U.S. Department of Energy focuses on joint electricity-hydrogen flexible operations. Joint electricity-hydrogen flexible operations entail the nuclear power plant diverting thermal energy via main steam to a hydrogen production plant located nearby. The steam serves to enhance the efficiency of the hydrogen production. Furthermore, high temperature electrolysis requires a large amount of electricity, which the plant can also provide. The plant provides steam and electricity to the hydrogen plant throughout the day, but during peak demand hours the nuclear power plant returns to solely providing electricity to meet the high demand. Through this flexible concept of operations, the plant can optimize the thermal energy it produces without having to maneuver the power of the plant. This report documents the human factors process to design and develop a prototype human-system interface for the steam extraction loop that serves as the conduit between the nuclear power plant and the adjacent hydrogen plant. The design process followed the human factors guidelines set by NUREG-0711, Human Factors Engineering Program Review Model (O’Hara, Higgins, & Fleger, 2012), and expanded upon by the Guideline for Operational Nuclear Usability and Knowledge Elicitation (GONUKE; Boring, Ulrich, Joe, & Lew, 2015; Boring, Lew, & Ulrich, 2016). The design process entailed operator interviews to determine the concept of operations for the steam extraction loop, a review and adaptation of digital interface design concepts developed by the team in prior projects, an iterative design process, and reviews conducted by both operators and human factors experts. Several versions of the prototype human-system interface were developed. Operators were interviewed to determine what design features they found useful and would like to see in the interface. The design underwent a review by human factors experts against NUREG-0700, Human Interface Design Review Guidelines (U.S. Nuclear Regulatory Commission, 2019), to ensure compliance with the latest human factors standards for digital interfaces in nuclear applications. The design was then prototyped as a functional windows-based application integrated with the Generic Pressurized Water Reactor simulator modified to include the steam extraction loop. The simulation is supported by the Human Systems Simulation Laboratory at Idaho National Laboratory, which supports operator-in-the-loop testing. This is an ongoing project and the next phase of the project entails performing an operator-in-the-loop usability study to evaluate the interface and examine the proposed concept of operations to extraction steam from the nuclear power plant for delivery to the coupled hydrogen production plant.

99 GENERAL AND MISCELLANEOUS↗

Conceptual Design of a Thermal–to-14-MeV Neutron Conversion Device for Use in the Advanced Test Reactor

Here, this paper details the conceptual design of a thermal-to-14-MeV neutron converter consisting of a mixture of lithium and deuterium in a blanket material. Such a device operates a two-step reaction, first generating tritons via thermal neutron absorption in the tritium breeding material, and in the second step, high-energy neutrons are produced either via deuterium-tritium fusion reaction or with tritium reacting with lithium. A thermal-to-14-MeV neutron converter significantly hardens the neutron spectrum by virtually removing thermal neutrons and adding a high-energy 14 MeV component to the neutron spectrum. While similar concepts have been previously proposed and tested in other reactors, the unique characteristics of the Advanced Test Reactor (ATR), namely its important thermal flux (up to $10^{15}$ n.cm$^{-2}$.s$^{-1}$) makes it markedly attractive for obtaining a very large fast neutron flux, usable for irradiation studies under neutron flux conditions prototypical of fusion reactors. The paper provides a description of a new computational scheme developed for handling the coupled neutron-triton transport mechanism using the Geant4 toolkit. Resulting neutron spectra and high-energy neutron yields are summarized for different irradiation positions and potential neutron breeder materials. Maximum predicted thermal-to-14-MeV neutron yields are on the order of $2.10^{-4}$, which is consistent with previous studies found in the literature. Thus, when placed inside the ATR, such a neutron converter will be providing the largest high-energy neutron source available for activation and irradiation studies of materials foreseen for use in fusion reactors. Future steps will involve qualifying the computational scheme using the ATR critical facility using activation foil measurements.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Trigger-based Incremental Data Processing with Unified Sync and Async Model

In recent years, more and more applications in the cloud have needs to process large-scale on-line datasets, which evolve over time as new entries are added and existing entries are modified. Several programming frameworks, such as Percolator and Oolong, are proposed for such incremental data processing and can achieve efficient processing with an event-driven abstraction. However, these frameworks are inherently asynchronous, leaving the heavy burden of managing synchronization to applications' developers, which further significantly restricts their usabilities. In this study, we propose a trigger-based incremental computing framework in the cloud, called Domino, with both synchronous and asynchronous mechanisms to coordinate parallel triggers. With this new framework, both synchronous and asynchronous applications can be seamlessly developed. Use cases and extensive evaluation results confirm that it can deliver sufficient performance, and also is easy to use for incremental applications in large-scale distributed computing.

97 MATHEMATICS AND COMPUTING↗

Machine Learning Using Rapidity-Mass Matrices for Event Classification Problems in HEP

In this work, supervised artificial neural networks (ANN) with rapidity–mass matrix (RMM) inputs are studied using several Monte Carlo event samples for various pp collision processes. The study shows the usability of this approach for general event classification problems. The proposed standardization of the ANN feature space can simplify searches for signatures of new physics at the Large Hadron Collider (LHC) when using machine learning techniques. In particular, we illustrate how to improve signal-over-background ratios in the search for new physics, how to filter out Standard Model events for model-agnostic searches, and how to separate gluon and quark jets for Standard Model measurements.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Operator Insights and Usability Evaluation of Machine Learning Assistance for Power Grid Contingency Analysis

Introducing machine learning (ML) assistance into any established process comes with adoption barriers, including entrenched procedures, technological and human readiness levels, human-machine trust, and work culture resistance to change. These barriers are even greater in critical operations such as operating a national or regional power grid, in which both regulatory frameworks and the importance of maintaining reliability levels causes additional resistance to the adoption of new computational support. Developers of future systems and job aides must consider not only technical aspects, but also whether new systems are usable by power system operators. This work presents the methodology and results of a study to evaluate the usability and readiness of a prototype recommender system for power grid contingency analysis. We explore operator cognitive load and evaluate operator performance when solving a collection of scenarios both with and without recommender assistance. We also examine operator trust in the system. We report insights gained on the readiness of the system using a collection of evaluation techniques.

Human-Machine Teaming, Power Systems, usability ev↗

A User-Centered Design Study in Scientific Visualization Targeting Domain Experts

The development of usable visualization solutions is essential for ensuring both their adoption and effectiveness. User-centered design principles, which involve users throughout the entire development process, have been shown to be effective in numerous information visualization endeavors. We describe how we applied these principles in scientific visualization over a two year collaboration to develop a hybrid in situ/post hoc solution tailored towards combustion researcher needs. Lastly, we examine the importance of user-centered design and lessons learned over the design process in an effort to aid others seeking to develop effective scientific visualization solutions.

97 MATHEMATICS AND COMPUTING↗

PRO-X Fuel Cycle Transportation and Crosscutting Progress Report

The PRO-X program is actively supporting the design of nuclear systems by developing a framework to both optimize the fuel cycle infrastructure for advanced reactors (ARs) and minimize the potential for production of weapons-usable nuclear material. Three study topics are currently being investigated by Sandia National Laboratories (SNL) with support from Argonne National Laboratories (ANL). This multi-lab collaboration is focused on three study topics which may offer proliferation resistance opportunities or advantages in the nuclear fuel cycle. These topics are: 1) Transportation Global Landscape, 2) Transportation Avoidability, and 3) Parallel Modular Systems vs Single Large System (Crosscutting Activity).

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

SCALE 6.2 Lattice Physics Performance Assessment

The US Nuclear Regulatory Commission relies on the lattice physics analysis capabilities of the SCALE code system to perform confirmatory licensing analyses. Either SCALE lattice physics code—TRITON/NEWT or Polaris—can be used to generate cross section data used by the PARCS nodal core simulator for full-core neutronics calculations. This report presents an assessment of the accuracy of SCALE lattice physics codes for preparation of lattice physics data that are used to support simulator codes such as the NRC’s PARCS, for UO 2 -mixed oxide (MOX)/Zr fueled light water reactor (LWR) analyses. Due to the nature of lattice physics calculations, critical reactor experiment benchmarks cannot be modeled in explicit detail in a lattice physics code. However, this limitation does not mean that these measurement data are not usable for lattice physics studies. Therefore, either geometry approximations or axial buckling must be implemented to determine the critical water height. These modeling limitations have led to development of a three-phase assessment strategy. In the first phase, selected critical experiment benchmarks are modeled using the SCALE 3D continuous-energy (CE) Monte Carlo (MC) code KENO, which is the most rigorous neutron transport method available in SCALE, with no approximations in the spatial, angle, or energy treatments. Biases and statistical uncertainties in quantities of interest such as k eff and pin power distributions are determined by comparing CE KENO results to experimental data. This first phase in the accuracy assessment is to demonstrate and establish the use of CE KENO as a reference solution for the second phase. In the second phase, 14 numerical test suites are used to compare SCALE lattice physics calculations with CE KENO as a reference solution. In the third phase, SCALE lattice physics depletion calculations are performed, and the spent fuel isotopic results are compared with available radiochemical assay measurements. Isotopic measurement comparisons provide quantitative assessment of isotopic density distribution predictions with the depletion models in SCALE lattice physics codes. This report documents results for all test suites. The assessment was performed using standard production techniques unless otherwise noted. Both TRITON/NEWT and Polaris exhibited acceptable accuracy for most test cases. For the few test cases in which acceptable accuracy criteria were not met, further code and data development are planned. The computer codes used in this assessment are as follows: SCALE 6.2 rev19189 (pre-release of 6.2.1) was used for CE KENO, TRITON/NEWT and Polaris (PWR only) calculations; SCALE 6.2.2 was used for Polaris calculations to address several updates in support of support boiling water reactor (BWR) lattice geometries. For this work, there is no difference between SCALE 6.2.1 and SCALE 6.2.2 beyond the inclusion of the Polaris BWR analysis capability; The ENDF/B-VII.1 continuous energy and 252 group libraries deployed in SCALE 6.2 were generated with AMPX 6.2 that is distributed with SCALE.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Computational Optimization of Room Temperature Usable Capacity for Hydrogen Storage in MFU-4-Type Metal–Organic Frameworks via Pairwise Metal Substitutions

The efficient storage of hydrogen is a critical challenge in the quest for sustainable energy solutions. Current adsorbent-based methods achieve satisfactory storage densities predominantly under cryogenic temperatures and/or high pressures, which imposes problems with cost-efficient and safe implementation of this technology. Materials that can bind hydrogen gas reversibly at ambient temperatures and more moderate pressures could play a pivotal role in enabling hydrogen-powered technologies. In this study, we use reliable computational modeling to investigate two synthetically feasible paths for tuning the enthalpy of H2 binding in MFU-4-type metal–organic frameworks (MOFs), aiming to maximize usable capacity. This study examines MIM4 IICl3(bta)6 (bta– = benzotriazolate) Kuratowski-type clusters as a model for strong binding sites in MFU-4l frameworks. We systematically evaluate the impact of separately tuning the central MII metal ion (which plays a structural role) and the peripheral MI metal ion (which binds the substrate) on the energetics of H2 binding. Our computational study reveals that H2 binding at an MI site mostly follows the trend AgI < CuI < NiI < CoI < AuI while a larger central MII site generally weakens the H2 binding at a MI site. Importantly, we have identified three new combinations of MI and MII to achieve high fractional usable capacities of the total H2 adsorbed under a pressure swing from 5 to 100 bar at room temperature. Additionally, we examine the nature of the binding interaction between the peripheral metal atom and the hydrogen molecule. While charge transfer predominantly induces this interaction, for several atom combinations, a change in the polarization (associated with variations in the ionic radius of the MI binding atom) is another important factor for adjusting the strength of the interaction. We suggest that the proposed compositions of Kuratowski-type clusters are highly desirable synthetic targets for future laboratory study.

Tkachenko, Nikolay V↗

Dark Energy Studies with LSST using the Photon Simulator (Final Report)

This grant funded the development and dissemination of the Photon Simulator (PhoSim) for the purpose of studying dark energy at high precision with the upcoming Large Synoptic Survey Telescope (LSST) astronomical survey. The work was in collaboration with the Dark Energy Science Collaboration (DESC). Several detailed physics improvements were made in the optics, atmosphere and sensor, a number of validation studies were performed, and a significant number of usability features were implemented. Future work in DESC will use PhoSim as the image simulation tool for data challenges used by the analysis groups.

79 ASTRONOMY AND ASTROPHYSICS↗

HydrogenAR: Interactive Data-Driven Presentation of Dispenser Reliability: Preprint

When delivering presentations to a co-located audience, we typically use slides with text and 2D graphics to complement the spoken narrative. Though presentations have largely been explored on 2D media, augmented reality (AR) allows presentation designers to add data and augmentations to existing physical infrastructure on display. This could provide a more engaging experience to the audience and support comprehension. With HydrogenAR, we present a novel application that leverages the benefits of data-driven storytelling with those of AR to explain the unique challenges of hydrogen dis- penser reliability. Utilizing physical props, situated data, and virtual augmentations and animations, HydrogenAR serves as a unique presentation tool, particularly critical for stakeholders, tour groups, and VIPs. HydrogenAR is a product of multiple collaborative de- sign iterations with a local Hydrogen Fuel research team and is evaluated through interviews with team members and a user study with end-users to evaluate the usability and quality of the interactive AR experience. Through this work, we provide design considera- tions for AR data-driven presentations and discuss how AR could be used for innovative content delivery beyond traditional slide-based presentations.

augmented reality↗

Modeling the impact of extreme summer drought on conventional and renewable generation capacity: Methods and a case study on the Eastern U.S. power system

Across recent years, there has been a growing prevalence of extreme weather events throughout the United States, posing significant challenges to the reliable and resilient operation of power systems. Specifically, summer droughts threaten to severely reduce available generation capacity to meet regional electricity demand, potentially leading to power outages. This underscores the importance of accurate resource adequacy (RA) assessment to ensure the reliable operation of the nation’s energy infrastructure. Accurately evaluating the usable capacity of regional generation fleets is a challenging undertaking due to the intricate interactions between power systems and hydro-climatic systems. Here, this paper proposes a systematic and analytical framework to evaluate the impacts of extreme summer drought events on the available capacity of various generating technologies, incorporating both meteorological and hydrologic factors. The framework provides detailed plant-level capacity derating models for hydroelectric, thermoelectric, and renewable power plants, facilitating evaluations with high temporal and spatial resolution. The application of the proposed impact assessment framework to the 2025 generation fleet of the real-world power system within the PJM and SERC regions of the United States yields insightful results. By analyzing the daily usable capacity of 6,055 at-risk generators across the study region, it shows that the summer capacity deration is most significant for hydroelectric and once-through thermal power plants, followed by recirculating thermal power plants and combustion turbines. In the event of the recurrence of the 2007 southeastern summer drought event in the near future, the generation fleet could experience a substantial reduction in available capacity, estimated at approximately 8.5 GW, compared to typical summer conditions. The sensitivity analysis reveals that the usable capacity of the generation fleet would suffer an even more significant decrease under conditions of increasingly severe summer droughts. The proposed approach and the findings of this study provide valuable methodologies and insights, empowering stakeholders to bolster the resilience of power systems against the potentially devastating effects of future extreme drought events.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A reactive separation process for pre-combustion CO 2 capture employing oxygen-blown coal gasifier off-gas

In this paper, we present an experimental study of a reactive separation system, consisting of a membrane reactor (MR) and an adsorptive reactor (AR) operating in tandem, with the MR’s reject stream serving as the AR’s feed. We investigates the feasibility of applying this MR-AR system for high-purity H 2 production and simultaneous CO 2 capture via the water gas shift (WGS) reaction in the context of Integrated Gas Combined Cycle (IGCC) power generation employing oxygen-blown gasifier syngas from biomass and coal. We previously studied this MR-AR system for the IGCC process employing air-blown gasifier syngas, for which it demonstrated good performance, attaining high conversion exceeding equilibrium, producing ultra-pure H 2 for power generation, and a CO 2 stream ready for sequestration. In this study, we focus on oxygen-blown gasifier off-gas that contains no N 2 , with composition distinctly different from the air-blown gasifier syngas which has a large N 2 content. We employ a carbon molecular sieve membrane (CMSM), a commercial sour-shift WGS catalyst, and a hydrotalcite (HTC) adsorbent. We carried out experiments to determine membrane performance and to identify promising operating conditions in an IGCC-relevant environment. The CMSM proved robust during a long-term (~344 hr run) experimental run under high temperature and pressure maintaining a high He/N 2 selectivity (~170). Multi-cycle runs were carried out during which the MR-AR system displayed superior performance to that of a PBR, by producing a high purity H 2 product directly usable in power generation. Therefore, the findings from this study demonstrate the ability of the MR-AR system to operate stably for a broad range of gasifier off-gas compositions, and indicate its potential for integration into IGCC plants for power generation with CO 2 capture.

01 COAL, LIGNITE, AND PEAT↗

Draft genome of multiple resistance donor plant Sinapis alba: An insight into SSRs, annotations and phylogenetics

Sinapis alba is a wild member of the Brassicaceae family reported to possess genetic resistance against major biotic and abiotic stresses of oilseed brassicas. However, the resistance nature of S. alba was not exploited generously due to the unavailability of usable genome sequences in public databases. Therefore, the present study was conducted to assemble the first draft genome from raw whole genome shotgun sequences with annotation and develop simple sequence repeat markers for molecular genetics and marker-assisted breeding. Results The raw genome sequences had 96x coverage on the Illumina platform with 170 Gbp data. The developed assembly by SOAPdenovo2 has ~459 Mbp genome size covered in 403,423 contigs with an average size of 1138.04 bp. The assembly was BLASTX with Arabidopsis thaliana which showed 32.9% positive hits between both plants. The top hit species distribution analysis showed the highest similarity with A. thaliana. A total of 809,597 GO level annotations were recorded after BLASTX results, and 34,012 sequences were annotated with different enzyme codes grouped under seven classes. The gene prediction tool AUGUSTUS identified 113,107 probable genes with an average size of 684 bp. The biochemical pathway annotation assigned 16,119 potential genes to 152 KEGG maps and 1751 enzyme codes. The development of potential SSRs from the de-novo assembly yielded 70731 unique primer pairs. Out of 159 randomly selected SSR markers for validation, 149 successfully amplified in S. alba. However, 10 SSR markers did not amplify during the validation experiment. Conclusion The annotated genome assembly with a large number of SSRs was developed in the present study. To the best of our knowledge, this is the first report of S. alba genome assembly development, annotation, and SSRs mining to date. The data presented here will be a very important resource for future crop improvement programs, especially for resistant breeding.

59 BASIC BIOLOGICAL SCIENCES↗

Irradiation of ultrasonic sensors and adhesive couplants for application in light water reactor primary loop piping and components

The Electric Power Research Institute (EPRI) Nuclear Sector and US Department of Energy Light Water Reactor Sustainability Program are committed to engaging in research and development endeavors to address materials aging issues specific to long term operation of light water power reactors. To this effect, EPRI launched an industry initiative to develop nondestructive evaluation systems for online monitoring of existing cracks in light water reactor primary coolant loop piping and components. One of the goals of this initiative is to develop a sensor system (or systems) that can determine nondestructively if cracks are growing or arrested and, in the case of the former, to characterize their growth rates. A missing component of this initiative is an experimental assessment of how sensors and adhesive couplants will perform in service when exposed to chronic energetic neutron radiation, particularly at the primary coolant loop hot and cold leg dissimilar metal welds, which join the primary loop piping to the reactor pressure vessel and reside in the vicinity of the reactor core. The objective of this experimental study was to determine how ultrasonic transducers and adhesive couplants perform when exposed to irradiation in a test reactor to simulate and accelerate in-service exposure. Further, to achieve this objective, the signal stability of piezoelectric transducers and performance of adhesive couplants as a function of accumulated fast neutron fluence were characterized by collecting ultrasonic data in-situ during irradiation. Of particular interest were the ultrasonic signal quality and time decay of the amplitude of acoustic reflections as a function of fast neutron fluence. The results of the study showed that, of the 8 transducer/substrate sample assemblies tested, only 3 generated usable ultrasonic signals through the conclusion of the irradiation campaign. It was found that high temperature epoxy tends to ultrasonically couple the sensors to the substrates better than three types of refractory ceramic cements studied, as is supported by post irradiation examination. The results obtained through this experimental study will be utilized in the achievement of the overall goal of development of a sensor system to perform online monitoring of primary loop components.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗