Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “user study”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Agent-based Large-Scale Emergency Evacuation Using Real-Time Open Government Data

The open government initiatives have provided tremendous data resources for the transportation system and emergency services in urban areas. This paper proposes a traffic simulation framework using high temporal resolution demographic data and real time open government data for evacuation planning and operation. A comparison study using real-world data in Seattle, Washington is conducted to evaluate the framework accuracy and evacuation efficiency. The successful simulations of selected area prove the concept to take advantage open government data, open source data, and high resolution demographic data in emergency management domain. There are two aspects of parameters considered in this study: user equilibrium (UE) conditions of traffic assignment model (simple Non-UE vs. iterative UE) and data temporal resolution (Daytime vs. Nighttime). Evacuation arrival rate, average travel time, and computation time are adopted as Measure of Effectiveness (MOE) for evacuation performance analysis. The temporal resolution of demographic data has significant impacts on urban transportation dynamics during evacuation scenarios. Better evacuation performance estimation can be approached by integrating both Non-UE and UE scenarios. The new framework shows flexibility in implementing different evacuation strategies and accuracy in evacuation performance. The use of this framework can be explored to day-to-day traffic assignment to support daily traffic operations.

big data↗

Towards Semantic Search in Building Sensor Data

This paper presents a search engine system for sensor time series data and metadata in the context of building management. It takes natural language queries as input, retrieves sensor time series data, ranks them with respect to their relevance to a given query, and visualizes the time series as search results. In addition, the system allows users to interact with the search results: they can define events of interest in the visualized results and search across sensor data for similar events, i.e., the search by example scheme. Quantitative evaluations and user studies demonstrate the value of this system for managing building sensor data.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Standards Quick Guide

This report contains a list of relevant standards developed or in development for the cybersecurity of solar energy resources. It outlines different types of standards, such as industry standards, enforceable regulations, and conceptual relevant cybersecurity studies. Users may use this quick guide as a tool to enhance understanding of existing standards and for brainstorming new ideas to help states improve the cybersecurity of solar energy resources in their jurisdiction through innovative policy.

14 SOLAR ENERGY↗

How Humans versus Bots React to Deceptive and Trusted News Sources: A Case Study of Active Users

Society's reliance on social media as a primary source of news has spawned a renewed focus on the spread of misinformation. In this work, we identify the differences in how social media accounts identified as bots react to news sources of varying credibility, regardless of the veracity of the content those sources have shared. We analyze bot and human responses annotated using a fine-grained model that labels responses as being an answer, appreciation, agreement, disagreement, an elaboration, humor, or a negative reaction. We present key findings of our analysis into the prevalence of bots, the variety and speed of bot and human reactions, and the disparity in authorship of reaction tweets between these two sub-populations. We observe that bots are responsible for 9-15% of the reactions to sources of any given type but comprise only 7-10% of accounts responsible for reaction-tweets; trusted news sources have the highest proportion of humans who reacted; bots respond with significantly shorter delays than humans when posting answer-reactions in response to sources identified as propaganda. Finally, we report significantly different inequality levels in reaction rates for accounts identified as bots vs not.

social media, deception↗

National Hurricane Program Hurricane Evacuation Study Tool End-User Engagement and Usability Analysis

The Hurricane Evacuation Study (HES) Tool prototype is a key component of the Federal Emergency Management Agency (FEMA) National Hurricane Program (NHP) Technology Modernization (TM) effort. To ensure the HES Tool captured the necessary capabilities and functionality, engagement with potential end-users and key stakeholders was considered a priority throughout development. Pilot studies with representatives from North Carolina and New York City were done to validate the HES Tool process with their current HES undertaking. These pilot studies let the development of additional capabilities and feedback on the needs of diverse regions. A usability study was carried out with key stakeholders identified by NHP leadership through individualized sessions with identified personnel. The results showed the value of the HES Tool compared to the current process as well as key issues that must be addressed to ensure a final transition.

54 ENVIRONMENTAL SCIENCES↗

U.S. Nuclear Regulatory Commission Extremely Low Probability of Rupture pilot study : xLPR framework model user's guide.

For the U.S. Nuclear Regulatory Commission (NRC) Extremely Low Probability of Rupture (xLPR) pilot study, Sandia National Laboratories (SNL) was tasked to develop and evaluate a probabilistic framework using a commercial software package for Version 1.0 of the xLPR Code. Version 1.0 of the xLPR code is focused assessing the probability of rupture due to primary water stress corrosion cracking in dissimilar metal welds in pressurizer surge nozzles. Future versions of this framework will expand the capabilities to other cracking mechanisms, and other piping systems for both pressurized water reactors and boiling water reactors. The goal of the pilot study project is to plan the xLPR framework transition from Version 1.0 to Version 2.0; hence the initial Version 1.0 framework and code development will be used to define the requirements for Version 2.0. The software documented in this report has been developed and tested solely for this purpose. This framework and demonstration problem will be used to evaluate the commercial software's capabilities and applicability for use in creating the final version of the xLPR framework. This report details the design, system requirements, and the steps necessary to use the commercial-code based xLPR framework developed by SNL.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Status and Development of Pulsed Magnets at the NHMFL Pulsed Field Facility

The National High Magnetic Field Laboratory's Pulsed Field Facility at Los Alamos National Laboratory is one of few research centers in the world that can create and use ultrahigh pulsed magnetic field for scientific research. The facility houses several types of nondestructive pulsed magnets which can provide the peak fields ranging from 60 to 100 T for users. This study will report the status of the user magnets and recent magnet developments to improve the quality and magnetic fields of our user magnets. In particular, this paper will present a new cooling technique that significantly reduces the cooling time without affecting the mechanical performance of the magnets. A possible upgrade of our facility with a new duplex magnet that is powered by a 4-MJ capacitor bank to deliver 80 T for users will be also reported. Finally, in addition, we will discuss some valuable lessons learned from magnet failures at our facility and possible further magnet design improvements to increase the magnet longevity or peak magnetic fields.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Fuel Cell Backup Power System for Grid-Service and Micro-Grid in Telecommunication Applications

This paper presents the feasibility and economics of using fuel cell backup power systems in telecommunication cell towers to provide grid services (e.g., ancillary services, demand response). The fuel cells are able to provide power for the cell tower during emergency conditions. This study evaluates the strategic integration of clean, efficient, and reliable fuel cell systems with the grid for improved economic benefits. The backup systems have potential as enhanced capability through information exchanges with the power grid to add value as grid services that depend on location and time. The economic analysis has been focused on the potential revenue for distributed telecommunications fuel cell backup units to provide value-added power supply. This paper shows case studies on current fuel cell backup power locations and regional grid service programs. The grid service benefits and system configurations for different operation modes provide opportunities for expanding backup fuel cell applications responsive to grid needs. The objective of this work primarily focuses on how fuel cells can become a significant part of the telecom backup power to reduce system costs, environmental impact, and dependence on fossil fuels, while ensuring continuity of indispensable service for mobile users. The study identifies the approaches on the fuel cell application through nano/microgrids for an extensive network of fuel cells as distributed energy resources. The possibilities of various application scenarios extend the fuel cell technologies and microgrid for reliable power supply.

30 DIRECT ENERGY CONVERSION↗

Case study of visualizing global user download patterns using Google Earth and NASA World Wind

Geo-visualization is significantly changing the way we view spatial data and discover information. On the one hand, a large number of spatial data are generated every day. On the other hand, these data are not well utilized due to the lack of free and easily used data-visualization tools. This becomes even worse when most of the spatial data remains in the form of plain text such as log files. This paper describes a way of visualizing massive plain-text spatial data at no cost by utilizing Google Earth and NASAWorld Wind. We illustrate our methods by visualizing over 170,000 global download requests for satellite images maintained by the Earth Resources Observation and Science (EROS) Center of U.S. Geological Survey (USGS). Our visualization results identify the most popular satellite images around the world and discover the global user download patterns. The benefits of this research are: 1. assisting in improving the satellite image downloading services provided by USGS, and 2. providing a proxy for analyzing the hot spot areas of research. Most importantly, our methods demonstrate an easy way to geovisualize massive textual spatial data, which is highly applicable to mining spatially referenced data and information on a wide variety of research domains (e.g., hydrology, agriculture, atmospheric science, natural hazard, and global climate change).

Zong, Ziliang↗

Enhancing the Useability of the IAEA's Physical Model: An Analysis of User Feedback

This study presents the results of Physical Model user interviews conducted with 12 people who have International Atomic Energy Agency (IAEA) safeguards experience. The goal of this report is to provide additional context for policy makers when prioritizing the needs of the IAEA regarding support for enhancements to the Physical Model. The interviews covered the general usability of the Physical Model, its effectiveness as a technical reference, and the scope and utility of the Physical Model's indicators and content. The key conclusions from these interviews are as follows: 1) The Physical Model is difficult to find and not well advertised. 2) The Physical Model can be difficult to use due to its format, which makes searching for information difficult, and lack of visual content. Therefore, the Physical Model should be supported in multiple formats (print, PDF, web) to maximize its usability for different stakeholders. 3) The scope of the Physical Model's content and indicators is likely sufficient, and translating indicators into other languages is unlikely to be worth the effort. 4) Despite its inefficiencies and other issues, the Physical Model in its current form is a vital (albeit under-utilized) resource for key stakeholders. 5) Despite its broad use case the Physical Model is not a catch-all tool and force-fitting the Physical Model into functions for which it has not been designed for would likely diminish its value. 6) It can be difficult to disentangle challenges related to the Physical Model and its usability from broader challenges at the Agency, such as general issues with communication and coordination. Based on these conclusions and considering the results of past studies on the Physical Model funded by NA-241, the analysis team developed a list of recommendations and associated actions for IAEA consideration. These recommendations are prioritized based on the assessed level of difficulty for the IAEA to implement a recommendation, emphasizing low hanging fruit then building to more ambitious changes to the Physical Model's format and content.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Nu Tools: Exploring Practical Roles for Neutrinos in Nuclear Energy and Security

For decades, physicists have used neutrinos from nuclear reactors to advance basic science. These pursuits have inspired many ideas for application of neutrino detectors in nuclear energy and security. While developments in neutrino detectors are now making some of these ideas technically feasible, their value in the context of real needs and constraints has been unclear. This report seeks to help focus the picture of where neutrino technology may find practical roles in nuclear energy and security. This report is the final product of the Nu Tools study, commissioned in 2019 by the DOE National Nuclear Security Administration (NNSA) Office of Defense Nuclear Nonproliferation Research and Development (DNN R&D). The study was conducted over two years by a group of neutrino physicists and nuclear engineers. A central theme of the study and this report is that useful application of neutrinos will depend not only on advancing physics and technology but also on understanding the needs and constraints of potential end-users. The Study Approach emphasized broad end-user engagement. The major effort, undertaken from May to December 2020, was a series of engagements with the wider nuclear energy and security communities. Interviews with 41 experts revealed points of common understanding, which this report captures in three Cross-Cutting Findings, a Framework for Evaluating Utility, and seven Use Case Findings. The report concludes with two Recommendations. The findings and recommendations are summarized below. The respective ordering within each category does not represent a prioritization or implied value judgement.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Improving the performance of first- and last-mile mobility services through transit coordination, real-time demand prediction, advanced reservations, and trip prioritization

Socio-demographic trends and recent economic development patterns have resulted in travel behavior changes that call for more flexible and accessible public transit options. Because flexible transit services vary in scope, size, and service type, new data-informed methods are useful to optimize services based on the specific needs of local communities and riders. In this study, real-world demand and vehicle trajectory data were used to evaluate and optimize system performance for an existing first-mile–last-mile (FMLM) service in Robinson Township, PA. A general FMLM model for arbitrary demand and service supply was then developed to quantify system performance—both travel time costs and day-to-day reliability—for various operational polices considering spatio-temporal demand variation and transportation network dynamics. Heuristics were used for optimal real-time vehicle routing in sizable real-world networks accommodating various service types and scopes. In this case study, total user costs were reduced by 18.6% when rides were coordinated with mainline fixed-route transit. Predictive routing strategies were shown to marginally improve system performance under sparse and variable spatio-temporal demand. The case study also highlights potentially large travel time and user reliability improvements—reductions of 51% and 53.8%, respectively—when trip requests were made in advance of their desired pickup time. Finally, we show that travel time reliability can be improved for time-inflexible trips with trip prioritization without increasing total user costs. These results were stable to changes in demand density.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Pseudonymized User-Perspective Summit Login Node Data for 2020 and 2021

This dataset contains hourly snapshot data from each of the 5 login nodes of the Summit supercomputer at Oak Ridge Leadership Computing Facility (OLCF) over a period of 2 years, starting January 2020 and ending after December 2021. The snapshots include lists of currently logged-in users, CPU and memory usage, status of users' batch jobs, and disk usage statistics. Usernames, project identifiers, and file paths have been pseudonymized in order to allow studies of user behavior without divulging Personally Identifiable Information (PII).

97 MATHEMATICS AND COMPUTING↗

Heuristic Evaluation Methods Applied to a Predictive Maintenance Chatbot

The need for an accessible iterative approach for evaluating prospective artificial intelligence (AI)/ML based technologies in the nuclear industry is needed, given the nature of algorithms and rapid advancements. This paper explores existing heuristic design principles for user-centered design and evaluates them based on their relevancy and usefulness for evaluating AI/ ML based technologies. Researchers at the Idaho National Laboratory (INL) have developed a machine learning software application called VIsualization for PrEdictive maintenance Recommendation (VIPER), which is used to help users understand and engage with the tool to learn more about work orders, data used, predictive maintenance, and machine learning (ML) algorithms. Early user research studies used to access VIPER’s technology readiness level have occurred; however, there is room for further improvement of the software through heuristic evaluations along with other methods and user testing. This work describes the applicability of heuristic evaluation methods and cognitive walkthroughs to help ensure human readiness for prospective AI/ ML based applications, using VIPER as a candidate use case. This work supports industry in ensuring that prospective AI/ML based technologies are usable and useful for plant personnel at nuclear power plants, ultimately leading to their safe, reliable, and efficient use.

99 - GENERAL AND MISCELLANEOUS↗

Heuristic Evaluation Methods Applied to a Predictive Maintenance Chatbot

The need for an accessible iterative approach for evaluating prospective artificial intelligence (AI)/ML based technologies in the nuclear industry is needed, given the nature of algorithms and rapid advancements. This paper explores existing heuristic design principles for user-centered design and evaluates them based on their relevancy and usefulness for evaluating AI/ ML based technologies. Researchers at the Idaho National Laboratory (INL) have developed a machine learning software application called VIsualization for PrEdictive maintenance Recommendation (VIPER), which is used to help users understand and engage with the tool to learn more about work orders, data used, predictive maintenance, and machine learning (ML) algorithms. Early user research studies used to access VIPER?s technology readiness level have occurred; however, there is room for further improvement of the software through heuristic evaluations along with other methods and user testing. This work describes the applicability of heuristic evaluation methods and cognitive walkthroughs to help ensure human readiness for prospective AI/ ML based applications, using VIPER as a candidate use case. This work supports industry in ensuring that prospective AI/ML based technologies are usable and useful for plant personnel at nuclear power plants, ultimately leading to their safe, reliable, and efficient use. PowerPoint for conference that was reviewed in PRS and LRS PRS/CON-25-05379 and INL/CON-25-82946

99 - GENERAL AND MISCELLANEOUS↗

Assessment of Modeling and Nuclear Data Needs for Active Neutron Interrogation

This document is the primary deliverable for a scoping study proposed to DOE National Laboratory Announcement Number LAB 19-2114 in the NNSA research area. The study supports user applications employing active neutron interrogation by providing a science plan to improve the modeling capability and the nuclear data that radiation transport codes use. Users rely on the accuracy of the elastic scattering and non-elastic cross-sections spanning thermal energies to 14 MeV (and higher in some cases) for modeling the neutron transport through complex geometries of materials potentially composed of many elements. While the elastic scattering cross-section data are accepted for all commonly occurring elements, the non-elastic cross-section data and the associated emission data include reaction channels that require attention. The study focused on the non-elastic reactions that emit secondary, also known as prompt, gammas with the premise that many users would benefit from improved modeling of these reactions. Many users develop material assay technologies based upon gamma signatures from radiative capture, inelastic scattering, and reactions on low-Z isotopes emitting multiple particles, so the nuclear data gaps, modeling deficiencies, and recommendations for addressing the shortfalls were assessed for these reactions. Fission gammas were excluded from this study because there are other efforts underway to address known shortfalls. Follow-on efforts that successfully execute the recommendations will tangibly improve to the ability to model gamma signatures and backgrounds for user applications, such as controlled substance detection, oil-well logging, and space exploration.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Providing plant data analytics through a seamless digital environment - 211

As technology continues to evolve and become more integrated into a worker's daily routine in the commercial nuclear power industry the need for easy access to data becomes a priority. Not only does the need for data increase but the amount of data collected increases. In most cases the data is collected and stored in various software applications, many of which are legacy systems, which do not offer any other option to access the data except through the application's user interface. Furthermore the data get grouped in 'silos' according to work function and not necessarily by subject. Hence, in order to access all the information needed for a particular task or analysis one may have to access multiple applications to gather all the data needed. The industry and the research community have identified the need for a digital architecture and more importantly the need for a Seamless Digital Environment (SDE). An SDE provides a means to access multiple applications, gather the data points needed, conduct the analysis requested, and present the result to the user with minimal or no effort by the user. The study researches the potential approaches to building an analytics solution for equipment reliability, on a small scale, focusing on either a single piece of equipment or a single system. The analytics solution will consist of a data integration layer, predictive and machine learning layer and the user interface layer that will display the output of the analysis in a straight forward, easy to consume manner. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Visualization Quality Assessment

Understanding how inaccuracies in visualizations affect users’ perception and understanding of scientific data is hard. Inaccuracies in visualizations are quite common and could arise from a range of sources such as errors in the original dataset arising from compression artifacts, errors in the capturing device, noise during transmission of the data, effects due to the algorithm being used to convert data to visualization images, images generated from neural networks, and sources we have yet to discover. Many image quality assessment metrics have been developed to quantify image errors. However, these are usually focused on “natural images” rather than visualizations of scientific data. Common image quality assessment metrics (IQAs) include MSE, PSNR, perceptual metrics such SSIM, FSIM as well as perceptual metrics using deep learning approaches. However, a critical part of understanding how errors are perceived by humans, and subsequently developing more accurate quality assessment metrics, is through user evaluation studies. The goal of this software is to develop a visualization quality assessment (VQA) process that will enable the generation of VQAs that can be used to quantify errors in scientific data visualizations. The VQA development process will include software to support user evaluation experimental design, analysis of visualization differences against standard quality metrics, and the ability to develop additional VQA metrics specific to scientific visualization images.

Grosset, Andre↗