Developing and Validating Measurement Scales During Pandemic Conditions: A Case Study with the Scale for Habitat Usability
Explore the source record for details and available documents.
Ian Robertson↗
SEARCH · Engineering Papers
Results for “usability studies”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Finite element analysis of a composite material interface
A finite element model of a composite material interface is developed to study the influence of the interface on the thermal strain in the composite. A plane stress model is used with an axisymmetric model as a check. The interface thickness, thermal coefficient, modulus, Poisson's ratio and the percent of mineral in the composite are variables in the study. The results confirmed the usability of the finite element model in studying the polymer-mineral interface.
Murray, K. H.↗
Conceptual Design of a Thermal–to-14-MeV Neutron Conversion Device for Use in the Advanced Test Reactor
Here, this paper details the conceptual design of a thermal-to-14-MeV neutron converter consisting of a mixture of lithium and deuterium in a blanket material. Such a device operates a two-step reaction, first generating tritons via thermal neutron absorption in the tritium breeding material, and in the second step, high-energy neutrons are produced either via deuterium-tritium fusion reaction or with tritium reacting with lithium. A thermal-to-14-MeV neutron converter significantly hardens the neutron spectrum by virtually removing thermal neutrons and adding a high-energy 14 MeV component to the neutron spectrum. While similar concepts have been previously proposed and tested in other reactors, the unique characteristics of the Advanced Test Reactor (ATR), namely its important thermal flux (up to $10^{15}$ n.cm$^{-2}$.s$^{-1}$) makes it markedly attractive for obtaining a very large fast neutron flux, usable for irradiation studies under neutron flux conditions prototypical of fusion reactors. The paper provides a description of a new computational scheme developed for handling the coupled neutron-triton transport mechanism using the Geant4 toolkit. Resulting neutron spectra and high-energy neutron yields are summarized for different irradiation positions and potential neutron breeder materials. Maximum predicted thermal-to-14-MeV neutron yields are on the order of $2.10^{-4}$, which is consistent with previous studies found in the literature. Thus, when placed inside the ATR, such a neutron converter will be providing the largest high-energy neutron source available for activation and irradiation studies of materials foreseen for use in fusion reactors. Future steps will involve qualifying the computational scheme using the ATR critical facility using activation foil measurements.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
Trigger-based Incremental Data Processing with Unified Sync and Async Model
In recent years, more and more applications in the cloud have needs to process large-scale on-line datasets, which evolve over time as new entries are added and existing entries are modified. Several programming frameworks, such as Percolator and Oolong, are proposed for such incremental data processing and can achieve efficient processing with an event-driven abstraction. However, these frameworks are inherently asynchronous, leaving the heavy burden of managing synchronization to applications' developers, which further significantly restricts their usabilities. In this study, we propose a trigger-based incremental computing framework in the cloud, called Domino, with both synchronous and asynchronous mechanisms to coordinate parallel triggers. With this new framework, both synchronous and asynchronous applications can be seamlessly developed. Use cases and extensive evaluation results confirm that it can deliver sufficient performance, and also is easy to use for incremental applications in large-scale distributed computing.
97 MATHEMATICS AND COMPUTING↗
Machine Learning Using Rapidity-Mass Matrices for Event Classification Problems in HEP
In this work, supervised artificial neural networks (ANN) with rapidity–mass matrix (RMM) inputs are studied using several Monte Carlo event samples for various pp collision processes. The study shows the usability of this approach for general event classification problems. The proposed standardization of the ANN feature space can simplify searches for signatures of new physics at the Large Hadron Collider (LHC) when using machine learning techniques. In particular, we illustrate how to improve signal-over-background ratios in the search for new physics, how to filter out Standard Model events for model-agnostic searches, and how to separate gluon and quark jets for Standard Model measurements.
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
Usability Evaluation of a Flight-Deck Airflow Hazard Visualization System
Many aircraft accidents each year are caused by encounters with unseen airflow hazards near the ground, such as vortices, downdrafts, low level wind shear, microbursts, or turbulence from surrounding vegetation or structures near the landing site. These hazards can be dangerous even to airliners; there have been hundreds of fatalities in the United States in the last two decades attributable to airliner encounters with microbursts and low level wind shear alone. However, helicopters are especially vulnerable to airflow hazards because they often have to operate in confined spaces and under operationally stressful conditions (such as emergency search and rescue, military or shipboard operations). Providing helicopter pilots with an augmented-reality display visualizing local airflow hazards may be of significant benefit. However, the form such a visualization might take, and whether it does indeed provide a benefit, had not been studied before our experiment. We recruited experienced military and civilian helicopter pilots for a preliminary usability study to evaluate a prototype augmented-reality visualization system. The study had two goals: first, to assess the efficacy of presenting airflow data in flight; and second, to obtain expert feedback on sample presentations of hazard indicators to refine our design choices. The study addressed the optimal way to provide critical safety information to the pilot, what level of detail to provide, whether to display specific aerodynamic causes or potential effects only, and how to safely and effectively shift the locus of attention during a high-workload task. Three-dimensional visual cues, with varying shape, color, transparency, texture, depth cueing, and use of motion, depicting regions of hazardous airflow, were developed and presented to the pilots. The study results indicated that such a visualization system could be of significant value in improving safety during critical takeoff and landing operations, and also gave clear indications of the best design choices in producing the hazard visual cues.
Aragon, Cecilia R.↗
Operator Insights and Usability Evaluation of Machine Learning Assistance for Power Grid Contingency Analysis
Introducing machine learning (ML) assistance into any established process comes with adoption barriers, including entrenched procedures, technological and human readiness levels, human-machine trust, and work culture resistance to change. These barriers are even greater in critical operations such as operating a national or regional power grid, in which both regulatory frameworks and the importance of maintaining reliability levels causes additional resistance to the adoption of new computational support. Developers of future systems and job aides must consider not only technical aspects, but also whether new systems are usable by power system operators. This work presents the methodology and results of a study to evaluate the usability and readiness of a prototype recommender system for power grid contingency analysis. We explore operator cognitive load and evaluate operator performance when solving a collection of scenarios both with and without recommender assistance. We also examine operator trust in the system. We report insights gained on the readiness of the system using a collection of evaluation techniques.
Human-Machine Teaming, Power Systems, usability ev↗
MPATH (Measuring Performance for Autonomy Teaming with Humans) Ground Control Station: Design Approach and Initial Usability Results
Envisioned future Advanced Air Mobility (AAM) operations will require a transition of aircraft command and control from onboard pilots to remote operators. The National Aeronautics and Space Administration (NASA) has developed a research ground control station (GCS) software called MPATH (Measuring Performance for Autonomy Teaming with Humans) to study the human factors of remote operators in a representative AAM environment, where small uncrewed aerial systems (sUAS; simulated or real) act as surrogates for larger AAM aircraft. A primary focus of the research being conducted with the MPATH GCS is scalability (i.e., one human managing multiple vehicles). MPATH has demonstrated to be a useful capability for human factors research and remote operations. Two initial usability studies and a multi-vehicle control assessment were recently conducted, and usability data and operator feedback were collected. Generally, participants rated MPATH high on usability and interface quality, whereas information quality was rated slightly lower. These results were supported by specific feedback. Several generalized GCS design recommendations are proposed based on the results and feedback from these flight activities. Future updates to MPATH will incorporate the proposed recommendations. In practice, these recommendations could be used by any GCS software designer or developer to promote usability and safety.
Advanced Air Mobility↗
Usability Evaluation of Fleet Management Interface for High Density Vertiplex Environments
To meet the rising demand for an Advanced Air Mobility (AAM) (i.e. urban and rural unmanned aircraft systems) ecosystem, the NASA Aeronautics Research Mission Directorate (ARMD) is hosting a series of simulations and flight tests under the High Density Vertiplex sub-project (HDV) to prototype and study the effectiveness AAM capabilities under various operational contexts. HDV aims to develop an integrated automation architecture to support terminal area flight operations. The HDV simulations and flight tests address safety, integration, and operational challenges, while integrated systems and software demonstrate design readiness, robustness, and interoperability. During the initial HDV simulation in 2021, a prototype traffic management tool developed by NASA called the Fleet Management Interface (FMI) was tested. FMI was designed to introduce an advanced level of human-automation interaction to aid both Ground Control Station Operators (GCSOs) and Fleet Managers (FMs) in remotely managing flights under their ownership. In a human-in-the-loop simulation, a usability study was conducted with the FMI to identify optimal approaches for displaying information to human operators using subjective measures of usability, workload, situation awareness, risk, and trust, along with qualitative feedback. This study consisted of task analysis in which GCSO and FM subjects used an Urban Air Mobility (UAM) environment to develop and execute a plan for two different traffic scenarios of remotely controlled vehicles. In each scenario, a remotely controlled vehicle completed a takeoff, active flight, and landing sequence while simulated traffic flew in the background at a rate of 20 operations per hour. In the first scenario, the controlled vehicle flew a nominal route with takeoff and landing at the same vertiport. In the second scenario, the controlled vehicle started on the nominal route, then diverted to an unplanned location mid-flight. Results showed that self- reported performance, usability, trust, and situation awareness ratings of FMI were moderately to strongly high. There were small differences between scenarios, with Scenario 2 being perceived as more unstable, complex, variable, risky, and potentially harmful than Scenario 1. Furthermore, participants described improvements that could be made to create a better user experience. For example, users suggested customizable interfaces to accommodate information display preferences, and the ability to review routes before assigning them. The results from this study will inform future development of the FMI with the end goal of creating a reference automation tool for airspace management procedures in AAM. The FMI could serve to reduce dependency on traditional air navigation services through increased automation in high density vertiplex environments.
Fleet manager↗
A User-Centered Design Study in Scientific Visualization Targeting Domain Experts
The development of usable visualization solutions is essential for ensuring both their adoption and effectiveness. User-centered design principles, which involve users throughout the entire development process, have been shown to be effective in numerous information visualization endeavors. We describe how we applied these principles in scientific visualization over a two year collaboration to develop a hybrid in situ/post hoc solution tailored towards combustion researcher needs. Lastly, we examine the importance of user-centered design and lessons learned over the design process in an effort to aid others seeking to develop effective scientific visualization solutions.
97 MATHEMATICS AND COMPUTING↗
Usability Evaluation of Spot and Runway Departure Advisor (SARDA) Concept in Dallas/Fort Worth Airport Tower Simulation
Spot and Runway Departure Advisor (SARDA) is a proposed decision-support tool for air traffic control tower controllers for reducing taxi delay and optimizing the departure sequence. In the present study, the tool's usability was evaluated to ensure that its claimed performance benefits are not being realized at the cost of increasing the work burden on controllers. For the evaluation, workload ratings and questionnaire responses collected during a human-in-the-loop simulation experiment were analyzed to assess the SARDA advisories' effects on the controllers' ratings on cognitive resources (e.g., workload, spare attention) and satisfaction. The results showed that SARDA reduced the controllers' workload and increased their spare attention. It also made workload and attention levels less susceptible to the effects of increases in the traffic load. The questionnaire responses suggested that the controllers generally were satisfied with the ease of use of the tool and the objectives of the SARDA concept, but with some caution. To gain more trust from controllers, the the reasoning behind advisories may need to be made more transparent to them.
human factors↗
Methods to Reduce Communication Workload for UAM Operations
Implementation of Urban Air Mobility (UAM) operations, or air passenger transportation systems within densely populated metropolitan areas, seeks to mitigate increasing traffic congestion. However, the development and integration of UAM operations into the national airspace system comes with its own unique challenges, such as vehicle requirements, flight planning and scheduling, and coordination between UAM flights and air traffic controllers. In particular, verbal coordination will play an integral part in the determined success of UAM operations and its ability to meet projected high consumer demands. In order to meet demands and higher traffic volumes on UAM routes, verbal communication between the UAM pilot and controller must be streamlined to reduce the controller's workload while helping to maintain safety within a given airspace. One method of reducing verbal workload are Letters Of Agreement (LOAs) that outline responsibilities and procedures for operations in an airspace. These LOAs will specify the operations, procedures, and routes for UAM flights. The proposed study will examine the usability of two route formatting styles for LOAs; (i) Verbal route descriptions and (ii) Tower En Route Control (TECs) routes. Verbal route descriptions will include the route name and associated visual cues on the route. The TEC route versions will include relevant waypoints and charts outlining the route with waypoints marked. The study will be part of a UAM X1 human in the loop (HITL) simulation. Controller participants will handle traditional air traffic including moderate levels of UAM traffic on current and modified helicopter routes within the Dallas Fort-Worth area. Scenarios will be counterbalanced and repeated to test both route formatting versions. After each trial, participants will rate the usability of the LOA used in the previous trial via a subjective questionnaire. We expect that controllers will prefer the LOA with TEC routes due to simplicity and visual elements available.
aerospace human factors↗
PRO-X Fuel Cycle Transportation and Crosscutting Progress Report
The PRO-X program is actively supporting the design of nuclear systems by developing a framework to both optimize the fuel cycle infrastructure for advanced reactors (ARs) and minimize the potential for production of weapons-usable nuclear material. Three study topics are currently being investigated by Sandia National Laboratories (SNL) with support from Argonne National Laboratories (ANL). This multi-lab collaboration is focused on three study topics which may offer proliferation resistance opportunities or advantages in the nuclear fuel cycle. These topics are: 1) Transportation Global Landscape, 2) Transportation Avoidability, and 3) Parallel Modular Systems vs Single Large System (Crosscutting Activity).
11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
SCALE 6.2 Lattice Physics Performance Assessment
The US Nuclear Regulatory Commission relies on the lattice physics analysis capabilities of the SCALE code system to perform confirmatory licensing analyses. Either SCALE lattice physics code—TRITON/NEWT or Polaris—can be used to generate cross section data used by the PARCS nodal core simulator for full-core neutronics calculations. This report presents an assessment of the accuracy of SCALE lattice physics codes for preparation of lattice physics data that are used to support simulator codes such as the NRC’s PARCS, for UO 2 -mixed oxide (MOX)/Zr fueled light water reactor (LWR) analyses. Due to the nature of lattice physics calculations, critical reactor experiment benchmarks cannot be modeled in explicit detail in a lattice physics code. However, this limitation does not mean that these measurement data are not usable for lattice physics studies. Therefore, either geometry approximations or axial buckling must be implemented to determine the critical water height. These modeling limitations have led to development of a three-phase assessment strategy. In the first phase, selected critical experiment benchmarks are modeled using the SCALE 3D continuous-energy (CE) Monte Carlo (MC) code KENO, which is the most rigorous neutron transport method available in SCALE, with no approximations in the spatial, angle, or energy treatments. Biases and statistical uncertainties in quantities of interest such as k eff and pin power distributions are determined by comparing CE KENO results to experimental data. This first phase in the accuracy assessment is to demonstrate and establish the use of CE KENO as a reference solution for the second phase. In the second phase, 14 numerical test suites are used to compare SCALE lattice physics calculations with CE KENO as a reference solution. In the third phase, SCALE lattice physics depletion calculations are performed, and the spent fuel isotopic results are compared with available radiochemical assay measurements. Isotopic measurement comparisons provide quantitative assessment of isotopic density distribution predictions with the depletion models in SCALE lattice physics codes. This report documents results for all test suites. The assessment was performed using standard production techniques unless otherwise noted. Both TRITON/NEWT and Polaris exhibited acceptable accuracy for most test cases. For the few test cases in which acceptable accuracy criteria were not met, further code and data development are planned. The computer codes used in this assessment are as follows: SCALE 6.2 rev19189 (pre-release of 6.2.1) was used for CE KENO, TRITON/NEWT and Polaris (PWR only) calculations; SCALE 6.2.2 was used for Polaris calculations to address several updates in support of support boiling water reactor (BWR) lattice geometries. For this work, there is no difference between SCALE 6.2.1 and SCALE 6.2.2 beyond the inclusion of the Polaris BWR analysis capability; The ENDF/B-VII.1 continuous energy and 252 group libraries deployed in SCALE 6.2 were generated with AMPX 6.2 that is distributed with SCALE.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
Extreme ultraviolet photometer for observations of helium in interplanetary space
A four-channel photometer sensitive to two solar EUV lines which are resonantly scattered by helium gas was developed for flight on the Apollo-Soyuz Test Project. Two channels observed the 58.4-nm line of He I and used helium gas resonant absorption cells to determine the intensities of the center and wings of that line. The other two channels observed the 30.4-nm line of He II. The instrument surveyed much of the celestial sphere during a series of slow rolling maneuvers by the Apollo spacecraft. The experiment operated properly, and usable data were obtained. Study of the distributions of flux seen, and of the ratio 58.4-nm fluxes seen with gas cells full and empty, will refine current understanding of several poorly known properties of the local interstellar medium. Study of the 30.4-nm flux distribution will refine present knowledge of the structure of the earth's plasmasphere.
Bowyer, S.↗
Space station Simulation Computer System (SCS) study for NASA/MSFC. Volume 5: Study analysis report
The Simulation Computer System (SCS) is the computer hardware, software, and workstations that will support the Payload Training Complex (PTC) at the Marshall Space Flight Center (MSFC). The PTC will train the space station payload scientists, station scientists, and ground controllers to operate the wide variety of experiments that will be on-board the Freedom Space Station. The further analysis performed on the SCS study as part of task 2-Perform Studies and Parametric Analysis-of the SCS study contract is summarized. These analyses were performed to resolve open issues remaining after the completion of task 1, and the publishing of the SCS study issues report. The results of these studies provide inputs into SCS task 3-Develop and present SCS requirements, and SCS task 4-develop SCS conceptual designs. The purpose of these studies is to resolve the issues into usable requirements given the best available information at the time of the study. A list of all the SCS study issues is given.
Source record↗
Domain-Specific Languages and Diagram Customization for a Concurrent Engineering Environment
A major open question for advocates of Model-Based Systems Engineering (MBSE) is the question of how system and subsystem engineers will work together. The Systems Modeling Language (SysML), like any language intended for a large audience, is in tension between the desires for simplicity and for expressiveness. In order to be more expressive, many specialized language elements may be introduced, which will unfortunately make a complete understanding of the language a more daunting task. While this may be acceptable for systems modelers, it will increase the challenge of including subsystem engineers in the modeling effort. One possible answer to this situation is the use of Domain-Specific Languages (DSL), which are fully supported by the Unified Modeling Language (UML). SysML is in fact a DSL for systems engineering. The expressive power of a DSL can be enhanced through the use of diagram customization. Various domains have already developed their own schematic vocabularies. Within the space engineering community, two excellent examples are the propulsion and telecommunication subsystems. A return to simple box-and-line diagrams (e.g., the SysML Internal Block Diagram) are in many ways a step backward. In order allow subsystem engineers to contribute directly to the model, it is necessary to make a system modeling tool at least approximate in accessibility to drawing tools like Microsoft PowerPoint and Visio. The challenge is made more extreme in a concurrent engineering environment, where designs must often be drafted in an hour or two. In the case of the Jet Propulsion Laboratory's Team X concurrent design team, a subsystem is specified using a combination of PowerPoint for drawing and Excel for calculation. A pilot has been undertaken in order to meld the drawing portion and the production of master equipment lists (MELs) via a SysML authoring tool, MagicDraw. Team X currently interacts with its customers in a process of sharing presentations. There are several inefficiencies that arise from this situation. The first is that a customer team must wait two weeks to a month (which is 2-4 times the duration of most Team X studies themselves) for a finalized, detailed design description. Another is that this information must be re-entered by hand into the set of engineering artifacts and design tools that the mission concept team uses after a study is complete. Further, there is no persistent connection to Team X or institutionally shared formulation design tools and data after a given study, again reducing the direct reuse of designs created in a Team X study. This paper presents the underpinnings of subsystem DSLs as they were developed for this pilot. This includes specialized semantics for different domains as well as the process by which major categories of objects were derived in support of defining the DSLs. The feedback given to us by the domain experts on usability, along with a pilot study with the partial inclusion of these tools is also discussed.
Cole, Bjorn↗
A study of commuter airplane design optimization
The usability of the general aviation synthesis program (GASP) was enhanced by the development of separate computer subroutines which can be added as a package to this assembly of computerized design methods or used as a separate subroutine program to compute the dynamic longitudinal, lateral-directional stability characteristics for a given airplane. Currently available analysis methods were evaluated to ascertain those most appropriate for the design functions which the GASP computerized design program performs. Methods for providing proper constraint and/or analysis functions for GASP were developed as well as the appropriate subroutines.
Keppel, B. V.↗