Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “qualitative research”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Initial planetary base construction techniques and machine implementation

Conceptual designs of (1) initial planetary base structures, and (2) an unmanned machine to perform the construction of these structures using materials local to the planet are presented. Rock melting is suggested as a possible technique to be used by the machine in fabricating roads, platforms, and interlocking bricks. Identification of problem areas in machine design and materials processing is accomplished. The feasibility of the designs is contingent upon favorable results of an analysis of the engineering behavior of the product materials. The analysis requires knowledge of several parameters for solution of the constitutive equations of the theory of elasticity. An initial collection of these parameters is presented which helps to define research needed to perform a realistic feasibility study. A qualitative approach to estimating power and mass lift requirements for the proposed machine is used which employs specifications of currently available equipment. An initial, unmanned mission scenario is discussed with emphasis on identifying uncompleted tasks and suggesting design considerations for vehicles and primitive structures which use the products of the machine processing.

Crockford, William W.↗

Synthetic Vision System Commercial Aircraft Flight Deck Display Technologies for Unusual Attitude Recovery

A Commercial Aviation Safety Team (CAST) study of 18 worldwide loss-of-control accidents and incidents determined that the lack of external visual references was associated with a flight crew's loss of attitude awareness or energy state awareness in 17 of these events. Therefore, CAST recommended development and implementation of virtual day-Visual Meteorological Condition (VMC) display systems, such as synthetic vision systems, which can promote flight crew attitude awareness similar to a day-VMC environment. This paper describes the results of a high-fidelity, large transport aircraft simulation experiment that evaluated virtual day-VMC displays and a "background attitude indicator" concept as an aid to pilots in recovery from unusual attitudes. Twelve commercial airline pilots performed multiple unusual attitude recoveries and both quantitative and qualitative dependent measures were collected. Experimental results and future research directions under this CAST initiative and the NASA "Technologies for Airplane State Awareness" research project are described.

Prinzel, Lawrence J., III↗

Qualitative Data Coding of User Experience with an Urban Air Mobility Fleet Manager Interface

The NASA Aeronautics Research Mission Directorate created the High Density Vertiplex (HDV) project to integrate and evaluate a prototype Urban Air Mobility (UAM) ecosystem. Part of the HDV testing environment included a prototype operator user interface called the Fleet Manager Interface (FMI). In 2023, HDV conducted flight testing with the FMI during which a user experience (UX) study was performed to assess the quality of UX and elicit design recommendations. As a result, a large database of open-ended, qualitative responses was generated and then coded using a new qualitative data coding technique called Directive String Coding, which used a blended coding approach to generate actionable heuristics that stakeholders (e.g., researchers, UI designers, software developers) could use to answer specific research questions and make future design decisions. The key themes that arose from the coded responses showed that the UX was pleasant, system notifications should be more salient, and information across multiple screens should be integrated into a central display. As the Fleet Manger operational role is still being defined, it is vital to increase our understanding of the tools and capabilities needed for such a role. The results from HDV work will eventually feed into standards for vertiport operations that will enable safe and scalable UAM operations in the United States.

high density vertiplex↗

Qualitative Data Coding of User Experience with an Urban Air Mobility Fleet Manager Interface

The NASA Aeronautics Research Mission Directorate created the High Density Vertiplex (HDV) project to integrate and evaluate a prototype Urban Air Mobility (UAM) ecosystem. Part of the HDV testing environment included a prototype operator user interface called the Fleet Manager Interface (FMI). In 2023, HDV conducted flight testing with the FMI during which a user experience (UX) study was performed to assess the quality of UX and elicit design recommendations. As a result, a large database of open-ended, qualitative responses was generated and then coded using a new qualitative data coding technique called Directive String Coding, which used a blended coding approach to generate actionable heuristics that stakeholders (e.g., researchers, UI designers, software developers) could use to answer specific research questions and make future design decisions. The key themes that arose from the coded responses showed that the UX was pleasant, system notifications should be more salient, and information across multiple screens should be integrated into a central display. As the Fleet Manger operational role is still being defined, it is vital to increase our understanding of the tools and capabilities needed for such a role. The results from HDV work will eventually feed into standards for vertiport operations that will enable safe and scalable UAM operations in the United States.

high density veriplex↗

Monitoring with Trackers Based on Semi-Quantitative Models

In three years of NASA-sponsored research preceding this project, we successfully developed a technology for: (1) building qualitative and semi-quantitative models from libraries of model-fragments, (2) simulating these models to predict future behaviors with the guarantee that all possible behaviors are covered, (3) assimilating observations into behaviors, shrinking uncertainty so that incorrect models are eventually refuted and correct models make stronger predictions for the future. In our object-oriented framework, a tracker is an object which embodies the hypothesis that the available observation stream is consistent with a particular behavior of a particular model. The tracker maintains its own status (consistent, superceded, or refuted), and answers questions about its explanation for past observations and its predictions for the future. In the MIMIC approach to monitoring of continuous systems, a number of trackers are active in parallel, representing alternate hypotheses about the behavior of a system. This approach is motivated by the need to avoid 'system accidents' [Perrow, 1985] due to operator fixation on a single hypothesis, as for example at Three Mile Island. As we began to address these issues, we focused on three major research directions that we planned to pursue over a three-year project: (1) tractable qualitative simulation, (2) semiquantitative inference, and (3) tracking set management. Unfortunately, funding limitations made it impossible to continue past year one. Nonetheless, we made major progress in the first two of these areas. Progress in the third area as slower because the graduate student working on that aspect of the project decided to leave school and take a job in industry. I enclosed a set of abstract of selected papers on the work describe below. Several papers that draw on the research supported during this period appeared in print after the grant period ended.

Kuipers, Benjamin↗

SimGraph: A Flight Simulation Data Visualization Workstation

Today's modern flight simulation research produces vast amounts of time sensitive data, making a qualitative analysis of the data difficult while it remains in a numerical representation. Therefore, a method of merging related data together and presenting it to the user in a more comprehensible format is necessary. Simulation Graphics (SimGraph) is an object-oriented data visualization software package that presents simulation data in animated graphical displays for easy interpretation. Data produced from a flight simulation is presented by SimGraph in several different formats, including: 3-Dimensional Views, Cockpit Control Views, Heads-Up Displays, Strip Charts, and Status Indicators. SimGraph can accommodate the addition of new graphical displays to allow the software to be customized to each user s particular environment. A new display can be developed and added to SimGraph without having to design a new application, allowing the graphics programmer to focus on the development of the graphical display. The SimGraph framework can be reused for a wide variety of visualization tasks. Although it was created for the flight simulation facilities at NASA Langley Research Center, SimGraph can be reconfigured to almost any data visualization environment. This paper describes the capabilities and operations of SimGraph.

Kaplan, Joseph A.↗

Resilient Communities, Maryland (RCM): A Framework for Community-Driven Energy Resilience (Final Technical Report)

The Resilient Communities, Maryland (RCM) project integrates community-based participatory research (CBPR) approaches into energy resilience planning. The combination of qualitative, community-driven data and quantitative utility data improves both the effectiveness and efficiency of assessing the impacts of disruptions to energy infrastructure. Centered around a metric of critical services access, RCM created a repeatable framework for evaluating and modeling energy resilience in communities and promoted community engagement, resulting in more equitable stakeholder participation and improved decision-making processes for siting infrastructure to improve community energy resilience.

14 SOLAR ENERGY↗

Strengthening Resilience: Florida Resident Voices on Resource Needs During Power Outages

Extreme weather events related to climate change, and an aging electricity infrastructure are disrupting reliable electricity services to a greater degree. Further, previous research has found that more socially vulnerable populations are more likely to live in areas with a higher probability of power outages. Here, this study examines the issues that people face during power outages and the resources that help individuals maintain resilience during power outages caused by extreme weather events in socially vulnerable communities. Using qualitative data from focus groups with 56 individuals in Central and North Florida, the research highlights lived experiences during outages and difficulties using and accessing resources during these conditions. Based on a qualitative review of the focus group discussions, this paper explores the solutions and support systems residents believe would improve their ability to cope. The findings offer insights to guide policy and strategic planning, with the goal of strengthening personal preparedness and response by focusing on the resources people consider most helpful for enduring frequent and severe outages.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Investigating uncertainties in human adaptation and their impacts on water scarcity in the Colorado river Basin, United States

The Colorado River Basin (CRB) supports the water supply for seven states and forty million people in the Western United States (US) and has been suffering an extensive drought for more than two decades. As climate change continues to reshape water resources distribution in the CRB, its impact can differ in intensity and location, resulting in variations in human adaptation behaviors. The feedback from human systems in response to the environmental changes and the associated uncertainty is critical to water resources management, especially for water-stressed basins. This paper investigates how human adaptation affects water scarcity uncertainty in the CRB and highlights the uncertainties in human behavior modeling. Our focus is on agricultural water consumption, as approximately 80% of the water consumption in the CRB is used in agriculture. We adopted a coupled agent-based and water resources modeling approach for exploring human-water system dynamics, in which an agent is a human behavior model that simulates a farmer’s water consumption decisions. We examined uncertainties at the system, agent, and parameter levels through uncertainty, clustering, and sensitivity analyses. The uncertainty analysis results suggest that the CRB water system may experience 13 to 30 years of water shortage during the 2019–2060 simulation period, depending on the paths of farmers’ adaptation. The clustering analysis identified three decision-making classes: bold, prudent, and forward-looking, and quantified the probabilities of an agent belonging to each class. The sensitivity analysis results indicated agents whose decision-making models require further investigation and the parameters with the higher uncertainty reduction potentials. Here, by conducting numerical experiments with the coupled model, this paper presents quantitative and qualitative information about farmers’ adaptation, water scarcity uncertainties, and future research directions for improving human behavior modeling.

Agent-based modeling↗

Alternative Technologies Adopters Outreach Survey Report

Brookhaven National Laboratory (BNL), in collaboration with Ioanna Iliopulos and Christopher Boyd (independent contractors), conducted quantitative and qualitative surveys to document views and opinions of scientists and researchers with firsthand experience operating x-ray devices for a wide range of research applications. The goal of the study was to fill critical information gaps and identify misconceptions widely held among the research community regarding the transition from Cesium-137 irradiators to x-ray devices. The survey instrument focused on three distinct yet interrelated areas that impact users' experience: operational impacts, including infrastructure needs, workflow, personnel management, and training, and regulatory compliance; research design and investigation impacts, including calibration, dosimetry, continuity of previous studies, development of new research agendas, and the outcomes for both; and funding impacts, specifically how grant sources and opportunities have responded to the transition.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Diagnosis by integrating model-based reasoning with knowledge-based reasoning

Our research investigates how observations can be categorized by integrating a qualitative physical model with experiential knowledge. Our domain is diagnosis of pathologic gait in humans, in which the observations are the gait motions, muscle activity during gait, and physical exam data, and the diagnostic hypotheses are the potential muscle weaknesses, muscle mistimings, and joint restrictions. Patients with underlying neurological disorders typically have several malfunctions. Among the problems that need to be faced are: the ambiguity of the observations, the ambiguity of the qualitative physical model, correspondence of the observations and hypotheses to the qualitative physical model, the inherent uncertainty of experiential knowledge, and the combinatorics involved in forming composite hypotheses. Our system divides the work so that the knowledge-based reasoning suggests which hypotheses appear more likely than others, the qualitative physical model is used to determine which hypotheses explain which observations, and another process combines these functionalities to construct a composite hypothesis based on explanatory power and plausibility. We speculate that the reasoning architecture of our system is generally applicable to complex domains in which a less-than-perfect physical model and less-than-perfect experiential knowledge need to be combined to perform diagnosis.

Bylander, Tom↗

Investigating Scientific Data Change with User Research Methods

Scientific datasets are continually expanding and changing due to fluctuations with instruments, quality assessment and quality control processes, and modifications to software pipelines. Datasets include minimal information about these changes or their effects requiring scientists manually assess modifications through a number of labor intensive and ad-hoc steps. The Deduce project is investigating data change to develop metrics, methods, and tools that will help scientists systematically identify and make decisions around data changes. Currently, there is a lack of understanding, and common practices, for identifying and evaluating changes in datasets since systematically measuring and managing data change is under explored in scientific work. We are conducting user research to address this need by exploring scientist's conceptualizations, behaviors, needs, and motivations when dealing with changing datasets. Our user research utilizes multiple methods to produce foundational, generative insights and evaluate research products produced by our team. In this paper, we detail our user research process and outline our findings about data change that emerge from our studies. Our work illustrates how scientific software teams can push beyond just usability testing user interfaces or tools to better probe the underlying ideas they are developing solutions to address.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Qualitative and quantitative imaging in microgravity combustion

An overview of the imaging techniques implemented by researchers in the microgravity combustion program shows that for almost any system, imaging of the flame may be accomplished in a variety of ways. Standard and intensified video, high speed, and infrared cameras and fluorescence, laser schlieren, rainbow schlieren, soot volume fraction, and soot temperature imaging have all been used in the laboratory and many in reduced gravity to make the necessary experimental measurements.

Weiland, Karen J.↗

Explaining word embeddings with perfect fidelity: a case study in predicting research impact

The best-performing approaches for scholarly document quality prediction are based on embedding models. In addition to their performance when used in classifiers, embedding models can also provide predictions even for words that were not contained in the labelled training data for the classification model, which is important in the context of the ever-evolving research terminology. Although model-agnostic explanation methods, such as Local interpretable model-agnostic explanations, can be applied to explain machine learning classifiers trained on embedding models, these produce results with questionable correspondence to the model. We introduce a new feature importance method, Self-Model Entities Rated (SMER), for logistic regression-based classification models trained on word embeddings. We show that SMER has theoretically perfect fidelity with the explained model, as the average of logits of SMER scores for individual words (SMER explanation) exactly corresponds to the logit of the prediction of the explained model. Quantitative and qualitative evaluation is performed through five diverse experiments conducted on 50,000 research articles (papers) from the CORD-19 corpus. In conclusion, through an AOPC curve analysis, we experimentally demonstrate that SMER produces better explanations than LIME, SHAP and global tree surrogates.

Coarse-grained models↗

Qualitative models for space system engineering

The objectives of this project were: (1) to investigate the implications of qualitative modeling techniques for problems arising in the monitoring, diagnosis, and design of Space Station subsystems and procedures; (2) to identify the issues involved in using qualitative models to enhance and automate engineering functions. These issues include representing operational criteria, fault models, alternate ontologies, and modeling continuous signals at a functional level of description; and (3) to develop a prototype collection of qualitative models for fluid and thermal systems commonly found in Space Station subsystems. Potential applications of qualitative modeling to space-systems engineering, including the notion of intelligent computer-aided engineering are summarized. Emphasis is given to determining which systems of the proposed Space Station provide the most leverage for study, given the current state of the art. Progress on using qualitative models, including development of the molecular collection ontology for reasoning about fluids, the interaction of qualitative and quantitative knowledge in analyzing thermodynamic cycles, and an experiment on building a natural language interface to qualitative reasoning is reported. Finally, some recommendations are made for future research.

Forbus, Kenneth D.↗

Automatic determination of fault effects on aircraft functionality

The problem of determining the behavior of physical systems subsequent to the occurrence of malfunctions is discussed. It is established that while it was reasonable to assume that the most important fault behavior modes of primitive components and simple subsystems could be known and predicted, interactions within composite systems reached levels of complexity that precluded the use of traditional rule-based expert system techniques. Reasoning from first principles, i.e., on the basis of causal models of the physical system, was required. The first question that arises is, of course, how the causal information required for such reasoning should be represented. The bond graphs presented here occupy a position intermediate between qualitative and quantitative models, allowing the automatic derivation of Kuipers-like qualitative constraint models as well as state equations. Their most salient feature, however, is that entities corresponding to components and interactions in the physical system are explicitly represented in the bond graph model, thus permitting systematic model updates to reflect malfunctions. Researchers show how this is done, as well as presenting a number of techniques for obtaining qualitative information from the state equations derivable from bond graph models. One insight is the fact that one of the most important advantages of the bond graph ontology is the highly systematic approach to model construction it imposes on the modeler, who is forced to classify the relevant physical entities into a small number of categories, and to look for two highly specific types of interactions among them. The systematic nature of bond graph model construction facilitates the process to the point where the guidelines are sufficiently specific to be followed by modelers who are not domain experts. As a result, models of a given system constructed by different modelers will have extensive similarities. Researchers conclude by pointing out that the ease of updating bond graph models to reflect malfunctions is a manifestation of the systematic nature of bond graph construction, and the regularity of the relationship between bond graph models and physical reality.

Feyock, Stefan↗

Possible Mechanisms for Turbofan Engine Ice Crystal Icing at High Altitude

A thermodynamic model is presented to describe possible mechanisms of ice formation on unheated surfaces inside a turbofan engine compression system from fully glaciated ice crystal clouds often formed at high altitude near deep convective weather systems. It is shown from the analysis that generally there could be two distinct types of ice formation: (1) when the "surface freezing fraction" is in the range of 0 to 1, dominated by the freezing of water melt from fully or partially melted ice crystals, the ice structure is formed from accretion with strong adhesion to the surface, and (2) when the "surface melting fraction" is the range of 0 to 1, dominated by the further melting of ice crystals, the ice structure is formed from accumulation of un-melted ice crystals with relatively weak bonding to the surface. The model captures important qualitative trends of the fundamental ice-crystal icing phenomenon reported earlier1,2 from the research collaboration work by NASA and the National Research Council (NRC) of Canada. Further, preliminary analysis of test data from the 2013 full scale turbofan engine ice crystal icing test3 conducted in the NASA Glenn Propulsion Systems Laboratory (PSL) has also suggested that (1) both types of ice formation occurred during the test, and (2) the model has captured some important qualitative trend of turning on (or off) the ice crystal ice formation process in the tested engine low pressure compressor (LPC) targeted area under different icing conditions that ultimately would lead to (or suppress) an engine core roll back (RB) event.

Crystal Icing↗

Building an experience factory for maintenance

This paper reports the preliminary results of a study of the software maintenance process in the Flight Dynamics Division (FDD) of the National Aeronautics and Space Administration/Goddard Space Flight Center (NASA/GSFC). This study is being conducted by the Software Engineering Laboratory (SEL), a research organization sponsored by the Software Engineering Branch of the FDD, which investigates the effectiveness of software engineering technologies when applied to the development of applications software. This software maintenance study began in October 1993 and is being conducted using the Quality Improvement Paradigm (QIP), a process improvement strategy based on three iterative steps: understanding, assessing, and packaging. The preliminary results represent the outcome of the understanding phase, during which SEL researchers characterized the maintenance environment, product, and process. Findings indicate that a combination of quantitative and qualitative analysis is effective for studying the software maintenance process, that additional measures should be collected for maintenance (as opposed to new development), and that characteristics such as effort, error rate, and productivity are best considered on a 'release' basis rather than on a project basis. The research thus far has documented some basic differences between new development and software maintenance. It lays the foundation for further application of the QIP to investigate means of improving the maintenance process and product in the FDD.

Valett, Jon D.↗