Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “qualitative evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Evaluation of Multiple Flow Constrained Area Capacity Setting Methods for Collaborative Trajectory Options Program

The purpose of this study was to compare flow constrained area (FCA) capacity setting methods for Collaborative Trajectory Options Program (CTOP) as they pertain to the Integrated Demand Management (IDM) concept. IDM uses flow balancing to manage air traffic across multiple FCAs with a common downstream constraint, as well as constraints at the respective FCA locations. FCA capacity rates can be set manually, but generating capacities for multiple, interdependent FCAs could potentially over-burden a user. A new enhancement to CTOP called the FCA Balance Algorithm (FBA) was developed at NASA Ames Research Center to improve the process of allocating capacity across multiple flow constrained segments in the airspace. The FBA evaluates the predicted demand and capacity across multiple FCAs and dynamically generates capacity settings for the FCAs that best meet capacity limits for all identified constraints. In a human-in-the-loop simulation study, both manual and automated capacity setting methods were evaluated in terms of their overall feasibility using measures of system performance, human performance, and qualitative feedback. Subject matter experts were asked to use three different methods to allocate capacity to three FCAs, either (1) by manually setting capacity for every 60-minute time window, (2) by manually setting capacity for every 15-minute time window, or (3) by using the FBA capability to automatically generate capacity settings. Results showed no significant differences in terms of overall system performance, indicated by similar ground delay and airport throughput numbers between methods. However, differences in individual strategies afforded by the manual methods allowed some participants to achieve system-wide delay that was much lower than the average. The FBA was the fastest method of capacity setting, and it received the lowest subjective rating scores on physical task load, mental task load, task difficulty and task complexity out of the three methods. Finally, participants explained through qualitative feedback that there were many benefits to using the FBA, such as ease of use, accuracy, and low risk of human input error. Participants did not experience the same limitations with the FBA that they did with the manual methods, such as reduced accuracy in the 60-minute manual condition, or high complexity in the 15-minute/manual condition. These results suggest that the FBA automation enhancement to CTOP maintains system performance while improving human performance. Therefore, the FBA could be introduced as a way to mitigate operator workload while planning a CTOP.

NextGen↗

Qualitative Data Coding of User Experience with an Urban Air Mobility Fleet Manager Interface

The NASA Aeronautics Research Mission Directorate created the High Density Vertiplex (HDV) project to integrate and evaluate a prototype Urban Air Mobility (UAM) ecosystem. Part of the HDV testing environment included a prototype operator user interface called the Fleet Manager Interface (FMI). In 2023, HDV conducted flight testing with the FMI during which a user experience (UX) study was performed to assess the quality of UX and elicit design recommendations. As a result, a large database of open-ended, qualitative responses was generated and then coded using a new qualitative data coding technique called Directive String Coding, which used a blended coding approach to generate actionable heuristics that stakeholders (e.g., researchers, UI designers, software developers) could use to answer specific research questions and make future design decisions. The key themes that arose from the coded responses showed that the UX was pleasant, system notifications should be more salient, and information across multiple screens should be integrated into a central display. As the Fleet Manger operational role is still being defined, it is vital to increase our understanding of the tools and capabilities needed for such a role. The results from HDV work will eventually feed into standards for vertiport operations that will enable safe and scalable UAM operations in the United States.

high density vertiplex↗

Qualitative Data Coding of User Experience with an Urban Air Mobility Fleet Manager Interface

The NASA Aeronautics Research Mission Directorate created the High Density Vertiplex (HDV) project to integrate and evaluate a prototype Urban Air Mobility (UAM) ecosystem. Part of the HDV testing environment included a prototype operator user interface called the Fleet Manager Interface (FMI). In 2023, HDV conducted flight testing with the FMI during which a user experience (UX) study was performed to assess the quality of UX and elicit design recommendations. As a result, a large database of open-ended, qualitative responses was generated and then coded using a new qualitative data coding technique called Directive String Coding, which used a blended coding approach to generate actionable heuristics that stakeholders (e.g., researchers, UI designers, software developers) could use to answer specific research questions and make future design decisions. The key themes that arose from the coded responses showed that the UX was pleasant, system notifications should be more salient, and information across multiple screens should be integrated into a central display. As the Fleet Manger operational role is still being defined, it is vital to increase our understanding of the tools and capabilities needed for such a role. The results from HDV work will eventually feed into standards for vertiport operations that will enable safe and scalable UAM operations in the United States.

high density veriplex↗

Infrared thermographic analysis of polymer composites during ballistic impact

An infrared thermographic system was used to measure the surface temperature profile of composite materials under ballistic impact. The heat deposited was calculated based on the temperature profiles. The extent of damage induced in the materials was determined qualitatively from the measured data. The relative contribution of frictional heat to total energy absorption was evaluated, and the effect of the shape of the projectile on the extent of damage and temperature distribution in the composites was examined. The results show that graphite and polyethylene composite are more effective than Kevlar composite in dissipating heat during the ballistic impact penetration process due to their higher thermal conductivity.

Hsieh, C. Y.↗

Space Science and Technology Partnership Forum: Analysis for a Joint Demonstration of High Priority, In-Space Assembly Technology

The various U. S. government agencies that are pursuing in-space assembly technology have a common need to demonstrate technological capabilities on a space-based platform. Several of the agencies, and different mission developers within an agency, have independently begun planning such demonstrations. This paper reports on a study of how well the different planned platforms could support demonstrations of the agencies’ joint needs. The study first prioritized a comprehensive list of the needs for in-space assembly capabilities across the agencies against jointly agreed evaluation criteria. Each planned demonstration platform was characterized to a first order. The capability needs were qualitatively assessed against four figures of merit including their joint priority, and the platforms were assessed against five criteria to produce a quantitative weighting factor of reach capability need and each platform. A Quality Function Deployment (QFD) matrix was used to deploy the weighted capability needs against the weighted platforms capabilities. This first-order assessment showed that the platforms reflect a great deal of redundant capability without a strong reason to prefer one over the others. These results were largely insensitive to the details of the assumptions.

Hamill, Doris L↗

Evaluation of SLAR and thematic mapper MSS data for forest cover mapping using computer-aided analysis techniques

Training and test data sets for CAM1S from NS-001 MSS data for two dates (geometrically adjusted to 30 meter resolution) were used to evaluate wavelength band. Two sets of tapes containing digitized HH and HV polarization data were obtained. Because the SAR data on the 9 track tapes contained no meaningful data, the 7 track tapes were copied onto 9 track tapes at LARS. The LARSYS programs were modified and a program was written to reformat the digitized SAR data into a LARSYS format. The radar imagery is being qualitatively interpreted. Results are to be used to identify possible cover types, to produce a classification map to aid in the numerical evaluation classification of radar data, and to develop an interpretation key for radar imagery. The four spatial resolution data sets were analyzed. A program was developed to reduce the spatial distortions resulting from variable viewing distance, and geometrically adjusted data sets were generated. A flowchart of steps taken to geometrically adjust a data set from the NS-001 scanner is presented.

Hoffer, R. M.↗

The Utilization of a Space Flight Plant Growth Chamber in the Cultivation of Salad Crop Species: A Prelude to a Salad Machine

The application of bioregenerative life support systems provides an attractive approach to minimize resupply requirement and ultimate self-sufficiency on long duration manned missions in space. The on-board cultivation of salad-type vegetables for crew consumption has been proposed as a first step approach towards reducing a total reliance on the resupply of food. The recent advances in the development of space flight plant growth facilities such as the Plant Generic Bioprocessing Apparatus (PGBA) have established a firm technical basis upon which the implementation of a 'salad machine' concept may be achieved. A presentation on ground based studies will be made evaluating (a) the operational performance of the PGBA facility in a crop production mode and (b) the qualitative and quantitative value of salad plant material produced within the chamber.

Heyenga, A. G.↗

Mutual coupling in a finite planar array of circular apertures

Equations are presented for the calculation of the interelement mutual coupling in a finite size planar array of wave-guide-fed apertures in an infinite flat conductor. The general mutual admittance expression is evaluated for circular apertures and the mutual coupling calculations are verified experimentally for two TE11 mode excited apertures. Qualitative agreement between calculations for a 183 element array and an infinite array establishes the validity of the finite array theoretical model.

Bailey, M. C.↗

A simple, objective analysis scheme for scatterometer data

A simple economical objective analysis scheme is devised and tested on real scatterometer data. It is designed to treat dense data such as those of the Seasat A Satellite Scatterometer (SASS) for individual or multiple passes, and preserves subsynoptic scale features. Errors are evaluated with the aid of sampling ('bootstrap') statistical methods. In addition, sensitivity tests have been performed which establish qualitative confidence in calculated fields of divergence and vorticity. The SASS wind algorithm could be improved; however, the data at this point are limited by instrument errors rather than analysis errors. The analysis error is typically negligible in comparison with the instrument error, but amounts to 30 percent of the instrument error in areas of strong wind shear. The scheme is very economical, and thus suitable for large volumes of dense data such as SASS data.

Levy, G.↗

An investigation into the flow behavior of a single phase gas system and a two phase gas/liquid system in normal gravity with nonuniform heating from above

The fluid behavior in normal gravity of a single phase gas system and a two phase gas/liquid system in an enclosed circular cylinder heated suddenly and nonuniformly from above was investigated. Flow visualization was used to obtain qualitative data on both systems. The use of thermochromatic liquid crystal particles as liquid phase flow tracers was evaluated as a possible means of simultaneously gathering both flow pattern and temperature gradient data for the two phase system. The results of the flow visualization experiments performed on both systems can be used to gain a better understanding of the behavior of such systems in a reduced gravity environment and aid in the verification of a numerical model of the system.

Disimile, Peter J.↗

A dynamic subgrid-scale model for compressible turbulence and scalar transport

The dynamic subgrid-scale (SGS) model of Germano et al. (1991) is generalized for the large eddy simulation (LES) of compressible flows and transport of a scalar. The model was applied to the LES of decaying isotropic turbulence, and the results are in excellent agreement with experimental data and direct numerical simulations. The expression for the SGS turbulent Prandtl number was evaluated using direct numerical simulation (DNS) data in isotropic turbulence, homogeneous shear flow, and turbulent channel flow. The qualitative behavior of the model for turbulent Prandtl number and its dependence on molecular Prandtl number, direction of scalar gradient, and distance from the wall are in accordance with the total turbulent Prandtl number from the DNS data.

Moin, P.↗

Enhanced Vision Flight Deck Technology for Commercial Aircraft Low-Visibility Surface Operations

NASA Langley Research Center and the FAA collaborated in an effort to evaluate the effect of Enhanced Vision (EV) technology display in a commercial flight deck during low visibility surface operations. Surface operations were simulated at the Memphis, TN (FAA identifier: KMEM) air field during nighttime with 500 Runway Visual Range (RVR) in a high-fidelity, full-motion simulator. Ten commercial airline flight crews evaluated the efficacy of various EV display locations and parallax and mini cation effects. The research paper discusses qualitative and quantitative results of the simulation experiment, including the effect of EV display placement on visual attention, as measured by the use of non-obtrusive oculometry and pilot mental workload. The results demonstrated the potential of EV technology to enhance situation awareness which is dependent on the ease of access and location of the displays. Implications and future directions are discussed.

Arthur, Jarvis J., III↗

ORACLES: Optimized Rational Algorithm for Conjecture of Long-term Exploration of Space

ORACLES is a joint venture between the United States Space Force (USSF) and the National Aeronautics and Space Administration (NASA) to develop a model for future space exploration, commercialization, and expansion. Following the success of qualitative future scenario exploration during the Space Futures Workshops (SFW), ORACLES aims to produce a quantitative means of evaluating these same factors. This model considers the social, economic, and political environment and determines possible inflection points; that is, the most crucial investments in technologies, infrastructure, and policy for the support and protection of U.S. and allied space assets. The development of ORACLES is in its infancy, with front end interfaces constructed for discussion and debate before the overall algorithm is finalized. Comments are highly encouraged as the team wishes to gain the broadest level of perspectives before continuing with development.

Robert B Adams↗

Where is the Human in the Loop? Human Factors Analysis of Extended Visual Line of Sight Unmanned Aerial System Operations within a Remote Operations Environment

Many envisioned technological and conceptual innovations focus on allocating more functions to automation, relegating the human as an afterthought if not a nuisance. Yet, until complete autonomy is realized, the human will remain “in the loop”. The National Aeronautics and Space Administration is supporting research for the development and maturation of automated technologies and architectures for the future of advanced air mobility. Standing up a remote operations center used to control, manage, and monitor multiple highly automated vehicles is an important step towards realizing the advanced air mobility vision. At the National Aeronautics and Space Administration’s Langley Research Center, a remote operation center exists and has been tested using humans piloting simulated vehicles. In this paper, we explore the human element within live flight operations that rely on increasingly automated technologies. Four ground control station operators performed multiple live flight operations. We employed a naturalistic approach and relied on qualitative data such as interviews and discussions with subject matter experts to help facilitate discovery. The present work evaluates the functions that the human and the automation had during the live operations, lists psychological constructs that may have promoted or reduced task performance, and provides recommendations on design of the remote operations environment and training of future ground control station operators.

Advanced Air Mobility↗

Where is the Human in the Loop? Human Factors Analysis of Extended Visual Line of Sight Unmanned Aerial System Operations within a Remote Operations Environment

Many envisioned technological and conceptual innovations focus on allocating more functions to automation, relegating the human as an afterthought if not a nuisance. Yet, until complete autonomy is realized, the human will remain “in the loop”. The National Aeronautics and Space Administration is supporting research for the development and maturation of automated technologies and architectures for the future of advanced air mobility. Standing up a remote operations center used to control, manage, and monitor multiple highly automated vehicles is an important step towards realizing the advanced air mobility vision. At the National Aeronautics and Space Administration’s Langley Research Center, a remote operation center exists and has been tested using humans piloting simulated vehicles. In this paper, we explore the human element within live flight operations that rely on increasingly automated technologies. Four ground control station operators performed multiple live flight operations. We employed a naturalistic approach and relied on qualitative data such as interviews and discussions with subject matter experts to help facilitate discovery. The present work evaluates the functions that the human and the automation had during the live operations, lists psychological constructs that may have promoted or reduced task performance, and provides recommendations on design of the remote operations environment and training of future ground control station operators.

Advanced Air Mobility↗

Conclusions of a Cryogenic Motor Configuration Study for Aircraft Propulsion

Cryogenic electric machines are a promising technology for multi megawatt electric aircraft drivetrains. Superconducting stators that make use of low AC loss superconducting wires are considered to be a key component for these cryogenic machines. This paper shares the lessons learned from a design study that evaluated several configurations of a 5 MW cryogenic motor for this application. The lessons are drawn from a qualitative study of 16 configurations and a quantitative study of 8 down selected configurations. The quantitative study involved using analytical calculations (electromagnetic, thermofluid, mechanical, and motor sizing) to determine each configuration’s Pareto front of total efficiency and total specific power. The conclusions from a preliminary assessment of different stator conductors (superconductors and cryogenic metals) are also presented. One motor configuration is down selected for future detailed design and demonstration at the multi megawatt level.

Electrified aircraft propulsion↗

Lessons Learned From A Cryogenic Motor Configuration Study for Aircraft Propulsion

Cryogenic electric machines are a promising technology for multi megawatt electric aircraft drivetrains. Superconducting stators that make use of low AC loss superconducting wires are considered to be a key component for these cryogenic machines. NASA has undertaken 6-year technical challenge to address this need by designing a 5 MW superconducting motor and cryogenic drive and developing multi-MW prototypes. This poster shares the lessons learned from a completed design study that evaluated several configurations of a 5 MW cryogenic motor for this application. The lessons are drawn from a qualitative study of 16 configurations and a quantitative study of 8 down selected configurations. The quantitative study involved using a motor design code based on analytical calculations (electromagnetic, thermofluid, mechanical, and motor sizing) to determine each configuration’s Pareto front of total efficiency and total specific power. This poster builds upon preliminary results that were previously presented by (1) reporting final results based on a revised design code for each configuration, including a considerable increase in fidelity for a novel radial flux motor and (2) making a down selection of the configuration for future detailed design and demonstration and documenting the rationale for the selection.

Superconductors↗

Advanced Signal Processing Methods Applied to Digital Mammography

The work reported here is on the extension of the earlier proposal of the same title, August 1994-June 1996. The report for that work is also being submitted. The work reported there forms the foundation for this work from January 1997 to September 1997. After the earlier work was completed there were a few items that needed to be completed prior to submission of a new and more comprehensive proposal for further research. Those tasks have been completed and two new proposals have been submitted, one to NASA, and one to Health & Human Services WS). The main purpose of this extension was to refine some of the techniques that lead to automatic large scale evaluation of full mammograms. Progress on each of the proposed tasks follows. Task 1: A multiresolution segmentation of background from breast has been developed and tested. The method is based on the different noise characteristics of the two different fields. The breast field has more power in the lower octaves and the off-breast field behaves similar to a wideband process, where more power is in the high frequency octaves. After the two fields are separated by lowpass filtering, a region labeling routine is used to find the largest contiguous region, the breast. Task 2: A wavelet expansion that can decompose the image without zero padding has been developed. The method preserves all properties of the power-of-two wavelet transform and does not add appreciably to computation time or storage. This work is essential for analysis of the full mammogram, as opposed to selecting sections from the full mammogram. Task 3: A clustering method has been developed based on a simple counting mechanism. No ROC analysis has been performed (and was not proposed), so we cannot finally evaluate this work without further support. Task 4: Further testing of the filter reveals that different wavelet bases do yield slightly different qualitative results. We cannot provide quantitative conclusions about this for all possible bases without further support. Task 5: Better modeling does indeed make an improvement in the detection output. After the proposal ended, we came up with some new theoretical explanations that helps in understanding when the D4 filter should be better. This work is currently in the review process. Task 6: N/A. This no longer applies in view of Tasks 4-5. Task 7: Comprehensive plans for further work have been completed. These plans are the subject of two proposals, one to NASA and one to HHS. These proposals represent plans for a complete evaluation of the methods for identifying normal mammograms, augmented with significant further theoretical work.

Stauduhar, Richard P.↗