Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “qualitative evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

A proposed framework for the development and qualitative evaluation of West Nile virus models and their application to local public health decision-making

West Nile virus (WNV) is a globally distributed mosquito-borne virus of great public health concern. The number of WNV human cases and mosquito infection patterns vary in space and time. Many statistical models have been developed to understand and predict WNV geographic and temporal dynamics. However, these modeling efforts have been disjointed with little model comparison and inconsistent validation. In this paper, we describe a framework to unify and standardize WNV modeling efforts nationwide. WNV risk, detection, or warning models for this review were solicited from active research groups working in different regions of the United States. A total of 13 models were selected and described. The spatial and temporal scales of each model were compared to guide the timing and the locations for mosquito and virus surveillance, to support mosquito vector control decisions, and to assist in conducting public health outreach campaigns at multiple scales of decision-making. Our overarching goal is to bridge the existing gap between model development, which is usually conducted as an academic exercise, and practical model applications, which occur at state, tribal, local, or territorial public health and mosquito control agency levels. The proposed model assessment and comparison framework helps clarify the value of individual models for decision-making and identifies the appropriate temporal and spatial scope of each model. This qualitative evaluation clearly identifies gaps in linking models to applied decisions and sets the stage for a quantitative comparison of models. Specifically, whereas many coarse-grained models (county resolution or greater) have been developed, the greatest need is for fine-grained, short-term planning models (m–km, days–weeks) that remain scarce. We further recommend quantifying the value of information for each decision to identify decisions that would benefit most from model input.

60 APPLIED LIFE SCIENCES↗
NASA NTRS1987

Qualitative evaluation of a flush air data system at transonic speeds and high angles of attack

Flight tests were performed on an F-14 aircraft to evaluate the use of flush pressure orifices on the nose section for obtaining air data at transonic speeds over a large range of flow angles. This program was part of a flight test and wind tunnel program to assess the accuracies of such systems for general use on aircraft. It also provided data to validate algorithms developed for the shuttle entry air data system designed at NASA Langley. Data were obtained for Mach numbers between 0.60 and 1.60, for angles of attack up to 26.0 deg, and for sideslip angles up to 11.0 deg. With careful calibration, a flush air data system with all flush orifices can provide accurate air data information over a large range of flow angles. Several orificies on the nose cap were found to be suitable for determination of stagnation pressure. Other orifices on the nose section aft of the nose cap were shown to be suitable for determination of static pressure. Pairs of orifices on the nose cap provided the most sensitive measurements for determining angles of attack and sideslip, although orifices located farther aft on the nose section could also be used.

Larson, Terry J.↗
NASA NTRS1990

Qualitative evaluation of a conformal velocity vector display for use at high angles-of-attack in fighter aircraft

A piloted simulation study was conducted to evaluate the utility of a display device designed to illustrate graphically and conformally the approximate location of a fighter aircraft's velocity vector. The display device consisted of two vertical rows of light emitting diodes (LED's) located toward the center of the cockpit instrument panel to each side of the control stick. The light strings provided a logical extension of the head up display (HUD) velocity vector symbol at flight path angles which exceeded the HUD field-of-view. Four test subjects flew a modified F/A-18 model with this display in an air-to-air engagement task against an equally capable opponent. Their responses to a questionnaire indicated that the conformal velocity vector information could not be used during the scenarios investigated due to the inability to visually track a target and view the lights simultaneously.

Jones, Denise R.↗
NASA NTRSDate not supplied

Identifying Emerging Safety Threats Through Topic Modeling in the Aviation Safety Reporting System: A Covid-19 Study

The NASA Aviation Safety Reporting System (ASRS) is a voluntary, confidential aviation safety reporting system. The ASRS receives reports from pilots, air traffic controllers, flight attendants, and others involved in aviation operations. The reports are de-identified and coded by ASRS expert safety analysts, and a short descriptive synopsis is written to describe the safety issue. The de-identified reports are then disseminated to the aviation community in many ways, including via an online database, Safety Alert Bulletins, For Your Information Notices, and the CALLBACK newsletter. In this work, we consider whether we can improve the grouping, linking, and understanding of safety concerns through topic modeling. Specifically, we use topic modeling as a building block to identify emerging safety threats over time. This unsupervised approach, we argue, offers the flexibility to identify new emerging themes in this large dataset by constructing different timelines based on the content similarity of ASRS report narratives. This method's unsupervised nature improves upon related research, which is limited to pre-defined labels and therefore can not fully capture emerging safety threats. We apply our method to all ASRS reports in 2020 to assess if the generated timelines can highlight COVID-19 as it is emerging as a safety threat in incoming ASRS reports. We perform both a quantitative and qualitative evaluation of the automatically constructed timelines. The qualitative evaluation is performed by describing the evolution of top terms in the timelines, generated by our method, which we found explicitly convey the themes of COVID-19. Separately, we use a set of 1,213 COVID-19 reports from 2020 that were manually identified by ASRS analysts to quantitatively evaluate the COVID-19 reports distribution across the timelines. Our results have shown that COVID-19 emergence can be identified using the top terms that were generated by topic modeling. The top terms in topic modeling therefore can serve as a summary alternative to manually inspecting reports. Moreover, leveraging the manually identified COVID-19 reports, we found the manually identified timelines accounted for over 70% of the COVID-19 reports curated by the ASRS analysts, which demonstrates the potential of this approach for facilitating the understanding of safety concerns as they emerge and evolve. This method shows great potential to understand aerospace safety threats and other narrative- driven incident report databases.

ASRS↗
NASA NTRSDate not supplied

Identifying Emerging Safety Threats Through Topic Modeling in the Aviation Safety Reporting System: A COVID-19 Study

The NASA Aviation Safety Reporting System (ASRS) is a voluntary, confidential aviation safety reporting system. The ASRS receives reports from pilots, air traffic controllers, flight attendants, and others involved in aviation operations. The reports are de-identified and coded by ASRS expert safety analysts, and a short descriptive synopsis is written to describe the safety issue. The de-identified reports are then disseminated to the aviation community in many ways, including via an online database, Safety Alert Bulletins, For Your Information Notices, and the CALLBACK newsletter. In this work, we consider whether we can improve the grouping, linking, and understanding of safety concerns through topic modeling. Specifically, we use topic modeling as a building block to identify emerging safety threats over time. This unsupervised approach, we argue, offers the flexibility to identify new emerging themes in this large dataset by constructing different timelines based on the content similarity of ASRS report narratives. This method's unsupervised nature improves upon related research, which is limited to pre-defined labels and therefore can not fully capture emerging safety threats. We apply our method to all ASRS reports in 2020 to assess if the generated timelines can highlight COVID-19 as it is emerging as a safety threat in incoming ASRS reports. We perform both a quantitative and qualitative evaluation of the automatically constructed timelines. The qualitative evaluation is performed by describing the evolution of top terms in the timelines, generated by our method, which we found explicitly convey the themes of COVID-19. Separately, we use a set of 1,213 COVID-19 reports from 2020 that were manually identified by ASRS analysts to quantitatively evaluate the COVID-19 reports distribution across the timelines. Our results have shown that COVID-19 emergence can be identified using the top terms that were generated by topic modeling. The top terms in topic modeling therefore can serve as a summary alternative to manually inspecting reports. Moreover, leveraging the manually identified COVID-19 reports, we found the manually identified timelines accounted for over 70% of the COVID-19 reports curated by the ASRS analysts, which demonstrates the potential of this approach for facilitating the understanding of safety concerns as they emerge and evolve. This method shows great potential to understand aerospace safety threats and other narrative- driven incident report databases.

ASRS↗
DOE OSTI2023

Automated Air Sealing Demonstration: Denver Federal Center Building 40

This project aimed to demonstrate building airtightness achieved by automated air sealing in a commercial building setting. The automated air sealing demonstrated in this project uses a modified blower door to pressurize and distribute the sealing aerosol to achieve the required building airtightness. To demonstrate this technology, Building 40 at the Denver Federal Center, a federally owned campus under the jurisdiction, custody and control of the U.S. General Services Administration (GSA), was selected for testing (Figure 2). This building is currently undergoing several retrofit projects, including increasing insulation, installing high-performance windows, and adding advanced equipment, control systems, and automated air sealing. This demonstration project involved installing automated air sealing and measuring the improvements in the building's airtightness. The automated air sealing was installed over two days by AeroBarrier, the vendor. An external blower door test contractor measured the airtightness of the demonstration space before and after air sealing. The new airtightness value and the percentage increase in airtightness were used to evaluate the energy savings potential of automated air sealing. These airtightness values were used to compute the energy savings and CO 2 emissions reduction for different climate zones, building types, and initial airtightness conditions. In addition, the heating, ventilation and air conditioning (HVAC) load reduction attributable to the reduced building air leakage was studied. This study included research to determine the cost and time reduction of automated air sealing. Finally, the automated air sealing performance was evaluated qualitatively using a focus group discussion that included GSA and Bristol, the general contractor. The installation has shown the demonstration site, with a floor size of 4,462 ft 2 , air leakage has reduced by more than 50% in less than 7 hours, including preparation, site sealing, and cleanup. The performance objectives were classified as quantitative or qualitative based on the evaluation metrics used to assess the project’s success. The key performance objectives for this project were the level of airtightness achieved, the time and cost required to perform the sealing, and the HVAC load reduction attributable to air sealing. Table 1 shows the quantitative performance objectives.

42 ENGINEERING↗
NASA NTRS2000

A Qualitative Piloted Evaluation of the Tupolev Tu-144 Supersonic Transport

Two U.S. research pilots evaluated the Tupolev Tu-144 supersonic transport aircraft on three dedicated flights: one subsonic and two supersonic profiles. The flight profiles and maneuvers were developed jointly by Tupolev and U.S. engineers. The vehicle was found to have unique operational and flight characteristics that serve as lessons for designers of future supersonic transport aircraft. Vehicle subsystems and observed characteristics are described as are flight test planning and ground monitoring facilities. Maneuver descriptions and extended pilot narratives for each flight are included as appendices.

Rivers, Robert A.↗
DOE OSTI2024

Evaluation of Saccadic Component Measure on Smooth Pursuit Tests

ABSTRACT Introduction Despite the advancement of eye-tracking technology for smooth pursuit (SP) eye movement evaluation, qualitative observation offers much information that is not captured by computers; hence, both objective and qualitative information should be utilized to evaluate SP. This study examined the consistency among our clinicians when evaluating SP using normal (N), grossly normal (GN), mildly abnormal (MA), and abnormal (AB) as classifications. We then evaluated the effect of combining GN and MA into a single subclinical (SUBC) category. We also evaluated the computerized percent saccade (PS) metric by determining its sensitivity and specificity in classifying SP. Materials and Methods Retrospective horizontal and vertical SP test videos and numerical data for 70 participants were obtained from the Neuro Kinetics Neuro-Otologic Test Center and de-identified. From this, eye-tracking videos, time plots of eye-tracking positional data, and tables of SP eye-tracking performance data were generated for 0.1, 0.3, and 0.5 Hz in both horizontal and vertical planes, totaling 6 tests per subject. Three clinicians rated each subject’s SP performance as N, GN, MA, or AB for a total of 6 ratings (3 frequencies, horizontal and vertical). This process was repeated using N, SUBC, and AB as rating categories. Clinicians also provided an overall SP rating for each plane as follows: AB if the results were abnormal for 2 or more frequencies tested. Alternatively, if fewer than 2 frequencies presented with a rating of AB, then an overall rating of MA, GN, or N was determined at the respective clinician’s discretion. Results When the 3 clinicians were tasked with classifying SP videos using 4 clinical categories, fair overall agreement was demonstrated. However, when MA and GN categories were combined into an SUBC category, the overall agreement for the 3 clinicians improved slightly for both horizontal SP (HSP) and vertical SP (VSP). This pattern of agreement did not differ considerably when comparing HSP versus VSP, and good consistency and reliability was observed across clinicians. Again, inter-rater consistency was smaller for VSP versus HSP despite the reduction in clinical categories. Cut-off values were generated for the PS metric and demonstrated good specificity and sensitivity when they were exceeded for 2 or more frequencies in a particular plane when evaluating a subject’s SP test. Conclusions

General & Internal Medicine↗
NASA NTRS1983

Integrated Technology Rotor/Flight Research Rotor (ITR/FRR) concept definition study

Studies were conducted by Hughes Helicopters, Inc. (HHI) for the Applied Technology Laboratory and Aeromechanics Laboratory, U.S. Army Research and Technology Laboratories (AVRADCOM) and the Ames Research Center, National Aeronautics and Space Administration (NASA). Results of predesign studies of advanced main rotor hubs, including bearingless designs, are presented in this report. In addition, the Government's rotor design goals and specifications were reviewed and evaluated. Hub concepts were designed and qualitatively evaluated in order to select the two most promising concepts for further development. Various flexure designs, control systems, and pitchcase designs were investigated during the initial phases of this study. The two designs selected for additional development were designated the V-strap and flat-strap cruciform hubs. These hubs were designed for a four bladed rotor and were sized for 18,400 pounds gross weight with the same diameter (62 feet) and solidity (23 inch chord) as the existing rotor on the Rotor Systems Research Aircraft (RSRA).

Hughes, C. W.↗
NASA NTRS2001

Boiler Tube Corrosion Characterization with a Scanning Thermal Line

Wall thinning due to corrosion in utility boiler water wall tubing is a significant operational concern for boiler operators. Historically, conventional ultrasonics has been used for inspection of these tubes. Unfortunately, ultrasonic inspection is very manpower intense and slow. Therefore, thickness measurements are typically taken over a relatively small percentage of the total boiler wall and statistical analysis is used to determine the overall condition of the boiler tubing. Other inspection techniques, such as electromagnetic acoustic transducer (EMAT), have recently been evaluated, however they provide only a qualitative evaluation - identifying areas or spots where corrosion has significantly reduced the wall thickness. NASA Langley Research Center, in cooperation with ThermTech Services, has developed a thermal NDE technique designed to quantitatively measure the wall thickness and thus determine the amount of material thinning present in steel boiler tubing. The technique involves the movement of a thermal line source across the outer surface of the tubing followed by an infrared imager at a fixed distance behind the line source. Quantitative images of the material loss due to corrosion are reconstructed from measurements of the induced surface temperature variations. This paper will present a discussion of the development of the thermal imaging system as well as the techniques used to reconstruct images of flaws. The application of the thermal line source coupled with the analysis technique represents a significant improvement in the inspection speed and accuracy for large structures such as boiler water walls. A theoretical basis for the technique will be presented to establish the quantitative nature of the technique. Further, a dynamic calibration system will be presented for the technique that allows the extraction of thickness information from the temperature data. Additionally, the results of the application of this technology to actual water wall tubing samples and in-situ inspections will be presented.

Cramer, K. Elliott↗
NASA NTRS1981

Vehicle test report: South Coast technology electric conversion of a Volkswagen Rabbit

The South Coast Technology Volkswagen Rabbit, was tested at the Jet Propulsion Laboratory's (JPL) dynamometer facility and at JPL's Edwards Test Station (ETS). The tests were performed to characterize certain parameters of the South Coast Rabbit and to provide baseline data that will be used for the comparison of near term batteries that are to be incorporated into the vehicle. The vehicle tests were concentrated on the electrical drive system; i.e., the batteries, controller, and motor. The tests included coastdowns to characterize the road load, maximum effort acceleration, and range evaluation for both cyclic and constant speed conditions. A qualitative evaluation of the vehicle was made by comparing its constant speed range performance with those vehicles described in the document 'state of the Art assessment of Electric and Hybrid Vehicles'. The Rabbit performance was near to the best of the 1977 vehicles.

Price, T. W.↗
NASA NTRS1981

Vehicle test report: Electric Vehicle Associates electric conversion of an AMC Pacer

Tests were performed to characterize certain parameters of the EVA Pacer and to provide baseline data that can be used for the comparison of improved batteries that may be incorporated into the vehicle at a later time. The vehicle tests were concentrated on the electrical drive subsystem; i.e., the batteries, controller and motor. The tests included coastdowns to characterize the road load, and range evaluations for both cyclic and constant speed conditions. A qualitative evaluation of the vehicle's performance was made by comparing its constant speed range performance with other electric and hybrid vehicles. The Pacer performance was approximately equal to the majority of those vehicles assessed in 1977.

Price, T. W.↗
NASA NTRS1982

Vehicle test report: Battronic pickup truck

An electric pickup truck was tested to characterize certain parameters and to provide baseline data that can be used for the comparison of improved batteries that may be incorporated into the vehicle at a later time. The vehicle tests were concentrated on the electrical drive subsystem; i.e., the batteries, controller, and motor. The tests included coastdowns to characterize the road load and range evaluations for both cyclic and constant speed conditions. A qualitative evaluation of the vehicle's performance was made by comparing its constant speed range performance with other vehicles.

Price, T. W.↗
DOE OSTI2021

Resilient cooling strategies – A critical review and qualitative assessment

The global effects of climate change will increase the frequency and intensity of extreme events such as heatwaves and power outages, which have consequences for buildings and their cooling systems. Buildings and their cooling systems should be designed and operated to be resilient under such events to protect occupants from potentially dangerous indoor thermal conditions. This study performed a critical review on the state-of-the-art of cooling strategies, with special attention to their performance under heatwaves and power outages. We proposed a definition of resilient cooling and described four criteria for resilience—absorptive capacity, adaptive capacity, restorative capacity, and recovery speed —and used them to qualitatively evaluate the resilience of each strategy. The literature review and qualitative analyses show that to attain resilient cooling, the four resilience criteria should be considered in the design phase of a building or during the planning of retrofits. The building and relevant cooling system characteristics should be considered simultaneously to withstand extreme events. A combination of strategies with different resilience capacities, such as a passive envelope strategy coupled with a low-energy space-cooling solution, may be needed to obtain resilient cooling. Finally, a further direction for a quantitative assessment approach has been pointed out.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Qualitative and Quantitative Evaluation for Representative Human Reliability Analysis Methods

The Korea Institute of Nuclear Safety (KINS) is the regulatory expert organization established by the Korean government to strengthen the nation’s technical capabilities relating to nuclear safety regulation. KINS oversees the technical aspects of nuclear safety regulation, including safety reviews, inspections, education, and safety research—all conducted based on technical knowledge and accumulated regulatory experience. In 2023, KINS requested that Idaho National Laboratory (INL) validates representative human reliability analysis (HRA) methods used throughout the world, thus affording KINS with a basis for determining an HRA method adequate for its domestic regulatory purposes. The present paper mainly examines INL’s efforts in this regard. The resulting INL study covered four representative HRA methods widely used by nuclear utilities and regulatory institutes. These methods were qualitatively evaluated by applying specific evaluation criteria and determining how well each method reflected critical HRA issues. For this assessment, INL benchmarked the Halden International HRA Empirical Study. Using the Halden empirical data, along with information on human failure events (HFEs), the present study employed the selected HRA methods to estimate human error probabilities (HEPs) for the HFEs. It also performed statistical analyses to compare the HEPs predicted via the HRA methods against those from the Halden empirical data.

99 - GENERAL AND MISCELLANEOUS↗
NASA NTRS1995

Flight test of the X-29A at high angle of attack: Flight dynamics and controls

The NASA Dryden Flight Research Center has flight tested two X-29A aircraft at low and high angles of attack. The high-angle-of-attack tests evaluate the feasibility of integrated X-29A technologies. More specific objectives focus on evaluating the high-angle-of-attack flying qualities, defining multiaxis controllability limits, and determining the maximum pitch-pointing capability. A pilot-selectable gain system allows examination of tradeoffs in airplane stability and maneuverability. Basic fighter maneuvers provide qualitative evaluation. Bank angle captures permit qualitative data analysis. This paper discusses the design goals and approach for high-angle-of-attack control laws and provides results from the envelope expansion and handling qualities testing at intermediate angles of attack. Comparisons of the flight test results to the predictions are made where appropriate. The pitch rate command structure of the longitudinal control system is shown to be a valid design for high-angle-of-attack control laws. Flight test results show that wing rock amplitude was overpredicted and aileron and rudder effectiveness were underpredicted. Flight tests show the X-29A airplane to be a good aircraft up to 40 deg angle of attack.

Bauer, Jeffrey E.↗
NASA NTRS1980

NASCAP modelling computations on large optics spacecraft in geosynchronous substorm environments

Satellites in geosynchronous orbits have been found to be charged to significant negative voltages during encounters with geomagnetic substorms. When satellite surfaces are charged, there is a probability of enhanced contamination from charged particles attracted back to the satellite by electrostatic forces. This could be particularly disturbing to large satellites using sensitive optical systems. In this study the NASA Charging Analyzer Program (NASCAP) is used to evaluate qualitatively the possibility of such enhanced contamination on a conceptual version of a large satellite. The evaluation is made by computing surface voltages on the satellite due to encounters with substorm environments and then computing charged-particle trajectories in the electric fields around the satellite. Particular attention is paid to the possibility of contaminants reaching a mirror surface inside a dielectric tube because this mirror represents a shielded optical surface in the satellite model used. Deposition of low energy charged particles from other parts of the spacecraft onto the mirror was found to be possible in the assumed moderate substorm environment condition. In the assumed severe substorm environment condition, however, voltage build up on the inside and edges of the dielectric tube in which the mirror is located prevents contaminants from reaching the mirror surface.

Stevens, N. J.↗