Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “qualitative evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Prognostic Launch Vehicle Probability of Failure Assessment Methodology for Conceptual Systems Predicated on Human Causal Factors

Lessons learned from past failures of launch vehicle developments and operations were used to create a new method to predict the probability of failure of conceptual systems. Existing methods such as Probabilistic Risk Assessments and Human Risk Assessments were considered but found to be too cumbersome for this type of system-wide application for yet-to-be-flown vehicles. The basis for this methodology were historic databases of past failures, where it was determined that various faulty human-interactions were the predominant root causes of failure rather than deficient component reliabilities evaluated through statistical analysis. This methodology contains an expert scoring part which can be used in either a qualitative or a quantitative mode. The method produces two products: a numerical score of the probability of failure or guidance to program management on critical areas in need of increased focus to improve the probability of success. In order to evaluate the effectiveness of this new method, data from a concluded vehicle program (USAF's Titan IV with the Centaur G-Prime upper stage) was used as a test case. Although the theoretical vs. actual probability of failure was found to be in reasonable agreement (4.46% vs. 6.67% respectively) the underlying sub-root cause scoring had significant disparities attributable to significant organizational changes and acquisitions. Recommendations are made for future applications of this method to ongoing launch vehicle development programs.

Craig H Williams↗

Testing of the NASA Exploration Extravehicular Mobility Unit Demonstration (xEMU Demo) Architecture at the Neutral Buoyancy Laboratory (NBL)

Following Z-2 space suit testing that occurred from 2016-2017, the Exploration Extravehicular Mobility Unit (xEMU) Project was tasked with building a demonstration unit of the xEMU space suit to test on the International Space Station (ISS) in 2023. This suit is called xEMU Demonstration Suit (xEMU Demo). Based on feedback from astronauts during the Z-2 NBL test series, design changes were made, resulting in a new prototype suit called the Z-2.5 space suit. The design of the Z-2.5 space suit with an exploration Portable Life Support Systems (xPLSS) mock-up represents the architecture of xEMU Demo. The team is testing Z-2.5 in the NBL to evaluate this architecture and validate changes made from Z-2. The results will inform the xEMU Demo design going forward to its Preliminary Design Review (PDR) in the summer of 2019. This Z-2.5 NBL test series focuses on evaluating the microgravity performance of the suit and the ability to complete ISS-related tasks. The series is comprised of 10 manned runs and an unmanned corn-man run. Six test subjects, including four astronauts, will participate. The test objective is to evaluate ability xEMU Demo architecture to perform ISS microgravity tasks. Each crew members will complete both a familiarization run and a nominal EMU EVA timeline run. Qualitative and quantitative data will be collected to aid the assessment of the suit. Preliminary feedback from astronauts who have completed the test series evaluate the xEMU Demo architecture as acceptable to complete a demonstration mission on the ISS.

Davis, Kristine↗

Evaluation of the sensitivity of reflectance ratios to mafic minerals in the lunar regolith

The 950/560-nm spectral ratio has been traditionally used as a qualitative indicator or lunar soil maturity because the 950-nm band falls within the major Fe(2+) mineral absorption bands near 1-micron characteristic of relatively immature crystalline surfaces. Since there are several other processes unrelated to maturation that may affect this ratio value, the 950/730-nm ratio has been evaluated as a potentially better measure of the relative 1-micron band strength. It is found that the 950/730-nm ratio appears to be much more sensitive to the 1-micron band depth, but it is believed that other unknown variables preclude using these single ratios to provide meaningful quantitative results at this time.

Larson, Stephen M.↗

Evaluation of the Accumulation of Foreign Object Debris in the International Space Station Ventilation Systems and Resulting Impacts to Systems

A challenge for the International Space Station (ISS) is accumulation of foreign object debris (FOD) in the ventilation systems and the impacts to crew, equipment, and experiments. One function of the temperature and humidity control system is to capture FOD with various methods of filtration to minimize these impacts. ISS filtration has been augmented by charcoal and High Efficiency Particulate Air (HEPA) filters and screens. A qualitative comparison of the quantity of FOD found since 2012 study and the current levels are evaluated. Impacts due to FOD are reduced air circulation, increased crew time for cleaning, reduction of equipment life, and component damage; examples are provided. Recommendations for further improvements to reduce the accumulation of FOD on ISS are provided.

ISS↗

Three-step LES-C models for flows at high Reynolds numbers

Here, we investigate the need for the second correction step in the recently proposed LES-C models for fluid flows at high Reynolds numbers. These models use a predictor-corrector idea to enhance the efficiency of the existing Large Eddy Simulation models. Different three-step(one defect step, two corrections) LES-C models, based on the Leray-α, ADM and NS-ω LES models, are tested in three different situations. The new Leray-α-C2 model (C2 stands for two correction steps) is applied to the Navier–Stokes equations; the ADC2 is applied to the MagnetoHydroDynamic flow; and the NS-ω-C2 is used in the fluid-fluid interaction problem. We evaluate the effectiveness of the second correction step in all these settings, using qualitative and quantitative numerical tests.

97 MATHEMATICS AND COMPUTING↗

Mitigative Strategies for Recovering From Large Language Model Trust Violations

In this study, we investigated strategies to address trust issues arising from errors in large language models (LLMs). The study examined the impact of confidence scores, system capability explanations, and user feedback on trust restoration post-error. 68 participants viewed the responses of an LLM to 20 general trivia questions, with an error introduced on the third trial. Each participant was presented with one mitigation strategy. Participants rated their overall trust in the model and the reliability of the answer. Results showed an immediate drop in trust after the error; however, there were no differences across the three strategies in trust recovery. All conditions had a logarithmic trend in trust recovery following error. Differences in overall trust were predicted by perceived reliability of the answer, suggesting that participants were evaluating results critically and using that to inform their trust in the model. Qualitative data supported this finding; participants expressed lasting distrust despite the LLM’s later accuracy. Results showcase the need to prioritize accuracy in LLM deployment, because early errors may irrevocably damage user trust calibration and later adoption.

97 MATHEMATICS AND COMPUTING↗

Land-mobile field experiments in Australia

The Mobile Satellite Experiment/Australia Mobile Satellite Experiment (MSAT-X/AUSSAT) experiment offered the first true land-mobile satellite configuration to evaluate the MSAT-X technologies and equipment. Both quantitative data tests and qualitative voice link demonstrations were successfully conducted. From the collected data, system performance in typical land-mobile conditions was extracted. A set of propagation characteristics corresponding to the wide range of environments encountered was also obtained. A brief description is given of the MSAT-X/AUSSAT experiment and a summary of its results analyzed to date.

Ho, Loretta G. L.↗

Fuel Systems Architecture (FSA) evaluation criteria and concept evaluation methodology

Consideration is given to two methods developed for the evaluation, screening, and ranking of concepts for Space Exploration Initiative vehicle propellant management systems. The methods selected for handling this multicriteria decision problem are based on the utility theory which transforms both qualitative and quantitative criteria into a nondimensional utility scale for comparison of dissimilar figures of merit. The development of the resultant FSA evaluation criteria and concept evaluation methodology is summarized.

Hendershot, J. E.↗

Enhancing Site Screening for Underground Hydrogen Storage: Qualitative Site Quality Assessment - SHASTA: Subsurface Hydrogen Assessment, Storage, and Technology Acceleration Project

The global shift towards renewable energy sources to mitigate fossil fuel dependency and meet carbon emission targets by 2050 has underscored the importance of innovative solutions to address energy supply-demand imbalances. Underground Hydrogen Storage (UHS) has emerged as a promising strategy to store excess renewable energy in subsurface formations for future retrieval and utilization. This report focuses on enhancing the site screening process for UHS facilities. By drawing on insights from prior research to identify key criteria influencing site suitability, our objective is to present a comprehensive set of sixteen specific criteria essential for refining the selection of UHS sites. These criteria cover various aspects such as reservoir performance, legal access, regulatory compliance, economic viability, public acceptance, and safety and security considerations. Our proposed methodology allows users to evaluate potential sites using binary responses, transitioning from isolated factors to broader considerations that facilitate a qualitative assessment of site suitability. This method enables comparative analysis and informed decision-making, supporting stakeholders in the site selection process. Our approach is designed as a guiding framework rather than a rigid template for site screening, emphasizing the importance of customizing approaches to individual circumstances. As UHS site development project evolves, adopting a comprehensive selection methodology that integrates holistic evaluations will be essential for ensuring efficient and effective site screening processes tailored to specific project needs.

08 HYDROGEN↗

Enhancing Site Screening for Underground Hydrogen Storage: Qualitative Site Quality Assessment - SHASTA: Subsurface Hydrogen Assessment, Storage, and Technology Acceleration Project

The global shift towards renewable energy sources to mitigate fossil fuel dependency and meet carbon emission targets by 2050 has underscored the importance of innovative solutions to address energy supply-demand imbalances. Underground Hydrogen Storage (UHS) has emerged as a promising strategy to store excess renewable energy in subsurface formations for future retrieval and utilization. This report focuses on enhancing the site screening process for UHS facilities. By drawing on insights from prior research to identify key criteria influencing site suitability, our objective is to present a comprehensive set of sixteen specific criteria essential for refining the selection of UHS sites. These criteria cover various aspects such as reservoir performance, legal access, regulatory compliance, economic viability, public acceptance, and safety and security considerations. Our proposed methodology allows users to evaluate potential sites using binary responses, transitioning from isolated factors to broader considerations that facilitate a qualitative assessment of site suitability. This method enables comparative analysis and informed decision-making, supporting stakeholders in the site selection process. Our approach is designed as a guiding framework rather than a rigid template for site screening, emphasizing the importance of customizing approaches to individual circumstances. As UHS site development project evolves, adopting a comprehensive selection methodology that integrates holistic evaluations will be essential for ensuring efficient and effective site screening processes tailored to specific project needs.

08 HYDROGEN↗

The Effect of Material Properties on Oxygen Evolution Activity and Assessing Half-Cell Screening as a Predictive Tool in Electrolysis

Iridium-based oxygen evolution catalysts are screened in this study for activity and stability with rotating disk electrode (RDE) half-cells. This study focuses on the electrochemical and materials approaches needed to characterize oxygen evolution catalysts, and include testing for activity, stability, composition, oxide content, and structure. Findings also discuss recommendations for data interpretation and detail the difficulties of comparing catalysts across materials sets with different elemental and oxide compositions, and linking RDE activity to device-level performance. The materials evaluated are a mixture of oxides and metals, and several methods are used to quantify metal content, qualitatively assess oxide content, and determine total surface area. Oxygen evolution activities and stabilities are compared, where a wide range of results are reported. In general, higher RDE performances are found for catalysts that contained larger amounts of ruthenium and metals. Higher durability, however, is found for catalysts that only contained iridium and a higher proportion of oxides. Additionally, catalysts are evaluated for performance in membrane electrode assemblies to assess RDE as a predictive tool in electrolysis. While activity trends within individual material sets generally held between ex- and in-situ testing, RDE tends to overestimate the activity of more metallic catalysts when compared to device-level performance. These results stress the need for multiple metal/oxide baselines for mixed catalysts, to better project in-situ kinetics.

36 MATERIALS SCIENCE↗

Terrain Portrayal for Head-Down Displays Experiment

The General Aviation Element of the Aviation Safety Program's Synthetic Vision Systems (SVS) Project is developing technology to eliminate low visibility induced General Aviation (GA) accidents. SVS displays present computer generated 3-dimensional imagery of the surrounding terrain on the Primary Flight Display (PFD) to greatly enhance pilot's situation awareness (SA), reducing or eliminating Controlled Flight into Terrain, as well as Low-Visibility Loss of Control accidents. SVS-conducted research is facilitating development of display concepts that provide the pilot with an unobstructed view of the outside terrain, regardless of weather conditions and time of day. A critical component of SVS displays is the appropriate presentation of terrain to the pilot. An experimental study has been conducted at NASA Langley Research Center (LaRC) to explore and quantify the relationship between the realism of the terrain presentation and resulting enhancements of pilot SA and pilot performance. Composed of complementary simulation and flight test efforts, Terrain Portrayal for Head-Down Displays (TP-HDD) experiments will help researchers evaluate critical terrain portrayal concepts. The experimental effort is to provide data to enable design trades that optimize SVS applications, as well as develop requirements and recommendations to facilitate the certification process. This paper focuses on the experimental set-up and preliminary qualitative results of the TP-HDD simulation experiment. In this experiment a fixed based flight simulator was equipped with various types of Head Down flight displays, ranging from conventional round dials (typical of most GA aircraft) to glass cockpit style PFD's. The variations of the PFD included an assortment of texturing and Digital Elevation Model (DEM) resolution combinations. A test matrix of 10 terrain display configurations (in addition to the baseline displays) were evaluated by 27 pilots of various backgrounds and experience levels. Qualitative (questionnaires) and quantitative (pilot performance and physiological) data were collected during the experimental runs. Preliminary results indicate that all of the evaluation pilots favored SVS displays over standard gauges, in terms of terrain awareness, SA, and perceived pilot performance. Among the terrain portrayal concepts tested, most pilots preferred the higher-resolution DEM. In addition, with minimal training, low-hour VFR evaluation pilots were able to negotiate a precision approach using SVS displays with a tunnel in the sky guidance concept.

Hughes, Monica F.↗

Detection of Anatoxins in Human Urine by Liquid Chromatography Triple Quadrupole Mass Spectrometry and ELISA

Harmful cyanobacterial blooms are becoming more common and persistent around the world. When in bloom, various cyanobacterial strains can produce anatoxins in high concentrations, which, unlike other cyanobacterial toxins, may be present in clear water. Potential human and animal exposures to anatoxins occur mainly through unintentional ingestion of contaminated algal mats and water. To address this public health threat, we developed and validated an LC-MS/MS method to detect anatoxins in human urine to confirm exposures. Pooled urine was fortified with anatoxin-a and dihydroanatoxin at concentrations from 10.0 to 500 ng/mL to create calibrators and quality control samples. Samples were diluted with isotopically labeled anatoxin and solvent prior to LC-MS/MS analysis. This method can accurately quantitate anatoxin-a with inter- and intraday accuracies ranging from 98.5 to 103% and relative standard deviations < 15%, which is within analytical guidelines for mass spectrometry methods. Additionally, this method qualitatively detects a common degradation product of anatoxin, dihydroanatoxin, above 10 ng/mL. We also evaluated a commercial anatoxin-a ELISA kit for potential diagnostic use; however, numerous false positives were detected from unexposed individual human urine samples. In conclusion, we have developed a method to detect anatoxins precisely and accurately in urine samples, addressing a public health area of concern, which can be applied to future exposure events.

urine↗

Use of Loran-C for general aviation aircraft navigation

Quantitative and qualitative observations were made on the Loran-C in general aviation aircraft. The evaluation of Loran-C for both cross country flights and nonprecision approaches was conducted under simulated instrument flight rules conditions. Particular emphasis was placed on the reliability and failure of Loran-C equipment as well as its susceptibility to atmospheric effects such as P static. Efforts were made to quantify the long term stability of the Loran-C time difference grid. Several E field antenna configurations were also evaluated in terms of performance. Significant results are reported.

Natarajan, K.↗

Summary of the 2004 CFD Validation Workshop on Synthetic Jets and Turbulent Separation Control

A CFD validation workshop for synthetic jets and turbulent separation control (CFDVAL2004) was held in Williamsburg, Virginia in March 2004. Three cases were investigated: synthetic jet into quiescent air, synthetic jet into a turbulent boundary layer crossflow, and flow over a hump model with no-flow-control, steady suction, and oscillatory control. This paper is a summary of the CFD results from the workshop. Although some detailed results are shown, mostly a broad viewpoint is taken, and the CFD state-of-the-art for predicting these types of flows is evaluated from a general point of view. Overall, for synthetic jets, CFD can only qualitatively predict the flow physics, but there is some uncertainty regarding how to best model the unsteady boundary conditions from the experiment consistently. As a result. there is wide variation among CFD results. For the hump flow, CFD as a whole is capable of predicting many of the particulars of this flow provided that tunnel blockage is accounted for, but the length of the separated region compared to experimental results is consistently overpredicted.

Rumsey, C. L.↗

Summary of the 2004 CFD Validation Workshop on Synthetic Jets and Turbulent Separation Control

A computational fluid dynamics (CFD) validation workshop for synthetic jets and turbulent separation control (CFDVAL2004) was held in Williamsburg, Virginia in March 2004. Three cases were investigated: synthetic jet into quiescent air, synthetic jet into a turbulent boundary layer crossflow, and flow over a hump model with no-flow-control, steady suction, and oscillatory control. This paper is a summary of the CFD results from the workshop. Although some detailed results are shown, mostly a broad viewpoint is taken, and the CFD state-of-the-art for predicting these types of flows is evaluated from a general point of view. Overall, for synthetic jets, CFD can only qualitatively predict the flow physics, but there is some uncertainty regarding how to best model the unsteady boundary conditions from the experiment consistently. As a result, there is wide variation among CFD results. For the hump flow, CFD as a whole is capable of predicting many of the particulars of this flow provided that tunnel blockage is accounted for, but the length of the separated region compared to experimental results is consistently overpredicted.

Rumsey, C. L.↗

Comparison of Damage Models for Predicting the Non-Linear Response of Laminates Under Matrix Dominated Loading Conditions

Five models for matrix damage in fiber reinforced laminates are evaluated for matrix-dominated loading conditions under plane stress and are compared both qualitatively and quantitatively. The emphasis of this study is on a comparison of the response of embedded plies subjected to a homogeneous stress state. Three of the models are specifically designed for modeling the non-linear response due to distributed matrix cracking under homogeneous loading, and also account for non-linear (shear) behavior prior to the onset of cracking. The remaining two models are localized damage models intended for predicting local failure at stress concentrations. The modeling approaches of distributed vs. localized cracking as well as the different formulations of damage initiation and damage progression are compared and discussed.

Schuecker, Clara↗

Handling Qualities of a Capsule Spacecraft During Atmospheric Entry

A piloted simulation was conducted to study handling qualities for capsule spacecraft entering the Earth s atmosphere. Eight evaluation pilots, including six pilot astronauts, provided Cooper-Harper ratings, workload ratings, and qualitative comments. The simulation began after descending through the atmospheric entry interface point and continued until the drogue parachutes deployed. There were two categories of piloting tasks, both of which required bank angle control. In one task category, the pilot followed a closed-loop bank angle command computed by the backup guidance system to manage g-loads during entry. In the other task category, the pilot used intuitive rules to determine the desired bank angle independently, based on an open-loop schedule of vertical speed, Mach, and total energy specified at several range-to-target gates along the entry trajectory. Pilots were able to accurately track the bank angle guidance commands and steered the capsule toward the recovery site with essentially the same range error as the benchmark autopilot trajectory albeit with substantially higher propellant usage, and the handling qualities for this task were satisfactory. Another key result was that the complex piloting task of atmospheric entry could be performed satisfactorily, even in the presence of large dispersions, by controlling bank angle to follow a simple open-loop schedule.

Bilimoria, Karl D.↗