Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Effectiveness evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Evaluating the effectiveness of M-AMBI with other biotic indexes in a temperate estuary

Need for a scalable and widely applicable index has been increasingly important. This study evaluates the applicability of the M-AMBI, a potential comprehensive index, at small spatial scales. M-AMBI was compared to regional indices (EMAP-E and GOM B-IBI), assessing response to natural environmental gradients and low oxygen stress. Results indicate poor agreement between indices with M-AMBI and GOM B-IBI showing positive correlation but significant disagreement in habitat condition. EMAP-E had no agreement. Indices showed similar patterns of better habitat scores in higher salinities. M-AMBI also showed a negative relationship with sediment organic matter and total nitrogen. DO influenced all indices with M-AMBI the most sensitive. However, mismatches between DO and index score were observed further calibration may be needed before adoption into programs. Altogether, the M-AMBI demonstrates potential at smaller, local scales, but additional studies are needed to validate its performance in different coastal environments and under different conditions.

54 ENVIRONMENTAL SCIENCES↗

Modeling Techniques for Evaluation the Effectiveness of Particle Damping in Turbomachinery

High power turbopumps are frequently used to supply propellants to the combustion chambers of rocket engines. Due to the high pressures and flow-rates required, turbopump components are subjected to harsh environments which include dynamic excitation due to random, sine, and acoustic vibration. Additionally, fluid-induced forces can couple with the dynamics of the structure resulting in flow induced instabilities (flutter). Structural response to these forms of excitation results in reduced fatigue life and increases the likelihood of an operational failure. Particle damping has been used successfully on vibration problems in the past by increasing the damping and therefore reducing the response to acceptable levels. Empirical methods have typically been employed to evaluate the performance of the particles in reducing the structural response. This report explores the use of finite element methods to estimate the effectiveness of particle damping in a typical non-rotating turbopump component. Axisymmetric harmonic models are used to estimate the increase in modal damping produced by the addition of particles in the cavity of an axisymmetric seal. Target modes of vibration are evaluated to quantify how the effective particle damping is altered by geometry changes in the seal design. A new method to predict the performance of particle dampers is developed and shown to provide more reasonable estimates of damping.

Ehrgott, R.↗

Spectral identification of minerals using imaging spectrometry data: Evaluating the effects of signal to noise and spectral resolution using the tricorder algorithm

The rapid development of sophisticated imaging spectrometers and resulting flood of imaging spectrometry data has prompted a rapid parallel development of spectral-information extraction technology. Even though these extraction techniques have evolved along different lines (band-shape fitting, endmember unmixing, near-infrared analysis, neural-network fitting, and expert systems to name a few), all are limited by the spectrometer's signal to noise (S/N) and spectral resolution in producing useful information. This study grew from a need to quantitatively determine what effects these parameters have on our ability to differentiate between mineral absorption features using a band-shape fitting algorithm. We chose to evaluate the AVIRIS, HYDICE, MIVIS, GERIS, VIMS, NIMS, and ASTER instruments because they collect data over wide S/N and spectral-resolution ranges. The study evaluates the performance of the Tricorder algorithm, in differentiating between mineral spectra in the 0.4-2.5 micrometer spectral region. The strength of the Tricorder algorithm is in its ability to produce an easily understood comparison of band shape that can concentrate on small relevant portions of the spectra, giving it an advantage over most unmixing schemes, and in that it need not spend large amounts of time reoptimizing each time a new mineral component is added to its reference library, as is the case with neural-network schemes. We believe the flexibility of the Tricorder algorithm is unparalleled among spectral-extraction techniques and that the results from this study, although dealing with minerals, will have direct applications to spectral identification in other disciplines.

Swayze, Gregg A.↗

Tools and Techniques for Evaluating the Effects of Maintenance Resource Management (MRM) in Air Safety

This research project was designed as part of a larger effort to help Human Factors (HF) implementers, and others in the aviation maintenance community, understand, evaluate, and validate the impact of Maintenance Resource Management (MRM) training programs, and other MRM interventions; on participant attitudes, opinions, behaviors, and ultimately on enhanced safety performance. It includes research and development of evaluation methodology as well as examination of psychological constructs and correlates of maintainer performance. In particular, during 2001, three issues were addressed. First a prototype process for measuring performance was developed and used. Second an automated calculator was developed to aid the HF implementer user in analyzing and evaluating local survey data. These results include being automatically compared with the experience from all MRM programs studied since 1991. Third the core survey (the Maintenance Resource Management Technical Operations Questionnaire, or 'MRM/TOQ') was further developed and tested to include topics of added relevance to the industry.

Taylor, James C.↗

Canada-US Blended Cyber-Physical Security Exercise (Final Report)

The Canada-US Blended Cyber-Physical Exercise was a successful, first of its kind, multiorganization and multi-laboratory exercise that culminated years of complex system development and planning. The project aimed to answer three driving research questions, (1) How do cyberattacks support malicious acts leading to theft or sabotage [at a nuclear site]? (2) What are aspects of an effective combined cyber-physical response? (3) How to evaluate effectiveness of that response? Which derived the following primary objectives, 1. The May 2023 Cyber-Physical Exercise shall present a cyber-attack scenario that supports malicious acts leading to theft or sabotage. 2. The May 2023 Cyber-Physical Exercise shall define aspects of an effective combined cyber-physical response. 3. Analysis of the May 2023 Cyber-Physical Exercise shall evaluate the effectiveness of the incident response against pre-established exercise evaluation criteria. 4. Analysis of the May 2023 Cyber-Physical Exercise shall assess the effectiveness of the evaluation criteria itself. 5. Exercises shall be performed in a real-life environment. The team believes these objectives were met, and the evidence will be presented in this report. Due to the novelty of the exercise, there were several lessons learned that will be presented in this report.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Evaluating Corrosion Effects on the Stainless Steel Components of the SAVY-4000/Hagan Nuclear Material Storage Containers: FY2022 Update

This report summarizes the work completed and underway for the Corrosion Working Group (CWG) for FY2022 in support of evaluating a greater than a 15 year design life for the SAVY4000. The CWG meets on an as needed basis to review new work, results or information regarding the corrosion of SAVY-4000 and Hagan nuclear material storage containers. The goal when analyzing corrosion is to develop a design life appropriate for the containers and to identify when a container should be removed from service. There are many parallel efforts associated with identifying and extending the service life of nuclear material storage containers. This report includes information from research and development efforts to address the lifetime. The CWG is closely related to surveillance activities and continues to play a role in identification of issues and paths forward for analysis of surveillance containers. This work summarizes the completed tasks for FY22 of the CWG while keeping in mind that some efforts continue into future years. Brief summaries of identified new avenues of work have been identified for FY23.

36 MATERIALS SCIENCE↗

Self-calibrating the look-elsewhere effect: fast evaluation of the statistical significance using peak heights

In experiments where one searches a large parameter space for an anomaly, one often finds many spurious noise-induced peaks in the likelihood. This is known as the look-elsewhere effect, and must be corrected for when performing statistical analysis. Here, this paper introduces a method to calibrate the false alarm probability (FAP), or p-value, for a given dataset by considering the heights of the highest peaks in the likelihood. Specifically, we derive an equation relating the global p-value to the rank and height of local maxima. In the simplest form of self-calibration, the look-elsewhere-corrected $\chi^2$ of a physical peak is approximated by the $\chi^2$ of the peak minus the $\chi^2$ of the highest noise-induced peak, with accuracy improved by considering lower peaks. In contrast to alternative methods, this approach has negligible computational cost as peaks in the likelihood are a byproduct of every peak-search analysis. We apply to examples from astronomy, including planet detection, periodograms, and cosmology.

79 ASTRONOMY AND ASTROPHYSICS↗

Analytical evaluation of effect of equivalence ratio inlet-air temperature and combustion pressure on performance of several possible ram-jet fuels

The results of an analytical investigation of the theoretical air specific impulse performance and adiabatic combustion temperatures of several possible ram-jet fuels over a range of equivalence ratios, inlet-air temperatures, and combustion pressures, is presented herein. The fuels include octane-1, 50-percent-magnesium slurry, boron, pentaborane, diborane, hydrogen, carbon, and aluminum. Thermal effects from high combustion temperatures were found to effect considerably the combustion performance of all the fuels. An increase in combustion pressure was beneficial to air specific impulse at high combustion temperatures. The use of these theoretical data in engine operation and in the evaluation of experimental data is described.

COMBUSTION - TURBINE ENGINES↗

Evaluating the Effects of Dimensionality in Advanced Avionic Display Concepts for Synthetic Vision Systems

Synthetic vision systems provide an in-cockpit view of terrain and other hazards via a computer-generated display representation. Two experiments examined several display concepts for synthetic vision and evaluated how such displays modulate pilot performance. Experiment 1 (24 general aviation pilots) compared three navigational display (ND) concepts: 2D coplanar, 3D, and split-screen. Experiment 2 (12 commercial airline pilots) evaluated baseline 'blue sky/brown ground' or synthetic vision-enabled primary flight displays (PFDs) and three ND concepts: 2D coplanar with and without synthetic vision and a dynamic multi-mode rotatable exocentric format. In general, the results pointed to an overall advantage for a split-screen format, whether it be stand-alone (Experiment 1) or available via rotatable viewpoints (Experiment 2). Furthermore, Experiment 2 revealed benefits associated with utilizing synthetic vision in both the PFD and ND representations and the value of combined ego- and exocentric presentations.

Alexander, Amy L.↗

Evaluating the Effectiveness of the 2001-2002 NASA CONNECT(tm) Program

NASA CONNECT(tm) is a research and standards-based, integrated mathematics, science, and technology series of 30-minute instructional distance learning (television and web-based) programs for students in grades 6-8. Respondents who evaluated the programs in the 2001-2002 NASA CONNECT(tm) series reported that (1) they used the programs in the series; (2) the goals and objectives for the series were met; (3) the programs were aligned with the national mathematics, science, and technology standards; (4) the program content was developmentally appropriate for grade level; and (5) the programs in the series enhanced and enriched the teaching of mathematics, science, and technology.

Pinelli, Thomas E.↗

Evaluating the Effectiveness of the 2002-2003 NASA CONNECT(TM) Program

NASA CONNECT is a research-, inquiry-, and standards-based, integrated mathematics, science, and technology series of 30-minute instructional distance learning (television and web-based) programs for students in grades 6 8. Respondents who evaluated the programs in the 2002 2003 NASA CONNECT series reported that (1) they used the programs in the series; (2) the goals and objectives for the series were met; (3) the programs were aligned with the national mathematics, science, and technology standards; (4) the program content was developmentally appropriate for grade level; and (5) the programs in the series enhanced and enriched the teaching of mathematics, science, and technology.

Pinelli, Thomas E.↗

Evaluating the Effectiveness of the 2002-2003 NASA SCIence Files(TM) Program

NASA SCIence Files (tm) is a research-, inquiry-, and standards-based, integrated mathematics, science, and technology series of 60-minute instructional distance learning (television and web-based) programs for students in grades 3-5. Respondents who evaluated the programs in the 2002-2003 NASA SCIence Files (tm) series reported that (1) they used the programs in the series; (2) the goals and objectives for the series were met; (3) the programs were aligned with the national mathematics, science, and technology standards; (4) the program content was developmentally appropriate for grade level; and (5) the programs in the series enhanced and enriched the teaching of mathematics, science, and technology.

Pinelli, Thomas E.↗

Evaluating the effectiveness of cockpit resource management training

The concept of providing flight crews with intensive training in crew coordination and interpersonal skills (cockpit resource management training - CRM) is outlined with emphasis on full mission simulator training (line-oriented flight training - LOFT). Findings from several airlines that have instituted CRM and LOFT are summarized. Four types of criteria used for evaluating CRM programs: observer ratings of crew behavior, measures of attitudes regarding cockpit management, self-reports by participants on the value of the training, and case studies of CRM-related incidents and accidents are covered. Attention is focused on ratings of the performance of crews during line flights and during simulator sessions conducted as a part of LOFT. A boomerang effect - the emergence of a subgroup that has changed the attitudes in the opposite direction from that desired is emphasized.

Helmreich, Robert L.↗

Using Remotely Sensed Data and Watershed and Hydrodynamic Models to Evaluate the Effects of Land Cover Land Use Change on Aquatic Ecosystems in Mobile Bay, AL

Alabama coastal systems have been subjected to increasing pressure from a variety of activities including urban and rural development, shoreline modifications, industrial activities, and dredging of shipping and navigation channels. The impacts on coastal ecosystems are often observed through the use of indicator species. One such indicator species for aquatic ecosystem health is submerged aquatic vegetation (SAV). Watershed and hydrodynamic modeling has been performed to evaluate the impact of land cover land use (LCLU) change in the two counties surrounding Mobile Bay (Mobile and Baldwin) on SAV stressors and controlling factors (temperature, salinity, and sediment) in the Mobile Bay estuary. Watershed modeling using the Loading Simulation Package in C++ (LSPC) was performed for all watersheds contiguous to Mobile Bay for LCLU scenarios in 1948, 1992, 2001, and 2030. Remotely sensed Landsat-derived National Land Cover Data (NLCD) were used in the 1992 and 2001 simulations after having been reclassified to a common classification scheme. The Prescott Spatial Growth Model was used to project the 2030 LCLU scenario based on current trends. The LSPC model simulations provided output on changes in flow, temperature, and sediment for 22 discharge points into the estuary. These results were inputted in the Environmental Fluid Dynamics Computer Code (EFDC) hydrodynamic model to generate data on changes in temperature, salinity, and sediment on a grid throughout Mobile Bay and adjacent estuaries. The changes in the aquatic ecosystem were used to perform an ecological analysis to evaluate the impact on SAV habitat suitability. This is the key product benefiting the Mobile Bay coastal environmental managers that integrates the influences of temperature, salinity, and sediment due to LCLU driven flow changes with the restoration potential of SAVs. Data products and results are being integrated into NOAA s EcoWatch and Gulf of Mexico Data Atlas online systems for dissemination to coastal resource managers and stakeholders. Objective 1: Develop and utilize Land Use scenarios for Mobile and Baldwin Counties, AL as input to models to predict the affects on water properties (temperature,salinity,)for Mobile Bay through 2030. Objective 2: Evaluate the impact of land use change on seagrasses and SAV in Mobile Bay. Hypothesis: Urbanization will significantly increase surface flows and impact salinity and temperature variables that effect seagrasses and SAVs.

Al-Hamdan, Mohammad↗

Evaluating the Effect of Electrolyte Additive Functionalities on NMC622/Si Cell Performance

Unstable electrode/electrolyte interface is the major cause of degradation for silicon (Si)-based anodes for lithium (Li)-ion batteries. Development of functional electrolyte additives can provide a viable path toward stabilizing the dynamic Si/electrolyte interface, which will benefit the development of high energy density Li-ion batteries. Here, we evaluate polymerizable electrolyte additives with varying functional groups (fluorocarbon, thiophosphate, and fluorophosphazene). The additives are examined using LiNi 0.6 Mn 0.2 Co 0.2 O 2 /Si full cells where the cycle performance and impedance are measured. Electrochemical tests show that the fluorine-containing additives provide better passivation at the Si electrode, leading to enhanced full cell performance. Here, among the three additives examined, best electrochemical performance is observed from the fluorocarbon-containing compound, followed by fluorophosphazene- and thiophosphate-containing compounds. Characterization of the solid electrolyte interphase (SEI) on cycled electrodes using Auger electron spectroscopy (AES), X-ray photoelectron spectroscopy (XPS), and attenuated total reflectance Fourier transform infrared spectroscopy (ATR-FTIR) reveal that higher concentration of fluorine and lithium oxide, and lower concentration of carbonate and organic species correlate with enhanced electrochemical performance.

25 ENERGY STORAGE↗

Methods of evaluating the effects of coding on SAR data

It is recognized that mean square error (MSE) is not a sufficient criterion for determining the acceptability of an image reconstructed from data that has been compressed and decompressed using an encoding algorithm. In the case of Synthetic Aperture Radar (SAR) data, it is also deemed to be insufficient to display the reconstructed image (and perhaps error image) alongside the original and make a (subjective) judgment as to the quality of the reconstructed data. In this paper we suggest a number of additional evaluation criteria which we feel should be included as evaluation metrics in SAR data encoding experiments. These criteria have been specifically chosen to provide a means of ensuring that the important information in the SAR data is preserved. The paper also presents the results of an investigation into the effects of coding on SAR data fidelity when the coding is applied in (1) the signal data domain, and (2) the image domain. An analysis of the results highlights the shortcomings of the MSE criterion, and shows which of the suggested additional criterion have been found to be most important.

Dutkiewicz, Melanie↗

Validation and Simulation of Ares I Scale Model Acoustic Test - 3 - Modeling and Evaluating the Effect of Rainbird Water Deluge Inclusion

The Ares I Scale Model Acoustics Test (ASMAT) is a series of live-fire tests of scaled rocket motors meant to simulate the conditions of the Ares I launch configuration. These tests have provided a well documented set of high fidelity measurements useful for validation including data taken over a range of test conditions and containing phenomena like Ignition Over-Pressure and water suppression of acoustics. Building on dry simulations of the ASMAT tests with the vehicle at 5 ft. elevation (100 ft. real vehicle elevation), wet simulations of the ASMAT test setup have been performed using the Loci/CHEM computational fluid dynamics software to explore the effect of rainbird water suppression inclusion on the launch platform deck. Two-phase water simulation has been performed using an energy and mass coupled lagrangian particle system module where liquid phase emissions are segregated into clouds of virtual particles and gas phase mass transfer is accomplished through simple Weber number controlled breakup and boiling models. Comparisons have been performed to the dry 5 ft. elevation cases, using configurations with and without launch mounts. These cases have been used to explore the interaction between rainbird spray patterns and launch mount geometry and evaluate the acoustic sound pressure level knockdown achieved through above-deck rainbird deluge inclusion. This comparison has been anchored with validation from live-fire test data which showed a reduction in rainbird effectiveness with the presence of a launch mount.

Strutzenberg, Louise L.↗

Using Remotely Sensed Data and Watershed and Hydrodynamic Models to Evaluate the Effects of Land Cover Land Use Change on Aquatic Ecosystems in Mobile Bay, AL

Alabama coastal systems have been subjected to increasing pressure from a variety of activities including urban and rural development, shoreline modifications, industrial activities, and dredging of shipping and navigation channels. The impacts on coastal ecosystems are often observed through the use of indicator species. One such indicator species for aquatic ecosystem health is submerged aquatic vegetation (SAV). Watershed and hydrodynamic modeling has been performed to evaluate the impact of land cover land use (LCLU) change in the two counties surrounding Mobile Bay (Mobile and Baldwin) on SAV stressors and controlling factors (temperature, salinity, and sediment) in the Mobile Bay estuary. Watershed modeling using the Loading Simulation Package in C++ (LSPC) was performed for all watersheds contiguous to Mobile Bay for LCLU scenarios in 1948, 1992, 2001, and 2030. Remotely sensed Landsat-derived National Land Cover Data (NLCD) were used in the 1992 and 2001 simulations after having been reclassified to a common classification scheme. The Prescott Spatial Growth Model was used to project the 2030 LCLU scenario based on current trends. The LSPC model simulations provided output on changes in flow, temperature, and sediment for 22 discharge points into the estuary. These results were inputted in the Environmental Fluid Dynamics Computer Code (EFDC) hydrodynamic model to generate data on changes in temperature, salinity, and sediment on a grid throughout Mobile Bay and adjacent estuaries. The changes in the aquatic ecosystem were used to perform an ecological analysis to evaluate the impact on SAV habitat suitability. This is the key product benefiting the Mobile Bay coastal environmental managers that integrates the influences of temperature, salinity, and sediment due to LCLU driven flow changes with the restoration potential of SAVs. Data products and results are being integrated into NOAA s EcoWatch and Gulf of Mexico Data Atlas online systems for dissemination to coastal resource managers and stakeholders.

Al-Hamdan, Mohammad Z.↗