Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Effectiveness evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Evaluating the Effectiveness of a Detection and Deterrent System in Reducing Golden Eagle Fatalities at Operational Wind Facilities

The Renewable Energy Wildlife Institute (REWI) was appointed as the prime awardee of DOE award number DE-EE0007883 to lead a team of scientists, wind developers, and technology manufacturers toward the overarching goal of evaluating the effectiveness of the current DTBird system in minimizing the risk of golden eagles (Aquila chrysaetos) and other large soaring raptors from approaching the rotor-swept zone (RSZ) of operating wind turbines. As part of this goal, the team set out to 1) quantify the expected reduction in collision risk for golden eagles from operation of the detection and deterrence modules in a manner that supports the approach used by the U.S. Fish and Wildlife Service (USFWS) to assess and credit facility operators for their efforts to minimize predicted collision fatalities and 2) provide information to help improve the technology to maximize its effectiveness. DTBird is an automated detection and audio deterrent system created by the Spanish company Liquen, designed to discourage birds from entering the RSZ of spinning wind turbines. The system uses cameras to automatically detect airborne targets of interest, records each such event in an online database, and triggers a warning signal (loud sound) if the tracked object has moved close to the turbine. If the object moves even closer to the RSZ, a more aggressive dissuasion signal is broadcast. To meet our objectives, the team conducted a two-year experiment at the Goodnoe Hills wind facility in Washington state, in which 14 turbines were outfitted with DTBird units. Daily, each DTBird-equipped turbine was randomly assigned to a control or treatment group. Treatment turbines operated with DTBird running as intended—broadcasting warning or deterrent signals when DTBird detected a target within range. On control turbines, no sound signals were broadcast if a moving target triggered the DTBird system. The team also flew unmanned aerial vehicles (UAVs) designed to coarsely mimic the general size, weight, and coloration of golden eagles in programmed flight transects across DTBird detection ranges to quantify DTBird’s ability to detect intended targets and to evaluate factors that influence the probability of detection and DTBird’s response distances. Additionally, the team evaluated the behavioral responses of in situ eagles exposed to spinning turbines alone (visual and sound influences) versus spinning turbines plus broadcasted DTBird audio deterrents, to estimate the effectiveness of deterrence by the DTBird system. The data and results from these investigations were combined with those from a pilot study conducted at the Manzana Wind Power Project in California to better evaluate DTBird’s effectiveness across different landscapes.

17 WIND ENERGY↗

Models and techniques for evaluating the effectiveness of aircraft computing systems

System models that provide a basis for the formulation and evaluation of the performability of commercial aircraft computer system are developed. Quantitative measures of the system effectiveness are formulated. Analytic and simulation techniques for evaluation of the effectiveness and performability of a proposed or existing aircraft computer were studied.

Meyer, J. F.↗

Evaluating the Effectiveness of an Ultrasonic Acoustic Deterrent in Reducing Bat Fatalities at Wind Energy Facilities

This project was designed to use thermal video cameras and fatality monitoring to evaluate the effectiveness of an ultrasonic acoustic deterrent (UAD) on bat activity and mortality, respectively. Our goals were to redesign the UAD device and installation infrastructure, determine the placement on wind turbines to optimize safety, compatibility and functionality, and to compare the mortality among the following conditions: Control (deterrents off and turbines feathered up to the manufacturer’s cut-in speed of 3.5 m/s), Deterrent (deterrents on and turbines feathered up to the manufacturer’s cut-in speed of 3.5 m/s), Curtailment (deterrents off and turbines feathered up to 5/ m/s), and combination (deterrents on and turbines feathered up to 5 m/s). The project was divided into a Feasibility Study and Comparative Study. The objectives for the Feasibility Study were to develop an installation strategy, redesign a previous iteration of a UAD to improve performance and weatherization, and test the effectiveness of the deterrents on bat activity. The Feasibility Study was intended to work out potential issues using a relatively small number of devices prior to manufacturing and installing numerous devices for a larger-scale comparative study. The division of the project into these separate studies was based on previous experience and the challenges of assessing the capabilities of an untested UAD. During the initial development and manufacturing of the UAD, NRG Systems decided to use a piezoelectric transducer rather than an electrostatic transducer, which was used by a previous device (i.e. Deaton UAD). NRG Systems conducted lab testing (i.e., IP67 or Ingress Protection) to ensure no water or dust ingress. In addition, shock/drop trials and variations in temperature exposure were conducted as part of the reliability testing. NRG Systems also developed a communications system to allow for continuous performance monitoring of the UADs. For the Feasibility Study, we installed 6 UADs on each of 2 Gamesa G90 2-MW wind turbines (Turbine 14 and 8) at the South Chestnut Wind Energy Facility, Pennsylvania and monitored activity under control and treatment (i.e. Deterrent) conditions using thermal video monitoring. There are two major sources of variation in bat activity (beyond the anticipated treatment effect): 1) environment around the turbines might inherently favor more activity at one than the other; 2) weather conditions on any given night or within season difference (e.g., migration later during the study period) might favor more activity on some nights than on other nights. Because we could only monitor two turbines on any night, we sought to control the potential influences of these two sources by alternating the turbine on which deterrents were activated each night. If there were no loss of data due to technical failures, this design would result in an equal number of deterrent and control nights at each turbine through the monitoring period, balancing the effects of both sources of variation. We compared the time bats spent and the number of events that occurred in overlapping cameras FOV as an indicator of risk, since 80% of the overlapping FOV of the cameras was in the RSA. Equipment failures, majority due to lightning, resulted in only 17 nights with useable data, with unbalanced treatment assignment within turbines and uneven distribution of treatment assignment throughout the observational period. This resulted in a confounding of treatment assignment and seasonal change. Deterrent treatment was measured at Turbine 14 on only 2 of the first 8 usable nights (spanning the period from 8/18-9/17), whereas 6 times on Turbine 8. From 9/18-927, deterrent was on at Turbine 14 on 6 of the remaining 10 nights, and 4 on Turbine 8. We recorded a total of 1,057 bats and observed a reduction in number of events and duration of events at the UAD-activated turbine when it was Turbine 14. When Turbine 8 had the UAD activated, we observed no difference in number or duration of events. Variation between turbines is not unusual and can cause issues when study designs have no true replication, i.e., multiple turbines per treatment. Within-turbine differences suggested a trend for reduced activity when UADs were activated, particularly for Turbine 14. These results may be caused by the overall higher bat activity at Turbine 8 and confounding of treatment assignment and seasonal trends. We mapped 58 bat events in 3-dimensional space (3D), 30 and 28 events during control and treatment conditions, respectively. We observed bats crossing the rotor plane under both control and treatment conditions and observed a total of 40 confirmed or near-collisions (i.e., target close to blade but no visual confirmation of a strike) out of a total of 1,491 medium and high confidence bat observations (880 control, 611 at treatment). Twice as many collisions/possible collisions were observed during control conditions. Given the challenges with the equipment and potential confounding of the data (i.e., different activity levels at the two wind turbines), we were unable to determine whether this initial turbine placement and orientation was optimal. Given no new information on how best to install the devices, we elected to use the same placement and orientation for the comparative study. For the Comparative Study, the objectives were to investigate the relative mortality rates among 4 treatments. We searched the area within 90 m of each turbine daily to recover the highest number of fresh fatalities possible. We were unable to detect a clear reduction in mortality from deterrents alone for any individual species. Surprisingly, mortality rate of the eastern red bat (Lasiurus borealis) was estimated to be 1.3–4.2 times as much when turbines were operating normally and UADs were on than when UADs were off. Reduction in mortality of all bat species combined due to curtailment of turbines was estimated to be between 0%–38%. This effect was nullified when, in addition to curtailment, UADs were on, with 95% confidence interval ranging from a 45% reduction to a 36% increase in mortality. This was likely due to the large proportion of eastern red bats in the total carcass population. Mortality of all low-frequency echolocating bats combined (i.e. hoary bat [L. cinereus], big brown bat [Eptesicus fuscus], silver-haired bat [Lasionycteris noctivagans]) relative to control was lower when curtailed (95% CI: 0%–74%), but the addition of UADs had no detectable effect (95%CI: 13%–79%). The combined treatment reduced mortality in silver-haired bats relative to control by 11%–99%, compared to curtailment (81% reduction–67% increase) or deterrent (82% reduction–67% increase) alone. Because silver-haired bats comprised a large proportion of low-frequency calling bats found during this study, a similar effect was seen for that group. The higher mortality observed for eastern red bats at UAD compared to control could have been caused by several factors, such as the effective range of the UAD, particularly at higher frequencies, behavior, positioning of the devices on the nacelle, or a combination of these. We used 3D thermal videography to compare control and UAD bat behavior from two turbines using a total of 203 3D bat-tracks across 34 nights. We recorded a similar number of bat-tracks between treatment groups, with 51% and 49% for control and UAD, respectively. Due to potential differences in bat behavior around spinning vs stationary turbine blades, we examined UAD effectiveness separately for non-operating turbines (feathered below cut-in speed of 3.5 m/s) and operating (normal operation above wind speed of 3.5 m/s). We found a higher proportion of bat-tracks at operating turbines (82%) compared to non-operating turbines (18%), although this does not account for overall time turbines were operating versus not. At non-operating turbines the UAD appears to be effective at reducing the amount of time, flight length, and number of passes through the rotor plane, compared to control. In addition, we found bats approached turbines similarly between control and treatment turbines, with 61% of control and 63% of UAD bat-tracks originating leeward of the hub. In contrast, at operating turbines, we saw little change in bat behavior in response to UADs. For example, we found an increase in the average duration of bat-tracks between non-operating and operating turbines for UAD but at control turbines we found average duration decreased once turbines became operational. Both control and UAD had a high proportion of bat-tracks that crossed the rotor plane (i.e., collision risk) originate from the windward side when turbines were operational 65% to 92%, respectively. Given that the UAD devices closest to the blades were orientated parallel to the blades, its possible bats were not exposed to the signal until they were close to the turbine blades, as suggested by the slightly higher mean duration within 5 meters of the blades for UAD turbines. Future research should consider concentrating UAD intensity on the areas of risk (i.e. blades) with enough buffer to allow bats to react to the sound before entering the rotor-swept area (RSA). In addition, investigating the potential of installing UAD units windward of the turbine blades (e.g. a hub-mounted UAD), particularly since even under control conditions, a relatively high proportion (65%) of crosses through the blade plane originated windward. 3D thermal videography provided valuable information on future testing strategies (e.g. device placement, UAD orientation) to improve UAD effectiveness when bats are at risk (i.e., operating wind turbines). Across the entire project we experienced issues with the operation and communication with the UADs. Most of the issues occurred during the Feasibility Study and were resolved prior to the Comparability Study. Additional challenges surfaced during the Comparability Study but were remedied immediately and are thought to have little impact on the results. We had logistical constraints at the project that limited our ability use traditional methods in our camera calibration. Several calibrations showed inaccurate scales, which may have been related to inadequate spatial coverage of “points” in the camera calibration volume. Because we were using actual video recordings of bats at a wind turbine, the behavior of bats could have concentrated “points” in specific areas of the turbine (i.e. leeward of nacelle), and limited “points” in other areas, resulting in camera calibration issues. We have plans to address these inconsistencies and improving the software and related methodologies by early 2020.

17 WIND ENERGY↗

Evaluating the effect of online data compression on the disk cache of a mass storage system

A trace driven simulation of the disk cache of a mass storage system was used to evaluate the effect of an online compression algorithm on various performance measures. Traces from the system at NASA's Center for Computational Sciences were used to run the simulation and disk cache hit ratios, number of files and bytes migrating to tertiary storage were measured. The measurements were performed for both an LRU and a size based migration algorithm. In addition to seeing the effect of online data compression on the disk cache performance measure, the simulation provided insight into the characteristics of the interactive references, suggesting that hint based prefetching algorithms are the only alternative for any future improvements to the disk cache hit ratio.

Pentakalos, Odysseas I.↗

ECAR-5067 Computational Evaluation on Effect of Edge-rounding in Circular to Annular Flow Transitions within a Hexagonal Duct

In this ECAR, the computational fluid dynamics (CFD) simulation of the duct with a cross-section varying from circle to annulus was performed to evaluate the effect of edge-rounding of the internal edges. The edge of circular channel and the edge of inner annular channel were rounded with the radius of curvature ranged from 0 mm to 20 mm. The CFD results show that the pressure loss of the duct can be reduced by increasing the radius of the rounded edge. Case-A results showed that the pressure drop can be significantly reduced by the edge-rounding, e.g., the pressure drop was reduced approximately 56% by the radius of curvature of 5.0mm, and reduced 70% by the radius of curvature of 20.0 mm although its effectiveness would be attenuated as the radius of curvature of edge increases. Results from Case-B showed the impact of rounding the inlet edge was practically negligible compared to the outlet edge. This ECAR could provide a guideline to determine the optimum inlet module design of the VTR fuel rod bundle.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Evaluating the Effectiveness of Soil Profile Rehabilitation for Pluvial Flood Mitigation Through Two-Dimensional Hydrodynamic Modeling

Pluvial flooding, driven by increasingly impervious surfaces and intense storm events, presents a growing challenge for urban areas worldwide. In Baltimore City, MD, USA, climate change, rapid urbanization, and aging stormwater infrastructure are exacerbating flooding impacts, resulting in significant socio-economic consequences. This study evaluated the effectiveness of a soil profile rehabilitation scenario using a 2D hydrodynamic modeling approach for the Tiffany Run watershed, Baltimore City. This study utilized different extreme storm events, a high-resolution (1 m) LiDAR Digital Terrain Model (DTM), building footprints, and hydrological soil data. These datasets were integrated into a fully coupled 2D hydrodynamic model, the City Catchment Analysis Tool (CityCAT), to simulate urban flood dynamics. The pre-soil rehabilitation simulation revealed a maximum water depth of 3.00 m in most areas, with hydrologic soil groups C and D, especially downstream of the study area. The post-soil rehabilitation simulation was targeted at vacant lots and public parcels, accounting for 33.20% of the total area of the watershed. This resulted in a reduced water depth of 2.50 m. Additionally, the baseline runoff coefficient of 0.49 decreased to 0.47 following the rehabilitation, and the model consistently recorded a peak runoff reduction rate of 4.10 across varying rainfall intensities. The validation using a contingency matrix demonstrated true-positive rates of 0.75, 0.50, 0.64, and 0 for the selected events, confirming the model’s capability at capturing real-world flood occurrences.

Baltimore City↗

Models and techniques for evaluating the effectiveness of aircraft computing systems

Progress in the development of system models and techniques for the formulation and evaluation of aircraft computer system effectiveness is reported. Topics covered include: analysis of functional dependence: a prototype software package, METAPHOR, developed to aid the evaluation of performability; and a comprehensive performability modeling and evaluation exercise involving the SIFT computer.

Meyer, J. F.↗

Coverage Metrics for Requirements-Based Testing: Evaluation of Effectiveness

In black-box testing, the tester creates a set of tests to exercise a system under test without regard to the internal structure of the system. Generally, no objective metric is used to measure the adequacy of black-box tests. In recent work, we have proposed three requirements coverage metrics, allowing testers to objectively measure the adequacy of a black-box test suite with respect to a set of requirements formalized as Linear Temporal Logic (LTL) properties. In this report, we evaluate the effectiveness of these coverage metrics with respect to fault finding. Specifically, we conduct an empirical study to investigate two questions: (1) do test suites satisfying a requirements coverage metric provide better fault finding than randomly generated test suites of approximately the same size?, and (2) do test suites satisfying a more rigorous requirements coverage metric provide better fault finding than test suites satisfying a less rigorous requirements coverage metric? Our results indicate (1) only one coverage metric proposed -- Unique First Cause (UFC) coverage -- is sufficiently rigorous to ensure test suites satisfying the metric outperform randomly generated test suites of similar size and (2) that test suites satisfying more rigorous coverage metrics provide better fault finding than test suites satisfying less rigorous coverage metrics.

Staats, Matt↗

Methods for Evaluating the Effectiveness of Programs to Train Pilot Monitoring

This report provides a compendium of methods for evaluation of training programs. It addresses training programs for developing pilot monitoring skills and has a focus on monitoring flight path management. It presents the Sensemaking Model of Monitoring as a framework for organizing the targets of training, and thus also the types of change in performance useful for assessing program effectiveness. It provides guidance for designing program evaluations, which can be tailored to address the specific monitoring topics or content for an application to fleet or airline needs.

monitoring↗

Evaluating the effectiveness of case method instruction in technical communication

The effectiveness of the case method as an instructional technique in improving technical writing was evaluated. The development of a self-report instrument that attempts to measure changes in attitude toward technical communication and the presentation results change are the purpose of this paper. Standards for developing a case set forth by Goldstein and Couture, were used to design an evaluation instrument to measure the effect instruction on student attitude toward technical communication. This self-report instrument is based on model developed and tested by Daly and Miller who studied writer attitude and apprehension toward writing. It was the most important objective of any evaluation is to provide information for improving the program.

Feinberg, S. G.↗

Evaluating the effectiveness of a camera-based detection system to support informed curtailment and minimize eagle fatalities at wind energy facilities

The American Wind Wildlife Institute (AWWI – now Renewable Energy Wildlife Institute, REWI) – was appointed prime awardee of DOE award number DE-EE0007880 to lead a team of scientists, wind developers, and technology manufacturers in a collaborative evaluation of the effectiveness of a technology intended to help reduce eagle collisions with wind turbines. IdentiFlight, developed by Renewable Energy Systems (RES) in collaboration with Boulder Imaging, is an autonomous aerial monitoring and detection system. REWI partnered with ecological consultants, Western Ecosystems Technology, Inc. (WEST), to independently evaluate the performance of IdentiFlight reducing eagle collision risk under a suite of environmental conditions relative to the performance of a Biomonitor (human observer-based) Program. The project objectives were to 1) evaluate how IdentiFlight compared to biomonitors in detecting and identifying eagles under a suite of environmental conditions and 2) use the observation data to model how IdentiFlight and biomonitors reduced the eagle fatality prediction through informed curtailment. Field testing was to take place at two geographically distinct wind farms over two field seasons at each wind farm with a study design appropriate for meta-analyses across sites and years.

17 WIND ENERGY↗

Use of phytochrome-dependent reaction in evaluating the effect of space flight factors on the plant organism

The effects of space flight factors on lettuce seeds aboard the Kosmos-936 and Kosmos-1129 satellites for 20 days were studied. The phytochrome dependent (PD) reaction of light sensitive seeds was a sensitive criterion for evaluating the biological effects of space flight factors. The PD reaction of air dry lettuce seeds was suppressed after space flight, especially if the seeds were exposed to open space during the flight. Space flight affects the physiological activity of both phytochrome forms, and both the phi sub 730 dependent reactions of lettuce seeds were suppressed.

Shteyne, B. A.↗

Evaluating the Effect of Bottom Trawls in Pamlico River, North Carolina

The objective of this study is to evaluate and quantify the amount of sediment resuspension on shallow estuarine systems, with specific comparisons between natural and trawling-induced events. This aids in the assessment of water quality and sediment processes on a specific coastal system of North Carolina, providing a basis for future studies on other shallow estuarine ecosystems. Categorizing these sediment processes into distinct individual units (e.g. natural vs. anthropogenic) is an important component toward fully realizing proper management of our coastal habitats. Heavy trawling activity along North Carolina s coast is one of the major obstacles in management plans. Therefore, it is imperative to quantify the effects of trawling to gain a more specific understanding of the human impact on estuaries.

Corbett, D. Reide↗

Evaluating the Effects of Precipitation and Evapotranspiration on Soil Moisture Variability Within CMIP5 Using SMAP and ERA5 Data

=The effects of precipitation (Pr) and evapotranspiration (ET) on surface soil moisture (SSM) play an essential role in the land-atmosphere system. Here we evaluate multimodel differences of these effects within the Coupled Model Intercomparison Project Phase 5 (CMIP5) compared to Soil Moisture Active Passive (SMAP) products and ECMWF Reanalysis v5 (ERA5) as references in a frequency domain. The variability of SSM, Pr, and ET within three frequency bands (1/7 ~ 1/30 days -1 , 1/30 ~ 1/90 days -1 , and 1/90 ~ 1/365 days -1 ) after normalization is quantified using Fourier transform. We analyze the impact of ET and Pr on SSM variability based on a transfer function assuming that these variables form a linear time-invariant (LTI) system. For the total effects of ET and Pr on SSM variability, the CMIP5 estimations are smaller than the reference data in the two higher frequency bands and are larger than the reference data in the lowest frequency band. Besides, the effects on SSM by Pr and ET are found to be different across the three frequency bands. In each frequency band, the variability of the factor that dominates SSM (i.e., Pr or ET) from CMIP5 is smaller than that from the references. This study identifies the spatiotemporal distribution of differences between CMIP5 models and references (SMAP and ERA5) in simulating ET and Pr effects on SSM within three frequency bands. This study provides insightful information on how soil moisture variability is affected by varying precipitation and evapotranspiration at different time scales within Earth System Models.

54 ENVIRONMENTAL SCIENCES↗

Evaluating the Effectiveness of the 2000-2001 NASA CONNECT(TM) Program

This report contains the results of the evaluation conducted for the 2000-2001 NASA CONNECT(TM) program conducted in March 2001. The analysis is based on the results collected from 154 surveys collected from educators registered for the program. Respondents indicated that the objectives for each program were met; the programs were aligned with the national (mathematics, science, and technology) standards; the programs were developmentally (grade level) appropriate; and the programs in the 2000-2001 NASA CONNECT(TM) series enhanced/enriched the teaching of mathematics, science, and technology.

Pinelli, Thomas E.↗

Evaluating the Effectiveness of the 2001-2002 NASA "Why?" Files Program

This report contains the results of the evaluation conducted for the 2001-2002 NASA 'Why?' Files program that was conducted in March 2002. The analysis is based on the results of 139 surveys collected from educators registered for the program. Respondents indicated that (1) the programs in the series are aligned with the national mathematics, science, and technology standards; (2) the programs are developmentally (grade level) appropriate; and (3) the programs enhance and enrich the teaching and learning of mathematics, science, and technology.

Pinelli, Thomas E.↗

Evaluation of effectiveness of various devices for attenuation of trailing vortices based on model tests in a large towing basin

The effectiveness of various candidate aircraft-wing devices for attenuation of trailing vortices generated by large aircraft is evaluated on basis of results of experiments conducted with a 0.03-scale model of a Boeing 747 transport aircraft using a technique developed at the HYDRONAUTICS Ship Model Basin. Emphasis is on the effects produced by these devices in the far-field (up to 8 kilometers downstream of full-scale generating aircraft) where the unaltered vortex-wakes could still be hazardous to small following aircraft. The evaluation is based primarily on quantitative measurements of the respective vortex velocity distributions made by means of hot-film probe traverses in a transverse plane at selected stations downstream. The effects of these altered wakes on rolling moment induced on a small following aircraft are also studied using a modified lifting-surface theory with a synthesized Gates Learjet as a typical example. Lift and drag measurements concurrently obtained in the model tests are used to appraise the effects of each device investigated on the performance characteristics of the generating aircraft.

Kirkman, K. L.↗

4.5-kW Hall Effect Thruster Evaluated

As part of an Interagency Agreement with the Air Force Research Lab (AFRL), a space simulation test of a Russian SPT 140 Hall Effect Thruster was completed in September 1999 at Vacuum Facility 6 at the NASA Glenn Research Center at Lewis Field. The thruster was subjected to a three-part test sequence that included thrust and performance characterization, electromagnetic interference, and plume contamination. SPT 140 is a 4.5-kW thruster developed under a joint agreement between AFRL, Atlantic Research Corp, and Space Systems/Loral, and was manufactured by the Fakal Experimental Design Bureau of Russia. All objectives were satisfied, and the thruster performed exceptionally well during the 120-hr test program, which comprised 33 engine firings. The Glenn testing provided a critical contribution to the thruster development effort, and the large volume and high pumping speed of this vacuum facility was key to the test s success. The low background pressure (1 10 6 torr) provided a more accurate representation of space vacuum than is possible in most vacuum chambers. The facility had been upgraded recently with new cryogenic pumps and sputter shielding to support the active electric propulsion program at Glenn. The Glenn test team was responsible for all test support equipment, including the thrust stand, power supplies, data acquisition, electromagnetic interference measurement equipment, and the contamination measurement system.

Mason, Lee S.↗