Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “program evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49

Review of Criticality Evaluations for Direct Disposal of DPCs and Recommendations

There are currently 2,462 dual-purpose canisters (DPCs) containing spent nuclear fuel (SNF) across the United States. Repackaging DPCs into specialized disposal canisters can be financially and operationally costly with undue risks. Technical feasibility of direct disposal of DPCs has been evaluated by the Department of Energy (DOE) and industry over the past 15 years. A concerted effort most recently conducted by DOE Office of Nuclear Energy (NE) Spent Fuel and Waste Science and Technology (SFWST) research and development (R&D) programs is evaluating the technical feasibility of direct disposal of DPCs in various geologies. This report focuses on reviewing the work completed by SFWST for the criticality considerations of DPC geologic disposal. Disposal of DPCs is not only viable, but assured from a technical and assumed regulatory perspective (similar to 10 CFR 63). The analysis approach should be multi-faceted to ensure effective implementation of a licensing basis. Recommendations are provided in this report that could enhance the bases for direct disposal of DPCs by exploiting all technically attainable and regulatorily defensible options. The review objectives, including addressing several questions regarding the value of accumulating asloaded fuel and DPC design data, suitability of DPC designs for disposal, and reasonable modifications for loading of DPCs that could facilitate eventual disposal, are also addressed in this report.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Space Shuttle Orbiter approach and landing program status

The approach and landing test (ALT) phase of the Space Shuttle program aims at assessing the Orbiter's subsonic aerodynamic flight and landing characteristics along with the support equipment, ground facilities, and the approximate hardware and software to be used in the terminal phase of orbital missions. The program also evaluates the performance of the Shuttle carrier aircraft (SCA) as related to the transport of the Orbiter to the launch sites during the stages of Space Shuttle operations. Results are presented for the SCA inert Orbiter flight testing and the program plans up to the completion of the ALT program. Emphasis is placed on testing the airworthiness of the mated B-747 Shuttle carrier aircraft and Orbiter, checkout of the Orbiter systems in captive flight, and launching the Orbiter with and without the tail cone installed. Major program milestones before the first manned orbital flight are summarized in graphic form.

Andrews, W. H.↗

Laser transmitter module for NASA lidar in space technology experiment (LITE)

NASA's lidar in Space Technology Experiment (LITE) is a multimission Space Transportation System (STS) program to evaluate the capability of a lidar experiment to measure aerosols and other atmospheric parameters from a space platform. The measurements will be made at three wavelengths (1.06, 0.532 and 0.355 microns). This paper presents the results to date of the program to produce the space-qualified laser transmitter module (LTM) for this mission.

Chang, J. H.↗

Flight test evaluation of the Stanford University/United Airlines differential GPS Category 3 automatic landing system

Test flights were conducted to evaluate the capability of Differential Global Positioning System (DGPS) to provide the accuracy and integrity required for International Civil Aviation Organization (ICAO) Category (CAT) 3 precision approach and landings. These test flights were part of a Federal Aviation Administration (FAA) program to evaluate the technical feasibility of using DGPS based technology for CAT 3 precision approach and landing applications. A United Airlines Boeing 737-300 (N304UA) was equipped with DGPS receiving equipment and additional computing capability provided by Stanford University. The test flights were conducted at NASA Ames Research Center's Crows Landing Flight Facility, Crows Landing, California. The flight test evaluation was based on completing 100 approaches and autolandings; 90 touch and go, and 10 terminating with a full stop. Two types of accuracy requirements were evaluated: 1) Total system error, based on the Required Navigation Performance (RNP), and 2) Navigation sensor error, based on ICAO requirements for the Microwave Landing System (MLS). All of the approaches and autolandings were evaluated against ground truth reference data provided by a laser tracker. Analysis of these approaches and autolandings shows that the Stanford University/United Airlines system met the requirements for a successful approach and autolanding 98 out of 100 approaches and autolandings, based on the total system error requirements as specified in the FAA CAT 3 Level 2 Flight Test Plan.

Kaufmann, David N.↗

Flight test evaluation of the E-systems Differential GPS category 3 automatic landing system

Test flights were conducted to evaluate the capability of Differential Global Positioning System (DGPS) to provide the accuracy and integrity required for International Civil Aviation Organization (ICAO) Category (CAT) III precision approach and landings. These test flights were part of a Federal Aviation Administration (FAA) program to evaluate the technical feasibility of using DGPS based technology for CAT III precision approach and landing applications. An IAI Westwind 1124 aircraft (N24RH) was equipped with DGPS receiving equipment and additional computing capability provided by E-Systems. The test flights were conducted at NASA Ames Research Center's Crows Landing Flight Facility, Crows Landing, California. The flight test evaluation was based on completing 100 approaches and landings. The navigation sensor error accuracy requirements were based on ICAO requirements for the Microwave Landing System (MLS). All of the approaches and landings were evaluated against ground truth reference data provided by a laser tracker. Analysis of these approaches and landings shows that the E-Systems DGPS system met the navigation sensor error requirements for a successful approach and landing 98 out of 100 approaches and landings, based on the requirements specified in the FAA CAT III Level 2 Flight Test Plan. In addition, the E-Systems DGPS system met the integrity requirements for a successful approach and landing or stationary trial for all 100 approaches and landings and all ten stationary trials, based on the requirements specified in the FAA CAT III Level 2 Flight Test Plan.

Kaufmann, David N.↗

Evaluation of Early Performance Results for Massachusetts Homes in the National Grid Pilot Deep Energy Retrofit Program

This research project evaluates post-retrofit performance measurements, energy use data and construction costs for 13 projects that participated in the National Grid Deep Energy Retrofit Pilot program. The projects implemented a package of measures defined by performance targets for building enclosure components and building enclosure air tightness. Nearly all of the homes reached a post-retrofit air tightness result of 1.5 ACH 50. Homes that used the chainsaw retrofit technique along with roof insulation, and wall insulation applied to the exterior had the best air tightness results and the lowest heating and cooling source energy use. Analysis of measure costs and project objectives yielded a categorization of costs relative to energy performance objectives. On average about ½ of the energy-related measure costs correspond primarily to energy-related objectives, and 20% of energy-related measure costs relate primarily to non-energy objectives.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Evaluation of Early Performance Results for Massachusetts Homes in the National Grid Pilot Deep Energy Retrofit Program

This research project evaluates post-retrofit performance measurements, energy use data and construction costs for 13 projects that participated in the National Grid Deep Energy Retrofit Pilot program. The projects implemented a package of measures defined by performance targets for building enclosure components and building enclosure air tightness. Nearly all of the homes reached a post-retrofit air tightness result of 1.5 ACH 50. Homes that used the chainsaw retrofit technique along with roof insulation, and wall insulation applied to the exterior had the best air tightness results and the lowest heating and cooling source energy use. Analysis of measure costs and project objectives yielded a categorization of costs relative to energy performance objectives. On average about 1/2 of the energy-related measure costs correspond primarily to energy-related objectives, and 20% of energy-related measure costs relate primarily to non-energy objectives.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Test program to demonstrate the stability of hydrazine in propellant tanks

A 24-month coupon test program to evaluate the decomposition of propellant tanks is reported. The propellant fuel evaluated was monopropellant-grade hydrazine (N2H4), which is normally a colorless, fuming, corrosive, strongly reducing liquid. The degree of hydrazine decomposition was determined by means of chemical analyses of the liquid and evolved gases at the end of the test program. The experimental rates of hydrazine decomposition were determined to be within acceptable limits. The propellant tank materials and material combinations were not degraded by a 2-year exposure to hydrazine propellant. This was verified using change-of-weight determinations and microscopic examination of the specimen surface before and after exposure, and by posttest chemical analyses of hydrazine liquid for residual metal content.

Moran, C. M.↗

Hierarchic Extensions in the Static and Dynamic Analysis of Elastic Beams

Approximate solutions of static and dynamic beam problems by the p-version of the finite element method are investigated. Within a hierarchy of engineering beam idealizations, rigorous formulations of the strain and kinetic energies for straight and circular beam elements are presented. These formulations include rotating coordinate system effects and geometric nonlinearities to allow for the evaluation of vertical axis wind turbines, the motivating problem for this research. Hierarchic finite element spaces, based on extensions of the polynomial orders used to approximate the displacement variables, are constructed. The developed models are implemented into a general purpose computer program for evaluation. Quality control procedures are examined for a diverse set of sample problems. These procedures include estimating discretization errors in energy norm and natural frequencies, performing static and dynamic equilibrium checks, observing convergence for qualities of interest, and comparison with more exacting theories and experimental data. It is demonstrated that p-extensions produce exponential rates of convergence in the approximation of strain energy and natural frequencies for the class of problems investigated.

Watson, Robert A.↗

INFORMATION: Management Alert on the Department's Monitoring of the Weatherization Assistance Program in the State of Illinois

Under the American Recovery and Reinvestment Act of 2009 (Recovery Act), the Department of Energy's Weatherization Assistance Program received $5 billion to improve the energy efficiency of homes owned or occupied by low income persons, reduce their total residential expenditures, and improve their health and safety. Since the Recovery Act was enacted in February 2009, the Department has awarded weatherization grants to every state, the District of Columbia and five territories. Because of the unprecedented level of funding and the risks associated with spending vast amounts of money in a relatively short period of time, the Office of Inspector General (OIG) initiated a series of audits designed to evaluate the Program's internal control structures at both the Federal and state levels. As part of our work, we are in the process of reviewing Weatherization Program internal controls for the State of Illinois. We are also currently performing identical audits in the States of North Carolina, Pennsylvania and Virginia. Under the Recovery Act and the Department's Program, the State of Illinois received $242 million to weatherize 26,933 homes. The State of Illinois awarded these funds to 35 local agencies responsible for determining recipients' eligibility, contracting for the installation of the weatherization work, and conducting final inspections to ensure that work on homes was done in accordance with requirements. Inspectors working for the local agencies are required to evaluate the quality of mechanical and architectural improvements, such as furnace installations and window caulking, and certify that the work performed meets established standards. Under a Department approved plan in place at the time of our review, state officials were required to evaluate the sufficiency of local agency monitoring controls and to inspect the work performed on at least five percent of the units weatherized with Department funds during the program year for each local agency. We identified significant internal control deficiencies in the management of the Weatherization Program in Illinois which require immediate attention. Specifically, our audit testing revealed significant problems with on-site monitoring and inspection of the Illinois Home Weatherization Assistance Program (Illinois). We noted that the Department had not fulfilled its requirement to perform monitoring visits at the State level. In addition, Illinois officials had not complied with the Department's requirements for inspecting weatherization work conducted by local agencies. Finally, we found that a weatherization inspection for one of the local agencies failed to detect substandard installation of energy saving materials. This case involved a furnace gas leak that could have resulted in serious injury to the occupants and material damage to the structure. This is an interim report and our audit work remains in progress.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Single stage experimental evaluation of tandem-airfoil rotor and stator blading for compressors. Part 4: Data and performance for stage B

Stage B, composed of tandem-airfoil rotor B and stator B, was tested with uniform inlet flow and with hub radial, tip radial and 90 degree one-per-revolution circumferential distortion of the inlet flow as part of an overall program to evaluate the effectiveness of tandem airfoils for increasing the design point loading capability and stable operating range of rotor and stator blading. The results of this series of tests provide overall performance and blade element data for evaluating: (1) the potential of tandem blading for extending the loading limit and stable operating range of a stage representative of a middle stage of an advanced high pressure compressor, (2) the effect of loading split between the two airfoils in tandem on the performance of tandem blading, and (3) the effects of inlet flow distortion on the stage performance. The rotor had an inlet hub/tip ratio of 0.8 and a design tip velocity of 757 ft/sec. With uniform inlet flow, rotor B achieved a maximum adiabatic efficiency of 88.4% at design equivalent rotor speed and a pressure ratio of 1.31. The stage maximum adiabatic efficiency at design equivalent rotor speed with uniform inlet flow was 82.5% at a pressure ratio of 1.28. Tip radial and circumferential distortion of the inlet flow caused substantial reductions in surge margin.

Brent, J. A.↗

Evaluation of Surface Flux Parameterizations with Long-Term ARM Observations

Surface momentum, sensible heat, and latent heat fluxes are critical for atmospheric processes such as clouds and precipitation, and are parameterized in a variety of models ranging from cloud-resolving models to large-scale weather and climate models. However, direct evaluation of the parameterization schemes for these surface fluxes is rare due to limited observations. This study takes advantage of the long-term observations of surface fluxes collected at the Southern Great Plains site by the Department of Energy Atmospheric Radiation Measurement program to evaluate the six surface flux parameterization schemes commonly used in the Weather Research and Forecasting (WRF) model and three U.S. general circulation models (GCMs). The unprecedented 7-yr-long measurements by the eddy correlation (EC) and energy balance Bowen ratio (EBBR) methods permit statistical evaluation of all six parameterizations under a variety of stability conditions, diurnal cycles, and seasonal variations. The statistical analyses show that the momentum flux parameterization agrees best with the EC observations, followed by latent heat flux, sensible heat flux, and evaporation ratio/Bowen ratio. The overall performance of the parameterizations depends on atmospheric stability, being best under neutral stratification and deteriorating toward both more stable and more unstable conditions. Further diagnostic analysis reveals that in addition to the parameterization schemes themselves, the discrepancies between observed and parameterized sensible and latent heat fluxes may stem from inadequate use of input variables such as surface temperature, moisture availability, and roughness length. The results demonstrate the need for improving the land surface models and measurements of surface properties, which would permit the evaluation of full land surface models.

54 ENVIRONMENTAL SCIENCES↗

Dissertation Defense: Three Papers on Organizational Decision-Making and Change at NASA Goddard Space Flight Center

This is a three-paper dissertation that responds to a call for empirical research on stakeholder influence in the implementation of evaluation recommendations. The literature is consistent but mostly theoretical: stakeholder participation should positively influence and increase the probability of implementation (see e.g., Christie, 2011; Cousins & Earl, 1992; Fetterman, 2004). In response, I use two Goddard Space Flight Center engineering technical training and development programs to build a causal argument supporting my proposition that stakeholder influence in the logic modeling process impacts organizational decision-making and change. I first introduce the logic modeling process as a tool to involve stakeholders in program and evaluation design (paper 1); then use the data collection process to implement the collaboratively constructed logic model outcomes (paper 2); and, finally, I triangulate the data using the Toal (2009) Evaluation Involvement Scale (paper 3). I do this to “increase the validity of the findings” (Noble & Heale, 2019, p. 67) and to garner potential mechanisms. I found that stakeholder participation in the logic modeling process positively influenced the use of data to inform recommendations which in turn positively influenced implementation of evaluation recommendations. I identified the process itself as the mechanism and the key decision points as links or influencers. Potential factors included power and interest (measured by role) and time-on-job.

organizational decision-making↗

SPC-70783 Rev 0 Seismic Detector and Switch Survey and Verification Specification

A. Idaho National Laboratory (INL) is developing a microreactor to produce electrical power utilizing a small nuclear core and Stirling engines under the Microreactor Application Research Validation and Evaluation (MARVEL) program. The MARVEL microreactor Reactor Protection System (RPS) will have a seismic trip function. The selected part for this design is ETNA2 manufactured by Kinemetrics, Inc. B. Acceptance of the items delivered under this scope of work can be performed through a direct evaluation of the supplier’s controls and a factory acceptance test.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗

U.S. Department of Energy Hydrogen Program: 2021 Annual Merit Review and Peer Evaluation Report; June 7-11, 2021

This document summarizes peer review comments and scores for the fiscal year 2021 U.S. Department of Energy (DOE) Hydrogen Program Annual Merit Review and Peer Evaluation Meeting (AMR), held virtually June 7-11, 2021. In response to direction from various stakeholders, including the National Academies, this review process provides project- and program-level evaluations of DOE-funded research, development, demonstration, and analysis of hydrogen and fuel cell technologies.

AMR↗

Spillover as a cause of bias in baseline evaluation methods for demand response programs

Prior research has shown load reduction estimates from residential event-driven demand response programs (e.g., Critical Peak Pricing)using X of the highest Y days with a weather adjustment method are the best performing within the class of currently used baseline methods. However, they are still biased relative to estimates produced from randomized control trials (RCTs), the unbiased “gold standard” evaluation method. In this paper we identify underlying factors that cause some of the bias found in one commonly used baseline method. Rather than simply quantifying bias, our research provides a deeper understanding of what causes the bias and thus can be used to develop more accurate methods that are not subject to these underlying factors. Previous studies have compared various baseline methods relative to each other; however, because all baseline methods are biased, it is impossible to determine the true bias that exists in them. We have access to a unique RCT dataset: the Sacramento Municipal Utility District's study of critical peak pricing. Our analysis of 23 event days over two summers allows us to identify the true bias on load reduction estimates by using the RCT estimates as the unbiased gold standard against which we compare the estimates from the baseline methods. We found that spillover of energy reductions, from hours targeted by a program onto other hours, is one underlying factor that is a major cause of bias in baseline methods. We discuss alternative baseline methods that may not be subject to this same bias.

24 POWER TRANSMISSION AND DISTRIBUTION↗