Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Program Evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

APPLICATION OF MATURITY MODELS FOR EVALUATING CYBERSECURITY PROGRAMS AT NUCLEAR AND RADIOLOGICAL FACILITIES

Maturity models can be used to provide government agencies, industry associations, and organizations operating nuclear facilities with the ability to quickly evaluate the maturity of their cybersecurity programs and identify areas to prioritize for improvement. The Cybersecurity Capability Maturity Model (C2M2) was developed by the U.S. Department of Energy to allow organizations in the energy sector to evaluate the programmatic capabilities of their cybersecurity programs in a consistent manner, communicate programmatic maturity information, prioritize cybersecurity investments in targeted areas of concern, and track how the maturity of their cybersecurity program evolves over time. The C2M2 is designed for use by any critical infrastructure organization regardless of ownership, structure, or size. The C2M2 can be easily fine-tuned to access the maturity of nuclear cybersecurity programs and their application at individual facilities. Built on a foundation of existing cybersecurity standards, frameworks, programs, and initiatives, the model features 10 security domains. Performance in each security domain is characterized using a structured set of cybersecurity practices that represent activities an organization can perform to improve cybersecurity in their domain. Each practice can be quickly evaluated as being either fully, largely, partially, or not implemented. Once practices are evaluated for each security domain, the model defines four maturity indicator levels that apply independently to each domain in the model. To earn a maturity level in a given domain, an organization must adequately perform all the practices for that maturity level and its predecessor level(s). A small assessment team can conduct a C2M2 assessment in a single day. A screening version of the C2M2 allows an initial look at the maturity of nuclear cybersecurity programs that could be completed in under an hour.

Cyber security, Nuclear security, maturity model↗
DOE OSTI2018

4th Quarter and Annual Transportation Report FY2018

This report satisfies the U.S. Department of Energy, National Nuclear Security Administration Nevada Field Office (NNSA/NFO) commitment to prepare a quarterly summary of waste shipments to the Nevada National Security Site (NNSS) Radioactive Waste Management Complex (RWMC) in Area 5. This report summarizes the fourth quarter of fiscal year (FY) 2018 and serves as an annual report for the following types of shipments: Low-Level Radioactive Waste (LLW); Mixed Low-Level Radioactive Waste (MLLW); Classified Non-Radioactive (CNR) Waste; Classified Non-Radioactive Hazardous (CNRH) Waste; Tabular summaries are provided that include the following: Number and external volume of LLW, MLLW, and CNR/CNRH shipments; Waste generators for LLW, MLLW, and CNR/CNRH shipments to and on the NNSS; Carriers for LLW, MLLW, and CNR/CNRH shipments to and on the NNSS; Waste generator shipments by quarter; Highway routes used by carriers; Incident and accident data applicable to LLW, MLLW, and CNR/CNRH shipments. In this report, shipments are accounted for upon arrival at the NNSS, while disposal volumes are accounted for upon waste burial. Volume reports showing cubic feet (ft 3 ) generated using the Low-Level Waste Information System may vary slightly due to rounding conventions for conversions from cubic meters to cubic feet. Shipments are transported by motor carriers that are either identified on the U.S. Department of Energy (DOE) Motor Carrier Evaluation Program (MCEP) list, have been evaluated in a manner similar to the MCEP process, or are government vehicles. Government vehicles are not evaluated using the MCEP process but are fully compliant with all transportation regulations and requirements.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2017

Californium-252 Program Equipment Evaluation

To successfully continue the 252 Cf production and meet the needs of the customers, a comprehensive evaluation of the Building 7920 processing equipment was requested to identify equipment critical to the operational continuity of the program.

47 OTHER INSTRUMENTATION↗
DOE OSTI2015

Benchmarking and Transparency Policy and Program Impact Evaluation Handbook

This Handbook provides both a strategic planning framework and standard methodologies to determine the energy and non-energy benefits of benchmarking and transparency policies and programs that recently began to proliferate in jurisdiction across the United States.

Benchmarking and Transparency, B&T Policy, Analysi↗
DOE OSTI2023

Initial Delayed Critical Configuration of SHEBA I and Subcritical Measurements by Californium Source-Driven Noise Analysis

In September 1980, the initial delayed critical configuration of the Solution High-Energy Burst Assembly (SHEBA I) was assembled, and the US Department of Energy’s Oak Ridge National Laboratory (ORNL) staff performed near critical and subcritical measurements using the californium source-driven noise analysis (CSDNA) method at the Los Alamos National Laboratory (LANL) Critical Experiments Facility. An unreflected 56 cm outside diameter stainless-steel cylindrical tank was partially filled with uranyl fluoride solution (235U enrichment was 4.95 wt %) until delayed criticality was achieved. Then, measurements were performed for various fuel solution heights from delayed critical to 60% of the height required for delayed criticality. The stainless-steel tank had an inside diameter of 54.6 cm and a height of 105 cm and was partially (20–36.5 cm) filled with an aqueous solution of uranyl fluoride (with a density of 2.162 g/cm 3 ). The density of the uranium in solution was 1.042 g/cm 3 , and the solution had a H/U atomic ratio of 20.43. The tank had a 6.35 mm wall thickness and an axial reentrant tube with an inside diameter of 6.02 cm and wall thickness of 0.165 cm. The tank was essentially unreflected on the top and sides because it was in a thin metal shed. The reactivity of the near–delayed critical configuration was −10.4 cents, which corresponds to a k eff value of 0.99922. In addition to the CSDNA measurements, the prompt neutron decay constants were determined from break frequency noise analysis (BNFA) measurements. The subcritical neutron multiplication factors from CSDNA and BFNA compared extremely well. These data can be used as the basis of International Nuclear Criticality Safety Evaluation benchmark for the near-critical configuration, and the k eff values at various subcritical configurations can be used as subcritical benchmarks. Furthermore, the measured prompt neutron decay constants can be used as reactor physics benchmarks. This report documents the experimental information for the measurements performed so that, at a later date, researchers could perform the required uncertainty and calculational analyses and documentation to use these data for an International Criticality Safety Benchmark Evaluation Program (ICSBEP) or Nuclear Energy Agency benchmarks. The measured prompt neutron decay constants can be used as the basis of a benchmark for the International Reactor Physics Evaluation Program (IRPhEP). The data from these measurements are available from the ORNL Records Management Services Department, and the logbook is available from ICSBEP at Idaho National Laboratory.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Delayed Critical Enriched Uranium Metal, 7-in.-diam. Cylinder with Thin Stainless Steel Top and Bottom Reflectors

Three 7 in. diameter highly enriched uranium (HEU; 93.17 wt % 235 U) metal cylinders were assembled on the vertical assembly machine of the Oak Ridge Critical Experiments Facility (ORCEF) with thin stainless steel reflectors (0.5, 1, and 2 in. thick) on the top and bottom. These experiments were performed during January 13–25, 1965, and used seven operational days at ORCEF. Before these experiments, unreflected and unmoderated 7 in. diameter HEU metal cylinders had been assembled to delayed criticality at ORCEF, and the results were benchmarked in HEU-MET-FAST-051. In addition to the critical experiments, the prompt neutron decay constant was measured via the Rossi-α technique, and those results are also presented in this report. To achieve near-delayed-critical systems, 5 × 5 × 0.03125 in. rectangular uranium metal parts were used on top of 7 in. diameter cylinders inside the top reflector. The delayed critical configuration from the three experiments described herein are acceptable for use as criticality safety benchmark experiments for the International Criticality Safety Benchmark Evaluation Program (ICSBEP), coordinated by the Nuclear Energy Agency, once the uncertainty analysis is completed. Based on previous ICSBEP benchmarks with this enriched uranium metal at ORCEF, the uncertainty in $k_{eff}$ is expected to be as low as ±0.0002. The prompt neutron time decay data could be the basis of an International Reactor Physics Evaluation Program benchmark.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Evaluation of Programming Language-Aware Diffs for Improving Developer Productivity

As the number of supported platforms for SNL software increases, so do the testing requirements. This increases the total time spent between when a developer submits code for testing, and when tests are completed. This in turn leads developers to hold off submitting code for testing, meaning that when code is ready for testing there's a lot more of it. This increases the likelihood of merge conflicts which the developer must resolve by hand -- because someone else touched the files near the lines the developer touched. Current text-based diff tools often have trouble resolving conflicts in these cases. Work in Europe and Japan has demonstrated that, using programming language aware diff tools (e.g., using the abstract syntax tree (AST) a compiler might generate) can reduce the manual labor necessary to resolve merge conflicts. These techniques can detect code blocks which have moved, as opposed than current text-based diff tools, which only detect insertions / deletions of text blocks. In this study, we evaluate one such tool, GumTree, and see how effective it is as a replacement for traditional text-based diff approaches.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

State Technical Assistance - New Mexico Energy and Conservation Management Division Report [Slides]

The New Mexico Energy and Conservation Management Division (ECMD) sought technical assistance to enhance their ability to evaluate program impacts using the Low-Income Energy Affordability Data (LEAD) tool. NLR assisted ECMD in leveraging the LEAD tool to calculate and analyze energy burden across electric utility service areas, enabling them to assess program outcomes more effectively. To meet ECMD's goals, NLR developed a customized methodology to calculate utility-specific energy burden metrics using census tract data and available utility service area information from the Energy Information Administration (EIA). While acknowledging some limitations in the EIA dataset, NLR estimated the percentage of households within each service territory and incorporated relevant filters such as income, housing characteristics, and other demographics from the LEAD tool. The analysis provided ECMD with a new capability to evaluate program success based on energy savings, reductions in energy burden, and other performance indicators. The data and methodology also support discussions with utilities to improve the accuracy of service territory datasets. ECMD can use the outputs to track program effectiveness and plan future initiatives. NLR offered the possibility of follow-on work, including capacity-building for ECMD to repeat the analysis independently and the option to refine the analysis with updated service.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Strategic Energy Management Program Persistence and Cost Effectiveness An Analysis of the SEM Program Landscape

This study examines the relationship between strategic energy management (SEM) programs and their persistence and cost effectiveness, with analysis based on interview data from 24 SEM program administrators, SEM program evaluations, and other reports. The 80 interview questions focused on the topics of program design, energy savings, energy savings persistence, cost effectiveness, and customer SEM persistence. The generosity of interview respondents provided a wealth of data, resulting in a report of sufficient length to warrant inclusion of this brief guide of the report structure. The major sections are listed below with brief descriptions. Individual sections of this report are mainly stand-alone and do not require reading of other sections. As a result, there is some duplication between sections, but with differing levels of detail. Executive Summary: Presents three key conclusions of this work with a short description of potential actions to advance the understanding of each key finding. Brief Observations: Lists a large number of bulleted observations resulting from this research, arranged by the five major topic areas included in the interviews. Analysis details are provided in the Analysis of Interview Results section. Foundations for this Research: Provides an overview of SEM, SEM frameworks, SEM programs, the topics of persistence and cost effectiveness, and the focus of this research. Methodology: Details the approach and strategy of this research, providing background information relevant to the formulation of interview questions and the identification of which SEM programs to interview. Observations from Compiled Evaluations and Other Reports: Reports observations from the collection and analysis of program evaluations, annual reports, utility planning documents, and SEM-related white papers. This section, presented in bullet form, highlights challenges in data collection and ultimately a comparison of program practices as they pertain to persistence and cost effectiveness. Analysis of Interview Results: Presents detailed analysis of responses from SEM program administrators, arranged by the five major categories examined: program design, energy savings, energy savings persistence, cost effectiveness, and customer SEM persistence. Interview questions are generally grouped together into subsections when it makes sense to examine them together. SEM Programs Challenge Traditional Cost-Effectiveness Metrics: Details an analysis based on five key factors showing that applying traditional cost-effectiveness metrics to SEM programs is not straightforward. This invites the opportunity to consider whether traditional cost-effectiveness metrics are applicable to SEM programs, either individually or at large. Resolution of Research Hypotheses: Tabulates a set of hypotheses that were developed to address the fundamental nature of the research at hand. Analysis of responses to multiple questions informs an understanding of each hypothesis and can be used to better understand the SEM program environment at large.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2015

SU-E-J-92: Validating Dose Uncertainty Estimates Produced by AUTODIRECT, An Automated Program to Evaluate Deformable Image Registration Accuracy

Purpose: Deformable image registration (DIR) is a powerful tool with the potential to deformably map dose from one computed-tomography (CT) image to another. Errors in the DIR, however, will produce errors in the transferred dose distribution. We have proposed a software tool, called AUTODIRECT (automated DIR evaluation of confidence tool), which predicts voxel-specific dose mapping errors on a patient-by-patient basis. This work validates the effectiveness of AUTODIRECT to predict dose mapping errors with virtual and physical phantom datasets. Methods: AUTODIRECT requires 4 inputs: moving and fixed CT images and two noise scans of a water phantom (for noise characterization). Then, AUTODIRECT uses algorithms to generate test deformations and applies them to the moving and fixed images (along with processing) to digitally create sets of test images, with known ground-truth deformations that are similar to the actual one. The clinical DIR algorithm is then applied to these test image sets (currently 4) . From these tests, AUTODIRECT generates spatial and dose uncertainty estimates for each image voxel based on a Student’s t distribution. This work compares these uncertainty estimates to the actual errors made by the Velocity Deformable Multi Pass algorithm on 11 virtual and 1 physical phantom datasets. Results: For 11 of the 12 tests, the predicted dose error distributions from AUTODIRECT are well matched to the actual error distributions within 1–6% for 10 virtual phantoms, and 9% for the physical phantom. For one of the cases though, the predictions underestimated the errors in the tail of the distribution. Conclusion: Overall, the AUTODIRECT algorithm performed well on the 12 phantom cases for Velocity and was shown to generate accurate estimates of dose warping uncertainty. AUTODIRECT is able to automatically generate patient-, organ- , and voxel-specific DIR uncertainty estimates. This ability would be useful for patient-specific DIR quality assurance.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2014

Evaluating Realized Impacts of DOE/EERE R&D Programs. Standard impact evaluation method

This document provides guidance for evaluators who conduct impact assessments of research and development (R&D) programs for the U.S. Department of Energy’s (DOE) Office of Energy Efficiency and Renewable Energy (EERE). It is also targeted at EERE program staff responsible for initiating and managing commissioned impact studies. The guide specifies how to estimate economic benefits and costs, energy saved and installed or generated, environmental impacts, energy security impacts, and knowledge impacts of R&D investments in advanced energy technologies.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2016

Validation of Criticality Analysis Capability of SuperMC with ICSBEP

SuperMC is a general purpose, intelligent and multifunctional, continuous energy Monte Carlo program for the design and safety evaluation of nuclear systems. It is designed to perform the comprehensive neutronics calculation, taking the radiation transport as the core and including the depletion, radiation source term/dose/biohazard, material activation and transmutation, etc. The latest version of SuperMC can perform the simulation of neutron, photon and coupled neutron and photon transport, and also equipped with the functions of automatic modeling and visualization. SuperMC has been verified by more than 2000 benchmark models and experiments including the handbook of International Criticality Safety Benchmark Evaluation Project (ICSBEP), the Shielding Integral Benchmark Archive Database (SINBAD), etc. The fusion reactor (ITER benchmark model, FDS Fusion Reactors), fast reactors (BN600, CLEAR-I), PWR reactors (HM, BEAVRS) and cases from the International Reactor Physics handbook Evaluation Program (IRPhEP) were employed for validating the comprehensive capability for reactor applications. In this paper, the validation of SuperMC based on the handbook of ICSBEP will be presented. ICSBEP, released by OECD/NEA, contains criticality safety benchmark specifications derived from experiments that were performed at various nuclear critical facilities around the world, which was widely used to verify neutronic codes and associated nuclear data libraries for criticality safety analysis. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2016

Performance of R-410A Alternative Refrigerants in a Reciprocating Compressor Designed for Air Conditioning Applications

In response to environmental concerns raised by the use of refrigerants with high Global Warming Potential (GWP), the Air-Conditioning, Heating, and Refrigeration Institute (AHRI) has launched an industry-wide cooperative research program, referred to as the Low-GWP Alternative Refrigerants Evaluation Program (AREP), to identify and evaluate promising alternative refrigerants for major product categories. After successfully completing the first phase of the program in December 2013, AHRI launched a second phase of the Low-GWP AREP in 2014 to continue research in areas that were not previously addressed, including refrigerants in high ambient conditions, refrigerants in applications not tested in the first phase, and new refrigerants identified since testing for the program began. Although the Ozone Depletion Potential of R-410A is zero, this refrigerant is under scrutiny due to its high GWP. Several candidate alternative refrigerants have already demonstrated low global warming potential. Performance of these low-GWP alternative refrigerants is being evaluated for Air conditioning and heat pump applications to ensure acceptable system capacity and efficiency. This paper reports the results of a series of compressor calorimeter tests conducted for the second phase of the AREP to evaluate the performance of R-410A alternative refrigerants in a reciprocating compressor designed for air conditioning systems. It compares performance of alternative refrigerants ARM-71A, L41-1, DR-5A, D2Y-60, and R-32 to that of R-410A over a wide range of operating conditions. The tests showed that, in general, cooling capacities were slightly lower (except for the R-32), but energy efficiency ratios (EER) of the alternative refrigerants were comparable to that of R-410A.

Alternative Refrigerants↗
DOE OSTI2021

Strategic Training in Transdisciplinary Radiation Science for the 21st Century (STARS21): 15-Year Evaluation of an Innovative Research Training Program

To evaluate the 15-year impact of a transdisciplinary research training program for graduate students, postdoctoral fellows, and clinical trainees focused on radiation science, entitled Strategic Training in Transdisciplinary Radiation Science for the 21st Century (STARS21) with a primary objective to build capacity in radiation research.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2025

Zero-Emission Transit Bus Needs Assessment

The transition to zero-emissions vehicles (ZEVs) in public transit has gained traction due to significant federal investments from the Bipartisan Infrastructure Law (BIL) and the Inflation Reduction Act (IRA). This needs assessment, commissioned by the Joint Office of Energy and Transportation and conducted by researchers at the Idaho National Laboratory, explores the current state of electrification in transit agencies, identifying barriers to implementation, potential funding sources, and operational considerations necessary for a successful transition. The assessment involved qualitative interviews with representatives from 19 transit service providers across diverse geographic regions. Key findings highlight the challenges related to bus facilities and operations, which require careful planning for charging infrastructure and maintenance capabilities to accommodate battery electric buses (BEBs) and hydrogen fuel cell buses (HFCBs). Agencies reported operational hurdles due to the shorter range of BEBs compared to diesel buses, necessitating revised scheduling and routing strategies. Despite these challenges, many agencies expressed optimism about their capacity to adapt. Funding availability emerged as a critical factor influencing the transition to ZEVs. While agencies welcomed increased financial support, particularly from the Low or No Emission Grant Program (Lo-No), concerns about the sustainability of this funding and the ongoing operational costs were prevalent. The need for a comprehensive funding inventory was underscored to ensure transit agencies are aware of all available resources. Technological constraints were significant barriers to ZEV adoption. The limited range of BEBs was frequently cited as a concern, leading to operational challenges and reliability issues. Agencies reported difficulties in sourcing replacement parts, which exacerbated downtime and maintenance challenges. Workforce development and training were identified as pivotal for a successful transition. Many agencies rely heavily on manufacturers for technician training, highlighting the need for scalable training programs that equip staff with the necessary skills to maintain electric powertrains effectively. This assessment offers actionable recommendations for the Joint Office, including enhancing outreach to transit agencies, developing resources for effective utility partnerships, and facilitating comprehensive training programs. Establishing a zero-emission bus evaluation program to track performance metrics such as cost, range, and reliability could provide valuable insights for transit agencies. The needs assessment provides a detailed examination of the challenges and opportunities facing transit agencies in their transition to zero-emissions bus fleets. By addressing these issues through targeted support, stakeholders can collaboratively work towards a cleaner, more sustainable public transportation system that benefits all communities.

33 - ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2022

Sludge Batch 10 (SB10) Acceptance Evaluation: Radionuclide Concentrations in Tank 51 Washed Qualification Sample

Savannah River National Laboratory (SRNL) has been tasked with the radionuclide characterization of the washed Sludge Batch 10 (SB10) qualification sample. The washed SB10 qualification sample is based on SRR Engineering guidance and the sample slurry is expected to be similar in composition to Tank 51 slurry after final preparations for transfer to Tank 40. Forty-four radionuclides along with total alpha and beta activity have been reported herein. These radionuclide measurements are required for the Defense Waste Processing Facility (DWPF) Radiological Evaluation Program, DWPF Technical Safety Requirements (TSR)/Waste Acceptance Criteria (WAC) Evaluation, and the DWPF Solid Waste Characterization Program.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗