Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Program Evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Evaluation of Portable Programming Models to Accelerate LArTPC Detector Simulations

The Liquid Argon Time Projection Chamber (LArTPC) technology is widely used in high energy physics experiments, including the upcoming Deep Underground Neutrino Experiment (DUNE). Accurately simulating LArTPC detector responses is essential for analysis algorithm development and physics model interpretations. Accurate LArTPC detector response simulations are computationally demanding, and can become a bottleneck in the analysis workflow. Compute devices such as General-Purpose Graphics Processing Units (GPGPUs) have the potential to substantially accelerate simulations compared to traditional CPU-only processing. The software development for these compute accelerators often carries the cost of specialized code refactorization and porting to match the target hardware architecture. With the rapid evolution and increased diversity of the computer architecture landscape, it is highly desirable to have a portable solution that also maintains reasonable performance. We report our ongoing effort in evaluating Kokkos as a basis for this portable programming model using LArTPC simulations in the context of the Wire-Cell Toolkit, a C++ library for LArTPC simulations, data analysis, reconstruction and visualization.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Performance Evaluation of Heterogeneous GPU Programming Frameworks for Hemodynamic Simulations

Preparing for the deployment of large scientific and engineering codes on upcoming exascale systems with GPU-dense nodes is made challenging by the unprecedented diversity of device architectures and heterogeneous programming models. In this work, we evaluate the process of porting a massively parallel, fluid dynamics code written in CUDA to SYCL, HIP, and Kokkos with a range of backends, using a combination of automated tools and manual tuning. We use a proxy application along with a custom performance model to inform the results and identify additional optimization strategies. At scale performance of the programming model implementations are evaluated on pre-production GPU node architectures for Frontier and Aurora, as well as on current NVIDIA device-based systems Summit and Polaris. Real-world workloads representing 3D blood flow calculations in complex vasculature are assessed. Our analysis highlights critical trade-offs between code performance, portability, and development time.

Martin, Aristotle↗
DOE OSTI2015

SU-B-213-03: Evaluation of Graduate Programs

The North American medical physics community validates the education received by medical physicists and the clinical qualifications for medical physicists through accreditation of educational programs and certification of medical physicists. Medical physics educational programs (graduate education and residency education) are accredited by the Commission on Accreditation of Medical Physics Education Programs (CAMPEP), whereas medical physicists are certified by several organizations, the most familiar of which is the American Board of Radiology (ABR). In order for an educational program to become accredited or a medical physicist to become certified, the applicant must meet certain specified standards set by the appropriate organization. In this Symposium, representatives from both CAMPEP and the ABR will describe the process by which standards are established as well as the process by which qualifications of candidates for accreditation or certification are shown to be compliant with these standards. The Symposium will conclude with a panel discussion. Learning Objectives: Recognize the difference between accreditation of an educational program and certification of an individual Identify the two organizations primarily responsible for these tasks Describe the development of educational standards Describe the process by which examination questions are developed GS is Executive Secretary of CAMPEP.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2015

SU-B-213-04: Evaluation of Residency Programs

The North American medical physics community validates the education received by medical physicists and the clinical qualifications for medical physicists through accreditation of educational programs and certification of medical physicists. Medical physics educational programs (graduate education and residency education) are accredited by the Commission on Accreditation of Medical Physics Education Programs (CAMPEP), whereas medical physicists are certified by several organizations, the most familiar of which is the American Board of Radiology (ABR). In order for an educational program to become accredited or a medical physicist to become certified, the applicant must meet certain specified standards set by the appropriate organization. In this Symposium, representatives from both CAMPEP and the ABR will describe the process by which standards are established as well as the process by which qualifications of candidates for accreditation or certification are shown to be compliant with these standards. The Symposium will conclude with a panel discussion. Learning Objectives: Recognize the difference between accreditation of an educational program and certification of an individual Identify the two organizations primarily responsible for these tasks Describe the development of educational standards Describe the process by which examination questions are developed GS is Executive Secretary of CAMPEP.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2022

Retracted: Monitoring Hatchery Broodstock Composition and Genetic Variation of Spring/Summer Chinook Salmon in the Columbia River Basin with Multigeneration Pedigrees

Abstract Hatchery production of Chinook Salmon Oncorhynchus tshawytscha in the Columbia River basin comprises most of the anadromous salmonid production in this region. Hatchery facilities and programs serve to mitigate for impacts to salmonids due to the construction and operation of hydropower dams and habitat impacts from development in addition to the conservation and restoration of natural populations. A genetic method referred to as parentage-based tagging (PBT) enables highly reliable detection of hatchery-origin fish and inference of multigeneration pedigrees. This study compiles 11 years of PBT data from nearly 125,000 interior stream-type Chinook Salmon from 24 spawning hatcheries located in tributaries of the mid- and upper Columbia River as well as the Salmon, Clearwater, and Grande Ronde River subbasins. Multigenerational pedigrees allowed investigation of the proportion of natural- and hatchery-origin broodstock (pNOB and pHOB, respectively) for each hatchery and enumeration of the scale of production between segregated and integrated programs. We then compared how pHOB and the scale of production influenced the number of stray fish observed, genetic diversity, relatedness, and age-class compositions within broodstocks. Over 91.0% of hatchery broodstock could be assigned back to their parents, and there was an overall rate of less than 1.0% of broodstock that were unintentionally incorporated into nonnatal hatchery programs. We evaluated 14 segregated programs with 0.0–10.0% pNOB, 7 intermediate programs (10.1–50.0% pNOB), and 3 integrated programs (>50.0% pNOB). There was no correlation between the scale of production or pNOB with the level of genetic diversity, but as production size increased, so did the effective number of breeders. This study demonstrates the utility of PBT as a monitoring tool for hatchery broodstocks, and results suggest that segregated and integrated programs have tradeoffs that generally align with their intended broodstock management purpose of providing fish for harvest and/or fish for supplementation or reintroduction.

Horn, Rebekah L.↗
DOE OSTI2023

Multigeneration Pedigrees to Monitor Hatchery Broodstock Composition and Genetic Variation of Spring/Summer Chinook Salmon in the Columbia River Basin

Abstract Hatchery production of Chinook Salmon Oncorhynchus tshawytscha in the Columbia River basin comprises most of the anadromous salmonid production in this region. Hatchery facilities and programs serve to mitigate for impacts to salmonids due to the construction and operation of hydropower dams and habitat impacts from development in addition to the conservation and restoration of natural populations. A genetic method referred to as parentage-based tagging (PBT) enables highly reliable detection of hatchery-origin fish and inference of multigeneration pedigrees. This study compiles 11 years of PBT data from nearly 125,000 interior stream-type Chinook Salmon from 24 spawning hatcheries located on tributaries of the mid- and upper Columbia River and in the Salmon, Clearwater, and Grande Ronde River subbasins. Multigenerational pedigrees allowed for investigation of the proportions of natural- and hatchery-origin broodstock (pNOB and pHOB, respectively) for each hatchery and enumeration of the scale of production between segregated and integrated programs. We then compared how pHOB and the scale of production influenced the number of stray fish observed, genetic diversity, relatedness, and age-class compositions within broodstocks. Over 91.0% of hatchery broodstock could be assigned back to their parents, and overall less than 1.0% of broodstock consisted of fish that were unintentionally incorporated into nonnatal hatchery programs. We evaluated 11 segregated programs with 0.0–10.0% pNOB, 9 intermediate programs (10.1–50.0% pNOB), and 3 integrated programs (>50.0% pNOB). There was no correlation between the scale of production or pNOB with the level of genetic diversity, but as production size increased, so did the effective number of breeders. This study demonstrates the utility of PBT as a monitoring tool for hatchery broodstocks, and results suggest that segregated and integrated programs have tradeoffs that generally align with their intended broodstock management purpose of providing fish for harvest and/or fish for supplementation or reintroduction.

Horn, Rebekah L.↗
DOE OSTI2016

Towards Resiliency Evaluation of Vector Programs

The systems resilience research community has developed methods to manually insert additional source-program level assertions to trap errors, and also devised tools to conduct fault injection studies for scalar program codes. In this work, we contribute the first vector oriented LLVM-level fault injector VULFI to help study the effects of faults in vector architectures that are of growing importance, especially for vectorizing loops. Using VULFI, we conduct a resiliency study of nine real-world vector benchmarks using Intel’s AVX and SSE extensions as the target vector instruction sets, and offer the first reported understanding of how faults affect vector instruction sets. We take this work further toward automating the insertion of resilience assertions during compilation. This is based on our observation that during intermediate (e.g., LLVM-level) code generation to handle full and partial vectorization, modern compilers exploit (and explicate in their code-documentation) critical invariants. These invariants are turned into error-checking code. We confirm the efficacy of these automatically inserted low-overhead error detectors for vectorized for-loops.

fault injection↗
DOE OSTI2012

Disposal Activities and the Unique Waste Streams at the Nevada National Security Site (NNSS)

This slide show documents waste disposal at the Nevada National Security Site. Topics covered include: radionuclide requirements for waste disposal; approved performance assessment (PA) for depleted uranium disposal; requirements; program approval; the Waste Acceptance Review Panel (WARP); description of the Radioactive Waste Acceptance Program (RWAP); facility evaluation; recent program accomplishments, nuclear facility safety changes; higher-activity waste stream disposal; and, large volume bulk waste streams.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2017

Commercial Midstream Energy Efficiency Incentive Programs: Guidelines for Future Program Design, Implementation, and Evaluation

Many electric utilities operate energy efficiency incentive programs that encourage increased dissemination and use of energy-efficient (EE) products in their service territories. The programs can be segmented into three broad categories—downstream incentive programs target product end users, midstream programs target product distributors, and upstream programs target product manufacturers. Traditional downstream programs have had difficulty engaging Small Business/Small Portfolio (SBSP) audiences, and an opportunity exists to expand Commercial Midstream Incentive Programs (CMIPs) to reach this market segment instead.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2019

Evaluating the effectiveness of program data features for guiding memory management

Recent trends have led to the adoption of larger and more complex memory systems, often with multiple tiers of memory performance within the same platform. To utilize complex memory systems efficiently, current data management strategies must be altered to map usage demands to the underlying hardware. Applications, as the generators of memory accesses, are well-suited to guide this process, but building and maintaining separate source code versions for different memory systems is not feasible in most cases. One potential solution is to employ automated program profiling and analysis to facilitate the production of application-based guidance. By attaching memory usage information to static or lightweight program features, compilers and runtime systems can generate fine-grained guidance without additional efforts from users or developers. Recent works have employed this approach with some success, but it is not clear which program features are most useful for guiding data management.This work evaluates the effectiveness of using different program data features to predict memory usage and guide memory management. It employs a custom set of simulation tools, based in the Intel® Pin framework, to collect and analyze the usage characteristics of application data associated with common program data features, such as allocation sites, types, and context. The results show that even relatively simple features, such as object size, are useful for selecting data with similar usage properties, but finer-grained features, such as the instructions that access a particular object, are often much more effective. Additionally, this work evaluates the performance of using different data features and different program inputs to guide data placement on a heterogeneous memory platform with a limited amount of high performance memory.

Effler, T. Chad↗
DOE OSTI2012

International Review of the Development and Implementation of Energy Efficiency Standards and Labeling Programs

Appliance energy efficiency standards and labeling (S&L) programs have been important policy tools for regulating the efficiency of energy-using products for over 40 years and continue to expand in terms of geographic and product coverage. The most common S&L programs include mandatory minimum energy performance standards (MEPS) that seek to push the market for efficient products, and energy information and endorsement labels that seek to pull the market. This study seeks to review and compare some of the earliest and most well-developed S&L programs in three countries and one region: the U.S. MEPS and ENERGY STAR, Australia MEPS and Energy Label, European Union MEPS and Ecodesign requirements and Energy Label and Japanese Top Runner programs. For each program, key elements of S&L programs are evaluated and comparative analyses across the programs undertaken to identify best practice examples of individual elements as well as cross-cutting factors for success and lessons learned in international S&L program development and implementation. The international review and comparative analysis identified several overarching themes and highlighted some common factors behind successful program elements. First, standard-setting and programmatic implementation can benefit significantly from a legal framework that stipulates a specific timeline or schedule for standard-setting and revision, product coverage and legal sanctions for non-compliance. Second, the different MEPS programs revealed similarities in targeting efficiency gains that are technically feasible and economically justified as the principle for choosing a standard level, in many cases at a level that no product on the current market could reach. Third, detailed survey data such as the U.S. Residential Energy Consumption Survey (RECS) and rigorous analyses provide a strong foundation for standard-setting while incorporating the participation of different groups of stakeholders further strengthen the process. Fourth, sufficient program resources for program implementation and evaluation are critical to the effectiveness of standards and labeling programs and cost-sharing between national and local governments can help ensure adequate resources and uniform implementation. Lastly, check-testing and punitive measures are important forms of enforcement while the cancellation of registration or product sales-based fines have also proven effective in reducing non-compliance. The international comparative analysis also revealed the differing degree to which the level of government decentralization has influenced S&L programs and while no single country has best practices in all elements of standards and labeling development and implementation, national examples of best practices for specific elements do exist. For example, the U.S. has exemplified the use of rigorous analyses for standard-setting and robust data source with the RECS database while Japan's Top Runner standard-setting principle has motivated manufacturers to exceed targets. In terms of standards implementation and enforcement, Australia has demonstrated success with enforcement given its long history of check-testing and enforcement initiatives while mandatory information-sharing between EU jurisdictions on compliance results is another important enforcement mechanism. These examples show that it is important to evaluate not only the drivers of different paths of standards and labeling development, but also the country-specific context for best practice examples in order to understand how and why certain elements of specific S&L programs have been effective.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2012

National evaluation of the weatherization assistance program during the ARRA period: program years 2009-2011

This report describes the third major evaluation of the Program, encompassing program years 2009 to 2011. In this report, this period of time is referred to as the ARRA Period. This is a special period of time for the Program because the American Recovery and Reinvestment Act (ARRA) of 2009 has allocated $\$$5 billion of funding for the Program. In normal program years, WAP s annual appropriation is in the range of $\$$200-250 million, supporting the weatherization of approximately 100,000 homes. With the addition of ARRA funding during these program years, the expectation is that weatherization activity will exceed 300,000 homes per year. In addition to saving energy and reducing low-income energy bills, expanded WAP funding is expected to stimulate the economy by providing new jobs in the weatherization field and allowing low-income households to spend more money on goods and services by spending less on energy.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

Analysis of Abdominal Radiology fellowship website content and comprehensiveness

Purpose: Fellowship programs’ online content plays a key role in prospective Abdominal Radiology applicants’ evaluation of programs. The purpose of this study is to examine the online accessibility of Abdominal Radiology fellowships, the comprehensiveness of the program websites’ content, and evaluate whether specific program characteristics are associated with differentiated website comprehensiveness. Methods: A list of 67 Abdominal Radiology fellowship programs was obtained from the Society of Abdominal Radiology (SAR) website. Each of the 65 publicly-available fellowship websites was scored for the presence of 19 binary variables related to the program’s attributes and curriculum to assess informational comprehensiveness. Comprehensiveness scores were compared by program characteristics (accreditation status, region, and size) using Kruskal–Wallis and two-tailed t tests. Results: Mean comprehensiveness score of Abdominal Radiology fellowship websites as measured by online criteria met was 52.6% (10.0 ± 3.0/19). Application requirements and information, rotation scheduling, and program director contact were found on more than 87.5% of the 65 websites, whereas salary and benefits, social information, and alumni were listed on fewer than 33.8% (22/65) of websites. Program accreditation status, region, and size were not associated with difference in mean comprehensiveness scores. Conclusions: There is a discrepancy between information commonly sought by prospective Abdominal Radiology fellowship applicants and what is available on fellowship program websites. Programs and applicants alike may benefit from programs strengthening their online material.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2024

Building a Clean Energy Workforce: An Evaluation Framework for State Energy Office Workforce Programs

This fact sheet is a summary of the workforce evaluation framework that was first proposed in the white paper, An Evaluation Framework for State Energy Offices' Energy Efficiency and Clean Energy Workforce Program. This evaluation framework was developed to guide State Energy Offices (SEOs) in assessing and enhancing the workforce development programs the manage, fund, or partner on. By following this step-by-step framework, SEOs can evaluate program components, identify areas for improvement, and optimize program outcomes for greater impact.

clean energy↗
DOE OSTI2023

140,142 Ce Neutron Cross Section Resolved Resonance Region Evaluation

A resolved resonance region evaluation of 140,142 Ce was conducted by Oak Ridge National Laboratory. Requested by the US Nuclear Criticality Safety Program, this evaluation is based on recent high-resolution transmission and capture high-resolution measurements of nat Ce and 142 Ce conducted at JRC-Geel at the Geel Linear Accelerator facility. It is also based on recently measured thermal constants available from the EX FOR database. Starting from the resonance parameters from the ENDF/B-VIII.0 library and following a preliminary R-matrix analysis, an updated set of resonance parameters and corresponding covariance in formation was derived by the fit of these experimental datasets using the Reich–Moore approximation of the R-matrix theory, as implemented in the SAMMY code system. The resolved resonance region upper energy limit for 140 Ce was kept at 200 keV, whereas the 142 Ce resonance region was extended from 13 to 26 keV. This new evaluation was found to be in good agreement not only with several integral quantities of interest to the reactor physics community, but also with the stellar Maxwellian-averaged cross section.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗