Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Program Evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Multi-Semester Mentoring and GPA Trajectories in SPINS: A Longitudinal Program Evaluation of STEM Scholars

This exploratory longitudinal program evaluation examined GPA trajectories among 14 STEM scholars participating in the Scholarly Partnership in Nuclear Security (SPINS) mentoring program at an HBCU. Using de-identified administrative data (37 scholar-semester observations), the study compared baseline and latest term GPAs anchored to each scholar’s first funded semester. A Wilcoxon signed-rank test was used to assess within-student change. Mean GPA increased modestly from 3.46 (SD = 0.30) at baseline to 3.61 (SD = 0.33) at the latest observed semester, with 12 of 14 scholars (85.7%) showing net improvement (median change = +0.12). The Wilcoxon signed-rank test indicated a statistically significant positive shift (W = 18, p = 0.030). However, scholars entered the program with a high baseline GPA, and ceiling effects were evident for several participants. Grounded in Social Cognitive Career Theory, findings suggest that multi-semester participation in SPINS is associated with GPA stability and modest improvement in an already high-performing cohort. Results should be interpreted cautiously given the small sample size and single-group design. The study highlights the value of sustained, culturally responsive mentoring at an HBCU while underscoring the need for larger evaluations with comparison cohorts and broader psychosocial outcomes. An evidence-informed mentoring framework is proposed to strengthen multi-semester support.

42 ENGINEERING↗
DOE OSTI2026

State Technical Assistance - New Mexico Energy and Conservation Management Division Report [Slides]

The New Mexico Energy and Conservation Management Division (ECMD) sought technical assistance to enhance their ability to evaluate program impacts using the Low-Income Energy Affordability Data (LEAD) tool. NLR assisted ECMD in leveraging the LEAD tool to calculate and analyze energy burden across electric utility service areas, enabling them to assess program outcomes more effectively. To meet ECMD's goals, NLR developed a customized methodology to calculate utility-specific energy burden metrics using census tract data and available utility service area information from the Energy Information Administration (EIA). While acknowledging some limitations in the EIA dataset, NLR estimated the percentage of households within each service territory and incorporated relevant filters such as income, housing characteristics, and other demographics from the LEAD tool. The analysis provided ECMD with a new capability to evaluate program success based on energy savings, reductions in energy burden, and other performance indicators. The data and methodology also support discussions with utilities to improve the accuracy of service territory datasets. ECMD can use the outputs to track program effectiveness and plan future initiatives. NLR offered the possibility of follow-on work, including capacity-building for ECMD to repeat the analysis independently and the option to refine the analysis with updated service.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

Zero-Emission Transit Bus Needs Assessment

The transition to zero-emissions vehicles (ZEVs) in public transit has gained traction due to significant federal investments from the Bipartisan Infrastructure Law (BIL) and the Inflation Reduction Act (IRA). This needs assessment, commissioned by the Joint Office of Energy and Transportation and conducted by researchers at the Idaho National Laboratory, explores the current state of electrification in transit agencies, identifying barriers to implementation, potential funding sources, and operational considerations necessary for a successful transition. The assessment involved qualitative interviews with representatives from 19 transit service providers across diverse geographic regions. Key findings highlight the challenges related to bus facilities and operations, which require careful planning for charging infrastructure and maintenance capabilities to accommodate battery electric buses (BEBs) and hydrogen fuel cell buses (HFCBs). Agencies reported operational hurdles due to the shorter range of BEBs compared to diesel buses, necessitating revised scheduling and routing strategies. Despite these challenges, many agencies expressed optimism about their capacity to adapt. Funding availability emerged as a critical factor influencing the transition to ZEVs. While agencies welcomed increased financial support, particularly from the Low or No Emission Grant Program (Lo-No), concerns about the sustainability of this funding and the ongoing operational costs were prevalent. The need for a comprehensive funding inventory was underscored to ensure transit agencies are aware of all available resources. Technological constraints were significant barriers to ZEV adoption. The limited range of BEBs was frequently cited as a concern, leading to operational challenges and reliability issues. Agencies reported difficulties in sourcing replacement parts, which exacerbated downtime and maintenance challenges. Workforce development and training were identified as pivotal for a successful transition. Many agencies rely heavily on manufacturers for technician training, highlighting the need for scalable training programs that equip staff with the necessary skills to maintain electric powertrains effectively. This assessment offers actionable recommendations for the Joint Office, including enhancing outreach to transit agencies, developing resources for effective utility partnerships, and facilitating comprehensive training programs. Establishing a zero-emission bus evaluation program to track performance metrics such as cost, range, and reliability could provide valuable insights for transit agencies. The needs assessment provides a detailed examination of the challenges and opportunities facing transit agencies in their transition to zero-emissions bus fleets. By addressing these issues through targeted support, stakeholders can collaboratively work towards a cleaner, more sustainable public transportation system that benefits all communities.

33 - ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2024

Improving Efficiency of Off-Road Vehicles by Novel Integration of Electric Machines and Advanced Combustion Engines

Modern off-road equipment will increasingly rely on electrified implements that will deliver precision control with a smaller footprint than hydraulics. The primary energy converter, however, will be an onboard reciprocating internal combustion engine because of the power density of hydrocarbon fuels in comparison to electrical energy storage and the remote locations where much of this equipment is deployed. Adding energy storage and electric machines creates opportunities to improve efficiency while reducing emissions. This program investigated approaches to take advantage of the extra flexibility that an enhanced electrical system to enable high-efficiency, low-emissions combustion technologies. The current program evaluated hybridization of both the torque application and air-handling systems to maximize efficiency while minimizing cost. This program designed, analyzed and tested a hybrid off-road vehicle consisting of a series electric powertrain with energy storage, an electrified air system, and a 33% downsized diesel engine. Detailed comparisons were made between the base powertrain and the developed powertrain using powertrain simulations, engine testing, and vehicle testing. The key results of the study are: • The resulting vehicle reduces fuel consumption by 5% to 15% at equal productivity. The primary improvements were due to recovery of regenerative braking losses for cycles where large transients are encountered. • The electrified air system was an enabler to allow engine downsizing. This was most important for duty-cycles where the engine primarily operated at moderate loads and had few low speed high torque conditions. • Engine level improvements showed re-optimization of the powertrain is possible when electrified air handing is available. Increased exhaust gas recirculation and advanced injection timing allowed up to a 15% reduction in brake specific fuel consumption at equal NOx and transient response. Compared to the larger engine, the downsized engine achieves up to an 18% reduction in brake specific fuel consumption over the non-road transient cycle. • The life cycle analysis and total cost of ownership study showed that the hybrid powertrain has the potential to reduce 5-year CO2 and total cost of ownership by ~6% over the baseline vehicle. The results also indicated that a pure battery electric vehicle is not feasible in this application and is likely to increase the CO2 emissions due to the CO2 from battery production. A hybrid powertrain with low carbon fuels shows the potential to substantially reduce CO2 and total cost of ownership.

02 PETROLEUM↗
DOE OSTI2025

Assessing the cumulative effects of nearshore habitat restoration actions for multiple populations of juvenile salmon in Whidbey Basin, Washington: foundation and approach for synthesis and evaluation

Ecosystem restoration is a common tool for re-establishing ecosystem processes, structures, and functions to improve biodiversity and services in coastal and estuarine ecosystems. In the Salish Sea, salmon habitats have been fragmented, reduced in size, and diminished in quality, and the ecosystem processes that form and sustain these habitats have been degraded and disrupted as well. This loss is especially prevalent in estuaries, where up to 90% of former salmon habitat has been lost or compromised. Salmon species are integral to the identities and cultures of people in the Pacific Northwest, yet salmon abundances remain at historic lows, especially in urbanized areas. Recent investments in restoration are creating rearing habitat and repairing lost ecosystem function. However, restoration efforts in this region have largely proceeded at the site scale, with less attention to big-picture thinking regarding how restoration will effectively recover degraded or lost habitats for target species. As a result, no landscape-scale evaluation program exists, and the cumulative benefits of multiple interventions are unknown. We describe innovative methods for science synthesis related to the evaluation of cumulative effects of ecosystem restoration for Pacific salmon, using years of existing, but disparate data. Building from previous work on cumulative effects evaluation and incorporating a hierarchy of hypotheses approach, we propose using causal inference across numerous hypotheses in a framework to assess the cumulative benefits to Pacific salmon from multiple estuarine restoration projects. We present the framework as a method that can be used to address many complex questions and provide examples from the Salish Sea where the approach is being implemented. The framework draws on science synthesis from numerous fields and uses a hierarchy of hypotheses, causal analysis at multiple scales, and a new hierarchy of synthesis for assessing multiple lines of evidence documenting restoration effects on Pacific salmon. We propose causal inference to synthesize dissimilar data streams, in our case, to identify various manifestations of cumulative effects of restoration and benefits to salmon, and to further inform restoration and recovery planning. A unifying framework would allow for the detection of thresholds at which restoration provides measurable improvement and would greatly advance understanding of the effects of restoration on ecosystems.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Farm Practice Typologies as a Strategy for Management-Relevant Land Use and Land Cover Mapping in the Great Lakes Region (Version 1) [Dataset]

Dataset overview and development This dataset provides spatially explicit agricultural land-use and land-management typologies developed for the Great Lakes Region (GLR) at the farm-parcel level. The typologies were designed to characterize not only the land-use and land-cover (LULC) associated with individual agricultural farm parcels, but also the land-management practices (LMPs), including irrigation, tile drainage, and conservation easements, occurring within those parcels and how these characteristics change through time. The dataset contains four related typology products: Annual integrated typology – describes the combined LULC and land-management characteristics for each farm parcel for individual years. LULC transition typology – describes the temporal pattern of LULC change for each farm parcel across the study period (2008-2023). LMP trend typology – describes the temporal pattern in the occurrence of LMPs for each farm parcel across the study period. Multi-year integrated typology – combines the LULC transition typology and LMP trend typology to provide an integrated characterization of long-term land-use and management patterns. Purpose of the dataset The purpose of these products is to provide a management-relevant integrated and consistent framework for evaluating the spatial and temporal organization of agricultural landscapes across the GLR. The resulting typologies can: support landscape-scale environmental and land-use analysis; provide spatial information relevant to land-management strategies, conservation planning, policy development, and program evaluation; characterize spatial patterns of agricultural land use and management; examine changes in agricultural landscapes through time; and identify persistent, transitional, and changing agricultural systems. Please refer to the README file provided in Files for more details.

Agriculture↗
DOE OSTI2024

ASME Design Code Rule Changes for Nuclear Graphite

The American Society of Mechanical Engineers Boiler Pressure and Vessel Code (ASME BPVC) Section III, Division 5, Article HHA-3000 outlines graphite core component and graphite core assembly design guidelines. Graphite core components are defined as ?components manufactured from graphite that are installed to form a graphite core assembly within the reactor pressure vessel of a high temperature, graphite moderated fission reactor.? (p. 413) Graphites? inherent defect distributions do not allow for deterministic material reliability. Rather, graphite has variable strength distributions which change by grade. Article HHA-3000 outlines two semi-probabilistic methods, the full and simplified assessments, which set design load limit targets for each of three component structural reliability classes. The Design Task Group was officially recognized as a specialized task group within ASME November of 2023, though we?ve been collaborating since 2022. The purpose of the Design Task Group is to correct, clarify, and make HHA-3000 function as intended. The Design Task Group will sunset once we?ve achieved our objectives. The Design Task Group was specifically told to not write new Code. While there may be more precise and more accurate methods to determine reliability targets, the current methods are conservative, relatively simple to implement, and have thus far been considered satisfactory for setting design reliability targets. Much of the ground-work to write proposal files and background documents for records to make the changes needed to achieve our objective have been completed. The Design Task Group has documented much of their work through papers, presentations, and memorandums. Three memorandums in which INL team members had substantial contributions are found in the Appendices: FEA Modeling for the Baseline Program, Evaluating the Effects on Margin of Updating the Threshold and Shape Parameters in the Full Assessment, and Interpretations of the Full and Simplified Assessments in ASME BPVC. Most of the on-going work to achieve the Design Task Group?s objective will be addressing comments on existing records and moving records through the balloting process. The Design Task Group met bi-weekly mostly through the end of FY2023. Since February 2024, the Design Task Group has mostly been completed with solving and documenting the technical issues associated with the assessments. Unless new tasks are identified, the remaining work of the Design Task Group will be political and editorial.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

ANALYSIS OF SUITABLE METHODOLOGIES FOR COMPRESSOR MASS FLOW RATE CORRECTION TO OTHER SUPERHEAT LEVELS AND REFRIGERANTS

This paper investigates the impact of suction conditions and refrigerant on scroll compressor mass flow rate by using calorimeter tests from AHRI-11 and AHRI-21 reports, published by AHRI's Low-GWP Alternative Refrigerants Evaluation program. Two Copeland scroll compressors (20 and 51 cm3) have been analyzed including different suction conditions (SH = 11K, SH = 22K, Ti = 18ºC) and several refrigerants (R134a, R32, R410A, R404A, etc.). Previous studies have explored response surfaces for energy consumption and mass flow rate variables. This study aims to expand the analysis by identifying the optimal approach to extrapolate mass flow rate from specific suction conditions to others SH or suction temperature levels and refrigerants. The current compressor characterization standard relies on the 1981 Dabiri correlation to correct compressor mass flow rate with suction conditions. Thus, this study aims to assess the adequacy of this correction and explore alternative correction methods for improved results.

Marchante Avellaneda, Javier↗
DOE OSTI2026

Energy to Communities Program Short Introduction: Evaluation of Enhanced Geothermal System for Cornell District Heating [Slides]

Through the U.S. Department of Energy's Energy to Communities (E2C) program, NLR, other national laboratory experts, and select organizations provide Expert Match - free, short-term technical assistance to address near-term energy challenges and questions. Expert Match is for community stakeholders who have decision-making power or influence in their community but need access to additional energy expertise to inform key upcoming decisions. This Expert Match request supported Cornell University (Itaca, NY) community efforts in developing Enhanced Geothermal System (EGS) reservoir performance, by simulating fracture flow to estimate pressure drop, flow distribution, and heat extraction efficiency in fractured rock. Thermal drawdown modeling was used to assess long-term resource sustainability, while system optimization studies refined key parameters such as well configuration and flow rate to improve overall reservoir efficiency.

15 GEOTHERMAL ENERGY↗
DOE OSTI2025

Performance Evaluation of Different Parallel Programming Models in SCALE-Shift Sequences for Criticality and Shielding Applications [Abstract]

The SCALE code system has been widely used for nuclear criticality safety, reactor physics, radiation shielding, source term generation, and inventory analyses by researchers, industry, and regulatory bodies. Although limited support for shared- and distributed-memory parallel processing was introduced via C++ threading, OpenMP, and MPI, a hybrid parallel programming model with both distributed- and shared-memory parallelism has not been fully supported in the SCALE code system.

Nuclear Criticality Safety Program (NCSP)↗
DOE OSTI2024

Evaluations for Nuclear Criticality Safety Program 12 C, 139 La, minor actinides, 235 U [Slides]

For light nuclei, preliminary work extends the evaluation from 6.5 MeV to ~ 10 MeV. For 139 La, the team delivered full evaluation in fast region to ORNL, including covariances. For sup>235 U, RPI data simulations, the team performed simulations and showed some improvement for neutrons below 5 MeV. Some of the changes needed for more improvement might not be supported by the current format. Some of the changes above 12 MeV to account for the angular distribution of preequilibrium neutrons require a change in the PFNS evaluation procedure.

235U re-evaluation↗
DOE OSTI2026

Evaluation Toolkit for Technical Assistance Programs

Across the United States, every home, business, industry, and government depends on abundant, reliable, and affordable electricity. Energy stakeholders have many options to improve how energy is generated, distributed, and used, but choosing the right path can be complex and challenging. To support more informed decision-making about local electricity systems, the U.S. Department of Energy (DOE) and its national laboratories provide customized technical assistance (TA) through several different programs. These TA programs are designed to support a wide range of stakeholders with a variety of needs. Technical assistance may include brief consultations with subject-matter experts, in-depth technical modeling and analysis, stakeholder engagement, and peer-to-peer exchange. Delivering effective TA is an iterative process that requires evaluation and adaptation. A comprehensive and robust evaluation framework provides the structure needed to ensure that TA programs and practitioners remain effective, responsive to industry trends, and aligned with local needs. This toolkit provides a framework—including a clear, structured process—that TA program staff can adapt to their program's goals to evaluate success.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

Driving Affordable Energy Through Utility Program Design

The presentation is aimed to teach participants about achieving affordable energy through utility program design. Learning objectives include: identify key utility program characteristics that support affordability and consumer choice; apply best practices in outreach, eligibility, and evaluation to improve program design; and evaluate strategies for aligning program design with customer needs and regulatory goals.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

LLM Benchmarking with LLaMA2: Evaluating Code Development Performance Across Multiple Programming Languages

The rapid evolution of large language models (LLMs) has opened new possibilities for automating various tasks in software development. This paper evaluates the capabilities of the LLaMA 2-70B model in automating these tasks for scientific applications written in commonly used programming languages. Using representative test problems, we assess the model's capacity to generate code, documentation, and unit tests, as well as its ability to translate existing code between commonly used programming languages. Our comprehensive analysis evaluates the compilation, runtime behavior, and correctness of the generated and translated code. Additionally, we assess the quality of automatically generated code, documentation, and unit tests. Here, our results indicate that while LLaMA 2-70B frequently generates syntactically correct and functional code for simpler numerical tasks, it encounters substantial difficulties with more complex, parallelized, or distributed computations, requiring considerable manual corrections. We identify key limitations and suggest areas for future improvements to better leverage AI-driven automation in scientific computing workflows.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

LANL Meteorology Program Self-Assessment 2025 Update

The LANL Meteorological (Met) Program has been subject to several external reviews over the past 19 years. The DOE Meteorological Coordinating Council (DMCC) conducted an initial Met Program Site Assist Visit (SAV) in August 2006 (DMCC 2006). A follow-up SAV in August 2015 assessed progress (DMCC 2015), and in June 2023, the DOE Meteorological Subcommittee (DMSC), successor to the DMCC, conducted a second follow-up SAV (DMSC 2023), in which the Met Program was evaluated relative to the following 8 high-level questions: • What is the state of the meteorological services provided to its customers? • What is the quality of meteorological data provided to its customers and is it adequate and available to meet all customer needs? • What is the quality of atmospheric transport and diffusion modeling provided to its customers and is it applicable to complex wind flow patterns at LANL? • Are the current and future meteorological service customers being serviced appropriately? • Are there adequate human resources to meet present and future program customer needs and are they being appropriately leveraged? • Are existing instrumentation, facilities, and systems adequate to meet present and future customer needs? • Are LANL meteorological services conducted in an efficient, cost-effective manner? • Is meteorological data used to ensure safety & health of LANL personnel? More specific evaluations were performed relative to 23 performance objectives extracted from the ANSI/ANS-3.11- 2024 national standard and 14 separate performance objectives associated with consequence assessment and atmospheric transport and diffusion modeling in the consequence assessment element of DOE G 151.1-1B. In 2023, the DMSC SAV Team also reviewed the status of each of the 18 remaining recommendations from its 2015 SAV. Based on this review, DMSC stated in its Exit Briefing that the LANL meteorological program has gotten much stronger and more robust since 2015 and now represents one of the better managed programs within the DOE complex.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Scalability and Effectiveness of Smart Charge Management

The rise in electric vehicle (EV) adoption presents growing challenges for power grids, particularly from simultaneous residential charging, which can cause voltage fluctuations and increase feeder peak loads. Baltimore Gas and Electric (BGE), with support from the U.S. Department of Energy, initiated a pilot program to evaluate managed residential EV charging through Smart Charge Management (SCM). This study analyzes real-world charging behavior data from the pilot and feeder-level base loads from BGE to simulate residential charging scenarios through 2035 across the Washington, DC–Baltimore region. Grid impacts under unmanaged charging are compared to three SCM strategies: TOU-immediate, TOU-distributed, and Load Balancing. Results show that the magnitude of peak reduction is highly feeder-dependent. Some feeders achieve reductions of more than 40% at high enrollment levels, while others show improvements closer to 10–15%. This heterogeneity reflects differences in baseline feeder load shapes, EV penetration, and plug-in behavior across customers. Results also highlight trade-offs between shifting load away from peak periods and minimizing secondary demand peaks, offering practical insights for future utility program design.

Electric vehicle↗