Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “EVALUATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Evaluation of the Turbine Integrated Mortality Reduction (TIMR SM ) Technology as a Smart Curtailment Approach (Final Summary Report)

Wind energy is a crucial technology for achieving net-zero emissions by 2050. However, the growth and deployment of wind energy in North America have led to the deaths of many bat species due to operating wind turbines. Hundreds of thousands of bats are estimated to die at wind turbines annually in North America. Operational minimization, which includes feathering turbine blades and curtailment, has been documented to reduce bat fatality effectively. Curtailment refers to altering turbine operation based on wind speed, time of year, temperature, sensors, and activity models. However, when turbines are curtailed, they do not generate power, resulting in energy loss and revenue for wind energy facilities. The Electric Power Research Institute (EPRI) funded the development of Turbine Integrated Mortality Reduction (TIM SM ) Technology, which curtails turbine operation when bats are detected. The initial TIMR system research showed promising results, with an 85% reduction in overall bat fatalities and a 91% reduction for the little brown bat. However, these results were based on a single site during one fall season, and it was unclear if similar results could be replicated at other wind energy facilities. This research aimed to validate the TIMR system results from the prior field study at a second site in the U.S., estimate the power production and reduction in bat mortality at turbines with installed TIMR systems relative to blanket curtailment and fully operational turbines, test the TIMR system in two calendar years and during the summer and fall periods, and evaluate the operational and commercial characteristics of the TIMR system for potential wind industry adoption. The study was conducted at a 500.9-MW wind energy facility in southeast Adair County, Iowa. Three experimental treatments were involved in this randomized block design study: TIMR, Curtailment at 5.0 m/s, and Normal Operation. In 2021, three treatments were used at 18 turbines, expanding to four treatments across 36 turbines in 2022. The TIMR system worked as designed throughout the entire study; however, because of unexpected wind turbine operational challenges in 2021, there was not sufficient sample size to evaluate the treatment differences. In 2022, there were significant differences in fatality levels between treatment types and normal operating turbines. Curtailment at 5.0 m/s reduced fatalities by 30.8% compared to normal operations, and TIMR decreased fatalities by 48.6% compared to normal operations. Two different methods were used to evaluate the differences in energy loss for each treatment. The TIMR system resulted in 1.3% to 1.6 % annual energy loss in 2021 and 1.0% to 1.2 % in 2022. The Curtailment at 5.0 m/s resulted in 0.6% to 0.8 % annual energy loss in 2021 and 0.5% to 0.6 % in 2022. The project achieved all the stated objectives and demonstrated that TIMR is an effective technology that balances bat fatality reduction with energy generation. The results will support the deployment of TIMR and other acoustic sensor-based technologies. The research provides valuable insights into the impact of different treatments on fatality rates and energy outputs, contributing to the ongoing efforts to mitigate the environmental impact of wind energy.

17 WIND ENERGY↗
DOE OSTI2024

Assessment of Machine Learning for Ultrasonic Nondestructive Evaluation of Alkali–Silica Reaction in Concrete

Alkali–silica reaction (ASR) is a type of material degradation in concrete structures that leads to concrete cracking and rebar corrosion, thereby reducing the material’s structural integrity and the overall structure’s lifetime and raising safety concerns. Ultrasonic nondestructive evaluation (NDE) has been proven to be a valuable technique for assessing concrete properties and monitoring ASR progression in concrete. However, the deployment and analysis of ultrasonic NDE and its data requires specialized expertise, often relying on the engineer’s subjective interpretation. With the surge in computational power, artificial intelligence (AI) and machine learning (ML) algorithms have become popular in automating NDE data analysis. Various industrial sectors are increasingly adopting ML algorithms for NDE data analysis with a growing emphasis on AI–assisted automation. Regulatory agencies are also preparing for this technological shift, anticipating corresponding revisions in standards. Thus, there is an urgent need to identify the capabilities and limitations of current ML technologies for the evaluation of concrete material properties and damage status. Furthermore, the effects of various factors on ML model performance must be thoroughly investigated. The study summarized herein evaluated the effectiveness of two ML models (i.e., support vector regression (SVR) and deep neural network (DNN)) in predicting concrete material damage induced by ASR based on the long-term ultrasonic monitoring data. Four distinct concrete specimens were cast with artificially induced ASR, and over a period exceeding 500 days, ultrasonic signals and expansion data were continuously collected. For the SVR model, wave velocity and 12 other wave features were extracted from the ultrasonic signals, with 6 out of 13 features selected as input for the model. Different combinations of training and testing datasets were designed to explore factors influencing prediction performance, including the range of data within training and testing sets, in addition to various signal preprocessing methodologies. These findings suggest the importance of using a training dataset with a broader data range compared with testing datasets for improved model performance alongside consistent signal preprocessing across datasets.

36 MATERIALS SCIENCE↗
DOE OSTI2024

​​Integrity Enhancing Protocols (IEP) Evaluation Framework​

​Protocols play an essential role in Advance Reactor systems. A diverse set of protocols are available to these reactors. Advanced Reactors benefit from technologies that can minimize their resource utilization and costs. Evaluation frameworks are often used when assessing protocols and processes related to cryptographic security systems. The following report discusses the various characteristics associated with these protocol evaluation frameworks, and derives a novel evaluative framework.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

High Temperature Component and Data Link Evaluation

Evaluation of high temperature (HT) microcontrollers for Geothermal applications. The goal was to evaluate the limited microcontrollers capable of operating above 200 degrees Celsius. The knowledge obtained from this research has been documented for contributing to future development of high temperature geothermal tools. Along with this research, a HT data link for communications was developed and evaluated, also for HT geothermal tools.

15 GEOTHERMAL ENERGY↗
DOE OSTI2024

Chlorine Nuclear Data Evaluation Aided Through New LANSCE Measurements

The collaboration between the Los Alamos National Laboratory Neutron Science Center (LANSCE) and TerraPower LLC enables the enhanced understanding of fast spectrum critical systems consisting of chlorine. Specifically, TerraPower is interested in updating the nuclear data for the stable isotopes of chlorine, 35 Cl and 37 Cl, because these nuclides are the primary constituents of the chloride fuel salt in the Molten Chloride Reactor Experiment (MCRE), for which TerraPower is leading the design. The Cooperative Research and Development Agreement (CRADA) between the parties is funded by DOE’s Office of Nuclear Energy’s Gateway for Accelerated Innovation in Nuclear (GAIN) initiative to provide the nuclear community with access to the technical, regulatory, and financial support necessary to motivate innovative nuclear reactor technologies toward commercialization. New measurements of 35 Cl(n,p total ) and 35 Cl(n,α total ) were completed at LANSCE to constrain the reaction theory models that are used to generate the updated evaluations. The updated evaluations were then tested across the sensitivities of the MCRE by TerraPower to provide direct feedback to the evaluation for application specific sensitivities.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2024

2023 Reftek Wrangler Digitizer Type Approval Evaluation

Sandia National Laboratories has tested and evaluated the Reftek Wrangler digitizer. The Wrangler digitizers are intended to record sensor output for seismic and infrasound monitoring applications. The purpose of this digitizer evaluation is to measure the performance characteristics in such areas as power consumption, input impedance, sensitivity, full scale, self-noise, dynamic range, system noise, response, passband, and timing. The Wrangler digitizers are being evaluated for potential use in the International Monitoring System (IMS) and On-site Inspection (OSI) components of Comprehensive Nuclear-Test-Ban Treaty (CTBT).

58 GEOSCIENCES↗
DOE OSTI2024

Optimization and Evaluation of Energy Savings for Connected and Autonomous Off-Road Vehicles

Off-road vehicles, such as wheel loaders, excavators, and harvesters, are extensively utilized across a wide range of industries, including construction, agriculture, and mining. These machines have become indispensable in supporting the day-to-day operational needs of a nation, playing a critical role in various sectors' infrastructure and productivity. However, despite their utility, off-road vehicles are significant consumers of fossil fuels, resulting in substantial emissions that contribute to environmental degradation. This highlights the pressing need for research and technological advancements aimed at improving their energy efficiency and reducing their carbon footprint. There are, however, two primary challenges that must be addressed to achieve these goals. First, off-road vehicles typically perform both driving and working tasks simultaneously, which introduces a high level of complexity into their overall dynamic systems. Analysis the interactions between these functions is challenging. Second, research into off-road vehicles is inherently interdisciplinary, demanding expertise across several domains such as fluid power systems, vehicle dynamics, control theory, optimization techniques, and real-world implementation. Recognizing these challenges, we proposed the project titled "Optimization and Evaluation of Energy Savings for Connected and Autonomous Off-Road Vehicles" as a comprehensive solution to enhance fuel efficiency while simultaneously improving productivity. This project specifically focuses on autonomous off-road vehicles, with particular attention to wheel loaders, and seeks to develop novel methods to optimize energy consumption without sacrificing operational performance. The project integrates real-time control algorithms, vehicle dynamics modeling, and co-optimization of powertrain system and vehicle system to achieve these goals. Our optimization strategy dynamically co-optimizes critical parameters at both the powertrain and vehicle levels, including vehicle speed, working tool movements, powertrain dynamics, and engine operations in real-time. To streamline this optimization process, we developed a vehicle model that captures the key dynamics while significantly enhancing computational efficiency. This allows the system to intelligently minimize fuel consumption, all while maintaining or even improving productivity through real-time calculations during various off-road operations. To validate the effectiveness of this energy optimization method, we introduced a state-of-the-art Hardware-in-the-Loop (HIL) testbed. This reconfigurable testbed seamlessly integrates the actual engine with virtual models of the wheel loader's subsystems, allowing for accurate emulation of real-world operational loads and environments. By simulating these conditions, the HIL testbed enables us to evaluate the wheel loader’s performance under diverse working scenarios, ensuring the developed solution is applicable in real-world operations. This testbed proved to be instrumental in validating the optimization algorithms and demonstrating the system's practical effectiveness. During the evaluation and testing phase, we employed the HIL testbed to rigorously assess the energy savings and productivity improvements generated by the optimized system. The results were highly encouraging, revealing that the automated wheel loader achieved over 30% fuel savings compared to traditional, human-operated cycles, with comparable or even enhanced levels of productivity. The insights gained from this HIL-based testing provided critical validation of our approach and highlighted the potential for deploying these optimized autonomous technologies in real-world off-road vehicles.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2023

Evaluation of printability methodologies and feasibility to down select LBPF steel and other materials for nuclear applications

In this work, new research is underway to produce alloys beyond well-known alloys with modified compositions that are better suited to be produced with additive manufacturing. These alloys can only possess improved radiation tolerance but also improved high temperature strength, creep resistance while also using elements that reduce the amount of activation after irradiation. This work package supports the vision and goals of the Advanced Materials and Manufacturing Technology (AMMT) program relevant to accelerate the development and deployment of advanced manufacturing processes. This work focuses on evaluating the methodology for designing alloys best suited for AM processes based on “printability”, literature research to evaluate and down select steel alloy systems. In this work, microstructural characterization and testing activities have been performed on certain steel alloys to support the efforts from collaborating laboratories during the evaluation and printing of the test articles. The final recommendation will be performed by all four participating laboratories.

316L↗
DOE OSTI2023

A section 110 evaluation of the 10,500-foot blast line civil effects structures and military trenches associated with the apple-2 test, area 1, nevada national security site, nye county, nevada

The U.S. Department of Energy, National Nuclear Security Administration Nevada Field Office (NNSA/NFO) has tasked Desert Research Institute (DRI) with identifying and evaluating additional resources that contribute to the significance of the Apple-2 Historic District as part of a Section 110 effort. Apple-2 was a 1955 atmospheric test in which the Federal Civil Defense Administration (FCDA) conducted an extensive civil effects program named Operation Cue. The objective of Operation Cue was to understand the blast and thermal effects of the test by using a simulated community of residential buildings, industrial structures, utilities, and commercial equipment arranged at various distances from ground zero (GZ). Military operations conducted by the Department of Defense (DoD) as part of the Desert Rock VI exercise were also associated with the Apple-2 test. The Apple-2 Historic District was originally defined in 2000 by Johnson and Edwards as 15 highly visible contributing elements dispersed across the landscape. Since its original recording, DRI has conducted additional archival research and this report details the identification and evaluation results of testing-related material remains at a distance of 10,500 ft from the Apple-2 GZ. Between 2017 and 2020, DRI conducted fieldwork at 10,500 ft from the Apple-2 GZ, revisited previously recorded contributing elements, and identified and evaluated newly recorded resources associated with Operation Cue as well as DoD operations. In total, DRI revisited or newly identified 15 principal resources. Of these, 13 are located within the historic district and contribute to the district’s significance. A set of military trenches and the associated material remains are discontiguous from the district, but also contribute to the district’s significance.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

2023 Reftek Colt Seismometer Exploratory Evaluation

Sandia National Laboratories has tested and evaluated three Colt broadband seismometers designed and manufactured by Reftek. The purpose of this seismometer evaluation is to measure performance characteristics in areas such as power consumption, sensitivity, frequency response, full scale, self-noise, dynamic range, calibration system response, and passband. The Colt model of sensors are being evaluated to explore the potential for a future seismometer Type Approval process in the International Monitoring System (IMS) of the Comprehensive Nuclear-Test-Ban Treaty (CTBT).

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Tables of Neutron Thermal Cross Sections, Westcott Factors, Resonance Integrals, Maxwellian Averaged Cross Sections, Astrophysical Reaction Rates, and r-process Abundances Calculated from the ENDF/B-VIII.1, JEFF-3.3, JENDL-5.0, BROND-3.1, and CENDL-3.2 Evaluated Data Libraries

We present calculations of neutron thermal cross sections, Westcott factors, resonance integrals, Maxwellian-averaged cross sections, astrophysical reaction rates, and solar system r-process abundances using the latest data from the major evaluated nuclear libraries for 849 ENDF target materials. The recent release of ENDF/B-VIII.1 library, progress in 252 Cf(SF) evaluation, extensive analysis of newly-evaluated neutron reaction cross sections, neutron covariances, and improvements in data processing techniques motivated us to calculate the nuclear industry and neutron physics parameters, produce s-process Maxwellian-averaged cross sections and astrophysical reaction rates, extract r-process abundances, systematically calculate uncertainties, and provide additional insights on currently available neutron-induced reaction data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Enabling Evaluation of a Southern Company Distribution Feeder on NREL ADMS Test Bed: Cooperative Research and Development (Final Report)

The objective of this project is to enable evaluation of a Southern Company distribution feeder on the Advanced Distribution Management System (ADMS) test bed. The long-term goal is to evaluate a federated distributed energy resource (DER) management solution that aggregates DERs through either direct control, transactive control or an aggregator to provide bulk services while observing distribution system voltage and power constraints. The DER aggregation needs to be coordinated with an ADMS that is responsible for reliable power delivery across the distribution systems. This project takes the first step towards enabling such evaluation by deploying an ADMS from Oracle (Southern Company's ADMS supplier) with a Southern Company feeder at NREL.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Evaluation of the Self Retrieval Augmented Generation Technique on Common Security Advisory Framework Data

This small experimental report evaluates a variation of Retrieval Augmented Generation (RAG), called Self-RAG. This method uses a generative language model that incorporates retrieved facts into its generation and is explicitly trained to be able to determine whether retrieved information is enough to answer the input query, with a user-defined threshold for confidence. We performed an experiment using data from the publicly available CISA Common Security Advisory Framework (CSAF) repository (https://github.com/cisagov/CSAF) as the database of facts to be used in retrieval. Qualitative results from the experiment demonstrate that the Self-RAG method has some ability to provide reasonable answers to queries that are in the dataset and will often ignore irrelevant information when asked outside of domain questions (e.g., general facts). In settings with deliberately confusing questions (the question is within domain, but asks about a fabricated advisory), it was able to refuse 40% of the time without further adjustments to the original framework. While this performance is not sufficient for current practical use, further improvements to data formatting, disambiguating results, and leveraging threshold values could improve performance significantly. However, evaluating this will require more extensive evaluations on larger datasets and potentially better models.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Evaluation of Pozzolan-substituted Cast Stone for Pretreated Hanford Tank Waste

Portland cement. The future availability of quality Class F fly ash has come into question as coal-fired power plants are being converted to gas or taken offline. Consequently, alternative pozzolanic reagents are being evaluated for fly ash replacement in cementitious matrices for treating radioactive waste and debris. In 2023 and 2024, Savannah River National Laboratory (SRNL) was funded to evaluate natural pozzolans for the replacement of Class F fly in the Savannah River Site (SRS) Saltstone formulation. Based on the promising results and uncertain availability of Class F fly ash in the northwestern US, Hanford Tank Waste Operations & Closure, LLC (H2C) requested SRNL to evaluate the potential for substituting natural pozzolans in the Hanford West Area Pretreated Low Activity Tank Waste (PTW/LAW) Cast Stone formulation1 . Task 1 in this request was to determine the change in Cast Stone volume resulting from stabilization/solidification of 1 L of PTW/LAW tank waste. The densities of three (Hess Pumice, tephra pumice, and clinoptilolite zeolite) pozzolan-substituted Baseline Cast Stone mixes were determined, and volume changes relative to the fly ash-Baseline Mix with a water-to-dry mix = 0.40 were calculated.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

ORNL FY2024 Nuclear Data Evaluation Contributions: Cu, La, N, and Ta [Slides]

63,65 Cu angular distributions resolved for ENDF/B-VIII.1, consistent with both differential data and integral benchmark performance. 139 La RRR and URR evaluations will be merged with the LANL high energy evaluation, and to be submitted to the future ENDF-B release (post-VIII.1). 14 N RRR evaluation is planned to produce n+ 14 N, p+ 14 C, and a+ 11 B contributions to be submitted to the future ENDF-B release (post-VIII.1). 181 Ta covariances repaired and reported as intended in an errata to ENDF/B-VIII.1.

139-La↗
DOE OSTI2025

Evaluation of LLM-Generated Kokkos Code Using Compile-Time and Run-Time Testing

Due to the growing use of large language models (LLMs) by developers and researchers, it has become essential to reliably evaluate their ability to generate code that uses specialized libraries. We explore the use of compile-time and run-time evaluation of LLM-generated Kokkos code through extending the methods used by OpenAI with the HumanEval dataset. Our evaluation framework is based on the first 40 prompts from the Kokkos138 dataset. We start by discussing two different forms of LLM prompting, using entirely plain English or providing pseudocode for added context. These two methods are used to generate Kokkos code with the Llama-3.1-8B-Instruct and CodeQwen1.5-7B-Chat models. We found that both forms of prompting led to high failure rates and difficulties with reliably parsing LLM-generated code, while prompts with pseudocode for context generally led to improved results on more complicated tests.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Long-Term Evaluation of Remedial Technology Performance in the Laboratory: Multi-year Experimental Test Plan

An understanding of the long-term effectiveness of remediation technologies is central to sustainable environmental cleanup. Long-term experiments are valuable for reducing uncertainty and predicting remediation outcomes at scales required for regulatory compliance. However, these types of tests can be costly and challenging to interpret. Therefore, contaminated sites often rely on short-term laboratory experiments that may not account for the potentially significant effects of gradual, time- dependent processes governing contaminant retention, release, and species transformation. For example, short-term lab experiments (from months to a year) conducted with sediments from the unsaturated and saturated zones at the Hanford Site play an important role in initial evaluations of remediation technologies but cannot capture the full extent of time-dependent reactions, leaving uncertainties in field-scale deployment. Here, long-term testing will be conducted on select technologies based on their performance in short-term testing. The overall objective is to directly address the challenges described above by generating and analyzing data on long-term (2–10 years) efficacy of selected remediation technologies, integrating this understanding into models, and providing critical input for remediation planning, monitoring, and 5-year review cycles for field-implemented remedies. Specific objectives include: 1. Evaluating long-term efficiency of promising remedies under site-specific conditions. 2. Generating robust parameters for modeling, reducing uncertainty in predictive simulations. 3. Advancing integrated monitoring by combining geochemical and geophysical observations. 4. Informing field-scale implementation by incrementally advancing technologies, identifying failure mechanisms early, and prioritizing robust, cost-effective remedies. Through systematic evaluation of technologies in laboratory-scale column experiments, integrated monitoring, and modeling support, this project is designed to bolster confidence in the long-term robustness of selected technologies. The ultimate outcome is the identification and deployment of more reliable, cost-effective remedies that safeguard human health and the environment while reducing the uncertainties that have historically hindered cleanup progress at Hanford Site. An experimental approach was developed and initiated for long-term testing potentially up to 10 years. The table below summarizes the experimental approach developed for testing select technologies and presented in this multi-year experimental test plan.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Optimizing Alabama’s CO 2 Storage in Shelby County (Project OASIS) Milestone 6.0: Evaluation of Class VI Readiness

Introduction. Project OASIS is approximately 30 miles southeast of Birmingham, Alabama, and approximately 5 miles north-northwest of Alabama Power Company's Plant Gaston. Geologically, the Project area is in the Alabama fold and thrust belt province. This work builds on the initiatives of the Southeast Regional Carbon Utilization and Storage Acceleration Partnership (SECARB-USA, DE-FE0031830) that identified nearly 500 million metric tonnes of CO 2 emitted on an annual basis that is not collocated with prospective storage geology (the Coastal Plain of the Southeastern US in this context). This observation suggests costly investments in connective infrastructure (e.g., pipelines) or exploratory well drilling campaigns to identify CO 2 storage opportunities in under explored areas. While not traditionally thought of for saline storage, these studies suggest that storage prospects in the Valley and Ridge Province occur in relatively flat lying structural panels between thrust faults. For the Project OASIS region, available geologic studies related to hydrocarbon exploration suggest that Cambro-Ordovician carbonates and Cambrian clastic units offer multiple potential storage intervals, and that regional confining systems are present, such as the tectonically thickened Floyd-Parkwood Shale. The Project OASIS surface property is owned by a timber and land stewardship company, The Westervelt Company, Inc., who worked with the Project Team to select and prepare adequate sites for geologic assessment. The purpose of drilling the Westover Stratigraphic Test Well #2 was to collect geologic data to model the feasibility of commercial scale CO 2 injection and storage in an under explored region. This initiative benefits the regions emitters as the data generated from this study can inform their own internal decision making. The field program included geological and geophysical evaluations, reservoir engineering analyses, and risk assessments. This report evaluates existing data, as well as a variety of modeling scenarios to evaluate project readiness. Importantly, the impact of this study is not limited to Alabama as there are numerous large emitters throughout Appalachia, in similar geologic settings, contemplating their decarbonization options.

20 FOSSIL-FUELED POWER PLANTS↗