Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “EVALUATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Data for Clumping Index Estimation With 30°-tilted Cameras in Row Crops: Evaluation of Methods and Segment Size Effects

The clumping index (CI) quantifies the spatial distribution of foliage elements and is essential for accurately estimating the plant area index (PAI), canopy radiative transfer, and photosynthesis. Traditionally, the finite-length averaging method (LX), the gap size distribution method (CC), and a combined approach of CC and LX (CLX) have been applied to instruments like TRAC and digital hemispherical photography to estimate CI. However, a comprehensive evaluation of these methods in row crops remains limited, especially regarding the influence of segment size on CI. Meanwhile, digital cameras offer a cost-effective and user-friendly solution for canopy measurements in row crops, yet their application in this context remains underexplored. In this study, we employed a new approach using a 30°-tilted digital camera to estimate CI in corn and soybean fields, applying the LX, CC, and CLX methods. We systematically assessed the performance of these three methods by combining field measurements in real-world fields with simulations using the LESS 3D radiative transfer model. Our results showed that CLX applied to the whole image and 45° segment offered accurate estimation of CI (bias within ±0.1, RMSE < 0.2) and PAI (bias within ±0.4, RMSE < 1) in real-world fields and LESS simulations. The accuracy of the LX method was highly sensitive to segment size, with the best performance observed at the 15° segment (PAI bias within ±0.4). In contrast, the CC method remained stable across different segment sizes, and its performance was generally comparable to that of LX, except at the 15° segment. Across view zenith angles, CI derived from CC generally showed a continuous increase, while those from LX and CLX followed a rising trend at small zenith angles but began to decline at 68°, likely due to an increasing proportion of no-gap segments. Seasonally, LX tended to show decreasing CI during early growth stages but increased as the canopy matured, whereas CC and CLX showed gradually increasing CI before plateauing at peak PAI. The 30°-tilted camera effectively captured CI variations across different angles and growth stages, making it a practical and robust instrument for row crop canopy structure analysis. Applying these CI methods to digital cameras offers a low-cost and accessible CI estimation alternative, improving canopy structure monitoring accuracy in row crops.

Modeling↗

Evaluation of accuracy and resolution of the electron beam profile scanner at the Fermilab Main Injector

The objective of this work is to assess the accuracy of measurements made by the Electron Beam Profile Scanner (EBPS), which captures the trajectory of an electron beam with and without a proton beam present. The proton beam induces deflection in the electron beam, which is influenced by proton charges.For high-resolution images, the probe beam needs to be of high intensity, small diameter, and small divergence, evaluated using a YAG screen and an optical transition radiation (OTR) screen. Additionally, the point spread function (PSF) will be calculated to characterize the optical system's properties using ZEMAX software. The capabilities of the Hamamatsu Charge-Injection Device (CID) camera and Kimball Physics electron gun (e-gun) will be considered for accuracy.

Mwaniki, Matilda [IIT, Chicago; Fermilab]↗

Evaluate data lake design for the accelerator control system

Increasing precision in automation for modern particle accelerators not only creates a requirement to gather data from all devices but also demands scalable and high-performance data infrastructure with the capability of handling vast incoming device data. A well architected data lake is suitable for such a system which integrates real-time data acquisition, transient data caching, and long-term storage. This paper evaluates data lake architecture for an Accelerator Control System (ACS), focusing on two critical components of a data lake, data cache and long-term storage.

Jaikar, Amol [Fermilab]↗

Evaluating the Impact of Residential Solar Contract Cancellations in the United States

The residential solar photovoltaic (PV) market in the United States is growing, despite frequent customer cancellations. Contract cancellations result in lost time and costs that must be borne by installers, often in the form of higher "soft costs" (i.e., non-equipment costs). These costs are often passed on to customers who successfully install PV systems. To date, few studies have attempted to estimate national cancellation rates or model the impacts on installed system costs. In this report, we utilize an installer-provided dataset of 199,665 residential PV-only projects representing about 10% of U.S. installs each year from 2017-2019. With this data, we evaluate cancellation rates and trends from contract signing to install. Next, by leveraging NREL's soft cost model for residential solar, we estimate installer spending through each phase of the pre-install process. Applying our findings on cancellation timelines and rates, we then estimate the potential cost impacts to successful installs from contract cancellations. Our work suggests that the rates and impacts of contract cancellations have been previously underestimated. Namely, we find that cancellations/unsuccessful project are; more common than previous estimates suggest; occur earlier in project timelines, though a significant number happen even after permit/ATB approvals; and contribute significantly to customer acquisition and other soft costs. We also find that cancellation do not appear to be driven by review delays in permitting and interconnection applications.

14 SOLAR ENERGY↗

Update on 17 O evaluation and fast neutron evaluation for 181 Ta [Slides]

Reliable fast-neutron evaluation can be entirely encapsulated in the reaction model and related input. Ta181 is a particularly relevant case due to extraordinary coverage of various observables by differential experiments that offer much help and relatively little headache. Differences from the similar ENDF/B-VIII evaluation are as follows: more advanced modeling (CC OMP, MSD, MSC, decay schemes), more careful selection of models and parameters, new experimental data, and isomers. Overall, there is improved agreement with differential data and hints of better performance in integral testing.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

An Evaluation of Energy Storage Cost and Performance Characteristics

The energy storage industry continues to expand globally as costs continue to fall and opportunities in consumer, transportation and grid applications are defined. As the rapid evolution of the industry continues, it has become increasingly important to understand how varying technologies compare in terms of cost and performance. This paper defines and evaluates cost and performance parameters of six battery energy storage technologies (BESS) - lithium-ion batteries, lead-acid batteries, redox flow batteries, sodium-sulfur batteries, sodium metal halide batteries, and zinc-hybrid cathode batteries - four non-BESS storage technologies - pumped storage hydropower, flywheels, compressed air energy storage, and ultracapacitors - and combustion turbines. Cost and performance information was compiled based on an extensive literature review, conversations with vendors and stakeholders, and costs of systems procured at sites across the United States. Detailed cost and performance estimates are presented for 2018 and projected out to 2025. Annualized costs were also calculated for each technology.

Mongird, Kendall↗

Pyrotechnic hazards classification and evaluation program. Phase 3, segments 1-4: Investigation of sensitivity test methods and procedures for pyrotechnic hazards evaluation and classification, part A

The findings, conclusions, and recommendations relative to the investigations conducted to evaluate tests for classifying pyrotechnic materials and end items as to their hazard potential are presented. Information required to establish an applicable means of determining the potential hazards of pyrotechnics is described. Hazard evaluations are based on the peak overpressure or impulse resulting from the explosion as a function of distance from the source. Other hazard classification tests include dust ignition sensitivity, impact ignition sensitivity, spark ignition sensitivity, and differential thermal analysis.

Source record↗

Evaluation of coated columbium alloy heat shields for space shuttle thermal protection system application. Volume 2, phase 2: Subsize heat shield and small size TPS evaluation

Initially a trade study was conducted of seven heat shield configurations. These were evaluated for structural reliability, fabricability, weight, inspectability, and refurbishability. Two concepts, a tee-stiffened and an open corrugation, were selected as offering the most potential for system success. Fourteen subsize heat shields of a full scale section were fabricated from C-129Y and Cb-752 and silicide coated with R-512E. These subsize panels were subjected to a simulated flight profile representing temperature, local surface pressures, and applied pressure differential loads. All corrugated panels of both alloys sustained 100 cycles without structural or coating failure. All Cb-752/R-512E panels performed well with one panel being successfully repaired after 66 cycles and completing 100 cycles. As a result of this evaluating the Cb-752/R-512E system was selected for hardware application during the subsequent phases. In addition, the tee-stiffened configuration was selected for further development and application in Phase III. This selection was based on an overall assessment of relative weight, cost, and structural performance of the tee-stiffened and open corrugation TPS.

Black, W. E.↗

Technical evaluation report of AGARD Technical Evaluation Meeting on Unsteady Aerodynamics: Fundamentals and Applications to Aircraft Dynamics

From May 6 to 9, 1985, the Fluid Dynamics Panel and Flight Mechanics Panel of AGARD jointly arranged a Symposium on Unsteady Aerodynamics-Fundamentals and Applications to Aircraft Dynamics at the Stadthall, Goettingen, West Germany. This Symposium was organized by an international program committee chaired by Dr. K. J. Orlik-Ruckemann of the Fluid Dynamics Panel. The program consisted of five sessions grouped in two parts: (1) Fundamentals of Unsteady Aerodynamics; and (2) Applications to Aircraft Dynamics. The 35 papers presented at the 4 day meeting are published in AGARD CP 386 and listed in the Appendix. As the papers are already available and cover a very wide field, the evaluators have offered brief comments on every paper, followed by an overall evaluation of the meeting, together with some general conclusions and recommendations.

Mabey, D. G.↗

Evaluation of Robotic Systems to Carry Out Traverse Execution, Opportunistic Science, and Landing Site Evaluation Tasks

This report covers the execution of and results from the activities proposed and approved in Exploration Analogs and Mission Development (EAMD) Field Test Protocol HMP2010: Evaluation of Robotic Systems to carry out Traverse Execution, Opportunistic Science, and Landing Site Evaluation Tasks. The field tests documented in this report examine one facet of a larger program of planetary surface exploration. This program has been evolving and maturing for several years, growing from a broad policy statement with a few specified milestones for NASA to an international effort with much higher fidelity descriptions of systems and operations necessary to accomplish this type of exploration.

Hoffman, Stephen J.↗

Usability Evaluation Technical Report: A Usability Evaluation of the Communication Tool Prototype Prepared in Adobe XD for High Density Vertiplex (HDV) Team

Purpose: As cities get more crowded, the roadway infrastructure cannot keep up with the travel demands. Aviation can be a solution. Organizations supporting NASA’s Urban Air Mobility (UAM) concept are conducting studies on feasible concepts of operations for the new air traffic management system required to implement UAM. NASA’s High Density Vertiplex (HDV) team conducts studies using both live flights and simulations. Significance: The goal of this study is to evaluate the effectiveness of a communication tool developed for this team to enhance team situation awareness. Specifically, the study aims to determine if the communication tool is effective in allowing NASA-Langley and NASA-Ames team members playing different roles to understand what others are doing so that completed steps can be communicated to the whole team. Methods: This study asks participants to conduct four distinct scenarios using an Adobe XD prototype. Participants included five members of the target audience, who each received up to 15 minutes of training on how to use the Adobe XD prototype. The participants were NASA-Ames or NASA-Langley researchers, developers or tech leads who had 0 to 15 years of experience. Their ages ranged from 20 to 40 years old, and they were of both genders. After training, each participant was asked to do 4 tasks of varying difficulty, using the prototype testbed. After each task they reported on task difficulty and after all tasks were completed they were asked to fill out the System Usability Survey (SUS). Performance will be assessed through task completion time and accuracy rating. Results: User perception was evaluated by the SUS which showed a mean score over the six participants of 84. All the participants were above the acceptable range which was 70 and nobody was in the marginal usability zone between 50 and 70. In addition, most of the participants did well in terms of time on task, success rate and task difficulty on all the tasks except for Task 3. Participants had two minutes to do the task correctly to succeed at the task, otherwise it was marked as a failure. The geomean for Task 1 for completion time was 22.20; Task 2 was 58.28; Task 3 was 84.68 and Task 4 was 19.61. In Task 3, three out of six people failed this task but all five scored this with an average score 4.2 out of 5 for self-rating on task difficulty.

human factors↗

Status of the CERBERUS Evaluation for the International Criticality Safety Benchmark Evaluation Project (ICSBEP) Handbook

Modeling & Simulation (M&S) tools are used to analyze advanced reactor designs and the safety of current nuclear operations. As computers continue to improve, we are able to enhance resolution in our calculations. Therefore, the limitations of simulation capability are in the quality of data that is being used, including our ability to quantify the uncertainty and sensitivity of that data. In order to model systems of interest with increasing accuracy, the industry must improve key nuclear data measurements. The International Criticality Safety Benchmark Evaluation Project (ICSBEP) compiles and evaluates experiment data in a handbook that can be used by criticality safety engineers and others to validate computer codes and cross section libraries at nuclear facilities. Both critical and subcritical experiments are included in the handbook. These experiments, along with differential measurements, can help improve the quality of nuclear data. Concerns regarding the accuracy of Cu nuclear data have been published. The large values and trend of C-E for the Zeus intermediate energy benchmark, being one of the primary examples. Furthermore, very few experiments have been designed to be sensitive to Cu (as shown in Figure 1), so an integral, critical experiment is needed to help resolve these differences.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Evaluation of riverbed magnetic susceptibility for mapping biogeochemical hot spots in groundwater‐impacted rivers

Abstract Redox hot spots occurring as metal‐rich anoxic groundwater discharges through oxic wetland and river sediments commonly result in the formation of iron (Fe) oxide precipitates. These redox‐sensitive precipitates influence the release of nutrients and metals to surface water and can act as ‘contaminant sponges’ by absorbing toxic compounds. We explore the feasibility of a non‐invasive, high‐resolution magnetic susceptibility (MS) technique to efficiently map the spatial variations of magnetic Fe oxide precipitates in the shallow bed of three rivers impacted by anoxic groundwater discharge. Laboratory analyses on Mashpee River (MA, USA) sediments demonstrate the sensitivity of MS to sediment Fe concentrations. Field surveys in the Mashpee and Quashnet rivers (MA, USA) reveal several discrete high MS zones, which are associated with likely anoxic groundwater discharge as evaluated by riverbed temperature, vertical head gradient, and groundwater chemistry measurements. In the East River (CO, USA), widespread cobbles/rocks exhibit high background MS from geological ferrimagnetic minerals, thereby obscuring the relatively small enhancement of MS from groundwater induced Fe oxide precipitates. Our study suggests that, in settings with low geological sources of magnetic minerals such as lowland rivers and wetlands, MS may serve as a complementary tool to temperature methods for efficiently mapping Fe oxide accumulation zones due to anoxic groundwater discharges that may function as biogeochemical hot spots and water quality control points in gaining systems.

Wang, Chen↗

Evaluation of Extreme Weather Impacts on Utility-scale Photovoltaic Plant Performance in the United States

The global energy system is undergoing significant changes, including a shift in energy generating technologies to more renewable energy sources. However, the dependence of renewable energy sources on local environmental conditions could also increase disruptions in service through exposures to compound, extreme weather events. By fusing three diverse datasets (operations and maintenance tickets, weather data, and production data), this analysis presents a novel methodology to identify and evaluate performance impacts arising from extreme weather events across diverse geographical regions. Text analysis of maintenance tickets identified snow, hurricanes, and storms as the leading extreme weather events affecting photovoltaic plants in the United States. Statistical techniques and machine learning were then implemented to identify the magnitude and variability of these extreme weather impacts on site performance. Impacts varied between event and non-event days, with snow events causing the greatest reductions in performance (54.5%), followed by hurricanes (12.6%) and storms (1.1%). Machine learning analysis identified key features in determining if a day is categorized as low performing, such as low irradiance, geographic location, weather features, and site size. The analysis improves our understanding of compound, extreme weather event impacts on photovoltaic systems, which can inform planning activities, especially as the industry continues to expand into new geographic and climatic regions around the world.

14 SOLAR ENERGY↗

Evaluation of darunavir-derived HIV-1 protease inhibitors incorporating P2' amide-derivatives: Synthesis, biological evaluation and structural studies

Here, we report here the synthesis and biological evaluation of darunavir derived HIV-1 protease inhibitors and their functional effect on enzyme inhibition and antiviral activity in MT-2 cell lines. The P2' 4-amino functionality was modified to make a number of amide derivatives to interact with residues in the S2' subsite of the HIV-1 protease active site. Several compounds exhibited picomolar enzyme inhibitory and low nanomolar antiviral activity. The X-ray crystal structure of the chloroacetate derivative bound to HIV-1 protease was determined. Interestingly, the active chloroacetate group converted to the acetate functionality during X-ray exposure. The structure revealed that the P2' carboxamide functionality makes enhanced hydrogen bonding interactions with the backbone atoms in the S2'-subsite.

59 BASIC BIOLOGICAL SCIENCES↗

Comparative evaluation of deep learning workloads for leadership-class systems

Deep learning (DL) workloads and their performance at scale are becoming important factors to consider as we design, develop and deploy next-generation high-performance computing systems. Since DL applications rely heavily on DL frameworks and underlying compute (CPU/GPU) stacks, it is essential to gain a holistic understanding from compute kernels, models, and frameworks of popular DL stacks, and to assess their impact on science-driven, mission-critical applications. At Oak Ridge Leadership Computing Facility (OLCF), we employ a set of micro and macro DL benchmarks established through the Collaboration of Oak Ridge, Argonne, and Livermore (CORAL) to evaluate the AI readiness of our next-generation supercomputers. In this paper, we present our early observations and performance benchmark comparisons between the Nvidia V100 based Summit system with its CUDA stack and an AMD MI100 based testbed system with its ROCm stack. We take a layered perspective on DL benchmarking and point to opportunities for future optimizations in the technologies that we consider.

Yin, Junqi↗