Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Average Accuracy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

A low-complexity non-intrusive approach to predict the energy demand of buildings over short-term horizons

Reliable, non-intrusive, short-term (of up to 12 hours ahead) prediction of a building's energy demand is a critical component of intelligent energy management applications. A number of such approaches have been proposed over time, utilizing various statistical and, more recently, machine learning techniques, such as decision trees, neural networks and support vector machines. Importantly, all of these works barely outperform simple seasonal auto-regressive integrated moving average models, while their complexity is significantly higher. Here, we propose a novel low-complexity non-intrusive approach that improves the predictive accuracy of the state-of-the-art by up to ~10%. The backbone of our approach is a K-nearest neighbours search method, that exploits the demand pattern of the most similar historical days, and incorporates appropriate time-series pre-processing and easing. In the context of this work, we evaluate our approach against state-of-the-art methods and provide insights on their performance.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

AI-Driven Crack Detection for Remanufacturing Cylinder Heads Using Deep Learning and Engineering-Informed Data Augmentation

Detecting cracks in cylinder heads traditionally relies on manual inspection, which is time-consuming and susceptible to human error. As an alternative, automated object detection utilizing computer vision and machine learning models has been explored. However, these methods often face challenges due to a lack of sufficiently annotated training data, limited image diversity, and the inherently small size of cracks. Addressing these constraints, this paper introduces a novel automated crack-detection method that enhances data availability through a synthetic data generation technique. Unlike general data augmentation practices, our method involves copying cracks from one location to another, guided by both random and informed engineering decisions about likely crack formations due to cyclic thermomechanical loads. The innovative aspect of our approach lies in the integration of domain-specific engineering knowledge into the synthetic generation process, which substantially improves detection accuracy. We evaluate our method’s effectiveness using two metrics: the F2 score, which emphasizes recall to prioritize detecting all potential cracks, and mean average precision (MAP), a standard measure in object detection. Experimental results demonstrate that, without engineering insights, our method increases the F2 score from 0.40 to 0.65, while maintaining a stable MAP. Incorporating detailed engineering knowledge further enhances the F2 score to 0.70 and improves MAP to 0.57, representing increases of 63% and 43%, respectively. These results confirm that our approach not only mitigates the limitations of traditional data augmentation but also significantly advances the reliability and precision of crack detection in industrial settings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Designing an Optimal LSST Deep Drilling Program for Cosmology with Type Ia Supernovae

The Vera C. Rubin Observatory's Legacy Survey of Space and Time (LSST) is forecast to collect a large sample of Type Ia supernovae (SNe Ia) expected to be instrumental in unveiling the nature of dark energy. The feat, however, requires accurately measuring the two components of the Hubble diagram, distance modulus and redshift. Distance is estimated from SN Ia parameters extracted from light-curve fits, where the average quality of light curves is primarily driven by survey parameters. An optimal observing strategy is thus critical for measuring cosmological parameters with high accuracy. We present in this paper a three-stage analysis to assess the impact of the deep drilling (DD) strategy parameters on three critical aspects of the survey: redshift completeness, the number of well-measured SNe Ia, and cosmological measurements. We demonstrate that the current DD survey plans (internal LSST simulations) are characterized by a low completeness (z ~ 0.55–0.65), and irregular and low cadences (several days), which dramatically decrease the size of the well-measured SN Ia sample. We propose a method providing the number of visits required to reach higher redshifts. We use the results to design a set of optimized DD surveys for SN Ia cosmology taking full advantage of spectroscopic resources for host galaxy redshift measurements. The most accurate cosmological measurements are achieved with deep rolling surveys characterized by a high cadence (1 day), a rolling strategy (at least two seasons of observation per field), and ultradeep (z ≳ 0.8) and deep (z ≳ 0.6) fields. A deterministic scheduler including a gap recovery mechanism is critical to achieving a high-quality DD survey.

79 ASTRONOMY AND ASTROPHYSICS↗

Why is My Zero Energy Home Not a Zero Carbon Home?

For years, carbon calculations were done very simply. The method of calculation was to take annual totals of energy consumption and multiply by an average emission factor, either for the grid serving a project or for a larger region (e.g. an EPA eGRID sub region). The level of accuracy of this approximation was reasonably good, although the issue of accuracy was not, to our knowledge, tested. And the data required were minimal – just a year’s worth of bills for each fuel and one lookup factor. But this method assures that a net zero energy home is automatically a net zero carbon home because zero times any possible emission factor is still zero. Starting in the early 2010s, things changed – grids were starting to rely more and more heavily on renewables, and the difference was showing up on aggregate load curves. This was perhaps noticed first in California, where aggressive renewable policies led to significant renewable power generation large enough to affect the overall shape of the diurnal load curve for the Independent Systems Operator.

14 SOLAR ENERGY↗

Empirical Validation of UBEM: An Assessment of Bias in Urban Building Energy Modeling for Chicago

Residential and commercial buildings currently account for 30% of total global final energy consumption. Urban-scale building energy modeling (UBEM) can enable scalable investments and unlock building improvements by quantifying energy, demand, emissions, and cost reductions of specific measures or packages for building-specific technologies in large geographic regions. While the sophistication of UBEM data sources and technologies have increased dramatically in the past decade, there remains a knowledge gap for empirical validation and sources of bias between building-specific energy models and measured data at varying geographic scales.As UBEM continues to develop, systemic analysis of accuracy, bias, and limitations of the resulting models is necessary to inform best practices and move toward standardization. These are characterized for the Automatic Building Energy Modeling (AutoBEM) software suite with an initial case study involving metered electricity consumption data from 247,188 buildings in Chicago, Illinois, USA - averaged across years 2019-2021 - compared to the following datasets: (1) the AutoBEM-generated nation-scale Model America version 2 (MAv2) data for 596,064 buildings, (2) tax assessor data for 579,829 buildings, (3) tax assessor data filled with MAv2, and (4) 102 representative dynamic archetypes. The accuracy is reported for every building type and vintage combination, along with multiple sources of bias for unique building descriptors. The AutoBEM simulation workflow produced energy consumption estimates that closely match aggregated metered electricity consumption data for different types of buildings constructed during various time periods at the city scale - with initial normalized mean bias error of 10.9%, and 1.1% after removing outliers. Contribution of statistically significant factors including building type, land use, age, and size to variance in UBEM bias is quantified.

Garg, Ankur↗

Benchmarking large language models for materials synthesis: The case of atomic layer deposition

In this work, we introduce an open-ended question benchmark, ALDbench, to evaluate the performance of large language models (LLMs) in materials synthesis, and, in particular, in the field of atomic layer deposition, a thin film growth technique used in energy applications and microelectronics. Our benchmark comprises questions with a level of difficulty ranging from the graduate level to domain expert current with the state of the art in the field. Human experts reviewed the questions along the criteria of difficulty and specificity, and the model responses along four different criteria: overall quality, specificity, relevance, and accuracy. We ran this benchmark on an instance of OpenAI’s GPT-4o. The responses from the model received a composite quality score of 3.7 on a 1–5 scale, consistent with a passing grade. However, 36% of the questions received at least one below average score. An in-depth analysis of the responses identified at least five instances of suspected hallucination. Finally, we observed statistically significant correlations between the difficulty of the question and the quality of the response, the difficulty of the question and the relevance of the response, the specificity of the question, and the accuracy of the response as graded by the human experts. Furthermore, this emphasizes the need to evaluate LLMs across multiple criteria beyond difficulty or accuracy.

Artificial intelligence↗

ISOCS-based Extended In Situ Gamma Spectrometry Services Tool SuperISOCS for Waste Measurements - 20275

Canberra's In Situ Object Counting System (ISOCS) is an established tool used for gamma spectrometry. It allows physical representation of complex geometries and mathematical calculation of the calibration function while avoiding the need for radioisotope standards. ISOCS provides a large range of templates to generate the geometry for most nuclear waste components in nuclear facilities. Nonetheless, there are some complex geometries where the accuracy attainable is limited by the conventional ISOCS templates. An ISOCS-based extended in-situ Gamma Spectrometry service tool has been developed, based on the so-called SuperISOCS (SISOCS) software. This tool was developed to generate the most complex geometries. The principle of geometry construction is based on the composition of 8 different primitive geometries. The primitive object is able to be cut and to change a part of an object. An object is able to overlap to another one to form a more complex object. These functions refine the modelled geometry compared to the real objects and decrease the measurement systematic error because they allow the mathematical model to represent the real-life geometry more faithfully through reducing the approximations and simplifications that need to be made The algorithm of SISOCS is the same as that of standard ISOCS. A set of calculations was done in comparison with MCNP efficiency calculation and SISOCS results. 80 different models were compared between SISOCS and MCNP, with added 30 cases compared between ISOCS and SISOCS. The average differences were less than 2%, for all energy's efficiency calculations. In this paper we illustrate the benefits that this new tool can provide, in terms of improved accuracy for complex realistic geometries, through simulation of some example scenarios. Furthermore, we demonstrate, through SISOCS modelling of the real object data test, the comparison between SISOCS to ISOCS calculations for the same geometry. This paper describes the added functions that are easily employed using SISOCS. Our results show the potential application and benefit of this technique for real waste assay projects and the way to integrate the tool into the waste assay systems. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Fading study of Harshaw LiF:Mg,Ti thermoluminescence dosimeters exposed to neutron doses

Sensitivity and signal fading were tested in Harshaw LiF:Mg,Ti thermoluminescence dosimeters (TLDs) exposed to neutron and beta/photons doses. A significant difference in the signal fading rate was observed for TLDs exposed to neutrons compared with TLDs exposed to betas. This difference may have been related to differences in glow curves for dosimeters exposed to different beams and to differences in glow curve evolution after exposure. A fading-correction algorithm was developed to correct the cumulative sensitivity + signal fading of TL doses for the fading time t using the formulae: y = 0.147∗exp(-t/4.36) + 0.308∗exp(-t/34.1) + 0.73 for neutrons, and: y = 0.132∗exp(-t/10.72) + 0.174∗exp(-t/31.5) + 0.8 for betas/photons. The formula was validated using the dose recovery test, where the average deviation of fading-corrected doses from delivery doses was within 1%. In conclusion, the proposed fading-correction approaches may significantly improve the accuracy of Harshaw TL dosimetry with LiF:Mg,Ti cards for both neutron and beta/gamma irradiation.

61 RADIATION PROTECTION AND DOSIMETRY↗

Thermodynamics of the Metal Carbonates and Bicarbonates of Mn, Co, Ni, Cu, and Zn Relevant to Mineral Energetics

The gas phase heats of formation of ground-state MCO 3 , M(HCO 3 ) 2 , and M(HCO 3 )(OH), where M = Mn, Co, Ni, Cu, and Zn, have been predicted using the correlated molecular orbital theory at the CCSD(T) level extrapolated to the complete basis set limit using the Feller–Peterson–Dixon (FPD) approach. Cohesive energies of the carbonates were predicted based on the calculated gas phase and experimental solid heats of formation. Coulombic dissociation energies (CDEs) between metal cations and anions show a near-linear correlation with Shannon metal cation atomic radii, yet no correlation is found with the hardness of these cations. The total reaction dissociation energies (TRDEs) of transition metals are higher than their CDEs for the di-bicarbonates, in contrast to those for Mg and Ca based on our prior work. In addition to differences in the energies needed to prepare the transition metal dications, electron donation from the ligands to the 3d orbitals of open-shell transition metal dications from lone pairs of adjacent O atoms also plays a role. No electron donation from the ligands to the fully occupied 3d orbitals of Zn and Cd was found. Decomposition energies for generating MO, CO 2 , and/or H 2 O were calculated. Gas phase metal exchange energies only partially correlate with the electrochemical series for M(s) → M 2+( aq). The FPD heats of formation were used to benchmark a range of density functional theory exchange–correlation functionals, including those commonly used in solid-state mineral calculations. None of the functionals provided chemical accuracy agreement (±1 kcal/mol) with the FPD results. So, the best agreement with the FPD results is predicted for the $\tau$-HCTH functional with an average unsigned error of 8.3 kcal/mol.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

An Optimization-Based Coupling of Reduced Order Models with an Efficient Reduced Adjoint Basis Generation Approach

Optimization-based coupling (OBC) is an attractive alternative to traditional Lagrange multiplier approaches in multiple modeling and simulation contexts. However, application of OBC to time-dependent problems has been hindered by the computational cost of finding the stationary points of the associated Lagrangian, which requires primal and adjoint solves. This issue can be mitigated by using OBC in conjunction with computationally efficient reduced order models (ROMs). To demonstrate the potential of this combination, in this paper, we develop an optimization-based ROM-ROM coupling for a transient advection-diffusion transmission problem. We pursue the “optimize-then-reduce” path toward solving the minimization problem at each time step and solve reduced space adjoint system of equations, where the main challenge in this formulation is the generation of adjoint snapshots and reduced bases for the adjoint systems required by the optimizer. One of the main contributions of the paper is a new technique for an efficient adjoint snapshot collection for gradient-based optimizers in the context of optimization-based ROM-ROM couplings. In conclusion, we present numerical studies demonstrating the accuracy of the approach along with comparison between various approaches for selecting a reduced order basis for the adjoint systems, including decay of snapshot energy, average iteration counts, and timings.

coupled problems↗

Resilience and fault tolerance in high-performance computing for numerical weather and climate prediction

Progress in numerical weather and climate prediction accuracy greatly depends on the growth of the available computing power. As the number of cores in top computing facilities pushes into the millions, increased average frequency of hardware and software failures forces users to review their algorithms and systems in order to protect simulations from breakdown. This report surveys hardware, application-level and algorithm-level resilience approaches of particular relevance to time-critical numerical weather and climate prediction systems. A selection of applicable existing strategies is analysed, featuring interpolation-restart and compressed checkpointing for the numerical schemes, in-memory checkpointing, user-level failure mitigation and backup-based methods for the systems. Numerical examples showcase the performance of the techniques in addressing faults, with particular emphasis on iterative solvers for linear systems, a staple of atmospheric fluid flow solvers. The potential impact of these strategies is discussed in relation to current development of numerical weather prediction algorithms and systems towards the exascale. Trade-offs between performance, efficiency and effectiveness of resiliency strategies are analysed and some recommendations outlined for future developments.

54 ENVIRONMENTAL SCIENCES↗

Comparison of open‐source three‐dimensional reconstruction pipelines for maize‐root phenotyping

Abstract Understanding three‐dimensional (3D) root traits is essential to improve water uptake, increase nitrogen capture, and raise carbon sequestration from the atmosphere. However, quantifying 3D root traits by reconstructing 3D root models for deeper field‐grown roots remains a challenge due to the unknown tradeoff between 3D root‐model quality and 3D root‐trait accuracy. Therefore, we performed two computational experiments. We first compared the 3D model quality generated by five state‐of‐the‐art open‐source 3D model reconstruction pipelines on 12 contrasting genotypes of field‐grown maize roots. These pipelines included COLMAP, COLMAP+PMVS (Patch‐based Multi‐View Stereo), VisualSFM, Meshroom, and OpenMVG+MVE (Multi‐View Environment). The COLMAP pipeline achieved the best performance regarding 3D model quality versus computational time and image number needed. In the second test, we compared the accuracy of 3D root‐trait measurement generated by the Digital Imaging of Root Traits 3D pipeline (DIRT/3D) using COLMAP‐based 3D reconstruction with our current DIRT/3D pipeline that uses a VisualSFM‐based 3D reconstruction on the same dataset of 12 genotypes, with 5–10 replicates per genotype. The results revealed that (1) the average number of images needed to build a denser 3D model was reduced from 3000 to 3600 (DIRT/3D [VisualSFM‐based 3D reconstruction]) to around 360 for computational test 1, and around 600 for computational test 2 (DIRT/3D [COLMAP‐based 3D reconstruction]); (2) denser 3D models helped improve the accuracy of the 3D root‐trait measurement; (3) reducing the number of images can help resolve data storage problems. The updated DIRT/3D (COLMAP‐based 3D reconstruction) pipeline enables quicker image collection without compromising the accuracy of 3D root‐trait measurements.

09 BIOMASS FUELS↗

A review of computational methods for studying oscillating water columns – the Navier-Stokes based equation approach

This review evaluates the state-of-the-practice numerical tools used to predict the performance of Oscillating Water Column (OWC). The OWC is a widely studied Wave Energy Converter that provides a reliable form of renewable form of electricity that can potentially meet global energy needs. However, the fluid-flow phenomena affecting its hydrodynamic performance are not fully understood. While there has been the successful full-scale deployment of OWCs, various computational methods are being explored to optimize this technology. Potential flow theory is commonly used to evaluate the efficiency of OWCs; however, this assumption tends to over-predict the hydrodynamic performance. Recently, numerical studies using a diverse set of commercial, open-source, or in-house Computational Fluid Dynamics (CFD) using Reynolds Averaged Navier Stokes (RANS) and Large-Eddy Simulation codes show a better comparison to available experimental results but are computationally expensive. ANSYS Fluent was found to be the most widely used CFD code applied to the study of the OWCs, with a high degree of accuracy in terms of experimental validation of numerical results.

16 TIDAL AND WAVE POWER↗

Onset dynamics of air-water menisci on rock fracture surfaces

Information on menisci dynamics and equilibrium contact angles, θ e , is needed for modeling multiphase flow of fluids in geologic formations. The wettability of fracture faces is relevant to applications such as waterflooding in enhanced oil recovery and evaluation of caprock integrity for geologic carbon sequestration. We investigated the vertical capillary rise of air-water menisci on exposed fracture faces for a sandstone, a shale, and three granites. The experimental design approximated that employed in the Wilhelmy plate method. Replicate fracture faces were prepared by fracturing cylindrical rock cores using the Brazilian method and splitting the fractured cores apart along their fracture planes. Meniscus onset was imaged from a cross-sectional perspective using dynamic neutron radiography, and quantified with change point analysis. An existing model for meniscus onset fitted the experimental data very well (median R 2 = 0.96). Capillary rise was typified by t 2/3 scaling (where t is time), followed by a constant equilibrium height, z e . The average time taken for the menisci to reach z e was 0.39 s, with no differences between rock types. The menisci achieved a greater vertical extent on the fracture faces of the sedimentary rocks as compared to those of the granites. Apparent θ e values were calculated from the best fit estimates of z e using the Wilhelmy plate equation for a smooth and planar vertical surface. Despite the fractal roughness of some of the fracture faces, there was a significant linear relationship (R 2 = 0.80) between the apparent θ e values and intrinsic θ e values measured on polished surfaces of the same rocks using the sessile drop method. The regression equation indicated the apparent θ e values were consistently greater than the intrinsic values. This overestimation may be due to averaging of pixels at the air-water-solid interface, a required step in the image analysis. Further exploration of the range of applicability and measurement accuracy of this proposed new technique would be valuable.

58 GEOSCIENCES↗

A machine learning photon detection algorithm for coherent x-ray ultrafast fluctuation analysis

X-ray free electron laser experiments have brought unique capabilities and opened new directions in research, such as creating new states of matter or directly measuring atomic motion. One such area is the ability to use finely spaced sets of coherent x-ray pulses to be compared after scattering from a dynamic system at different times. This enables the study of fluctuations in many-body quantum systems at the level of the ultrafast pulse durations, but this method has been limited to a select number of examples and required complex and advanced analytical tools. By applying a new methodology to this problem, we have made qualitative advances in three separate areas that will likely also find application to new fields. As compared to the “droplet-type” models, which typically are used to estimate the photon distributions on pixelated detectors to obtain the coherent x-ray speckle patterns, our algorithm achieves an order of magnitude speedup on CPU hardware and two orders of magnitude improvement on GPU hardware. We also find that it retains accuracy in low-contrast conditions, which is the typical regime for many experiments in structural dynamics. Finally, it can predict photon distributions in high average-intensity applications, a regime which up until now has not been accessible. Our artificial intelligence-assisted algorithm will enable a wider adoption of x-ray coherence spectroscopies, by both automating previously challenging analyses and enabling new experiments that were not otherwise feasible without the developments described in this work.

47 OTHER INSTRUMENTATION↗

Report on local data recovery approaches suitable for weather and climate prediction (Deliverable 1.3) (V.1.0)

Numerical weather and climate prediction rates as one of the scientific applications whose accuracy improvements greatly depend on the growth of the available computing power. As the number of cores in top computing facilities pushes into the millions, increasing average frequency of hardware and software failures forces users to review their algorithms and systems in order to protect simulations from breakdown. This report surveys approaches for fault-tolerance in numerical algorithms and system resilience in parallel simulations from the perspective of numerical weather and climate prediction systems. A selection of existing strategies is analyzed, featuring interpolation-restart and compressed checkpointing for the numerics, in-memory checkpointing, user-level failure mitigation-based and backup-based methods for the systems. Numerical examples showcase the performance of the techniques in addressing faults, with particular emphasis on iterative solvers for linear systems, a staple of atmospheric fluid flow solvers. The potential impact of these strategies is discussed in relation to current development of numerical weather prediction algorithms and systems towards the exascale. Trade-offs between performance, efficiency and effectiveness of resiliency strategies are analyzed and some recommendations outlined for future developments.

97 MATHEMATICS AND COMPUTING↗

Sea-Ice Effects on the Alaskan Wave Climate

This study investigates the uncertainty of wave resource assessments due to sea ice in the nearshore region of Alaska using an innovative approach of combining remotely sensed data and a third-generation phase-averaged wave model. Modeling analysis focused on winter months, when high wave energy is present along with sea ice. This study includes recommendations to improve the accuracy of wave resource assessments and optimize marine and hydrokinetic device siting with consideration of sea-ice effects. Additional recommendations, based on preliminary sea-ice information in Cook Inlet, Alaska, are provided for a trajectory analysis of drifting sea ice and a collision risk assessment of sea ice and tidal turbines. The outcome of this project will provide valuable information about the level of sea-ice impact on the accuracy of wave resource assessments in the Alaska nearshore region, and of sea-ice collision risk with MHK devices and ocean observation systems during winter months when sea ice is present.

16 TIDAL AND WAVE POWER↗

Deep Learning-based Parameterization of Complex 3D CO2 Saturation Data in Large-scale Geological Carbon Storage

In deep learning (DL), dimension reduction plays a pivotal role in improving training efficiency and minimizing overfitting, especially when working with complex datasets like three-dimensional (3D) saturation data. In the context of geological carbon storage (GCS), 3D saturation data introduces unique challenges due to its sparse nature and sharp transitions at plume boundaries, known as shock fronts. To tackle these challenges, we developed a novel DL framework that combines dimension reduction with advanced 3D reconstruction techniques. Our approach utilizes latent variables derived from 2D average saturation fields to efficiently capture the essential features of high-dimensional data while reducing the number of variables. This enhances both the robustness and accuracy of DL models, making the framework more practical for real-world applications. By offering a tailored solution for modeling complex 3D saturation dynamics, this framework holds significant potential for environmental monitoring, energy storage, and other geological applications.

Wang, Hongsheng [University of Texas at Austin]↗