Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error indicators”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Study of Overfitting by Machine Learning Methods Using Generalization Equations

The training error of Machine Learning (ML) methods has been extensively used for performance assessment, and its low values have been used as a main justification for complex methods such as estimator fusion and ensembles, and hyper parameter tuning. We present two practical cases where independent tests indicate that the low training error is more of a reflection of over-fitting rather than the generalization ability. We derive a generic form of the generalization equations that separates the training error terms of ML methods from their epistemic terms that correspond to approximation and learnability properties. It provides a framework to separately account for both terms to ensure an overall high generalization performance. For regression estimation tasks, we derive conditions for performance enhancements achieved by hyper parameter tuning, and fusion and ensemble methods over their constituent methods. We present experimental measurements and ML estimates that illustrate the analytical results for the throughput profile estimation of a data transport infrastructure.

Rao, Nageswara↗

Local hybrid functionals with orbital-free mixing functions and balanced elimination of self-interaction error

The recently introduced density overlap regions indicator (DORI) [P. de Silva and C. Corminboeuf, J. Chem. Theory Comput. 10(9), 3745–3756 (2014)] is a density-dependent scalar field revealing regions of high density overlap between shells, atoms, and molecules. In this work, we exploit its properties to construct local hybrid exchange-correlation functionals aiming at balanced reduction of the self-interaction error. We show that DORI can successfully replace the ratio of the von Weizsäcker and exact positive-definite kinetic energy densities, which is commonly used in mixing functions of local hybrids. Additionally, we introduce several semi-empirical parameters to control the local and global admixture of exact exchange. The most promising of our local hybrids clearly outperforms the underlying semi-local functionals as well as their global hybrids.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Deterministic skill of ENSO predictions from the North American Multimodel Ensemble

Hindcasts and real-time predictions of the east-central tropical Pacific sea surface temperature (SST) from the North American Multimodel Ensemble (NMME) system are verified for 1982–2015. Skill is examined using two deterministic verification measures: mean squared error skill score (MSESS) and anomaly correlation. Verification of eight individual models shows somewhat differing skills among them, with some models consistently producing more successful predictions than others. The skill levels of MME predictions are approximately the same as the two best performing individual models, and sometimes exceed both of them. A decomposition of the MSESS indicates the presence of calibration errors in some of the models. In particular, the amplitudes of some model predictions are too high when predictability is limited by the northern spring ENSO predictability barrier and/or when the interannual variability of the SST is near its seasonal minimum. The skill of the NMME system is compared to that of the MME from the IRI/CPC ENSO prediction plume, both for a comparable hindcast period and also for a set of real-time predictions spanning 2002–2011. Comparisons are made both between the MME predictions of each model group, and between the average of the skills of the respective individual models in each group. Acknowledging a hindcast versus real-time inconsistency in the 2002–2012 skill comparison, the skill of the NMME is slightly higher than that of the prediction plume models in all cases. This result reflects well on the NMME system, with its large total ensemble size and opportunity for possible complementary contributions to skill.

54 ENVIRONMENTAL SCIENCES↗

Flood Forecasting in River System Using ANFIS

The aim of the present study is to investigate applicability of artificial intelligence techniques such as ANFIS (Adaptive Neuro-Fuzzy Inference System) in forecasting flood flow in a river system. The proposed technique combines the learning ability of neural network with the transparent linguistic representation of fuzzy system. The technique is applied to forecast discharge at a downstream station using flow information at various upstream stations. A total of three years data has been selected for the implementation of this model. ANFIS models with various input structures and membership functions are constructed, trained and tested to evaluate efficiency of the models. Statistical indices such as Root Mean Square Error (RMSE), Correlation Coefficient (CORR) and Coefficient of Efficiency (CE) are used to evaluate performance of the ANFIS models in forecasting river flood. The values of the indices show that ANFIS model can accurately and reliably be used to forecast flood in a river system.

58 GEOSCIENCES↗

A Look Inside the Black Box: Using graph-theoretical descriptors to interpret a Continuous-Filter Convolutional Neural Network (CF-CNN) trained on the global and local minimum energy structures of neutral water clusters

A Continuous Filter Convolutional Neural Network (CF-CNN) was trained to predict the potential energy of water cluster networks \ce{(H2O)_{\textit{N}}}, \textit{N}=10--30, corresponding to local minima lying within 5 kcal/mol from the putative minima taken from a newly published database containing over 5 million unique networks. The chemical sampling space of the database was characterized using chemical descriptors derived from graph theory, which led to the identification of important trends in the topology, connectivity, polygon structures associated with the various networks as a function of cluster size. The resulting graphs are available alongside the original database at \url{https://sites.uw.edu/wdbase/}. The CF-CNN trained on a subset of 500,000 networks for (\textit{N}=10, 30) yielded a mean absolute error of 0.002$\pm$0.002 kcal/mol per water molecule, giving the trained CF-CNN the highest accuracy of any neural network-based surrogate model to date. In addition, clusters of sizes not included in the training set exhibited errors of the same magnitude, indicating that the CF-CNN ptotocol is general enough to accurately predict energies of networks for both smaller and larger sizes than those used during training. The graph-theoretical descriptors were developed in order to analyze the properties of the full database and interpret the predictive power of the CF-CNN. Using topology measures, such as the Wiener index and the average shortest path length along with two similarity measures, we showed that all networks from the test set were within the range of the ones from the training set, suggesting that the training set covered the chemical space of interest quite well. Our graph analysis suggests that the mean degree and number of polygons for networks with larger errors tend to lie further from the mean than those with lower errors. The generality of the used CF-CNN was thus demonstrated, while the use of the graph-theoretical descriptors assisted in interpreting the predicted results.

Bilbrey, Jenna A.↗

Real-time out-of-plane artifact subtraction tomosynthesis imaging using prior CT for scanning beam digital x-ray system

Purpose: The scanning beam digital x-ray system (SBDX) is an inverse geometry fluoroscopic system with high dose efficiency and the ability to perform continuous real-time tomosynthesis in multiple planes. This system could be used for image guidance during lung nodule biopsy. However, the reconstructed images suffer from strong out-of-plane artifact due to the small tomographic angle of the system. Methods: The authors propose an out-of-plane artifact subtraction tomosynthesis (OPAST) algorithm that utilizes a prior CT volume to augment the run-time image processing. A blur-and-add (BAA) analytical model, derived from the project-to-backproject physical model, permits the generation of tomosynthesis images that are a good approximation to the shift-and-add (SAA) reconstructed image. A computationally practical algorithm is proposed to simulate images and out-of-plane artifacts from patient-specific prior CT volumes using the BAA model. A 3D image registration algorithm to align the simulated and reconstructed images is described. The accuracy of the BAA analytical model and the OPAST algorithm was evaluated using three lung cancer patients’ CT data. The OPAST and image registration algorithms were also tested with added nonrigid respiratory motions. Results: Image similarity measurements, including the correlation coefficient, mean squared error, and structural similarity index, indicated that the BAA model is very accurate in simulating the SAA images from the prior CT for the SBDX system. The shift-variant effect of the BAA model can be ignored when the shifts between SBDX images and CT volumes are within ±10 mm in the x and y directions. The nodule visibility and depth resolution are improved by subtracting simulated artifacts from the reconstructions. The image registration and OPAST are robust in the presence of added respiratory motions. The dominant artifacts in the subtraction images are caused by the mismatches between the real object and the prior CT volume. Conclusions: Their proposed prior CT-augmented OPAST reconstruction algorithm improves lung nodule visibility and depth resolution for the SBDX system.

60 APPLIED LIFE SCIENCES↗

Stellar chemical abundances: in pursuit of the highest achievable precision

The achievable level of precision on photospheric abundances of stars is a major limiting factor on investigations of exoplanet host star characteristics, the chemical histories of star clusters, and the evolution of the Milky Way and other galaxies. While model-induced errors can be minimized through the differential analysis of spectrally similar stars, the maximum achievable precision of this technique has been debated. As a test, we derive differential abundances of 19 elements from high-quality asteroid-reflected solar spectra taken using a variety of instruments and conditions. We treat the solar spectra as being from unknown stars and use the resulting differential abundances, which are expected to be zero, as a diagnostic of the error in our measurements. Our results indicate that the relative resolution of the target and reference spectra is a major consideration, with use of different instruments to obtain the two spectra leading to errors up to 0.04 dex. Use of the same instrument at different epochs for the two spectra has a much smaller effect (∼0.007 dex). The asteroid used to obtain the solar standard also has a negligible effect (∼0.006 dex). Assuming that systematic errors from the stellar model atmospheres have been minimized, as in the case of solar twins, we confirm that differential chemical abundances can be obtained at sub-0.01 dex precision with due care in the observations, data reduction, and abundance analysis.

79 ASTRONOMY AND ASTROPHYSICS↗

Effects of refractive index mismatch in optical CT imaging of polymer gel dosimeters

Purpose: Proposing an image reconstruction technique, algebraic reconstruction technique-refraction correction (ART-rc). The proposed method takes care of refractive index mismatches present in gel dosimeter scanner at the boundary, and also corrects for the interior ray refraction. Polymer gel dosimeters with high dose regions have higher refractive index and optical density compared to the background medium, these changes in refractive index at high dose results in interior ray bending. Methods: The inclusion of the effects of refraction is an important step in reconstruction of optical density in gel dosimeters. The proposed ray tracing algorithm models the interior multiple refraction at the inhomogeneities. Jacob’s ray tracing algorithm has been modified to calculate the pathlengths of the ray that traverses through the higher dose regions. The algorithm computes the length of the ray in each pixel along its path and is used as the weight matrix. Algebraic reconstruction technique and pixel based reconstruction algorithms are used for solving the reconstruction problem. The proposed method is tested with numerical phantoms for various noise levels. The experimental dosimetric results are also presented. Results: The results show that the proposed scheme ART-rc is able to reconstruct optical density inside the dosimeter better than the results obtained using filtered backprojection and conventional algebraic reconstruction approaches. The quantitative improvement using ART-rc is evaluated using gamma-index. The refraction errors due to regions of different refractive indices are discussed. The effects of modeling of interior refraction in the dose region are presented. Conclusions: The errors propagated due to multiple refraction effects have been modeled and the improvements in reconstruction using proposed model is presented. The refractive index of the dosimeter has a mismatch with the surrounding medium (for dry air or water scanning). The algorithm reconstructs the dose profiles by estimating refractive indices of multiple inhomogeneities having different refractive indices and optical densities embedded in the dosimeter. This is achieved by tracking the path of the ray that traverses through the dosimeter. Extensive simulation studies have been carried out and results are found to be matching that of experimental results.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Error Analysis of the Thornado Supernova Simulation Code

The iron core collapse of a supernova throws 1.5 solar masses at speeds up to 35% the speed of light into a space with radius 50km, which creates a high density environment capable of generating neutrinos, producing gravitational waves, and driving chemical evolution of matter past iron. By designing a simulation of the process, we can better understand the origins and properties of these rare phenomena which are not seen anywhere else in the universe. Typically, supernovas are simulated with a finite volume method, but we want to incorporate a Nodal Discontinuous Galerkin Method to better utilize high performance computing because the DG method allows us to increase precision without increasing the number of computational elements. This project focuses on the fluid dynamics during collapse and the resulting shockwaves. To understand this, we improved on an existing simulation by comparing benchmark tests against published and theoretical results to identify and correct sources of error. The DG Method creates discontinuous functions across computational elements by solving the Euler fluid equations computed over Runge-Kutta time steps. The DG method allows for discontinuous functions to be built from polynomials defined in individual elements; however, it can lead to unphysical oscillation near discontinuities. We apply the characteristic slope limiter to reduce these affects, but when applied globally it leads to a 1% increase in absolute error. By introducing a Trouble Cell Indicator, which marks certain fluid elements based on the rate of change of observables, we can constrain the limiter to elements near shocks and manage the resulting absolute error. By constraining the limiter to discontinuous regions, we can remove what we know will be unrealistic without impacting naturally occurring oscillations.

79 ASTRONOMY AND ASTROPHYSICS↗

Emulating climate extreme indices

We use simple pattern scaling and time-shift to emulate changes in a set of climate extreme indices under future scenarios, and evaluate the emulators' accuracy. We propose a metric for the error in emulation in the context of initial condition ensembles, to specifically characterize the role of internal variability in the emulation performance. Our metric separates systematic emulation errors from unavoidable discrepancies between emulated and target values due to internal variability. We compute the metricis at grid-point scale, and we show geographically resolved results, or aggregate them at global scale. We demonstrate the use of our error metric in the emulation of a suite of temperature and precipitation extreme indices. We test and compare simple pattern scaling and time-shift using a range of trajectories spanning targets inspired by the Paris agreement -- warming to 1.5C and 2.0C from the pre-industrial baseline -- and two of the longer-established trajectories, RCP4.5 and RCP8.5. With this suite of scenarios we can test the effects on the performance of the size of the temperature gap between emulation origin and target. We find that for most indices emulation the dominant source of discrepancy is internal variability. For at least one index, however, counting exceedances of a high temperature threshold, significant portions of the globally aggregated discrepancy and its regional pattern originate from the systematic emulation error. This error exceeds internal variability of both the target and the emulated quantities in large coherent regions at low latitudes, and the explanation can be found in the differential behavior of temperature distributions across latitudes. The metric also highlights a fundamental difference in the two methods related to the simulation of internal variability, which is dampened significantly by simple pattern scaling. This aspect is of consequence when using these methods for specific applications, where preserving variability for uncertainty quantification is deemed important. With this study we offer our metric as a diagnostic tool, facilitating the formulation of scientific hypotheses on the reasons for the error. In the meantime, we show that for many impact relevant indices by now traditional emulation techniques can be accurate within the variations unavoidably introduced by internal variability, establishing the fundamental condition for using their emulation in impact modeling.

54 ENVIRONMENTAL SCIENCES↗

Forward and inverse predictive transient models of TREAT using surrogate reactivity models

In this work, we present two novel approaches for predicting the power evolution and control rod height of the Transient Reactor Test Facility (TREAT) to support experiment modeling; specifically, transient analysis of the NASA-sponsored Sirius series of experiments. These approaches utilize steady-state Monte Carlo model, point kinetics model, and surrogate models to predict power evolution and control rod axial position during transient experiments. Both approaches were tested and validated against several Sirius experiments that were performed in the TREAT facility at different power levels. The validation test results show very good agreement with the experimental data, and the models were able to accurately predict the power evolution and the axial control rod position with an average error within 3.0%. Finally, this indicates that these approaches will help the reactor engineering team of the TREAT facility in preparing and predicting the power and temperature of the experiment.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Isochronous and period-doubling diagrams for symplectic maps of the plane

Symplectic mappings of the plane serve as key models for exploring the fundamental nature of complex behavior in nonlinear systems. Central to this exploration is the effective visualization of stability regimes, which enables the interpretation of how systems evolve under varying conditions. While the area-preserving quadratic Hénon map has received significant theoretical attention, a comprehensive description of its mixed parameter-space dynamics remain lacking. This limitation arises from early attempts to reduce the full two-dimensional phase space to a one-dimensional projection, a simplification that resulted in the loss of important dynamical features. Consequently, there is a clear need for a more thorough understanding of the underlying qualitative aspects. This paper aims to address this gap by revisiting the foundational concepts of reversibility and associated symmetries, first explored in the early works of G.D. Birkhoff. We extend the original framework proposed by Hénon by adding a period-doubling diagram to his isochronous diagram, which allows to represents the system’s bifurcations and the groups of symmetric periodic orbits that emerge in typical bifurcations of the fixed point. A qualitative and quantitative explanation of the main features of the region of parameters with bounded motion is provided, along with the application of this technique to other symplectic mappings, including cases of multiple reversibility. Modern chaos indicators, such as the Reversibility Error Method (REM) and the Generalized Alignment Index (GALI), are employed to distinguish between various dynamical regimes in the mixed space of variables and parameters. These tools prove effective in differentiating regular and chaotic dynamics, as well as in identifying twistless orbits and their associated bifurcations. Additionally, we discuss the application of these methods to real-world problems, such as visualizing dynamic aperture in accelerator physics, where our findings have direct relevance.

43 PARTICLE ACCELERATORS↗

A machine learning approach to thermal conductivity modeling: A case study on irradiated uranium-molybdenum nuclear fuels

A deep neural network was developed for the purpose of predicting thermal conductivity with a case study performed on irradiated nuclear fuel. Traditional thermal conductivity modeling approaches rely on existing theoretical frameworks that describe known, relevant phenomena that govern the microstructural evolution processes during neutron irradiation (such as recrystallization, and pore size, distribution and morphology). Current empirical modeling approaches, however, do not represent all irradiation test data well. We develop a machine learning approach to thermal conductivity modeling that does not require a priori knowledge of a specific material microstructure and system of interest. Our approach allows re-searchers to probe dependency of thermal conductivity on a variety of reactor operating and material conditions. The purpose of building such a model is to allow for improved predictive capabilities linking structure-property-processing-performance relationships in the system of interest (here, irradiated nuclear fuel), which could lead to improved experimental test planning and characterization. The uranium-molybdenum system is the fuel system studied in this work, and historic irradiation test data is leveraged for model development. Our model achieved a mean absolute percent error of approximately 10%. Results indicate our model generalizes well to never before seen data, and thus use of deep learning methods for material property predictions from limited, historic irradiation data is a viable approach. This work challenges the current paradigm in materials science, where material property models are based on limited experimental data fitted to low-dimensionality phenomenological models, or by simulations in which fundamental equations are explicitly solved. The work presented here aims to demonstrate the potential and limitations of machine learning in the field of materials science and material property modeling.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Pool boiling heat transfer evaluation of next-generation dielectric fluid: Opteon™ 2P50

The growing use of artificial intelligence has led to heavy thermal loads and high heat dissipation rates in data centers. Conventional air-cooled technologies are not able to fulfill these requirements. To overcome these challenges, two-phase immersion cooling (2PIC) has emerged as one of the leading technologies for high power-density chips. 2PIC increases the heat dissipation rate and efficiency of the system while reducing the footprint of the cooling equipment. A fluid with adequate dielectric properties, a suitable normal boiling temperature to maintain chip temperatures, and good material compatibility, is desired for 2PIC system. In this study, the pool boiling heat transfer of a new developmental dielectric fluid, Opteon™ 2P50, was experimentally investigated. The heat transfer coefficients at various heat fluxes (20–150 kW/m 2 ) and the critical heat flux were measured using a smooth aluminum surface. Compared with HFE-7100, Opteon™ 2P50 shows higher heat transfer coefficient (up to 59% higher) and a slightly lower value of critical heat flux (around 5.9% lower). The modified Cooper correlation with the optimized leading constant resulted in reliable prediction accuracy with a 5.3% mean absolute error percentage. Overall, these results indicate that the new dielectric fluid provides similar thermal performance to some legacy fluids.

2P50↗

Nowcasting, predictive control, and feedback control for temperature regulation in a novel hybrid solar-electric reactor for continuous solar-thermal chemical processing

A novel 15 kW reactor for the hybridization of concentrated solar and conventional electric heat was fabricated for renewable and continuous chemical processing at temperatures up to 1700 °C. Solar-electric controllers based on feedback or predictive linear models were used to regulate the device at 925 °C for the production of syngas via the gasification of carbon. The system was challenged with cloud transients programmed on a 45 kW high-flux solar simulator that approximated weather observed in the San Luis Valley (Colorado, USA). In experiment it was found that model predictive control with a 1 min ahead nowcast of incipient clouding best regulated solar-electric reactor temperatures, potentially averting thermal fatigue. Upon clouding, model predictive control with a nowcast yielded temperature disturbances of ±10 °C, whereas feedback control alone featured ±25 °C excursions. Overall, the performance of model predictive control with a nowcast was 75% better than feedback as indicated by the integral squared error of temperature excursion residuals. The importance of nowcast accuracy was explored, and although the model-based controller was robust to forecast amplitude inaccuracy, temporal forecast inaccuracy wholly negated the benefits of predictive control.

14 SOLAR ENERGY↗

Resistive Switching Memory Performance of Two-Dimensional Polyimide Covalent Organic Framework Films

Two-dimensional polyimide covalent organic framework (2D PI-NT COF) films were constructed on indium tin oxide-coated glass substrates to fabricate two-terminal sandwiched resistive memory devices. The 2D PI-NT COF films condensated from the reaction between 4,4',4"-triaminotriphenylamine and naphthalene-1,4,5,8-tetracarboxylic dianhydride under solvothermal conditions demonstrated high crystallinity, good orientation preference, tunable thickness, and low surface roughness. The well-aligned electron-donor (triphenylamine unit) and -acceptor (naphthalene diimide unit) arrays rendered the 2D PI-NT COF films a promising candidate for electronic applications. The memory devices based on 2D PI-NT COF films exhibited a typical write-once-read-many-time resistive switching behavior under an operating voltage of +2.30 V on the positive scan and -2.64 V on the negative scan. A high ON/OFF current ratio (>10 6 for the positive scan and 10 4 -10 6 for the negative scan) and long-term retention time indicated the high fidelity, low error, and high stability of the resistive memory devices. The memory behavior was attributed to an electric field-induced intramolecular charge transfer in an ordered donor-acceptor system, which provided the effective charge-transfer channels for injected charge carriers. Furthermore, this work represents the first example that explores the resistive memory properties of 2D PI-COF films, shedding light on the potential application of 2D COFs as information storage media.

2D covalent organic framework film↗

Towards an Introspective Dynamic Model of Globally Distributed Computing Infrastructures

Large-scale scientific collaborations like ATLAS, Belle II, CMS, DUNE, and others involve hundreds of research institutes and thousands of researchers spread across the globe. These experiments generate petabytes of data, with volumes soon expected to reach exabytes. Consequently, there is a growing need for computation, including structured data processing from raw data to consumer-ready derived data, extensive Monte Carlo simulation campaigns, and a wide range of end-user analysis. To manage these computational and storage demands, centralized workflow and data management systems are implemented. However, decisions regarding data placement and payload allocation are often made disjointly and via heuristic means. A significant obstacle in adopting more effective heuristic or AI-driven solutions is the absence of a quick and reliable introspective dynamic model to evaluate and refine alternative approaches. In this study, we aim to develop such an interactive system using real-world data. By examining job execution records from the PanDA workflow management system, we have pinpointed key performance indicators such as queuing time, error rate, and the extent of remote data access. The dataset includes five months of activity. Additionally, we are creating a generative AI model to simulate time series of payloads, which incorporate visible features like category, event count, and submitting group, as well as hidden features like the total computational load—derived from existing PanDA records and computing site capabilities. These hidden features, which are not visible to job allocators, whether heuristic or AI-driven, influence factors such as queuing times and data movement.

kilic, Ozgur Ozan [Brookhaven National Laboratory ↗