Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance Modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Uncertainty Quantification of Bifacial Performance Modeling

Analysis on uncertainty in the annual energy of PV systems that can be attributed to parameters of particular importance to bifacial PV modules is presented. Monte Carlo simulations are used to evaluate the effect of uncertain module bifaciality factors, module transmission fractions, albedo values, and ground clearance. The analyses cover a wide spectrum of potential PV array archetypes through variation of installation parameters. The results of the Monte Carlo analysis reveal that the uncertainty is largely dependent on albedo uncertainty, but more simulations are needed to identify trends across system archetypes. The simulations are aimed at attributing an annual energy uncertainty factor for bifacial considerations that can be applied in post-processing of project probability of exceedance analysis.

bifacial↗

Uncertainty Quantification of Bifacial Performance Modeling: Preprint

Analysis on uncertainty in the annual energy of PV systems that can be attributed to parameters of particular importance to bifacial PV modules is presented. Monte Carlo simulations are used to evaluate the effect of uncertain module bifaciality factors, module transmission fractions, albedo values, and ground clearance. The analyses cover a wide spectrum of potential PV array archetypes through variation of installation parameters. The results of the Monte Carlo analysis reveal that the uncertainty is largely dependent on albedo uncertainty, but more simulations are needed to identify trends across system archetypes. The simulations are aimed at attributing an annual energy uncertainty factor for bifacial considerations that can be applied in post-processing of project probability of exceedance analysis.

energy modeling↗

An Efficient Annual-Performance Model of a Geothermal Network for Improved System Design, Operation, and Control: Preprint

Geothermal district energy systems (DES), and specifically geothermal networks, provide a viable solution for decarbonizing residential and commercial heating and cooling loads. District energy systems of all kinds enable a thermal resource with a relatively high capital cost (such as a geothermal borehole field) to be shared among a large number of users. While district heating and cooling has been studied for many years, geothermal networks, fifth generation DES that utilize water-source heat pumps and an ambient temperature loop to meet heating and cooling loads, have not been implemented extensively and thus require additional technical and economic optimization to obtain maximum benefits. This paper presents a newly developed reduced-order model that captures the flow of energy within the network, including the commercial and residential users' electrical usage, at an hourly rate over a year. The model includes building loads, heat pumps, borehole fields, and auxiliary heat/cool input, all connected with an ambient-temperature thermal loop model. In the model, operational control is possible for the borehole fields, circulation pump, and auxiliary system. For a given system, the model can output the complete state parameters for each component, the thermal loop, and the collective system, such as flow rate over time, average thermal loop temperature over time, and total electricity usage. The model can also be used to optimize the system control for maximizing system efficiency or minimizing system operational cost. For example, one initial assessment of the borehole controller for an example system showed that a controller with on/off operation of the borehole field reduces annual electrical usage by 33%, compared with continuous operation mode. Hence, the model can assist in optimizing a given system's operation to get the most value out of a geothermal network installation. Future work will consider the model's application to a demonstration project, including the model validation against operational data and system operation optimization.

ambient-temperature loop↗

Fuel Performance Modeling

I've been asked to give a brief overview of myself and the work I do at a virtual recruitment event with the University of South Carolina. I graduated from their in 2022 and the the recruitment asked if I could give a brief 10 min presentation.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Reference Cell Performance and Modeling on a One-Axis Tracking Surface: Preprint

Performance of five silicon-based reference cells is examined on a single-axis tracking surface. The reference cells' output are modeled using one-minute sampled spectral irradiance and reference cell temperature measurements. The model also incorporates spectral responsivity data for the reference cell. The transmission of light through the glazing multiplies the sum over all appropriate wavelengths of temperature adjusted reference cell responsivity times the measured spectral irradiance. Modeled reference cell output is compared with measured reference cell output under clear sky and totally cloudy sky conditions. For each reference cell the ratio of modeled to measured output varies by less than 2% over the year.

modeling↗

An interlaboratory comparison of mid-infrared spectra acquisition: Instruments and procedures matter

Diffuse reflectance spectroscopy has been extensively employed to deliver timely and cost-effective predictions of a number of soil properties. However, although several soil spectral laboratories have been established worldwide, the distinct characteristics of instruments and operations still hamper further integration and interoperability across mid-infrared (MIR) soil spectral libraries. In this study, we conducted a large-scale ring trial experiment to understand the lab-to-lab variability of multiple MIR instruments. By developing a systematic evaluation of different mathematical treatments with modeling algorithms, including regular preprocessing and spectral standardization, we quantified and evaluated instruments' dissimilarity and how this impacts internal and shared model performance. We found that all instruments delivered good predictions when calibrated internally using the same instruments' characteristics and standard operating procedures by solely relying on regular spectral preprocessing that accounts for light scattering and multiplicative/additive effects, e.g., using standard normal variate (SNV). When performing model transfer from a large public library (the USDA NSSCKSSL MIR library) to secondary instruments, good performance was also achieved by regular preprocessing (e. g., SNV) if both instruments shared the same manufacturer. However, significant differences between the KSSL MIR library and contrasting ring trial instruments responses were evident and confirmed by a semi-unsupervised spectral clustering. For heavily contrasting setups, spectral standardization was necessary before transferring prediction models. Non-linear model types like Cubist and memory-based learning delivered more precise estimates because they seemed to be less sensitive to spectral variations than global partial least square regression. In summary, the results from this study can assist new laboratories in building spectroscopy capacity utilizing existing MIR spectral libraries and support the recent global efforts to make soil spectroscopy universally accessible with centralized or shared operating procedures.

58 GEOSCIENCES↗

Two-Step Hyperparameter Optimization Method: Accelerating Hyperparameter Search by Using a Fraction of a Training Dataset

Abstract Hyperparameter optimization (HPO) is an important step in machine learning (ML) model development, but common practices are archaic—primarily relying on manual or grid searches. This is partly because adopting advanced HPO algorithms introduces added complexity to the workflow, leading to longer computation times. This poses a notable challenge to ML applications, as suboptimal hyperparameter selections curtail the potential of ML model performance, ultimately obstructing the full exploitation of ML techniques. In this article, we present a two-step HPO method as a strategic solution to curbing computational demands and wait times, gleaned from practical experiences in applied ML parameterization work. The initial phase involves a preliminary evaluation of hyperparameters on a small subset of the training dataset, followed by a reevaluation of the top-performing candidate models postretraining with the entire training dataset. This two-step HPO method is universally applicable across HPO search algorithms, and we argue it has attractive efficiency gains. As a case study, we present our recent application of the two-step HPO method to the development of neural network emulators for aerosol activation. Although our primary use case is a data-rich limit with many millions of samples, we also find that using up to 0.0025% of the data—a few thousand samples—in the initial step is sufficient to find optimal hyperparameter configurations from much more extensive sampling, achieving up to 135× speedup. The benefits of this method materialize through an assessment of hyperparameters and model performance, revealing the minimal model complexity required to achieve the best performance. The assortment of top-performing models harvested from the HPO process allows us to choose a high-performing model with a low inference cost for efficient use in global climate models (GCMs).

97 MATHEMATICS AND COMPUTING↗

Efforts to enhance reproducibility in a human performance research project

Background: Ensuring the validity of results from funded programs is a critical concern for agencies that sponsor biological research. In recent years, the open science movement has sought to promote reproducibility by encouraging sharing not only of finished manuscripts but also of data and code supporting their findings. While these innovations have lent support to third-party efforts to replicate calculations underlying key results in the scientific literature, fields of inquiry where privacy considerations or other sensitivities preclude the broad distribution of raw data or analysis may require a more targeted approach to promote the quality of research output. Methods: We describe efforts oriented toward this goal that were implemented in one human performance research program, Measuring Biological Aptitude, organized by the Defense Advanced Research Project Agency's Biological Technologies Office. Our team implemented a four-pronged independent verification and validation (IV&V) strategy including 1) a centralized data storage and exchange platform, 2) quality assurance and quality control (QA/QC) of data collection, 3) test and evaluation of performer models, and 4) an archival software and data repository. Results: Our IV&V plan was carried out with assistance from both the funding agency and participating teams of researchers. QA/QC of data acquisition aided in process improvement and the flagging of experimental errors. Holdout validation set tests provided an independent gauge of model performance. Conclusions: In circumstances that do not support a fully open approach to scientific criticism, standing up independent teams to cross-check and validate the results generated by primary investigators can be an important tool to promote reproducibility of results.

59 BASIC BIOLOGICAL SCIENCES↗

Application of Machine Learning and Data Augmentation Algorithms in the Discovery of Metal Hydrides for Hydrogen Storage

The development of efficient and sustainable hydrogen storage materials is a key challenge for realizing hydrogen as a clean and flexible energy carrier. Among various options, metal hydrides offer high volumetric storage density and operational safety, yet their application is limited by thermodynamic, kinetic, and compositional constraints. In this work, we investigate the potential of machine learning (ML) to predict key thermodynamic properties—equilibrium plateau pressure, enthalpy, and entropy of hydride formation—based solely on alloy composition using Magpie-generated descriptors. We significantly expand an existing experimental dataset from ~400 to 806 entries and assess the impact of dataset size and data augmentation, using the PADRE algorithm, on model performance. Models including Support Vector Machines and Gradient Boosted Random Forests were trained and optimized via grid search and cross-validation. Results show a marked improvement in predictive accuracy with increased dataset size, while data augmentation benefits are limited to smaller datasets and do not improve accuracy in underrepresented pressure regimes. Furthermore, clustering and cross-validation analyses highlight the limited generalizability of models across different material classes, though high accuracy is achieved when training and testing within a single hydride family (e.g., AB2). The study demonstrates the viability and limitations of ML for accelerating hydride discovery, emphasizing the importance of dataset diversity and representation for robust property prediction.

augmentation↗

Performance Comparison of Machine Learning Models for Ultrasonic Nondestructive Evaluation of Alkali-Silica Reaction in Concrete

Alkali-silica reaction (ASR) causes concrete degradation, leading to cracking, rebar corrosion, and reduced structural integrity, which raises safety concerns. Ultrasonic nondestructive evaluation (NDE) effectively assesses concrete properties and monitors ASR progression. However, its deployment and analysis require specialized expertise and subjective interpretation. As computational power increases, artificial intelligence (AI) and machine learning (ML) algorithms are increasingly being used to automate NDE data analysis across various industries for AI-assisted automation. Regulatory agencies are adapting to this technological shift, prompting a need to evaluate current ML technologies’ capabilities and limitations in assessing concrete material properties and damage. This report presents a comparative analysis of four ML regression models for predicting concrete material damage induced by ASR expansion using long-term ultrasonic data monitoring. The models investigated include linear regression (LR), support vector regression (SVR), shallow neural networks (NN), and deep neural networks (DNN). LR, SVR, and shallow NN models use features extracted from ultrasonic signals, whereas the DNN model processes time-domain ultrasonic signals and frequency spectra directly. The study systematically compared the models’ performance from various perspectives, including model input, prediction performance, and generalization ability. The findings indicate significant variability in model performance, with some ML algorithms achieving very high or very low prediction accuracy depending on the preprocessing and feature engineering (extraction and selection) applied. Key insights include the observation that shallow ML models (LR, SVR, and shallow NNs) require meticulous preprocessing and feature extraction to achieve high accuracy. In contrast, the DNN model, although it bypasses the need for feature engineering, necessitates extensive preprocessing to mitigate noise and computational demands. The SVR model emerged as the top performer among the shallow models, and the DNN model exhibited superior performance on specific datasets but struggled with generalization across specimens from different batches. Additionally, the SVR model is sensitive to temperature variations, whereas the DNN model is robust in this regard. Using recurrent neural networks is recommended for future ASR expansion prediction studies. Recurrent neural networks’ inherent ability to capture temporal dependencies and long-term patterns makes them well suited for analyzing sequential ultrasonic monitoring data. Overall, the results and conclusions of this study could provide insights into the capabilities and effectiveness of ML when applied to ultrasonic NDE data and help identify best practices for using ML for ultrasonic NDE of concrete material properties.

36 MATERIALS SCIENCE↗

Comparison of Fission Product Release Predictions using PARFUME and BISON with Results from the AGR-3/4 Irradiation Experiment

The PARFUME (PARticle Fuel ModEl) fuel performance modeling code and the BISON nuclear fuel performance application built on the Multiphysics Object-Oriented Simulation Environment (MOOSE) finite element library were used to predict the fission product release from tristructural isotropic (TRISO) coated fuel particles and compacts during the third and fourth irradiation experiment of the Advanced Gas Reactor (AGR-3/4) Fuel Development and Qualification Program. The fuel performance modeling codes PARFUME and BISON modeled the AGR-3/4 irradiation experiment using the fuel compact time-averaged volume averaged (TAVA) daily temperatures for a total irradiation duration of 369.1 effective full power days (EFPD) to predict the release fraction of the fission product silver (Ag-110m) from a representative TRISO-coated fuel particle from AGR-3/4 compacts. Post-irradiation examination (PIE) measurements provided data on the release of these fission products in the compacts outside of the silicon carbide (SIC) layer. The PARFUME and BISON results were then compared to the silver release measured from compact gamma scanning. The results showed good agreement between PARFUME and BISON but both codes under-predicted the silver release fraction for all the compacts. In addition, BISON was used to model and predict the fission product concentration radial profile outside of the compacts in capsules’ inner and outer rings. These rings were either comprised of matrix and/or structural graphite. To obtain the concentration profiles of silver, cesium, and strontium, a sorption isotherm model was developed in BISON to capture the effects of fission product transport across the gaps between the concentric rings. The general shape of the concentration radial profiles as calculated by BISON were similar in the inner ring (IR) but varied in the outer ring (OR) depending on the fission product of interest or capsule temperature. Using this methodology and model, BISON now has the capability to aid in developing new fission product diffusion coefficients for matrix or structural graphite materials.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Open‐source photovoltaic model pipeline validation against well‐characterized system data

Abstract All freely available plane‐of‐array (POA) transposition models and photovoltaic (PV) temperature and performance models in pvlib‐python and pvpltools‐python were examined against multiyear field data from Albuquerque, New Mexico. The data include different PV systems composed of crystalline silicon modules that vary in cell type, module construction, and materials. These systems have been characterized via IEC 61853‐1 and 61853‐2 testing, and the input data for each model were sourced from these system‐specific test results, rather than considering any generic input data (e.g., manufacturer's specification [spec] sheets or generic Panneau Solaire [PAN] files). Six POA transposition models, 7 temperature models, and 12 performance models are included in this comparative analysis. These freely available models were proven effective across many different types of technologies. The POA transposition models exhibited average normalized mean bias errors (NMBEs) within ±3%. Most PV temperature models underestimated temperature exhibiting mean and median residuals ranging from −6.5°C to 2.7°C; all temperature models saw a reduction in root mean square error when using transient assumptions over steady state. The performance models demonstrated similar behavior with a first and third interquartile NMBEs within ±4.2% and an overall average NMBE within ±2.3%. Although differences among models were observed at different times of the day/year, this study shows that the availability of system‐specific input data is more important than model selection. For example, using spec sheet or generic PAN file data with a complex PV performance model does not guarantee a better accuracy than a simpler PV performance model that uses system‐specific data.

14 SOLAR ENERGY↗

Modeling Reference Cell Performance Using Measured and Modeled Spectral Data

The performance of several silicon-based reference cells is examined under clear skies on a horizontal and two-axis tracking surface during the winter of 2022. The ratio of the calculated reference cell output to the measured reference cell output is examined. For each reference cell, when using the measured spectral data, the ratio of the estimated to measured output varies by less than +/-0.6% at the P95 level. The analysis was also done using modeled spectral values obtained from the Bird spectrl2 model. The ratio between the estimated reference cell output using the modeled spectral values to the measured reference cell output varies by +/-1.1% at the P95 level.

angle of incidence↗

Assessment and validation of NEAMS tools for high-fidelity multiphysics transient modeling of microreactors: Application of NEAMS codes to perform multiphysics modeling analyses of micro-reactor concepts

The NEAMS Multiphysics Applications team aims at providing assessment of code useability and functionality for microreactor design and analyses, together with demonstration of their capabilities to properly capture the steady-state and time-dependent behavior of different microreactor concepts. In FY-24, significant progress was achieved in improving multi-physics models of several microreactors systems: HP-MR, GC-MR and KRUSTY. These efforts focused on solving more complex multiphysics problems enabled by enhanced tools capability, verifying and validating results obtained, providing feedback to developers for suggested improvements, and sharing these models to facilitate user training. A series of new multiphysics transients were completed on the HP-MR (using Griffin/BISON/Sockeye) with core startup transient, control drum inadvertent rotation accident, and hydrogen leakage from hydride moderator (also including SWIFT). On the GC-MR, a new full-core model was developed and analyzed through a series of new multiphysics (Griffin/BISON/SAM) transients to simulate moderator leakage (also including SWIFT), flow blockage and coolant depressurization. Additional and updated TRISO failure analyses were completed on the HP-MR unit-cell and GC-MR assembly models leveraging improved TRISO modeling capabilities. The amount of SiC failure following accidental transients at end-of-life was null. However, GC-MR assembly TRISO analysis highlighted Pd penetration rate can be problematic and may require design changes on the studied microreactor concept. The neutronics discrepancies observed on the KRUSTY model in previous years were resolved using hybrid set of Monte Carlo/Deterministic cross-sections. The multiphysics (Griffin neutronics / BISON thermal-mechanics) 15₵ insertion transient simulation displayed good agreement when comparing with experimental data. Initial modeling of the 30 ₵ reactivity insertion also displays promising results. Such close agreement provides important validation data that can be leveraged by the NEAMS program and by microreactor vendors to support licensing of their technology. Finally, important experience was gathered with the NEAMS tools leading to several user feedback shared with tools developers, especially with regards to MOOSE mesh generator and Griffin. This project led to many publications demonstrating modeling capabilities, and to three models shared on the Virtual Test Bed.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗