Engineering PapersSearch

SEARCH · Engineering Papers

Results for “model evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47

Performance Comparison of Machine Learning Models for Ultrasonic Nondestructive Evaluation of Alkali-Silica Reaction in Concrete

Alkali-silica reaction (ASR) causes concrete degradation, leading to cracking, rebar corrosion, and reduced structural integrity, which raises safety concerns. Ultrasonic nondestructive evaluation (NDE) effectively assesses concrete properties and monitors ASR progression. However, its deployment and analysis require specialized expertise and subjective interpretation. As computational power increases, artificial intelligence (AI) and machine learning (ML) algorithms are increasingly being used to automate NDE data analysis across various industries for AI-assisted automation. Regulatory agencies are adapting to this technological shift, prompting a need to evaluate current ML technologies’ capabilities and limitations in assessing concrete material properties and damage. This report presents a comparative analysis of four ML regression models for predicting concrete material damage induced by ASR expansion using long-term ultrasonic data monitoring. The models investigated include linear regression (LR), support vector regression (SVR), shallow neural networks (NN), and deep neural networks (DNN). LR, SVR, and shallow NN models use features extracted from ultrasonic signals, whereas the DNN model processes time-domain ultrasonic signals and frequency spectra directly. The study systematically compared the models’ performance from various perspectives, including model input, prediction performance, and generalization ability. The findings indicate significant variability in model performance, with some ML algorithms achieving very high or very low prediction accuracy depending on the preprocessing and feature engineering (extraction and selection) applied. Key insights include the observation that shallow ML models (LR, SVR, and shallow NNs) require meticulous preprocessing and feature extraction to achieve high accuracy. In contrast, the DNN model, although it bypasses the need for feature engineering, necessitates extensive preprocessing to mitigate noise and computational demands. The SVR model emerged as the top performer among the shallow models, and the DNN model exhibited superior performance on specific datasets but struggled with generalization across specimens from different batches. Additionally, the SVR model is sensitive to temperature variations, whereas the DNN model is robust in this regard. Using recurrent neural networks is recommended for future ASR expansion prediction studies. Recurrent neural networks’ inherent ability to capture temporal dependencies and long-term patterns makes them well suited for analyzing sequential ultrasonic monitoring data. Overall, the results and conclusions of this study could provide insights into the capabilities and effectiveness of ML when applied to ultrasonic NDE data and help identify best practices for using ML for ultrasonic NDE of concrete material properties.

36 MATERIALS SCIENCE

Aeroheating model advancements featuring electroless metallic plating

Discussed are advancements in wind tunnel model construction methods and hypersonic test data demonstrating the methods. The general objective was to develop model fabrication methods for improved heat transfer measuring capability at less model cost. A plated slab model approach was evaluated with cast models containing constantan wires that formed single-wire-to-plate surface thermocouple junctions with a seamless skin of electroless nickel alloy. The surface of a space shuttle orbiter model was selectively plated with scaled tiles to simulate, with high fidelity, the probable misalignments of the heatshield tiles on a flight vehicle. Initial, Mach 8 heating results indicated a minor effect of tile misalignment roughness on boundary layer transition, implying a possible relaxation of heatshield manufacturing tolerances. Some loss of the plated tiles was experienced when the model was tested at high heating rates.

Stalmach, C. J., Jr.

Linear analysis of poststall gyrations

The poststall gyrations of a high-performance aircraft are investigated by approximating the equations of motion with a linear mathematical model. Equilibrium poststall spin conditions are determined, which are not limited to small angles or spin rates and are used as reference conditions about which the linear model is developed. As a result, complete coupling between lateral and longitudinal motions is retained. Three aerodynamic models are evaluated using this linear analysis. These models include pure rotary derivatives obtained from VPI&SU stability tunnel, forced-oscillation data obtained from NASA tests, and a combination of the two which separates the unsteady and pure rotary derivatives. Results indicate that this last model gives better predictions of aircraft motion during poststall gyrations at high angles of attack and large sideslip angles. Comparisons are made with full-scale flight test results.

Hreha, M. A.

Millimeter wave radiometry as a means of determining cometary surface and subsurface temperature

Thermal emission spectra for a variety of cometary nucleus models were evaluated by a radiative transfer technique adapted from modeling of terrestrial ice and snow fields. It appears that millimeter wave sensing from an interplanetary spacecraft is the most effective available means for distinguishing between alternate models of the nucleus and for evaluating the thermal state of the layer which is below the instantaneous surface where modern theories of the nucleus indicate that sublimation of the cometary volatiles actually occurs.

Hobbs, R. W.

Effects of different convection models upon the high-latitude ionosphere

The plasma convection models of Volland (1975) and Heelis (1982) are utilized to study the ionosphere. The parameters for the two models are evaluated. The two-cell convection models have similar total cross tail electric potential, diameter of the polar cap, and potential falloff rate outside the polar cap; however, they differ in maximum potential, and the electric field in the polar cap. The input parameters for the high-latitude ionospheric model are described. Two high-latitude ionospheric model runs were conducted and the data are compared in terms of electron density at and above the F 2 peak, attitude of the F 2 peak, ion temperature, and molecular-atomic ion transition height. The altitude dependence of electron density is analyzed using coherent scatter radar data. The data reveal differences between the two models in the height of the F 2 peak and in the ion temperature. The altitude values of the Heelis model are higher than the Volland model in the region where plasma is transported into the polar cap and lower in the region plasma is transported out of the polar cap; the Heelis model also produces an increase in ion temperature. It is noted that the ionosphere has a limited dependence upon the details of the convection models.

Rasmussen, C. E.

Reduction of interior sound fields in flexible cylinders by active vibration control

The mechanisms of interior sound reduction through active control of a thin flexible shell's vibrational response are presently evaluated in view of an analytical model. The noise source is a single exterior acoustic monopole. The active control model is evaluated for harmonic excitation; the results obtained indicate spatially-averaged noise reductions in excess of 20 dB over the source plane, for acoustic resonant conditions inside the cavity.

Jones, J. D.

Physical consistency in modeling interplanetary magnetohydrodynamic fluctuations

The validity of the Velli, Grappin and Mangeney (1989) model is evaluated. It is argued that the model is incorrect because it mixes different dynamical models, assumes weak nonlinearities, makes predictions that vary with observations, and violates causality. It is proposed that self-similar behavior in the coronal source region of the magnetohydrodynamic fluctuations cause the Kolmogorov-like spectra.

Zhou, Y.

Linear dynamic analysis of the Space Station Freedom thermal/environmental control system

A methodology for dynamic analysis of the Space Station Freedom thermal/environmental control system is described which uses linear system analysis techniques to determine the ability of the system to accommodate thermal load transients. A nonlinear integrated model of the system as it exists at Stage 6, Man Tended Capability (MTC), is described which encompasses the cabin air cooling system, avionics air cooling system, internal and external thermal control systems. The nonlinear model is linearized at an assumed design operating point, and the linear model is evaluated by comparison with the nonlinear model. Transfer functions are derived to determine the response of the heat rejection system to time-varying thermal loads applied at various points in the heat acquisition system. The frequency response calculated from the transfer functions is used to determine allowable operating envelopes of thermal load magnitude and frequency for each point of application of thermal load. The dynamic operating envelopes provide a quantitative indication of the degree and duration of peak loads which the thermal/environmental system is able to transport and reject.

Tandler, John

Overview of thermal barrier coatings in diesel engines

An understanding of delamination mechanisms in thermal barrier coatings has been developed for diesel applications through nondestructive evaluation, structural analysis modeling and engine evaluation of various thermal barrier coatings. This knowledge has resulted in improved thermal barrier coatings which survive abusive cyclic fatigue tests in high output diesel engines. Significant efforts are still required to improve the plasma spray processing capability and the economics for complex geometry diesel engine components. Data obtained from advanced diesel engines on the effect of thermal barrier coatings on engine fuel economy and emission has not been encouraging. Although the underlying metal component temperatures have been reduced through the use of thermal barrier coating, engine efficiency and emission trends have not been promising.

Yonushonis, T. M.

Finite Element Model Development For Aircraft Fuselage Structures

The ability to extend the valid frequency range for finite element based structural dynamic predictions using detailed models of the structural components and attachment interfaces is examined for several stiffened aircraft fuselage structures. This extended dynamic prediction capability is needed for the integration of mid-frequency noise control technology. Beam, plate and solid element models of the stiffener components are evaluated. Attachment models between the stiffener and panel skin range from a line along the rivets of the physical structure to a constraint over the entire contact surface. The finite element models are validated using experimental modal analysis results.

Buehrle, Ralph D.

Finite Element Model Development and Validation for Aircraft Fuselage Structures

The ability to extend the valid frequency range for finite element based structural dynamic predictions using detailed models of the structural components and attachment interfaces is examined for several stiffened aircraft fuselage structures. This extended dynamic prediction capability is needed for the integration of mid-frequency noise control technology. Beam, plate and solid element models of the stiffener components are evaluated. Attachment models between the stiffener and panel skin range from a line along the rivets of the physical structure to a constraint over the entire contact surface. The finite element models are validated using experimental modal analysis results. The increased frequency range results in a corresponding increase in the number of modes, modal density and spatial resolution requirements. In this study, conventional modal tests using accelerometers are complemented with Scanning Laser Doppler Velocimetry and Electro-Optic Holography measurements to further resolve the spatial response characteristics. Whenever possible, component and subassembly modal tests are used to validate the finite element models at lower levels of assembly. Normal mode predictions for different finite element representations of components and assemblies are compared with experimental results to assess the most accurate techniques for modeling aircraft fuselage type structures.

Buehrle, Ralph D.

Comparison of Turbulent Thermal Diffusivity and Scalar Variance Models

This paper will include a detailed comparison of heat transfer models that rely upon the thermal diffusivity. The goals are to inform users of the development history of the various models and the resulting differences in model formulations, as well as to evaluate the models on a variety of validation cases so that users might better understand which models are more broadly applicable.

turbulence models

Validation of a Two-Phase CFD Model for Autogenous Pressurization and Expulsion

This paper presents a two-phase computational fluid dynamics (CFD) model for simulating autogenous pressurization and expulsion in a cryogenic liquid hydrogen storage tank, utilizing a volume-of-fluid (VOF) approach combined with the kinetics-based Schrage equation to accurately capture the phase boundary and interfacial heat, mass, and momentum transfer between liquid and vapor phases. The model is validated against experimental data from NASA's K-site tank facility, specifically experimental case 225, which involved pressurization and controlled expulsion of liquid hydrogen. Various turbulence models are evaluated to assess their influence on model accuracy. The CFD simulations successfully replicate key thermodynamic behaviors observed during the experiments, including pressure evolution, temperature profiles, and phase-change dynamics at the vapor-liquid interface. The predicted tank pressures, temperatures, and pressurant requirements agree with experimental data, with pressurant mass predictions within 16\% of observed values. This study highlights the importance of selecting appropriate turbulence models to accurately simulate complex flow and heat transfer phenomena during tank pressurization and expulsion. By enhancing the accuracy and reliability of CFD models for liquid hydrogen under cryogenic conditions, this research contributes to developing efficient cryogenic propellant management strategies for future space missions.

Computational Fluid Dynamics

Validation of a Two-Phase CFD Model for Autogenous Pressurization and Expulsion

This paper presents a two-phase computational fluid dynamics (CFD) model for simulating autogenous pressurization and expulsion in a cryogenic liquid hydrogen storage tank, utilizing a volume-of-fluid (VOF) approach combined with the kinetics-based Schrage equation to accurately capture the phase boundary and interfacial heat, mass, and momentum transfer between vapor and liquid phases. The model is validated against experimental data from NASA's K-site tank facility, specifically experimental case 225, which involved autogenous pressurization and controlled expulsion of liquid hydrogen. Various turbulence models are evaluated to assess their influence on model accuracy. The CFD simulations successfully replicate key thermodynamic behaviors observed during the experiments, including pressure evolution, temperature profiles, and phase-change dynamics at the vapor-liquid interface. The predicted tank pressures and temperatures agree well with experimental data, whereas the pressurant mass predictions are within 16% of observed values. This study emphasizes the importance of selecting appropriate turbulence models to accurately simulate the complex flow and heat transfer phenomena during tank autogenous pressurization and expulsion. By improving the accuracy and reliability of CFD models for these processes, this research contributes to developing efficient cryogenic propellant management strategies for future space missions.

Computational Fluid Dynamics

Automating Anomaly Detection for Target systems at Spallation Neutron Source

The Spallation Neutron Source (SNS) at Oak Ridge National Laboratory, produces the world’s most intense pulse neutrons beams. An accelerated proton beam is directed into a mercury target to generate neutrons via spallation. The target system accounted for over 40% of the overall downtime of the facility in 2022. Thus, early detection in anomalies in the target systems can enable taking corrective actions to avoid failures and reduce downtime. Fault prognostics and anomaly detection in accelerators, both at SNS and outside, has largely focused on the beam side. This paper presents one the first studies exploring leveraging machine learning to automate the detection of anomalies in the target system. The target system consists of over 30 different interconnected subsystems, and the present work focuses on the mercury process system as a use case. Analyzing data from 28 process variables from 2022 and 2023, tree-based and reconstruction-based algorithms are employed to detect anomalies in archived data. The algorithms detected previously unreported anomalies, several of which were deemed alert worthy by human experts, particularly those found by reconstruction-based algorithms. Using data from each production run in the accelerator increased the generalizability of the models in time. Efforts are now underway to implement a workflow for incorporating human feedback to update the models and evaluating performance on unseen data. The models will eventually be integrated into the existing System Tracking and Reliability system with a web interface for automated anomaly detection and reporting along with a pathway for incorporating human feedback for model updates.

Raj, Anant [ORNL] (ORCID:0000000306711244)

Technical, Economic, Energetic, and Environmental Evaluation of Pretreatment Strategies for Scaling Control in Brackish Water Desalination Brine Treatment

Effective pretreatment is essential for achieving long-term stable operation and high water recovery during the desalination of alternative waters. This study developed a process modeling approach for technical, economic, energetic, and environmental assessments of pretreatment technologies to identify the impacts of each technology treating brackish water desalination brine with high scaling propensity. The model simulations evaluated individual pretreatment technologies, including chemical softening (CS), chemical coagulation (CC), electrocoagulation (EC), and ion exchange (IX). In addition, combinations of these pretreatment technologies aiming at the effective reduction of key scaling constituents such as hardness and silica were investigated. The three evaluation parameters in this assessment consist of levelized cost of water (LCOW, $/m 3 ), specific energy consumption and cumulative energy demand (SEC|CED, kWh/m 3 ), and carbon dioxide emissions (CO 2 , kg CO 2-eq /m 3 ). The case study evaluated in this work was the desalination brine from the Kay Bailey Hutchison Desalination Plant (KBHDP) with a total dissolved solids (TDS) concentration of 11,000 mg/L and rich in hardness and silica. The evaluation of individual pretreatment units from the highest to lowest LCOW, SEC|CED, and CO 2 emissions in the KBHDP brine was IX > CS > EC > CC, CS > IX > EC > CC, and CC > CS > EC > IX, respectively. In the case of pretreatment combinations for the KBHDP, the EC + IX treatment combination was shown to be the best in terms of the LCOW and CO 2 emissions. The modeling and evaluation of these pretreatment units provide valuable guidance on the selection of cost-effective, energy-efficient, and environmentally sustainable pretreatment technologies tailored to desalination brine applications for minimal- or zero-liquid discharge.

14 SOLAR ENERGY

Evaluation of a distributed catchment scale water balance model

The validity of some of the simplifying assumptions in a conceptual water balance model is investigated by comparing simulation results from the conceptual model with simulation results from a three-dimensional physically based numerical model and with field observations. We examine, in particular, assumptions and simplifications related to water table dynamics, vertical soil moisture and pressure head distributions, and subsurface flow contributions to stream discharge. The conceptual model relies on a topographic index to predict saturation excess runoff and on Philip's infiltration equation to predict infiltration excess runoff. The numerical model solves the three-dimensional Richards equation describing flow in variably saturated porous media, and handles seepage face boundaries, infiltration excess and saturation excess runoff production, and soil driven and atmosphere driven surface fluxes. The study catchments (a 7.2 sq km catchment and a 0.64 sq km subcatchment) are located in the North Appalachian ridge and valley region of eastern Pennsylvania. Hydrologic data collected during the MACHYDRO 90 field experiment are used to calibrate the models and to evaluate simulation results. It is found that water table dynamics as predicted by the conceptual model are close to the observations in a shallow water well and therefore, that a linear relationship between a topographic index and the local water table depth is found to be a reasonable assumption for catchment scale modeling. However, the hydraulic equilibrium assumption is not valid for the upper 100 cm layer of the unsaturated zone and a conceptual model that incorporates a root zone is suggested. Furthermore, theoretical subsurface flow characteristics from the conceptual model are found to be different from field observations, numerical simulation results, and theoretical baseflow recession characteristics based on Boussinesq's groundwater equation.

Troch, Peter A.

AgMIP Training in Multiple Crop Models and Tools

The Agricultural Model Intercomparison and Improvement Project (AgMIP) has the goal of using multiple crop models to evaluate climate impacts on agricultural production and food security in developed and developing countries. There are several major limitations that must be overcome to achieve this goal, including the need to train AgMIP regional research team (RRT) crop modelers to use models other than the ones they are currently familiar with, plus the need to harmonize and interconvert the disparate input file formats used for the various models. Two activities were followed to address these shortcomings among AgMIP RRTs to enable them to use multiple models to evaluate climate impacts on crop production and food security. We designed and conducted courses in which participants trained on two different sets of crop models, with emphasis on the model of least experience. In a second activity, the AgMIP IT group created templates for inputting data on soils, management, weather, and crops into AgMIP harmonized databases, and developed translation tools for converting the harmonized data into files that are ready for multiple crop model simulations. The strategies for creating and conducting the multi-model course and developing entry and translation tools are reviewed in this chapter.

farm crops