Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,171 records · Page 65

Uncertainty Propagation Analysis of Computational Models in Laser Powder Bed Fusion Additive Manufacturing Using Polynomial Chaos Expansions

Computational models for simulating physical phenomena during laser-based powder bed fusion additive manufacturing (L-PBF AM) processes are critical for enhancing our understanding of these phenomena, enable process optimization, and accelerate qualification and certification of AM materials and parts. It is a well-known fact that such models typically involve multiple sources of uncertainty that originate from different sources such as model parameters uncertainty, or model/code inadequacy, among many others. Uncertainty quantification (UQ) is a broad field that focuses on characterizing such uncertainties in order to maximize the benefit of these models. Although UQ has been a center theme in computational models associated with diverse fields such as computational fluid dynamics and macro-economics, it has not yet been fully exploited with computational models for advanced manufacturing. The current study introduces one among the first efforts to conduct uncertainty propagation (UP) analysis in the context of L-PBF AM. More specifically, we present a generalized polynomial chaos expansions (gPCE) framework to assess the distributions of melt pool dimensions due to uncertainty in input model parameters. We develop the methodology and then employ it to validate model predictions, both through benchmarking them against Monte Carlo (MC) methods and against experimental data acquired from an experimental testbed.

36 MATERIALS SCIENCE↗

Experimental and Modeling Studies of the Combustion Characteristics of Conventional and Alternative Jet Fuels. Final Report

The objectives of this project have been to develop a comprehensive set of fundamental data regarding the combustion behavior of jet fuels and appropriately associated model fuels. Based on the fundamental study results, an auxiliary objective was to identify differentiating characteristics of molecular fuel components that can be used to explain different fuel behavior and that may ultimately be used in the planning and design of optimal fuel-production processes. The fuels studied in this project were Fischer-Tropsch (F-T) fuels and biomass-derived jet fuels that meet certain specifications of currently used jet propulsion applications. Prior to this project, there were no systematic experimental flame data available for such fuels. One of the key goals has been to generate such data, and to use this data in developing and verifying effective kinetic models. The models have then been reduced through automated means to enable multidimensional simulation of the combustion characteristics of such fuels in real combustors. Such reliable kinetic models, validated against fundamental data derived from laminar flames using idealized flow models, are key to the development and design of optimal combustors and fuels. The models provide direct information about the relative contribution of different molecular constituents to the fuel performance and can be used to assess both combustion and emissions characteristics.

Meeks, Ellen↗

On the Reconstruction of Palaeo-Ice Sheets: Recent Advances and Future Challenges

Reconstructing the growth and decay of palaeo-ice sheets is critical to understanding mechanisms of global climate change and associated sea-level fluctuations in the past, present and future. The significance of palaeo-ice sheets is further underlined by the broad range of disciplines concerned with reconstructing their behaviour, many of which have undergone a rapid expansion since the 1980s. In particular, there has been a major increase in the size and qualitative diversity of empirical data used to reconstruct and date ice sheets, and major improvements in our ability to simulate their dynamics in numerical ice sheet models. These developments have made it increasingly necessary to forge interdisciplinary links between sub-disciplines and to link numerical modelling with observations and dating of proxy records. The aim of this paper is to evaluate recent developments in the methods used to reconstruct ice sheets and outline some key challenges that remain, with an emphasis on how future work might integrate terrestrial and marine evidence together with numerical modelling. Our focus is on pan-ice sheet reconstructions of the last deglaciation, but regional case studies are used to illustrate methodological achievements, challenges and opportunities. Whilst various disciplines have made important progress in our understanding of ice-sheet dynamics, it is clear that data-model integration remains under-used, and that uncertainties remain poorly quantified in both empirically-based and numerical ice-sheet reconstructions. The representation of past climate will continue to be the largest source of uncertainty for numerical modelling. As such, palaeo-observations are critical to constrain and validate modelling. State-of-the-art numerical models will continue to improve both in model resolution and in the breadth of inclusion of relevant processes, thereby enabling more accurate and more direct comparison with the increasing range of palaeo-observations. Thus, the capability is developing to use all relevant palaeo-records to more strongly constrain deglacial (and to a lesser extent pre-LGM) ice sheet evolution. In working towards that goal, the accurate representation of uncertainties is required for both constraint data and model outputs. Close cooperation between modelling and data-gathering communities is essential to ensure this capability is realised and continues to progress.

Ice sheet reconstruction↗

Machine Learning based Aircraft Performance Model Estimation for Trajectory Prediction

The accurate prediction of aircraft trajectory by ground-based decision support tools is a critical component of air traffic management in the US National Airspace System (NAS). Accurate predictions of where the aircraft will be in the future or when they will arrive at specific locations (e.g., fixes) is a key enabler for sequencing and efficient arrival management of flights. Traditional physics based aircraft trajectory prediction relies on a simplified point-mass total energy model whose parameters are referred to as Aircraft Performance Model (APM) parameters. Even though the performance coefficients and weight of an aircraft are a vital part of the aircraft performance model’s predictions and accuracy, these coefficients are proprietary in nature and therefore, unavailable to decision-support tools. Current approaches freeze some coefficients to default base of aircraft data (BADA) values and optimize others. However, the APM parameters are highly coupled by the flight dynamics and prioritizing one parameter over others leads to bias and skewed predictions. To alleviate this problem, we provide a combined optimization framework to predict all the critical (thrust, drag and weight) APM parameters. This paper is focused on training Machine Learning (ML) models that map historical flights to optimized APM parameters that provide the best fit (in terms of prediction error). Our dataset obtained from NASA’s Sherlock data warehouse is comprised of thousands of historical flights and includes weather and track data collected from 2019. Using different subsets of relevant features (e.g., aircraft type), we trained several ML models to estimate the aircraft’s take off weight, drag polar coefficients (both parasitic and lift induced), and thrust settings (multiplier applied to the maximum engine thrust). The chosen flights are from three of the most common aircraft types (B738, B737, and A320) arriving at four airports (LAX, DEN, MSP, and DFW). Our ML approach is comprised of two different solutions: 1- using a subset of features that are known prior to the flight departure and do not change during flight (such as engine type, current temperature at departure & destination airports, aircraft type) and 2 - using a subset of temporal features of the flight trajectory (such as cruise altitude, Mach, airspeed, and rate of climb) in addition to the pre-departure features from the first solution. The labels or target variables are the APM parameters that were obtained by an optimized ordinary differential equations (ODE) fitting process (applied to individual flights). The ODE-fitting is very time intensive and is therefore performed offline. Thus, training an ML model to learn the relationship between the flight features and ODE-generated labels enables faster estimation of the APM parameters and is therefore amenable to real-time prediction. Various ML models including linear regression, random forest, XGBoost, and neural network were trained, and the results are compared. After model validation and hyperparameter-tuning, we observed that the Random Forest model outperformed the other three models by the overall mean square error (MSE) of 2% for the first solution and 1.5% for the second solution. Finally, the ML-derived parameters are compared against default BADA APM parameters using NASA’s Autonomy Development toolkit (ADK) simulation software. The simulation results for one of each aircraft type is shown and discussed.

Aida Sharif Rohani↗

Validation of Community Models: 2. Development of a Baseline, Using the Wang-Sheeley-Arge Model

This paper is the second in a series providing independent validation of community models of the outer corona and inner heliosphere. Here I present a comprehensive validation of the Wang-Sheeley-Arge (WSA) model. These results will serve as a baseline against which to compare the next generation of comparable forecasting models. The WSA model is used by a number of agencies to predict Solar wind conditions at Earth up to 4 days into the future. Given its importance to both the research and forecasting communities, it is essential that its performance be measured systematically and independently. I offer just such an independent and systematic validation. I report skill scores for the model's predictions of wind speed and interplanetary magnetic field (IMF) polarity for a large set of Carrington rotations. The model was run in all its routinely used configurations. It ingests synoptic line of sight magnetograms. For this study I generated model results for monthly magnetograms from multiple observatories, spanning the Carrington rotation range from 1650 to 2074. I compare the influence of the different magnetogram sources and performance at quiet and active times. I also consider the ability of the WSA model to forecast both sharp transitions in wind speed from slow to fast wind and reversals in the polarity of the radial component of the IMF. These results will serve as a baseline against which to compare future versions of the model as well as the current and future generation of magnetohydrodynamic models under development for forecasting use.

MacNeice, Peter↗

Validation of implosion modeling through direct-drive shock timing experiments at the National Ignition Facility

Precise modeling of shocks in inertial confinement fusion implosions is critical for obtaining the desired compression in experiments. Shock velocities and post-shock conditions are determined by laser-energy deposition, heat conduction, and equations of state. This paper describes experiments at the National Ignition Facility (NIF) where multiple shocks are launched into a cone-in-shell target made of polystyrene, using laser pulse shapes with two or three pickets and varying on-target intensities. Shocks are diagnosed using the Velocity Interferometric System for Any Reflector diagnostic. Simulated and inferred shock velocities agree well for the range of intensities studied in this work. These results are the first shock-velocity measurements using direct drive on the NIF and provide a good measure of early-time, directly driven laser-energy coupling. Furthermore, the validated models add to the credibility of direct-drive-ignition designs at the megajoule scale.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Dynamic Model of Basic Oxygen Steelmaking Process Based on Multi-zone Reaction Kinetics: Model Derivation and Validation

A multi-zone kinetic model coupled with a dynamic slag generation model was developed for the simulation of hot metal and slag composition during the basic oxygen furnace (BOF) operation. The three reaction zones (i) jet impact zone, (ii) slag–bulk metal zone, (iii) slag–metal–gas emulsion zone were considered for the calculation of overall refining kinetics. In the rate equations, the transient rate parameters were mathematically described as a function of process variables. A micro and macroscopic rate calculation methodology (micro-kinetics and macro-kinetics) were developed to estimate the total refining contributed by the recirculating metal droplets through the slag–metal emulsion zone. The micro-kinetics involves developing the rate equation for individual droplets in the emulsion. The mathematical models for the size distribution of initial droplets, kinetics of simultaneous refining of elements, the residence time in the emulsion, and dynamic interfacial area change were established in the micro-kinetic model. In the macro-kinetics calculation, a droplet generation model was employed and the total amount of refining by emulsion was calculated by summing the refining from the entire population of returning droplets. A dynamic Fe{sub t}O generation model based on oxygen mass balance was developed and coupled with the multi-zone kinetic model. The effect of post-combustion on the evolution of slag and metal composition was investigated. The model was applied to a 200-ton top blowing converter and the simulated value of metal and slag was found to be in good agreement with the measured data. The post-combustion ratio was found to be an important factor in controlling Fe{sub t}O content in the slag and the kinetics of Mn and P in a BOF process.

36 MATERIALS SCIENCE↗

Event-by-Event Evaluation of the Prompt Fission Neutron Spectrum From 239 Pu(n,f)

We have developed an improved evaluation method for the spectrum of neutrons emitted in fission of 239 Pu induced by incident neutrons with energies up to 20 MeV. The <v> covariance data, including incident energy correlations introduced by the <v> evaluation method, were used to fix the input parameters in our event-by-event model of fission, FREYA, by applying formal statistical methods. Formal estimates of uncertainties in the evaluation were developed by randomly sampling model inputs and calculating likelihood functions based on agreement with the evaluated <v>. Our approach is able to employ a greater variety of fission measurements than the relatively coarse spectral data alone. It also allows the study of numerous fission observables for more accurate model validation. The combination of an event-by-event Monte Carlo fission model with a statistical-likelihood analysis is thus a powerful tool for evaluation of fission-neutron data. Our empirical model FREYA follows the complete fission event from birth of the excited fragments through their decay via neutron emission until the fragment excitation energy is below the neutron separation energy when neutron emission can no longer occur. The most recent version of FREYA incorporates pre-equilibrium neutron emission, the emission of the first neutron before equilibrium is reached in the compound nucleus, and multi-chance fission, neutron evaporation prior to fission when the incident neutron energy is above the neutron separation energy. Energy, momentum, charge and mass number are conserved throughout the fission process. The best available values of fragment masses and total kinetic energies are used as inputs to FREYA. We fit three parameters that are not well under control from previous measurements: the shift in the total fragment kinetic energy; the energy scale of the asymptotic level density parameter, controlling the fragment 'temperature' for neutron evaporation; and the relative excitation of the light and heavy fragments, governing the number and energy of neutrons emitted from each fragment. The latter two parameters are assumed to be independent of the incident neutron energy while the first varies with incident energy. We describe our method and the subsequent spectral evaluation and present the results of several standard validation calculations that test our new evaluation. These benchmarks include critical assemblies, sensitive to criticality in fast systems; pulsed sphere measurements testing the spectra at incident neutron energies of 14 MeV; and other tests.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Validation of hydrogen gas stratification and mixing models

Two validation benchmarks confirm that the BMIX++ code is capable of simulating unintended hydrogen release scenarios efficiently. The BMIX++ (UC Berkeley mechanistic MIXing code in C++) code has been developed to accurately and efficiently predict the fluid mixture distribution and heat transfer in large stratified enclosures for accident analyses and design optimizations. The BMIX++ code uses a scaling based one-dimensional method to achieve large reduction in computational effort compared to a 3-D computational fluid dynamics (CFD) simulation. Two BMIX++ benchmark models have been developed. One is for a single buoyant jet in an open space and another is for a large sealed enclosure with both a jet source and a vent near the floor. Both of them have been validated by comparisons with experimental data. Excellent agreements are observed. The entrainment coefficients of 0.09 and 0.08 are found to fit the experimental data for hydrogen leaks with the Froude number of 99 and 268 best, respectively. In addition, the BIX++ simulation results of the average helium concentration for an enclosure with a vent and a single jet agree with the experimental data within a margin of about 10% for jet flow rates ranging from 1.21 × 10⁻⁴ to 3.29 × 10⁻⁴ m³/s. In conclusion, computing time for each BMIX++ model with a normal desktop computer is less than 5 min.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

ATMOSPHERIC CIRCULATION OF HOT JUPITERS: A SHALLOW THREE-DIMENSIONAL MODEL

Remote observing of exoplanetary atmospheres is now possible, offering us access to circulation regimes unlike any of the familiar solar system cases. Atmospheric circulation models are being developed to study these new regimes but model validations and intercomparisons are needed to establish their consistency and accuracy. To this end, we present a simple Earth-like validation of the pseudospectral solver of meteorological equations called Intermediate General Circulation Model (IGCM), based on Newtonian relaxation to a prescribed latitudinal profile of equilibrium temperatures. We then describe a straightforward and idealized model extension to the atmospheric flow on a hot Jupiter with the same IGCM solver. This shallow, three-dimensional hot Jupiter model is based on Newtonian relaxation to a permanent day-night pattern of equilibrium temperatures and the absence of surface drag. The baroclinic regime{sup 1} of the Earth's lower atmosphere is contrasted with the more barotropic regime of the simulated hot Jupiter flow. For plausible conditions at the 0.1-1 bar pressure level on HD 209458b, the simulated flow is characterized by unsteadiness, subsonic wind speeds, a zonally perturbed superrotating equatorial jet and large-scale polar vortices. Violation of the Rayleigh-Kuo inflexion point criterion on the flanks of the accelerating equatorial jet indicates that barotropic (horizontal shear) instabilities may be important dynamical features of the simulated flow. Similarities and differences with previously published simulated hot Jupiter flows are briefly noted.

99 GENERAL AND MISCELLANEOUS↗

Comparison of Analytical and Numerical Performance Predictions for a Regenerative Heat Exchanger in the International Space Station Node 3 Internal Active Thermal Control System

The complexity of International Space Station (ISS) systems modeling often necessitates the concurrence of various dissimilar, parallel analysis techniques to validate modeling. This was the case with a feasibility and performance study of the ISS Node 3 Regenerative Heat Exchanger (RHX). A thermo-hydraulic network model was created and analyzed in SINDA/FLUINT. A less complex, closed form solution of the system dynamics was created using Excel. The purpose of this paper is to provide a brief description of the modeling processes utilized, the results and benefits of each to the ISS Node 3 RHX study.

Wise, Stephen A.↗

Comparison of Analytical and Numerical Performance Predictions for an International Space Station Node 3 Internal Active Thermal Control System Regenerative Heat Exchanger

The complexity of International Space Station (ISS) systems modeling often necessitates the concurrence of various dissimilar, parallel analysis techniques to validate modeling. This was the case with a feasibility and performance study of the ISS Node 3 Regenerative Heat Exchanger (RHX). A thermo-hydraulic network model was created and analyzed in SINDA/FLUINT. A less complex, closed form solution of the systems dynamics was created using an Excel Spreadsheet. The purpose of this paper is to provide a brief description of the modeling processes utilized, the results and benefits of each to the ISS Node 3 RHX study.

Wise, Stephen A.↗

Structural Test and Analysis of a Hybrid Inflatable Antenna

NASA is developing ultra-lightweight structures technology for communication antennas for space missions. One of the research goals is to evaluate the structural characteristics of inflatable and rigidizable antennas through test and analysis. Being able to test and analyze the structural characteristics of a full scale antenna is important to enable the simulation of various mission scenarios to determine system performance in space. Recent work completed to evaluate a Hybrid Inflatable Antenna concept will be discussed. Tests were completed on a 2-m prototype to optimize its static shape and identify its modal dynamics that are important for analytical model validation. These test results were used to evaluate a preliminary finite element model of the antenna, and this model development and correlation activity is also described in the paper.

Gaspar, James L.↗

Numerical Model Development and Validation for the WECCOMP Control Competition: Preprint

This paper details the development and validation of a numerical model of the Wavestar wave energy converter (WEC) in WEC-Sim. This numerical model was developed in support of the WEC Control Competition (WECCCOMP), an open competition with the objective of maximizing WEC power production through innovative control strategies. WECCCOMP has two stages: numerical implementation of control strategies, and experimental implementation. The work presented in this paper is for support of the stage one numerical implementation, where contestants are provided a WEC-Sim model of the Wavestar device to develop their control algorithms.

16 TIDAL AND WAVE POWER↗

“Max-tech FHR”: What is the maximum technically achievable water delivery capacity from a single 120 V plug?

Electrifying water heating will require affordable, direct drop-in replacements for existing gas water heaters that meet consumer expectations for hot water delivery. For many replacement scenarios, affordability requires a replacement option with like-for-like physical product dimensions, and existing consumer expectations presume a large delivery capacity from a small water heater. This work explores the technical potential for hot water delivery capacity for a heat pump water heater (HPWH) powered from a common 120 V plug. Delivery capability in this work is quantified by two metrics: the First Hour Rating (FHR) defined in the Code of Federal Regulations, and a real-world draw profile that resulted in hot water runout during field studies of 120 V HPWHs. The work focuses on the common “tall-and-slim” gas water heater product category, with external product dimensions of 20 inch diameter and 60 inch height. Using a simulation model in DOE/ORNL Heat Pump Design Model, validated by experimental baseline testing of a commercially available 120 V HPWH model, several measures were evaluated to maximize the delivery capacity of a 120 V HPWH. The 120 V HPWH was constrained by 1) external product dimensions of 20 in diameter and 60 inch height, 2) electrical power of 1.5 kW (85% of the available power from a dedicated 120 V, 15 A circuit), and 3) commercially-available components. The measures implemented included a large compressor, a pumped loop with plate heat exchanger to maximize tank stratification, enlarged heat exchangers, and relatively thin insulation to maximize the water storage volume.

Gluesenkamp, Kyle↗

Active Aeroelastic Wing Aerodynamic Model Development and Validation for a Modified F/A-18A

A new aerodynamic model has been developed and validated for a modified F/A-18A used for the Active Aeroelastic Wing (AAW) research program. The goal of the program was to demonstrate the advantages of using the inherent flexibility of an aircraft to enhance its performance. The research aircraft was an F/A-18A with wings modified to reduce stiffness and a new control system to increase control authority. There have been two flight phases. Data gathered from the first flight phase were used to create the new aerodynamic model. A maximum-likelihood output-error parameter estimation technique was used to obtain stability and control derivatives. The derivatives were incorporated into the National Aeronautics and Space Administration F-18 simulation, validated, and used to develop new AAW control laws. The second phase of flights was used to evaluate the handling qualities of the AAW aircraft and the control law design process, and to further test the accuracy of the new model. The flight test envelope covered Mach numbers between 0.85 and 1.30 and dynamic pressures from 600 to 1250 pound-force per square foot. The results presented in this report demonstrate that a thorough parameter identification analysis can be used to improve upon models that were developed using other means. This report describes the parameter estimation technique used, details the validation techniques, discusses differences between previously existing F/A-18 models, and presents results from the second phase of research flights.

Cumming, Stephen B.↗

Statistical and Neural Network for Real Sensor-Data-Driven Anomaly Detection in Nuclear Applications

Anomaly detection (AD) in sensor data is critical to ensure uninterrupted functionality of nuclear power plants (NPPs). Consequently, AD model validation through real-world sensor data is important for applications in nuclear facilities. In this paper, we propose an Autoencoder (AE)—a multi-layered neural network, for AD in sensor data from an operational NPP testbed. Since the dataset lacks labels for irregularities, we introduce random noise and label them to effectively train our model. The proposed AE model assigns a higher reconstruction error to the abnormal samples that deviate from those encountered during the training phase and uses the reconstruction loss to detect anomalies in a representative imbalanced dataset. We also introduce an analytical solution—seasonal trend decomposition (STD)—as another AD scheme for identifying irregularities withinthe same time-series dataset. In contrast to the AE model which relies on reconstruction loss, the STD scheme decomposes the entire dataset into its trend, seasonality, and residual components to pinpoint irregularities. Our findings indicate that the proposed AE and STD models individually achieve recall scores of 97% and 92%, respectively. We validate the performance of the two models on both balanced and imbalanced data. We further solidify the results by picking the combined selected anomalies of the two solutions with an "AND" operator for more reliable predictions.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗