Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “MODEL VALIDATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Model validation - A connection between robust control and identification

The gap between the models used in control synthesis and those obtained from identification experiments is considered by investigating the connection between uncertain models and data. The model validation problem addressed is: given experimental data and a model with both additive noise and norm-bounded perturbations, is it possible that the model could produce the observed input-output data? This problem is studied for the standard H-infinity/mu framework models. A necessary condition for such a model to describe an experimental datum is obtained. For a large class of models in the robust control framework, this condition is computable as the solution of a quadratic optimization problem.

Smith, Roy S.↗

Bennu Shape Model Validation Methods and Results

The OSIRIS-REx Independent Shape Modeling Team, staffed by the Jet Propulsion Laboratory (JPL), has used stereophotoclinometry (SPC) to produce a three-dimensional shape model of Bennu. The SPC process is informed by (but is separate from) orbit determination, so it is important to ensure that the resulting shape model is consistent with all available spacecraft tracking data. Specifically, checking the shape model’s consistency with LIDAR measurements can illuminate any discrepancies, because LIDAR measurements are highly correlated with the shape model. This study focuses on the JPL experience with these LIDAR measurements and the greater context of the shape model validation process.

Lauretta, Dante S.↗

Medium-Scale Methanol Pool Fire Model Validation

In this work, medium scale (30 cm diameter) methanol pool fires were simulated using the latest fire modeling suite implemented in Sierra/Fuego, a low Mach number multiphysics reacting flow code. The sensitivity of model outputs to various model parameters was studied with the objective of providing model validation. This work also assesses model performance relative to other recently published large eddy simulations (LES) of the same validation case. Two pool surface boundary conditions were simulated. The first was a prescribed fuel mass flux and the second used an algorithm to predict mass flux based on a mass and energy balance at the fuel surface. Gray gas radiation model parameters (absorption coefficients and gas radiation sources) were varied to assess radiant heat losses to the surroundings and pool surface. The radiation model was calibrated by comparing the simulated radiant fraction of the plume to experimental data. The effects of mesh resolution were also quantified starting with a grid resolution representative of engineering type fire calculations and then uniformly refining that mesh in the plume region. Simulation data were compared to experimental data collected at the University of Waterloo and the National Institute of Standards and Technology (NIST). Validation data included plume temperature, radial and axial velocities, velocity temperature turbulent correlations, velocity velocity turbulent correlations, radiant and convective heat fluxes to the pool surface, and plume radiant fraction. Additional analyses were performed in the pool boundary layer to assess simulated flame anchoring and the effect on convective heat fluxes. This work assesses the capability of the latest Fuego physics and chemistry model suite and provides additional insight into pool fire modeling for nonluminous, non-sooting flames.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

ISS Stage 12A Post-Flight Modal Analysis, Model Validation and Correlation

This paper summarizes the on-orbit structural dynamic data and the related modal analysis, model validation and correlation performed for the ISS configurations spanning ISS Stage 12A. The objective of this analysis is to validate and correlate analytical models used to verify the ISS critical interface dynamic loads and improve its fatigue life prediction. On-Orbit dynamic responses were measured during the ISS configurations throughout ISS Stage 12A by the two main ISS instrumentation systems; Internal Wireless Instrumentation System (IWIS) and the Structural Dynamic Measurement System (SDMS). These nominal on-orbit events include Russian vehicle docking and undockings. Also, the ISS photogrammetric system recorded the movements of the 2A and 4A solar arrays during a modified ISS maneuver. Modal analyses were performed on the measured data to extract modal parameters including frequency, damping and mode shapes. Correlation and comparisons between the test and analytical frequencies and mode shapes were performed to assess the accuracy of the analytical models for the ISS configurations under consideration.

Fitzpatrick, Kristin↗

Highly Accurate Experimental Heave Decay Tests with a Floating Sphere: A Public Benchmark Dataset for Model Validation of Fluid–Structure Interaction

Highly accurate and precise heave decay tests on a sphere with a diameter of 300 mm were completed in a meticulously designed test setup in the wave basin in the Ocean and Coastal Engineering Laboratory at Aalborg University, Denmark. The tests were dedicated to providing a rigorous benchmark dataset for numerical model validation. The sphere was ballasted to half submergence, thereby floating with the waterline at the equator when at rest in calm water. Heave decay tests were conducted, wherein the sphere was held stationary and dropped from three drop heights: a small drop height, which can be considered a linear case, a moderately nonlinear case, and a highly nonlinear case with a drop height from a position where the whole sphere was initially above the water. The precision of the heave decay time series was calculated from random and systematic standard uncertainties. At a 95% confidence level, uncertainties were found to be very low—on average only about 0.3% of the respective drop heights. Physical parameters of the test setup and associated uncertainties were quantified. A test case was formulated that closely represents the physical tests, enabling the reader to do his/her own numerical tests. The paper includes a comparison of the physical test results to the results from several independent numerical models based on linear potential flow, fully nonlinear potential flow, and the Reynolds-averaged Navier–Stokes (RANS) equations. A high correlation between physical and numerical test results is shown. The physical test results are very suitable for numerical model validation and are public as a benchmark dataset.

42 ENGINEERING↗

A Framework for Model Validation and Calibration of Microgrid Components Using PMU Data

This paper presents a framework for phasor measurement-based component model validation and calibration islanded microgrids, with emphasis on grid-forming inverters. Real measurements from the Plum Island microgrid facility are used to calibrate the model of a commercial inverter in the open-source phasor-based distribution system simulator GridLAB-D.Limitations of current distribution system simulators in replicating the behavior of commercial inverters are also identified.

microgrid, Synchrophasor data, model validation↗

Multi-component testing using HZ-PAN and AgZ-PAN Sorbents for OSPREY Model validation

In efforts to further develop the capability of the Off-gas SeParation and RecoverY (OSPREY) model, multi-component tests were completed using both HZ-PAN and AgZ-PAN sorbents. The primary purpose of this effort was to obtain multi-component xenon and krypton capacities for comparison to future OSPREY predicted multi-component capacities using previously acquired Langmuir equilibrium parameters determined from single component isotherms. Experimental capacities were determined for each sorbent using two feed gas compositions of 1000 ppmv xenon and 150 ppmv krypton in either a helium or air balance. Test temperatures were consistently held at 220 K and the gas flowrate was 50 sccm. Capacities were calculated from breakthrough curves using TableCurve® 2D software by Jandel Scientific. The HZ-PAN sorbent was tested in the custom designed cryostat while the AgZ-PAN was tested in a newly installed cooling apparatus. Previous modeling validation efforts indicated the OSPREY model can be used to effectively predict single component xenon and krypton capacities for both engineered form sorbents. Results indicated good agreement with the experimental and predicted capacity values for both krypton and xenon on the sorbents. Overall, the model predicted slightly elevated capacities for both gases which can be partially attributed to the estimation of the parameters and the uncertainty associated with the experimental measurements. Currently, OSPREY is configured such that one species adsorbs and one does not (i.e. krypton in helium). Modification of OSPREY code is currently being performed to incorporate multiple adsorbing species and non-ideal interactions of gas phase species with the sorbent and adsorbed phases. Once these modifications are complete, the sorbent capacities determined in the present work will be used to validate OSPREY multicomponent adsorption predictions.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Model Validation and its Crucial Roles in Connecting Space Weather Research, Operations, and End-User Needs

Model validation is indispensable to transitioning a model from research to operations. In this presentation, we focus on the performance of models for specific operational purposes/user needs, which include careful selection of the corresponding specific Essential Space Environment Quantity (ESEQ) and a proper set of metrics. Initial results of our community-wide validation efforts under the COSPAR ISWAT Initiative with relevance to surface charging and internal charging will be shown. We will highlight processes involved in performing such tasks, such as setting up unified guidelines, data preparation, assessment using different metrics, etc. We will also present setbacks and challenges associated with such efforts so further progress can be made.

Yihua Zheng↗

Modeling, Validation, and Control of the IEA‐15 MW Reference Wind Turbine and VolturnUS‐S Platform

This paper presents the acausal modeling, validation, and control of floating offshore wind turbines (FOWTs). The model simulates the IEA‐15 MW reference turbine and the semi‐submersible VolturnUS‐S platform utilizing a Control‐oriented, Reconfigurable, and Acausal Floating Turbine Simulator (CRAFTS), which integrates the key coupled aero‐hydro‐elasto‐servo dynamics and is being developed by authors at the University of Central Florida. Verification and validation are conducted using numerical data from the industry‐standard simulation platform OpenFAST and experimental data from the Floating Offshore‐wind and Controls Advanced Laboratory (FOCAL) project, in which the authors were involved. Numerical results demonstrate the model's ability to qualitatively capture loads and responses across various load cases, highlighting the impact of the control system under different wind and wave conditions and opening new opportunities for optimizing FOWT designs. This paper provides wind turbine researchers with valuable insights into system characteristics, system frequencies, damping effects, and internal reaction forces, serving as a reference for future studies in FOWT modeling and control.

17 WIND ENERGY↗

Recent DIII-D advances in runaway electron measurement and model validation

Novel measurements and modeling of runaway electron (RE) dynamics in DIII-D have resolved experimental discrepancies and validated predictions for ITER, improving confidence that RE avoidance and mitigation can be predictably achieved. Considering RE formation, first experimental assessments of the RE seed current demonstrates that present hot-tail theories are not yet accurate and require improved treatment of the pellet dynamics. Novel measurements of kinetic instabilities in the MHz-range have been made in the RE formation phase, with the intensity of these modes correlated with previously unexplained empirical thresholds for RE generation. Controlled RE dissipation experiments in quiescent regimes have validated RE distribution function dependencies on collisional and synchrotron damping, both in terms of distribution function shape and dissipation rates. Measurements of RE bremsstrahlung and synchrotron emission are now used in tandem to resolve energy and pitch-angle effects. A resolution to long-standing dissipation anomalies in the quiescent regime is offered by taking into account kinetic instability effects on RE phase-space dynamics. Kinetic instabilities in the 100–200 MHz range are directly observed, though modeling finds the largest dissipation arises from GHz range instabilities that are beyond the reach of existing diagnostics. Kinetic instabilities are also observed in the mature post-disruption RE plateau phase, so long as the collisional damping rate is reduced with low-Z injection. Experiments with high-Z injection find that the dissipation rate saturates with injection quantity, likely due to neutral diffusion rates being slower than vertical instability rates in DIII-D. Considering the final loss, a 0D model for first-wall Joule heating is found to be in agreement with experiment, and controlled access to RE equilibria with edge safety factor of two identifies novel dynamics brought about by large-scale kink instabilities. These dynamics are typified by fast (tens of microseconds) RE loss rates without RE beam regeneration. The above measurements and comparison with theory represent significant advances in the understanding of RE dynamics and indicate possible new opportunities for RE avoidance or mitigation via kinetic instabilities.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Dynamic Model Validation with Governor Deadband on the Eastern Interconnection

This report documents the efforts to perform dynamic model validation on the Eastern Interconnection (EI) by modeling governor deadband. An on-peak EI dynamic model is modified to represent governor deadband characteristics. Simulation results are compared with synchrophasor measurements collected by the Frequency Monitoring Network (FNET/GridEye). The comparison shows that by modeling governor deadband the simulated frequency response can closely align with the actual system response.

dynamic↗

Solar Sail Model Validation from Echo Trajectories

The NASA In-Space Propulsion program has been engaged in a project to increase the technology readiness of solar sails. Recently, these efforts came to fruition in the form of several software tools to model solar sail guidance, navigation and control. Furthermore, solar sails are one of five technologies competing for the New Millennium Program Space Technology 9 flight demonstration mission. The historic Echo 1 and Echo 2 balloons were comprised of aluminized Mylar, which is the near-term material of choice for solar sails. Both spacecraft, but particularly Echo 2, were in low Earth orbits with characteristics similar to the proposed Space Technology 9 orbit. Therefore, the Echo balloons are excellent test cases for solar sail model validation. We present the results of studies of Echo trajectories that validate solar sail models of optics, solar radiation pressure, shape and low-thrust orbital dynamics.

Heaton, Andrew F.↗

Earth as an Extrasolar Planet: Earth Model Validation Using EPOXI Earth Observations

The EPOXI Discovery Mission of Opportunity reused the Deep Impact flyby spacecraft to obtain spatially and temporally resolved visible photometric and moderate resolution near-infrared (NIR) spectroscopic observations of Earth. These remote observations provide a rigorous validation of whole disk Earth model simulations used to better under- stand remotely detectable extrasolar planet characteristics. We have used these data to upgrade, correct, and validate the NASA Astrobiology Institute s Virtual Planetary Laboratory three-dimensional line-by-line, multiple-scattering spectral Earth model (Tinetti et al., 2006a,b). This comprehensive model now includes specular reflectance from the ocean and explicitly includes atmospheric effects such as Rayleigh scattering, gas absorption, and temperature structure. We have used this model to generate spatially and temporally resolved synthetic spectra and images of Earth for the dates of EPOXI observation. Model parameters were varied to yield an optimum fit to the data. We found that a minimum spatial resolution of approx.100 pixels on the visible disk, and four categories of water clouds, which were defined using observed cloud positions and optical thicknesses, were needed to yield acceptable fits. The validated model provides a simultaneous fit to the Earth s lightcurve, absolute brightness, and spectral data, with a root-mean-square error of typically less than 3% for the multiwavelength lightcurves, and residuals of approx.10% for the absolute brightness throughout the visible and NIR spectral range. We extend our validation into the mid-infrared by comparing the model to high spectral resolution observations of Earth from the Atmospheric Infrared Sounder, obtaining a fit with residuals of approx.7%, and temperature errors of less than 1K in the atmospheric window. For the purpose of understanding the observable characteristics of the distant Earth at arbitrary viewing geometry and observing cadence, our validated forward model can be used to simulate Earth s time dependent brightness and spectral properties for wavelengths from the far ultraviolet to the far infrared.brightness

Robinson, Tyler D.↗

Optial Experiments and Model Validation of Perturbed Starshade Designs

Starshades are a leading technology to enable the direct detection and spectroscopic characterization of Earth- like exoplanets. Critical starshade technologies are currently being advanced through the S5 Project and at the Princeton starshade testbed. We report on the status of Milestone 2 of the S5 Project, optical model validation. We present results from optical experiments of starshades with intentional perturbations built into their design. These perturbations are representative of the type of perturbations possible in a flight design and serve as points of validation for dffraction models and error budgets. We show experimental results for two perturbed shapes, a mask with all petals shifted radially outward by 5 um and a mask with shallow sine waves built into two petals. We compare these data to outputs of the optical model and demonstrate better than 25% agreement. We also present images taken in crossed polarized light and use those data to constrain physical parameters of the optical edge. Bringing in previously obtained results for other perturbed shapes, we show an agreement between experiment and model of better than 25% and argue that this satisfies the Milestone 2 criteria.

Galvin, Michael↗

Crystal Plasticity Model Validation Using Combined High-Energy Diffraction Microscopy Data for a Ti-7Al Specimen

High-Energy Diffraction Microscopy (HEDM) is a 3-d x-ray characterization method that is uniquely suited to measuring the evolving micromechanical state and microstructure of polycrystalline materials during in situ processing. The near-field and far-field configurations provide complementary information; orientation maps computed from the near-field measurements provide grain morphologies, while the high angular resolution of the far-field measurements provide intergranular strain tensors. The ability to measure these data during deformation in situ makes HEDM an ideal tool for validating micro-mechanical deformation models that make their predictions at the scale of individual grains. Crystal Plasticity Finite Element Models (CPFEM) are one such class of micro-mechanical models. While there have been extensive studies validating homogenized CPFEM response at a macroscopic level, a lack of detailed data measured at the level of the microstructure has hindered more stringent model validation efforts. Here, we utilize an HEDM dataset from an alphatitanium alloy (Ti-7Al), collected at the Advanced Photon Source, Argonne National Laboratory, under in situ tensile deformation. The initial microstructure of the central slab of the gage section, measured via near-field HEDM, is used to inform a CPFEM model. The predicted intergranular stresses for 39 internal grains are then directly compared to data from 4 far-field measurements taken between ~4% and ~80% of the macroscopic yield strength. In conclusion, the intergranular stresses from the CPFEM model and far-field HEDM measurements up to incipient yield are shown to be in good agreement, and implications for application of such an integrated computational/experimental approach to phenomena such as fatigue and crack propagation is discussed.

36 MATERIALS SCIENCE↗

NESC Peer Review of Exploration Systems Development (ESD) Integrated Vehicle Modal Test, Model Correlation, Development Flight Instrumentation (DFI) and Flight Loads Readiness; Uncertainty Propagation for Model Validation Sub-task

This report details a sub-task (regarding Uncertainty Propagation for Model Validation) from a NASA Engineering and Safety Center assessment that is a multi-year activity spanning the complete development of the Space Launch System integrated vehicle structural dynamic models, and the development of the certification of flight readiness for the Artemis 1 and Artemis 2 vehicles and their variants.

Exploration Systems Development; Development Fligh↗

System Advisor Model: Flat Plate Photovoltaic Performance Modeling Validation Report

The System Advisor Model (SAM) is a free software tool that performs detailed analysis of both system performance and system financing for a variety of renewable energy technologies. This report provides detailed validation of the SAM flat plate photovoltaic performance model by comparing SAM-modeled PV system generation data to actual measured production data for nine PV systems ranging from 75 kW to greater than 25 MW in size. The results show strong agreement between SAM predictions and field data, with annualized prediction error below 3% for all fixed tilt cases and below 8% for all one axis tracked cases. The analysis concludes that snow cover and system outages are the primary sources of disagreement, and other deviations resulting from seasonal biases in the irradiation models and one axis tracking issues are discussed in detail.

14 SOLAR ENERGY↗