Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data base for model validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Physics model validation of propane and methane for Hydrogen Plus Other Alternative Fuels Risk Assessment Models (HyRAM+)

HyRAM+ is a toolkit that includes fast-running models for the unconstrained (i.e., no wall interactions) dispersion and flames for non-premixed fuels. The models were developed for use with hydrogen, but the toolkit was expanded to include propane and methane in a recent release. Here, in this work we validate the dispersion and flame models for these additional fuels, based on reported literature data. The validation efforts spanned a range of release conditions, from subsonic to underexpanded jets and flames for a range of mass flow rates. In general, the dispersion model works well for both propane and methane although the width of the jet/plume is predicted to be wider than observed in some cases. The flame model tends to over-predict the induced buoyancy for low-momentum flames, while the radiative heat flux agrees with the experimental data reasonably well, for both fuels. The models could be improved but give acceptable predictions for propane and methane behavior for the purposes of risk assessment.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2024

VALIDATION, VERIFICATION, AND CALIBRATION THROUGH A CAUSAL LENS

This paper presents an alternative method based on causal inference to perform validation, verification, and calibration of simulation models. While classical validation and verification approaches focus on the identification of the associations between data elements using statistical and machine learning methods, the novel methods in this paper focus instead on the identification of causal relationships between data elements. Statistical and machine learning-based approaches are strictly data-driven, meaning that they provide quantitative comparison measures between datasets without explicitly considering the hypotheses behind them. This can lead to the erroneous conclusion that, if two data sets are close enough, then the models that generated them are similar. In addition, when experimental and simulated data differ to an extent that fails to meet the acceptance criteria, calibration techniques are used to tweak simulation model parameters to reduce the gap between the two types of data. This produces the false expectation that a simulation model will match reality. The methods presented in this paper move away from these strictly data-driven methods for validation and calibration toward more robust, model-driven methods based on causal inference. Causal inference aims to identify the possible mechanisms that might have generated data. Thus, this analysis targets the prediction of the effects when one (or more) of the identified mechanisms are altered. There are many approaches to identify, quantify and illustrate causal relationships. For the scope of this paper, directed graphs are employed as causal models. If the directed graph lacks cycles it is known as a directed acyclic graph (DAG). A node in such a graph represents an observed data element while a directed edge connecting two nodes represents a causal relationship between two variables. The developed causal methods are designed to extract causal models from simulation models and from experimental data. Causal models capture the causal relationships between data elements (e.g., simulated and experimental data). In this context, validation and verification are performed by comparing causal models. The proposed approach does not only inform system analysts on how a simulation model matches real-world data, but also identifies elements of the simulation model that should be revised when discrepancies between simulation and experimental data are observed. Through these causal methods, analysts have a means to identify the portion of the model equation(s) that are behind an edge connecting two variables. Hence, once the structural differences between causal models have been determined, model calibration can occur by changing only those model parameters that impact the identified causal relationships.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Optimizing Batch Crystallization with Model-based Design of Experiments

Adaptive and self-optimizing intelligent systems such as digital twins are increasingly important in science and engineering. Digital twins utilize mathematical models to provide added precision to decision-making. However, physics-informed models are challenging to build, calibrate, and validate with existing data science methods. Model-based design of experiments (MBDoE) is a popular framework for optimizing data collection to maximize parameter precision in mathematical models and digital twins. In this work, we apply MBDoE, facilitated by the open-source package Pyomo.DoE, to train and validate mathematical models for batch crystallization. We quantitatively examined the estimability of the model parameters for experiments with different cooling rates. This analysis provides a quantitative explanation for the heuristic of using multiple experiments at different cooling rates.

Lynch, Hailey↗
DOE OSTI2023

Comparative Study and Validation of Photovoltaic Model Formulations for the IBPSA Modelica Library based on Rooftop Measurement Data

Domain-overarching system models are crucial to investigate sector coupling concepts. Specifically, the coupling of building and electrical energy systems becomes crucial to integrate renewable energy sources such as photovoltaic power systems (PV). For such interdisciplinary simulation models, Modelica is a suitable language. However, most open-source Modelica libraries are either domain-specific or lack simple-to-parameterize PV models. We close this gap by developing a PV model for the IBPSA Modelica library. The model comprises two I-V-characteristic models and three mounting-dependent approaches to calculate the cell temperature. The I-V-characteristic models follow a single- and two-diodes approach. This study uses measurement data from a rooftop PV system in Berlin, Germany, for validation. The focus lies on comparing the implemented single- and two-diodes approach. Results prove that both models accurately calculate the modules’ DC power output and cell temperature. The two-diodes approach slightly outperforms the single-diode one at the expense of a higher parameterization effort.

Maier, Laura↗
DOE OSTI2024

Inverter Model Validation and Calibration Using Phasor Measurement Unit Data

As the penetration of inverter-based renewable energy resources increases in the power grid, especially at the distribution and microgrid levels, the need to accurately represent them in planning studies increases as well. However, due to the lack of well-established standard procedures, and vendor reluctance towards the detailed sharing of proprietary models, automated dynamic model validation and parameter calibration tools for inverter based resources (IBRs) remain scarce. This work presents a model validation and parameter calibration platform for representing IBRs with generic phasor-domain models. Phasor measurements of power system events are used for continuous validation using the data playback method, and model parameters are re-calibrated if a significant mismatch between measurements and model response is observed. Unique features of the proposed platform include- (a) an iterative Bayesian optimization approach towards parameter calibration to address a possible mismatch between the structures of generic models implemented in simulation softwares and actual commercial inverters, (b) error metrics designed to account for a possible mismatch between the time resolution of simulation and measurements, and (c) analysis of the measurement-simulation mismatch to provide guidance to engineering personnel regarding model shortcomings. The performance of the platform has been illustrated using both simulated data and field measurements to validate/calibrate inverter models in GridLAB-D.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS1998

Binning for IC Quality: Experimental Studies on the SEMATECH Data

The earlier smaller bipolar study did not provide a high enough bin 0 population to directly observe test escapes and thereby estimate defect levels for the best bin. Results presented here indicate that the best bin can be reasonably expected to show a 2 - 5 factor improvement in defect levels over the average for the lot for moderate to high yields (the overall yield for these experiments was approximately 65%). The experiments also confirm the dependence of the best bin quality on test transparency. The defect level improvement is poorer for the case Of IDDQ escapes where the tests applied had a much higher escape rate. Overall experimental results are consistent with analytical projections for typical values of the clustering parameter in [9]. The final version of this paper will include extensive analysis to validate the analytical models based on this data.

Singh, Adit D.↗
NASA NTRSDate not supplied

Validation of A Simulation Environment for Future Space Traffic Management

This study presents initial results of a newly developed simulation environment intendedto explore and assess future Space Traffic Management (STM) scenarios. The number ofnew Resident Space Objects (RSOs) in near-Earth orbit is expected to increase significantlywith the expected future deployment of a number of large constellations. These futurescenarios involve the addition of many tens of thousands of new RSOs, making the analysisinto their impact on collision risk extend beyond what traditional data-mining of present-dayconjunction data can reliably predict. To address this, a robust simulation environment wasdeveloped that implements a full force-model for orbit propagation, and computes continuousall-on-all conjunction statistics for arbitrarily large catalog sizes and simulation timeframes.Collision avoidance and station-keeping maneuvers can be optionally implemented based onconfigurable user inputs including physical characteristics and spacecraft meta-data (e.g.,commercial/government, owner country, etc.). Constellation build-out and de-orbit scenarioswere also implemented and modeled based on real-data analysis. Validation of the simulationresults was a critical component of the simulation development, and was done using the currentcatalog with comparisons against both public and internal NASA data-sets. The comparisonsdemonstrate that, with the appropriate settings, representative levels of conjunction ratesand probabilities can be obtained, providing confidence that the simulation tool can generatemeaningful outcomes for test scenarios. As an initial demonstration of the tool’s capabilities,year-long simulations with station-keeping were conducted to examine conjunction historiesusing both the current object catalog (5800 active satellites) and a hypothetical 60,000 objectscenario involving five potential large constellations. Output metrics include the number ofconjunction events, estimates of collision consequence (fragmentation), delta-V maneuver costs,and the probability of at least one collision occurring. The results highlight the potential thatthe simulation tool has for incorporating and running performance comparisons between, e.g.,various sets of maneuver guidelines, industry norms, and definitions of risk, with the overallobjective of providing actionable data to STM policy makers. The presentation will providean overview of the simulation development and validation efforts, as well as a discussion ofobservations gathered from the initial simulations performed.

conjunction assessment↗
NASA NTRSDate not supplied

Modeling Low-G Slosh Using Negative Mass

The modeling of the behavior of fluids in low- or microgravity is a field with little validated data but of great interest to space agencies and companies in the face of humanity’s expanding presence beyond low Earth orbit. Efforts to refuel and repair satellites in geostationary orbit require an understanding of the behavior of sloshing fuel in microgravity. The stability of remote sensing equipment and satellites depends on robust fluid slosh dampening or very accurate modeling, and the Artemis program includes the refueling of large landing systems in its architecture. However, current methodologies are quite binary: either use a relatively low-accuracy equivalent mechanical model or use computational fluid dynamics which are not practical for onboard systems due to their relatively high computational cost. In this work, a novel method of tracking the bubble rather than tracking the fuel itself is presented. Computational fluid dynamics simulations are used to validate the model based on available experimental data, and the dynamics of a refueler spacecraft based on Gateway’s Logistics Module are simulated both for the sloshing case and without sloshing considered.

Matthew M. Wittal↗
DOE OSTI2025

Validation of Photovoltaic Modeling Tool Solargraf Against Measured Data

Solargraf is a cloud-based 3D design tool by Enphase Energy that allows users to design solar and storage systems with a variety of elements. Through a Cooperative Research and Development Agreement (CRADA), Enphase Energy collaborated with the National Renewable Energy Laboratory (NREL) to validate Solargraf's 3D design simulation against measured PV system performance. This study follows the same methodology of similar validation studies completed at NREL. The predicted performance results from simulations in both Solargraf and NREL's System Advisor Model (SAM) tool were compared with measured data to evaluate performance predictions.

14 SOLAR ENERGY↗
NASA NTRS1978

Computational Fluid Dynamics (CFD): Future role and requirements as viewed by an applied aerodynamicist

The problem of designing the wing-fuselage configuration of an advanced transonic commercial airliner and the optimization of a supercruiser fighter are sketched, pointing out the essential fluid mechanical phenomena that play an important role. Such problems suggest that for a numerical method to be useful, it must be able to treat highly three dimensional turbulent separations, flows with jet engine exhausts, and complex vehicle configurations. Weaknesses of the two principal tools of the aerodynamicist, the wind tunnel and the computer, suggest a complementing combined use of these tools, which is illustrated by the case of the transonic wing-fuselage design. The anticipated difficulties in developing an adequate turbulent transport model suggest that such an approach may have to suffice for an extended period. On a longer term, experimentation of turbulent transport in meaningful cases must be intensified to provide a data base for both modeling and theory validation purposes.

Yoshihara, H.↗
NASA NTRS1986

Shuttle Continuous Open Wind Tunnel (SCOWT)

The aerodynamic and heat transfer coefficients are studied within the range of thermo-fluid-dynamic conditions experienced by a satellite during Tethered Satellite System (TSS) atmospheric flights. The gasdynamic processes occuring downstream of the bow wave standing in front of the satellite are also studied. The knowledge of the chemistry and physics of the upper atmosphere related to satellite aerothermodynamics is furthered. The existence of an overshooting of the air drag coefficient of the sphere in the transition regime is validated. A complete set of measurements is performed in order to provide the data base to develop and validate theoretical models of free molecule transition flow fields.

Carlomagno, G. M.↗
NASA NTRS1990

Analytical aerodynamic model of a high alpha research vehicle wind-tunnel model

A 6 DOF analytical aerodynamic model of a high alpha research vehicle is derived. The derivation is based on wind-tunnel model data valid in the altitude-Mach flight envelope centered at 15,000 ft altitude and 0.6 Mach number with Mach range between 0.3 and 0.9. The analytical models of the aerodynamics coefficients are nonlinear functions of alpha with all control variable and other states fixed. Interpolation is required between the parameterized nonlinear functions. The lift and pitching moment coefficients have unsteady flow parts due to the time range of change of angle-of-attack (alpha dot). The analytical models are plotted and compared with their corresponding wind-tunnel data. Piloted simulated maneuvers of the wind-tunnel model are used to evaluate the analytical model. The maneuvers considered are pitch-ups, 360 degree loaded and unloaded rolls, turn reversals, split S's, and level turns. The evaluation finds that (1) the analytical model is a good representation at Mach 0.6, (2) the longitudinal part is good for the Mach range 0.3 to 0.9, and (3) the lateral part is good for Mach numbers between 0.6 and 0.9. The computer simulations show that the storage requirement of the analytical model is about one tenth that of the wind-tunnel model and it runs twice as fast.

Cao, Jichang↗
NASA NTRS1992

Vibro-Acoustic FE Analyses of the Saab 2000 Aircraft

A finite element model of the Saab 2000 fuselage structure and interior cavity has been created in order to compute the noise level in the passenger cabin due to propeller noise. Areas covered in viewgraph format include the following: coupled acoustic/structural noise; data base creation; frequency response analysis; model validation; and planned analyses.

Green, Inge S.↗
NASA NTRS2017

Model-Based Thermal System Design Optimization for the James Webb Space Telescope

Spacecraft thermal model validation is normally performed by comparing model predictions with thermal test data and reducing their discrepancies to meet the mission requirements. Based on thermal engineering expertise, the model input parameters are adjusted to tune the model output response to the test data. The end result is not guaranteed to be the best solution in terms of reduced discrepancy and the process requires months to complete. A model-based methodology was developed to perform the validation process in a fully automated fashion and provide mathematical bases to the search for the optimal parameter set that minimizes the discrepancies between model and data. The methodology was successfully applied to several thermal subsystems of the James Webb Space Telescope (JWST). Global or quasiglobal optimal solutions were found and the total execution time of the model validation process was reduced to about two weeks. The model sensitivities to the parameters, which are required to solve the optimization problem, can be calculated automatically before the test begins and provide a library for sensitivity studies. This methodology represents a crucial commodity when testing complex, large-scale systems under time and budget constraints. Here, results for the JWST Core thermal system will be presented in detail.

Cataldo, Giuseppe↗
NASA NTRS1995

Ground-based grasslands data to support remote sensing and ecosystem modeling of terrestrial primary production

Estimating terrestrial net primary production (NPP) using remote-sensing tools and ecosystem models requires adequate ground-based measurements for calibration, parameterization, and validation. These data needs were strongly endorsed at a recent meeting of ecosystem modelers organized by the International Geosphere-Biosphere Program's (IGBP's) Data and Information System (DIS) and its Global Analysis, Interpretation, and Modelling (GAIM) Task Force. To meet these needs, a multinational, multiagency project is being coordinated by the IGBP DIS to compile existing NPP data from field sites and to regionalize NPP point estimates to various-sized grid cells. Progress at Oak Ridge National Laboratory (ORNL) on compiling NPP data for grasslands as part of the IGBP DIS data initiative is described. Site data and associated documentation from diverse field studies are being acquired for selected grasslands and are being reviewed for completeness, consistency, and adequacy of documentation, including a description of sampling methods. Data are being compiled in a database with spatial, temporal, and thematic characteristics relevant to remote sensing and global modeling. NPP data are available from the ORNL Distributed Active Archive Center (DAAC) for biogeochemical dynamics. The ORNL DAAC is part of the Earth Observing System Data and Information System, of the US National Aeronautics and Space Administration.

Olson, R. J.↗
DOE OSTI2023

HPC-Enabled Optimization of High Temperature Heat Exchangers (CRADA Final Report)

This project was a collaborative effort between Lawrence Livermore National Security, LLC (LLNS) as manager and operator of Lawrence Livermore National Laboratory (LLNL) and Materials Sciences, LLC, to develop a technology for design and optimization of heat exchangers using powerful desktop and laptop computers. The project was originally designated as a 12-month project, and consisted of 3# major tasks and the following 8# major deliverables: 1) CFD models of 3D heat exchangers based on existing and new geometry. 2) Validation against experimental data provided by MSC and published in the literature. 3) CFD models of 3D unit cells based on TPMS. 4) Surrogate models capable of delivering the gradients of the homogenized properties with respect to the parametrization. 5) 3D design methodology using TO algorithms. 6) Conventional reference and topology optimized designs. 7) 3D optimized designs stored in a 3D printer build format. 8) Verification of the improved performance. All of the deliverables for this project were successfully completed with two no-cost time extensions.

36 MATERIALS SCIENCE↗
DOE OSTI2026

HPC-Enabled Optimization of High Temperature Heat Exchangers (CRADA Final Report)

This project was a collaborative effort between Lawrence Livermore National Security, LLC (LLNS) as manager and operator of Lawrence Livermore National Laboratory (LLNL) and Materials Sciences, LLC, to develop a technology for design and optimization of heat exchangers using powerful desktop and laptop computers. The project was originally designated as a 12-month project, and consisted of 3# major tasks and the following 8# major deliverables: 1) CFD models of 3D heat exchangers based on existing and new geometry. 2) Validation against experimental data provided by MSC and published in the literature. 3) CFD models of 3D unit cells based on TPMS. 4) Surrogate models capable of delivering the gradients of the homogenized properties with respect to the parametrization. 5) 3D design methodology using TO algorithms. 6) Conventional reference and topology optimized designs. 7) 3D optimized designs stored in a 3D printer build format. 8) Verification of the improved performance. All of the deliverables for this project were successfully completed with two no-cost time extensions.

13 HYDRO ENERGY↗
NASA NTRS2023

Evaluating Greenland Surface-Mass-Balance and Firn-Densification Data Using ICESat-2 Altimetry

Surface-mass-balance (SMB) and firn-densification (FD) models are widely used in altimetry studies as a tool to separate atmospheric-driven from ice-dynamics-driven ice-sheet mass changes and to partition observed volume changes into ice-mass changes and firn-air-content changes. Until now, SMB models have been principally validated based on comparison with ice core and weather station data or comparison with widely separated flight radar-survey flight lines. Firn-densification models have been primarily validated based on their ability to match net densification over decades, as recorded in firn cores, and the short-term time-dependent component of densification has rarely been evaluated at all. The advent of systematic ice-sheet-wide repeated ice-surface-height measurements from ICESat-2 (the Ice Cloud, and land Elevation Satellite, 2) allows us to measure the net surface-height change of the Greenland ice sheet at quarterly resolution and compare the measured surface-height differences directly with those predicted by three FD–SMB models: MARv3.5.11 (Modèle Atmosphérique Régional version 3.5.11) and GSFCv1.1 and GSFCv1.2 (the Goddard Space Flight Center FD–SMB models version 1.1 and 1.2). By segregating the data by season and elevation, and based on the timing and magnitude of modelled processes in areas where we expect minimal ice-dynamics-driven height changes, we investigate the models' accuracy in predicting atmospherically driven height changes. We find that while all three models do well in predicting the large seasonal changes in the low-elevation parts of the ice sheet where melt rates are highest, two of the models (MARv3.5.11 and GSFCv1.1) systematically overpredict, by around a factor of 2, the magnitude of height changes in the high-elevation parts of the ice sheet, particularly those associated with melt events. This overprediction seems to be associated with the melt sensitivity of the models in the high-elevation part of the ice sheet. The third model, GSFCv1.2, which has an updated high-elevation melt parameterization, avoids this overprediction.

Benjamin E. Smith↗