Model testing for design evaluation of major components and configurations of static test and launch facilities.
Model testing for design evaluation of major components and configurations of static test and launch facilities, noting hot jet model
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Model testing for design evaluation of major components and configurations of static test and launch facilities, noting hot jet model
Sea-salt aerosol global models are typically evaluated against concentration observations at coastal stations that are unaffected by local surf conditions and thus considered representative of open ocean conditions. Despite recent improvements in sea-salt source functions, studies still show significant model errors in specific regions. Using a multiscale model, we investigated the effect of high model resolution (0.1deg x 0.1deg vs. 1deg x 1.4deg) upon sea-salt patterns in four stations from the University of Miami Network: Baring Head, Chatam Island, and Invercargill in New Zealand, and Marion Island in the sub-antarctic Indian Ocean. Normalized biases improved from +63.7% to +3.3% and correlation increased from 0.52 to 0.84. The representation of sea/land interfaces, mesoscale circulations, and precipitation with the higher resolution model played a major role in the simulation of annual concentration trends. Our results recommend caution when comparing or constraining global models using surface concentration observations from coastal stations.
Nuclear data evaluation methods conventionally make the following assumptions: prior and posterior probability distribution functions (PDFs) of all model parameters and data are normal (Gaussian); the linear approximation is sufficiently accurate for minimization of a cost function (even for non-linear models); and that both the model (of, e.g., neutron cross section) and experimental data (including their covariance data) are perfect. These assumptions are inherent to the well-known generalized linear least squares (GLLS) minimization method commonly used for evaluations of resolved resonance region (RRR) neutron cross sections. However, these assumptions are often not justified due to the presence of non-normal PDFs, non-linear models (e.g. R -matrix formalism), and inherent imperfections in data and models (e.g. discrepant data sets, discrepancies between the previous evaluation and newly measured data, or imperfect covariance data). We remove the said assumptions in a mathematical framework of Bayes’ theorem, and implement it using the Metropolis-Hastings Monte Carlo method. Parameters of a new kind are introduced to parameterize inherent imperfections, e.g. , any discrepancies between the theoretical model and measured data. These new parameters enable evaluators to quantify their expert judgement about any discrepancies or imperfections in a reproducible manner. We demonstrate the framework with an ongoing evaluation of 233 U in the eV region using the ENDF-B/VIII library and transmission data measured by Guber, et al. , and compare the posterior parameters to those obtained by conventional evaluation methods.
The National Infrastructure Simulations and Analysis Center (NISAC) conducted a literature review on modeling cyber networks and evaluating cyber risks. The literature review explores where modeling is used in the cyber regime and ways that consequence and risk are evaluated. The relevant literature clusters in three different spaces: network security, cyber-physical, and mission assurance. In all approaches, some form of modeling is utilized at varying levels of detail, while the ability to understand consequence varies, as do interpretations of risk. This document summarizes the different literature viewpoints and explores their applicability to securing enterprise networks.
The accuracy of the Porcelli sawtooth model is evaluated using realistic numerical calculations for a DIII-D [J. L. Luxon, Nucl. Fusion 42, 614 (2002)] experiment with neutral beam injection and fast wave heating. Simulation results confirm that beam ions accelerated by the fast waves play a crucial role in delaying the normal sawtooth crash and inducing giant sawteeth with large amplitude and long period. A single giant sawtooth period was analyzed in detail in an effort to evaluate the efficacy of the Porcelli model in quantitatively predicting a particular sawtooth crash by evaluating the model through the sawtooth period using equilibria reconstructed from the discharge data. The kinetic stabilizing contribution of fast trapped ions is found to depend strongly on both the experimentally reconstructed magnetic shear at the q=1 surface (s{sub 1}) and the calculated poloidal beta of trapped beam ions inside the q=1 surface. To within estimates of the error from the equilibrium reconstructions and the simulation fast ion particle statistics, the results are consistent with the observed sawtooth crash. The calculations indicate that the sawtooth crash is ultimately triggered by the resistive kink in the ion-kinetic regime after the stabilizing contribution from the fast ions is reduced due to an increase in s{sub 1} as the discharge evolves.
The Greenland Ice Sheet's (GrIS) firn layer buffers the ice sheet's contribution to sea level rise by storing meltwater in its pore space. However, available pore space and meltwater retention capability is lost due to ablation of the firn layer and refreezing of meltwater as near-surface ice slabs in the firn. Understanding how firn properties respond to climate is important for constraining the GrIS's future contribution to sea level rise in a warming climate. Observations of firn density provide detailed information about firn properties, but they are spatially and temporally limited. Here we use two firn models, the physics-based SNOWPACK model and the Community Firn Model configured with a semi-empirical densification equation (CFM-GSFC), to quantify firn properties across the GrIS from 1980 through 2020. We use an identical forcing (Modern-Era Retrospective Analysis for Research and Applications, version 2 (MERRA-2) atmospheric reanalysis) for SNOWPACK and the CFM-GSFC in order to isolate firn model differences. To evaluate the models, we compare simulated firn properties, including firn air content (FAC), to measurements from the Surface Mass Balance and Snow on Sea Ice Working Group (SUMup) dataset of snow and firn density. Both models perform well (mean absolute percentage errors of 14 % in SNOWPACK and 16 % in the CFM-GSFC), though their performance is hindered by the spatial resolution of the atmospheric forcing. In the ice-sheet-wide simulations, the 1980–1995 average spatially integrated FAC (i.e., air volume in the firn) for the upper 100 m is 34 645 km 3 from SNOWPACK and 28 581 km 3 from the CFM-GSFC. The discrepancy in the magnitude of the modeled FAC stems from differences in densification with depth and variations in the sensitivity of the models to atmospheric forcing. In more recent years (2005–2020), both models simulate substantial depletion of pore space. During this period, the spatially integrated FAC across the entire GrIS decreases by 3.2 % (−66.6 km 3 yr −1 ) in SNOWPACK and 1.5 % (−17.4 km 3 yr −1 ) in the CFM-GSFC. These differing magnitudes demonstrate how model differences propagate throughout the FAC record. Over the full modeled record (1980–2020), SNOWPACK simulates a loss of pore space equivalent to 3 mm of sea level rise buffering, while the CFM-GSFC simulates a loss of 1 mm. The greatest depletion in FAC is along the margins and especially along the western margin where observations and models show the formation of near-surface, low-permeability ice slabs that may inhibit meltwater storage.
Abstract Land surface models (LSMs) play a crucial role in elucidating water and carbon cycles by simulating processes such as plant transpiration and evaporation from bare soil, yet calibration often relies on comparing LSM outputs of landscape total evapotranspiration ( ET ) and discharge with measured bulk fluxes. Discrepancies in partitioning into component fluxes predicted by various LSMs have been noted, prompting the need for improved evaluation methods. Stable water isotopes serve as effective tracers of component hydrologic fluxes, but data and model integration challenges have hindered their widespread application. Leveraging National Ecological Observation Network measurements of water isotope ratios at 16 US sites over 3 years combined with LSM‐modeled fluxes, we employed an isotope‐enabled mass balance framework to simulate ET isotope values ( δET ) within three operational LSMs (Mosaic, Noah, and VIC) to evaluate their partitioning. Models simulating δET values consistent with observations were deemed more reflective of water cycling in these ecosystems. Mosaic exhibited the best overall performance (Kling‐Gupta Efficiency of 0.28). For both Mosaic and Noah there were robust correlations between bare soil evaporation fraction and error (negative) as well as transpiration fraction and error (positive). We found the point at which errors are smallest ( x ‐intercept of the multi‐site regression) is at a higher transpiration fraction than is currently specified in the models. Which means that transpiration fraction is underestimated on average. Stable isotope tracers offer an additional tool for model evaluation and identifying areas for improvement, potentially enhancing LSM simulations and our understanding of land‐surface hydrologic processes.
Stellar population synthesis (SPS) provides the link between the stellar and dust content of galaxies and their observed spectral energy distributions. In the present work, we perform a comprehensive calibration of our own flexible SPS (FSPS) model against a suite of data. These data include ultraviolet, optical, and near-IR photometry, surface brightness fluctuations, and integrated spectra of star clusters in the Magellanic Clouds (MCs), M87, M31, and the Milky Way (MW), and photometry and spectral indices of both quiescent and post-starburst galaxies at z {approx} 0. Several public SPS models are intercompared, including the models of Bruzual and Charlot (BC03), Maraston (M05), and FSPS. The relative strengths and weaknesses of these models are evaluated, with the following conclusions: (1) the FSPS and BC03 models compare favorably with MC data at all ages, whereas M05 colors are too red and the age dependence is incorrect; (2) all models yield similar optical and near-IR colors for old metal-poor systems, and yet they all provide poor fits to the integrated J - K and V - K colors of both MW and M31 star clusters; (3) FSPS is able to fit all of the ultraviolet data because both the post-asymptotic giant branch (post-AGB) and horizontal branch evolutionary phases are handled flexibly, while the BC03 and M05 models fail in the far-UV, and both far- and near-UV, respectively; (4) all models predict ugr colors too red, D{sub n}4000 strengths too strong, and Hdelta{sub A} strengths too weak compared to massive red sequence galaxies, under the assumption that such galaxies are composed solely of old metal-rich stars; and (5) FSPS and, to a lesser extent, BC03 can reproduce the optical and near-IR colors of post-starburst galaxies, while M05 cannot. Reasons for these discrepancies are explored. The failure at predicting the ugr colors, D{sub n}4000, and Hdelta{sub A} strengths can be explained by some combination of a minority population of metal-poor stars, young stars, blue straggler and/or blue horizontal branch (HB) stars, but not by appealing to inadequacies in either theoretical stellar atmospheres or canonical evolutionary phases (e.g., the main-sequence turnoff). The different model predictions in the near-IR for intermediate age systems are due to different treatments of the thermally pulsating asymptotic giant branch stellar evolutionary phase. We emphasize that due to a lack of calibrating star cluster data in regions of the metallicity-age plane relevant for galaxies, all of these models continue to suffer from serious uncertainties that are difficult to quantify.
Abstract Regional convection‐permitting model simulations of cloud populations observed during the 2011 Atmospheric Radiation Measurement (ARM) Madden‐Julian Oscillation Investigation Experiment/Dynamics of the Madden‐Julian Oscillation Experiment (AMIE/DYNAMO) field campaign are evaluated against ground‐based radar and ship‐based observations. Sensitivity of model simulated reflectivity, surface rain rate, and cold pool statistics to variations of raindrop breakup/self‐collection parameters in four state‐of‐the‐art two‐moment bulk microphysics schemes in the Weather Research and Forecasting (WRF) model is examined. The model simulations generally overestimate reflectivity from large and deep convective cells, and underestimate stratiform rain and the frequency of cold pools. In the sensitivity experiments, introduction of more aggressive raindrop breakup or decreasing the self‐collection efficiency increases the cold pool occurrence frequency in all of the simulations, and slightly reduces the reflectivity and precipitation statistics bias in some schemes but has little effect on the overall mean surface precipitation. Both the radar observations and model simulations of cloud populations show an approximate power law relationship between convective echo‐top height and equivalent convective cell radius.
The nature and origin of organic aerosol in the atmosphere remain unclear. The gas–particle partitioning of semi-volatile organic compounds (SVOCs) that constitute primary organic aerosols (POAs) and the multigenerational chemical aging of SVOCs are particularly poorly understood. The volatility basis set (VBS) approach, implemented in air quality models such as WRF-Chem (Weather Research and Forecasting model with Chemistry), can be a useful tool to describe emissions of POA and its chemical evolution. However, the evaluation of model uncertainty and the optimal model parameterization may be expensive to probe using only WRF-Chem simulations. Gaussian process emulators, trained on simulations from relatively few WRF-Chem simulations, are capable of reproducing model results and estimating the sources of model uncertainty within a defined range of model parameters. In this study, a WRF-Chem VBS parameterization is proposed; we then generate a perturbed parameter ensemble of 111 model runs, perturbing 10 parameters of the WRF-Chem model relating to organic aerosol emissions and the VBS oxidation reactions. This allowed us to cover the model's uncertainty space and to compare outputs from each run to aerosol mass spectrometer observations of organic aerosol concentrations and O:C ratios measured in New Delhi, India. The simulations spanned the organic aerosol concentrations measured with the aerosol mass spectrometer (AMS). However, they also highlighted potential structural errors in the model that may be related to unsuitable diurnal cycles in the emissions and/or failure to adequately represent the dynamics of the planetary boundary layer. While the structural errors prevented us from clearly identifying an optimized VBS approach in WRF-Chem, we were able to apply the emulator in the following two periods: the full period (1–29 May) and a subperiod period of 14:00–16:00 h LT (local time) on 1–29 May. The combination of emulator analysis and model evaluation metrics allowed us to identify plausible parameter combinations for the analyzed periods. We demonstrate that the methodology presented in this study can be used to determine the model uncertainty and to identify the appropriate parameter combination for the VBS approach and hence to provide valuable information to improve our understanding of OA production.
We evaluate the ability of future data sets to discriminate among different quintessence dark energy models. This approach gives an alternative (and complementary) measure for assessing the impact of future experiments, as compared with the large body of literature that compares experiments in abstract parameter spaces (such as the well-known w{sub 0}-w{sub a} parameters) and more recent work that evaluates the constraining power of experiments on individual parameter spaces of specific quintessence models. We use the Dark Energy Task Force (DETF) models of future data sets and compare the discriminative power of experiments designated by the DETF as stages 2, 3, and 4 (denoting increasing capabilities). Our work reveals a minimal increase in discriminating power when comparing stage 3 to stage 2, but a very striking increase in discriminating power when going to stage 4 (including the possibility of completely eliminating some quintessence models). We also see evidence that even modest improvements over DETF stage 4 (which many believe are realistic) could result in even more dramatic discriminating power among quintessence dark energy models. We develop and demonstrate the technique of using the independently measured modes of the equation of state (derived from principle component analysis) as a common parameter space in which to compare the different quintessence models, and we argue that this technique is a powerful one. We use the PNGB, Exponential, Albrecht-Skordis, and Inverse Tracker (or inverse power law) quintessence models for this work. One of our main results is that the goal of discriminating among these models sets a concrete measure on the capabilities of future dark energy experiments. Experiments have to be somewhat better than DETF stage 4 simulated experiments to fully meet this goal.
The Xanthos-Lake v1.0 dataset provides the input data, trained machine-learning models, and simulation outputs needed to characterize lake water balance, snow and ice conditions, and mixing-layer temperature within the Xanthos global hydrological modeling framework. The dataset supports lake representation across a wide range of lake sizes and hydroclimatic conditions by combining xLSIM, a basin-specific machine-learning emulator of lake snow, ice, ice-cover fraction, and mixing-layer temperature, with the Xanthos-Lake water-balance model. The archive contains NetCDF datasets used to train and evaluate xLSIM, trained model weights, processed meteorological and lake-property inputs, and basin- and lake-category-specific simulation outputs. These materials are organized into four primary data groups, described below. Snowice_model_inputs: Contains the NetCDF input data used to train xLSIM. The xLSIM machine-learning framework uses three lake-based datasets. The meteorological forcing dataset provides monthly relative humidity, specific humidity, surface wind speed, maximum and minimum air temperature, downward longwave and shortwave radiation, snowfall, surface air pressure, and total precipitation. Lake surface area is included as an additional static predictor. The target-state dataset provides lake ice thickness, snow depth, snow cover, and lake mixing-layer temperature, while a companion lake-surface dataset provides the lake ice-cover fraction. Before training, ice thickness and snow depth are converted from meters to centimeters, mixing-layer temperature is converted from kelvin to degrees Celsius and constrained to nonnegative values, and ice-cover fraction is converted from a fraction to a percentage. The predictor variables are normalized using statistics calculated across the selected lakes and time steps. Snowice_model_outputs: Contains the NetCDF outputs generated by xLSIM. For each basin, xLSIM produces a file containing observed and predicted lake-state variables for the training, validation, and testing periods. The modeled variables include lake ice thickness, snow depth, snow cover, mixing-layer temperature, and lake ice-cover fraction. For basins without a sufficiently persistent snow-and-ice signal, the emulator predicts only mixing-layer temperature. The outputs also include training and validation loss histories, the selected model configuration, identifiers of the lakes used in training, and SHAP-based feature-importance information at the global, lake, and seasonal-regime levels. The trained machine-learning model weights are provided separately within the dataset archive. Together, these files support model evaluation and subsequent coupling with the Xanthos-Lake water-balance framework. XanthosLAKES: Contains the NetCDF input data used by the Xanthos-Lake framework. Monthly meteorological inputs include relative and specific humidity, downward shortwave and longwave radiation, mean, maximum, and minimum air temperature, wind speed, precipitation, snowfall, and surface air pressure. Static lake-property datasets provide lake identifiers, geographic locations, surface area, volume, mean depth, elevation, drainage area, fetch, outlet-routing information, and associated Xanthos grid-cell attributes. Separate bathymetric datasets provide the coefficients of the area–depth and volume–depth relationships for each aggregated lake unit. GLEV-based records provide observed lake surface area and evaporation data used to initialize lake states, define reference conditions, and calibrate and evaluate the model. Xanthos-Lake Outputs: Contains the basin- and lake-category-specific NetCDF outputs generated by Xanthos-Lake. Monthly variables include lake surface area, storage volume, outlet discharge, evaporation rate, evaporation volume, lake–groundwater exchange, lake inflow, ice thickness, snow depth, snow-cover fraction, ice-cover fraction, and mixing-layer temperature. The files also contain lake-specific calibration and validation statistics, including normalized root-mean-square error, mean absolute error, Nash–Sutcliffe efficiency, Kling–Gupta efficiency, and percent bias. Stored calibrated and derived parameters include the weir discharge coefficient, fractional freeboard, groundwater exchange coefficient, reference water level, corresponding reference surface area and storage volume, weir-width adjustment factor, and the fraction of routed inflow entering the lake. Basin identifiers, lake category, simulation period, calibration and validation periods, and parameter-schema information are retained as NetCDF metadata.
This paper describes the development and evaluation of a musculoskeletal model that represents human elbow flexion-extension and forearm pronation-supination. The length, velocity, and moment arm for each of the eight musculotendon actuators were based on skeletal anatomy and position. Musculotendon parameters were determined for each actuator and verified by comparing analytical torque-angle curves with experimental joint torque data. The parameters and skeletal geometry were also utilized in the musculoskeletal model for the analysis of ballistic elbow joint complex movements. The key objective was to develop a computational model, guided by parameterized optimal control, to investigate the relationship among patterns of muscle excitation, individual muscle forces, and movement kinematics. The model was verified using experimental kinematic, torque, and electromyographic data from volunteer subjects performing ballistic elbow joint complex movements.
An evaluation is conducted of the ability of a crack-closure model to predict the fatigue life of notched specimens under spectrum loading, for the cases of crack initiation and growth along the bore of a semicircular notch and the growth of large cracks in 2024-T3 Al alloy sheets under constant-amplitude loading. These cases are used to establish an initial defect size and relationship between the stress-intensity factor range and crack-growth rate. Experimental and calculation results for small-crack growth rates are in good agreement and exhibited a stress level effect at equal values of stress-intensity factor range.
Dilute combustion in spark-ignition engines has the potential to improve thermal efficiency by mitigating knock and by reducing throttling and wall heat losses. However, ignition and combustion processes can become unstable for dilute operation due to a lowered laminar flame speed, resulting in excessive cycle-to-cycle variability (CCV) of the combustion process. To compensate for the slower combustion in less reactive mixtures, a modified intake port geometry can be employed to generate a strong tumble flow in the cylinder and elevate turbulence levels around the spark plug, thereby promoting a faster transition to turbulent deflagration. Consequently, optimizing combustion chamber geometry and operating strategy is crucial to maximizing the benefits of using dilute combustion with enhanced in-cylinder turbulence across a wide range of operating conditions. Computational fluid dynamics (CFD) simulations can be utilized for virtual engine optimization tasks, but this would require the models to be truly predictive regarding the impact of changes to the engine design and operational parameters.In this study, multicycle large-eddy simulations (LES) are performed for a direct-injection spark-ignition engine to investigate the model performance in predicting engine combustion characteristics with respect to changes in the intake configuration. A tumble plate that blocks the lower part of the intake port inlet is used to vary the tumble. A set of CFD models that have been recently developed are employed, which takes into account the drag of nonspherical droplets, flash-boiling behavior of liquid sprays, spray-wall interaction, surrogate formulation of a research-grade E10 gasoline, and fast chemical kinetic solvers. Simulation results are compared to experimental engine data in terms of cylinder pressure, apparent heat release rate, mass fraction burned timing, and flame images. It is found that LES employing the state-of-the-art CFD models are capable of properly predicting the spray processes and reproducing the measured mean cylinder pressure for the case with the tumble plate. On the other hand, the LES over-predicts the combustion rate during the early combustion stage and under-estimates the CCV, and these discrepancies become larger when the tumble plate is removed.
In many situations across computational science and engineering, multiple computational models are available that describe a system of interest. These different models have varying evaluation costs and varying fidelities. Typically, a computationally expensive high-fidelity model describes the system with the accuracy required by the current application at hand, while lower-fidelity models are less accurate but computationally cheaper than the high-fidelity model. Outer-loop applications, such as optimization, inference, and uncertainty quantification, require multiple model evaluations at many different inputs, which often leads to computational demands that exceed available resources if only the high-fidelity model is used. This work surveys multifidelity methods that accelerate the solution of outer-loop applications by combining high-fidelity and low-fidelity model evaluations, where the low-fidelity evaluations arise from an explicit low-fidelity model (e.g., a simplified physics approximation, a reduced model, a data-fit surrogate) that approximates the same output quantity as the high-fidelity model. The overall premise of these multifidelity methods is that low-fidelity models are leveraged for speedup while the high-fidelity model is kept in the loop to establish accuracy and/or convergence guarantees. We categorize multifidelity methods according to three classes of strategies: adaptation, fusion, and filtering. The paper reviews multifidelity methods in the outer-loop contexts of uncertainty propagation, inference, and optimization.
When conducting model averaging for assessing groundwater conceptual model uncertainty, the averaging weights are often evaluated using model selection criteria such as AIC, AICc, BIC, and KIC (Akaike Information Criterion, Corrected Akaike Information Criterion, Bayesian Information Criterion, and Kashyap Information Criterion, respectively). However, this method often leads to an unrealistic situation in which the best model receives overwhelmingly large averaging weight (close to 100%), which cannot be justified by available data and knowledge. It was found in this study that this problem was caused by using the covariance matrix, CE, of measurement errors for estimating the negative log likelihood function common to all the model selection criteria. This problem can be resolved by using the covariance matrix, Cek, of total errors (including model errors and measurement errors) to account for the correlation between the total errors. An iterative two-stage method was developed in the context of maximum likelihood inverse modeling to iteratively infer the unknown Cek from the residuals during model calibration. The inferred Cek was then used in the evaluation of model selection criteria and model averaging weights. While this method was limited to serial data using time series techniques in this study, it can be extended to spatial data using geostatistical techniques. The method was first evaluated in a synthetic study and then applied to an experimental study, in which alternative surface complexation models were developed to simulate column experiments of uranium reactive transport. It was found that the total errors of the alternative models were temporally correlated due to the model errors. The iterative two-stage method using Cek resolved the problem that the best model receives 100% model averaging weight, and the resulting model averaging weights were supported by the calibration results and physical understanding of the alternative models. Using Cek obtained from the iterative two-stage method also improved predictive performance of the individual models and model averaging in both synthetic and experimental studies.
Based on existing integration models in the psychological literature, an evaluation framework is developed to assess sensor fusion displays as might be implemented in an enhanced/synthetic vision system. The proposed evaluation framework for evaluating the operator's ability to use such systems is a normative approach: The pilot's performance with the sensor fusion image is compared to models' predictions based on the pilot's performance when viewing the original component sensor images prior to fusion. This allows for the determination as to when a sensor fusion system leads to: poorer performance than one of the original sensor displays, clearly an undesirable system in which the fused sensor system causes some distortion or interference; better performance than with either single sensor system alone, but at a sub-optimal level compared to model predictions; optimal performance compared to model predictions; or, super-optimal performance, which may occur if the operator were able to use some highly diagnostic 'emergent features' in the sensor fusion display, which were unavailable in the original sensor displays.