Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,639 records · Page 91

Executive summary: Benefit-cost evaluation of an intra-regional air service in the Bay Area and a technology assessment of transportation system investments

The benefits and costs that would result from an intra-regional air service operation in the San Francisco Bay area were determined by utilizing an iterative statistical decision model to evaluate combinations of commuter airport sites and surface transportation facilities in conjunction with service by a given commuter aircraft type in light of area regional growth alternatives and peak and off-peak regional travel patterns. The model evaluates such transportation option with respect to criteria of airline profitability, public acceptance, and public and private non-user costs. In so doing, it incorporates information on modal split, peak and off-peak use of the air commuter fleet, terminal and airport costs, development costs and uses of land in proximity to the airport sites, regional population shifts, and induced zonal shifts in travel demand. The model is multimodal in its analytic capability, and performs exhaustive sensitivity analysis.

Haefner, L. E.↗

A framework to evaluate IMEX schemes for atmospheric models

We present a new evaluation framework for implicit and explicit (IMEX) Runge–Kutta time-stepping schemes. The new framework uses a linearized nonhydrostatic system of normal modes. We utilize the framework to investigate the stability of IMEX methods and their dispersion and dissipation of gravity, Rossby, and acoustic waves. We test the new framework on a variety of IMEX schemes and use it to develop and analyze a set of second-order low-storage IMEX Runge–Kutta methods with a high Courant–Friedrichs–Lewy (CFL) number. We show that the new framework is more selective than the 2-D acoustic system previously used in the literature. Schemes that are stable for the 2-D acoustic system are not stable for the system of normal modes.

54 ENVIRONMENTAL SCIENCES↗

Multi-model Mean Nitrogen and Sulfur Deposition from the Atmospheric Chemistry and Climate Model Intercomparison Project (ACCMIP): Evaluation Historical and Projected Changes

We present multi-model global datasets of nitrogen and sulfate deposition covering time periods from 1850 to 2100, calculated within the Atmospheric Chemistry and Climate Model Intercomparison Project (ACCMIP). The computed deposition fluxes are compared to surface wet deposition and ice-core measurements. We use a new dataset of wet deposition for 2000-2002 based on critical assessment of the quality of existing regional network data. We show that for present-day (year 2000 ACCMIP time-slice), the ACCMIP results perform similarly to previously published multi-model assessments. For this time slice, we find a multi-model mean deposition of 50 Tg(N) yr1 from nitrogen oxide emissions, 60 Tg(N) yr1 from ammonia emissions, and 83 Tg(S) yr1 from sulfur emissions. The analysis of changes between 1980 and 2000 indicates significant differences between model and measurements over the United States but less so over Europe. This difference points towards misrepresentation of 1980 NH3 emissions over North America. Based on ice-core records, the 1850 deposition fluxes agree well with Greenland ice cores but the change between 1850 and 2000 seems to be overestimated in the Northern Hemisphere for both nitrogen and sulfur species. Using the Representative Concentration Pathways to define the projected climate and atmospheric chemistry related emissions and concentrations, we find large regional nitrogen deposition increases in 2100 in Latin America, Africa and parts of Asia under some of the scenarios considered. Increases in South Asia are especially large, and are seen in all scenarios, with 2100 values more than double 2000 in some scenarios and reaching 1300 mg(N) m2 yr1 averaged over regional to continental scale regions in RCP 2.6 and 8.5, 3050 larger than the values in any region currently (2000). The new ACCMIP deposition dataset provides novel, consistent and evaluated global gridded deposition fields for use in a wide range of climate and ecological studies.

Lamarque, J.-F.↗

Development and evaluation of a variably saturated flow model in the global E3SM Land Model (ELM) version 1.0

Abstract. Improving global-scale model representations of near-surface soil moisture and groundwater hydrology is important for accurately simulating terrestrial processes and predicting climate change effects on water resources. Most existing land surface models, including the default E3SM Land Model (ELMv0), which we modify here, routinely employ different formulations for water transport in the vadose and phreatic zones. Clark et al. (2015) identified a variably saturated Richards equation flow model as an important capability for improving simulation of coupled soil moisture and shallow groundwater dynamics. In this work, we developed the Variably Saturated Flow Model (VSFM) in ELMv1 to unify the treatment of soil hydrologic processes in the unsaturated and saturated zones. VSFM was tested on three benchmark problems and results were evaluated against observations and an existing benchmark model (PFLOTRAN). The ELMv1-VSFM's subsurface drainage parameter, fd, was calibrated to match an observationally constrained and spatially explicit global water table depth (WTD) product. Optimal spatially explicit fd values were obtained for 79 % of global 1.9∘ × 2.5∘ grid cells, while the remaining 21 % of global grid cells had predicted WTD deeper than the observationally constrained estimate. Comparison with predictions using the default fd value demonstrated that calibration significantly improved predictions, primarily by allowing much deeper WTDs. Model evaluation using the International Land Model Benchmarking package (ILAMB) showed that improvements in WTD predictions did not degrade model skill for any other metrics. We evaluated the computational performance of the VSFM model and found that the model is about 30 % more expensive than the default ELMv0 with an optimal processor layout. The modular software design of VSFM not only provides flexibility to configure the model for a range of problem setups but also allows for building the model independently of the ELM code, thus enabling straightforward testing of the model's physics against other models.

58 GEOSCIENCES↗

CFD code evaluation for internal flow modeling

Research on the computational fluid dynamics (CFD) code evaluation with emphasis on supercomputing in reacting flows is discussed. Advantages of unstructured grids, multigrids, adaptive methods, improved flow solvers, vector processing, parallel processing, and reduction of memory requirements are discussed. As examples, researchers include applications of supercomputing to reacting flow Navier-Stokes equations including shock waves and turbulence and combustion instability problems associated with solid and liquid propellants. Evaluation of codes developed by other organizations are not included. Instead, the basic criteria for accuracy and efficiency have been established, and some applications on rocket combustion have been made. Research toward an ultimate goal, the most accurate and efficient CFD code, is in progress and will continue for years to come.

Chung, T. J.↗

A real time Pegasus propulsion system model for VSTOL piloted simulation evaluation

A real time propulsion system modeling technique suitable for use in man-in-the-loop simulator studies was developd. This technique provides the system accuracy, stability, and transient response required for integrated aircraft and propulsion control system studies. A Pegasus-Harrier propulsion system was selected as a baseline for developing mathematical modeling and simulation techniques for VSTOL. Initially, static and dynamic propulsion system characteristics were modeled in detail to form a nonlinear aerothermodynamic digital computer simulation of a Pegasus engine. From this high fidelity simulation, a real time propulsion model was formulated by applying a piece-wise linear state variable methodology. A hydromechanical and water injection control system was also simulated. The real time dynamic model includes the detail and flexibility required for the evaluation of critical control parameters and propulsion component limits over a limited flight envelope. The model was programmed for interfacing with a Harrier aircraft simulation. Typical propulsion system simulation results are presented.

Mihaloew, J. R.↗

Thermal Management for Planar Package Power Electronics (CRADA Final Report)

The National Renewable Energy Laboratory (NREL) and John Deere Electronic Solutions (JDES) collaborated to develop and evaluate computer models and simulations related to the thermal performance of semiconductor device packaging for an inverter of an off-road vehicle ("Semiconductor Packaging"). The objective of the research was for NREL and JDES to develop a two or three-dimensional computer-aided design model of the Semiconductor Packaging ("Computer Model") for thermal performance evaluation in a simulation. The project developed computer models of a Semiconductor Package of silicon-carbide semiconductor devices with appropriate thermal dissipation via one or more of the following thermal features: a double-sided planar cooling configuration, an air-cooled configuration, a liquid-cooled configuration for off-road inverter applications in a relevant simulated operating environment. It is noted that surface area and prototype product embodiment consisting of air-cooled and liquid-cooled configurations may and may not be in direct contact with power semiconductor chips. The idea was to explore and develop packaging and thermal management technology for power semiconductors that was most effective in the performance yet had least burden in overall product cost for a given application.

33 ADVANCED PROPULSION SYSTEMS↗

Comparison With Global Soil Radiocarbon Observations Indicates Needed Carbon Cycle Improvements in the E3SM Land Model

We evaluated global soil organic carbon (SOC) stocks and turnover time predictions from a global land model (ELMv1-ECA) integrated in an Earth System Model (E3SM) by comparing them with observed soil bulk and Δ 14 C values around the world. We analyzed observed and simulated SOC stocks and Δ 14 C values using machine learning methods at the Earth System Model grid cell scale (~200 km). In grid cells with sufficient observations, the model provided reasonable estimates of soil carbon stocks across soil depth and Δ 14 C values near the surface but underestimated Δ 14 C at depth. Among many explanatory variables, soil albedo index, soil order, plant function type, air temperature, and SOC content were major factors affecting predicted SOC Δ 14 C values. The influences of soil albedo index, soil order, and air temperature were primarily important in the shallow subsurface (≤30 cm). We also performed sensitivity studies using different vertical root distributions and decomposition turnover times and compared to observed SOC stock and Δ 14 C profiles. The analyses support the role of vegetation in affecting soil carbon turnover, particularly in deep soil, possibly through supplying fresh carbon and degrading physical-chemical protection of SOC via root activities. Allowing for grid cell-specific rooting and decomposition rates substantially reduced discrepancies between observed and predicted Δ 14 C values and SOC content. Furthermore, our results highlight the need for more explicit representation of roots, microbes, and soil physical protection in land models.

58 GEOSCIENCES↗

A Coupled Evaluation of Operational MODIS and Model Aerosol Products for Maritime Environments Using Sun Photometry: Evaluation of the Fine and Coarse Mode

Although satellite retrievals and data assimilation have progressed to where there is a good skill for monitoring maritime Aerosol Optical Depth (AOD), there remains uncertainty in achieving further degrees of freedom, such as distinguishing fine and coarse mode dominated species in maritime environments (e.g., coarse mode sea salt and dust versus fine mode terrestrial anthropogenic emissions, biomass burning, and maritime secondary production). For the years 2016 through 2019, we performed an analysis of 550 nm total AOD550, fine mode AOD (FAOD550; also known as FM AOD in the literature), coarse mode AOD (CAOD550), and fine mode fraction (η550) between Moderate Resolution Spectral Imaging Radiometer (MODIS) V6.1 MOD/MYD04 dark target aerosol retrievals and the International Cooperative for Aerosol Prediction (ICAP) core four multi-model consensus (C4C) of analyses/short term forecasts that assimilate total MODIS AOD550. Differences were adjudicated by the global shipboard Maritime Aerosol Network (MAN) and selected island AERONET sun photometer observations with the application of the spectral deconvolution algorithm (SDA). Through a series of conditional and regional analyses, we found divergence included regions of terrestrial influence and latitudinal dependencies in the remote oceans. Notably, MODIS and the C4C and its members, while having good correlations overall, have a persistent +0.04 to +0.02 biases relative to MAN and AERONET for typical AOD550 values (84th% < 0.28), with the C4C underestimating significant events thereafter. Second, high biases in AOD550 are largely associated with the attribution of the fine mode in satellites and models alike. Thus, both MODIS and C4C members are systematically overestimating AOD550 and FAOD550 but perform better in characterizing the CAOD550. Third, for MODIS, findings are consistent with previous reports of a high bias in the retrieved Ångström Exponent, and we diagnosed both the optical model and cloud masking as likely causal factors for the AOD550 and FAOD550 high bias, whereas for the C4C, it is likely from secondary overproduction and perhaps numerical diffusion. Fourth, while there is no wind-speed-dependent bias for surface winds <12 m s−1, the C4C and MODIS AOD550s also overestimate CAOD550 and FAOD550, respectively, for wind speeds above 12 m/s. Finally, sampling bias inherent in MAN, as well as other circumstantial evidence, suggests biases in MODIS are likely MODIS and the C4C products have their own strengths and challenges for a given climate application and discuss needed research. even larger than what was diagnosed here. We conclude with a discussion on how

Aerosols↗

Evaluation of two statistical models using the shock structure problem.

The accuracy of two statistical models for the collision integral of the Boltzmann equation has been evaluated by applying the models to the solution of the problem of shock structure in a monatomic gas and then comparing the theoretical results with available ex perimental data. The two models considered here are the Bhatnagar-Gross-Krook and ellipsoidal statistical models. The Mach number range covered is 1.59-10.7 and profiles for density and, where available, temperature are compared. The method of numerical solution is the discrete ordinate technique which looks quite promising for application to more complicated models. The results indicate that the ellipsoidal statistical model, which gives a correct value for the Prandtl number, gives accurate results for a low Mach number shock. However, the accuracy degenerates as the Mach number increases. The Bhatnagar-Gross-Krook model gives poorer agreement with experimental data in all cases examined.

Giddens, D. P.↗

Conversion of IVA Human Computer Model to EVA Use and Evaluation and Comparison of the Result to Existing EVA Models

This paper describes the methods, rationale, and comparative results of the conversion of an intravehicular (IVA) 3D human computer model (HCM) to extravehicular (EVA) use and compares the converted model to an existing model on another computer platform. The task of accurately modeling a spacesuited human figure in software is daunting: the suit restricts the human's joint range of motion (ROM) and does not have joints collocated with human joints. The modeling of the variety of materials needed to construct a space suit (e. g. metal bearings, rigid fiberglass torso, flexible cloth limbs and rubber coated gloves) attached to a human figure is currently out of reach of desktop computer hardware and software. Therefore a simplified approach was taken. The HCM's body parts were enlarged and the joint ROM was restricted to match the existing spacesuit model. This basic approach could be used to model other restrictive environments in industry such as chemical or fire protective clothing. In summary, the approach provides a moderate fidelity, usable tool which will run on current notebook computers.

Hamilton, George S.↗

Characterization and Valuation of the Uncertainty of Calibrated Parameters in Microsimulation Decision Models

We evaluated the implications of different approaches to characterize the uncertainty of calibrated parameters of microsimulation decision models (DMs) and quantified the value of such uncertainty in decision making. We calibrated the natural history model of CRC to simulated epidemiological data with different degrees of uncertainty and obtained the joint posterior distribution of the parameters using a Bayesian approach. We conducted a probabilistic sensitivity analysis (PSA) on all the model parameters with different characterizations of the uncertainty of the calibrated parameters. We estimated the value of uncertainty of the various characterizations with a value of information analysis. We conducted all analyses using high-performance computing resources running the Extreme-scale Model Exploration with Swift (EMEWS) framework. The posterior distribution had a high correlation among some parameters. The parameters of the Weibull hazard function for the age of onset of adenomas had the highest posterior correlation of -0.958. When comparing full posterior distributions and the maximum-a-posteriori estimate of the calibrated parameters, there is little difference in the spread of the distribution of the CEA outcomes with a similar expected value of perfect information (EVPI) of $\$$653 and $\$$685, respectively, at a willingness-to-pay (WTP) threshold of $\$$66,000 per quality-adjusted life year (QALY). Ignoring correlation on the calibrated parameters’ posterior distribution produced the broadest distribution of CEA outcomes and the highest EVPI of $\$$809 at the same WTP threshold. Different characterizations of the uncertainty of calibrated parameters affect the expected value of eliminating parametric uncertainty on the CEA. Ignoring inherent correlation among calibrated parameters on a PSA overestimates the value of uncertainty.

97 MATHEMATICS AND COMPUTING↗

Prioritization of engineering support requests and advanced technology projects using decision support and industrial engineering models

The evaluation and prioritization of Engineering Support Requests (ESR's) is a particularly difficult task at the Kennedy Space Center (KSC) -- Shuttle Project Engineering Office. This difficulty is due to the complexities inherent in the evaluation process and the lack of structured information. The evaluation process must consider a multitude of relevant pieces of information concerning Safety, Supportability, O&M Cost Savings, Process Enhancement, Reliability, and Implementation. Various analytical and normative models developed over the past have helped decision makers at KSC utilize large volumes of information in the evaluation of ESR's. The purpose of this project is to build on the existing methodologies and develop a multiple criteria decision support system that captures the decision maker's beliefs through a series of sequential, rational, and analytical processes. The model utilizes the Analytic Hierarchy Process (AHP), subjective probabilities, the entropy concept, and Maximize Agreement Heuristic (MAH) to enhance the decision maker's intuition in evaluating a set of ESR's.

Tavana, Madjid↗

Precision Determination of r{sub 0{Lambda}MS} from the QCD Static Energy

We use the recently obtained theoretical expression for the complete QCD static energy at next-to-next-to-next-to leading-logarithmic accuracy to determine r{sub 0{Lambda}MS} by comparison with available lattice data, where r{sub 0} is the lattice scale and {Lambda}{sub MS} is the QCD scale. We obtain r{sub 0{Lambda}MS}=0.622{sub -0.015}{sup +0.019} for the zero-flavor case. The procedure we describe can be directly used to obtain r{sub 0{Lambda}MS} in the unquenched case, when unquenched lattice data for the static energy at short distances becomes available. Using the value of the strong coupling {alpha}{sub s} as an input, the unquenched result would provide a determination of the lattice scale r{sub 0}.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Modeling procedures for handling qualities evaluation of flexible aircraft

This paper presents simplified modeling procedures to evaluate the impact of flexible modes and the unsteady aerodynamic effects on the handling qualities of Supersonic Cruise Aircraft (SCR). The modeling procedures involve obtaining reduced order transfer function models of SCR vehicles, including the important flexible mode responses and unsteady aerodynamic effects, and conversion of the transfer function models to time domain equations for use in simulations. The use of the modeling procedures is illustrated by a simple example.

Govindaraj, K. S.↗

Non-Markovian finite-temperature two-time correlation functions of system operators of a pure-dephasing model

We evaluate the non-Markovian finite-temperature two-time correlation functions (CF's) of system operators of a pure-dephasing spin-boson model in two different ways, one by the direct exact operator technique and the other by the recently derived evolution equations, valid to second order in the system-environment interaction Hamiltonian. This pure-dephasing spin-boson model that is exactly solvable has been extensively studied as a simple decoherence model. However, its exact non-Markovian finite-temperature two-time system operator CF's, to our knowledge, have not been presented in the literature. This may be mainly due to the fact, illustrated in this article, that in contrast to the Markovian case, the time evolution of the reduced density matrix of the system (or the reduced quantum master equation) alone is not sufficient to calculate the two-time system operator CF's of non-Markovian open systems. The two-time CF's obtained using the recently derived evolution equations in the weak system-environment coupling case for this non-Markovian pure-dephasing model happen to be the same as those obtained from the exact evaluation. However, these results significantly differ from the non-Markovian two-time CF's obtained by wrongly directly applying the quantum regression theorem (QRT), a useful procedure to calculate the two-time CF's for weak-coupling Markovian open systems. This demonstrates clearly that the recently derived evolution equations generalize correctly the QRT to non-Markovian finite-temperature cases. It is believed that these evolution equations will have applications in many different branches of physics.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Using an Advanced Distribution Management System Test Bed to Evaluate the Impact of Model Quality on Volt/VAR Optimization: Preprint

In this paper, we present a test bed for evaluating existing and future advanced distribution management system (ADMS) applications in a realistic laboratory setting, including other utility management systems and field equipment. We present an example of using it to evaluate the impact of the ADMS network model quality on a Volt/VAR optimization (VVO) application. The test bed integrates a commercial ADMS with a real-time simulation model of a utility distribution feeder. Representative power and controller hardware are integrated through hardware-in-the-loop (HIL) techniques. The performance of the ADMS VVO application is also evaluated for different levels of measurement density. Initial results indicate that a higher model quality achieves the highest possible energy savings while avoiding voltage violations, whereas a lower model quality results in increased energy savings but at the expense of more voltage violations.

ADMS↗

Development and Evaluation of a Performance Modeling Flight Test Approach Based on Quasi Steady-State Maneuvers

The development, implementation and flight test evaluation of a performance modeling technique which required a limited amount of quasisteady state flight test data to predict the overall one g performance characteristics of an aircraft. The concept definition phase of the program include development of: (1) the relationship for defining aerodynamic characteristics from quasi steady state maneuvers; (2) a simplified in flight thrust and airflow prediction technique; (3) a flight test maneuvering sequence which efficiently provided definition of baseline aerodynamic and engine characteristics including power effects on lift and drag; and (4) the algorithms necessary for cruise and flight trajectory predictions. Implementation of the concept include design of the overall flight test data flow, definition of instrumentation system and ground test requirements, development and verification of all applicable software and consolidation of the overall requirements in a flight test plan.

Yechout, T. R.↗