Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,423 records · Page 79

An evaluation of global organic aerosol schemes using airborne observations

Chemical transport models have historically struggled to accurately simulate the magnitude and variability of observed organic aerosol (OA), with previous studies demonstrating that models significantly underestimate observed concentrations in the troposphere. In this study, we explore two different model OA schemes within the standard GEOS-Chem chemical transport model and evaluate the simulations against a suite of 15 globally distributed airborne campaigns from 2008 to 2017, primarily in the spring and summer seasons. These include the ATom, KORUS-AQ, GoAmazon,FRAPPE, SEAC4RS, SENEX, DC3, CalNex, OP3, EUCAARI, ARCTAS and ARCPAC campaigns and provide broad coverage over a diverse set of atmospheric composition regimes – anthropogenic, biogenic, pyrogenic and remote. The schemes include significant differences in their treatment of the primary and secondary components of OA – a “simple scheme” that models primary OA (POA) as non-volatile and takes a fixed-yield approach to secondary OA (SOA) formation and a “complex scheme” that simulates POA as semi-volatile and uses a more sophisticated volatility basis set approach for non-isoprene SOA, with an explicit aqueous uptake mechanism to model isoprene SOA. Despite these substantial differences, both the simple and complex schemes perform comparably across the aggregate dataset in their ability to capture the observed variability (with an R2 of 0.41 and 0.44, respectively). The simple scheme displays greater skill in minimizing the overall model bias (with a normalized mean bias of 0.04 compared to 0.30 for the complex scheme). Across both schemes, the model skill in reproducing observed OA is superior to previous model evaluations and approaches the fidelity of the sulfate simulation within the GEOS-Chem model. However,there are significant differences in model performance across different chemical source regimes, classified here into seven categories.Higher-resolution nested regional simulations indicate that model resolution is an important factor in capturing variability in highly localized campaigns, while also demonstrating the importance of well-constrained emissions inventories and local meteorology, particularly over Asia. Our analysis suggests that a semi-volatile treatment of POA is superior to anon-volatile treatment. It is also likely that the complex scheme parameterization overestimates biogenic SOA at the global scale. While this study identifies factors within the SOA schemes that likely contribute to OA model bias (such as a strong dependency of the bias in the complex scheme on relative humidity and sulfate concentrations), comparisons with the skill of the sulfate aerosol scheme in GEOS-Chem indicate the importance of other drivers of bias, such as emissions, transport and deposition, that are exogenous to the OA chemical scheme.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Evaluation of stock profile models for burden distribution in blast furnace

Burden distribution in a blast furnace is vital to its smooth running. We have applied mathematical models to guide the charging process to achieve desired burden distribution. Furthermore, the accuracies of such models depend on the prediction of falling curve, stock profile and burden descent mode. Among them, the stock profile model greatly influences the final burden distribution. In this study, a special evaluation index for the accuracy of the modelled burden profile based on charging volume is established. Six existing stock profile models were evaluated and compared with the published experiment data of a scaled blast furnace. It is found that all the models predicted the stock profile well. But, certain models showed increased accuracy for the particular case.

42 ENGINEERING↗

MODEL AND ALGORITHM EVALUATION FOR THE HYBRID UF6 CONTAINER INSPECTION SYSTEM

ABSTRACT Pacific Northwest National Laboratory (PNNL) is developing an automated UF6 cylinder verification station concept based on the combined collection of traditional enrichment-meter (186 keV photons from U-235) data and non-traditional, neutron-induced, high-energy gamma-signatures (3-8.5 MeV) with an array of collimated, medium-resolution scintillators. Previous (2010) work at PNNL demonstrated proof-of-principle that this hybrid method yields accurate, full-volume assay of the cylinder enrichment, reduces systematic errors when compared to several other enrichment assay methods, and provides simplified instrumentation and algorithms suitable for long-term unattended operations. We used Monte Carlo modeling with MCNP5 to support system design (e.g., number and configuration of detector arrays, and design of iron/poly collimators for enhanced (n,γ) conversion) and enrichment algorithm development. We developed a first-generation modeling framework in 2010. These tools have since been expanded, refined and benchmarked against field measurements with a prototype system of a 30B cylinder population (0.2 to 4.95 weight % U-235). The MCNP5 model decomposes the radiation transport problem into a linear superposition of “basis spectra” representing contributions from the different uranium isotopes and gamma-ray generation mechanisms (e.g. neutron capture). This scheme accommodates fast generation of “virtual assay signatures” for arbitrary enrichment, material age, and fill variations. Ongoing (FY-2011) refinements to the physics model include accounting for generation of bremsstrahlung photons, arising primarily from the beta decay of Pa-234m, a U-238 daughter. We are using the refined model to optimize collimator design for the hybrid method. The traditional assay method benefits from a high degree of collimation (to isolate each detector’s field-of-view) and relatively small detector area, while the non-traditional method benefits from a wide field-of-view, i.e. less collimation and larger detectors. We implement the enrichment-meter method by applying a square-wave digital filter to a raw spectrum and extracting the 186-keV peak area directly from the convolute spectrum. Ongoing enhancements to this approach include mitigating a systematic peak-area measurement deficit arising from curvature in the spectrum continuum shape. An optimized system prototype based on model results is utilized in a new set of 2011 field measurements, and model and measurement enrichment assay uncertainties are compared.

MODEL AND ALGORITHM EVALUATION FOR THE HYBRID UF6 ↗

Geoengineering as a design problem

Understanding the climate impacts of solar geoengineering is essential for evaluating its benefits and risks. Most previous simulations have prescribed a particular strategy and evaluated its modeled effects. Here we turn this approach around by first choosing example climate objectives and then designing a strategy to meet those objectives in climate models. There are four essential criteria for designing a strategy: (i) an explicit specification of the objectives, (ii) defining what climate forcing agents to modify so the objectives are met, (iii) a method for managing uncertainties, and (iv) independent verification of the strategy in an evaluation model. We demonstrate this design perspective through two multi-objective examples. First, changes in Arctic temperature and the position of tropical precipitation due to CO 2 increases are offset by adjusting high-latitude insolation in each hemisphere independently. Second, three different latitude-dependent patterns of insolation are modified to offset CO 2 -induced changes in global mean temperature, interhemispheric temperature asymmetry, and the Equator-to-pole temperature gradient. In both examples, the "design" and "evaluation" models are state-of-the-art fully coupled atmosphere–ocean general circulation models.

Kravitz, Ben↗

The design, analysis and experimental evaluation of an elastic model wing

An elastic orbiter model was developed to evaluate the effectiveness of aeroelasticity computer programs. The elasticity properties were introduced by constructing beam-like straight wings for the wind tunnel model. A standard influence coefficient mathematical model was used to estimate aeroelastic effects analytically. In general good agreement was obtained between the empirical and analytical estimates of the deformed shape. However, in the static aeroelasticity case, it was found that the physical wing exhibited less bending and more twist than was predicted by theory.

Cavin, R. K., III↗

Evaluation of Three Constitutive Models for the Prediction of Hastelloy X Elevated Temperature Cyclic Response

The approach for the method development assumes that, for a thermally loaded structure, the overall strain history is defined by linear elastic analysis. The local stress history at a fatigue critical location is then determined from a one dimensional material behavior model and the local strain and temperature conditions. Three material models are currently being evaluated to assess their ability to predict relevant high temperature cyclic material response characteristics. They are: a time independent classical plasticity and creep representation, a time dependent viscoplastic model capable of predicting combined creep and plasticity effects, and an approximate elastic analysis approach that uses a series of stress-strain curves and a cyclic hardening model to determine reverse plasticity.

Moreno, V.↗

Single-Pass Flow-Through Test Elucidation of Weathering Behavior and Evaluation of Contaminant Release Models for Hanford Tank Residual Radioactive Waste

Contaminant release models are required to evaluate and predict long-term environmental impacts of even residual amounts of high-level radioactive waste after cleanup and closure of radioactively contaminated sites such as the DOE’s Hanford Site. More realistic and representative models have been developed for release of uranium, technetium, and chromium from Hanford Site tanks C-202, C-203, and C-103 residual wastes using data collected with a single-pass flow-through test (SPFT) method. These revised models indicate that contaminant release concentrations from these residual wastes will be considerably lower than previous estimates based on batch experiments. For uranium, a thermodynamic solubility model provides an effective description of uranium release, which can account for differences in pore fluid chemistry contacting the waste that could occur through time and as a result of different closure scenarios. Under certain circumstances in the SPFT experiments various calcium rich precipitates (calcium phosphates and calcite) form on the surfaces of the waste particles, inhibiting dissolution of the underlying uranium phases in the waste. This behavior was not observed in previous batch experiments. For both technetium and chromium, empirical release models were developed. In the case of technetium, release from all three wastes was modeled using an equilibrium Kd model. For chromium release, a constant concentration model was applied for all three wastes.

chromium↗

Modeling framework for evaluating the impacts of hydrodynamic pressure on hydrologic exchange fluxes and residence time for a large-scale river section over a long-term period

Quantifying hydrologic exchange fluxes (HEF) at the river and subsurface interface and their residence times (RT) in subsurface are important for managing the water quality and ecosystem health in dynamic river corridor systems. In this study, a modeling framework is developed for coupling the three-dimensional (3D) multi-phase surface, subsurface flow transport, and numerical tracer model for RT in a large-scale river section over a long period. The framework is utilized to evaluate the impacts of hydrodynamic pressure on HEFs and RT for a 30 km section of the Columbia River in Washington State over a three-year period. Based on comparisons between model simulations with and without considering hydrodynamic pressure, we found that hydrodynamic pressure increases the net HEFs by 7% with river gaining water from the subsurface domain, and leads to slight reduction of RT.

54 ENVIRONMENTAL SCIENCES↗

Spatial Environmental Assessment Tool (SEAT): A Modeling Tool to Evaluate Potential Environmental Risks Associated with Wave Energy Converter Deployments

Wave energy converter (WEC) arrays deployed in coastal regions may create physical disturbances, potentially resulting in environmental stresses. Presently, limited information is available on the nature of these physical disturbance or the resultant effects. A quantitative Spatial Environmental Assessment Tool (SEAT) for evaluating the potential effects of wave energy converter (WEC) arrays on nearshore hydrodynamics and sediment transport is presented for the central Oregon coast (USA) through coupled numerical model simulations of an array of WECs. Derived climatological wave conditions were used as inputs to the model to allow for the calculation of risk metrics associated with various hydrodynamic and sediment transport variables such as maximum shear stress, bottom velocity, and change in bed elevation. The risk maps provided simple, quantitative, and spatially-resolved means of evaluating physical changes in the vicinity of a hypothetical WEC array in response to varying wave conditions. The near-field risk of sediment mobility was determined to be moderate in the lee of the densely spaced array, where the potential for increased sediment deposition could result in benthic habitat alteration. Modifications to the nearshore sediment deposition and erosion patterns were observed near headlands and topographic features, which could have implications for littoral sediment transport. The results illustrate the benefits of a risk evaluation tool for facilitating coastal resource management at early market marine renewable energy sites.

Jones, Craig↗

A proposed framework for the development and qualitative evaluation of West Nile virus models and their application to local public health decision-making

West Nile virus (WNV) is a globally distributed mosquito-borne virus of great public health concern. The number of WNV human cases and mosquito infection patterns vary in space and time. Many statistical models have been developed to understand and predict WNV geographic and temporal dynamics. However, these modeling efforts have been disjointed with little model comparison and inconsistent validation. In this paper, we describe a framework to unify and standardize WNV modeling efforts nationwide. WNV risk, detection, or warning models for this review were solicited from active research groups working in different regions of the United States. A total of 13 models were selected and described. The spatial and temporal scales of each model were compared to guide the timing and the locations for mosquito and virus surveillance, to support mosquito vector control decisions, and to assist in conducting public health outreach campaigns at multiple scales of decision-making. Our overarching goal is to bridge the existing gap between model development, which is usually conducted as an academic exercise, and practical model applications, which occur at state, tribal, local, or territorial public health and mosquito control agency levels. The proposed model assessment and comparison framework helps clarify the value of individual models for decision-making and identifies the appropriate temporal and spatial scope of each model. This qualitative evaluation clearly identifies gaps in linking models to applied decisions and sets the stage for a quantitative comparison of models. Specifically, whereas many coarse-grained models (county resolution or greater) have been developed, the greatest need is for fine-grained, short-term planning models (m–km, days–weeks) that remain scarce. We further recommend quantifying the value of information for each decision to identify decisions that would benefit most from model input.

60 APPLIED LIFE SCIENCES↗

Evaluating Ground Motion Predictions of USGS 3D Seismic Model of the San Francisco Bay Area with Broadband Seismograms

The USGS (Menlo Park) developed a three-dimensional (3D) geologic and seismic model of the greater San Francisco Bay Area for the purposes of computing earthquake ground motions. This model was used to compute scenario ground motions for the 1906 San Francisco, 1989 Loma Prieta and a suite of Hayward Fault earthquakes. While scenario ground motion calculations are important for investigating the amplitude, duration and variability of motions from large damaging earthquakes, the accuracy of such predictions depends on the accuracy of the 3D model. We evaluated the USGS 3D model of the Bay Area by computing predictions of broadband waveforms for 12 moderate (Mw 4-5) earthquakes and comparing them to the observed waveforms. Calculations were performed using WPP (an elastic finite difference code developed at LLNL) on massively parallel computers. Data were obtained from IRIS for Berkeley Digital Seismic Network (BDSN) and USArray broadband stations. The figure below shows a snapshot of the vertical component displacements for an earthquake near Glen Ellen (Sonoma County). Also shown is the comparison of the observed (blue) and computed (red) three-component seismograms at two stations: BKS (Berkeley) and JRSC (Stanford). Note that the motions at BKS are more complex and longer duration due to basin propagation effects from the San Pablo Bay, however the 3D model predicts this energy quite well. The motions at JRSC are simpler and the 3D model predicts the weaker late arriving energy on the transverse (T) component. This analysis found that the USGS 3D model could predict the amplitude, duration and waveform shapes of moderate earthquake ground motions quite well however we did find that phase delays reveal that shear velocities in the model were too fast. This information was used to revise the model for subsequent ground motion modeling.

58 GEOSCIENCES↗

Quartz c-axis orientation patterns in fracture cement as a measure of fracture opening rate and a validation tool for fracture pattern models

Here, we evaluate a published model for crystal growth patterns in quartz cement in sandstone fractures by comparing crystal fracture-spanning predictions to quartz c-axis orientation distributions measured by electron backscatter diffraction (EBSD) of spanning quartz deposits. Samples from eight subvertical opening-mode fractures in four sandstone formations, the Jurassic– Cretaceous Nikanassin Formation, northwestern Alberta Foothills (Canada), Cretaceous Mesaverde Group (USA; Cozzette Sandstone Member of the Iles Formation), Piceance Basin, Colorado (USA), and upper Jurassic–lower Cretaceous Cotton Valley Group (Taylor sandstone) and overlying Travis Peak Formation, east Texas, have similar quartzose composition and grain size but contain fractures with different temperature histories and opening rates based on fluid inclusion assemblages and burial history. Spherical statistical analysis shows that, in agreement with model predictions, bridging crystals have a preferred orientation with c-axis orientations at a high angle to fracture walls. The second form of validation is for spanning potential that depends on the size of cut substrate grains. Using measured cut substrate grain sizes and c-axis orientations of spanning bridges, we calculated the required orientation for the smallest cut grain to span the maximum gap size and the required orientation of the crystal with the least spanning potential to form overgrowths that span across maximum measured gap sizes. We find that within a 10° error all spanning crystals conform to model predictions. Using crystals with the lowest spanning potential based on crystallographic orientation (c-axis parallel to fracture wall) and a temperature range for fracture opening measured from fluid inclusion assemblages, we calculate maximum fracture opening rates that allow crystals to span. These rates are comparable to those derived independently from fracture temperature histories based on burial history and multiple sequential fluid inclusion assemblages. Results support the R. Lander and S. Laubach model, which predicts that for quartz deposited synchronously with fracture opening, spanning potential, or likelihood of quartz deposits that are thick enough to span between fracture walls, depends on temperature history, fracture opening rate, size of opening increments, and size, mineralogy, and crystallographic orientation of substrates in the fracture wall (transected grains). Results suggest that EBSD maps, which can be more rapidly acquired than measurement of tens to hundreds of fluid inclusion assemblages, can provide a useful measure of relative opening rates within populations of quartz-filled fractures formed under sedimentary basin conditions. Such data are useful for evaluating fracture pattern development models.

36 MATERIALS SCIENCE↗

Models and techniques for evaluating the effectiveness of aircraft computing systems

Models, measures and techniques were developed for evaluating the effectiveness of aircraft computing systems. The concept of effectiveness involves aspects of system performance, reliability and worth. Specifically done was a detailed development of model hierarchy at mission, functional task, and computational task levels. An appropriate class of stochastic models was investigated which served as bottom level models in the hierarchial scheme. A unified measure of effectiveness called 'performability' was defined and formulated.

Meyer, J. F.↗

Follow-Up from the Photovoltaic Reliability Workshop (PVRW): Cost Modeling Capabilities to Evaluate Trends in PV Technologies

NREL's Solar and Storage Techno-Economic Analysis (TEA) team reviews live polling results from the Photovoltaic Reliability Workshop (PVRW) related to module technology trends believed to have the greatest reliability impacts. Then, the team reviews the publicly available tools and inputs necessary for evaluating reliability tradeoffs between initial module and system costs, degradation profiles, and levelized cost of energy (LCOE). These tools include the online Detailed Cost Analysis Models (DCAM) and the DuraMAT LCOE calculator.

cost modeling↗

Concept Lens: Visual Comparison and Evaluation of Generative Model Manipulations

Generative models are becoming a transformative technology for the creation and editing of images. However, it remains challenging to harness these models for precise image manipulation. These challenges often manifest as inconsistency in the editing process, where both the type and amount of semantic change, depend on the image being manipulated. Moreover, there exist many methods for computing image manipulations, whose development is hindered by the matter of inconsistency. This paper aims to address these challenges by improving how we evaluate, compare, and explore the space of manipulations offered by a generative model. We present Concept Lens, a visual interface that is designed to aid users in understanding semantic concepts carried in image manipulations, and how these manipulations vary over generated images. Given the large space of possible images produced by a generative model, Concept Lens is designed to support the exploration of both generated images, and their manipulations, at multiple levels of detail. To this end, the layout of Concept Lens is informed by two hierarchies: a hierarchical organization of (1) original images, grouped by their similarities, and (2) image manipulations, where manipulations that induce similar changes are grouped together. This layout allows one to discover the types of images that consistently respond to a group of manipulations, and vice versa, manipulations that consistently respond to a group of codes. We show the benefits of this design across multiple use cases, specifically, studying the quality of manipulations for a single method, and offering a means of comparing different methods.

clustering↗

A Macroalgal Cultivation Modeling System (MACMODS): Evaluating the Role of Physical-Biological Coupling on Nutrients and Farm Yield

Offshore aquaculture has the potential to expand the macroalgal industry. However, moving into deeper waters requires suspended structures that will present novel farm-environment interactions. Here, we present a computational modeling framework, the Macroalgal Cultivation Modeling System (MACMODS), to explore within-farm modifications to light, seawater flow, and nutrient fields across time and space scales relevant to macroalgae. A regional ocean model informs the site-specific setting, the Santa Barbara Channel in the Southern California Bight. A fine-scale hydrodynamic model predicts modified flows and turbulent mixing within the farm. A spatially resolved macroalgal growth model, parameterized for giant kelp, Macrocystis pyrifera , predicts kelp biomass. Key findings from model integration are that regional ocean conditions set overall farm performance, while fine-scale within-farm circulation and nutrient delivery are important to resolve variation in within-farm macroalgal performance. Therefore, we conclude that models resolving within-farm dynamics can provide benefit to farmers with insight on how farm design and regional ocean conditions interact to influence overall yield. Here, the presence of repeating longlines aligned with the mean current generate flow diversions around the farm as well as attached Langmuir circulations and increased turbulence intensity. These flow-induced phenomena lead to less biomass in the interior portion of the farm relative to the edges. We also find that there is an effluent “footprint” that extends as much as 20 km beyond the farm. In this regard, MACMODS can be used to not only evaluate farm design and cultivation practices that maximize yield but also explore interactions between the farm and ecosystem in order to minimize impacts.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of the Role of Cisplatin-conjugated-soluble Gelatin Sponge: Feasibility Study in a Swine Model

PurposeTo evaluate the safety and the delivery function of cisplatin-conjugated-soluble gelatin sponge in a swine model.MethodsFifteen healthy young swine were assigned into three groups: transarterial cisplatin infusion group, transarterial chemoembolization (TACE) with cisplatin-conjugated 120-min soluble gelatin sponge (TACE-120) group, and TACE with cisplatin-conjugated 360-min soluble gelatin sponge (TACE-360) group. A total volume of 0.8 mL/kg cisplatin in each group and 8 mg/kg soluble gelatin sponge in TACE-120 and TACE-360 groups were injected from the left hepatic artery in small increments for 10 min. Common hepatic angiography and whole-blood sampling via the left hepatic vein were conducted to explore recanalization immediately after the procedure and again at 10, 30, 60, 90, 120, 180, 240, 300, 360, and 420 min later. The area under the plasma concentration curve (AUC) of non-protein-bound platinum was compared among the three groups. Each liver was removed and cut into 10-cm-thick sections for calculating liver-damaged volume ratio.ResultsSequential angiography depicted gradual recanalization of the occluded hepatic artery and total recanalization at 120 and 360 min after embolization in the TACE-120 and TACE-360 groups, respectively. Of the three groups, AUC{sub 0-30}, AUC{sub 30-120}, and AUC{sub 120-420} were significantly highest in the transarterial cisplatin infusion group (p < 0.001), the TACE-120 group (p < 0.001), and the TACE-360 group (p < 0.001), respectively. The liver-damaged volume ratio in the TACE-360 group was small (8.20 %) but significantly higher than that in the TACE-120 group (2.67 %, p = 0.014).ConclusionCisplatin-conjugated soluble gelatin sponge functions as a cisplatin carrier and is associated with tolerable liver damage.

62 RADIOLOGY AND NUCLEAR MEDICINE↗