Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

Evaluating the Taylor hardening model in polycrystalline Ti using high energy X-ray diffraction microscopy

High energy X-ray diffraction microscopy (HEDM) was employed to index nearly 1000 grains in a polycrystalline Ti specimen and characterize their deformation during an incremental tensile test. For each grain, the positions of its associated diffraction peaks were used for analyzing its evolving crystal orientation and stress tensor. The azimuthal breadth of each peak at different load steps was measured, allowing measurement of initial yielding and providing an estimate of the dislocation density evolution in each grain. Furthermore, the Taylor hardening model was evaluated grain by grain using the above data, indicating that it can represent hardening in most grains. The yield stress and the strain hardening coefficient for all grains were statistically analyzed with respect to grain orientation, grain size, slip systems, and the surrounding neighborhood to examine how the yield stress and hardening are correlated.

36 MATERIALS SCIENCE↗

The development of methods for primary mast cells in vitro and ex vivo: An historical review

Highlights: • Mast cells form a first-line defense of immune system against various challenges. • Over the past few decades, technologies for acquiring mast cells have been continually optimized. • The advantages and applicability of diverse mast cell models evaluated. • It is important to choose a proper cell source for mast cell-related experiments. Mast cells (MCs) are tissue-based stationary effector cells that form the immune system's first-line defense against various challenges. They are developed from the bone marrow-derived progenitors to complete their differentiation and maturation in the tissues where they eventually establish residence. MCs have been implicated in many diseases, such as allergy, parasitic infection, and neoplastic disorders. Immortalized MC lines, such as RBL-2H3, HMC-1, and LAD-2, are useful for investigating the biological functions of MC only to some extents due to the restriction of degranulation evaluation, in vivo injection and other factors. Over the past few decades, technologies for acquiring primarily MCs have been continually optimized, and novel protocols have been proposed. However, no relevant publications have analyzed and summarized these techniques. In this review, the classical approaches for extracting MCs are generalized, and new methods with potential values are introduced. We also evaluate the advantages and applicability of diverse MC models. Since MCs exhibit substantial plasticity and functional diversity due to different origins, it is both necessary and urgent to select a reliable and suitable source of MCs for a particular study.

60 APPLIED LIFE SCIENCES↗

Assessing the accuracy of time-fraction and ductility exhaustion approaches for creep-fatigue damage prediction through feature-test validation

Determining creep-fatigue damage formation is critical for elevated temperature components integrity. This study evaluates creep-fatigue assessments with emphasis on differences between creep damage models. Evaluated are the time-fraction model and the classical and stress-modified ductility exhaustion creep damage models. This work extends the domain of stress-modified ductility exhaustion models by introducing and validating such formalism to Ni-based alloys. The fidelity of the assessments was benchmarked against uniaxial creep-fatigue and multiaxial feature tests of Alloy 617. For uniaxial specimens, best estimate predictions rank ductility exhaustion as the most accurate and precise and time-fraction as markedly conservative. For feature tests, ductility exhaustion predictions are within < 4.0 times difference, whereas time-fraction underpredicts life by factors of 7–14. The observations suggest ductility exhaustion models as alternative to time-fraction models in design codes for situations requiring characterization of the design margin. Further work in employing such models to assess other relevant phenomena (e.g., stress relaxation cracking) is discussed.

creep-fatigue↗

Microbial models with data‐driven parameters predict stronger soil carbon responses to climate change

Abstract Long‐term carbon (C) cycle feedbacks to climate depend on the future dynamics of soil organic carbon ( SOC ). Current models show low predictive accuracy at simulating contemporary SOC pools, which can be improved through parameter estimation. However, major uncertainty remains in global soil responses to climate change, particularly uncertainty in how the activity of soil microbial communities will respond. To date, the role of microbes in SOC dynamics has been implicitly described by decay rate constants in most conventional global carbon cycle models. Explicitly including microbial biomass dynamics into C cycle model formulations has shown potential to improve model predictive performance when assessed against global SOC databases. This study aimed to data‐constrained parameters of two soil microbial models, evaluate the improvements in performance of those calibrated models in predicting contemporary carbon stocks, and compare the SOC responses to climate change and their uncertainties between microbial and conventional models. Microbial models with calibrated parameters explained 51% of variability in the observed total SOC , whereas a calibrated conventional model explained 41%. The microbial models, when forced with climate and soil carbon input predictions from the 5th Coupled Model Intercomparison Project ( CMIP 5), produced stronger soil C responses to 95 years of climate change than any of the 11 CMIP 5 models. The calibrated microbial models predicted between 8% (2‐pool model) and 11% (4‐pool model) soil C losses compared with CMIP 5 model projections which ranged from a 7% loss to a 22.6% gain. Lastly, we observed unrealistic oscillatory SOC dynamics in the 2‐pool microbial model. The 4‐pool model also produced oscillations, but they were less prominent and could be avoided, depending on the parameter values.

Hararuk, Oleksandra↗

ELM model simulations of Plum Island Ecosystems LTER low marsh site 2018-2020

Model simulations using the Department of Energy's Energy Exascale Earth System Model (E3SM) land model (ELM) with improved capabilities to represent vegetation response to salinity and inundation. The simulations were conducted for a tidal salt marsh at Plum Island Ecosystems Long Term Ecological Research (LTER) site near Rowley, Massachusetts, USA; the site is a low marsh dominated by Spartina alterniflora. The model was forced with site-specific meteorology, salinity and tidal cycles from 2018-2020. Four sets of model simulations are included and described below:1. Parameterization of the salinity response function. These simulations tested different combinations of values for optimal salinity and salinity tolerance.2. Model evaluation. This comparison conducted simulations using the default model, the salinity function only, the submergence function only, and both the salinity and submergence functions. 3. Salinity scenarios. These simulations used the 2018 salinity input data varied by -5 to +10 ppt salinity.4. Water level scenarios. These simulations used the tide height varied by -10 to +50 cm. These simulations were used to demonstrate how the salinity and submergence functions better represent carbon uptake by tidal salt marshes.The data package includes netCDF files used as forcing files for tide height and salinity, one for each year 2018-2020 at observed salinity concentrations, and an additional three forcing files in which salinity concentrations were varied 5 ppt lower, 5 ppt higher, and 10 ppt higher than the measured 2018 time series. Also included are python scripts for creating forcing files, plain text parameter and command files for running simulations, model outputs in netCDF format, and python scripts for visualizing outputs. Code for the modified E3SM model is archived in Sulman et al 2023 at doi:10.15485/1991625. More detail about files is provided in the README.md file.

54 ENVIRONMENTAL SCIENCES↗

Perennialization and Cover Cropping Mitigate Soil Carbon Loss from Residue Harvesting

While the US Midwest is expected to serve as a primary feedstock source for cellulosic biofuel production, the impacts of residue harvesting on soil organic carbon (SOC) may greatly limit sustainable production capacity. However, viable feedstock production could be realized through adoption of management practices and cropping systems that offset residue‐harvest‐induced SOC losses. Sequestration of SOC can be enhanced by increasing the duration of crop soil cover through cover or double cropping or cultivation of dedicated perennials. However, assessing the efficacy of such options across sites and over long periods is experimentally challenging. Hence, we use the Environmental Productivity Integrated Climate (EPIC) model to provide such an assessment. Model‐data integration was used to calibrate and evaluate model suitability, which exhibited reasonable effectiveness through R 2 of 0.97 and 0.63 for SOC stock and yield, respectively. Long‐term simulations indicate considerable capacity for offsetting SOC loss. Incorporating rye ( Secale cereal L.) into continuous corn ( Zea mays L.) and corn–soybean [ Glycine max (L.) Merr.] systems offset the SOC losses induced by harvesting 21.2 and 38.3% of available stover, respectively. Similarly, converting 20.4% of corn–soybean land to miscanthus ( Miscanthus × giganteus J.M. Greef & Deuter ex Hodkinson & Renvoize) or 27.5% of land to switchgrass ( Panicum virgatum L.) offset the SOC impacts of harvesting 60% of stover from the remaining corn–soybean lands. These responses indicate that adoption of such measures would sizably affect the life cycle consequences of residue‐derived biofuels and expand estimates of sustainable cellulosic feedstock production capacity from the US Midwest. Core Ideas EPIC suitably assessed SOC under annual, cover, double, and perennial crops. Perennial cultivation offset the SOC losses of considerable residue harvesting. Rye double crops offset sizable residue‐induced SOC losses. Adoption could greatly expand Midwestern sustainable biofuel production capacity.

Jones, Curtis D.↗

Course: 17664 TSQP - Evaluation [Slides]

The purpose of this course is to help you understand evaluation concepts, Kirkpatrick’s Evaluation Model, and to be able to apply basic evaluation techniques to training courses, programs, and processes.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Simulating mixed-phase Arctic stratus clouds: Sensitivity to ice initiationmechanisms

The importance of Arctic mixed-phase clouds on radiation and the Arctic climate is well known. However, the development of mixed-phase cloud parameterization for use in large scale models is limited by lack of both related observations and numerical studies using multidimensional models with advanced microphysics that provide the basis for understanding the relative importance of different microphysical processes that take place in mixed-phase clouds. To improve the representation of mixed-phase cloud processes in the GISS GCM we use the GISS single-column model coupled to a bin resolved microphysics (BRM) scheme that was specially designed to simulate mixed-phase clouds and aerosol-cloud interactions. Using this model with the microphysical measurements obtained from the DOE ARM Mixed-Phase Arctic Cloud Experiment (MPACE) campaign in October 2004 at the North Slope of Alaska, we investigate the effect of ice initiation processes and Bergeron-Findeisen process (BFP) on glaciation time and longevity of single-layer stratiform mixed-phase clouds. We focus on observations taken during October 9th-10th, which indicated the presence of a single-layer mixed-phase clouds. We performed several sets of 12-hour simulations to examine model sensitivity to different ice initiation mechanisms and evaluate model output (hydrometeors concentrations, contents, effective radii, precipitation fluxes, and radar reflectivity) against measurements from the MPACE Intensive Observing Period. Overall, the model qualitatively simulates ice crystal concentration and hydrometeors content, but it fails to predict quantitatively the effective radii of ice particles and their vertical profiles. In particular, the ice effective radii are overestimated by at least 50%. However, using the same definition as used for observations, the effective radii simulated and that observed were more comparable. We find that for the single-layer stratiform mixed-phase clouds simulated, process of ice phase initiation due to freezing of supercooled water in both saturated and subsaturated (w.r.t. water) environments is as important as primary ice crystal origination from water vapor. We also find that the BFP is a process mainly responsible for the rates of glaciation of simulated clouds. These glaciation rates cannot be adequately represented by a water-ice saturation adjustment scheme that only depends on temperature and liquid and solid hydrometeors contents as is widely used in bulk microphysics schemes and are better represented by processes that also account for supersaturation changes as the hydrometeors grow.

54 ENVIRONMENTAL SCIENCES↗

Simulating mixed-phase Arctic stratus clouds: sensitivity to ice initiation mechanisms

The importance of Arctic mixed-phase clouds on radiation and the Arctic climate is well known. However, the development of mixed-phase cloud parameterization for use in large scale models is limited by lack of both related observations and numerical studies using multidimensional models with advanced microphysics that provide the basis for understanding the relative importance of different microphysical processes that take place in mixed-phase clouds. To improve the representation of mixed-phase cloud processes in the GISS GCM we use the GISS single-column model coupled to a bin resolved microphysics (BRM) scheme that was specially designed to simulate mixed-phase clouds and aerosol-cloud interactions. Using this model with the microphysical measurements obtained from the DOE ARM Mixed-Phase Arctic Cloud Experiment (MPACE) campaign in October 2004 at the North Slope of Alaska, we investigate the effect of ice initiation processes and Bergeron-Findeisen process (BFP) on glaciation time and longevity of single-layer stratiform mixed-phase clouds. We focus on observations taken during 9th-10th October, which indicated the presence of a single-layer mixed-phase clouds. We performed several sets of 12-h simulations to examine model sensitivity to different ice initiation mechanisms and evaluate model output (hydrometeors concentrations, contents, effective radii, precipitation fluxes, and radar reflectivity) against measurements from the MPACE Intensive Observing Period. Overall, the model qualitatively simulates ice crystal concentration and hydrometeors content, but it fails to predict quantitatively the effective radii of ice particles and their vertical profiles. In particular, the ice effective radii are overestimated by at least 50%. However, using the same definition as used for observations, the effective radii simulated and that observed were more comparable. We find that for the single-layer stratiform mixed-phase clouds simulated, process of ice phase initiation due to freezing of supercooled water in both saturated and undersaturated (w.r.t. water) environments is as important as primary ice crystal origination from water vapor. We also find that the BFP is a process mainly responsible for the rates of glaciation of simulated clouds. These glaciation rates cannot be adequately represented by a water-ice saturation adjustment scheme that only depends on temperature and liquid and solid hydrometeors contents as is widely used in bulk microphysics schemes and are better represented by processes that also account for supersaturation changes as the hydrometeors grow.

54 ENVIRONMENTAL SCIENCES↗

Extracting scene feature vectors through modeling, volume 3

The remote estimation of the leaf area index of winter wheat at Finney County, Kansas was studied. The procedure developed consists of three activities: (1) field measurements; (2) model simulations; and (3) response classifications. The first activity is designed to identify model input parameters and develop a model evaluation data set. A stochastic plant canopy reflectance model is employed to simulate reflectance in the LANDSAT bands as a function of leaf area index for two phenological stages. An atmospheric model is used to translate these surface reflectances into simulated satellite radiance. A divergence classifier determines the relative similarity between model derived spectral responses and those of areas with unknown leaf area index. The unknown areas are assigned the index associated with the closest model response. This research demonstrated that the SRVC canopy reflectance model is appropriate for wheat scenes and that broad categories of leaf area index can be inferred from the procedure developed.

Berry, J. K.↗

Active Control of Space Structures (ACOSS) model 2

A complete description of the active control of space structures model #2 which is a simple but realistic evaluation model is given. The design of this system was driven by the desire to incorporate certain attributes into the overall system characteristics. The desired features were structural design based on realistic sizes and weights; a simple unclassified optical system with associated performance measures and tolerance; and a set of disturbances typical of equipment vibration and attitude control (slew). The resulting model is described in detail along with the resulting mode shapes and natural frequencies of the system. A description of the line-of-sight performance measure including theory and implementation is given.

Henderson, T. C.↗

Adaptive Modeling of the International Space Station Electrical Power System

Software simulations provide NASA engineers the ability to experiment with spacecraft systems in a computer-imitated environment. Engineers currently develop software models that encapsulate spacecraft system behavior. These models can be inaccurate due to invalid assumptions, erroneous operation, or system evolution. Increasing accuracy requires manual calibration and domain-specific knowledge. This thesis presents a method for automatically learning system models without any assumptions regarding system behavior. Data stream mining techniques are applied to learn models for critical portions of the International Space Station (ISS) Electrical Power System (EPS). We also explore a knowledge fusion approach that uses traditional engineered EPS models to supplement the learned models. We observed that these engineered EPS models provide useful background knowledge to reduce predictive error spikes when confronted with making predictions in situations that are quite different from the training scenarios used when learning the model. Evaluations using ISS sensor data and existing EPS models demonstrate the success of the adaptive approach. Our experimental results show that adaptive modeling provides reductions in model error anywhere from 80% to 96% over these existing models. Final discussions include impending use of adaptive modeling technology for ISS mission operations and the need for adaptive modeling in future NASA lunar and Martian exploration.

Thomas, Justin Ray↗

Tropical Cyclone Information System

The JPL Tropical Cyclone Infor ma tion System (TCIS) is a Web portal (http://tropicalcyclone.jpl.nasa.gov) that provides researchers with an extensive set of observed hurricane parameters together with large-scale and convection resolving model outputs. It provides a comprehensive set of high-resolution satellite (see figure), airborne, and in-situ observations in both image and data formats. Large-scale datasets depict the surrounding environmental parameters such as SST (Sea Surface Temperature) and aerosol loading. Model outputs and analysis tools are provided to evaluate model performance and compare observations from different platforms. The system pertains to the thermodynamic and microphysical structure of the storm, the air-sea interaction processes, and the larger-scale environment as depicted by ocean heat content and the aerosol loading of the environment. Currently, the TCIS is populated with satellite observations of all tropical cyclones observed globally during 2005. There is a plan to extend the database both forward in time till present as well as backward to 1998. The portal is powered by a MySQL database and an Apache/Tomcat Web server on a Linux system. The interactive graphic user interface is provided by Google Map.

Li, P. Peggy↗

The Response of Tropospheric Ozone to ENSO in Observations and a Chemistry-Climate Simulation

The El Nino-Southern Oscillation (ENSO) is the dominant mode of tropical variability on interannual time scales. ENSO appears to extend its influence into the chemical composition of the tropical troposphere. Recent results have revealed an ENSO induced wave-l anomaly in observed tropical tropospheric column ozone. This results in a dipole over the western and eastern tropical Pacific, whereby differencing the two regions produces an ozone anomaly with an extremely high correlation to the Nino 3.4 Index. We have successfully reproduced this result using the Goddard Earth Observing System Version 5 (GEOS-5) general circulation model coupled to a comprehensive stratospheric and tropospheric chemical mechanism forced with observed sea surface temperatures over the past 25 years. An examination of the modeled ozone field reveals the vertical contributions of tropospheric ozone to the column over the western and eastern Pacific region. We will show targeted comparisons with observations from NASA's Aura satellite Microwave Limb Sounder (MLS), and the Tropospheric Emissions Spectrometer (TES) to provide insight into the vertical structure of ozone changes. The tropospheric ozone response to ENSO could be a useful chemistry-climate model evaluation tool and should be considered in future modeling assessments.

Oman, L. D.↗

Modeling the Effects of Global Change on Ecosystem Processes in a Tropical Rainforest

Ongoing land-use change and climate change in wet tropical forests can potentially drive shifts in tree species composition, representing a change in individual species within a functional group, tropical evergreen trees. The impacts on the global carbon cycle are potentially large, but unclear. We explored the differential effects of species within this functional group, in comparison with the effects of climate change, using the Century model as a research tool. Simulating effects of individual tree species on biome-level biogeochemical cycles constituted a novel application for Century. Background and Objectives: A unique, long-term, replicated field experiment containing five evergreen tree species in monodominant stands under similar environmental conditions in a Costa Rican wet forest provided data for model evaluation. Our objectives were to gain insights about this forest’s biogeochemical cycles and effects of tree species within this functional group, in comparison with climate change. Materials and Methods: We calibrated Century, using long-term meteorological, soil, and plant data from the field-based experiment. In modeling experiments, we evaluated effects on forest biogeochemistry of eight plant traits that were both observed and modeled. Climate-change simulation experiments represented two climate-change aspects observed in this region. Results: Model calibration revealed that unmodeled soil processes would be required to sustain observed P budgets. In species-traits experiments, three separate plant traits (leaf death rate, leaf C:N, and allocation to fine roots) resulted in modeled biomass C stock changes of >50%, compared with a maximum 21% change in the climate-change experiments. Conclusions: Modeled ecosystem properties and processes in Century were sensitive to changes in plant traits and nutrient limitations to productivity. Realistic model output was attainable for some species, but unusual plant traits thwarted predictions for one species. Including more plant traits and soil processes could increase realism, but less-complex models provide an accessible means for exploring plant-soil-atmosphere interactions.

54 ENVIRONMENTAL SCIENCES↗

Neural Posterior Estimation for Scalable and Accurate Inverse Parameter Inference in Li-Ion Batteries

Diagnosing the internal state of Li-ion batteries is critical for battery research, operation of real-world systems, and prognostic evaluation of remaining lifetime. By using physics-based models to perform probabilistic parameter estimation via Bayesian calibration, diagnostics can account for the uncertainty due to model fitness, data noise, and the observability of any given parameter. However, Bayesian calibration in Li-ion batteries using electrochemical data is computationally intensive even when using a fast surrogate in place of physics-based models, requiring many thousands of model evaluations. A fully amortized alternative is neural posterior estimation (NPE). NPE shifts the computational burden from the parameter estimation step to data generation and model training, reducing the parameter estimation time from minutes to milliseconds, enabling real-time applications. The present work shows that NPE can infer parameters equally or more accurately than Bayesian calibration, even if it leads to higher voltage reconstruction errors. We also demonstrate that the higher computational costs for data generation are tractable even in high-dimensional cases (ranging from 6 to 27 estimated parameters). The NPE method also offers several interpretability advantages over Bayesian calibration, such as local parameter sensitivity to specific regions of the voltage curve. The NPE method is demonstrated using an experimental fast charge dataset, with parameter estimates validated against measurements of loss of lithium inventory and loss of active material. The implementation is made available in a companion repository (https://github.com/NatLabRockies/BatFIT).

25 ENERGY STORAGE↗