Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,747 records · Page 97

Integrated Modeling Approach for the Development of Climate-Informed, Actionable Information

Flooding is a prevalent natural disaster with both short and long-term social, economic, and infrastructure impacts. Changes in intensity and frequency of precipitation (including rain, snow, and rain on snow) events create challenges for the planning and management of resilient infrastructure and communities. While there is general acknowledgement that new infrastructure design should account for future climate change, no clear methods or actionable information is available to community planners and designers to ensure resilient design considering an uncertain climate future. This research used climate projections to drive high-resolution hydrology and flood models to evaluate social, economic, and infrastructure resilience for the Snohomish Watershed, WA, U.S.A. The proposed model chain has been calibrated and validated. Based on the established model chain, the peaks of precipitation and streamflows were found to shift from spring and summer to earlier winter season. The nonstationarity of peak discharges was discovered with more frequent and severe flood risks projected. The peak discharges were also projected to decrease for a certain period in the near future, which might be due to the reduced rain-on-snow events. This research was expected to provide a clear method for the incorporation of climate science in flood resilience analysis and to also provide actionable information relative to the frequency and intensity of future precipitation events.

54 ENVIRONMENTAL SCIENCES↗

LANDSAT 4 band 6 data evaluation

Computer modelled atmospheric transmittance and path radiance values were compared with empirical values derived from aircraft underflight data. Aircraft thermal infrared imagery and calibration data were available on two dates as were corresponding atmospheric radiosonde data. The radiosonde data were used as input to the LOWTRAN 5A code. The aircraft data were calibrated and utilized to generate analogous measurements. The results of the analysis indicate that there is a tendancy for the LOWTRAN model to underestimate atmospheric path radiance and overestimate atmospheric transmittance.

Source record↗

Impact of Parcel Size, Field Shape, Crop Yield, Storage Location, and Collection Equipment on the Performance of Single-Pass Cut-and-Chip Harvest System in Commercial Shrub Willow Fields

In this paper, an integrated system of harvesting, collecting, and transporting willow biomass crop to a storage site was modeled and evaluated using the IBSAL simulation model. A scenario analysis was used to quantify the impacts of five major input parameters on the performance of the integrated system. These parameters include parcel size, field shape, willow yield, distance to the storage site, and type of the collection equipment. Multiple performance indicators were identified to quantify the impacts on the system such as size of the equipment fleet, effective material and field capacity of the harvester, operating costs, and waiting times. The input data were collected from 36 commercial, short-rotation, shrub willow fields in northern New York State. The simulation results indicated that crop yield and type of collection equipment have the highest impact on operating costs and the equipment fleet size. As the size of equipment fleet increases in the system, variability in the system performance tends to increase. Field shape has the least impact on the overall system performance compared to the other four input parameters. The simulation results suggest that a combination of performance indicators need to be considered to evaluate the overall performance of the dynamic and complex system of harvesting, collection and transportation in commercial willow fields. The developed IBSAL model and scenario analysis approach can assist in planning this system based on the characteristics of field, crop, and logistical equipment to reach a high system performance.

54 ENVIRONMENTAL SCIENCES↗

Technical Evaluation of the NASA Model for Cancer Risk to Astronauts Due to Space Radiation

At the request of NASA, the National Research Council's (NRC's) Committee for Evaluation of Space Radiation Cancer Risk Model1 reviewed a number of changes that NASA proposes to make to its model for estimating the risk of radiation-induced cancer in astronauts. The NASA model in current use was last updated in 2005, and the proposed model would incorporate recent research directed at improving the quantification and understanding of the health risks posed by the space radiation environment. NASA's proposed model is defined by the 2011 NASA report Space Radiation Cancer Risk Projections and Uncertainties--2010 . The committee's evaluation is based primarily on this source, which is referred to hereafter as the 2011 NASA report, with mention of specific sections or tables. The overall process for estimating cancer risks due to low linear energy transfer (LET) radiation exposure has been fully described in reports by a number of organizations. The approaches described in the reports from all of these expert groups are quite similar. NASA's proposed space radiation cancer risk assessment model calculates, as its main output, age- and gender-specific risk of exposure-induced death (REID) for use in the estimation of mission and astronaut-specific cancer risk. The model also calculates the associated uncertainties in REID. The general approach for estimating risk and uncertainty in the proposed model is broadly similar to that used for the current (2005) NASA model and is based on recommendations by the National Council on Radiation Protection and Measurements. However, NASA's proposed model has significant changes with respect to the following: the integration of new findings and methods into its components by taking into account newer epidemiological data and analyses, new radiobiological data indicating that quality factors differ for leukemia and solid cancers, an improved method for specifying quality factors in terms of radiation track structure concepts as opposed to the previous approach based on linear energy transfer, the development of a new solar particle event (SPE) model, and the updates to galactic cosmic ray (GCR) and shielding transport models. The newer epidemiological information includes updates to the cancer incidence rates from the life span study (LSS) of the Japanese atomic bomb survivors, transferred to the U.S. population and converted to cancer mortality rates from U.S. population statistics. In addition, the proposed model provides an alternative analysis applicable to lifetime never-smokers (NSs). Details of the uncertainty analysis in the model have also been updated and revised. NASA's proposed model and associated uncertainties are complex in their formulation and as such require a very clear and precise set of descriptions. The committee found the 2011 NASA report challenging to review largely because of the lack of clarity in the model descriptions and derivation of the various parameters used. The committee requested some clarifications from NASA throughout its review and was able to resolve many, but not all, of the ambiguities in the written description.

Source record↗

Semivolatile POA and parameterized total combustion SOA in CMAQv5.2: impacts on source strength and partitioning

Abstract. Mounting evidence from field and laboratory observations coupled with atmospheric model analyses shows that primary combustion emissions of organic compounds dynamically partition between the vapor and particulate phases, especially as near-source emissions dilute and cool to ambient conditions. The most recent version of the Community Multiscale Air Quality model version 5.2 (CMAQv5.2) accounts for the semivolatile partitioning and gas-phase aging of these primary organic aerosol (POA) compounds consistent with experimentally derived parameterizations. We also include a new surrogate species, potential secondary organic aerosol from combustion emissions (pcSOA), which provides a representation of the secondary organic aerosol (SOA) from anthropogenic combustion sources that could be missing from current chemical transport model predictions. The reasons for this missing mass likely include the following: (1) unspeciated semivolatile and intermediate volatility organic compound (SVOC and IVOC, respectively) emissions missing from current inventories, (2) multigenerational aging of organic vapor products from known SOA precursors (e.g., toluene, alkanes), (3) underestimation of SOA yields due to vapor wall losses in smog chamber experiments, and (4) reversible organic compounds–water interactions and/or aqueous-phase processing of known organic vapor emissions. CMAQ predicts the spatially averaged contribution of pcSOA to OA surface concentrations in the continental United States to be 38.6 and 23.6 % in the 2011 winter and summer, respectively. Whereas many past modeling studies focused on a particular measurement campaign, season, location, or model configuration, we endeavor to evaluate the model and important uncertain parameters with a comprehensive set of United States-based model runs using multiple horizontal scales (4 and 12 km), gas-phase chemical mechanisms, and seasons and years. The model with representation of semivolatile POA improves predictions of hourly OA observations over the traditional nonvolatile model at sites during field campaigns in southern California (CalNex, May–June 2010), northern California (CARES, June 2010), the southeast US (SOAS, June 2013; SEARCH, January and July, 2011). Model improvements manifest better correlations (e.g., the correlation coefficient at Pasadena at night increases from 0.38 to 0.62) and reductions in underprediction during the photochemically active afternoon period (e.g., bias at Pasadena from −5.62 to −2.42 µg m−3). Daily averaged predictions of observations at routine-monitoring networks from simulations over the continental US (CONUS) in 2011 show modest improvement during winter, with mean biases reducing from 1.14 to 0.73 µg m−3, but less change in the summer when the decreases from POA evaporation were similar to the magnitude of added SOA mass. Because the model-performance improvement realized by including the relatively simple pcSOA approach is similar to that of more-complicated parameterizations of OA formation and aging, we recommend caution when applying these more-complicated approaches as they currently rely on numerous uncertain parameters. The pcSOA parameters optimized for performance at the southern and northern California sites lead to higher OA formation than is observed in the CONUS evaluation. This may be due to any of the following: variations in real pcSOA in different regions or time periods, too-high concentrations of other OA sources in the model that are important over the larger domain, or other model issues such as loss processes. This discrepancy is likely regionally and temporally dependent and driven by interferences from factors like varying emissions and chemical regimes.

54 ENVIRONMENTAL SCIENCES↗

U.S. Eastern Continental Shelf Carbon Cycling (USECoS): Modeling, Data Assimilation, and Analysis

Although the oceans play a major role in the uptake of fossil fuel CO2 from the atmosphere, there is much debate about the contribution from continental shelves, since many key shelf fluxes are not yet well quantified: the exchange of carbon across the land-ocean and shelf-slope interfaces, air-sea exchange of CO2, burial, and biological processes including productivity. Our goal is to quantify these carbon fluxes along the eastern U.S. coast using models quantitatively verified by comparison to observations, and to establish a framework for predicting how these fluxes may be modified as a result of climate and land use change. Our research questions build on those addressed with previous NASA funding for the USECoS (U.S. Eastern Continental Shelf Carbon Cycling) project. We have developed a coupled biogeochemical ocean circulation model configured for this study region and have extensively evaluated this model with both in situ and remotely-sensed data. Results indicate that to further reduce uncertainties in the shelf component of the global carbon cycle, future efforts must be directed towards 1) increasing the resolution of the physical model via nesting and 2) making refinements to the biogeochemical model and quantitatively evaluating these via the assimilation of biogeochemical data (in situ and remotely-sensed). These model improvements are essential for better understanding and reducing estimates of uncertainties in current and future carbon transformations and cycling in continental shelf systems. Our approach and science questions are particularly germane to the carbon cycle science goals of the NASA Earth Science Research Program as well as the U.S. Climate Change Research Program and the North American Carbon Program. Our interdisciplinary research team consists of scientists who have expertise in the physics and biogeochemistry of the U.S. eastern continental shelf, remote-sensing data analysis and data assimilative numerical models.

Mannino, Antonio↗

Evaluating performance of two-group interfacial area transport equation for vertical small and large diameter pipes

In the two-fluid transport model, the coupling of mass, momentum and energy transfer between phases is highly dependent on interfacial area transfer terms. Several research efforts in the past have been focused on the development of an interfacial area transport equation model (IATE), in order to eliminate the drawbacks of static flow regime maps currently used in best-estimate thermal-hydraulic system codes. The IATE attempts to model the dynamics that are involved in two phase flows by accounting for the different interaction mechanisms affecting bubble transport in the flow. The further development and validation of IATE models has been hindered by the lack of adequate experimental data in regions beyond the bubbly flow regime. At the Helmholtz-Zentrum Dresden-Rossendorf (HZDR) experiments utilizing wire mesh sensors have been performed over all flow regimes, establishing a database of high-resolution (in space and time) data. Two sets of data from small and large diameter pipes fitted with wire mesh sensors is utilized in this work. Analysis of flow conditions in the bubbly, churn turbulent and annular flow regimes is presented. The performance of the Fu-Ishii two-group model is evaluated against small diameter database. Results indicate good performance (< 10% error) for small group 1 bubbles, and poor performance for large group 2 bubbles. The Smith two-group large diameter IATE model is evaluated for the large diameter database. In low void-fraction regimes, the Smith model performs well. In high void-fraction regimes, there is poor group-wise interfacial area prediction - however the total interfacial area is erroneously predicted well as group-wise errors compensate each other. Overall, the study suggests that further efforts and re-evaluation of closure terms are needed in order to extend the range of validity of the IATE models. (authors)

42 ENGINEERING↗

Evaluating the Effects of Detector Modeling Uncertainties on Sterile Neutrino Oscillation Analysis with the ICARUS Detector

he ICARUS T600 LArTPC detector was refurbished after an initial run at the underground LNGS labs and is currently taking data within its experimental hall at Fermilab after full commissioning. Regular data taking began in May 2021 with neutrinos from the Booster Neutrino Beam (BNB) and the Neutrinos at the Main Injector (NuMI) off-axis beam. As the far detector of the Short-Baseline Neutrino (SBN) Program, the ICARUS detector's capability in searching for both muon neutrino disappearance and electron neutrino appearance will allow for unprecedented sensitivity to light sterile neutrinos with eV-scale mass. The ultimate sensitivity of the detector to sterile neutrino oscillations depends on the understanding of the detector response and the uncertainties remaining after calibrating the detector model. This poster will review how detector-model-related uncertainties are quantified, evaluated and their impact on expected sterile neutrino oscillation sensitivities using the existing ICARUS data. The work pursued here is broadly applicable to other ICARUS analysis pathways such as neutrino-argon cross-sections and Beyond the Standard Model physics searches. It will finally discuss improvement pathways to reduce the systematic uncertainties to the level needed for the joint sterile neutrino oscillation analysis with the Short Baseline Near Detector (SBND) within the SBN Program.

43 PARTICLE ACCELERATORS↗

Simulation of Ozone and Long Lived Tracers in the GSFC Two-Dimensional Model

The GSFC two-dimensional transport and chemistry model has been used for a wide variety of scientific and assessment studies of stratospheric ozone. Transport is a key element in the ozone simulations, and we have recently upgraded our model transport formulation to include much of the information about atmospheric transport processes available from existing data sets. To properly evaluate the model transport, it is desirable to examine the effects of transport and photochemistry separately. Recently, high quality observations of several long lived stratospheric tracers have become available from aircraft, balloon, and satellite measurement systems. This data provides a means to do a detailed model transport evaluation, as has been done in the recent Models and Measurements Intercomparison Project II. In this paper, we will discuss the GSFC 2D model simulations of ozone together with model-data comparisons of long lived tracers such as methane and the age of air transport diagnostic. We will show that the model can reproduce many of the transport-sensitive features observed in the stratosphere, and can compare reasonably well with measurements of both total ozone and long lived tracers simultaneously. We will also discuss the model deficiencies in simulating some of the detailed aspects of the observations.

Fleming, Eric L.↗

Battery Ownership Model: A Tool for Evaluating the Economics of Electrified Vehicles and Related Infrastructure (Presentation)

This presentation uses a vehicle simulator and economics model called the Battery Ownership Model to examine the levelized cost per mile of conventional (CV) and hybrid electric vehicles (HEVs) in comparison with the cost to operate an electric vehicle (EV) under a service provider business model. The service provider is assumed to provide EV infrastructure such as charge points and swap stationsto allow an EV with a 100-mile range to operate with driving profiles equivalent to CVs and HEVs. Battery cost, fuel price forecast, battery life, and other variables are examined to determine under what scenarios the levelized cost of an EV with a service provider can approach that of a CV. Scenarios in both the United States as an average and Hawaii are examined. The levelized cost ofoperating an EV with a service provider under average U.S. conditions is approximately twice the cost of operating a small CV. If battery cost and life can be improved, in this study the cost of an EV drops to under 1.5 times the cost of a CV for U.S. average conditions. In Hawaii, the same EV is only slightly more expensive to operate than a CV.

25 ENERGY STORAGE↗

Revised Tijeras Arroyo Groundwater Current Conceptual Model and Corrective Measures Evaluation Report - February 2018.

The U.S. Department of Energy (DOE) and the management and operating (M&O) contractor for Sandia National Laboratories beginning on May 1, 2017, National Technology & Engineering Solutions of Sandia, LLC (NTESS), hereinafter collectively referred to as DOE/NTESS, prepared this Revised Tijeras Arroyo Groundwater Current Conceptual Model (CCM) and Corrective Measures Evaluation (CME) Report , referred to as the Revised CCM/CME Report, to meet requirements under the Sandia National Laboratories-New Mexico (SNL/NM) Compliance Order on Consent (Consent Order). The Consent Order became effective on April 29, 2004. The Consent Order identifies the Tijeras Arroyo Groundwater (TAG) Area of Concern (AOC) as an area of groundwater contamination requiring further characterization and corrective action. In November 2004, New Mexico Environment Department (NMED) approved the July 2004 CME Work Plan. In April 2005, DOE and the SNL M&O contractor at the time, Sandia Corporation (Sandia), hereinafter collectively referred to as DOE/Sandia, submitted a CME Report, but NMED did not finalize review of that document. In December 2016, DOE/Sandia submitted a combined and updated CCM/CME Report. NMED issued a disapproval letter in May 2017 that included comments on the December 2016 CCM/CME Report. In August 2017, NMED and DOE/NTESS staff held a meeting to discuss and clarify outstanding issues. This Revised CCM/CME Report addresses (1) the issues presented in the NMED May 2017 disapproval letter and (2) findings from the August 2017 meeting.

54 ENVIRONMENTAL SCIENCES↗

A Comparison of Dose-Response Models for the Parotid Gland in a Large Group of Head-and-Neck Cancer Patients

Purpose: The dose-response relationship of the parotid gland has been described most frequently using the Lyman-Kutcher-Burman model. However, various other normal tissue complication probability (NTCP) models exist. We evaluated in a large group of patients the value of six NTCP models that describe the parotid gland dose response 1 year after radiotherapy. Methods and Materials: A total of 347 patients with head-and-neck tumors were included in this prospective parotid gland dose-response study. The patients were treated with either conventional radiotherapy or intensity-modulated radiotherapy. Dose-volume histograms for the parotid glands were derived from three-dimensional dose calculations using computed tomography scans. Stimulated salivary flow rates were measured before and 1 year after radiotherapy. A threshold of 25% of the pretreatment flow rate was used to define a complication. The evaluated models included the Lyman-Kutcher-Burman model, the mean dose model, the relative seriality model, the critical volume model, the parallel functional subunit model, and the dose-threshold model. The goodness of fit (GOF) was determined by the deviance and a Monte Carlo hypothesis test. Ranking of the models was based on Akaike's information criterion (AIC). Results: None of the models was rejected based on the evaluation of the GOF. The mean dose model was ranked as the best model based on the AIC. The TD{sub 50} in these models was approximately 39 Gy. Conclusions: The mean dose model was preferred for describing the dose-response relationship of the parotid gland.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Three models of the vibrating ulna.

Evaluation of the ability of three models of the ulna to predict ulnar resonant frequency. The ulna is considered to be a uniform cylindrical tube made of homogeneous isotropic material. In model I the tube is attached at each end to rigid supports by hinges, in model II the tube is attached to rigid supports by springs rather than hinges, while model III is the same as model II except for the addition of a spring-mass system simulating an accelerometer strapped to the wrist. It is found that all three models exhibit comparable effectiveness in predicting the allowed cyclic vibration frequency, although model I is marginally better than models II or III in predicting this parameter. All three models also yield relatively realistic values for Young's modulus. In terms of results, therefore, there is no clear choice between the models. However, owing to greater costs incurred with models II and III, it is concluded that model I is the most useful, even though it is the least 'realistic' of the three models evaluated.-

Jurist, J. M.↗

Short-term electricity load forecasting: Application-driven evaluation of machine learning models across spatial and temporal scales

As we transition towards a decarbonized economy, the integration of variable renewable energy resources and new demands (e.g., electric vehicles, heat pumps) into the electricity grid places unprecedented pressure on grid operators to effectively anticipate and manage peak load. In this context, machine learning algorithms are proving to be indispensable for accurate short-term load forecasting, a crucial task to address these challenges. This study benchmarks 6 machine learning algorithms, including three neural networks and three tree-based algorithms, across various levels of spatial aggregation and time horizons (1, 4, 8, 24, and 48 h). The central contribution of this work is the comparison and analysis of load forecasting models not only based on statistical metrics, but also based on a novel error metric, which evaluates the cost implications of forecast errors for power system stakeholders. Results show that tree-based models outperform neural networks, based on statistical metrics, and yield less skewed error distributions for most spatial scales. However, through the lens of the novel error metric, neural networks are the more competitive choice, especially for forecast horizons that exceed 8 h. The study concludes with actionable recommendations to grid operators and highlights the need for the development of error metrics that link forecasting accuracy to operational costs. To promote transparency and open science, the datasets and Python code are open-sourced via a supplementary repository.

Houben, Nikolaus↗

Monitoring leaf phenology in moist tropical forests by applying a superpixel-based deep learning method to time-series images of tree canopies

Tropical leaf phenology-particularly its variability at the tree-crown scale-dominates the seasonality of carbon and water fluxes. However, given enormous species diversity, accurate means of monitoring leaf phenology in tropical forests is still lacking. Time series of the Green Chromatic Coordinate (GCC) metric derived from tower-based red-green-blue (RGB) phenocams have been widely used to monitor leaf phenology in temperate forests, but its application in the tropics remains problematic. To improve monitoring of tropical phenology, we explored the use of a deep learning model (i.e. superpixel-based Residual Networks 50, SP-ResNet50) to automatically differentiate leaves from non-leaves in phenocam images and to derive leaf fraction at the tree-crown scale. To evaluate our model, we used a year of data from six phenocams in two contrasting forests in Panama. Here, we first built a comprehensive library of leaf and non-leaf pixels across various acquisition times, exposure conditions and specific phenocams. We then divided this library into training and testing components. We evaluated the model at three levels: 1) superpixel level with a testing set, 2) crown level by comparing the model-derived leaf fractions with those derived using image-specific supervised classification, and 3) temporally using all daily images to assess the diurnal stability of the model-derived leaf fraction. Finally, we compared the model-derived leaf fraction phenology with leaf phenology derived from GCC. Our results show that: 1) the SP-ResNet50 model accurately differentiates leaves from non-leaves (overall accuracy of 93%) and is robust across all three levels of evaluations; 2) the model accurately quantifies leaf fraction phenology across tree-crowns and forest ecosystems; and 3) the combined use of leaf fraction and GCC helps infer the timing of leaf emergence, maturation and senescence, critical information for modeling photosynthetic seasonality of tropical forests. Collectively, this study offers an improved means for automated tropical phenology monitoring using phenocams.

54 ENVIRONMENTAL SCIENCES↗