Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,459 records · Page 81

Solar Activity from 2006 to 2014 and Short-term Forecasts of Solar Proton Events Using the ESPERTA Model

To evaluate the solar energetic proton (SEP) forecast model of Laurenza et al., here termed ESPERTA, we computed the input parameters (soft X-ray (SXR) fluence and ∼1 MHz radio fluence) for all ≥M2 SXR flares from 2006 to 2014. This database is outside the 1995–2005 interval on which ESPERTA was developed. To assess the difference in the general level of activity between these two intervals, we compared the occurrence frequencies of SXR flares and SEP events for the first six years of cycles 23 (1996 September–2002 September) and 24 (2008 December–2014 December). We found a reduction of SXR flares and SEP events of 40% and 46%, respectively, in the latter period. Moreover, the numbers of ≥M2 flares with high values of SXR and ∼1 MHz fluences (>0.1 J m{sup −2} and >6 × 10{sup 5} sfu × minute, respectively) are both reduced by ∼30%. A somewhat larger percentage decrease of these two parameters (∼40% versus ∼30%) is obtained for the 2006–2014 interval in comparison with 1995–2005. Despite these differences, ESPERTA performance was comparable for the two intervals. For the 2006–2014 interval, ESPERTA had a probability of detection (POD) of 59% (19/32) and a false alarm rate (FAR) of 30% (8/27), versus a POD = 63% (47/75) and an FAR = 42% (34/81) for the original 1995–2005 data set. In addition, for the 2006–2014 interval the median (average) warning time was estimated to be ∼2 hr (∼7 hr), versus ∼6 hr (∼9 hr), for the 1995–2005 data set.

79 ASTRONOMY AND ASTROPHYSICS↗

An automated procedure for material parameter evaluation for viscoplastic constitutive models

An automated procedure is presented for evaluating the material parameters in Walker's exponential viscoplastic constitutive model for metals at elevated temperature. Both physical and numerical approximations are utilized to compute the constants for Inconel 718 at 1100 F. When intermediate results are carefully scrutinized and engineering judgement applied, parameters may be computed which yield stress output histories that are in agreement with experimental results. A qualitative assessment of the theta-plot method for predicting the limiting value of stress is also presented. The procedure may also be used as a basis to develop evaluation schemes for other viscoplastic constitutive theories of this type.

Imbrie, P. K.↗

A system dynamic modeling approach for evaluating municipal solid waste generation, landfill capacity and related cost management issues

As planning for sustainable municipal solid waste management has to address several inter-connected issues such as landfill capacity, environmental impacts and financial expenditure, it becomes increasingly necessary to understand the dynamic nature of their interactions. A system dynamics approach designed here attempts to address some of these issues by fitting a model framework for Newark urban region in the US, and running a forecast simulation. The dynamic system developed in this study incorporates the complexity of the waste generation and management process to some extent which is achieved through a combination of simpler sub-processes that are linked together to form a whole. The impact of decision options on the generation of waste in the city, on the remaining landfill capacity of the state, and on the economic cost or benefit actualized by different waste processing options are explored through this approach, providing valuable insights into the urban waste-management process.

09 BIOMASS FUELS↗

A new parameterization of ice heterogeneous nucleation coupled to aerosol chemistry in WRF-Chem model version 3.5.1: evaluation through ISDAC measurements

In the Arctic, during polar night and early spring, ice clouds are separated into two leading types of ice clouds (TICs): (1) TIC1 clouds characterized by a large concentration of very small crystals and TIC2 clouds characterized by a low concentration of large ice crystals. Using a suitable parameterization of heterogeneous ice nucleation is essential for properly representing ice clouds in meteorological and climate models and subsequently understanding their interactions with aerosols and radiation. Here, we describe a new parameterization for ice crystal formation by heterogeneous nucleation in water-subsaturated conditions coupled to aerosol chemistry in the Weather Research and Forecasting model coupled with chemistry (WRF-Chem). The parameterization is implemented in the Milbrandt and Yau (2005a, b) two-moment cloud microphysics scheme, and we assess how the WRF-Chem model responds to the run-time interaction between chemistry and the new parameterization. Well-documented reference cases provided us with in situ data from the spring 2008 Indirect and Semi-Direct Aerosol Campaign (ISDAC) over Alaska. Our analysis reveals that the new parameterization clearly improves the representation of the ice water content (IWC) in polluted or unpolluted air masses and shows the poor performance of the reference parameterization in representing ice clouds with low IWC. The new parameterization is able to represent TIC1 and TIC2 microphysical characteristics at the top of the clouds, where heterogenous ice nucleation is most likely occurring, even with the known bias of simulated aerosols by WRF-Chem over the Arctic.

54 ENVIRONMENTAL SCIENCES↗

Contaminant Transport Modeling for Technology Evaluation and Long-Term Monitoring in the Tims Branch Testbed, SC - 20343

Studies conducted at U.S. DOE sites have shown the presence of heavy metals, radionuclides, and volatile organic compounds in surface water, groundwater, and soil as a result of nuclear activity in the Cold War era. Since the 1990's, innovative cleanup methods have been implemented in the Tims Branch watershed at Savannah River Site (SRS) to limit the contaminant flux to the stream that have reduced the contaminant concentrations to acceptable regulatory levels in the dissolved phase. A tin-based treatment which effectively eliminated all local anthropogenic mercury inputs to this ecosystem resulted in a known step function addition of inert tin oxide particles which now serve as a potential tracer for sedimentation and particle transport processes in the stream. The long-term effectiveness of this and other remediation techniques and the potential for remobilization of adsorbed contaminant in sediment during extreme hydrologic conditions however remains unclear. It is therefore important to understand not only the fate and transport of dissolved contaminants, but also the movement of sediment and the relevant interactions with dissolved contaminant. To narrow this knowledge gap, a study is being conducted using the Tims Branch watershed as a stream-scale ecosystem test-bed to identify the primary transport processes of major contaminants of concern (such as mercury, nickel and uranium) with an emphasis on interactions with sediment transport. This involves the development of a fully distributed hydrologic watershed model of the Tims Branch watershed to predict streamflow under extreme weather conditions, as well as the development of a comprehensive contaminant transport model that can properly account for coupled contaminant and sediment transport. Review of relevant research reports and peer-reviewed journals revealed that aside from advection-dispersion transport of dissolved contaminants, adsorption and desorption with suspended solids and bed sediment also play an important role in the transport of those contaminants of concern. To develop the fully distributed hydrologic watershed model, the MIKE SHE 2-dimensional (2D) land surface/3D groundwater model that simulates surface/subsurface hydrologic processes (such as overland flow, evapotranspiration, and infiltration) was coupled with a 1D streamflow model that accounts for stream water hydraulics (such as hydraulic structures, cross-sections, and network). To model contaminant transport, the MIKE 11 streamflow component was coupled with the MIKE 11 AD module that simulates solute transport through advection and dispersion, and MIKE ECO Lab module that accounts for both sediment transport and interactions with dissolved contaminant. At this stage, the development and optimization of the fully distributed hydrologic model has been completed, achieving satisfactory statistical results between observed and predicted discharge as indicated by a root mean square error (RMSE) of 0.039 cms and a Nash-Sutcliffe efficiency coefficient (NSE) of 0.764. The ongoing development of the contaminant transport model has also yielded realistic results from preliminary tests. Results from this study are a key to evaluating the effectiveness of tin (II)-based mercury treatment of wetlands at the SRS site, and are also relevant to evaluating the potential of using this type of novel remediation technology in other mercury-contaminated stream systems. Knowledge acquired from this research will also support interpretation of historical data on the trends of contaminant concentration distribution in Tims Branch, particularly considering the effect of extreme hydrological events on the stream flow and pollutant transport. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Detailed Modeling, Design, and Evaluation of a Scalable Multi-level Checkpointing System

High-performance computing (HPC) systems are growing more powerful by utilizing more hardware components. As the system mean-time-before-failure correspondingly drops, applications must checkpoint more frequently to make progress. However, as the system memory sizes grow faster than the bandwidth to the parallel file system, the cost of checkpointing begins to dominate application run times. A potential solution to this problem is to use multi-level checkpointing, which employs multiple types of checkpoints with different costs and different levels of resiliency in a single run. The goal is to design light-weight checkpoints to handle the most common failure modes and rely on more expensive checkpoints for less common, but more severe failures. While this approach is theoretically promising, it has not been fully evaluated in a large-scale, production system context. To this end we have designed a system, called the Scalable Checkpoint/Restart (SCR) library, that writes checkpoints to storage on the compute nodes utilizing RAM, Flash, or disk, in addition to the parallel file system. We present the performance and reliability properties of SCR as well as a probabilistic Markov model that predicts its performance on current and future systems. We show that multi-level checkpointing improves efficiency on existing large-scale systems and that this benefit increases as the system size grows. In particular, we developed low-cost checkpoint schemes that are 100x-1000x faster than the parallel file system and effective against 85% of our system failures. This leads to a gain in machine efficiency of up to 35%, and it reduces the the load on the parallel file system by a factor of two on current and future systems.

99 GENERAL AND MISCELLANEOUS↗

Engineering a modular 44 Ti/ 44 Sc generator: eluate evaluation in preclinical models and estimation of human radiation dosimetry

Background: 44 Sc/ 47 Sc is an attractive theranostic pair for targeted in vivo positron emission tomographic (PET) imaging and beta-particle treatment of cancer. The 44 Ti/ 44 Sc generator allows daily onsite production of this diagnostic isotope, which may provide an attractive alternative for PET facilities that lack in-house irradiation capabilities. Early animal and patient studies have demonstrated the utility of 44 Sc. In our current study, we built and evaluated a novel clinical-scale 44 Ti/ 44 Sc generator, explored the pharmacokinetic profiles of 44 ScCl 3 , [ 44 Sc]-citrate and [ 44 Sc]-NODAGA (1,4,7-triazacyclononane,1-glutaric acid-4,7-acetic acid) in naïve mice, and estimated the radiation burden of 44 ScCl 3 in humans. Methods: 44 Ti/ 44 Sc (101.2 MBq) in 6 M HCl solution was utilized to assemble a modular ZR resin containing generator. After assembly, 44 Sc was eluted with 0.05 M HCl for further PET imaging and biodistribution studies in female Swiss Webster mice. Based on the biodistribution data, absorbed doses of 44 / 47 ScCl 3 in human adults were calculated for 18 organs and tissues using the IDAC-Dose software. Results: 44 Ti in 6 M HCl was loaded onto the organic resin generator with a yield of 99.97%. After loading and initial stabilization, 44 ScCl 3 was eluted with 0.05 M HCl in typical yields of 82.9 ± 5.3% (N = 16), which was normalized to the estimated generator capacity. Estimated generator capacity was computed based on elution time interval and the total amount of 44 Ti loaded on the generator. Run in forward and reverse directions, the 44 Sc/ 44 Ti ratio from a primary column was significantly improved from 1038 ± 440 to 3557 ± 680 (Bq/Bq) when a secondary, replaceable, ZR resin cartridge was employed at the flow outlet. In vivo imaging and ex vivo distribution studies of the reversible modular generator for 44 ScCl 3 , [ 44 Sc]-citrate and [ 44 Sc]-NODAGA show that free 44 Sc remained in the circulation significantly longer than the chelated 44 Sc. The dose estimation of 44 ScCl 3 reveals that the radiation burden is 0.146 mSv/MBq for a 70 kg adult male and 0.179 mSv/MBq for a 57 kg adult female. Liver, spleen and heart wall will receive the highest absorbed dose: 0.524, 0.502, and 0.303 mGy/MBq, respectively, for the adult male. Conclusions: A clinical-scale 44 Ti/ 44 Sc generator system with a modular design was developed to supply 44 ScCl 3 in 0.05 M HCl, which is suitable for further radiolabeling and in vivo use. Our data demonstrated that free 44 ScCl 3 remained in the circulation for extended periods, which resulted in approximately 10 times greater radiation burden than stably chelated 44 Sc. Stable 44 Sc/ 47 Sc-complexation will be more favorable for in vivo use and for clinical utility.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

ACTINIDE REMOVAL PROCESS SAMPLE ANALYSIS, CHEMICAL MODELING, AND FILTRATION EVALUATION

Filtration within the Actinide Removal Process (ARP) currently limits the throughput in interim salt processing at the Savannah River Site. In this process, batches of salt solution with Monosodium Titanate (MST) sorbent are concentrated by crossflow filtration. The filtrate is subsequently processed to remove cesium in the Modular Caustic Side Solvent Extraction Unit (MCU) followed by disposal in saltstone grout. The concentrated MST slurry is washed and sent to the Defense Waste Processing Facility (DWPF) for vitrification. During recent ARP processing, there has been a degradation of filter performance manifested as the inability to maintain high filtrate flux throughout a multi-batch cycle. The objectives of this effort were to characterize the feed streams, to determine if solids (in addition to MST) are precipitating and causing the degraded performance of the filters, and to assess the particle size and rheological data to address potential filtration impacts. Equilibrium modelling with OLI Analyzer{sup TM} and OLI ESP{sup TM} was performed to determine chemical components at risk of precipitation and to simulate the ARP process. The performance of ARP filtration was evaluated to review potential causes of the observed filter behavior. Task activities for this study included extensive physical and chemical analysis of samples from the Late Wash Pump Tank (LWPT) and the Late Wash Hold Tank (LWHT) within ARP as well as samples of the tank farm feed from Tank 49H. The samples from the LWPT and LWHT were obtained from several stages of processing of Salt Batch 6D, Cycle 6, Batch 16.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

OpenCGRA: An Open-Source Unified Framework for Modeling,Testing, and Evaluating CGRAs

Coarse-grained reconfigurable arrays (CGRAs),loosely defined as arrays of functional units (e.g, adder, sub-tractor, multiplier, divider, or larger multi-operation units, butsmaller than a general-purpose core) interconnected through aNetwork-on-Chip, provide higher flexibility than domain-specificASIC accelerators while offering increased hardware efficiencywith respect to fine-grained reconfigurable devices, such as FieldProgrammable Gate Arrays (FPGAs). The fast evolving fieldsof machine learning and edge computing, which are seeing acontinuous flow of novel algorithms and larger models, makeCGRAs ideal target architectures to allow domain specializationwithout loosing too much generality. They also generally offerquicker and more effective reconfigurability than FPGAs, po-tentially allowing adaptation during actual algorithm execution,and implement a dataflow programming paradigm that adaptswell to these emerging workloads. Designing and generating aCGRA, however, still requires to define the type and number ofthe specific functional units, implement their interconnect andthe network topology, and perform its simulation and validation,given a variety of workloads of interest.In this paper, we propose OpenCGRA, a Python-based unifiedframework that integrates generation, modeling, testing and eval-uation for CGRAs. OpenCGRA is the first open-source integratedframework able to support the full top-to-bottom design flow forspecializing and implementing CGRAs: modeling at different ab-straction levels (functional level, cycle level, register-transfer level),generation, simulation, testing at different granularities (unit test-ing, integration testing, property-based testing), and characteriza-tion (area, power, and timing). OpenCGRAs will be made availableon GitHub.

CGRA, synthesis↗

Chaparral Model 60 Infrasound Sensor Evaluation.

Sandia National Laboratories has tested and evaluated an infrasound sensor, the Model 60 manufactured by Chaparral Physics, a Division of Geophysical Institute of the University of Alaska, Fairbanks. The purpose of the infrasound sensor evaluation was to determine a measured sensitivity, transfer function, power, self-noise, dynamic range, and seismic sensitivity. The Model 60 infrasound sensor is a new sensor developed by Chaparral Physics intended to be a small, rugged sensor used in more flexible application conditions.

47 OTHER INSTRUMENTATION↗

Evaluating power grid model hydropower feasibility with a river operations model

Production cost models (PCMs) simulate dispatch of generators across a large power grid and are used widely by planners to study the reliability of electricity supply. As energy systems transition away from the thermoelectric technologies that have traditionally balanced electricity supply and demand, hydropower and its representation in PCMs is of increasing importance. A limitation of PCMs applied to continental power grids with diverse generation portfolios is that hydropower generation is simulated without full consideration of complex river dynamics, leading to possible misrepresentation of grid flexibility and performance. In addition, data used in PCMs may reflect outdated operating policies. In this paper we propose a hydropower generation feasibility test for PCMs. The approach uses a detailed hydropower model to determine whether the hourly hydropower schedule from a PCM with simplified monthly parameterization can be attained after accounting for realistic river dynamics and operating policies, such as spill requirements and general water movement and balance through a cascade reservoir system. We perform this hydropower generation test for the ‘Big 10’ hydropower system on the Columbia River (part of the Western Interconnect of the United States), revealing 9% overestimation of available hydropower generation in a PCM solution in an average hydrologic year. Our evaluation provides insight on the cost and opportunities for better representing hydropower in PCMs.

54 ENVIRONMENTAL SCIENCES↗

Development of a realistic photonic modeling for the evaluation of infrared reflections in the metallic environment of ITER

In nuclear fusion experiments, the plasma facing components are exposed to high heat fluxes and infrared (IR) imaging diagnostics are routinely used for surveying their surface temperature for preventing damages. However the future use of metallic components in the ITER tokamak adds complications in temperature estimation. Indeed, low and variable emissivity of the observed surface and the multiple reflections of the light coming from hot regions will have to be understood and then taken into account. In this paper, a realistic photonic modeling based on Monte Carlo ray-tracing codes is used to predict the global response of the complete IR survey system. This also includes the complex vessel geometry and the thermal and optical surface properties using the bidirectional reflectivity distribution function that models the photon-material interactions. The first results of this simulation applied to a reference torus are presented and are used as a benchmark to investigate the validity of the global model. Finally the most critical key model parameters in the reflected signals are identified and their contribution is discussed.

36 MATERIALS SCIENCE↗

Toward a Holistic Performance Evaluation of Large Language Models Across Diverse AI Accelerators

Artificial intelligence (AI) methods have become critical in scientific applications to help accelerate scientific discovery. Large language models (LLMs) are being considered a promising approach to address some challenging problems because of their superior generalization capabilities across domains. The effectiveness of the models and the accuracy of the applications are contingent upon their efficient execution on the underlying hardware infrastructure. Specialized Al accelerator hardware systems have recently become available for accelerating Al applications. However, the comparative performance of these AI accelerators on large language models has not been previously studied. In this paper, we systematically study LLMs on multiple AI accelerators and GPUs and evaluate their performance characteristics for these models. We evaluate these systems with (i) a micro-benchmark using a core transformer block, (ii) a GPT-2 model, and (iii) an 1,I,M-driven science use case, GenSLM. We present our findings and analyses of the models' performance to better understand the intrinsic capabilities of AI accelerators. Furthermore, our analysis takes into account key factors such as sequence lengths, scaling behavior, and sensitivity to gradient accumulation steps.

Emani, Murali↗

Evaluation of Centralized Model Based FLISR in a Lab Setup

Utilities are installing advanced distribution management systems (ADMS) around the globe to improve the sensing and control of distribution systems. ADMS is becoming a critical component to improve the resiliency and reliability of distribution systems. These management systems host a multitude of applications that can be used to sense, control, and operate distribution systems. Fault location, isolation, and service restoration (FLISR) is one of the ADMS applications that is critical to improving resilience during fault conditions. FLISR applications use smart, controllable devices that are installed in the distribution system for FLISR operation. These controllable devices include distributed energy resources (DER) and reclosers. Evaluating such ADMS applications before installation in the field can help de-risk the field implementation and avoid costly failures in the field. This paper presents a background on experimental setup that are typically used to evaluate ADMS applications. This is followed by briefly presenting the setup used to evaluate the FLISR application in an off-the-shelf ADMS tool. Finally, results from the evaluation experiments are presented.

94 GMLC - Grid Modernization Laboratory Consortium↗

MODELING AND PERFORMANCE EVALUATION FOR AVIATION SECURITY CARGO INSPECTION QUEUING SYSTEM

Beginning in 2010, the U.S. will require that all cargo loaded in passenger aircraft be inspected. This will require more efficient processing of cargo and will have a significant impact on the inspection protocols and business practices of government agencies and the airlines. In this paper, we conduct performance evaluation study for an aviation security cargo inspection queuing system for material flow and accountability. The overall performance of the aviation security cargo inspection system is computed, analyzed, and optimized for the different system dynamics. Various performance measures are considered such as system capacity, residual capacity, and throughput. These metrics are performance indicators of the system s ability to service current needs and response capacity to additional requests. The increased physical understanding resulting from execution of the queuing model utilizing these vetted performance measures will reduce the overall cost and shipping delays associated with the new inspection requirements.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

SU-E-I-33: Initial Evaluation of Model-Based Iterative CT Reconstruction Using Standard Image Quality Phantoms

Purpose: The purpose of this study was to compare a new model-based iterative reconstruction with existing reconstruction methods (filtered backprojection and basic iterative reconstruction) using quantitative analysis of standard image quality phantom images. Methods: An ACR accreditation phantom (Gammex 464) and a CATPHAN600 phantom were scanned using 3 routine clinical acquisition protocols (adult axial brain, adult abdomen, and pediatric abdomen) on a Philips iCT system. Each scan was acquired using default conditions and 75%, 50% and 25% dose levels. Images were reconstructed using standard filtered backprojection (FBP), conventional iterative reconstruction (iDose4) and a prototype model-based iterative reconstruction (IMR). Phantom measurements included CT number accuracy, contrast to noise ratio (CNR), modulation transfer function (MTF), low contrast detectability (LCD), and noise power spectrum (NPS). Results: The choice of reconstruction method had no effect on CT number accuracy, or MTF (p<0.01). The CNR of a 6 HU contrast target was improved by 1–67% with iDose4 relative to FBP, while IMR improved CNR by 145–367% across all protocols and dose levels. Within each scan protocol, the CNR improvement from IMR vs FBP showed a general trend of greater improvement at lower dose levels. NPS magnitude was greatest for FBP and lowest for IMR. The NPS of the IMR reconstruction showed a pronounced decrease with increasing spatial frequency, consistent with the unusual noise texture seen in IMR images. Conclusion: Iterative Model Reconstruction reduces noise and improves contrast-to-noise ratio without sacrificing spatial resolution in CT phantom images. This offers the possibility of radiation dose reduction and improved low contrast detectability compared with filtered backprojection or conventional iterative reconstruction.

60 APPLIED LIFE SCIENCES↗

A mixed model approach for evaluating yield improvements in interspecific hybrids of shrub willow, a dedicated bioenergy crop

Lignocellulosic bioenergy crops such as shrub willow (Salix spp.) are expected to have a significant role in climate mitigation strategies. Yield is perhaps the most important trait for genetic selection and development of biomass feedstocks, but the selection process is complicated by the strong influence that environmental factors has on cultivar performance. Understanding the genotype-by-environment interactions using regional yield trials of shrub willow will inform future breeding efforts and improve the ability to make regionally-specific cultivar recommendations. Here we analyzed two yield trial datasets containing genotypes from successive rounds of breeding using a series of mixed models. Stability variance parameters were used together with overall yields to identify genotypes with stable yields or specific adaptation. Analysis of the first dataset revealed a group of triploid interspecific hybrid cultivars with exceptional performance and specific adaptation to either poor or good quality environments. The best performing cultivar showed a 14% yield improvement over the mean of the check cultivars. In the second dataset, new selections were assessed along with the top performing cultivars from dataset 1. New triploid hybrids had yields 19 to 27% greater than the check cultivar and exhibited similar patterns of specific adaptation as some of the selections from the first dataset. Partial least squares regression analysis indicated that top-yielding genotypes were favored in environments with higher temperatures and greater growing degree days. This analysis demonstrates incremental improvements in yield with successive rounds of breeding through the development of interspecific triploid hybrids.

09 BIOMASS FUELS↗