Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,153 records · Page 64

Validation of the galactic cosmic ray and geomagnetic transmission models

A very high-momentum resolution particle spectrometer called the Alpha Magnetic Spectrometer (AMS) was flown in the payload bay of the Space Shuttle in a 51.65 degrees x 380-km orbit during the last solar minimum. This spectrometer has provided the first high statistics data set for galactic cosmic radiation protons, and helium, as well as limited spectral data on carbon and oxygen nuclei in the International Space Station orbit. First measurements of the albedo protons at this inclination were also made. Because of the high-momentum resolution and high statistics, the data can be separated as a function of magnetic latitude. A related investigation, the balloon borne experiment with a superconducting solenoid spectrometer (BESS), has been flown from Lynn Lake, Canada and has also provided excellent high-resolution data on protons and helium. These two data sets have been used here to study the validity of two galactic cosmic ray models and the geomagnetic transmission function developed from the 1990 geomagnetic reference field model. The predictions of both the CREME96 and NASA/JSC models are in good agreement with the AMS data. The shape of the AMS measured albedo proton spectrum, up to 2 GeV, is in excellent agreement with the previous balloon and satellite observations. A new LIS spectrum was developed that is consistent with both previous and new BESS 3He observations. Because the astronaut radiation exposures onboard ISS will be highest around the time of the solar minimum, these AMS measurements and these models provide important benchmarks for future radiation studies. AMS-02 slated for launch in September 2003, will provide even better momentum resolution and higher statistics data. Published by Elsevier Science Ltd.

unmanned↗

EPIC 219388192b—An Inhabitant of the Brown Dwarf Desert in the Ruprecht 147 Open Cluster

We report the discovery of EPIC 219388192b, a transiting brown dwarf in a 5.3 day orbit around a member star of Ruprecht 147, the oldest nearby open cluster association, which was photometrically monitored by K2 during its Campaign 7. We combine the K2 time-series data with ground-based adaptive optics imaging and high-resolution spectroscopy to rule out false positive scenarios and determine the main parameters of the system. EPIC 219388192b has a radius of R{sub b}=0.937±0.032 R {sub Jup} and mass of M{sub b}=36.84±0.97 M {sub Jup}, yielding a mean density of 59.6±7.6 g cm{sup −3}. The host star is nearly a solar twin with mass M{sub ⋆}=1.01±0.04 M {sub ⊙}, radius R{sub ⋆}=1.01±0.03 R {sub ⊙}, effective temperature T {sub eff} = 5850 ± 85 K, and iron abundance [Fe/H] = 0.03 ± 0.08 dex. Its age, spectroscopic distance, and reddening are consistent with those of Ruprecht 147, corroborating its cluster membership. EPIC 219388192b is the first mature brown dwarf with precise determinations of mass, radius, and age, and serves as benchmark for evolutionary models in the substellar regime.

79 ASTRONOMY AND ASTROPHYSICS↗

A Spectral Approach for the Design of Experiments: Design, Analysis and Algorithms

This paper proposes a new approach to construct high quality space-filling sample designs. First, we propose a novel technique to quantify the space-filling property and optimally trade-off uniformity and randomness in sample designs in arbitrary dimensions. Second, we connect the proposed metric (defined in the spatial domain) to the quality metric of the design performance (defined in the spectral domain). This connection serves as an analytic framework for evaluating the qualitative properties of space-filling designs in general. Using the theoretical insights provided by this spatial-spectral analysis, we derive the notion of optimal space-filling designs, which we refer to as space-filling spectral designs. Third, we propose an efficient estimator to evaluate the space-filling properties of sample designs in arbitrary dimensions and use it to develop an optimization framework for generating high quality space-filling designs. Finally, we carry out a detailed performance comparison on two different applications in varying dimensions: a) image reconstruction and b) surrogate modeling for several benchmark optimization functions and a physics simulation code for inertial confinement fusion (ICF). Our results clearly evidence the superiority of the proposed space-filling designs over existing approaches, particularly in high dimensions.

97 MATHEMATICS AND COMPUTING↗

Thread Group Multithreading: Accelerating the Computation of an Agent-Based Power System Modeling and Simulation Tool -- C GridLAB-D

GridLAB-DTM is an open source next generation agent-based smart-grid simulator that provides unprecedented capability to model the performance of smart grid technologies. Over the past few years, GridLAB-D has been used to conduct important analyses of smart grid concepts, but it is still quite limited by its computational performance. In order to break through the performance bottleneck to meet the need for large scale power grid simulations, we develop a thread group mechanism to implement highly granular multithreaded computation in GridLAB-D. We achieve close to linear speedups on multithreading version compared against the single-thread version of the same code running on general purpose multi-core commodity for a benchmark simple house model. The performance of the multithreading code shows favorable scalability properties and resource utilization, and much shorter execution time for large-scale power grid simulations.

Jin, Shuangshuang↗

U.S. Solar Photovoltaic System Cost Benchmark: Q1 2016

NREL has been modeling U.S. photovoltaic (PV) system costs since 2009. This report benchmarks costs of U.S. solar PV for residential, commercial, and utility-scale systems built in the first quarter of 2016 (Q1 2016). Our methodology includes bottom-up accounting for all system and project-development costs incurred when installing residential, commercial, and utility-scale systems, and it models the capital costs for such systems.

14 SOLAR ENERGY↗

U.S. Solar Photovoltaic System Cost Benchmark: Q1 2018

NREL has been modeling U.S. photovoltaic (PV) system costs since 2009. This report benchmarks costs of U.S. solar PV for residential, commercial, and utility-scale systems built in the first quarter of 2018 (Q1 2018). Our methodology includes bottom-up accounting for all system and project-development costs incurred when installing residential, commercial, and utility-scale systems, and it models the capital costs for such systems.

14 SOLAR ENERGY↗

U.S. Solar Photovoltaic System Cost Benchmark: Q1 2018

NREL has been modeling U.S. photovoltaic (PV) system costs since 2009. This report benchmarks costs of U.S. solar PV for residential, commercial, and utility-scale systems built in the first quarter of 2018 (Q1 2018). Our methodology includes bottom-up accounting for all system and project-development costs incurred when installing residential, commercial, and utility-scale systems, and it models the capital costs for such systems.

14 SOLAR ENERGY↗

U.S. Solar Photovoltaic System Cost Benchmark: Q1 2016

NREL has been modeling U.S. photovoltaic (PV) system costs since 2009. This report benchmarks costs of U.S. solar PV for residential, commercial, and utility-scale systems built in the first quarter of 2016 (Q1 2016). Our methodology includes bottom-up accounting for all system and project-development costs incurred when installing residential, commercial, and utility-scale systems, and it models the capital costs for such systems.

14 SOLAR ENERGY↗

U.S. Solar Photovoltaic System and Energy Storage Cost Benchmark: Q1 2020 [PowerPoint]

NREL has been modeling U.S. photovoltaic (PV) system costs since 2009. This report benchmarks costs of U.S. solar PV for residential, commercial, and utility-scale systems, with and without storage, built in the first quarter of 2020 (Q1 2020). Our methodology includes bottom-up accounting for all system and project-development costs incurred when installing residential, commercial, and utility-scale systems, and it models the capital costs for such systems.

14 SOLAR ENERGY↗

Procedure for Creating, Reviewing, and Submitting Input Files into the Benchmark Library

Los Alamos National Laboratory (LANL) has a number of criticality benchmark input files, modeled for use with MCNP, developed and maintained by various organizations including the Nuclear Criticality Safety (NCS) Division, XCP-3, and XCP-5. The purpose of this procedure is to standardize input file creation, review, and maintenance. This procedure incorporates existing practices used by IRSN as documented in the original report and the translation from French in addition to practices used by the LANL NCS Division as documented in. The report relates to input files used for the validation of the continuous energy Monte Carlo code MCNP6 but is general enough to be extended to other codes. This report describes the procedure on how to prepare and use benchmarks (taken mainly from the ICSBEP Handbook) for the validation of calculation routes. In particular, this report describes the procedure to follow in the creation of the input files and their integration in the experimental validation databases.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Thermal tensor renormalization group simulations of square-lattice quantum spin models

In this work, we benchmark the well-controlled and numerically accurate exponential thermal tensor renormalization group (XTRG) in the simulation of interacting spin models in two dimensions. Finite temperature introduces a finite thermal correlation length ξ, such that for system sizes L >> ξ finite-size calculations actually simulate the thermodynamic limit. Here in this paper, we focus on the square lattice Heisenberg antiferromagnet (SLH) and quantum Ising models (QIM) on open and cylindrical geometries up to width W = 10 . We explore various one-dimensional mapping paths in the matrix product operator (MPO) representation, whose performance is clearly shown to be geometry dependent. We benchmark against quantum Monte Carlo (QMC) data, yet also the series-expansion thermal tensor network results. Thermal properties including the internal energy, specific heat, and spin structure factors, etc. are computed with high precision, obtaining excellent agreement with QMC results. XTRG also allows us to reach remarkably low temperatures. For SLH, we obtain an energy per site u$^*_g$ ≃ -0.6694 (4) and a spontaneous magnetization m$^*_S$ ≃ 0.30 ( 1 ) already consistent with the ground-state properties, which is obtained from extrapolated low-T thermal data on W ≤ 8 cylinders and W ≤ 10 open strips, respectively. We extract an exponential divergence versus T of the structure factor S (M), as well as the correlation length ξ, at the ordering wave vector M = ($π,π$) , which represents the renormalized classical behavior and can be observed over a narrow but appreciable temperature window, by analyzing the finite-size data by XTRG simulations. For the QIM with a finite-temperature phase transition, we employ several thermal quantities, including the specific heat, Binder ratio, as well as the MPO entanglement to determine the critical temperature $T_c$.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Efficient DNA sequence compression with neural networks

Abstract Background The increasing production of genomic data has led to an intensified need for models that can cope efficiently with the lossless compression of DNA sequences. Important applications include long-term storage and compression-based data analysis. In the literature, only a few recent articles propose the use of neural networks for DNA sequence compression. However, they fall short when compared with specific DNA compression tools, such as GeCo2. This limitation is due to the absence of models specifically designed for DNA sequences. In this work, we combine the power of neural networks with specific DNA models. For this purpose, we created GeCo3, a new genomic sequence compressor that uses neural networks for mixing multiple context and substitution-tolerant context models. Findings We benchmark GeCo3 as a reference-free DNA compressor in 5 datasets, including a balanced and comprehensive dataset of DNA sequences, the Y-chromosome and human mitogenome, 2 compilations of archaeal and virus genomes, 4 whole genomes, and 2 collections of FASTQ data of a human virome and ancient DNA. GeCo3 achieves a solid improvement in compression over the previous version (GeCo2) of $2.4\%$, $7.1\%$, $6.1\%$, $5.8\%$, and $6.0\%$, respectively. To test its performance as a reference-based DNA compressor, we benchmark GeCo3 in 4 datasets constituted by the pairwise compression of the chromosomes of the genomes of several primates. GeCo3 improves the compression in $12.4\%$, $11.7\%$, $10.8\%$, and $10.1\%$ over the state of the art. The cost of this compression improvement is some additional computational time (1.7–3 times slower than GeCo2). The RAM use is constant, and the tool scales efficiently, independently of the sequence size. Overall, these values outperform the state of the art. Conclusions GeCo3 is a genomic sequence compressor with a neural network mixing approach that provides additional gains over top specific genomic compressors. The proposed mixing method is portable, requiring only the probabilities of the models as inputs, providing easy adaptation to other data compressors or compression-based data analysis tools. GeCo3 is released under GPLv3 and is available for free download at https://github.com/cobilab/geco3.

Silva, Milton↗

A Secure Learning Control Strategy via Dynamic Camouflaging for Unknown Dynamical Systems under Attacks

This paper presents a secure reinforcement learning (RL) based control method for unknown linear time-invariant cyber-physical systems (CPSs) that are subjected to compositional attacks such as eavesdropping and covert attack. We consider the attack scenario where the attacker learns about the dynamic model during the exploration phase of the learning conducted by the designer to learn a linear quadratic regulator (LQR), and thereafter, use such information to conduct a covert attack on the dynamic system, which we refer to as doubly learning-based control and attack (DLCA) framework. We propose a dynamic camouflaging based attack-resilient reinforcement learning (ARRL) algorithm which can learn the desired optimal controller for the dynamic system, and at the same time, can inject sufficient misinformation in the estimation of system dynamics by the attacker. The algorithm is accompanied by theoretical guarantees and extensive numerical experiments on a consensus multi-agent system and on a benchmark power grid model.

Mukherjee, Sayak↗

Guidelines for Publicly Archiving Terrestrial Model Data to Enhance Usability, Intercomparison, and Synthesis

Scientific communities are increasingly publishing data to evaluate, accredit, and build on published research. However, guidelines for curating data for publication are sparse for model-related research, limiting the usability of archived simulation data. In particular, there are no established guidelines for archiving data related to terrestrial models that simulate land processes and their coupled interactions with climate. Terrestrial modelers have a unique set of challenges when publishing data due to the diversity of scientific domains, research questions, and the types and scales of simulations. Researchers in the U.S. Department of Energy’s (DOE) projects use a variety of multiscale models to advance robust predictions of terrestrial and subsurface ecosystem processes. Here, we synthesize archiving needs for data associated with different DOE models, and provide guidelines for publishing terrestrial model data components following FAIR (Findable, Accessible, Interoperable, Reusable) principles. The guidelines recommend archiving model inputs and testing data used in final simulation runs along with associated codes, workflow scripts, and metadata in public repositories. Researchers should consider archiving model outputs if they are within the storage limits of the repository. We also provide considerations for how to bundle files into different data publications with citable digital object identifiers. Finally, we identify repository features and tools that would enable storage and reuse of model data. Given the diversity of DOE terrestrial models, these guidelines are transferable to other model types and will enable efficient reuse of simulation data for purposes such as model intercomparisons, initialization, benchmarking, synthesis, and comparisons with field observations.

58 GEOSCIENCES↗

Compression behavior of delaminated composite plates

The response of delaminated composite plates to compressive in-plane loads was investigated. The delaminated region may be either circular or elliptical, and may be located between any two plies of the laminate. For elliptical delaminations, the axes of the ellipse may be arbitrarily oriented with respect to the applied loads. A model was developed that describes the stresses, strains, and deformation of the sublaminate created by the delamination. The mathematical model is based on a two dimensional nonlinear plate theory that includes the effects of transverse shear deformation. The model takes into account thermal and moisture induced strains, transverse pressures acting on the sublaminate, and contact between the sublaminate and plate. The solution technique used is the Ritz method. A computationally efficient computer implementation of the model was developed. The code can be used to predict the nonlinear-load-strain behavior of the sublaminate including the buckling load, postbuckling behavior, and the onset of delamination growth. The accuracy of the code was evaluated by comparing the model results to benchmark analytical solutions. A series of experiments was conducted on Fiberite T300/976 graphite/epoxy laminates bonded to an aluminum honeycomb core forming a sandwich panel. Either circles or ellipses made from Teflon film were embedded in the laminates, simulating the presence of a delamination. Each specimen was loaded in compression and the strain history of the sublaminate was recorded far into the postbuckling regime. The extent of delamination growth was evaluated by C-scan examination of each specimen. The experimental data were compared to code predictions. The code was found to describe the data with reasonable accuracy. A sensitivity study examined the relative importance of various material properties, the delamination dimensions, the contact model, the transverse pressure differential, the critical strain energy release rate, and the relative growth direction on the buckling load, the postbuckling behavior, and the growth load of the sublaminate.

Peck, Scott O.↗

Initial Probabilistic Evaluation of Reactor Pressure Vessel Fracture with Grizzly and Raven

The Grizzly code is being developed with the goal of creating a general tool that can be applied to study a variety of degradation mechanisms in nuclear power plant components. The first application of Grizzly has been to study fracture in embrittled reactor pressure vessels (RPVs). Grizzly can be used to model the thermal/mechanical response of an RPV under transient conditions that would be observed in a pressurized thermal shock (PTS) scenario. The global response of the vessel provides boundary conditions for local models of the material in the vicinity of a flaw. Fracture domain integrals are computed to obtain stress intensity factors, which can in turn be used to assess whether a fracture would initiate at a pre-existing flaw. These capabilities have been demonstrated previously. A typical RPV is likely to contain a large population of pre-existing flaws introduced during the manufacturing process. This flaw population is characterized stastistically through probability density functions of the flaw distributions. The use of probabilistic techniques is necessary to assess the likelihood of crack initiation during a transient event. This report documents initial work to perform probabilistic analysis of RPV fracture during a PTS event using a combination of the RAVEN risk analysis code and Grizzly. This work is limited in scope, considering only a single flaw with deterministic geometry, but with uncertainty introduced in the parameters that influence fracture toughness. These results are benchmarked against equivalent models run in the FAVOR code. When fully developed, the RAVEN/Grizzly methodology for modeling probabilistic fracture in RPVs will provide a general capability that can be used to consider a wider variety of vessel and flaw conditions that are difficult to consider with current tools. In addition, this will provide access to advanced probabilistic techniques provided by RAVEN, including adaptive sampling and parallelism, which can dramatically decrease run times.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Laser produced plasma sources for nanolithography—Recent integrated simulation and benchmarking

Photon sources for extreme ultraviolet lithography (EUVL) are still facing challenging problems to achieve high volume manufacturing in the semiconductor industry. The requirements for high EUV power, longer optical system and components lifetime, and efficient mechanisms for target delivery have narrowed investigators towards the development and optimization of dual-pulse laser sources with high repetition rate of small liquid tin droplets and the use of multi-layer mirror optical system for collecting EUV photons. We comprehensively simulated laser-produced plasma sources in full 3D configuration using 10–50 μm tin droplet targets as single droplets as well as, for the first time, distributed fragmented microdroplets with equivalent mass. The latter is to examine the effects of droplet fragmentation resulting from the first pulse and prior to the incident second main laser pulse. We studied the dependence of target mass and size, laser parameters, and dual pulse system configuration on EUV radiation output and on atomic and ionic debris generation. Our modeling and simulation included all phases of laser target evolution: from laser/droplet interaction, energy deposition, target vaporization, ionization, plasma hydrodynamic expansion, thermal and radiation energy redistribution, and EUV photons collection as well as detail mapping of photons source size and location. We also simulated and predicted the potential damage to the optical mirror collection system from plasma thermal and energetic debris and the requirements for mitigating systems to reduce debris fluence. The debris effect on mirror collection system is analyzed using our three-dimensional ITMC-DYN Monte Carlo package. Modeling results were benchmarked against our CMUXE laboratory experimental studies for the EUV photons production and for debris and ions generation.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗