Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,441 records · Page 80

Congestion Avoidance Testbed Experiments

DARTnet provides an excellent environment for executing networking experiments. Since the network is private and spans the continental United States, it gives researchers a great opportunity to test network behavior under controlled conditions. However, this opportunity is not available very often, and therefore a support environment for such testing is lacking. To help remedy this situation, part of SRI's effort in this project was devoted to advancing the state of the art in the techniques used for benchmarking network performance. The second objective of SRI's effort in this project was to advance networking technology in the area of traffic control, and to test our ideas on DARTnet, using the tools we developed to improve benchmarking networks. Networks are becoming more common and are being used by more and more people. The applications, such as multimedia conferencing and distributed simulations, are also placing greater demand on the resources the networks provide. Hence, new mechanisms for traffic control must be created to enable their networks to serve the needs of their users. SRI's objective, therefore, was to investigate a new queueing and scheduling approach that will help to meet the needs of a large, diverse user population in a "fair" way.

Denny, Barbara A.↗

Thermal/epithermal experiments with hafnium (TEX-Hf)

Critical experiment benchmarks are essential for validating calculational techniques used by criticality safety engineers to guarantee safe fissile material operations, yet there remain significant areas of need where existing benchmarks are insufficient or entirely absent. There is a particularly notable shortage of intermediate benchmarks (where the majority of fissions are caused by neutrons with energy between 0.625 eV and 100 keV). This work describes the design of a set of critical experiments (TEX-Hf) that address this gap by developing a highly enriched uranium (HEU) test bed into which various materials of interest (diluents) can be substituted. The first diluent to be investigated with this test bed is hafnium, a neutron poison used in nuclear applications for which there are no sufficiently sensitive benchmarks. Twenty-one critical configurations made up of stacked disks of HEU, polyethylene, and hafnium were designed and simulated in MCNP6 to calculate their fission energy spectra and the sensitivity of k{sub eff} to changes in various cross sections. It was shown that configurations spanned the energy range from thermal (below 0.625 eV), through the intermediate energy range (0.625 eV to 100 keV), to fast (above 100 keV). Furthermore, it was determined that this set of experiments is sensitive to the hafnium and {sup 235}U cross section data. These test bed experiments were designed to allow substitution of various diluent plates and can therefore be used to quickly and easily produce many more benchmarks. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Evaluation of Dell Frenzi Park, Mercury, Area 23, Nevada National Security Site, Nye County, Nevada (Cultural Resources Inventory Report)

The U.S. Department of Energy, National Nuclear Security Administration Nevada Field Office (NNSA/NFO) proposes to remove the ball courts and grade the area known as Dell Frenzi Park in the town of Mercury at the Nevada National Security Site (NNSS) in Nye County, Nevada. The park is within the Mercury Historic District (Nevada State Historic Preservation Office (SHPO) Resource No. D230). This project is an undertaking subject to review under Title 54 U.S.C. § 306108, commonly known as Section 106 of the National Historic Preservation Act, Title 54 U.S.C. § 300101, et seq., and its implementing regulations, 36 C.F.R. Part 800. The NNSA/NFO has consulted with the SHPO and the Advisory Council on Historic Preservation regarding the demolition of and modification to resources in Mercury as part of a modernization project, and has developed the Mercury Programmatic Agreement (PA) with the SHPO that specifies the approach that NNSA/NFO will take to meet its statutory obligations toward historic preservation within the district. The district is located in Sections 10–12, 14, and 15, T15S R53E, Mount Diablo Benchmark (BM) (projected) in Area 23 of the NNSS. In 2010, the Nevada Test Site became the NNSS, and will be referred to as such throughout this report as appropriate. This report is part of the Report Series: Evaluation, Finding of Effect, and Mitigation Documentation for Dell Frenzi Park, Mercury, Area 23, Nevada National Security Site, Nye County, Nevada

54 ENVIRONMENTAL SCIENCES↗

Performance and physics measurements at protoDUNE-SP

The protoDUNE Single Phase (protoDUNE-SP) TPC is a prototype for the DUNE far detector and it is currently under construction at CERN. It will not only serve as a test-bed for the engineering design and construction techniques but will also provide a set of key measurements for the future DUNE far detector.The new extension of the H4 beam-line at CERN will provide electron, muon and hadron beams with energies in the range of sub-GeV to a few GeV. The data collected during the test beams will be analysed to assess the performance of a state-of-the-art LAr TPC. For such detectors the event reconstruction is challenging and test beam data will allow the performance of the different reconstruction algorithms, which also involve machine-learning techniques, to be benchmarked and improved. Furthermore, important physics measurements are foreseen with protoDUNE-SP. For example, the study of pion interactions in argon using test beams is fundamental to understand some of the processes that will be seen as part of the primary neutrino interactions and which would modify the event signature in the DUNE detectors. ProtoDUNE-SP will provide new measurements of the pion-Ar cross-section, for both positive and negative charges, which will make a vital contribution to improve the current, very limited knowledge of such interactions.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Hardware Demonstration of Weak Grid Oscillations in Grid-Following Converters

The increasing penetration of inverter-based resources (IBRs) introduces some unexpected dynamic issues, including low-frequency oscillations. In this paper, a laboratory-scale grid-following voltage-source converter (VSC) system is implemented to demonstrate weak grid oscillations. Grid-following control is applied in VSC to provide active power, reactive power or ac voltage control. The test bed is also replicated in electromagnetic transient (EMT) simulation environment (MAT-LAB/SimPowerSystems) for benchmark purpose. Case studies are carried out to demonstrate low-frequency oscillations under real power/ac voltage or real power/reactive power control. The excellent agreement between the simulation and experimental results ensures that the two test beds are exchangeable and can be used for testing oscillation mitigation strategies in future research.

Bao, Li↗

Aerothermodynamic testing requirements for future space transportation systems

Aerothermodynamics, encompassing aerodynamics, aeroheating, and fluid dynamic and physical processes, is the genesis for the design and development of advanced space transportation vehicles. It provides crucial information to other disciplines involved in the development process such as structures, materials, propulsion, and avionics. Sources of aerothermodynamic information include ground-based facilities, computational fluid dynamic (CFD) and engineering computer codes, and flight experiments. Utilization of this triad is required to provide the optimum requirements while reducing undue design conservatism, risk, and cost. This paper discusses the role of ground-based facilities in the design of future space transportation system concepts. Testing methodology is addressed, including the iterative approach often required for the assessment and optimization of configurations from an aerothermodynamic perspective. The influence of vehicle shape and the transition from parametric studies for optimization to benchmark studies for final design and establishment of the flight data book is discussed. Future aerothermodynamic testing requirements including the need for new facilities are also presented.

Paulson, John W., Jr.↗

Polyethylene-Reflected Arrays of HEU(93.2) Metal Units Separated by Vermiculite

This benchmark details the results of an experiment performed in the early 1970s as part of a series testing critical configurations in three dimensional arrays. For this experiment, cylinders of 93.2% enriched uranium metal were arranged in a 2x2x2 array inside of a polyethylene reflector. Layers of vermiculite of varying heights were surrounding each cylinder to achieve criticality variations. A total of four experimental configurations were tested by D.W. Magnuson, and detailed in his experimental report “Critical Three-Dimensional Arrays of Neutron Interacting Units: Part IV. Arrays of U(93.2) Metal Reflected by Concrete and Arrays Separated by Vermiculite and Reflected by Polyethylene.” The benchmark HEU-MET-FAST054 is closely related; the results of both experiments are discussed in the same report (Ref. 1) Closely related work has been recorded in HEU-MET-FAST-053, which is a benchmark evaluation of a different series of three dimensional array experiments with four different moderator materials. HEU-MET-FAST-023 and HEU-MET-FAST-026 are also related because they utilize the same metal cylinders as these experiments.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Characterization of Heat Transfer in a Trapped-Vortex Combustor Designed for High-Temperature Material Testing

Next generation gas turbines will reduce carbon emissions by improving their cycle efficiencies and implementing hydrogen as a low-carbon fuel. The combined-cycle efficiency can be improved by increasing the combustor outlet temperature and decreasing the cooling air required for hot-section parts. Ultra-high temperature ceramic matrix composites (CMC) can survive increasingly extreme environments due to their strong mechanical properties at expected conditions. The introduction of CMCs in high-hydrogen flame environments requires testing at realistic conditions that mimic the thermochemical and fluid mechanic states in gas-turbine combustors. In this work, we describe a new experiment that has been designed to test high-temperature materials in a combustor-relevant environment. Its trapped-vortex combustor chamber design allows for high levels of fuel flexibility and wide flame stability limits. Testing of monolithic silicon carbide (SiC) samples in this environment was done to characterize the heat transfer to material samples over a wide range of operating conditions, including variations in fuel composition and thermal power. Heat flux measurements were verified in non-reacting and reacting environments after which they were benchmarked with previous literature to verify the operation of the facility with heated air. Testing in combustor-relevant conditions shows high levels of heat flux to the material samples in the combustor, particularly downstream of the anchored flame.

Richins, Porter [Pennsylvania State University , ,↗

Linear polarizabilities and second hyperpolarizabilities of streptocyanines: Results from broken-Symmetry DFT and new CCSD(T) benchmarks

In this work, we present a detailed analysis of the linear polarizability (α) and second hyperpolarizability (γ) in a series of streptocyanines, as predicted with various range-separated functionals and CCSD(T)-based methods. Contrary to previous work on these systems, we find that the lowest-energy electronic states for the larger streptocyanine oligomers are not closed-shell singlets, and improved accuracy can be obtained with certain DFT methods by allowing the system to relax to a lower-energy broken-symmetry solution. Our extensive analyses are complemented by new large-scale CCSD(T) and explicitly correlated CCSD(T)-F12 calculations that comprise the most complete and accurate benchmarks of α and γ for the streptocyanine systems to date. Taken together, our CCSD(T) and broken-symmetry DFT calculations (1) show that the MP2 benchmarks used in previous studies still exhibit significant errors (~ 25% for α and ~100% for γ) and, therefore, the MP2 calculations should not be used as reliable benchmarks for polarizabilities or hyperpolarizabilities, and (2) emphasize the importance of testing for a lower-energy open-shell configuration when calculating nonlinear optical properties for these systems. © 2018 Wiley Periodicals, Inc.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

An Open Combinatorial Diffraction Dataset Including Consensus Human and Machine Learning Labels with Quantified Uncertainty for Training New Machine Learning Models

Modern machine learning and autonomous experimentation schemes in materials science rely on accurate analysis of the data ingested by these models. Unfortunately, accurate analysis of the underlying data can be difficult, even for domain experts, complicating the training of the models intended to drive experiments. This is especially true when the goal is to identify the presence of weak signatures in diffraction or spectroscopic datasets. In this work, we examine a set of as-obtained diffraction data that track the phase transition from monoclinic to tetragonal in a Nb-doped VO2 film as a function of temperature and dopant concentration. We then task a set of domain experts and a set of machine learning experts with identifying which phase is present in each diffraction pattern manually and algorithmically, respectively; in both cases, the labels can vary dramatically, especially at the phase boundaries. We use the mode of the labels and the Shannon entropy as a method to capture, preserve and propagate consensus labels and their variance. Further we use the expert labels as a benchmark and demonstrate the use of Shannon entropy weighted scoring to test the performance of machine learning generated labels. Finally, we propose a material data challenge centered around generating improved labeling algorithms. This real-world dataset curated with expert labels can act as test bed for new algorithms. The raw data, annotations and code used in this study are all available online at data.gov and the interested reader is encouraged to replicate and improve the existing models

97 MATHEMATICS AND COMPUTING↗

Fourier-DeepONet: Fourier-enhanced deep operator networks for full waveform inversion with improved accuracy, generalizability, and robustness

In this article, full waveform inversion (FWI) infers the subsurface structure information from seismic waveform data by solving a non-convex optimization problem. Data-driven FWI has been increasingly studied with various neural network architectures to improve accuracy and computational efficiency. Nevertheless, the applicability of pre-trained neural networks is severely restricted by potential discrepancies between the source function used in the field survey and the one utilized during training. Here, we develop a Fourier-enhanced deep operator network (Fourier-DeepONet) for FWI with the generalization of seismic sources, including the frequencies and locations of sources. Specifically, we employ the Fourier neural operator as the decoder of DeepONet, and we utilize source parameters as one input of Fourier-DeepONet, facilitating the resolution of FWI with variable sources. To test Fourier-DeepONet, we develop three new and realistic FWI benchmark datasets (FWI-F, FWI-L, and FWI-FL) with varying source frequencies, locations, or both. Our experiments demonstrate that compared with existing data-driven FWI methods, Fourier-DeepONet obtains more accurate predictions of subsurface structures in a wide range of source parameters. Moreover, the proposed Fourier-DeepONet exhibits superior robustness when handling data with Gaussian noise or missing traces and sources with Gaussian noise, paving the way for more reliable and accurate subsurface imaging across diverse real conditions.

42 ENGINEERING↗

A multi-state trajectory method for non-adiabatic dynamics simulations

A multi-state trajectory approach is proposed to describe nuclear-electron coupled dynamics in nonadiabatic simulations. In this approach, each electronic state is associated with an individual trajectory, among which electronic transition occurs. The set of these individual trajectories constitutes a multi-state trajectory, and nuclear dynamics is described by one of these individual trajectories as the system is on the corresponding state. The total nuclear-electron coupled dynamics is obtained from the ensemble average of the multi-state trajectories. A variety of benchmark systems such as the spin-boson system have been tested and the results generated using the quasi-classical version of the method show reasonably good agreement with the exact quantum calculations. Featured in a clear multi-state picture, high efficiency, and excellent numerical stability, the proposed method may have advantages in being implemented to realistic complex molecular systems, and it could be straightforwardly applied to general nonadiabatic dynamics involving multiple states.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A Privacy Preserving Model-Free Optimization and Control Framework for Demand Response from Residential Thermal Loads

We consider the problem of optimizing the cost of procuring electricity for a large collection of homes managed by a load serving entity, by pre-cooling or pre-heating the thermal inertial loads in the homes to avoid procuring power during periods of peak electricity pricing. We would like to accomplish this objective in a completely privacy-preserving and model-free manner, that is, without direct access to the state variables (temperatures or power consumption) or the dynamical models (thermal characteristics) of individual homes, while guaranteeing personal comfort constraints of the consumers. We propose a two-stage optimization and control framework to address this problem. In the first stage, we use a long short-term memory (LSTM) network to predict hourly electricity prices, based on historical pricing data and weather forecasts. Given the hourly price forecast and thermal models of the homes, the problem of designing an optimal power consumption trajectory that minimizes the total electricity procurement cost for the collection of thermal loads can be formulated as a large-scale integer program (with millions of variables) due to the on-off cyclical dynamics of such loads. We provide a simple heuristic relaxation to make this large-scale optimization problem model-free and computationally tractable. In the second stage, we translate the results of this optimization problem into distributed open-loop control laws that can be implemented at individual homes without measuring or estimating their state variables, while simultaneously ensuring consumer comfort constraints. We demonstrate the performance of this approach on a large-scale test case comprising of 500 homes in the Houston area and benchmark its performance against a direct model-based optimization and control solution.

Sivaranjani, S.↗

Advanced Computational Methods for Security Constrained Financial Transmission Rights

Financial Transmission Rights (FTRs) are financial insurance tools to help power market participants reduce price risks associated with transmission congestion. FTRs are issued based on a process of solving a constrained optimization problem with the objective to maximize the FTR social welfare under power flow security constraints. Security constraints for different FTR categories (monthly, seasonal or annual) are usually coupled and the number of constraints increases exponentially with the number of categories. Commercial software for FTR calculation can only provide limited categories of FTRs due to the inherent computational challenges mentioned above. In this paper, first an innovative mathematical reformulation of the FTR problem is presented which dramatically improves the computational efficiency of optimization problem. After having re-formulated the problem, a novel non-linear dynamic system (NDS) approach is proposed to solve the optimization problem. The new formulation and performance of the NDS solver is benchmarked against widely used linear programming (LP) solvers like CPLEX™ and tested on both standard IEEE test systems and large-scale systems using data from the Western Electricity Coordinating Council (WECC). The performance of the NDS is demonstrated to be comparable and in some cases is shown to outperform the widely used CPLEX algorithms. The proposed formulation and NDS based solver is also easily parallelizable enabling further computational improvement.

Environmental Molecular Sciences Laboratory↗

Matrix approach to land carbon cycle modeling: A case study with the Community Land Model

The terrestrial carbon (C) cycle has been commonly represented by a series of C balance equations to track C influxes into and effluxes out of individual pools in earth system models (ESMs). This representation matches our understanding of C cycle processes well but makes it difficult to track model behaviors. It is also computationally expensive, limiting the ability to conduct comprehensive parametric sensitivity analyses. To overcome these challenges, we have developed a matrix approach, which reorganizes the C balance equations in the original ESM into one matrix equation without changing any modeled C cycle processes and mechanisms. We applied the matrix approach to the Community Land Model (CLM4.5) with vertically-resolved biogeochemistry. The matrix equation exactly reproduces litter and soil organic carbon (SOC) dynamics of the standard CLM4.5 across different spatial-temporal scales. The matrix approach enables effective diagnosis of system properties such as C residence time and attribution of global change impacts to relevant processes. We illustrated, for example, the impacts of CO 2 fertilization on litter and SOC dynamics can be easily decomposed into the relative contributions from C input, allocation of external C into different C pools, nitrogen regulation, altered soil environmental conditions, and vertical mixing along the soil profile. In addition, the matrix tool can accelerate model spin-up, permit thorough parametric sensitivity tests, enable pool-based data assimilation, and facilitate tracking and benchmarking of model behaviors. Altogether, the matrix approach can make a broad range of future modeling activities more efficient and effective.

59 BASIC BIOLOGICAL SCIENCES↗

SU-F-T-486: A Simple Approach to Performing Light Versus Radiation Field Coincidence Quality Assurance Using An Electronic Portal Imaging Device (EPID)

Purpose: To develop an accurate, straightforward, and user-independent method for performing light versus radiation field coincidence quality assurance utilizing EPID images, a simple phantom made of readily-accessible materials, and a free software program. Methods: A simple phantom consisting of a blocking tray, graph paper, and high-density wire was constructed. The phantom was used to accurately set the size of a desired light field and imaged on the electronic portal imaging device (EPID). A macro written for use in ImageJ, a free image processing software, was then use to determine the radiation field size utilizing the high density wires on the phantom for a pixel to distance calibration. The macro also performs an analysis on the measured radiation field utilizing the tolerances recommended in the AAPM Task Group #142. To verify the accuracy of this method, radiochromic film was used to qualitatively demonstrate agreement between the film and EPID results, and an additional ImageJ macro was used to quantitatively compare the radiation field sizes measured both with the EPID and film images. Results: The results of this technique were benchmarked against film measurements, which have been the gold standard for testing light versus radiation field coincidence. The agreement between this method and film measurements were within 0.5 mm. Conclusion: Due to the operator dependency associated with tracing light fields and measuring radiation fields by hand when using film, this method allows for a more accurate comparison between the light and radiation fields with minimal operator dependency. Removing the need for radiographic or radiochromic film also eliminates a reoccurring cost and increases procedural efficiency.

60 APPLIED LIFE SCIENCES↗

Digital acoustic sensor performance across the infrasound range in non-isolated conditions

The next generation of acoustic sensors is emerging to supplement legacy sensors traditionally used in regional and global networks. These devices operate under similar principles as traditional sensors, without the need of a separate external digitizer. The calibration of these sensors against their predecessors is crucial to the modernization of conventional technologies. This work describes the characterization of the next-generation MB3 digital microbarometer and the iPrecision smartphone microphone in a non-isolated calibration room across the infrasound (i.e., 0.01–20 Hz) range. The intent is to evaluate nominal instrument performance before deployment. A portable rotary subwoofer is used as a controllable infrasound source to generate single-tone sinusoidal and broadband noise pressure waves in a room configured for calibration purposes. For each device, comparison measurements are made, from which the digital sensitivity and the parametric response is developed. The results provide insight into the performance of the sensors in non-isolated environments. By overlapping the responses of the test sensors, digital sensor performance across the infrasound range can be benchmarked. These responses may serve as a double-reference scheme in future pressure measurements and digital calibrations of acoustic sensors.

47 OTHER INSTRUMENTATION↗