Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Uranium Mass Attribute System (UMAS) Study: Evaluation of Options Against the Arms Control Evaluation Criteria

In this study, eleven possible radiation and other non-destructive measurement systems for confirming U-235 mass attribute were identified. The systems were reviewed for their applicability in a potential future arms control agreement, and a subset of the eight most plausible systems were selected for futher evaluation against the Arms Control Evaluation Criteria (ACEC). The evaluation results were then used to identify a primary and secondary recommended UMAS for confirming a U-235 mass attribute on warheads, nuclear components of warheads, and/or materials as part of a hypothetical arms control agreement.

36 MATERIALS SCIENCE↗

Adaptive Cybersecurity for Distributed Energy Resources (AdCyDER): Online Reinforcement Learning with Stackelberg-Optimized Defenses — Pipeline Architecture, Evaluation Methodology, and Findings from a Synthetic-Data Evaluation

This report documents the design and evaluation of an integrated online-learning pipeline developed within the AdCyDER project for Distributed Energy Resource (DER) cybersecurity. The pipeline couples a Reinforcement Learning (RL) attack classifier — which produces an attack-type probability distribution — with a Stackelberg game-theoretic (GT) defense selector that consumes those distributions alongside SME-encoded priors over (defense, attack) effectiveness pairings and perdefense costs to choose grid-health-preserving defenses. The objective is not attack classification per se but production of distributions that drive effective defense selection through the Stackelberg layer, learned from delayed grid-health feedback rather than labeled attack data. AdCyDER as a whole is broader than the work presented here; this report covers the specific RL/GT loop integration and its evaluation. We present the integrated pipeline (SCADA telemetry with Fronius inverter physics, Suricata IDS, time-windowed aggregation, per-facility LSTM classifier, Stackelberg optimizer, OpenC2 actuators), an experimental campaign of 28 eight-hour iterations across three baseline modes, and a pipeline-ordered diagnostic protocol. The protocol identifies two distinct failure modes within the loop: paired supervised ceilings on the same features establish that the deployed online RL classifier (macro F1 ≈ 0.07) sits at least 4.7× below a same-architecture supervised LSTM (≈ 0.34) and 10–11× below a linear feature-signal ceiling (≈ 0.70–0.79 depending on per-facility isolation), localizing the dominant failure to the training procedure; and the reward signal driving online updates carries weak directional coupling with classifier correctness in the methodology-expected direction (multi-lens convergent: top-decile P(true) records produce more frequent state changes and slightly larger improvements, top-vs-bot Cohen’s 𝑑 ≈ −0.19), but at effect magnitudes too small to drive gradient-based learning at the campaign sample size. The original learning hypothesis is not supported by the data. The primary contributions are the diagnostic methodology — proposed as a transferable falsification protocol for online RL/GT defense pipelines learning from delayed environmental reward — and the open, reproducible experimental infrastructure. We outline reward reformulation as the highest-priority aspirational next step given the underpowered-but-aligned Q6 reading, with hardware-in-the-loop evaluation as the broadest scope-expansion option.

Blakely, Benjamin [Argonne National Laboratory (AN↗

Innovating the next generation of commercial smart building software

Nearly 30% of commercial building energy use is wasted due to equipment faults and HVAC controls problems. The result is increased emissions, compromised comfort and productivity, and less reliable coordination of building power needs with a clean grid. The energy impact alone represents $17 billion in potential savings. Today’s smart building software provides a robust solution to address these operational deficiencies. Energy management and information systems (EMIS) are saving up to 9% on average, with two-year paybacks. They are being incorporated into energy management processes, commissioning services, and utility programs. As effective as they are, two barriers prevent even deeper benefits; limited personnel to fix problems once they are identified, and the expense and time to manually implement changes in control systems. In partnership with the research community, the EMIS industry is developing new capabilities to overcome these barriers. Moving beyond siloed products for either fault detection and diagnostics, or optimal control, these new capabilities empower users to not only automatically identify faults, but also to push corrective action, and control improvements to their buildings. In this paper, several areas for enhancements are documented: ‘one-time’ correction of faults such as setpoints, schedules, and economizer lockouts; short-term active testing for automated proportional integral derivative (PID) loop tuning and functional testing; and continuous supervisory control for demand flexibility and year-round efficiency. Results are presented from a pair of partner implementations out of a dozen providers integrating these enhancements into their products, including field tests from across the country, and insights into operator acceptance and integration into operations and maintenance practices.

Casillas, Armando↗

Computer-implemented security evaluation methods, security evaluation systems, and articles of manufacture

Computer-implemented security evaluation methods, security evaluation systems, and articles of manufacture are described. According to one aspect, a computer-implemented security evaluation method includes accessing information regarding a physical architecture and a cyber architecture of a facility, building a model of the facility comprising a plurality of physical areas of the physical architecture, a plurality of cyber areas of the cyber architecture, and a plurality of pathways between the physical areas and the cyber areas, identifying a target within the facility, executing the model a plurality of times to simulate a plurality of attacks against the target by an adversary traversing at least one of the areas in the physical domain and at least one of the areas in the cyber domain, and using results of the executing, providing information regarding a security risk of the facility with respect to the target.

97 MATHEMATICS AND COMPUTING↗

Evaluation of a new commercial Monte Carlo dose calculation algorithm for electron beams

Purpose: In this report the authors present the validation of a Monte Carlo dose calculation algorithm (XiO EMC from Elekta Software) for electron beams. Methods: Calculated and measured dose distributions were compared for homogeneous water phantoms and for a 3D heterogeneous phantom meant to approximate the geometry of a trachea and spine. Comparisons of measurements and calculated data were performed using 2D and 3D gamma index dose comparison metrics. Results: Measured outputs agree with calculated values within estimated uncertainties for standard and extended SSDs for open applicators, and for cutouts, with the exception of the 17 MeV electron beam at extended SSD for cutout sizes smaller than 5 × 5 cm{sup 2}. Good agreement was obtained between calculated and experimental depth dose curves and dose profiles (minimum number of measurements that pass a 2%/2 mm agreement 2D gamma index criteria for any applicator or energy was 97%). Dose calculations in a heterogeneous phantom agree with radiochromic film measurements (>98% of pixels pass a 3 dimensional 3%/2 mm γ-criteria) provided that the steep dose gradient in the depth direction is considered. Conclusions: Clinically acceptable agreement (at the 2%/2 mm level) between the measurements and calculated data for measurements in water are obtained for this dose calculation algorithm. Radiochromic film is a useful tool to evaluate the accuracy of electron MC treatment planning systems in heterogeneous media.

61 RADIATION PROTECTION AND DOSIMETRY↗

Evaluation of advanced automatic PET segmentation methods using nonspherical thin-wall inserts

Purpose: The use of positron emission tomography (PET) within radiotherapy treatment planning requires the availability of reliable and accurate segmentation tools. PET automatic segmentation (PET-AS) methods have been recommended for the delineation of tumors, but there is still a lack of thorough validation and cross-comparison of such methods using clinically relevant data. In particular, studies validating PET segmentation tools mainly use phantoms with thick plastic walls inserts of simple spherical geometry and have not specifically investigated the effect of the target object geometry on the delineation accuracy. Our work therefore aimed at generating clinically realistic data using nonspherical thin-wall plastic inserts, for the evaluation and comparison of a set of eight promising PET-AS approaches. Methods: Sixteen nonspherical inserts were manufactured with a plastic wall of 0.18 mm and scanned within a custom plastic phantom. These included ellipsoids and toroids derived with different volumes, as well as tubes, pear- and drop-shaped inserts with different aspect ratios. A set of six spheres of volumes ranging from 0.5 to 102 ml was used for a baseline study. A selection of eight PET-AS methods, written in house, was applied to the images obtained. The methods represented promising segmentation approaches such as adaptive iterative thresholding, region-growing, clustering and gradient-based schemes. The delineation accuracy was measured in terms of overlap with the computed tomography reference contour, using the dice similarity coefficient (DSC), and error in dimensions. Results: The delineation accuracy was lower for nonspherical inserts than for spheres of the same volume in 88% cases. Slice-by-slice gradient-based methods, showed particularly lower DSC for tori (DSC < 0.5), caused by a failure to recover the object geometry. The region-growing method reached high levels of accuracy for most inserts (DSC > 0.76 except for tori) but showed the largest errors in the recovery of pears and drops dimensions (higher than 10% and 30% of the true length, respectively). Large errors were visible for one of the gradient-based contouring methods when delineating drop-shaped inserts. Low DSC due to systematic underestimation of the volumes was observed for our fuzzy clustering method when using nonspherical inserts. The adaptive iterative thresholding method produced the highest DSC score on our nonspherical dataset (DSC > 0.83, except for tori) and showed robustness to the insert geometry. Conclusions: This study investigated the accuracy of eight PET-AS methods for the delineation of objects with a range of nonspherical geometries. The authors’ results confirmed the robustness of some segmentation approaches, but also showed the weaknesses of some of the other methods implemented, which were not observed with spherical inserts. This work therefore highlights the importance of using a variety of thin-wall inserts with complex geometries for the validation of PET-AS methods and provided useful information for further development of the methods tested.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Dynamic aperture evaluation for the RHIC 2009 polarized proton runs

In this article we numerically evaluate the dynamic apertures of the proposed lattices for the coming Relativistic Heavy Ion Collider (RHIC) 2009 polarized proton (pp) 100 GeV and 250 GeV runs. One goal of this study is to find out the appropriate {beta}* for the coming 2009 pp runs. Another goal is to check the effect of second order chromaticity correction in the RHIC pp runs.

43 PARTICLE ACCELERATORS↗

Aerosol indirect effects – general circulation model intercomparison and evaluation with satellite data

Aerosol indirect effects continue to constitute one of the most important uncertainties for anthropogenic climate perturbations. Within the international AEROCOM initiative, the representation of aerosol-cloud-radiation interactions in ten different general circulation models (GCMs) is evaluated in the present study using three satellite datasets. The satellite datasets are taken as reference bearing in mind that cloud and aerosol retrievals include uncertainties. We compute statistical relationships between aerosol optical depth (τa) and various cloud and radiation quantities consistently in models and satellite data. It is found that the model-simulated influence of aerosols on cloud droplet number concentration (Nd) compares relatively well to the satellite data at least over oceans. The relationship between τa and liquid water path is simulated much too strongly by the models. It is shown that this is partly related to rep¬resentation of the second aerosol indirect effect in terms of autoconversion. A positive re¬lationship between total cloud fraction (fcld) and τa as found in the satellite data is simulated by the majority of the models, albeit less strongly in most of them. In a discussion of the hypo¬theses proposed in the literature to explain the satellite-derived strong fcld – τa relation¬ship, we find that none is unequivocally confirmed by our results. Relationships similar to the ones found in satellite data between τa and cloud top tem¬perature and outgoing long-wave radiation (OLR) are simulated by only a few GCMs. The GCMs that simulate a negative OLR - τa relationship show a strong positive cor¬relation between τa and cloud fraction. The short-wave total aerosol radiative forcing as simulated by the GCMs is strongly influenced by the simulated anthropogenic fraction of τa, and parameterisation assumptions such as a lower bound on Nd. Nevertheless, the strengths of the statistical relationships are good predictors for the short-wave total aerosol forcings in the models. An estimate of the total short-wave aerosol forcing inferred from the combination of these predictors for the modelled forcings with the satellite-derived statistical relationships yields a global annual mean value of -1.5±0.5 Wm-2. An alternative estim¬ate obtained by scaling the simulated clear- and cloudy-sky forcings with estimates of anthropogenic τa and satellite-retrieved Nd – τa regression slopes, respectively, yields a global annual mean clear-sky (aerosol direct effect) es¬timate of -0.4±0.2 Wm-2 and a cloudy-sky (aerosol indirect effect) estimate of -0.7±0.5 Wm-2, with a total estimate of -1.2±0.4 Wm-2.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of a multi-scale WRF-CAM5 simulation during the 2010 East Asian Summer Monsoon

The Weather Research and Forecasting model with Chemistry (WRF-Chem) with the physics package of the Community Atmosphere Model Version 5 (CAM5) has been applied at multiple scales over Eastern China (EC) and the Yangtze River Delta (YRD) to evaluate how increased horizontal resolution with physics designed for a coarser resolution climate model impacts aerosols and clouds, and the resulting precipitation characteristics and performance during the 2010 East Asian Summer Monsoon (EASM). Despite large underpredictions in surface aerosol concentrations and aerosol optical depth, there is good spatial agreement with surface observations of chemical predictions, and increasing spatial resolution tends to improve performance. Model bias and normalized root mean square values for precipitation predictions are relatively small, but there are significant differences when comparing modeled and observed probability density functions for precipitation in EC and YRD. Increasing model horizontal resolution tends to reduce model bias and error for precipitation predictions. The surface and column aerosol loading is maximized between about 32N and 42N in early to mid-May during the 2010 EASM, and then shifts north while decreasing in magnitude during July and August. Changing model resolution moderately changes the spatiotemporal relationships between aerosols, cloud properties, and precipitation during the EASM, thus demonstrating the importance of model grid resolution in simulating EASM circulation and rainfall patterns over EC and the YRD. Results from this work demonstrate the capability and limitations in the aerosol, cloud, and precipitation representation of WRF-CAM5 for regional-scale applications down to relatively fine horizontal resolutions. Further WRF-CAM5 model development and application in this area is needed.

Campbell, Patrick↗

Accurate derivative evaluation for any Grad–Shafranov solver

We present a numerical scheme that can be combined with any fixed boundary finite element based Poisson or Grad–Shafranov solver to compute the first and second partial derivatives of the solution to these equations with the same order of convergence as the solution itself. At the heart of our scheme is an efficient and accurate computation of the Dirichlet to Neumann map through the evaluation of a singular volume integral and the solution to a Fredholm integral equation of the second kind. Our numerical method is particularly useful for magnetic confinement fusion simulations, since it allows the evaluation of quantities such as the magnetic field, the parallel current density and the magnetic curvature with much higher accuracy than has been previously feasible on the affordable coarse grids that are usually implemented.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

First Compilation and Evaluation of Beta-Delayed Neutron Emission Probabilities and Associated Half-Lives for A ≤ 72 Nuclei

A comprehensive compilation and evaluation of beta-delayed neutron (β{sup −}n) emission probabilities, P{sub n}, and associated half-lives for A ≤ 72 nuclei has been performed for the first time. The recommended values have been used to analyze the systematics of β{sup −}n emission in this region. The ratio P{sub n}/T{sub 1/2} is better correlated with the Q-value of the β{sup −}n decay mode than the previously proposed Kratz-Herrmann Formula (KHF). The recommended values are also compared with theoretical quasi-particle random phase approximation (QRPA) calculations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Full dimensional Franck-Condon factors for the acetylene A{sup ~} {sup 1}A{sub u}—X{sup ~1}Σ{sup +}{sub g} transition. I. Method for calculating polyatomic linear—bent vibrational intensity factors and evaluation of calculated intensities for the gerade vibrational modes in acetylene

Franck-Condon vibrational overlap integrals for the A{sup ~1}A{sub u}—X{sup ~1}Σ{sup +}{sub g} transition in acetylene have been calculated in full dimension in the harmonic normal mode basis. The calculation uses the method of generating functions first developed for polyatomic Franck-Condon factors by Sharp and Rosenstock [J. Chem. Phys. 41(11), 3453–3463 (1964)], and previously applied to acetylene by Watson [J. Mol. Spectrosc. 207(2), 276–284 (2001)] in a reduced-dimension calculation. Because the transition involves a large change in the equilibrium geometry of the electronic states, two different types of corrections to the coordinate transformation are considered to first order: corrections for axis-switching between the Cartesian molecular frames and corrections for the curvilinear nature of the normal modes at large amplitude. The angular factor in the wave function for the out-of-plane component of the trans bending mode, ν{sub 4}{sup ″}, is treated as a rotation, which results in an Eckart constraint on the polar coordinates of the bending modes. To simplify the calculation, the other degenerate bending mode, ν{sub 5}{sup ″}, is integrated in the Cartesian basis and later transformed to the constrained polar coordinate basis, restoring the conventional v and l quantum numbers. An updated A{sup ~}-state harmonic force field obtained recently in the R. W. Field research group is evaluated. The results for transitions involving the gerade vibrational modes are in qualitative agreement with experiment. Calculated results for transitions involving ungerade modes are presented in Paper II of this series [G. B. Park, J. H. Baraban, and R. W. Field, “Full dimensional Franck–Condon factors for the acetylene A{sup ~1}A{sub u}—X{sup ~1}Σ{sup +}{sub g} transition. II. Vibrational overlap factors for levels involving excitation in ungerade modes,” J. Chem. Phys. 141, 134305 (2014)].

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Evaluation and Modeling of Edge-Seal Materials for Photovoltaic Applications

Because of the sensitivity of some photovoltaic devices to moisture-induced corrosion, they are packaged using impermeable front- and back-sheets along with an edge seal to prevent moisture ingress. Evaluation of edge seal materials can be difficult because of the low permeation rates involved and/or non-Fickian behavior. Here, using a Ca film deposited on a glass substrate, we demonstrate theevaluation of edge seal materials in a manner that effectively duplicates their use in a photovoltaic application and compare the results with standard methods for measuring water vapor transport. We demonstrate how moisture permeation data from polymer films can be used to estimate moisture ingress rates and compare the results of these two methods. Encapsulant materials were also evaluated forcomparison and to highlight the need for edge seals. Of the materials studied, desiccant filled polyisobutylene materials demonstrate by far the best potential to keep moisture out for a 20 to 30 year lifetime.

14 SOLAR ENERGY↗

Evaluation of electropolished stainless steel electrodes for use in DC high voltage photoelectron guns

DC high voltage photoelectron guns are used to produce polarized electron beams for accelerator-based nuclear and high-energy physics research. Low-level field emission (∼nA) from the cathode electrode degrades the vacuum within the photogun and reduces the photoelectron yield of the delicate GaAs-based photocathode used to produce the electron beams. High-level field emission (>μA) can cause significant damage the photogun. To minimize field emission, stainless steel electrodes are typically diamond-paste polished, a labor-intensive process often yielding field emission performance with a high degree of variability, sample to sample. As an alternative approach and as comparative study, the performance of electrodes electropolished by conventional commercially available methods is presented. Our observations indicate the electropolished electrodes exhibited less field emission upon the initial application of high voltage, but showed less improvement with gas conditioning compared to the diamond-paste polished electrodes. In contrast, the diamond-paste polished electrodes responded favorably to gas conditioning, and ultimately reached higher voltages and field strengths without field emission, compared to electrodes that were only electropolished. The best performing electrode was one that was both diamond-paste polished and electropolished, reaching a field strength of 18.7 MV/m while generating less than 100 pA of field emission. The authors speculate that the combined processes were the most effective at reducing both large and small scale topography. However, surface science evaluation indicates topography cannot be the only relevant parameter when it comes to predicting field emission performance.

42 ENGINEERING↗

ENERGY STAR® Retail Products Platform (RPP): Conditions and Considerations in Evaluating Market Transformation Programs and Evaluation Guidance for RPP

The purpose of this guide is to provide a resource for state utility regulators, utilities, the evaluation community and regulatory stakeholders on methods to measure energy savings from the ENERGY STAR Retail Products Platform (link is external). The guidelines outlined in this document were developed by evaluation experts.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Coronado Generating Station Repowering Evaluation - Siting Evaluation

The purpose of this initial siting evaluation is to consider the suitability of the Salt River Project (SRP) owned land at/near Coronado Generating Station (CGS) for a nuclear generating station (including advanced light water reactors, light water small modular reactors, and non-light-water designs1) and to assess if there are any exclusionary or avoidance factors associated with coal to nuclear repowering at CGS. This initial siting evaluation considers several characteristics (e.g., environmental conditions, seismic concerns, site footprint, water use, etc.) and highlights favorable/preferred characteristics as well as potential risks to feasibility. The results are intended to inform SRP on the strengths and weaknesses associated with the CGS site and inform the selection of candidate nuclear technologies for the CGS site that align with SRP’s mission and business objectives. This report relies on industry-recognized siting guidance, including Electric Power Research Institute’s (EPRI’s) Siting Guide (Reference 1) 2 and Nuclear Regulatory Commission’s (NRC’s) Regulatory Guide (RG) 4.7 (Reference 3), as well as nuclear domain expertise within the Gateway for Accelerated Innovation in Nuclear (GAIN), MPR Associates, Inc. (MPR), and the Idaho National Laboratory (INL).

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗