Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “confidence measures”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Application and Certification of Comparative Vacuum Monitoring Sensors for Structural Health Monitoring of 737 Wing Box Fittings

Multi-site fatigue damage, hidden cracks in hard-to-reach locations, disbonded joints, erosion, impact, and corrosion are among the major flaws encountered in today's extensive fleet of aging aircraft and space vehicles. The use of in-situ sensors for real-time health monitoring of aircraft structures are a viable option to overcome inspection impediments stemming from accessibility limitations, complex geometries, and the location and depth of hidden damage. Reliable, structural health monitoring systems can automatically process data, assess structural condition, and signal the need for human intervention. Prevention of unexpected flaw growth and structural failure can be improved if on-board health monitoring systems are used to continuously assess structural integrity. Such systems are able to detect incipient damage before catastrophic failures occurs. Condition-based maintenance practices could be substituted for the current time-based maintenance approach. Other advantages of on-board distributed sensor systems are that they can eliminate costly, and potentially damaging, disassembly, improve sensitivity by producing optimum placement of sensors and decrease maintenance costs by eliminating more time- consuming manual inspections. This report presents a Sandia Labs-aviation industry effort to move SHM into routine use for aircraft maintenance. This program addressed formal SHM technology validation and certification issues so that the full spectrum of concerns, including design, deployment, performance and certification were appropriately considered. The Airworthiness Assurance NDI Validation Center (AANC) at Sandia Labs, in conjunction with Boeing, Delta Air Lines, Structural Monitoring Systems Ltd., Anodyne Electronics Manufacturing Corp. and the Federal Aviation Administration (FAA) carried out a certification program to formally introduce Comparative Vacuum Monitoring (CVM) as a structural health monitoring solution to a specific aircraft wing box application. Validation tasks were designed to address the SHM equipment, the health monitoring task, the resolution required, the sensor interrogation procedures, the conditions under which the monitoring will occur, the potential inspector population, adoption of CVM into an airline maintenance program and the document revisions necessary to allow for routine use of CVM as an alternate means of performing periodic structural inspects. To carry out the validation process, knowledge of aircraft maintenance practices was coupled with an unbiased, independent evaluation. Sandia Labs designed, implemented, and analyzed the results from a focused and statistically-relevant experimental effort to quantify the reliability of the CVM system applied to the Boeing 737 Wing Box fitting application. All factors that affect SHM sensitivity were included in this program: flaw size, shape, orientation and location relative to the sensors, as well as operational and environmental variables. Statistical methods were applied to performance data to derive Probability of Detection (POD) values for CVM sensors in a manner that agrees with current nondestructive inspection (NDI) validation requirements and also is acceptable to both the aviation industry and regulatory bodies. This report presents the use of several different statistical methods, some of them adapted from NDI performance assessments and some proposed to address the unique nature of damage detection via SHM systems, and discusses how they can converge to produce a confident quantification of SHM performance An important element in developing SHM validation processes is a clear understanding of the regulatory measures needed to adopt SHM solutions along with the knowledge of the structural and maintenance characteristics that may impact the operational performance of an SHM system. This report describes the major elements of an SHM validation approach and differentiates the SHM elements from those found in NDI validation. The activities conducted in this program demonstrated the feasibility of routine SHM usage in general and CVM in particular for the application selected. They also helped establish an optimum OEM-airline-regulator process and determined how to safely adopt SHM solutions. This formal SHM validation will allow aircraft manufacturers and airlines to confidently make informed decisions about the proper utilization of CVM technology. It will also streamline the regulatory actions and formal certification measures needed to assure the safe application of SHM solutions.

42 ENGINEERING↗

Spatio-Temporal Deep Graph Network for Event Detection, Localization, and Classification in Cyber-Physical Electric Distribution System

This work proposes a deep graph learning framework to identify, locate, and classify power, cyber, and cyber power events at the distribution system level. The proposed algorithm jointly exploits spatial, temporal, and node-level cyber and physical data features. The developed graph neural network, together with a deep autoencoder, utilizes physical measurements from distribution level phasor measurement units and cyber data from communication network logs. The spatial structure of the synchrophasor measurements and network is incorporated through a weighted adjacency matrix. The temporal structure is incorporated by defining a spatial operation in the gated recurrent unit. This spatio-temporal learning element resides inside a power event detection, localization, and classification module that provides the degree of confidence for an event label. To accurately pinpoint the location of an event to the nearest bus equipped with a measurement unit, a combination of squared error and proximity score is utilized. Also included is a cyber event detection module that employs heteroskedasticity to analyze the significance of various cyber features during different types of attacks. Finally, a dual-bit cyber-power decision table determines the nature of the event. The proposed method is validated on two distribution systems modeled in OPAL-RT/Hypersim with limited phasor measurement units for different possible physical and cyber events. Further analyses include comparison with other state-of-the-art methods and validation in the presence of measurement noise. As a result, our method outperforms existing approaches and achieves an average detection accuracy of 97.97%, F1-score of 96.88%, precision of 96.53%, and recall of 98.57%.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Amplitude analysis and branching-fraction measurement of $\mathrm{D}^+_s$ → $π^+π^oη'$

Using data collected with the BESIII detector in $e^+e^-$ collisions at center-of-mass energies between 4.178 and 4.226 GeV and corresponding to 6.32 fb -1 of integrated luminosity, we report the amplitude analysis and branching-fraction measurement of the $\mathrm{D}^+_s$ → $π^+π^oη'$ decay. We find that the dominant intermediate process is $\mathrm{D}^+_s$ →$ρ^+η'$ and the significances of other resonant and nonresonant processes are all less than 3σ. The upper limits on the branching fractions of S-wave and P-wave nonresonant components are set to 0.10% and 0.74% at the 90% confidence level, respectively. In addition, the branching fraction of the $\mathrm{D}^+_s$ → $π^+π^oη'$ decay is measured to be (6.15 ± 0.25(stat.) ± 0.18(syst.))%, which receives significant contribution only from $\mathrm{D}^+_s$ →$ρ^+η'$ according to the amplitude analysis.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Measuring autoionization decay lifetimes of optically forbidden inner valence excited states in neon atoms with attosecond noncollinear four-wave-mixing spectroscopy

Attosecond noncollinear four-wave-mixing spectroscopy with one attosecond extreme ultraviolet (XUV) pulse and two few-cycle near-infrared (NIR) pulses was used to measure the autoionization decay lifetimes of inner valence electronic excitations in neon atoms. After a 43-48-eV XUV photon excites a 2s electron into the 2s2p 6 (np) Rydberg series, broadband NIR pulses couple the 2s2p 6 3p XUV-bright state to neighboring 2s2p 6 3s and 2s2p 6 3d XUV-dark states. Controllable delays of one or both NIR pulses with respect to the attosecond XUV pulse reveal the temporal evolution of either the dark or bright states, respectively. Experimental lifetimes for the 3s, 3p, and 3d states are measured to be 7±2, 48±8, and 427±40 fs, respectively, with 95% confidence. Accompanying calculations with two independent ab initio theoretical methods, newstock and astra, verify the findings. The results support the expected trend that the autoionization lifetime should be longer for states that have a smaller penetration in the radial region of the 2s core hole, which in this case is for the higher angular momentum Rydberg orbitals. In conclusion, the underlying theory thus links the lifetime results to electron correlation and provides an assessment of the direct and exchange terms in the autoionization process.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Bayesian uncertainty quantification for nuclear matter incompressibility

Within a Bayesian statistical framework using the standard Skyrme-Hartree-Fock model, the maximum a posteriori (MAP) values and uncertainties of nuclear matter incompressibility and isovector interaction parameters are inferred from the experimental data of giant resonances and neutron-skin thicknesses of typical heavy nuclei. Furthermore, with the uncertainties of the isovector interaction parameters constrained by the data of the isovector giant dipole resonance and the neutron-skin thickness, we have obtained K 0 = 223$^{+7}_{–8}$ MeV at 68% confidence level using the data of the isoscalar giant monopole resonance in 208 Pb measured at the Research Center for Nuclear Physics (RCNP), Japan, and at the Texas A&M University, USA. Although the corresponding 120 Sn data gives a MAP value for K 0 about 5 MeV smaller than the 208 Pb data, there are significant overlaps in their posterior probability distribution functions.

190 ≤ A ≤ 219↗

The Anisotropic Circumgalactic Medium of Massive Early-type Galaxies

Using measurements of the [O iii], Hα, and [N ii] emission line fluxes originating in the cool (T ~10 4 K) gas that populates the halos of massive early-type galaxies with stellar masses greater than 10 10.4 M ⊙ , we explore the recent conjecture that active galactic nucleus (AGN) activity preferentially removes the circumgalactic medium (CGM) along the polar (minor-axis) direction. We find deficits in the mean emission line flux of [O III] and Hα (65% and 43%, respectively) along the polar versus planar directions, although due to the large uncertainties in these difficult measurements the results are of marginal statistical significance (1.5σ). More robustly (97%–99.9% confidence depending on the statistical test), diagnostic line ratios show stronger AGN ionization signatures along the polar direction at small radii than at other angles or radii. Our results are consistent with the conjecture of an anisotropic CGM in massive early-type galaxies, suggested on independent grounds, that is tied to AGN activity and begin to show the potential of CGM mapping using emission lines.

79 ASTRONOMY AND ASTROPHYSICS↗

Pronghorn Porous Media Model Validation with Pressure Drop Measurements

The verification and validation (V&V) of Pronghorn is imperative to assert its accuracy when predicting the fluid velocity, temperature, and pressure in high temperature gas-cooled reactors. Pronghorn is a coarse-mesh, intermediate-fidelity, and multidimensional thermal-hydraulics (TH) code developed by the Idaho National Laboratory (INL). New pebble bed experiments are used to observe the details of the fluid motion and pressure drop in the porous bed under the reactor normal operation. This paper focuses on the validation of the Pronghorn compressible and incompressible Navier-Stokes equations using the pressure drop measurements performed at the engineering-scale pebble bed facility at the Texas A&M university (TAMU). Various pressure drop correlations and porosity functions are implemented in both Pronghorn and STAR-CCM+ to compare the pressure drop due to the combined viscous and inertial resistances in the porous bed. The correlations accounting for the near-wall effect are also utilized to observe if the pressure drop estimates can be improved. Pronghorn porous media models predict the pressure drop well relative to the STAR-CCM+ simulation results and 1D correlations, and both the finite element method (FEM) and finite volume method (FVM) perform accurately. Pronghorn models are also validated with the experimental measurements given the different Reynolds number ranges and specific aspect ratios. The likelihood of the statistical significance between the pressure drop measurements and specific correlations or simulations is low provided that the overlap of their confidence intervals is more than the half of a single arm. Several validation metrics are reasonable in regard to the similar studies from other literature. The precise average pebble bed porosity estimation has much impact on the pressure drop, and the Foumeny and Montillet (dense packing) models carry out the accurate pressure drop prediction by considering the near-wall effect.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Measurement of the CP-violating phase ϕ s in B$_s^0$→J/ψϕ decays in ATLAS at 13 TeV

A measurement of the B$_s^0$→J/ψϕ decay parameters using 80.5 fb -1 of integrated luminosity collected with the ATLAS detector from 13 Te proton–proton collisions at the LHC is presented. The measured parameters include the CP-violating phase ϕ s , the width difference Δ Γ s between the B$_s^0$ meson mass eigenstates and the average decay width Γ s . The values measured for the physical parameters are combined with those from 19.2fb -1 of 7 and 8 Te data, leading to the following: ϕs=-0.087±0.036(stat.)±0.021(syst.)rad ΔΓ s =0.0657±0.0043(stat.)±0.0037(syst.)ps -1 Γ s =0.6703±0.0014(stat.)±0.0018(syst.)ps -1 Results for ϕ s and Δ Γ s are also presented as 68% confidence level contours in the ϕ s –Δ Γ s plane. Furthermore the transversity amplitudes and corresponding strong phases are measured. ϕ s and Δ Γ s measurements are in agreement with the Standard Model predictions.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Dark Energy Survey: A 2.1% measurement of the angular baryonic acoustic oscillation scale at redshift z eff = 0.85 from the final dataset

Here, we present the angular diameter distance measurement obtained with the baryonic acoustic oscillation (BAO) feature from galaxy clustering in the completed Dark Energy Survey, consisting of six years (Y6) of observations. We use the Y6 BAO galaxy sample, optimized for BAO science in the redshift range 0.6 < z <1.2, with an effective redshift at z eff = 0.85 and split into six tomographic bins. The sample has nearly 16 million galaxies over 4,273 square degrees. Our consensus measurement constrains the ratio of the angular distance to sound horizon scale to D M ⁡(z eff )/r d = 19.51 ± 0.41 (at 68.3% confidence interval), resulting from comparing the BAO position in our data to that predicted by planck Λ⁢CDM via the BAO shift parameter α =(D M /r d )/(D M /r d ) PLANCK . To achieve this, the BAO shift is measured with three different methods, angular correlation function (ACF), angular power spectrum (APS), and projected correlation function (PCF), obtaining α = 0.952 ± 0.023, 0.962 ± 0.022, and 0.955 ± 0.020, respectively, which we combine to α = 0.957 ± 0.020, including systematic errors. When compared with the Λ⁢CDM model that best fits planck data, this measurement is found to be 4.3% and 2.1⁢σ below the angular BAO scale predicted. To date, it represents the most precise angular BAO measurement at z > 0.75 from any survey and the most precise measurement at any redshift from photometric surveys. The analysis was performed blinded to the BAO position, and it is shown to be robust against analysis choices, data removal, redshift calibrations, and observational systematics.

79 ASTRONOMY AND ASTROPHYSICS↗

A data analysis method to rapidly characterize gallium concentration in plutonium matrices using LIBS

The processing of actinide samples is a complex and costly endeavor that requires compositional analysis at various stages. Laser-induced breakdown spectroscopy (LIBS) has been used to analyze actinide-containing samples in many nuclear applications including waste management, fuel processing and forensics. The LIBS spectrum obtained from actinide materials are generally extremely complex, exhibiting many thousands of strong emission lines. This makes it difficult to identify other elements within the sample of interest, given the rich and dominant actinide spectrum. Here, in this article, we describe a recent effort to identify and quantify impurities and alloying constituents in plutonium matrices using a hand-held LIBS instrument that is used to rapidly and efficiently measure an emission spectrum from a material sample. We tabulate the emission line positions and intensities of plutonium. We report the development of machine-learning software that can identify gallium and quantify its concentration in plutonium matrices. This work has the potential to provide a rapid and nearly non-destructive technique that allows more confidence in characterizing the composition of materials that are present within complex actinide associated targets. We describe how our LIBS measurements and data analysis methods have successfully quantified the gallium concentration in a variety of samples.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Electrochemical behavior of SnCl 2 and influence of Cu and Ni ions in molten LiCl−KCl−CaCl 2 eutectic

Reliable transport and thermodynamic data for multivalent ions in complex molten salts are scarce, limiting model fidelity for electrorefining and impurity control. Here, we report a comprehensive electrochemical characterization of SnCl₂ in LiCl–KCl–CaCl₂ (50.5–44.2–5.3 mol%) at 685 K, including the effects of Ni 2+ and Cu + impurities. Using cyclic voltammetry (CV), chronoamperometry (CA), and chronopotentiometry (CP), we quantified Sn 2+ and Ni 2+ diffusion with exceptional agreement across methods: Sn 2+ averaged (1.03 ± 0.10) × 10 −5 cm 2 s −1 , and Ni 2+ averaged (0.75 ± 0.19) × 10 −5 cm 2 s −1 . The tight confidence-interval overlap across CV, CA, and CP strengthens confidence in these values and is uncommon in molten chloride studies. Open-circuit-potential measurements provided standard apparent reduction potentials that closely match LiCl–KCl literature, indicating minimal shift with CaCl₂ present. The Sn 2+ /Sn couple behaves as a reversible two-electron soluble–insoluble process at 685 K; the Sn 4+ /Sn 2+ couple transitions to soluble–soluble behavior near 788 K, which may correlate with the decomposition of surface bound chlorostannates, though direct characterization remains to be established. In mixed systems, Cu+/Cu overlaps Sn 2+ /Sn, limiting Cusingle bondSn electroseparation, whereas the larger potential gap between Ni 2+ /Ni and Sn 2+ /Sn supports selective Ni removal. These internally consistent transport and thermodynamic data establish a validated basis for process modeling and optimization of Sn electrorefining and impurity management in LiCl–KCl–CaCl₂.

Berzins-Delahay↗

Design of COVID-19 staged alert systems to ensure healthcare capacity with minimal closures

Community mitigation strategies to combat COVID-19, ranging from healthy hygiene to shelter-in-place orders, exact substantial socioeconomic costs. Judicious implementation and relaxation of restrictions amplify their public health benefits while reducing costs. We derive optimal strategies for toggling between mitigation stages using daily COVID-19 hospital admissions. With public compliance, the policy triggers ensure adequate intensive care unit capacity with high probability while minimizing the duration of strict mitigation measures. In comparison, we show that other sensible COVID-19 staging policies, including France’s ICU-based thresholds and a widely adopted indicator for reopening schools and businesses, require overly restrictive measures or trigger strict stages too late to avert catastrophic surges. As proof-of-concept, we describe the optimization and maintenance of the staged alert system that has guided COVID-19 policy in a large US city (Austin, Texas) since May 2020. As cities worldwide face future pandemic waves, our findings provide a robust strategy for tracking COVID-19 hospital admissions as an early indicator of hospital surges and enacting staged measures to ensure integrity of the health system, safety of the health workforce, and public confidence.

60 APPLIED LIFE SCIENCES↗

Dose reconstruction for plutonium-239 intakes at the Rocky Flats Plant

Purpose: The Rocky Flats (RF) Plant was a weapons manufacturing facility that operated from the early 1950s to 1989. Its primary missions were the production of plutonium (Pu) pits for thermonuclear weapons and the processing of retired weapons for Pu recovery. The purpose of this study was to estimate radiation doses to a cohort of 4499 RF workers from an intake of 239 Pu, the primary plutonium isotope handled at the site. Materials and methods: The latest biokinetic models of the International Commission on Radiological Protection, or site-specific variations of those models, were used to estimate 239 Pu intakes for each worker based on model fits to bioassay data often coupled with lung measurements. Results: Urinary excretion and lung retention data for most 239 Pu intakes could be fit reasonably well by a mixture of Pu dioxide and moderately soluble material. For some workers, better fits were obtained by application of other absorption types including Type S, 239 Pu nitrate, or pure 239 Pu dioxide, or by assuming intake via a wound. The lungs typically received the highest tissue doses, with fifty-year committed equivalent doses in the range of 0.5–1 Sv for 275 workers, 1–5 Sv for 115 workers, and greater than 5 Sv for 12 workers. Conclusions: RF was a unique site regarding a large number of lung measurements available for determining the appropriate absorption types for inhaled material. Further, this provided higher confidence in reconstructed 239 Pu doses than is generally gained from urinary data alone.

61 RADIATION PROTECTION AND DOSIMETRY↗

Search for X ( 1870 ) via the decay J / ψ → ω K + K − η

Using a sample of ( 10087 ± 44 ) × 10 6 J / ψ events collected by the BESIII detector at the BEPCII collider, we search for the decay X ( 1870 ) → K + K − η via the J / ψ → ω K + K − η process for the first time. No significant X ( 1870 ) signal is observed. The upper limit on the branching fraction of the decay J / ψ → ω X ( 1870 ) → ω K + K − η is determined to be 9.55 × 10 − 7 at the 90% confidence level. In addition, the branching faction B ( J / ψ → ω K + K − η ) is measured to be ( 3.33 ± 0.02 ( stat ) ± 0.12 ( syst ) ) × 10 − 4 . Published by the American Physical Society 2024

Astronomy & Astrophysics↗

Measurement of the CP properties of Higgs boson interactions with $\tau$-leptons with the ATLAS detector

A study of the charge conjugation and parity ($CP$) properties of the interaction between the Higgs boson and $\tau$-leptons is presented. The study is based on a measurement of $CP$-sensitive angular observables defined by the visible decay products of $\tau$-leptons produced in Higgs boson decays. The analysis uses 139 fb -1 of proton–proton collision data recorded at a centre-of-mass energy of $\sqrt{s}$ = 13 TeV with the ATLAS detector at the Large Hadron Collider. Contributions from $\tau$-violating interactions between the Higgs boson and $\tau$-leptons are described by a single mixing angle parameter Φ $\tau$ in the generalised Yukawa interaction. Without constraining the $H$ $\rightarrow$ $\tau$$\tau$ signal strength to its expected value under the Standard Model hypothesis, the mixing angle Φ $\tau$ is measured to be 9° ± 16°, with an expected value of 0° ± 28° at the 68% confidence level. The pure $CP$-odd hypothesis is disfavoured at a level of 3.4 standard deviations. The results are compatible with the predictions for the Higgs boson in the Standard Model.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Search for Astrophysical Neutrinos from 1FLE Blazars with IceCube

The majority of astrophysical neutrinos have undetermined origins. The IceCube Neutrino Observatory has observed astrophysical neutrinos but has not yet identified their sources. Blazars are promising source candidates, but previous searches for neutrino emission from populations of blazars detected in ≳GeV gamma rays have not observed any significant neutrino excess. Recent findings in multimessenger astronomy indicate that high-energy photons, coproduced with high-energy neutrinos, are likely to be absorbed and reemitted at lower energies. Thus, lower-energy photons may be better indicators of TeV–PeV neutrino production. This paper presents the first time-integrated stacking search for astrophysical neutrino emission from MeV-detected blazars in the first Fermi Large Area Telescope low energy (1FLE) catalog using ten years of IceCube muon–neutrino data. The results of this analysis are found to be consistent with a background-only hypothesis. Assuming an E -2 neutrino spectrum and proportionality between the blazars MeV gamma-ray fluxes and TeV–PeV neutrino flux, the upper limit on the 1FLE blazar energy-scaled neutrino flux is determined to be 1.64 x 10 -12 TeV cm -2 s -1 at 90% confidence level. This upper limit is approximately 1% of IceCube’s diffuse muon–neutrino flux measurement.

79 ASTRONOMY AND ASTROPHYSICS↗

Measurement of the B s 0 → μ + μ - decay properties and search for the B 0 → μ + μ - and B s 0 → μ + μ - γ decays

An improved measurement of the decay $B^0_S$ → $μ^+μ^-$ and searches for the decays $B^0$ → $μ^+μ^+$ and $B^0_S$ → $μ^+μ^-γ$ are performed at the LHCb experiment using data collected in proton-proton collisions at $\sqrt{s}$ = 7, 8 and 13 TeV. corresponding to integrated luminosities of 1, 2 and 6 fb -1 , respectively. The $B^0_S$ → $μ^+μ^-$ branching fraction and effective lifetime are measured to be $\mathscr{B}$($B^0_S$ → $μ^+μ^-$) = (3.09$^{(+0.46+0.15)}_{(-0.43-0.11)}$) x 10 -9 and $τ(B^0_s →μ^+μ^-)$ = (2.07 ± 0.29 ± 0.03) ps, respectively, where the uncertainties include both statistical and systematic contributions. No significant signal for $B^0$ → $μ^+μ^-$ and $B^0_S$ → $μ^+μ^-γ$ decays is found and the upper limits $\mathscr{B}$($B^0$ → $μ^+μ^-$) < 2.6 x 10 -10 and $B^0_S$ → $μ^+μ^-γ$ < 2.0 x 10 -9 at 95% confidence level are determined, where the latter is limited to the range $m_{μμ}$ > 4.9 GeV/c 2 . Additionally, the ratio between the $B^0$ → $μ^+μ^-$ and $B^0_S$ → $μ^+μ^-$ branching fractions is measured to be $\mathscr{R}_{μ+μ-}$ < 0.095 at 95% confidence level. The results are in agreement with the Standard Model predictions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Accuracy of HVAC Load Predictions: Validation of EnergyPlus and DOE-2 using FLEXLAB Measurements

The aim of the project reported here was to better understand the level of accuracy of three building energy simulation (BES) engines (‘engines’) — EnergyPlus™, DOE-2.1e, and DOE-2.2 — by identifying and investigating significant deviations between the performance predicted by these engines and actual performance as measured in the FLEXLAB® test facility at Lawrence Berkeley National Laboratory (LBNL). The specific test conditions included some of those prescribed in ANSI/ASHRAE Standard 140 - Standard Method of Test for the Evaluation of Building Energy Analysis Computer Programs. Detailed measurements of FLEXLAB performance, including indoor temperatures and heat fluxes and air-flow and water flow rates and temperatures in the Heating, Ventilating and Air Conditioning (HVAC) system, together with hourly weather data, were recorded and used in analyzing the simulation results from EnergyPlus v8.8, DOE-2.2 v3.65 and DOE-2.1e v127. These engines are commonly used in the United States for building energy code compliance, federal, state, and utility incentives programs, as well as energy efficient design of new buildings and energy retrofit of existing buildings. Seven conventional overhead mixing ventilation scenarios were tested and each engine was found to have a similar level of agreement with the measurements of space-level heating and sensible cooling loads. These results provide useful information regarding the accuracy of these engines in predicting the cooling and heating load elements of whole building energy performance. This information is intended for practitioners who are concerned about transitioning between simulation tools with different engines and for managers of utility programs leveraging these tools for evaluating and/or projecting measure savings to be incentivized under their programs. The results of the comparisons of simulated and measured performance indicate that the predictions from all three engines are not significantly different. The 24-hour average value of the absolute mean bias indicates the likely magnitude of the error in any particular case. The average mean bias is reduced by cancelation of overprediction in one case by underprediction in another. The daytime absolute mean biases, which may be more important for both energy performance and occupant comfort, are ~6%, presumably because of the greater complexity involved in simulating in the presence of solar radiation. EnergyPlus typically overpredicts the cooling load and/or underpredicts the heating load by ~1.5% and the DOE-2 engines typically underpredict the cooling load by approximately the same amount. The Root Mean Square Error is relatively more sensitive to shorter term variations in the difference between predicted and measured loads; the three engines have similar values, ~10%, suggesting that the uncertainties in their predictions of peak loads may also be similar in magnitude. The implication of these results is that users, both designers and program analysts, can use EnergyPlus, DOE-2.1e, or DOE-2.2 to model conventional commercial buildings equipped with overhead mixing ventilation with a similar level of confidence. Further work is required to better understand the variability in the level of agreement between the engine predictions and FLEXLAB measurements, where a particular engine will agree well with FLEXLAB in some cases and not so well in others and another engine will agree or disagree in different cases. As the sources of this variability are identified and eliminated or reduced significantly, it is recommended that the experimental capabilities and methods developed in the study reported here should be applied to validating heating and cooling load calculations for spaces with different types of furniture and miscellaneous loads. These methods should then be applied to low energy space conditioning systems in EnergyPlus including, in particular, radiant slab and radiant ceiling panel cooling and heating systems and ‘mixed mode’ systems that combine mechanical cooling and natural ventilation systems, focusing on controls, including control of thermal mass. The work reported here addresses the conventional method of heating and cooling occupied spaces; other methods, such as the use of radiant heating and cooling systems have the potential to provide equivalent occupant comfort, or better, with lower energy consumption. These systems are addressed more explicitly in EnergyPlus but there is a need for empirical validation to give users the same level of confidence in modeling these systems that they have, or should have, in modeling conventional systems, based on the results presented here.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗