Likelihood-Based Climate Model Evaluation
No abstract available
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
No abstract available
Abstract Low cloud fractions (LCFs) and meteorological factors (MFs) over an oceanic region containing multiple cloud regimes are examined for three data sets: one Energy Exascale Earth System Model (E3SM) simulation with the default 72‐layer vertical grid (E3SM72), another one with 8‐times vertical resolution via the Framework for Improvement by Vertical Enhancement (E3SM 8), and one with MFs from ERA5 reanalysis and LCFs from the CERES SSF product (ERA5‐SSF). Neural networks (NNs) are trained to capture the relationship between MFs and LCF and to select the best‐performing MF subsets for predicting LCF. NN ensembles are used to (a) confirm the performance of selected MF subsets, (b) to serve as proxy models for each data set to predict LCFs for MFs from all data sets, and (c) to classify MFs into those in shared and uniquely occupied MF subspaces. Overall, E3SM72 and E3SM 8 have large fractions of MFs in shared MF subspace, but less so near the Californian and Peruvian stratocumulus decks. E3SM 8 and ERA5 have small fractions of MFs in shared MF subspace but greater than E3SM72 and ERA5, especially in the Southeast Pacific. The differences in LCFs between three pairs of data sets are decomposed into those associated with the differences in the LCF‐MF relationship and those involving different MFs. Given the same MFs, LCFs produced by E3SM 8 are greater than those produced by E3SM72 but are still different from those in ERA5‐SSF. In general, the shift in MFs dominates the difference in the LCFs.
Building energy consumption benchmarking involves challenges associated with various energy patterns for different building types; heating, ventilating, and air-conditioning (HVAC) system types; and climates. Given significant variation in energy use patterns, accurate prediction of long-term energy use using surrogate models remains challenging. Multiple linear regression (MLR) is commonly used for building energy benchmarking because of its simple structure; however, it lacks accuracy compared to other black-box models. Although many studies have compared surrogate models and offer guidance on model selection based on metrics, they do not provide detailed analysis on improving the surrogate model accuracy. In this paper, we implement a surrogate model using polynomial ridge regression (i.e., MLR with interaction terms combined with ridge regularization) for small office and retail strip mall buildings across six HVAC system types and all climate zones, for electricity and natural gas in baseline and proposed scenarios. A simulation workflow is developed using OpenStudio TM /EnergyPlus TM to generate simulation data using measures over a wide range of efficiency inputs. Enhancements based on statistical insights are used for improving the model accuracy using filters, input transformations, and change points. Surrogate models achieved average coefficient of variation of the root mean squared error (CVRMSE) values of 2.17, 1.06, 2.05, and 3.26 for proposed electricity, proposed natural gas, baseline electricity, and baseline natural gas, respectively, with enhancements reducing CVRMSE by an average of 14.9% across all combinations. We provide model interpretation via Shapley additive explanations to determine which input variables most influence energy consumption and provide supportive arguments for enhancements.
Navier-Stokes solutions about a supercritical airfoil with aileron deflection have been computed using the CFL3D code coupled with the Baldwin-Lomax, Johnson-King, Baldwin-Barth, and Spalart-Allmaras turbulence models. Computations were made at a Mach number of 0.716 and chord Reynolds numbers of 5, 15, and 25 million. The airfoil was analyzed with both 0 deg and 2 deg (TED) aileron deflections. Comparisons over a range of angles-of-attack showed that solutions obtained using the Baldwin-Barth turbulence model presented the best agreement with experimental pressures and sectional lift coefficients. However, Reynolds number trends in sectional lift coefficient and in aileron effectiveness were not predicted consistently.
Geomagnetic indices are convenient quantities that distill the complicated physics of some region or aspect of near–Earth space into a single parameter. Most of the best–known indices are calculated from ground–based magnetometer data sets, such as Dst, SYM–H, Kp, AE, AL, and PC. Many models have been created that predict the values of these indices, often using solar wind measurements upstream from Earth as the input variables to the calculation. This document reviews the current state of models that predict geomagnetic indices and the methods used to assess their ability to reproduce the target index time series. These existing methods are synthesized into a baseline collection of metrics for benchmarking a new or updated geomagnetic index prediction model. These methods fall into two categories: (1) fit performance metrics such as root mean square error (RMSE) and mean absolute error (MAE) that are applied to a time–series comparison of model output and observations; and (2) event detection performance metrics such as Heidke Skill Score and probability of detection (POD) that are derived from a contingency table that compares model and observation values exceeding (or not) a threshold value. Furthermore, a few examples of codes being used with this set of metrics are presented, and other aspects of metrics assessment best practices, limitations, and uncertainties are discussed, including several caveats to consider when using geomagnetic indices.
Column densities from satellite retrievals can provide valuable information for estimating emissions and chemical lifetimes objectively across the globe. To better understand the uncertainties associated with these estimates, we test four methods using simulated column densities from a point source: a box model approach, a 2D Gaussian fit, an Inverse Radius fit and an Exponentially-Modified Gaussian fit. The model results were simulated using the WRF and CAMx models for the year 2005, for a single point source outside Atlanta in Georgia, USA with specified emissions and three chemical scenarios: no chemical reactions, 12 h chemical lifetime and 1 h chemical lifetime. No other sources were included in the simulations. We find that the box model provides reliable estimates irrespective of plume speed and plume direction, if the plume speed and the chemical lifetime are known accurately. The 2D Gaussian fit was found to be sensitive to plume speed and direction, and requires omnidirectional dispersion in order to have a decent fit. However, the 2D Gaussian fit is only an approximate fit to the data, and the discrepancies mean that the results are dependent on the geographical domain used for the optimization. An Inverse Radius fit is introduced to correct this issue, which is found to provide improved emissions and lifetime estimates. The Exponentially-Modified Gaussian fit also gave improved estimates. It is however dependent on accurate plume rotation such that reported chemical lifetimes with this method could be significantly underestimated.
In the lower frequency range, where particular boundary conditions can make a significant difference to panel response characteristics Statistical Energy Analysis (SEA) has never been the analytical tool of choice. In addition to boundary condition effects, SEA is not well suited in frequency bands where no modes or less than a few modes exist. The advent of the Hybrid Module has enabled integration of Finite Element Analysis to expand and enhance the capability for response calculations within VA One into the lower frequency range. Exploration of several additional modeling approaches was completed for the cylindrical orthogrid panel test article that was examined in Reference 1. Comparison of the new analytical response predictions with the measured response data from ground test and the pure SEA results from the reference will be presented. One approach that is considered promising is the periodic subsystem capability. Initially, a detailed FEM of just one region of the test article is defined. After evaluating this small region using symmetric boundary conditions, the FEM may be expanded to determine the properties of the entire system using similar connected regions that map over the entire test article. Another approach is the direct use of a very detailed finite element model of the entire panel, explicitly modeling pocket and rib details of the structure. A third approach is to approximate localized structure geometry details with a smeared property generalization using a PCOMP (NASTRAN card used to define layered composite structures) to define skin layer and ribbed layer for the orthogrid panel. The authors expect to demonstrate that the integrated Hybrid/FEM approach increases confidence in response prediction in the lower frequency range (for example from 20-300 Hz for the test article under consideration). In addition the strength and weakness of each additional approach will be highlighted and compared to those reported with those reported in an earlier paper
Detailed measurements of the mean flow and turbulence were made with the use of a micrometeorological facility consisting of an instrumented 76-m tall tower located within a 100-m distance from the Atlantic Ocean at Wallops Island, Virginia. Under moderately strong wind conditions, the popular neutral boundary layer flow model fails to provide an adequate description of the actual flow. In addition to detailed flow information for all wind directions, averages of the important flow parameters used for design such as vertical distribution of mean velocity, turbulence intensities and turbulence integral scales were presented for wind direction sectors with near uniform upstream terrain. Power spectra of the three velocity components for the prevailing northwesterly and southerly winds are discussed.
The motivation for the experiments reported here pertains to the siting of Liquefied Natural Gas (LNG) facilities which requires assessing the potential adverse radiant thermal impacts of accidental fires on the public. The objective is to obtain data on jet fires, pool fires, fireballs, and concrete walls that could serve as thermal barriers for model validation. The fuels tested include ethane, ethylene, propane, and isopentane.
The Deep Vadose Zone Treatability Test Plan for the Hanford Central Plateau includes testing of the desiccation technology as a potential technology to be used in conjunction with surface infiltration control to limit the flux of technetium and other contaminants in the vadose zone to the groundwater. Laboratory and modeling efforts were conducted to investigate technical uncertainties related to the desiccation process and its impact on contaminant transport. This information is intended to support planning, operation, and interpretation of a field test for desiccation in the Hanford Central Plateau.
This report contains the technical basis in support of the DOE's derivation of Authorized Limits (ALs) for the DOE Paducah C-746-U Landfill. A complete description of the methodology, including an assessment of the input parameters, model inputs, and results is provided in this report. This report also provides initial recommendations on applying the derived soil guidelines. The ORISE-derived soil guidelines are specifically applicable to the Landfill at the end of its operational life. A suggested 'upper bound' multiple of the derived soil guidelines for individual shipments is provided.
No abstract available
This project, started in July 1995 and ending in July 1996, related: to evaluation of the possible importance of soot and sulfur dioxide emissions from subsonic and supersonic aircraft; to research contributions and special responsibilities for NASA AEAP assessments of subsonic aircraft and High Speed Civil Transport aircraft; and to science team responsibilities supporting the development of the three-dimensional atmospheric chemistry model of the Global Modeling Initiative.
Oxidation flow reactors (OFRs) efficiently produce OH radicals using low-pressure Hg-lamp emissions at λ=254 nm (OFR254) or both λ=185 and 254 nm (OFR185). OFRs under most conditions are limited to studying low-NO chemistry (where RO2+HO2 dominates RO2 fate), even though substantial amounts of initial NO may be injected. This is due to very fast NO oxidation by high concentrations of OH, HO2, and O3. Here, we model new techniques for maintaining high-NO conditions in OFRs, i.e., continuous NO addition along the length of the reactor in OFR185 (OFR185-cNO), recently proposed injection of N2O at the entrance of the reactor in OFR254 (OFR254-iN2O), and an extension of that idea to OFR185 (OFR185-iN2O). For these techniques, we evaluate (1) fraction of conditions dominated by RO2+NO while avoiding significant non-tropospheric photolysis and (2) fraction of conditions where reactions of precursors with OH dominate over unwanted reactions with NO3. OFR185-iN2O is the most practical for general high-NO experiments since it represents the best compromise between experimental complexity and performance upon proper usage. Short lamp distances are recommended for OFR185-iN2O to ensure a relatively uniform radiation field. OFR185-iN2O with low O2 or using Hg lamps with higher 185-nm-to-254-nm ratio can improve performance. OFR185-iN2O experiments should generally be conducted at higher relative humidity, higher UV, lower concentration of non-NOy external OH reactants, and percent-level N2O. OFR185-cNO and OFR185-iN2O at optimal NO precursor injection rate (~2 ppb/s) or concentration (~3%) would have satisfactory performance in typical field studies where ambient air is oxidized. Finally, we provide exposure estimation equations to aid experimental planning. This work enables improved high-NO OFR experimental design and interpretation.
This study examines boundary layer turbulence derived from high temporal resolution meteorological measurements from 40 research flights over the western North Atlantic Ocean during the 2020 deployments of ACTIVATE. Frequency distributions of various turbulent quantities reveal stronger turbulence during the winter deployment than in summer and for cloud‐topped than in cloud‐free boundary layers during the summer deployment. Maximum turbulence kinetic energy (TKE) is most often within cloud from observations in winter and summer, whereas it is mostly below cloud in both seasons by a global model turbulence parameterization. Further, bivariate frequency distributions are consistent with the bivariate Gaussian probability distribution functions assumed for the closure of higher‐order turbulence/shallow convection parameterizations used by some global models. Turbulence simulated by the Community Atmosphere Model version 6 and the Energy Exascale Earth System Model Atmosphere Model version 2 using such parameterizations is not as strong as observed, with more TKE going into vertical wind perturbations rather than into zonal wind perturbations as observed, suggesting that the treatment of turbulence in Earth system models still needs to be further improved.
ZionSolutions is in the process of decommissioning the Zion Nuclear Power Plant in order to establish a new water treatment plant. There is some residual radioactive particles from the plant which need to be brought down to levels so an individual who receives water from the new treatment plant does not receive a radioactive dose in excess of 25 mrem/y⁻¹ as specified in 10 CFR 20 Subpart E. The objectives of this report are: (a) To present a simplified conceptual model for release from the buildings with residual subsurface structures that can be used to provide an upper bound on radionuclide concentrations in the fill material and the water in the interstitial spaces of the fill. (b) Provide maximum water concentrations and the corresponding amount of mass sorbed to the solid fill material that could occur in each building for use by ZSRP in selecting ROCs for detailed dose assessment calculations.
The U.S. Department of Energy is implementing corrective actions at facilities where nuclear-related operations were conducted in Nevada. Among the most significant sites being addressed are the locations of underground nuclear tests on the Nevada National Security Site (NNSS). The process for implementing corrective actions for the Underground Test Area (UGTA) locations is defined in Appendix VI of a Federal Facility Agreement and Consent Order (1996, as amended). In broad terms, Appendix VI describes a Corrective Action Investigation followed by a Corrective Action Decision, and implementation of a Corrective Action Plan prior to closure. The Frenchman Flat Corrective Action Unit (CAU) is farthest along in the UGTA corrective action process. It includes ten underground tests within the Frenchman Flat topographic basin, in the southeastern portion of the NNSS. Data have been collected from drilling exploration, hydrologic testing, and field and laboratory studies. Modeling has been completed at a variety of scales and focusing on a variety of flow and transport aspects ranging from regional boundary conditions to process dynamics within a single nuclear cavity. The culmination of the investigations is a transport model for the Frenchman Flat CAU (Stoller Navarro Joint Venture, 2009) that has undergone rigorous peer review and been accepted by the State of Nevada, setting the stage for the Corrective Action Decision and progression from the investigation phase to the corrective action phase of the project.
We present a global chemical data assimilation system using a global atmosphere model, the Community Atmosphere Model (CAM3) with simplified chemistry and the Data Assimilation Research Testbed (DART) assimilation package. DART is a community software facility for assimilation studies using the ensemble Kalman filter approach. Here, we apply the assimilation system to constrain global tropospheric carbon monoxide (CO) by assimilating meteorological observations of temperature and horizontal wind velocity and satellite CO retrievals from the Measurement of Pollution in the Troposphere (MOPITT) satellite instrument. We verify the system performance using independent CO observations taken on board the NSFINCAR C-130 and NASA DC-8 aircrafts during the April 2006 part of the Intercontinental Chemical Transport Experiment (INTEX-B). Our evaluations show that MOPITT data assimilation provides significant improvements in terms of capturing the observed CO variability relative to no MOPITT assimilation (i.e. the correlation improves from 0.62 to 0.71, significant at 99% confidence). The assimilation provides evidence of median CO loading of about 150 ppbv at 700 hPa over the NE Pacific during April 2006. This is marginally higher than the modeled CO with no MOPITT assimilation (-140 ppbv). Our ensemble-based estimates of model uncertainty also show model overprediction over the source region (i.e. China) and underprediction over the NE Pacific, suggesting model errors that cannot be readily explained by emissions alone. These results have important implications for improving regional chemical forecasts and for inverse modeling of CO sources and further demonstrate the utility of the assimilation system in comparing non-coincident measurements, e.g. comparing satellite retrievals of CO with in-situ aircraft measurements. The work described above also brought to light several short-comings of the data assimilation approach for CO profiles. Because of the limited vertical resolution of the measurement, the retrievals at different altitudes are correlated which can lead to problems with numerical error and overall efficiency. This has resulted in a manuscript that is about to be submitted to JGR: