Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “validation method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

A SIMPLIFIED ENERGY MODELING APPROACH FOR BUILDINGS

This paper introduces simplified energy modeling (SEM) approaches using DOE2 and EnergyPlus and proposes a validation method for simplified energy modeling. Simplified energy modeling can allow more design teams and owners to leverage the power of energy modeling to inform their designs and lead to greater energy savings and a lower first cost because the technologies and design strategies can be thoroughly tested against models before the decisions are made. By starting a discussion on how to develop simplified energy modeling approaches and methods to validate results, we hope to increase innovation in energy modeling software while decreasing variation between modelers. Simplified modeling is not yet widely accepted because it is unclear if the simplifications reduce the accuracy of the results. By starting an industry dialogue on a testing method for these modeling approaches, we hope to aid adoption of more streamlined tools when they can be shown to provide similar accuracy to more detailed tools. This paper proposes a method to test simplified energy modeling programs against the DOE prototype buildings. It builds on the testing procedure established for simulation engines by ASHRAE Standard 140. By comparing whole building and end use results from the accepted prototype buildings to any simplified modeling approach across multiple building types and climate zones we can determine if the simplifications create unwarranted error. We will present the SEM approach and results for a case study validation for a sample building types in 16 US climate zones from two such simplified energy modeling tools.

Energy Modeling, 90.1 Appendix G, Asset Score Tool↗

Lilith: An Enduring Plutonium Critical Assembly [Slides]

A design of an enduring Pu critical assembly has been produced. This is very important to DOE/NNSA missions. This assembly would result in advances/improvements in nuclear data validation, analytical methods validation, dosimetry, reactor kinetics, materials, and more.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Why the US Needs an Enduring Plutonium Critical Assembly

Jezebel (operated from 1954-1977) has been the primary experiment for fast 239 Pu nuclear data validation for the last 70 years. Validation has included not only k eff , but also spectral indicies, Rossi-α, reactivity coefficients, and neutron leakage spectra. While this has been incredibly valuable to the community, there are three major issues. The first issue is that documentation on many of these experiments were lacking, leading to large uncertainties or (even worse) incorrect assumptions. The second issue is that while there have been many advances in research, there is no way to test those new advances today. The last issue is that since the assembly only operated for 23 years (and at time when 30 other critical assemblies were operating at the same facility and nuclear weapons testing was occurring), there were limited opportunities to observe how any system parameters changed as a function of time. Note that this work is not suggesting that a "Jezebel re placement" used for a limited experiment campaign would have great value. A new enduring (100 year target) plutonium (Pu) assembly with simple geometry and low uncertainties, however, would be extremely valuable. Such a capability would have a transformative impact on many research areas including nuclear data validation, analytical methods validation, dosimetry, reactor kinetics, and materials. The need for a new plutonium assembly is not new: it has been in the DOE Nuclear Criticality Safety Program (NCSP) Mission and Vision for over 10 years and was also the top priority established at the 2022 National Criticality Experiments Research Center (NCERC) Futures meeting. This work will discuss how such a new capability would help ensure that the US retains international leadership in plutonium research. Last, a brief overview of Lilith, a project aimed to design a new enduring plutonium assembly for operation at the NCERC will be given.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Resource for the Development of Biomedical Accelerator Mass Spectrometry (AMS) Final Report

The NIH Research Resource for Biomedical AMS was originally funded at Lawrence Livermore National Laboratory in 1999 to develop and apply the technology of accelerator mass spectrometry (AMS) in broad- based biomedical research. The Resource’s niche is to fill needs for ultra high sensitivity quantitation when isotope-labeled agents are used. The Research Resource’s Technology Research and Development (TR&D) efforts will focus on the needs of the biomedical research community in the context of seven Driving Biomedical Projects (DBPs) that will drive the Center’s technical capabilities through three core TR&Ds. We will expand our present capabilities by developing a fully integrated HPLC AMS to increase our capabilities for metabolic measurements, we will develop methods to understand cellular processes and we will develop and validate methods for the application of AMS in human studies, which is a growing area of demand by collaborators and service users. In addition, we will continue to support new and ongoing collaborative and service projects that require the capabilities of the Resource. The Center will continue to train researchers in the use of the AMS capabilities being developed, and the results of all efforts will be widely disseminated to advance progress in biomedical research. Towards these goals, our specific aims are to:1.) Increase the value and information content of AMS measurements by combining molecular speciation with quantitation of defined macromolecular isolates. Specifically, develop and validate methods for macromolecule labeling, characterization and quantitation.2.) Develop and validate methods and strategies to enable AMS to become more broadly used in human studies. Specifically, demonstrate robust methods for conducting pharmacokinetic/pharmacodynamics studies in humans and model systems.3.) Increase the accessibility of AMS to the Biomedical research community and the throughput of AMS through direct coupling to separatory instruments.4.) Provide high throughput 14C BioAMS analysis for collaborative and service clients.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

To have value, comparisons of high-throughput phenotyping methods need statistical tests of bias and variance

The gap between genomics and phenomics is narrowing. The rate at which it is narrowing, however, is being slowed by improper statistical comparison of methods. Quantification using Pearson’s correlation coefficient ( r ) is commonly used to assess method quality, but it is an often misleading statistic for this purpose as it is unable to provide information about the relative quality of two methods. Using r can both erroneously discount methods that are inherently more precise and validate methods that are less accurate. These errors occur because of logical flaws inherent in the use of r when comparing methods, not as a problem of limited sample size or the unavoidable possibility of a type I error. A popular alternative to using r is to measure the limits of agreement (LOA). However both r and LOA fail to identify which instrument is more or less variable than the other and can lead to incorrect conclusions about method quality. An alternative approach, comparing variances of methods, requires repeated measurements of the same subject, but avoids incorrect conclusions. Variance comparison is arguably the most important component of method validation and, thus, when repeated measurements are possible, variance comparison provides considerable value to these studies. Statistical tests to compare variances presented here are well established, easy to interpret and ubiquitously available. The widespread use of r has potentially led to numerous incorrect conclusions about method quality, hampering development, and the approach described here would be useful to advance high throughput phenotyping methods but can also extend into any branch of science. The adoption of the statistical techniques outlined in this paper will help speed the adoption of new high throughput phenotyping techniques by indicating when one should reject a new method, outright replace an old method or conditionally use a new method.

59 BASIC BIOLOGICAL SCIENCES↗

Development of Nontargeted Workflow of Occupational Exposure by Infrared Ion Spectroscopy and Silicone Wristbands’ Passive Sampling

Monitoring chemical exposure has well-established protocols and procedures for occupational health and industrial hygiene across various career fields and in a variety of occupational and environmental conditions. Iterative analytical development has led to validated methods to provide employers and employees with safe working conditions in terms of industrial hygiene. These validated methods are commonly supported by commercial laboratories. Here, this workflow is explicitly a targeted approach in which sampling media, sample preparation, chemical separation, quantitative target detection, and post processing are well established. This workflow also relies on commercially available chemical surrogates, isotopically labeled internal standards, and certified/standard reference materials from reputable vendors. An untargeted workflow lacks many key ingredients of validated analytical methods to include the known chemical target.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A systematic review of validated suicide outcome classification in observational studies

Abstract Background Suicidal outcomes, including ideation, attempt, and completed suicide, are an important drug safety issue, though few epidemiological studies address the accuracy of suicidal outcome ascertainment. Our primary objective was to evaluate validated methods for suicidal outcome classification in electronic health care database studies. Methods We performed a systematic review of PubMed and EMBASE to identify studies that validated methods for suicidal outcome classification published 1 January 1990 to 15 March 2016. Abstracts and full texts were screened by two reviewers using prespecified criteria. Sensitivity, specificity, and predictive value for suicidal outcomes were extracted by two reviewers. Methods followed PRISMA-P guidelines, PROSPERO Protocol: 2016: CRD42016042794. Results We identified 2202 citations, of which 34 validated the accuracy of measuring suicidal outcomes using International Classification of Diseases (ICD) codes or algorithms, chart review or vital records. ICD E-codes (E950-9) for suicide attempt had 2–19% sensitivity, and 83–100% positive predictive value (PPV). ICD algorithms that included events with ‘uncertain’ intent had 4–70% PPV. The three best-performing algorithms had 74–92% PPV, with improved sensitivity compared with E-codes. Read code algorithms had 14–68% sensitivity and 0–56% PPV. Studies estimated 19–80% sensitivity for chart review, and 41–97% sensitivity and 100% PPV for vital records. Conclusions Pharmacoepidemiological studies measuring suicidal outcomes often use methodologies with poor sensitivity or predictive value or both, which may result in underestimation of associations between drugs and suicidal behaviour. Studies should validate outcomes or use a previously validated algorithm with high PPV and acceptable sensitivity in an appropriate population and data source.

Swain, Richard S.↗

Summary Report of the FY24 DOE Contributions to the GIF VHTR CMVB

The Generation-IV Forum (GIF) Very-High-Temperature Reactor-Computational Methods Validation and Benchmark (VHTR-CMVB) initiative, involving organizations from Korea Atomic Energy Research Institute (KAERI) (South Korea), Institute of Nuclear and New Energy Technology of Tsinghua University (INET) (China), U.S. Department of Energy (DOE) (U.S.), Joint Research Centre (JRC) (Europe), and Japan Atomic Energy Agency (JAEA) (Japan), is dedicated to the verification and validation of tools for High-Temperature Gas-Cooled Reactors (HTGRs) analysis, using data shared by Computational Methods Validation and Benchmark (CMVB) signatories. For FY24, the US DOE CMVB has committed to several critical activities. Under WP1, led by the US, the integration of the High Temperature Gas Cooled Reactor - Pebble-Bed Module (HTR-PM) Phenomena Identification and Ranking Table (PIRT) into the comparative PIRT is progressing, with a new draft of the comparison tables issued earlier this year and currently being utilized by INET for their contribution. Neutronic validation efforts under WP3 include the preparation of the burnup analysis benchmark, preliminary calculations, and the development of reference models and results. In WP2, a validation exercise for hot gas mixing in the lower plenum of HTR-PM is in progress, using experimental data from INET (China) to validate modeling approaches. A model of the experimental facility has been developed using StarCCM+, with initial calculations slated for presentation at the GIF CMVB meeting this fall. Another WP2 activity focuses on validating numerical models for air-cooled Reactor Cavity Cooling System (RCCS) with experimental data from the Wisconsin Madison RCCS facility. A high-fidelity model, developed using NEK-RS, is currently being validated with available data from a low power forced convection test. These efforts are aimed at enhancing and confirming the accuracy of HTGR analysis tools, ensuring their alignment with experimental data and regulatory requirements.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Topographic Effects on Radiation in the WRF Model with the Immersed Boundary Method: Implementation, Validation, and Application to Complex Terrain

Abstract Topographic effects on radiation, including both topographic shading and slope effects, are included in the Weather Research and Forecasting (WRF) Model, and here they are made compatible with the immersed boundary method (IBM). IBM is an alternative method for representing complex terrain that reduces numerical errors over sloped terrain, thus extending the range of slopes that can be represented in WRF simulations. The implementation of topographic effects on radiation is validated by comparing land surface fluxes, as well as temperature and velocity fields, between idealized WRF simulations both with and without IBM. Following validation, the topographic shading implementation is tested in a semirealistic simulation of flow over Granite Mountain, Utah, where topographic shading is known to affect downslope flow development in the evening. The horizontal grid spacing is 50 m and the vertical grid spacing is approximately 8–27 m near the surface. Such a case would fail to run in WRF with its native terrain-following coordinates because of large local slope values reaching up to 55°. Good agreement is found between modeled surface energy budget components and observations from the Mountain Terrain Atmospheric Modeling and Observations (MATERHORN) program at a location on the east slope of Granite Mountain. In addition, the model captures large spatiotemporal inhomogeneities in the surface sensible heat flux that are important for the development of thermally driven flows over complex terrain.

54 ENVIRONMENTAL SCIENCES↗

Diesel Fuel Consumption in Prominent U.S. Open-Pit Mines: Site-Level Estimates

This report presents a comprehensive framework for estimating diesel fuel consumption and prices at open-pit mines in the United States. The framework includes transparent methods for calculating site-level diesel energy use when direct reporting is unavailable, and a structured confidence evaluation for each method. The framework is demonstrated to estimate current diesel consumption at 21 open-pit mines in the United States. Initial findings support ongoing efforts to strengthen the competitiveness and security of the U.S. industrial base by supporting data-driven supply chain analysis and decision-making, improved transparency in mining sector energy use, and targeted deployment of energy innovation and cost-reduction strategies. Future updates to the dataset—coupled with expanded data transparency and method validation—will help ensure that the findings remain relevant as the sector continues to evolve.

02 PETROLEUM↗

Clustering Methods and Validation of Representative Distribution Feeders

Clustering has received a lot of focus globally in recent years to determine representative feeders for validating smart grid technologies; however, clear reasoning on why a particular technique was used to accomplish a clustering step and whether similar results can be obtained from different techniques has not been reported. Further, and most importantly, validating final representative feeders and clusters when a sizeable feeder data set is used has not been completed. This paper addresses these issues. This paper also highlights the parameters that were determined to be critical for photovoltaic hosting capacity based on this analysis.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Modeling Isothermal Reduction of Iron Ore Pellet Using Finite Element Analysis Method: Experiments & Validation

Iron ore pellet reduction experiments were performed with pure hydrogen (H2) and mixtures with carbon monoxide (CO) at different ratios. For direct reduction processes that switch dynamically between reformed natural gas and hydrogen as the reductant, it is important to understand the effects of the transition on the oxide reduction kinetics to optimize the residence time of iron ore pellets in a shaft reactor. Hence, the reduction rates were studied by varying experimental parameters such as the temperature (800, 850 & 900 °C), reactant gas flow rate (100, 150 & 200 cm3/min), pellet size and composition of the reactant gas mixture. The rate of reduction was observed to increase with an increase in temperature and reactant gas flow rate, but it decreased with an increase in pellet size. SEM greyscale analysis was performed to analyze the porosity and phase composition of partially reduced pellets. The porosity of the pellets was observed to increase from 0.3 for unreacted pellet to 0.42 for a completely reduced pellet. Energy-dispersive X-ray spectroscopy (EDAX) analysis was performed to identify the phases observed in the SEM images. The fraction of iron phase was observed to increase from the shell region of the pellet to the core region with an increase in the degree of reduction. A 2D-axisymmetric numerical model was developed on COMSOL Multiphysics, and it was validated using the conversion (X) vs. time curves obtained from each experiment. The model was able to accurately predict the total time needed for the complete conversion of a single iron ore pellet for multiple experiments. Effects of changes in the porosity and tortuosity of the pellet on the model were also studied and the rate of reduction was observed to be sensitive to changes in both porosity and tortuosity. The SEM analysis and the model results show that tortuosity is higher for pellets reduced with H2 than for pellets reduced with H2-CO gas mixtures.

08 HYDROGEN↗

Design and Validation of a High-Throughput Reductive Catalytic Fractionation Method

Reductive catalytic fractionation (RCF) is a promising method to extract and depolymerize lignin from biomass, and bench-scale studies have enabled considerable progress in the past decade. RCF experiments are typically conducted in pressurized batch reactors with volumes ranging between 50 and 1000 mL, limiting the throughput of these experiments to one to six reactions per day for an individual researcher. Here, we report a high-throughput RCF (HTP-RCF) method in which batch RCF reactions are conducted in 1 mL wells machined directly into Hastelloy reactor plates. The plate reactors can seal high pressures produced by organic solvents by vertically stacking multiple reactor plates, leading to a compact and modular system capable of performing 240 reactions per experiment. Using this setup, we screened solvent mixtures and catalyst loadings for hydrogen-free RCF using 50 mg poplar and 0.5 mL reaction solvent. The system of 1:1 isopropanol/methanol showed optimal monomer yields and selectivity to 4-propyl substituted monomers, and validation reactions using 75 mL batch reactors produced identical monomer yields. To accommodate the low material loadings, we then developed a workup procedure for parallel filtration, washing, and drying of samples and a 1H nuclear magnetic resonance spectroscopy method to measure the RCF oil yield without performing liquid-liquid extraction. As a demonstration of this experimental pipeline, 50 unique switchgrass samples were screened in RCF reactions in the HTP-RCF system, revealing a wide range of monomer yields (21-36%), S/G ratios (0.41-0.93), and oil yields (40-75%). These results were successfully validated by repeating RCF reactions in 75 mL batch reactors for a subset of samples. We anticipate that this approach can be used to rapidly screen substrates, catalysts, and reaction conditions in high-pressure batch reactions with higher throughput than standard batch reactors.

BIOMASS FUELS,INORGANIC, ORGANIC, PHYSICAL, AND AN↗

Validation of Microgrid Algorithms using At-Scale Simulation and Emulation Real-Time (ASSERT) Framework

This paper presents a novel framework for validating microgrid algorithms using a At-Scale Simulation and Emulation Real-Time (ASSERT) setup. The proposed universal microgrid validation framework was developed at Advanced Research on Integrated Energy Systems (ARIES) platform at National Renewable Energy Laboratory in Golden, Colorado, USA. As the number of intercommunicating devices grow in power systems, along with more integration of inverter-based resources, developing and validating microgrid operation and control algorithms is becoming complex and time-consuming task. The ASSERT framework is designed to provide a comprehensive, accurate, and efficient solution for validating microgrid algorithms. It combines at-scale simulations and real-time emulation to create a virtual environment that closely mimics the behavior of a physical microgrids which are characteristic of future smart distribution systems, such as: (1) increasing variability in the physical size of new energy technologies; (2) requiring control large numbers of interconnected devices, and (3) integrating diverse technologies that have not previously worked together. The paper describes the technical details of the ASSERT framework, its validation process, and its benefits over traditional validation methods. The framework's ability to validate the performance of various algorithms is demonstrated through a case study, which shows that it can effectively identify the weaknesses of an algorithm and optimize its performance. Overall, the ASSERT framework is a promising tool that can significantly enhance the development and validation of microgrid algorithms, leading to more reliable and efficient microgrid operation.

at-scale↗