Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “METRICS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Validation Assessment of Turbulent Reacting Flow Model Using The Area-Validation Metric on Medium-Scale Methanol Pool Fire Results

Accident analysis and ensuring power plant safety are pivotal in the nuclear energy sector. Significant strides have been achieved over the past few decades regarding fire protection and safety, primarily centered on design and regulatory compliance. Yet, after the Fukushima accident a decade ago, the imperative to enhance measures against fire, internal flooding, and power loss has intensified. Hence, a comprehensive, multilayered protection strategy against severe accidents is needed. Consequently, gaining a deeper insight into pool fires and their behavior through extensive validated data can greatly aid in improving these measures using advanced validation techniques. A model validation study was performed at Sandia National Laboratories in which a 30-cm diameter methanol pool fire was modeled using the SIERRA/Fuego turbulent reacting flow code. This validation study used a standard validation experiment to compare model results against, and conclusions have been published. The fire was modeled with a Large Eddy Simulation (LES) turbulence model with subgrid turbulent kinetic energy closure. Combustion was modeled using a strained laminar flamelet library approach. Radiative heat transfer was accounted for with a model utilizing the gray-gas approximation. In the present study, additional validation analysis is performed using the area validation metric (AVM). These activities are done on multiple datasets involving different variables and temporal/spatial ranges and intervals. In conclusion, the results provide insight into the use of the area validation metric on such temporally varying datasets and the importance of physics-aware use of the metric for proper analysis.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2025

Direct measurement of the quantum metric tensor in solids

The quantum metric tensor is a central geometric quantity in modern physics that is defined as the distance between nearby quantum states. Despite numerous studies highlighting its relevance to fundamental physical phenomena in solids, measuring the complete quantum metric tensors in real solid-state materials is challenging. In this work, we report a direct measurement of the full quantum metric tensors of Bloch electrons in solids using black phosphorus as a representative material. We extracted the momentum space distribution of the pseudospin texture of the valence band from the polarization dependence of angle-resolved photoemission spectroscopy measurement. Our approach is poised to advance our understanding of quantum geometric responses in a wide class of crystalline systems.

Kim, Sunje↗
DOE OSTI2025

Meta‐Analysis and Regression Modeling of the Impacts of Four Indoor Environmental Quality Metrics on Office Performance

Awareness of how buildings interact with the occupant experience—especially human performance—is becoming more prevalent, as seen by increasing interest and investment in healthy built environments. However, there is a need to synthesize the wide array of existing indoor environmental assessment and performance research in a way that can translate directly to building design and operation. Existing research in this area typically focuses on a single isolated metric and has not focused on making the results utilizable by building practitioners. The aim of this research is to investigate existing office performance literature through meta‐analyses and produce regression models for four indoor environmental quality (IEQ) metrics to support critical decision‐making for building operation and renovation. To reach this aim, a literature review was conducted to identify studies that measure the impact of changing ventilation rate, temperature, horizontal illuminance, and noise level in offices on occupant task performance. This repository of field and laboratory studies was analyzed to visualize the trends between the selected IEQ metrics and task performance. The temperature, ventilation rate, and horizontal illuminance regression models showed clear improvement potential when modifying indoor conditions toward the defined high‐performance range, while the regression model for noise level was inconclusive. The discussion notes the importance of designing holistically for all components of these IEQ categories to utilize the results, for example, good filtration on outdoor air for quantifying ventilation impact and uniform overhead lighting with low contrast for quantifying horizontal illuminance impact. The novelty of this work is in considering multiple facets of the indoor environment under a single, unified analysis schema and producing IEQ‐based performance gains that can directly inform cost‐benefit analyses of building design and renovation.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

NERSC_Lightweight Distributed Metric Service (NERSC_LDMS) v4.4.2

Miscellany This LDMS Loftsman/Helm Chart horizontally scales LDMS daemons in order to achieve a 1Hz sample rate from over 5,000 nodes, collecting 38k metrics per minute on Perlmutter. This LMDS Configuration relies on already running `ldmsd` producers running on nodes, which produce metrics via sampler plugins. The Helm chart distributes the collection of metrics from producer acrross many aggregator and storage `ldmsd` daemons, ensuring no damon is overloaded and data loss is avoided.

Stile, John [Lawrence Berkeley National Laboratory↗
DOE OSTI2020

A Novel and Practical Method to Quantify the Quality of Mobility: The Mobility Energy Productivity Metric: Preprint

Recent technology innovations are enabling fundamental improvements in mobility systems, including options for new travel modes, methods, and opportunities to connect people with goods, services, and employment. A desire to quantify and compare both existing and emerging transportation options motivated development of the mobility energy productivity (MEP) metric described herein. The MEP metric fundamentally measures the potential of a city's transportation system to connect a person to a variety of services and activities that define a high-quality of life, relative to the convenience, cost and energy needed to provide these connections. Fundamentally derived from accessibility theory, the MEP advances practice by using readily available travel time data (either from web-based application programming interfaces (APIs) or outputs from an urban transportation model) combined with established parameters that reflect the energy intensity and cost of various travel modes, and relative frequency of activity engagement. The construction of the MEP metric allows for aggregation and disaggregation to the appropriate spatial, modal, and trip purpose resolution, as analysis needs dictate. The MEP could be used to compare alternative futures related to technology, infrastructure investment, or policy, providing a much-needed tool for planners, researchers, and analysts.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2022

Multiphysics FISPACT-II and TENDL-2019 simulation: neutron-induced damage metrics

Nuclear interactions can be the source of atomic displacement, irradiation-induced defects and transmutation in structural materials. Such quantities are derived from, or can be correlated to, nuclear kinematic simulations of primary atomic energy distributions spectra and the quantification of the numbers of secondary defects produced per primary as a function of the available recoils, residual and emitted, energies. Recoil kinematics of neutral, residual, gas, proton, alpha particle emissions are now more rigorously treated based on recent, complete and enhanced nuclear data parsed in state-of-the-art processing tools. Defect production metrics are the starting point in the complex problem of correlating and simulating the behaviour of materials under irradiation, as experimental information is rare or scattered. Detailed, segregated primary knock-on-atom metrics are now becoming available as the starting point of further simulation processes of isolated and clustered defects in material lattices. This allows more materials, lattices, neutron incident energy ranges, and irradiation conditions to be explored with sufficient data to adequately cover both standard and novel applications and materials: the broader reactor applications landscape. The damage metrics of of materials are systematically explored under typical but different reactor's type environment. The inventory code FISPACT-II combined with the enhanced nuclear data forms of the TENDL-2019 libraries allow one to not only calculate dpa from mostly scattering events but to also properly predict gas production, nuclear heating and transmutation under the same conditions.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Performance Assessment of the Overall Building Envelope Thermal Performance—Building Envelope Performance (BEP) Metric

Today, to describe the thermal performance of the building envelope and its components we use a variation of metrics; such as, R-value, ACH (air exchange rate per hour), SHGC (solar heat gain coefficient) of windows, U-factor etc. None of these performance indicators is meant to represent the overall thermal performance. In this paper, such a metric is introduced, the BEP (building envelope performance) value. Unlike the thermal resistance, typically expressed as an R-value, the BEP-value considers additional elements of heat transfer that affect the energy demand of the building because of exterior and interior (solar) thermal loads: conductive and radiant heat transfer, and air infiltration. To demonstrate BEP’s utility, validation studies were carried out by comparing the BEP-value to theoretical results using whole building energy simulation tools such as EnergyPlus and WUFI Plus. Results show that BEP calculations are comparable to calculations made using these simulation tools and that unlike other similar metrics, the BEP-value accounts for all heat transfer mechanisms that are relevant for the overall energy performance of the building envelope. The BEP-value thus allows comparing envelopes of buildings with different use types in a fair and realistic manner.

42 ENGINEERING↗
DOE OSTI2020

FY2020 Fourth Quarter Performance Metric: Evaluate Improvement in Simulations of Mesoscale Convective Systems from New Parameterization Developments in E3SM

Mesoscale convective systems (MCSs) consist of an assembly of cumulonimbus clouds on scales of 100 km or more and produce mesoscale circulations (Houze, 2004, 2018). As the largest form of deep convective storms, MCSs contribute to 30% – 70% of annual and warm season rainfall in the U.S. and in the global tropics (Houze 2018; Stevenson & Schumacher, 2014; Feng et al., 2019; Haberlie & Ashley, 2019). Since MCSs contribute importantly to mean and extreme precipitation in the U.S. and many other regions around the world, understanding how well they are simulated by E3SM may guide future development towards more skillful modeling of convective storms and associated hydrologic impacts. The FY2020 Second Quarter Performance Metric Report documented comparisons of MCSs in the central and eastern U.S. in a high-resolution simulation produced by E3SM v1 at 25 km resolution (Caldwell et al. 2019) with observations. MCSs in the simulation occur less frequently and produce less intense precipitation, resulting in large underestimation of MCS volumetric rain-rate compared to observations. The first and third quarter performance metric report indicated that these model biases in simulating MCSs can be attributed to model limitations in parameterizing convection, clouds, and other related processes, as well as model biases in simulating the MCS large-scale environment. In the current FY2020 Fourth Quarter Performance Metric Report, we evaluate MCSs simulated in E3SM with several new developments in convection parameterizations that are being developed for its next generation. The goal is to summarize what have been improved with the new developments and highlight what need more work in the future.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Biases associated with a particular image volume metric

Image analysis area and volume metrics A 80 and V 80 , used by others, are studied as a function of image morphology, a 3D feature, and Monte Carlo noise in simulated images. The A 80 area metric is found to be stable, with consistent results (and meaning) obtainable without a detailed understanding of 3D features and/or simulation noise levels. However, the V 80 volume metric varies significantly with image morphology, 3D features, and simulation noise. If an experimental image set gives A 80 area inferences that are consistent with 2D image simulations, but V 80 volume inferences that are significantly larger than those corresponding to simulated images, then issues related to 3D features and simulation noise should be explored before conclusions are drawn related to a possible mismatch in the real physical size of experimental and simulated source volumes.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

MCNP® Code V.6.3.0 Unstructured-mesh Quality Metrics & Assessment

This report describes a variety of metrics calculated by the MCNP code for a user to assess the quality of an input unstructured mesh (UM). These UM quality metrics are calculated automatically, but the user has the opportunity to opt-out of doing so. At present, only linear tetrahedral elements and linear hexahedral elements have extensive quality metrics calculated and reported.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Metrics and Methods for Radiation Detection Algorithm Characterization for Nuclear/Radiological Source Search

This report presents a series of recommendations for data to train and evaluate radiation detection algorithms and performance metrics to evaluate these algorithms. These recommendations were formed through a community consensus approach through the Detection Radiation Algorithms Group (DRAG), a multi-institution collaboration spanning eight Department of Energy laboratories and John Hopkins Applied Physics Laboratory. This report includes recommendations on background data variability, and metrics to quantify variability, sources and shielding configurations to include in data collection campaigns and detector response variability. In addition, this report describes several anomaly detection and identification algorithms and recommends metrics to report their performance. Finally, this report ends with a discussion on machine learning algorithms.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Integrating the Mobility Energy Productivity Metric into the CDOT Statewide Model

The Mobility Energy Productivity (MEP) metric measures the quality of mobility at a specific location and can be used to evaluate how changes to transportation systems impact the mobility of that location over time, such as through infrastructure investments. The objective of this study is to demonstrate integration of the MEP metric into CDOT's transportation planning process by leveraging data from their statewide travel demand model. We evaluate the MEP metric in 2015 as well as 2030 baselines and projected impacts in 2030 for two different regions in Colorado under multiple scenarios across multiple modes (driving, walking, biking, and transit). It was found that increasing development (increasing population density, jobs, and opportunities) had a significant impact on MEP, independent of any specific alternatives. For drive mode, there was a trade- off of increasing congestion on the road network and increasing job and opportunity access. Impacts to bike, walk, and transit MEP were also demonstrated in both regions. This report shows how MEP can be used as a tool to support evaluating the impacts of various transportation projects across the state. With projections of significant growth across the state of Colorado, access to the increasing opportunities and jobs will be important to understand through the context of energy efficiency. MEP could support future project evaluation and decision-making by enabling the unique and important dimension of energy- efficient accessibility of a transportation system.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2025

Dense Image Matching Uncertainty Estimation and Confidence Metrics

Dense stereo matching takes overlapping image pairs as input and outputs a disparity map which encodes pixel-by-pixel matches between the images. Recently, there has been an interest in ranking the quality, or even quantifying the accuracy, of disparity estimates. The proposed methods can be described as either uncertainty estimators or confidence metrics. Uncertainty estimators are a small minority of the research. However, they have the potential to be the most useful because they estimate disparity accuracy (in pixel units) that can be used to threshold matches or carried forward using error propagation. The majority of the research deals with confidence metrics which give an ordinal (or binary) ranking of a match’s quality relative to other matches. Confidence metrics do not have units and thus are useful primarily for thresholding matches from mismatches. The methods could also be described as handcrafted or deep-learning based. The majority of the research focused on outdoor driving scenes. Hence, our interest–application to a satellite semi-global matching pipeline–is a domain shift that may challenge deep-learning based methods. We conclude by recommending five handcrafted and two deep-learning based methods for evaluation in our pipeline.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Review of Grey Box/Black Box Data Contamination Metrics on Open and Commercial Models

Dataset contamination is a problem where benchmarks and tasks used to evaluate the capabilities of Large Language Models (LLMs) have been incorporated into the training dataset of the models. This gives a false sense of performance that can overestimate how these models will function on truly unseen data. This problem becomes worse with commercial LLMs with larger and non-accessible training data, so techniques have been developed to try to measure the degree to which a model is contaminated with a benchmark’s data. To understand the effectiveness of these techniques, particularly when evaluating contamination on coding tasks, we review trends and categorize techniques by the degree of access to the model that is required. The research literature on this topic has reported mixed effectiveness of these techniques, so we select a set of black box (text access only) and grey box (access to model loss/probabilities required) techniques and apply them to both commercial and non-commercial models. We implement these metrics as part of a framework to test the contamination of Python code in LLMs to see to what extent we can replicate the effectiveness (or ineffectiveness) of these contamination detection techniques. Though we find mixed results in the capabilities of these metrics to identify contamination, we do observe evidence that they can identify contamination (broadly) in fine-tuned models when both a baseline and fine-tuned model is present. Additionally, similarity metrics were able to identify between contaminated and uncontaminated data even in situations where the data is distributionally similar (e.g., drawn from the same set of code projects).

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Demonstration of Optimal Benchmark Selection Website and Validation of the q c Coverage Metric Using HEU-SOL-THERM-013-003 Experiment

In the work documented in this interim report, the experiment selection toolkit web site was demonstrated and q C coverage metric methodology was validated for IEU-MET-FAST-002-001, MIX-COMP-THERM 004-004, and HEU-SOL-THERM-013-003 experiments. 𝑞 𝐶 is an information-theoretic measure based on mutual information that quantifies the ability of candidate benchmark experiments to reduce the bias and uncertainty of a target criticality safety application. The metric and an accompanying open-source Python toolkit with a web-based interface were tested against a benchmark set of 425 experiments drawn from the International Criticality Safety Benchmark Evaluation Project Handbook. The interface is hosted at https://edim.covdef.com. It accepts sensitivity data files produced by the TSUNAMI-IP module of the SCALE code system and supports both (i) deterministic analysis using the ENDF/B-VII.0 covariance library and (ii) stochastic analysis based on user-supplied keff samples. Demonstrations on representative applications across a range of material composition, spectrum, and form show that q C -guided benchmark selection achieves greater uncertainty reduction with fewer experiments and yields more stable posterior bias and uncertainty estimates than traditional similarity coefficient ( c k )–based selection, while also capturing valuable low-ck experiments that one-to-one metrics overlook.

Abdel-khalik, Hany S. [Indiana Univ.-Purdue Univ. ↗
DOE OSTI2023

Trimming and Decontamination of Metagenomic Data can Significantly Impact Assembly and Binning Metrics, Phylogenomic and Functional Analysis

Background: Investigators using metagenomic sequencing to study microbiomes often trim and decontaminate reads without knowing their effect on downstream analyses. Objective: This study was designed to evaluate the impacts JGI trimming and decontamination procedures have on assembly and binning metrics, placement of MAGs into species trees, and functional profiles of MAGs extracted from complex rhizosphere metagenomes, as well as how more aggressive trimming impacts these binning metrics. Methods: Twenty-three Miscanthus x giganteus rhizosphere metagenomes were subjected to different combinations and thresholds of force, kmer, and quality trimming and decontamination using BBDuk. Reads were assembled and binned in KBase. Phylogenomic and statistical analyses were applied to evaluate the effects of trimming and decontamination on downstream analyses. Results: We found that JGI trimmed and decontaminated reads had significant impacts on assembly and binning metrics compared to raw reads, including significantly higher total contig counts, more contigs greater than 10k bp in length, and larger total lengths of raw assemblies compared to QC assemblies, and 2.0% lower average contamination of QC MAGs compared to raw MAGs. We also found that differences in the placement of MAGs in species trees increased with decreasing completeness and contamination thresholds. Furthermore, aggressive trimming (Q20) was found to significantly reduce MAG counts. Conclusion: Trimming and decontamination of metagenomics reads prior to assembly can change an investigator’s answer to the questions, “Who is there and what are they doing?” However, mild trimming and decontamination of metagenomic reads with high-quality scores are recommended for removing sample processing and sequencing artifacts.

Whitham, Jason M.↗
DOE OSTI2021

Persistent Homology Metrics Reveal Quantum Fluctuations and Reactive Atoms in Path Integral Dynamics

Nuclear quantum effects (NQEs) are known to impact a number of features associated with chemical reactivity and physicochemical properties, particularly for light atoms and at low temperatures. In the imaginary time path integral formalism, each atom is mapped onto a “ring polymer” whose spread is related to the quantum mechanical uncertainty in the particle’s position, i.e., its thermal wavelength. A number of metrics have previously been used to investigate and characterize this spread and explain effects arising from quantum delocalization, zero-point energy, and tunneling. Many of these shape metrics consider just the instantaneous structure of the ring polymers. However, given the significant interest in methods such as centroid molecular dynamics and ring polymer molecular dynamics that link the molecular dynamics of these ring polymers to real time properties, there exists significant opportunity to exploit metrics that also allow for the study of the fluctuations of the atom delocalization in time. Here we consider the ring polymer delocalization from the perspective of computational topology, specifically persistent homology, which describes the 3-dimensional arrangement of point cloud data, (i.e. atomic positions). We employ the Betti sequence probability distribution to define the ensemble of shapes adopted by the ring polymer. The Wasserstein distances of Betti sequences adjacent in time are used to characterize fluctuations in shape, where the Fourier transform and associated principal components provides added information differentiating atoms with different NQEs based on their dynamic properties. We demonstrate this methodology on two representative systems, a glassy system consisting of two atom types with dramatically different de Broglie thermal wavelengths, and ab initio molecular dynamics simulation of an aqueous 4 M HCl solution where the H-atoms are differentiated based on their participation in proton transfer reactions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Can Simple Metrics Identify the Process(es) Driving Extreme Precipitation?

This work seeks an automatic algorithm to determine the primary meteorological cause(s) of individual extreme precipitation events. Such determinations have been made before, but required a by-hand analysis of each separate event. This is very time-consuming and the field would benefit from an automatic process. This is especially relevant when comparing different datasets to determine which ones most closely hew towards reality. This paper tests three simple metrics over the continental United States using the European Center for Medium-Range Weather Forecasting’s (ECMWF) atmospheric reanalysis (ERA5). The metrics tested measure and compare the strength of three meteorological processes associated with extreme precipitation: fronts, convection, and cyclones. A multivariate statistical technique as well as individual case studies show evidence that the three meteorological processes of interest cannot be isolated from one another using these simple physical metrics. This shows the difficulty in finding “pure” cases of these precipitation-generating processes and suggests approaching these processes with an eye toward mixed-type events.

Swenson, Leif M. (ORCID:0000000199708735)↗