SEARCH · Engineering Papers

Results for “METRICS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Gaussian Process Optimization of Sensitivity-Based Similarity Metrics between New Nuclear Applications and New/Existing Benchmarks

Confidently designing safe, new nuclear criticality experiments requires expert judgement, which could take years of experience. Sensitivity/uncertainty (S/U) analysis can be utilized by less experienced individuals to conservatively estimate uncertainties in important parameters, such as k eff , in newly proposed nuclear applications. This type of analysis relies on matching new nuclear applications with existing benchmark experiments. The Whisper-1.1 software package included in MCNP6.2 ®1 contains more than 1,100 International Criticality Safety Benchmark Evaluation Project (ICSBEP) benchmarks. These benchmarks however rarely match new nuclear applications. The number of benchmarks available to match a given set of materials or geometric configurations varies significantly. Furthermore, recently performed benchmark experiments may not have had enough time to be properly documented and published. Benchmarks are vital for determining the accuracy of nuclear data and can assist nuclear physics and evaluators in improving nuclear data libraries. Exhaustively exploring the parameter space using simulations with software such as MCNP is too computationally expensive. In this work, Gaussian process optimization was implemented to reduce the number of simulations needed for optimization over multiple parameters. This optimization scheme was designed to selectively generate new benchmarks with high sensitivity-based similarity metrics to user-defined nuclear applications. Two benchmark models of spherically nested shells containing plutonium, uranium, tantalum, and water were used in the optimization to match an application containing plutonium plates, stacked in a tantalum reflector, surrounded by water.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2023

LTE-P-19 Comparison Metrics and Terms for Low Temperature Electrolysis

Defines a standard set of definitions, metrics, units, and conventions for low temperature electrolysis (LTE). The goal is to ensure that the literature is consistent from research group to research group, and data is reported in similar formats, such that results can be compared on a similar basis.

Electryolyzer↗

DOE OSTI2020

Developing Metrics to Evaluate the Skill and Credibility of Downscaling

In this project, our overarching goal was to evaluate the skill and credibility of statistical and dynamical downscaling techniques for reconstructing the historical climate record and projecting future climate change. This report summarizes our approach and accomplishments. In the first year of the project, the priority was to generate new data sets. For Year 2, the overall goal was to focus comparisons during the historical period and for a subset of variables, especially temperature and precipitation. In Year 3 and beyond, the focus was mainly on comparisons and metrics for future climate change simulations. To quantify the uncertainty associated with gridded dataset choice, the UCLA group compared eight gridded temperature datasets, examining climatologies, variability, and trends. The Scripps group completed statistical downscaling of NARR with the LOCA method, and UCLA and Scripps collaborated on a comparison of historical and end-of-century temperature and precipitation patterns over California from WRF, LOCA-WRF, and LOCA-Livneh. In addition to downscaling temperature and precipitation, the Scripps group has spent considerable time working on near-surface wind and humidity downscaling. The Santa Clara group assembled the Variable Infiltration Capacity (VIC) for nine snow-dominated river basins draining the western slopes of the Sierra Nevada range and assessed the role of snow albedo feedback in their VIC simulations. The results will help inform future downscaling studies.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Developing Metrics to Evaluate the Skill and Credibility of Downscaling (Final Report)

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

LDMS-GPU: Lightweight Distributed Metric Service (LDMS) for NVIDIA GPGPUs

GPUs are now a fundamental accelerator for many high-performance computing applications. They are viewed by many as a technology facilitator for the surge in fields like machine learning and Convolutional Neural Networks. To deliver the best performance on a GPU, we need to create monitoring tools to ensure that we optimize the code to get the most performance and efficiency out of a GPU. Since NVIDIA GPUs are currently the most commonly implemented in HPC applications and systems, NVIDIA tools are the solution for performance monitoring. The Light-Weight Distributed Metric System (LDMS) at Sandia is an infrastructure widely adopted for large-scale systems and application monitoring. Sandia has developed CPU application monitoring capability within LDMS. Therefore, we chose to develop a GPU monitoring capability within the same framework. In this report, we discuss the current limitations in the NVIDIA monitoring tools, how we overcame such limitations, and present an overview of the tool we built to monitor GPU performance in LDMS and its capabilities. Also, we discuss our current validation results. Most of the performance counter results are the same in both vendor tools and our tool when using LDMS to collect these results. Furthermore, our tool provides these statistics during the entire runtime of the tool as a time series and not just aggregate statistics at the end of the application run. This allows the user to see the progress of the behavior of the applications during their lifetime.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Distributed Wind Resilience Metrics for Electric Energy Delivery Systems: Comprehensive Literature Review

While most people have a general concept of what it means to be “resilient,” an examination of definitions from different sources reveals that there are key commonalities but key differences as well. The lack of a generally accepted definition and application of resilience extends to electric energy delivery systems. Without an accepted definition, it is difficult to implement programs or processes to improve resiliency. In this paper, existing work from industry, regulatory bodies, and national laboratories to define and apply resilience to electric energy delivery systems is studied to understand the key components to define resilience and better understand associated metrics. This understanding is then applied to distributed wind for a specific example of how resilience of a system is affected by the technologies and generation sources used to support it. A key finding is that there is no “one size fits all” process for resilience. Each system has a “distinctiveness” characteristic, which qualifies the possibility of differences in resilience due to different threats, geography, stakeholders, risk tolerance, and mitigations. The distinctiveness characteristic extends to distributed wind, where different configurations may lend the distributed wind to contribute to the resilience of systems in a variety of ways. The findings of this research demonstrate the need for a resilience framework that can be readily applied by stakeholders to improve resilience based on the specific system, threat, risk tolerance and stakeholders.

17 WIND ENERGY↗

DOE OSTI2022

GaAs Neutron Response Functions and Radiation Damage Metrics

The radiation effects community needs clear, well-documented, neutron energy-dependent responses that can be used in assessing radiation-induced material damage to GaAs semiconductors and for correlating observed radiation-induced changes in the GaAs electronic properties with computed damage metrics. In support of the objective, this document provides: a) a clearly defined set of relevant neutron response functions for use in dosimetry applications; b) clear mathematical expressions for the defined response functions; and c) updated quantitative values for the energy- dependent response functions that reflect the best current nuclear data and modelling. This document recaps the legacy response functions. It then surveys the latest nuclear data and updates the recommended response function to support current GaAs damage studies. A detailed tabulation for six of the energy-dependent response functions is provided in an Appendix.

36 MATERIALS SCIENCE↗

DOE OSTI2022

Empirical Performance Analysis of HPC Applications with Portable Hardware Counter Metrics [Thesis]

In this dissertation, we demonstrate that it is possible to develop methods of empirical hardware-counter-based performance analysis for scientific applications running on diverse types of CPUs. Although hardware counters have been used in performance analysis for at least 30 years, the methods used are still limited to particular CPU vendors or even particular generations of CPUs from the same vendor. Our motivating hypothesis is that hardware counter-based measurements could be developed to provide consistent performance information on diverse CPU types. This dissertation proves the hypothesis was correct by demonstrating one such set of metrics.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Graph-Based Similarity Metrics for Comparing Simulation Model Causal Structures

The causal structure of a simulation is a major determinant of both its character and behavior, yet most methods we use to compare simulations focus only on simulation outputs. We introduce a method that combines graphical representation with information theoretic metrics to quantitatively compare the causal structures of models. The method applies to agent-based simulations as well as system dynamics models and facilitates comparison within and between types. Comparing models based on their causal structures can illuminate differences in assumptions made by the models, allowing modelers to (1) better situate their models in the context of existing work, including highlighting novelty, (2) explicitly compare conceptual theory and assumptions to simulated theory and assumptions, and (3) investigate potential causal drivers of divergent behavior between models. We demonstrate the method by comparing two epidemiology models at different levels of aggregation.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Developing and applying quantifiable metrics for diagnostic and experiment design on Z

This project applies methods in Bayesian inference and modern statistical methods to quantify the value of new experimental data, in the form of new or modified diagnostic configurations and/or experiment designs. We demonstrate experiment design methods that can be used to identify the highest priority diagnostic improvements or experimental data to obtain in order to reduce uncertainties on critical inferred experimental quantities and select the best course of action to distinguish between competing physical models. Bayesian statistics and information theory provide the foundation for developing the necessary metrics, using two high impact experimental platforms on Z as exemplars to develop and illustrate the technique. We emphasize that the general methodology is extensible to new diagnostics (provided synthetic models are available), as well as additional platforms. We also discuss initial scoping of additional applications that began development in the last year of this LDRD.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

AI-Assisted Conceptual Development of a Pre-Geometric Cosmological Model - An Exercise in AI-Assisted Conceptual Framework Generation, Paper II: Local Geometry and Metric Structure

This paper develops the geometric sector of the replication-driven cosmogenesis framework introduced in Paper I. Starting from a pre-geometric spectral substrate and a minimal set of replication axioms, we show how coherent self-replicating units generate a spatial adjacency graph whose continuum limit acquires an effective Riemannian structure. The replication dynamics determines a characteristic correlation length that seeds the local metric, while overlap relations among coherent units produce an isotropic neighborhood geometry with an emergent dimensionality $d_{\rm eff}\simeq 3$ across a broad range of replication factors. As replication slows and causal order stabilizes, a limiting signal speed $c_\ast$ appears, providing the basis for the Lorentzian structure of spacetime without assuming a pre-existing light cone. We derive conditions under which the adjacency graph converges to a smooth three-dimensional manifold, describe the transition from Euclidean to Lorentzian propagation, and identify geometric invariants controlled by the replication parameters. This work establishes the geometric and causal layer of the replication cosmogenesis program, bridging the spectral axioms of Paper I to the cosmological dynamics explored in Paper III.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2024

DOE BSSD Performance Management Metrics Report Q2

The vision of the National Microbiome Data Collaborative (NMDC) centers on the concept of connecting data, people, and ideas to advance microbiome innovation and discovery. Building data infrastructure, while key to NMDC’s ability to execute on our vision, can only go so far in creating scientific impact. By fostering strong community partnerships and developing a set of robust community outreach and training programs, we are able to turn our products – the Submission Portal, NMDC EDGE, and the Data Portal – into tools that empower the scientific community. Our multi-pronged community building approach spans individual researchers, research teams, consortia and scientific societies, and institutions and federal agencies. To foster a collaborative and inclusive community-centered environment, we have identified three strategic objectives to promote an inclusive and connected community: (1) recognize and support the diverse research needs and perspectives of the microbiome research community; (2) promote best practices across the microbiome community, from researchers to funders, through community-driven practices (FAIR, CARE, and TRUST); and (3) build a microbiome ecosystem that enables scientific discovery and innovation across stakeholders. These strategic objectives allow our team to focus on impact across a diverse range of activities, from launching the American Society for Microbiology (ASM) Microbiome Data Prize to supporting the Ambassador and Champions programs fostering learning and building a collaborative network. We broadly communicate our work through social media (X/Twitter, LinkedIn, and Instagram), The Microbiome Standard (our quarterly newsletter), and Annual Reports. All our work is underpinned by a strong commitment to diversity, equity, and inclusion as articulated in our Action Plan that tracks progress towards key metrics. A core component of our engagement strategy is user research. User research ensures the Submission Portal, NMDC EDGE, Data Portal, and the new Field Notes mobile app are designed with and for the scientific community. Our user research efforts consist of asking researchers exploratory questions to collect information on researcher priorities, methodologies, and perceptions to ensure that we are aware of the current state of microbiome research. Our usability testing provides researchers with prototypes or test environments of the NMDC products, and we capture valuable information on how users interact with the products to make improvements. Given the diverse nature of microbiome work, we acknowledge that we are not aware of all pressing data challenges and thus rely on the research community to help us identify the most important issues to prioritize. To date, we have conducted 24 interviews and one beta-testing call with 10 participants across all NMDC products, which have generated 321 insights and 120 action items. Herein, we describe the ways we engage with the microbiome research community to advance the NMDC mission.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2023

Rapid identification of enteric bacteria from whole genome sequences using average nucleotide identity metrics

Identification of enteric bacteria species by whole genome sequence (WGS) analysis requires a rapid and an easily standardized approach. We leveraged the principles of average nucleotide identity using MUMmer (ANIm) software, which calculates the percent bases aligned between two bacterial genomes and their corresponding ANI values, to set threshold values for determining species consistent with the conventional identification methods of known species. The performance of species identification was evaluated using two datasets: the Reference Genome Dataset v2 (RGDv2), consisting of 43 enteric genome assemblies representing 32 species, and the Test Genome Dataset (TGDv1), comprising 454 genome assemblies which is designed to represent all species needed to query for identification, as well as rare and closely related species. The RGDv2 contains six Campylobacter spp., three Escherichia/Shigella spp., one Grimontia hollisae, six Listeria spp., one Photobacterium damselae, two Salmonella spp., and thirteen Vibrio spp., while the TGDv1 contains 454 enteric bacterial genomes representing 42 different species. The analysis showed that, when a standard minimum of 70% genome bases alignment existed, the ANI threshold values determined for these species were ≥95 for Escherichia/Shigella and Vibrio species, ≥93% for Salmonella species, and ≥92% for Campylobacter and Listeria species. Using these metrics, the RGDv2 accurately classified all validation strains in TGDv1 at the species level, which is consistent with the classification based on previous gold standard methods.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2021

Development and Application of Schema Based Occupant-Centric Building Performance Metrics

Occupant behavior can significantly influence the operation and performance of buildings. Many occupant-centric key performance indicators (KPIs) rely on having accurate counts of the number of occupants in a building, which is very different to how occupancy information is currently collected in the majority of buildings today. To address this gap, the authors develop a standardized methodology for the calculation of percent space utilization for buildings, which is formulated with respect to two prevalent operational data schemas: the Brick Schema and Project Haystack. The methodology is scalable across different levels of spatial granularity and irrespective of sensor placement. Moreover, the methods are intended to make use of typical occupancy sensors that capture presence level occupancy and not counts of people. Since occupant-hours is a preferable metric to use in KPI calculations, a method to convert between percent space utilization and occupant-hours using the design occupancy for a space is also developed. The methodology is demonstrated on a small commercial office space in Boulder, Colorado using data collected between June 2018 and February 2019. A multiple linear regression is performed that shows strong evidence for a relationship between building energy consumption and percent space utilization.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2024

Battery Energy Storage Systems: A Review of Energy Management Systems and Health Metrics

With increasing concerns about climate change, there is a transition from high-carbon-emitting fuels to green energy resources in various applications including household, commercial, transportation, and electric grid applications. Even though renewable energy resources are receiving traction for being carbon-neutral, their availability is intermittent. To address this issue to achieve extensive application, the integration of energy storage systems in conjunction with these resources is becoming a recommended practice. Additionally, in the transportation sector, the increased demand for EVs requires the development of energy storage systems that can deliver energy for rigorous driving cycles, with lithium-ion-based batteries emerging as the superior choice for energy storage due to their high power and energy densities, length of their life cycle, low self-discharge rates, and reasonable cost. As a result, battery energy storage systems (BESSs) are becoming a primary energy storage system. The high-performance demand on these BESS can have severe negative effects on their internal operations such as heating and catching on fire when operating in overcharge or undercharge states. Reduced efficiency and poor charge storage result in the battery operating at higher temperatures. To mitigate early battery degradation, battery management systems (BMSs) have been devised to enhance battery life and ensure normal operation under safe operating conditions. Some BMSs are capable of determining precise state estimations to ensure safe battery operation and reduce hazards. Precise estimation of battery health is computed by evaluating several metrics and is a central factor in effective battery management systems. In this scenario, the accurate estimation of the health indicators (HIs) of the battery becomes even more important within the framework of a BMS. This paper provides a comprehensive review and discussion of battery management systems and different health indicators for BESSs, with suitable classification based on key characteristics.

Nazaralizadeh, Solmaz (ORCID:0009000737004039)↗

DOE OSTI2024

A Physical Metric for Inertial Confinement Fusion Capsules

The performance of fusion capsules on the National Ignition Facility (NIF) is strongly affected by the physical properties of the hot deuterium–tritium (DT) fuel, such as the mass, areal density, and pressure of the hot spot at the stagnation time. All of these critical quantities depend on one measured quantity, which is the ratio of the specific peak implosion energy to the specific internal energy of the hot spot. This unique physical quantity not only can measure the incremental progress of the inertial confinement fusion capsules towards ignition but also measures the conversion of the peak implosion kinetic energy of the pusher shell into the internal energy of the hot fuel in a capsule. Analysis of existing NIF shots to date are performed. The ratio metric is compared quantitatively with the ignition criterion. Results provide new perspectives on the NIF experiments by which the performance of the burning plasma can be determined and controlled through the fine tune of the implosion parameters, which improves future designs and predictions of the ignition capsules.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2020

Atmospheric condition identification in multivariate data through a metric for total variation

Identification of atmospheric conditions within a multivariable atmospheric data set is a necessary step in the validation of emerging and existing high-fidelity models used to simulate wind plant flows and operation.Atmospheric conditions relevant for wind energy research include stationary conditions, given the need for well-converged statistics for model validation, as well as conditions observed less frequently, such as extreme atmospheric events, which are used in wind turbine and wind plant design.Aggregation of observations without regard to covariance between time series discounts the dynamical nature of the atmosphere and is not sufficiently representative of atmospheric conditions.Identification and characterization of continuous time periods with atmospheric conditions that have a high value for analysis or simulation set the stage for more advanced model validation and the development of real-time control and operational strategies.The current work explores a single metric for variation in a multivariate data sample that quantifies variability within each channel as well as covariance between channels.The total variation is used to identify conditions of interest that conform to desired objective functions, such as stationary conditions, ramps or waves of wind speed, and changes in wind direction.Total variation is somewhat sensitive to the presence of outliers in the input data, and the method is best complemented by quality-control procedures to ensure reliable results.The direct detection and classification of events or conditions of interest within atmospheric data sets is vital to developing our understanding of wind plant response and to the formulation of forecasting and control models.

17 WIND ENERGY↗

DOE OSTI2022

Metrics for Intercomparison of Remapping Algorithms (MIRA) protocol applied to Earth system models

Abstract. Strongly coupled nonlinear phenomena such as those described by Earth system models (ESMs) are composed of multiple component models with independent mesh topologies and scalable numerical solvers. A common operation in ESMs is to remap or interpolate component solution fields defined on their computational mesh to another mesh with a different combinatorial structure and decomposition, e.g., from the atmosphere to the ocean, during the temporal integration of the coupled system. Several remapping schemes are currently in use or available for ESMs. However, a unified approach to compare the properties of these different schemes has not been attempted previously. We present a rigorous methodology for the evaluation and intercomparison of remapping methods through an independently implemented suite of metrics that measure the ability of a method to adhere to constraints such as grid independence, monotonicity, global conservation, and local extrema or feature preservation. A comprehensive set of numerical evaluations is conducted based on a progression of scalar fields from idealized and smooth to more general climate data with strong discontinuities and strict bounds. We examine four remapping algorithms with distinct design approaches, namely ESMF Regrid (Hill et al., 2004), TempestRemap (Ullrich and Taylor, 2015), generalized moving least squares (GMLS) (Trask and Kuberry, 2020) with post-processing filters, and WLS-ENOR (Li et al., 2020). By repeated iterative application of the high-order remapping methods to the test fields, we verify the accuracy of each scheme in terms of their observed convergence order for smooth data and determine the bounded error propagation using challenging, realistic field data on both uniform and regionally refined mesh cases. In addition to retaining high-order accuracy under idealized conditions, the methods also demonstrate robust remapping performance when dealing with non-smooth data. There is a failure to maintain monotonicity in the traditional L2-minimization approaches used in ESMF and TempestRemap, in contrast to stable recovery through nonlinear filters used in both meshless GMLS and hybrid mesh-based WLS-ENOR schemes. Local feature preservation analysis indicates that high-order methods perform better than low-order dissipative schemes for all test cases. The behavior of these remappers remains consistent when applied on regionally refined meshes, indicating mesh-invariant implementations. The MIRA intercomparison protocol proposed in this paper and the detailed comparison of the four algorithms demonstrate that the new schemes, namely GMLS and WLS-ENOR, are competitive compared to standard conservative minimization methods requiring computation of mesh intersections. The work presented in this paper provides a foundation that can be extended to include complex field definitions, realistic mesh topologies, and spectral element discretizations, thereby allowing for a more complete analysis of production-ready remapping packages.

58 GEOSCIENCES↗