Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Metric”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Developing and Evaluating Metrics for Demand Flexibility in Buildings: Comparing Simulations and Field Data

Building demand flexibility (DF) has attracted significant attention in recent years among researchers, technology developers and control companies, aggregators, utilities, and many others. There are numerous challenges with today’s electricity systems such as managing peak demand capacity and integrating variable renewables into the grid. Flexible building loads can provide various grid services to help reduce electricity costs, smooth out renewables intermittency and balance supply and demand. Recognizing this, the US DOE is leading the Grid-interactive Efficient Buildings (GEB) initiative which includes research to evaluate the potential, availability and timing of flexible loads. In this paper we present load shed metrics for three building types – medium office, large office and retail store – and compare prototype simulation results with measured data from 12 actual buildings that participated in hot summertime utility demand response (DR) events. The DR strategies included varying zone temperature and reducing light levels. The magnitude of a key DF metric, “demand decrease intensity” (or “shed intensity”) (W/ft2), between the simulation results and field data are similar (14-32% differences) for both mean and median values, though the field data show much larger variation among DR events. The coefficient p-values from linear regression model tests showed that outside air temperature is a significant variable for the whole building shed intensity when the resetting zone temperature strategy is deployed. These findings support the concept of using prototype building simulation to estimate building DF and expanding future simulation research to additional building types and climate zones.

Liu, Jingjing↗

Applying Compression-Based Metrics to Seismic Data in Support of Global Nuclear Explosion Monitoring

The analysis of seismic data for evidence of possible nuclear explosion testing is a critical global security mission that relies heavily on human expertise to identify and mark seismic signals embedded in background noise. To assist analysts in making these determinations, we adapted two compression distance metrics for use with seismic data. First, we demonstrated that the Normalized Compression Distance (NCD) metric can be adapted for use with waveform data and can identify the arrival times of seismic signals. Then we tested an approximation for the NCD called Sliding Information Distance (SLID), which can be computed much faster than NCD. We assessed the accuracy of the SLID output by comparing it to both the Akaike Information Criterion (AIC) and the judgments of expert seismic analysts. Our results indicate that SLID effectively identifies arrival times and provides analysts with useful information that can aid their analysis process.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Science Resource Office Peer Review and Metrics Factsheet [Slides]

The Science Resource Office-Peer Review and Metrics (SRO-PRM) Team hosts and maintains LANL's central repository for Science, Technology, and Engineering (STE) data. The Team tracks, integrates, analyzes, and reports qualitative and quantitative data measuring performance, quality, impact, and productivity. These metrics are indicators of the effectiveness and impact of STE efforts.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

ARM Data-Oriented Metrics and Diagnostics Package for Climate Model Evaluation

A Python-based metrics and diagnostics package is currently being developed by the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility Infrastructure Team at Lawrence Livermore National Laboratory to facilitate the use of long-term, high-frequency measurements from ARM in evaluating the regional climate simulation of clouds, radiation, and precipitation. This metrics and diagnostics package computes climatological means of targeted climate model simulation and generates tables and plots for comparing the model simulation with ARM observational data.

54 ENVIRONMENTAL SCIENCES↗

Image Analysis: Comparison Metrics

Despite an increased reliance on computational modeling in engineering and physics, graphically comparing computational and experimental results has often been qualitative, via a so-called ‘viewgraph norm’. Image recognition, computer vision and artificial intelligence (AI) are fields of study in themselves and rapidly progressing, but relying on AI to grade image similarity evokes a notion of asking for an expert judgement, which could be seen as an artificial version of the viewgraph norm. It is, therefore, desirable to use simpler metrics which are more tractable and unambiguous, even though they may not be as ‘intelligent.’ In this document, a few metrics are studied by systematically altering an image and their implications are analyzed

97 MATHEMATICS AND COMPUTING↗

Performance Metrics to Evaluate Utility Resilience Investments

In 2019, Sandia National Laboratories (Sandia) contracted Synapse Energy Economics (Synapse) to research the integration of community and electric grid resilience investment planning as part of the Designing Resilient Communities (DRC): A Consequence-Based Approach for Grid Investment project. Synapse produced a series of reports to explore the challenges and opportunities in several key areas, including benefit-cost analysis (BCA), performance metrics, microgrids, and regulatory mechanisms. This report focuses on BCA. BCA is an approach that electric utilities, electric utility regulators, and communities can use to evaluate the costs and benefits of a wide range of grid resilience investments in a comprehensive and consistent way. While BCA is regularly applied to some types of grid investments, application of BCA to grid resilience investments is in the early stages of development. Though resilience is increasingly cited in connection with grid investment proposals and plans, the resilience- related costs and benefits of grid resilience investments are typically not fully identified, infrequently quantified, and almost never monetized. Without complete assessments of costs and benefits, regulators can be hesitant to approve some types of grid resilience investments. This report provides the first application of the framework developed in the 2020 National Standard Practice Manual for Benefit-Cost Analysis of Distributed Energy Resources (NSPM for DERs) to grid resilience investments. We provide guidance on next steps for implementation to enable grid resilience investments to receive due consideration. We suggest developing BCA principles and standards for jurisdiction-specific BCA tests. We also recommend identifying the resilience impacts of the investments and quantification of these impacts by establishing utility performance metrics for resilience. Proactive integration of grid resilience investments into existing regulatory processes and practices can increase the capacity of jurisdictions to respond to and recover from the consequences of extreme events. 1 National Energy Screening Project. 2020. National Standard Practice Manual for Benefit-Cost Analysis of Distributed Energy Resources.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Cumulative χ 2 Metric for VALID for ENDF/B-VII.1 and ENDF/B-VIII.0 in SCALE 6.3b9 [Slides]

Quantifying the performance of a new evaluation is difficult and doing so for a new library is significantly more challenging. Cumulative χ 2 metric is an established approach to comparing distributions. In this case, C/E results from different libraries. Andrei Trkov and Roberto Capote have published cumulative χ 2 results for ENDF/B-VIII.0. Cumulative χ 2 metric was recently calculated for VALID library maintained at ORNL.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Quality Control Metrics to Assess MoS 2 Sputtered Films for Tribological Applications [Slides]

Easily measured metrics that could assign quantifiable values to coating batches for quality control have started to be developed. High-density is an attribute of quality films. Increased density results in harder, more wear resistant coatings in inert and humid environments. Denser films are more resistant to oxidation from aging, limiting the severity and depth of oxide into the coating. Future work includes using metrics for quality. The next step is to develop in house deposition capabilities to develop process-structure relationships.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Characterization of Non-Science Grade DESI CCDs and Creating Additional ICARUS Monitoring Metrics

DESI, otherwise known as the Dark Energy Spectroscopic Instrument, is a tool to measure optical spectra from the effects of dark energy on the universe and has been running for 3 years. My work delves into the data taking/analysis side of the DESI CCDs which will help in swapping out broken CCDs on the instrument. Additionally, I worked on making new metrics for ICARUS, Imaging Cosmic and Rare Underground Signals for their monitoring of run data. This paper will talk about the types of characterizations done for DESI and some metrics for data quality and tools used for ICARUS monitoring.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

AMPP-4 Metric Dashboard

The AMPP-4 Metric Dashboard is an interactive tool used for visualizing key performance indicators and milestones for the various teams in the Material Recovery & Recycle (AMPP-4) group. This dashboard provides current group data for FY25 tracking purposes. The dashboard is organized by various chapters: 1) AMPP-4 overview, 2) Scheduling, and 3) individual chapters for each team. AMPP-4 supports 7 teams, where the day- and swing-shift aqueous demolition teams are treated as one team for the purpose of metric tracking. The dashboard is used internally to monitor the success and health of the AMPP-4 teams. Additionally, the dashboard can be used externally to support programmatic reporting to sponsors and aid in future milestone and work package planning.

97 MATHEMATICS AND COMPUTING↗

Assessing the Impact of Large Removable Beryllium Reflector Experiments on HFIR Performance and Safety Metrics

This study investigated the effect of various removable beryllium (RB) experiment configurations on High Flux Isotope Reactor (HFIR) metrics to address increasing interest in these facilities for materials and fuels irradiation research. The RB reflector contains eight large and four small irradiation experiment facilities that offer excellent neutron flux conditions to perform fission and fusion reactor materials and fuels irradiation research. This work aims to outline acceptable RB configurations based on safety, performance, and programmatic metrics. This study assessed experiment effects on reactivity, cycle length, fission rate density distributions, and neutron flux distributions using the Shift, HFIRCON, and SCALE ORIGEN codes. Initial evaluations focused on generic experiment materials including aluminum plugs, stainless steel plugs, molybdenum plugs, and aluminum plugs with gadolinium shields. Subsequent analyses of MiniFuel experiments were performed to evaluate a heterogenous experiment, consisting of a more complex geometry and bearing several materials, and to test the correlations developed with the generic materials on a real experiment. Furthermore, the effects of neutron poison concentrations in the standard beryllium plugs were evaluated. When assuming a reference RB configuration with eight large fresh beryllium plugs, perturbed configurations with three aluminum plugs, one stainless steel plug, one molybdenum plug, one gadolinium-shielded aluminum plug, and one MiniFuel experiment resulted in a cycle length reduction of less than 1.3 days, the current threshold before requiring additional approvals. Configurations with five aluminum plugs, one stainless steel plug, one molybdenum plug, one gadolinium-shielded aluminum plug, and two MiniFuel experiments meet the 1.3 day limit if irradiated beryllium plugs are considered. Fuel element fission rate density distributions remained within safety limits, with maximum local increases under 9%. Neutron flux calculations revealed large thermal flux depressions inside and around the perturbed RB facilities, while epithermal and fast neutron fluxes increased because of reduced neutron moderation by the perturbed materials. These findings provide valuable guidance for optimizing RB configurations to balance safety and performance at HFIR.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

A User-Facing Metric to Quantify the Quality of Mobility (CRADA Final Report)

The leading urban mobility data analytics firm StreetLight Data, Inc. partnered with the National Renewable Energy Laboratory to explore a commercial version of the Mobility Energy Productivity (MEP) metric. The commercialization effort was aimed to expand the adoption of the metric to key stakeholders in the urban planning space. Research comprised industry analysis, stakeholder feedback and conducting transportation practitioner focus groups. StreetLight concluded that commercialization of MEP is not feasible in the current market because users need a dynamic MEP tool that enables scenario planning. It should be able to calculate a MEP score dynamically (near instantaneous) when different inputs are changed.

33 ADVANCED PROPULSION SYSTEMS↗

Integrating the Mobility Energy Productivity Metric Into the Delaware Department of Transportation Statewide Model

The Mobility Energy Productivity (MEP) metric quantifies the quality of mobility at a given location and evaluates how changes in the transportation system impact mobility over time, such as through infrastructure investments. This study demonstrates the integration of the MEP metric into the Delaware Department of Transportation's (DelDOT's) transportation planning process by utilizing data from its statewide travel demand model. Specifically, the study assesses MEP for the 2020 baseline conditions and three alternative scenarios - 2030, Churchman, and Old Orchard - across multiple travel modes, including driving, walking, biking, and transit. The findings highlight that mobility and accessibility in Delaware are primarily supported by the driving mode, while transit services remain relatively limited, often ranking below biking and walking in many areas. In the 2030 scenario, where network operations and opportunities expand as projected, overall statewide accessibility declines, although Kent and Sussex counties experience improvements. The results from the Churchman and Old Orchard scenarios indicate that local network enhancements can positively influence accessibility, though primarily at a localized level, demonstrating MEP's capability to capture regional accessibility changes. Further, the National Renewable Energy Laboratory team successfully transferred MEP operational knowledge to the DelDOT team through dockerization, enabling DelDOT to independently run MEP for various scenarios of interest. Integrating MEP into DelDOT's planning framework supports future project evaluations and decision-making by incorporating access to opportunities as a key dimension of transportation system assessment.

33 ADVANCED PROPULSION SYSTEMS↗

PROACTIVE Focus Area 4: Structured Decision Metrics Analysis (Final Report)

A structured decision metrics analysis was developed as one of the tasks under PROACTIVE’s Focus Area 4 (FA4) and used structured decision metrics for processes, items, and facilities (PIF) to determine the efficacy of an M&V system in meeting treaty goals and technical objectives. The method starts with the functional decomposition of a “treaty” with the M&V system overlaid on it. A Functional Decomposition Rubric (FDR) for each PIF is used to determine a score ranging from 0 (weak) to 4 (strong) for assurance, security, and burden. The individual scores are combined to provide an overall Verification System Score (VSS) which assesses the overall verification system’s suitability given goals; scores for each step of the process are also given. The outcome of the evaluation is to identify needs or modifications to the enterprise model, verification system, or proposed testbed capabilities. VeriScore was used to evaluate FA4’s Spiral 0 exercise; those results are included in this report. The VeriScore and FDR framework can also be used in a non-treaty environment, as any goal/objective/method structure will work, thus expanding its applicability beyond traditional arms control structures.

99 GENERAL AND MISCELLANEOUS↗

Mobility Energy Productivity (MEP) Metric: Partnerships, Applications, and Key Enhancements

The Mobility Energy Productivity (MEP) metric is a holistic measure of transportation systems performance that quantifies the ability of individuals to reach destinations in a cost-efficient and energy-efficient manner. This presentation highlights recent partnerships that have advanced the adoption of MEP as a decision-support tool by various agencies, stakeholders, and researchers. Applications include evaluating multimodal accessibility, comparing system-level energy impacts, and informing infrastructure investment strategies. Key enhancements to the metric - such as expanded regional applications and incorporation of emerging technologies - are also discussed. Together, these efforts highlight the potential of MEP to inform data-driven decisions that shape future transportation systems.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Proposed Critical Thinking Metrics for Power Grid Trainees

The TRS Intro to Critical Thinking for Operational Decision-Making course for power grid operators seeks to help trainees improve their use of critical thinking skills in operation environments. To determine the effectiveness of this training, we have identified 3 categories of evaluation measures: critical thinking metrics, situation awareness (SA) evaluations, and behavioral observations. Critical thinking metrics seek to directly measure trainee’s ability to use critical thinking skills through their verbalized responses to different questions or scenarios. SA will be evaluated during various points throughout simulated exercises completed during the training. SA evaluations aim to determine the level of a trainee’s ability to perceive, comprehend and anticipate events in the operational environment. This construct will be assessed through verbalized responses to questions informed by the Situation Awareness Global Assessment Technique (SAGAT). Behavioral observations capture how trainees use the system, including which simulator displays or windows they use or actions they perform and in what order. These observations help us understand how the critical thinking training may inform operator action. We hypothesize that while these measures are correlated with each other, they provide different perspectives on each trainee’s ability to gain SA and use critical thinking skills in operation environments. By comparing these measures in a pre-assessment and a post-assessment, we can determine how much improvement a trainee gains through the training. These measures may also be used during the training as appropriate. This document specifies these 3 categories of measures, which components of these measures currently seem to be the best candidates to use in the training course, and which parts of the training course is related to each component.

24 POWER TRANSMISSION AND DISTRIBUTION↗