Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

Historical Examination of the ASTM Standard E722 1-MeV Silicon Equivalent Fluence Metric

ASTM Committee E10 on Nuclear Technology and Applications develops and maintains many standards that are relevant to the radiation metrology activities in Sandia National Laboratories' Radiation and Electrical Sciences Center. This is particularly true for the reactor facilities and Subcommittee E10.07 on Radiation Dosimetry for Radiation Effects on Materials and Devices. In the past decade, Subcommittee E10.07 has been making substantive changes to the standard widely used to assess radiation hardness to neutron effects in electronics, E722 – Standard Practice for Characterking Neutron Fluence Spectra in Terms of an Equivalent Monoenergetic Neutron Fluence for Radiation-Hardness Testing of Electronics . ASTM Standard E722 describes the method that defines the 1-MeV silicon and the 1-MeV gallium arsenide equivalent fluence radiation damage metrics. An evaluation of the impact of changes to the shape of the 1-MeV silicon equivalent fluence radiation damage metric from the 1985 version (E722-85) to the most recent version (E722-19) is performed.

36 MATERIALS SCIENCE↗

Transactive System: Part II: Analysis of Two Pilot Transactive Systems using Foundational Theory and Metrics

This document is the second of a two-part report. Part 1 reviewed several demonstrations of transactive control and compared them in terms of their payoff functions, control decisions, information privacy, and mathematical solution concepts. It was suggested in Part 1 that these four listed components should be adopted for meaningful comparison and design of future transactive systems. Part 2 proposes qualitative and quantitative metrics that will be needed to compare alternative transactive systems. It then uses the analysis and design principles from Part 1 while conducting more in-depth analysis of two transactive demonstrations: the American Electric Power (AEP) gridSMART Demonstration, which used a double-auction market mechanism, and a consensus method like that used in the Pacific Northwest Smart Grid Demonstration. Ultimately, metrics must be devised and used to meaningfully compare alternative transactive systems. One significant contribution of this report is an observation that the decision function used for thermostat control in the AEP gridSMART Demonstration has superior performance if its decision function is recast to more accurately reflect the power that will be used under for thermostatic control under alternative market outcomes.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Applying Compression-Based Metrics to Seismic Data in Support of Global Nuclear Explosion Monitoring

The analysis of seismic data for evidence of possible nuclear explosion testing is a critical global security mission that relies heavily on human expertise to identify and mark seismic signals embedded in background noise. To assist analysts in making these determinations, we adapted two compression distance metrics for use with seismic data. First, we demonstrated that the Normalized Compression Distance (NCD) metric can be adapted for use with waveform data and can identify the arrival times of seismic signals. Then we tested an approximation for the NCD called Sliding Information Distance (SLID), which can be computed much faster than NCD. We assessed the accuracy of the SLID output by comparing it to both the Akaike Information Criterion (AIC) and the judgments of expert seismic analysts. Our results indicate that SLID effectively identifies arrival times and provides analysts with useful information that can aid their analysis process.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Science Resource Office Peer Review and Metrics Factsheet [Slides]

The Science Resource Office-Peer Review and Metrics (SRO-PRM) Team hosts and maintains LANL's central repository for Science, Technology, and Engineering (STE) data. The Team tracks, integrates, analyzes, and reports qualitative and quantitative data measuring performance, quality, impact, and productivity. These metrics are indicators of the effectiveness and impact of STE efforts.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

ARM Data-Oriented Metrics and Diagnostics Package for Climate Model Evaluation

A Python-based metrics and diagnostics package is currently being developed by the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility Infrastructure Team at Lawrence Livermore National Laboratory to facilitate the use of long-term, high-frequency measurements from ARM in evaluating the regional climate simulation of clouds, radiation, and precipitation. This metrics and diagnostics package computes climatological means of targeted climate model simulation and generates tables and plots for comparing the model simulation with ARM observational data.

54 ENVIRONMENTAL SCIENCES↗

Image Analysis: Comparison Metrics

Despite an increased reliance on computational modeling in engineering and physics, graphically comparing computational and experimental results has often been qualitative, via a so-called ‘viewgraph norm’. Image recognition, computer vision and artificial intelligence (AI) are fields of study in themselves and rapidly progressing, but relying on AI to grade image similarity evokes a notion of asking for an expert judgement, which could be seen as an artificial version of the viewgraph norm. It is, therefore, desirable to use simpler metrics which are more tractable and unambiguous, even though they may not be as ‘intelligent.’ In this document, a few metrics are studied by systematically altering an image and their implications are analyzed

97 MATHEMATICS AND COMPUTING↗

Performance Metrics to Evaluate Utility Resilience Investments

In 2019, Sandia National Laboratories (Sandia) contracted Synapse Energy Economics (Synapse) to research the integration of community and electric grid resilience investment planning as part of the Designing Resilient Communities (DRC): A Consequence-Based Approach for Grid Investment project. Synapse produced a series of reports to explore the challenges and opportunities in several key areas, including benefit-cost analysis (BCA), performance metrics, microgrids, and regulatory mechanisms. This report focuses on BCA. BCA is an approach that electric utilities, electric utility regulators, and communities can use to evaluate the costs and benefits of a wide range of grid resilience investments in a comprehensive and consistent way. While BCA is regularly applied to some types of grid investments, application of BCA to grid resilience investments is in the early stages of development. Though resilience is increasingly cited in connection with grid investment proposals and plans, the resilience- related costs and benefits of grid resilience investments are typically not fully identified, infrequently quantified, and almost never monetized. Without complete assessments of costs and benefits, regulators can be hesitant to approve some types of grid resilience investments. This report provides the first application of the framework developed in the 2020 National Standard Practice Manual for Benefit-Cost Analysis of Distributed Energy Resources (NSPM for DERs) to grid resilience investments. We provide guidance on next steps for implementation to enable grid resilience investments to receive due consideration. We suggest developing BCA principles and standards for jurisdiction-specific BCA tests. We also recommend identifying the resilience impacts of the investments and quantification of these impacts by establishing utility performance metrics for resilience. Proactive integration of grid resilience investments into existing regulatory processes and practices can increase the capacity of jurisdictions to respond to and recover from the consequences of extreme events. 1 National Energy Screening Project. 2020. National Standard Practice Manual for Benefit-Cost Analysis of Distributed Energy Resources.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Cumulative χ 2 Metric for VALID for ENDF/B-VII.1 and ENDF/B-VIII.0 in SCALE 6.3b9 [Slides]

Quantifying the performance of a new evaluation is difficult and doing so for a new library is significantly more challenging. Cumulative χ 2 metric is an established approach to comparing distributions. In this case, C/E results from different libraries. Andrei Trkov and Roberto Capote have published cumulative χ 2 results for ENDF/B-VIII.0. Cumulative χ 2 metric was recently calculated for VALID library maintained at ORNL.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Quality Control Metrics to Assess MoS 2 Sputtered Films for Tribological Applications [Slides]

Easily measured metrics that could assign quantifiable values to coating batches for quality control have started to be developed. High-density is an attribute of quality films. Increased density results in harder, more wear resistant coatings in inert and humid environments. Denser films are more resistant to oxidation from aging, limiting the severity and depth of oxide into the coating. Future work includes using metrics for quality. The next step is to develop in house deposition capabilities to develop process-structure relationships.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Characterization of Non-Science Grade DESI CCDs and Creating Additional ICARUS Monitoring Metrics

DESI, otherwise known as the Dark Energy Spectroscopic Instrument, is a tool to measure optical spectra from the effects of dark energy on the universe and has been running for 3 years. My work delves into the data taking/analysis side of the DESI CCDs which will help in swapping out broken CCDs on the instrument. Additionally, I worked on making new metrics for ICARUS, Imaging Cosmic and Rare Underground Signals for their monitoring of run data. This paper will talk about the types of characterizations done for DESI and some metrics for data quality and tools used for ICARUS monitoring.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

AMPP-4 Metric Dashboard

The AMPP-4 Metric Dashboard is an interactive tool used for visualizing key performance indicators and milestones for the various teams in the Material Recovery & Recycle (AMPP-4) group. This dashboard provides current group data for FY25 tracking purposes. The dashboard is organized by various chapters: 1) AMPP-4 overview, 2) Scheduling, and 3) individual chapters for each team. AMPP-4 supports 7 teams, where the day- and swing-shift aqueous demolition teams are treated as one team for the purpose of metric tracking. The dashboard is used internally to monitor the success and health of the AMPP-4 teams. Additionally, the dashboard can be used externally to support programmatic reporting to sponsors and aid in future milestone and work package planning.

97 MATHEMATICS AND COMPUTING↗

Assessing the Impact of Large Removable Beryllium Reflector Experiments on HFIR Performance and Safety Metrics

This study investigated the effect of various removable beryllium (RB) experiment configurations on High Flux Isotope Reactor (HFIR) metrics to address increasing interest in these facilities for materials and fuels irradiation research. The RB reflector contains eight large and four small irradiation experiment facilities that offer excellent neutron flux conditions to perform fission and fusion reactor materials and fuels irradiation research. This work aims to outline acceptable RB configurations based on safety, performance, and programmatic metrics. This study assessed experiment effects on reactivity, cycle length, fission rate density distributions, and neutron flux distributions using the Shift, HFIRCON, and SCALE ORIGEN codes. Initial evaluations focused on generic experiment materials including aluminum plugs, stainless steel plugs, molybdenum plugs, and aluminum plugs with gadolinium shields. Subsequent analyses of MiniFuel experiments were performed to evaluate a heterogenous experiment, consisting of a more complex geometry and bearing several materials, and to test the correlations developed with the generic materials on a real experiment. Furthermore, the effects of neutron poison concentrations in the standard beryllium plugs were evaluated. When assuming a reference RB configuration with eight large fresh beryllium plugs, perturbed configurations with three aluminum plugs, one stainless steel plug, one molybdenum plug, one gadolinium-shielded aluminum plug, and one MiniFuel experiment resulted in a cycle length reduction of less than 1.3 days, the current threshold before requiring additional approvals. Configurations with five aluminum plugs, one stainless steel plug, one molybdenum plug, one gadolinium-shielded aluminum plug, and two MiniFuel experiments meet the 1.3 day limit if irradiated beryllium plugs are considered. Fuel element fission rate density distributions remained within safety limits, with maximum local increases under 9%. Neutron flux calculations revealed large thermal flux depressions inside and around the perturbed RB facilities, while epithermal and fast neutron fluxes increased because of reduced neutron moderation by the perturbed materials. These findings provide valuable guidance for optimizing RB configurations to balance safety and performance at HFIR.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

A User-Facing Metric to Quantify the Quality of Mobility (CRADA Final Report)

The leading urban mobility data analytics firm StreetLight Data, Inc. partnered with the National Renewable Energy Laboratory to explore a commercial version of the Mobility Energy Productivity (MEP) metric. The commercialization effort was aimed to expand the adoption of the metric to key stakeholders in the urban planning space. Research comprised industry analysis, stakeholder feedback and conducting transportation practitioner focus groups. StreetLight concluded that commercialization of MEP is not feasible in the current market because users need a dynamic MEP tool that enables scenario planning. It should be able to calculate a MEP score dynamically (near instantaneous) when different inputs are changed.

33 ADVANCED PROPULSION SYSTEMS↗

Integrating the Mobility Energy Productivity Metric Into the Delaware Department of Transportation Statewide Model

The Mobility Energy Productivity (MEP) metric quantifies the quality of mobility at a given location and evaluates how changes in the transportation system impact mobility over time, such as through infrastructure investments. This study demonstrates the integration of the MEP metric into the Delaware Department of Transportation's (DelDOT's) transportation planning process by utilizing data from its statewide travel demand model. Specifically, the study assesses MEP for the 2020 baseline conditions and three alternative scenarios - 2030, Churchman, and Old Orchard - across multiple travel modes, including driving, walking, biking, and transit. The findings highlight that mobility and accessibility in Delaware are primarily supported by the driving mode, while transit services remain relatively limited, often ranking below biking and walking in many areas. In the 2030 scenario, where network operations and opportunities expand as projected, overall statewide accessibility declines, although Kent and Sussex counties experience improvements. The results from the Churchman and Old Orchard scenarios indicate that local network enhancements can positively influence accessibility, though primarily at a localized level, demonstrating MEP's capability to capture regional accessibility changes. Further, the National Renewable Energy Laboratory team successfully transferred MEP operational knowledge to the DelDOT team through dockerization, enabling DelDOT to independently run MEP for various scenarios of interest. Integrating MEP into DelDOT's planning framework supports future project evaluations and decision-making by incorporating access to opportunities as a key dimension of transportation system assessment.

33 ADVANCED PROPULSION SYSTEMS↗

PROACTIVE Focus Area 4: Structured Decision Metrics Analysis (Final Report)

A structured decision metrics analysis was developed as one of the tasks under PROACTIVE’s Focus Area 4 (FA4) and used structured decision metrics for processes, items, and facilities (PIF) to determine the efficacy of an M&V system in meeting treaty goals and technical objectives. The method starts with the functional decomposition of a “treaty” with the M&V system overlaid on it. A Functional Decomposition Rubric (FDR) for each PIF is used to determine a score ranging from 0 (weak) to 4 (strong) for assurance, security, and burden. The individual scores are combined to provide an overall Verification System Score (VSS) which assesses the overall verification system’s suitability given goals; scores for each step of the process are also given. The outcome of the evaluation is to identify needs or modifications to the enterprise model, verification system, or proposed testbed capabilities. VeriScore was used to evaluate FA4’s Spiral 0 exercise; those results are included in this report. The VeriScore and FDR framework can also be used in a non-treaty environment, as any goal/objective/method structure will work, thus expanding its applicability beyond traditional arms control structures.

99 GENERAL AND MISCELLANEOUS↗

Mobility Energy Productivity (MEP) Metric: Partnerships, Applications, and Key Enhancements

The Mobility Energy Productivity (MEP) metric is a holistic measure of transportation systems performance that quantifies the ability of individuals to reach destinations in a cost-efficient and energy-efficient manner. This presentation highlights recent partnerships that have advanced the adoption of MEP as a decision-support tool by various agencies, stakeholders, and researchers. Applications include evaluating multimodal accessibility, comparing system-level energy impacts, and informing infrastructure investment strategies. Key enhancements to the metric - such as expanded regional applications and incorporation of emerging technologies - are also discussed. Together, these efforts highlight the potential of MEP to inform data-driven decisions that shape future transportation systems.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗