Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51

Resilience Metrics and Framework for Distributed Wind Presentation

This presentation communicates information about the MIRACL project Resilience Metrics report and Resilience Framework report. It was created for the 2021 MIRACL advisory board meeting. We propose a three-tiered approach for the resilience framework. At the top level, we consider the time horizons on which resilience will be evaluated and executed. At the middle level, we consider the core functions of resilience, which span across the time horizons. At the lower level, we consider the process steps that correspond to implementing practices for resilience in each of the core functions. The framework considers three time horizons in order to enable organizations to assess and improve their system’s resilience throughout its lifecycle. We call these time horizons the planning, operational, and future stages. The planning stage uses organizational needs and current system evaluation to prepare for potential hazards. The operational stage seeks to execute responses to hazards as prudently and efficiently as possible to maintain system resilience. The future stage seeks to improve on current system resilience and feeds back into the planning stage to promote continuous improvement. While all three time horizons are important when considering a specific topic, the planning and evaluation phase (i.e., what is done in advance of the event) is critical in defining a system’s resilience characteristics and in outlining how a system responds to an event. This framework intentionally emphasizes the planning stage to highlight the overarching emphasis of this effort, not to imply that the other two time-related horizons (i.e., operational and change the future) are less important. The core functions in the framework are identify, prepare, detect, adapt, and recover. These five functions stem from a rigorous analysis of definitions used across the industry, and they represent the core capabilities that an organization must have to enable lifecycle resilience. Within each core function, process steps are described that help walk an organization through the information gathering, evaluation, decision-making, and implementation processes they will need to ensure their resilience goals are maintained throughout the system and the system lifecycle. Also highlighted in the figure is the concept that a resilience framework should be cyclical in nature. Because a system’s resilience is based on finite resources and time, it must continually evolve through this framework’s risk management and capital investment steps at an appropriate level of scope and pace.

17 WIND ENERGY↗

Integer Sequences from Configurations in the Hausdorff Metric Geometry via Edge Covers of Bipartite Graphs

The Hausdorff metric provides a way to measure the distance between nonempty compact sets in $\mathbb{R}^N$, from which we can build a geometry of sets. This geometry is very different than the standard Euclidean geometry and provides many interesting results. In this paper we focus on line segments in this geometry, where pairs of disjoint sets $A$ and $B$ satisfying certain distance conditions have the property that there are exactly $m$ different sets on the line segment $\overline{AB}$ at every distance from $A$, where $m$ can assume many values different than one. We provide new families of sets that generate previously unrecorded integer sequences via these values of $m$ by connecting the values of $m$ to the number of edge coverings of a graph corresponding to the sets $A$ and $B$.

97 MATHEMATICS AND COMPUTING↗

Prioritizing Off-gas Metrics

Off-gas research within the Material Recovery and Waste Form Development (MRWFD) team is dispersed among four national laboratories and multiple universities and small businesses. Ensuring research is conducted consistently and in a manner conducive to direct comparison is a nontrivial task. The team assembled to realign goals and expectations by identifying distinct R&D phases, prioritizing crucial metrics, and outlining standardized tests specifically associated with Kr, Xe, and I capture.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Metrics correlation and analysis service (MCAS)

The complexity of Grid workflow activities and their associated software stacks inevitably involves multiple organizations, ownership, and deployment domains. In this setting, important and common tasks such as the correlation and display of metrics and debugging information (fundamental ingredients of troubleshooting) are challenged by the informational entropy inherent to independently maintained and operated software components. Because such an information 'pond' is disorganized, it a difficult environment for business intelligence analysis i.e. troubleshooting, incident investigation and trend spotting. The mission of the MCAS project is to deliver a software solution to help with adaptation, retrieval, correlation, and display of workflow-driven data and of type-agnostic events, generated by disjoint middleware.

99 GENERAL AND MISCELLANEOUS↗

Proceedings of the 2009 Performance Metrics for Intelligent Systems Workshop

The Performance Metrics for Intelligent Systems (PerMIS) workshop is dedicated to defining measures and methodologies of evaluating performance of intelligent systems. As the only workshop of its kind, PerMIS has proved to be an excellent forum for sharing lessons learned and discussions as well as fostering collaborations between researchers and practitioners from industry, academia and government agencies. The main theme of the ninth iteration of the workshop, PerMIS'09, seeks to address the question: 'Does performance measurement accelerate the pace of advancement for intelligent systems?' In addition to the main theme, as in previous years, the workshop will focus on applications of performance measures to practical problems in commercial, industrial, homeland security, and military applications. The PerMIS'09 program consists of six plenary addresses and six general and special sessions. The topics that are to be discussed by the speakers cover a wide array of themes centered on many intricate facets of intelligent system research. The presentations will emphasize and showcase the interdisciplinary nature of intelligent systems research and why it is not straightforward to evaluate such interconnected system of systems. The three days of twelve sessions will span themes from manufacturing, mobile robotics, human-system interaction, theory of mind, testing and evaluation of unmanned systems, to name a few.

42 ENGINEERING↗

PROGRESS TOWARDS NEXT GENERATION, WAVEFORM BASED THREE-DIMENSIONAL MODELS AND METRICS TO IMPROVE NUCLEAR EXPLOSION MONITORING IN THE MIDDLE EAST

Efforts to update current wave speed models of the Middle East require a thoroughly tested database of sources and recordings. Recordings of seismic waves traversing the region from Tibet to the Red Sea will be the principal metric in guiding improvements to the current wave speed model. Precise characterizations of the earthquakes, specifically depths and faulting mechanisms, are essential to avoid mapping source errors into the refined wave speed model. Errors associated with the source are manifested in amplitude and phase changes. Source depths and paths near nodal planes are particularly error prone as small changes may severely affect the resulting wavefield. Once sources are quantified, regions requiring refinement will be highlighted using adjoint tomography methods based on spectral element simulations [Komatitsch and Tromp (1999)]. An initial database of 250 regional Middle Eastern events from 1990-2007, was inverted for depth and focal mechanism using teleseismic arrivals [Kikuchi and Kanamori (1982)] and regional surface and body waves [Zhao and Helmberger (1994)]. From this initial database, we reinterpreted a large, well recorded subset of 201 events through a direct comparison between data and synthetics based upon a centroid moment tensor inversion [Liu et al. (2004)]. Evaluation was done using both a 1D reference model [Dziewonski and Anderson (1981)] at periods greater than 80 seconds and a 3D model [Kustowski et al. (2008)] at periods of 25 seconds and longer. The final source reinterpretations will be within the 3D model, as this is the initial starting point for the adjoint tomography. Transitioning from a 1D to 3D wave speed model shows dramatic improvements when comparisons are done at shorter periods, (25 s). Synthetics from the 1D model were created through mode summations while those from the 3D simulations were created using the spectral element method. To further assess errors in source depth and focal mechanism, comparisons between the three methods were made. These comparisons help to identify problematic stations and sources which may bias the final solution. Estimates of standard errors were generated for each event's source depth and focal mechanism to identify poorly constrained events. A final, well characterized set of sources and stations will be then used to iteratively improve the wave speed model of the Middle East. After a few iterations during the adjoint inversion process, the sources will be reexamined and relocated to further reduce mapping of source errors into structural features. Finally, efforts continue in developing the infrastructure required to 'quickly' generate event kernels at the n-th iteration and invert for a new, (n+1)-th, wave speed model of the Middle East. While development of the infrastructure proceeds, initial tests using a limited number of events shows the 3D model, while showing vast improvement compared to the 1D model, still requires substantial modifications. Employing our new, full source set and iterating the adjoint inversions at successively shorter periods will lead to significant changes and refined wave speed structures of the Middle East.

58 GEOSCIENCES↗

Power-Capping Metric Evaluation for Improving Energy Efficiency in HPC Applications

With high-performance computing systems now running at exascale, optimizing power-scaling management and resource utilization has become more critical than ever. This paper explores runtime power-capping optimizations that leverage integrated CPU-GPU power management on architectures like the NVIDIA GH200 superchip. We evaluate energy-performance metrics that account for simultaneous CPU and GPU power-capping effects by using two complementary approaches: speedup-energy-delay and a Euclidean distance-based multi-objective optimization method. By targeting a mostly compute-bound exascale science application, the Locally Self-Consistent Multiple Scattering (LSMS), we explore challenging scenarios to identify potential opportunities for energy savings in exascale applications, and we recognize that even modest reductions in energy consumption can have significant overall impacts. Our results highlight how GPU task-specific dynamic power-cap adjustments combined with integrated CPU-GPU power steering can improve the energy utilization of certain GPU tasks, thereby laying the groundwork for future adaptive optimization strategies.

Patrou, Maria [ORNL] (ORCID:0000000339754638)↗

Jet rotational metrics

Abstract Embedding symmetries in the architectures of deep neural networks can improve classification and network convergence in the context of jet substructure. These results hint at the existence of symmetries in jet energy depositions, such as rotational symmetry, arising from the physical features of the underlying processes. We introduce new jet observables, Jet Rotational Metrics (JRMs), which provide insights into the substructure of jets by comparing them to jets with perfect discrete rotational symmetry. We show that JRMs are formidable jet features, achieving good classification scores when used as inputs to deep neural networks. We also show that when used in combination with other jet observables, like N-subjettiness and EFPs, our features increase classification performance. The results suggest that JRMs may capture information not efficiently captured by the other observables, motivating the design of future jet observables for learning the underlying symmetries in the physical processes.

Physics↗

Sensitivity of Multi-gas Climate Policy to Emission Metrics

Multi-gas greenhouse emission targets require that different emissions be combined into an aggregate total. The Global Warming Potential (GWP) index is currently used for this purpose, despite various criticisms of the underlying concept. It is not possible to uniquely define a single metric that perfectly captures the different impacts of emissions of substances with widely disparate atmospheric lifetimes, which leads to a wide range of possible index values. We examine the sensitivity of emissions and climate outcomes to the value of the index used to aggregate methane emissions using a technologically detailed integrated assessment model. We find that the sensitivity to index value is of order 4-14% in terms of methane emissions and 2% in terms of total radiative forcing, using index values between 4 and 70 for methane, with larger regional differences in some cases. The sensitivity to index value is much higher in economic terms, with total 2-gas mitigation cost decreasing 4-5% for a lower index and increasing 10-13% for a larger index, with even larger changes if the emissions reduction targets are small. The sensitivity to index value also depends on the assumed maximum amount of mitigation available in each sector. Evaluation of the maximum mitigation potential for major sources of non-CO2 greenhouse gases would greatly aid analysis

Smith, Steven J↗

Comparative hazard analysis and toxicological modeling of diverse nanomaterials using the embryonic zebrafish (EZ) metric of toxicity

The integration of rapid assays, large data sets, informatics and modeling can overcome current barriers in understanding nanomaterial structure-toxicity relationships by providing a weight-of-the-evidence mechanism to generate hazard rankings for nanomaterials. Here we present the use of a rapid, low-cost assay to perform screening-level toxicity evaluations of nanomaterials in vivo. Calculated EZ Metric scores, a combined measure of morbidity and mortality, were established at realistic exposure levels and used to develop a predictive model of nanomaterial toxicity. Hazard ranking and clustering analysis of 68 diverse nanomaterials revealed distinct patterns of toxicity related to both core composition and outermost surface chemistry of nanomaterials. The resulting clusters guided the development of a predictive model of gold nanoparticle toxicity to embryonic zebrafish. In addition, our findings suggest that risk assessments based on the size and core composition of nanomaterials alone may be wholly inappropriate, especially when considering complex engineered nanomaterials. These findings reveal the need to expeditiously increase the availability of quantitative measures of nanomaterial hazard and broaden the sharing of that data and knowledge to support predictive modeling. In addition, research should continue to focus on methodologies for developing predictive models of nanomaterial hazard based on sub-lethal responses to low dose exposures.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Computer Model Calibration Based on Image Warping Metrics: An Application for Sea Ice Deformation

Arctic sea ice plays an important role in the global climate. Sea ice models governed by physical equations have been used to simulate the state of the ice including characteristics such as ice thickness, concentration, and motion. More recent models also attempt to capture features such as fractures or leads in the ice. These simulated features can be partially misaligned or misshapen when compared to observational data, whether due to numerical approximation or incomplete physics. In order to make realistic forecasts and improve understanding of the underlying processes, it is necessary to calibrate the numerical model to field data. Traditional calibration methods based on generalized least-square metrics are flawed for linear features such as sea ice cracks. We develop a statistical emulation and calibration framework that accounts for feature misalignment and misshapenness, which involves optimally aligning model output with observed features using cutting-edge image registration techniques. Here, this work can also have application to other physical models which produce coherent structures.

54 ENVIRONMENTAL SCIENCES↗

Large-scale seismic waveform quality metric calculation using Hadoop

Here in this work we investigated the suitability of Hadoop MapReduce and Apache Spark for large-scale computation of seismic waveform quality metrics by comparing their performance with that of a traditional distributed implementation. The Incorporated Research Institutions for Seismology (IRIS) Data Management Center (DMC) provided 43 terabytes of broadband waveform data of which 5.1 TB of data were processed with the traditional architecture, and the full 43 TB were processed using MapReduce and Spark. Maximum performance of ~0.56 terabytes per hour was achieved using all 5 nodes of the traditional implementation. We noted that I/O dominated processing, and that I/O performance was deteriorating with the addition of the 5th node. Data collected from this experiment provided the baseline against which the Hadoop results were compared. Next, we processed the full 43 TB dataset using both MapReduce and Apache Spark on our 18-node Hadoop cluster. We conducted these experiments multiple times with various subsets of the data so that we could build models to predict performance as a function of dataset size. We found that both MapReduce and Spark significantly outperformed the traditional reference implementation. At a dataset size of 5.1 terabytes, both Spark and MapReduce were about 15 times faster than the reference implementation. Furthermore, our performance models predict that for a dataset of 350 terabytes, Spark running on a 100-node cluster would be about 265 times faster than the reference implementation. We do not expect that the reference implementation deployed on a 100-node cluster would perform significantly better than on the 5-node cluster because the I/O performance cannot be made to scale. Finally, we note that although Big Data technologies clearly provide a way to process seismic waveform datasets in a high-performance and scalable manner, the technology is still rapidly changing, requires a high degree of investment in personnel, and will likely require significant changes in other parts of our infrastructure. Nevertheless, we anticipate that as the technology matures and third-party tool vendors make it easier to manage and operate clusters, Hadoop (or a successor) will play a large role in our seismic data processing.

58 GEOSCIENCES↗

Analytically differentiable metrics for phase stability

Here, in this work, a long-established but sparsely documented method of obtaining semi-analytic derivatives of thermodynamic properties with respect to equilibrium conditions is briefly reviewed and rigorously derived. This procedure is then leveraged to construct general forms of derivatives of the residual driving force, a metric for measuring phase stability used in CALPHAD model optimization, with respect to overall system and individual phase compositions. Applied examples – calculating heat capacity in the Al-Fe system, thermodynamic factors in the Nb-V-W system, and residual driving force derivatives in the Ni-Ti system – demonstrate the versatility, accuracy, and extensibility of this method. Using the developed method, residual driving force gradients can be applied directly in CALPHAD model optimizers, as well as in materials design frameworks, to identify regions of phase stability with an efficient, gradient-based approach.

36 MATERIALS SCIENCE↗

Designing robust energy policy packages under deep uncertainty: A multi-metric decision support framework

The complexity of transitioning to sustainable energy systems requires policy frameworks capable of balancing multiple objectives while addressing deep uncertainty. However, existing approaches often lack systematic methods to identify combinations of policy levers that remain effective across a wide range of uncertain futures. This paper presents a novel decision support framework that guides the selection of robust policy packages based on their performance across multiple objectives under uncertainty. Our method leverages a large ensemble of scenarios and applies scenario discovery techniques to identify influential policy levers. Here, we introduce new indicators to assess the robustness of policies by evaluating their ability to mitigate adverse outcomes across metrics. These indicators support an iterative process to build a robust policy package. Finally, we map the technological and energy pathways associated with the robust policy package by leveraging an energy system optimization model. We illustrate the application of this framework to the Spanish energy system, providing insights into how specific combinations of policy levers shape decarbonization pathways under uncertainty.

Decision-support method↗

Assessing the sensitivity and repeatability of permanganate oxidizable carbon as a soil health metric: An interlab comparison across soils

Soil organic matter is central to the soil health framework. Therefore, reliable indicators of Soil organic matter is central to the soil health framework. Therefore, reliable indicators of changes in soil organic matter are essential to inform land management decisions. Permanganate oxidizable carbon (PDXC), an emerging soil health indicator, has shown promise for being sensitive to soil management. However, strict standardization is required for widespread implementation in research and commercial contexts. Here, we used 36 soils-three from each of the 12 USDA soil orders-to determine the effects of sieve size and soil mass of analysis on PDXC results. Using replicated measurements across 12 labs in the US and the EU (n = 7951 samples), we quantified the relative importance of 1) variation between labs, 2) variation within labs, 3) effect soil mass, and 4) effect of soil sieve size on the repeatability of PDXC. We found a wide range of overall variability in PDXC values across labs (0.03 to 171.8%; mean = 13.4%), and much of this variability was attributable to within-lab variation (median = 6.5%) independently of soil mass or sieve size. Greater soil mass (2.5 g) decreased absolute PDXC values by a mean of 177 mg kg -1 soil and decreased analytical variability by 6.5%. For soils with organic carbon (SOC) >10%, greater soil mass (2.5 g) resulted in more frequent PDXC values above the limit of detection whereas the lower soil mass (0.75 g) resulted in PDXC values below the limit of detection for SOC contents <5%. A finer sieve size increased absolute values of PDXC by 124 mg kg -1 while decreasing the analytical variability by 1.8%. In general, soils with greater SOC contents had lower analytical variability. These results point to potential standardizations of the PDXC protocol that can decrease the variability of the metric. We recommend that the PDXC protocol be standardized to use 2.5 g for soils <10% SOC. Sieve size was a relatively small contributor to analytical variability and therefore we recommend that this decision be tailored to the study purpose. Tradeoffs associated with these standardizations can be mitigated, ultimately providing guidance on how to standardize PDXC for routine analysis.

54 ENVIRONMENTAL SCIENCES↗

Optimization of key energy and performance metrics for drug product manufacturing

During the development of pharmaceutical manufacturing processes, detailed systems-based analysis and optimization are required to control and regulate critical quality attributes within specific ranges, to maintain product performance. As discussions on carbon footprint, sustainability, and energy efficiency are gaining prominence, the development and utilization of these concepts in pharmaceutical manufacturing are seldom reported, which limits the potential of pharmaceutical industry in maximizing key energy and performance metrics. Based on an integrated modeling and techno-economic analysis framework previously developed by the authors, this study presents the development of a combined sensitivity analysis and optimization approach to minimize energy consumption while maintaining product quality and meeting operational constraints in a pharmaceutical process. The optimal input process conditions identified were validated against experiments and good agreement resulted between simulated and experimental data. Here, the results also allowed for a comparison of the capital and operational costs for batch and continuous manufacturing schemes under nominal and optimized conditions. Using the nominal batch operations as a basis, the optimized batch operation results in a 71.7% reduction of energy consumption, whereas the optimized continuous case results in an energy saving of 83.3%.

59 BASIC BIOLOGICAL SCIENCES↗

Brachytherapy Partial Breast Irradiation: Analyzing Effect of Source Configurations on Dose Metrics Relevant to Toxicity

Purpose: Recently, the use of partial breast irradiation (PBI) for patients with early-stage breast cancer with low-risk factors has increased. The volume of the high-dose regions has been correlated with toxicity in interstitial treatment. Although no such associations have been made in applicator-based experience, new applicators are being developed that use complex noncentered source configurations. This work studied the effect of noncentered source placements on the volume of the high-dose regions around a spherical applicator. Methods and Materials: Many applicator configurations were numerically simulated for a range of inflation radii. For each configuration, a dose homogeneity index was used as a dose metric to measure the volume of the high-dose region. Results: All multisource configurations examined resulted in an increase of the high-dose region compared with a single-center source. The resulting decrease in the prescription dose homogeneity index was more pronounced for sources further from the center of the applicator, and the effect was reduced as the number of dwell locations was increased. Conclusion: The geometries of particular applicators were not considered to achieve a more general result. On the basis of the calculations of this work, it would appear that treatment using noncentered dwell locations will lead to an increase in the volume of the high-dose regions.

62 RADIOLOGY AND NUCLEAR MEDICINE↗