Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “METRICS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Assessing the sensitivity and repeatability of permanganate oxidizable carbon as a soil health metric: An interlab comparison across soils

Soil organic matter is central to the soil health framework. Therefore, reliable indicators of Soil organic matter is central to the soil health framework. Therefore, reliable indicators of changes in soil organic matter are essential to inform land management decisions. Permanganate oxidizable carbon (PDXC), an emerging soil health indicator, has shown promise for being sensitive to soil management. However, strict standardization is required for widespread implementation in research and commercial contexts. Here, we used 36 soils-three from each of the 12 USDA soil orders-to determine the effects of sieve size and soil mass of analysis on PDXC results. Using replicated measurements across 12 labs in the US and the EU (n = 7951 samples), we quantified the relative importance of 1) variation between labs, 2) variation within labs, 3) effect soil mass, and 4) effect of soil sieve size on the repeatability of PDXC. We found a wide range of overall variability in PDXC values across labs (0.03 to 171.8%; mean = 13.4%), and much of this variability was attributable to within-lab variation (median = 6.5%) independently of soil mass or sieve size. Greater soil mass (2.5 g) decreased absolute PDXC values by a mean of 177 mg kg -1 soil and decreased analytical variability by 6.5%. For soils with organic carbon (SOC) >10%, greater soil mass (2.5 g) resulted in more frequent PDXC values above the limit of detection whereas the lower soil mass (0.75 g) resulted in PDXC values below the limit of detection for SOC contents <5%. A finer sieve size increased absolute values of PDXC by 124 mg kg -1 while decreasing the analytical variability by 1.8%. In general, soils with greater SOC contents had lower analytical variability. These results point to potential standardizations of the PDXC protocol that can decrease the variability of the metric. We recommend that the PDXC protocol be standardized to use 2.5 g for soils <10% SOC. Sieve size was a relatively small contributor to analytical variability and therefore we recommend that this decision be tailored to the study purpose. Tradeoffs associated with these standardizations can be mitigated, ultimately providing guidance on how to standardize PDXC for routine analysis.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Optimization of key energy and performance metrics for drug product manufacturing

During the development of pharmaceutical manufacturing processes, detailed systems-based analysis and optimization are required to control and regulate critical quality attributes within specific ranges, to maintain product performance. As discussions on carbon footprint, sustainability, and energy efficiency are gaining prominence, the development and utilization of these concepts in pharmaceutical manufacturing are seldom reported, which limits the potential of pharmaceutical industry in maximizing key energy and performance metrics. Based on an integrated modeling and techno-economic analysis framework previously developed by the authors, this study presents the development of a combined sensitivity analysis and optimization approach to minimize energy consumption while maintaining product quality and meeting operational constraints in a pharmaceutical process. The optimal input process conditions identified were validated against experiments and good agreement resulted between simulated and experimental data. Here, the results also allowed for a comparison of the capital and operational costs for batch and continuous manufacturing schemes under nominal and optimized conditions. Using the nominal batch operations as a basis, the optimized batch operation results in a 71.7% reduction of energy consumption, whereas the optimized continuous case results in an energy saving of 83.3%.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Uncertainty quantification in scientific machine learning: Methods, metrics, and comparisons

Neural networks (NNs) are currently changing the computational paradigm on how to combine data with mathematical laws in physics and engineering in a profound way, tackling challenging inverse and ill-posed problems not solvable with traditional methods. However, quantifying errors and uncertainties in NN-based inference is more complicated than in traditional methods. This is because in addition to aleatoric uncertainty associated with noisy data, there is also uncertainty due to limited data, but also due to NN hyperparameters, overparametrization, optimization and sampling errors as well as model misspecification. Although there are some recent works on uncertainty quantification (UQ) in NNs, there is no systematic investigation of suitable methods towards quantifying the total uncertainty effectively and efficiently even for function approximation, and there is even less work on solving partial differential equations and learning operator mappings between infinite-dimensional function spaces using NNs. In this work, we present a comprehensive framework that includes uncertainty modeling, new and existing solution methods, as well as evaluation metrics and post-hoc improvement approaches. Further, to demonstrate the applicability and reliability of our framework, we present an extensive comparative study in which various methods are tested on prototype problems, including problems with mixed input-output data, and stochastic problems in high dimensions. In the Appendix, we include a comprehensive description of all the UQ methods employed. Further, to help facilitate the deployment of UQ in Scientific Machine Learning research and practice, we present and develop in [1] an open-source Python library (github.com/Crunch-UQ4MI/neuraluq), termed NeuralUQ, that is accompanied by an educational tutorial and additional computational experiments.

11 physics-informed neural networks↗
DOE OSTI2025

The detrimental ratio ( ρ ): A critical metric complementing coulombic loss for long calendar-life silicon-based lithium-ion batteries

Silicon (Si) is a promising high-capacity anode in lithium-ion batteries but suffers from chronic chemical degradation and capacity fading during calendar aging, greatly hindering its automobile applications. Electrolyte engineering currently relies on conventional evaluation criteria of reducing coulombic consumption, which implicitly presume its equivalence to irreversible capacity loss and complicates battery development. Here, we introduce the detrimental ratio p to quantify the fraction of parasitic species that permanently degrades active material. This metric is independent and crucially complements total coulombic consumption for accurate performance evaluation. We systematically investigate multiple electrolyte formulations using high-precision leakage current measurements, open-circuit-voltage experiments, and post-mortem characterizations. Although some electrolytes exhibit similarly low coulombic consumption, they diverge significantly incapacity retention and p. Especially, dimethyl-carbonate-based localized-high concentration electrolyte can synergically achieve low coulombic consumption and detrimental ratio p during calendar aging, owing to its chemically inert and structurally resilient solidelectrolyte interface with minimal isolated Si material. By contrast, increasing fluoroethylene carbonate (FEC) additive content suppresses electrolyte breakdown but suffers aggravated chemical degradation of more LixSi isolation for irreversible capacity loss with arising p. This study critically reveals that the chemistry-characteristic detrimental ratio p establishes physically informed performance evaluation to pave the way for accelerating battery development.

Calendar aging↗
DOE OSTI2022

Revealing latent pole and zone line information in atom probe detector maps using crystallographically correlated metrics

Poles and zone lines observed within atom probe field evaporation images are useful for a range of atom probe crystallography studies, including calibration of the reconstruction and crystallographic characterisation of microstructural features such as grain boundaries. However, this information is not always readily apparent. Techniques for plotting crystallographically correlated metrics contained within atom probe data to enhance pole and zone line contrast across the detector space are developed. This includes consideration of the electric field, molecular ions, lattice structure retained within the reconstruction, specific elemental species, the number of pulses between detection events, and the lateral distance between sequential detection events. These approaches are then applied to experimental atom probe tomography datasets on technically pure Al, nanocrystalline Al, highly doped Si, and additively manufactured Inconel 738, Haynes 282, and Ti–6Al–4V. The results facilitate the extension of atom probe crystallography studies to a broader range of crystalline datasets where crystallographic information is not readily apparent from existing methods, as well as a deeper understanding of field evaporation behaviour during an atom probe experiment.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Similarity Metric for Data Optimization and Efficient Training of Reactive Machine Learning Force Fields for Hydrocarbon Radiolysis

Radiolysis is a common approach to sterilize polymers, chemically modify them for upcycling, and accelerate their decomposition for recycling purposes. Reactive molecular dynamics (MD) simulations provide a powerful tool to generate atomic-level trajectories of the reactive processes and quantify radiolytic chemical degradation pathways. For this, machine learning (ML) surrogate models for reactive force fields with quantum mechanical accuracy are now widely used, which require ML training data sets that can provide information on atomic environments for target chemical systems. However, radiolysis chemistry can be highly complex and diverse, which poses significant challenges for generating training data to parametrize ML models. In this regard, we developed a method for optimizing the training data set using a cosine similarity metric to help guide training set selection for radiolysis of polyethylene, a model hydrocarbon polymer, as well as to enhance the transferability of our reactive ML force field (MLFF) to a variety of molecular and polymeric systems. Our approach performs atom-by-atom comparisons between local atomic environments to pinpoint important data points associated with rare and localized events, such as radiolysis damage within structures. We apply this approach to train the Chebyshev Interaction Model for Efficient Simulation (ChIMES) MLFF model, which expresses the atomic interaction potentials in terms of linear combinations of many-body Chebyshev polynomials. We first show that our method can reduce our training set size by ∼70% while improving overall accuracy compared to more standard MD model fitting approaches. We then validate our optimum model against diverse hydrocarbon simulation data, including simple alkanes and systems with unsaturated carbon bonds, over a wide range of thermodynamic conditions. Finally, we use our ChIMES model to perform MD simulations of radiolytic damage with large-scale systems that help avoid system size effects. Overall, our approach yields an MD force field that retains most of the accuracy of the underlying quantum method while yielding many orders of improvement in computational efficiency. In conclusion, our efforts will have impact on future hydrocarbon polymer radiolysis studies, where the chemical details of the polymer–radiation interactions can have a strong effect on the resulting products observed in experiments.

Hydrocarbons↗
DOE OSTI2022

The Entropic Braiding Index ( eBI ): A Robust Metric to Account for the Diversity of Channel Scales in Multi‐Thread Rivers

Abstract The Braiding Index ( BI ), defined as the average count of intercepted channels per cross‐section, is a widely used metric for characterizing multi‐thread river systems. However, it does not account for the diversity of channels (e.g., in terms of water discharge) within different cross‐sections, omitting important information related to system complexity. Here we present a modification of BI, the Entropic Braiding Index ( eBI ), which augments the information content in BI by using Shannon Entropy to encode the diversity of channels in each cross section. eBI is interpreted as the number of “effective channels” per cross‐section, allowing a direct comparison with the traditional BI . We demonstrate the potential of the ratio BI/eBI to quantify channel disparity, differentiate types of multi‐thread systems (braided vs. anastomosed), and assess the effect of discharge variability, such as seasonal flooding, on river cross‐section stability.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Ab initio-based metric for predicting the protectiveness of surface films in aqueous media

Abstract Materials can passivate by forming surface films when placed in aqueous media. However, these films may or may not be stable, and their stability can be predicted by a metric called the Pilling-Bedworth Ratio (PBR). In this article, we extend PBR to predict passivation protectiveness of multi-component materials. We then evaluate this PBR (ePBR)’s effectiveness by comparing its predictions against experimental studies of 21 multi-element materials of diverse chemistries, with agreement for 17 of the materials. Finally, we encode the methodology to compute ePBR in a web-application to predict the protectiveness of 140,000+ materials in the Materials Project database.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Quantitative metrics for evaluating thermonuclear design codes and physics models applied to the National Ignition Campaign

In this study, physics models and design codes for hot dense plasmas undergoing thermonuclear burn are evaluated objectively using statistical metrics that compare the difference between calculations and data relative to the experimental uncertainties. The analysis is applied to the National Ignition Campaign (NIC) because it is relevant, comprehensive, and well documented. The statistics confirm that a key process afflicting NIC performance is mix driven by hydrodynamic instabilities as approximated here using the KL model [G. Dimonte and R. Tipton, Phys. Fluids 18, 085101 (2006)]. New physics models are also presented for instability-driven magnetic fields [B. Srinivasan et al., Phys. Rev. Lett. 108, 165002 (2012)] and the Coulomb logarithm for electron–ion thermal relaxation [G. Dimonte and J. Daligault, Phys. Rev. Lett. 101, 135001 (2008)]. The plasma-generated magnetic fields improve the agreement between code and data in a statistically significant manner by reducing the electron thermal conduction in the hot-spot via the Hall term. The Coulomb logarithm is presented in a numerically practical form that incorporates recent theoretical advances. However, it does not improve the agreement between the code and data because the thermal relaxation is so fast in non-ignited NIC plasmas that the typical 20% error does not change the tight coupling between electrons and ions. Even with these improved physics models, the one-dimensional simulations presented here are not able to describe the high-convergence NIC implosions in a statistically acceptable manner. Of the heroic multi-dimensional simulations of Clark et al. [Phys. Plasmas 23, 056302 (2016)], only those in three-dimensions satisfy the statistical acceptance criterion.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Modified Schwarzschild metric from a unitary accelerating mirror analog

We present a modified Schwarzschild solution for a model of evaporation of a black hole with information preservation. By drawing a direct analogy to the quantum pure accelerating mirror (dynamical Casimir effect of a 1D horizon), we derive a Schwarzschild metric with not only the usual Schwarzschild radius but an additional length scale related to the Planck length. The black hole has thermal particle production that leads to complete evaporation of the black hole, resulting in non-divergent entanglement entropy, Page curve turn-over, and an asymptotic quantum pure state with no information loss.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Energy metric prediction for double insertion mutants via the RoseNet deep learning framework

Studying the structural and functional implications of protein mutations is an important task in computational biology and bioinformatics. We leverage our previously proposed RoseNet neural network architecture to predict energy metrics of proteins with double amino acid insertions or deletions (InDels). We train models on previously generated benchmark datasets containing the exhaustive double InDel mutations for three proteins, as well as an additional three proteins for which ∼145k random mutants, each with two InDels, have been generated. We expand on our previous work by evaluating three additional proteins and analyzing domain features that impact the prediction capabilities of RoseNet. These features include InDels into secondary structures and the solvent accessible surface area (SASA) scores of the residues. We uncover further evidence to support that RoseNet has a higher proficiency of generalizing to unseen residue combinations than unseen insertion positions. We also observe that RoseNet produces higher-quality predictions when inserting into a β-sheet over an α-helix. Additionally, when the insertions fall in an area of high SASA, RoseNet often displays better performance than inserting into areas of low SASA.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Beyond Contrast Transfer: Spectral SNR as a Finite-Dose Metric for STEM Phase Retrieval

The contrast transfer function (CTF) is widely used to evaluate phase retrieval methods in scanning transmission electron microscopy (STEM), including center-of-mass imaging, parallax imaging, direct ptychography, and iterative ptychography. However, the CTF reflects only the maximum usable signal, neglecting the effects of finite electron fluence and the Poisson-limited nature of detection. As a result, it can significantly overestimate practical performance, especially in low-dose regimes. Here, we employ the spectral signal-to-noise ratio (SSNR), as a finite-dose statistical framework to evaluate the recoverable signal as a function of spatial frequency. Using numerical reconstructions of white-noise objects, we show that center-of-mass, parallax, and direct ptychography exhibit dose-independent SSNRs, with close-form analytic expressions. In contrast, iterative ptychography exhibits a surprising dose dependence: at low fluence, its SSNR converges to that of direct ptychography; at high fluence, it saturates at a value consistent with the maximum detective quantum efficiency predicted by recent quantum Fisher information bounds. The results highlight the limitations of CTF-based evaluation and motivate SSNR as a more accurate, finite-dose metric for assessing STEM phase retrieval methods.

STEM phase retrieval↗
DOE OSTI2025

The impact of varying inhomogeneous reionization histories on metrics of Ly α opacity

The epoch of hydrogen reionization is complete by z = 5⁠, but its progression at higher redshifts is uncertain. Measurements of Ly α forest opacity show large scatter at z < 6⁠, suggestive of spatial fluctuations in neutral fraction, temperature, or ionizing background, either individually or in combination. However, there are degeneracies in the impact of such fluctuations, necessitating careful modelling. We develop a framework for modelling the reionization history and associated temperature fluctuations, with the intention of incorporating ionizing background fluctuations at a later time. We generate several reionization histories using seminumerical code AMBER, and implement them in the Nyx cosmological hydrodynamics code to examine the impact on the evolution of gas within the simulation and the associated metrics of the Ly α forest opacity. We find that the pressure smoothing scale within the intergalactic medium is strongly correlated with the adiabatic index of the temperature–density relation. We find that while models with 20 000 K photoheating at reionization are better able to reproduce the shape of the observed z = 5 1D flux power spectrum than colder ones, they fail to match the highest wavenumbers. The simulated autocorrelation function and optical depth distributions are systematically low and narrow, respectively, compared to the observed values, but are in better agreement when the reionization history is longer in duration, more symmetric in its distribution of reionization redshifts, or if there are remaining neutral regions at z < 6.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Black hole perturbations and quasinormal modes in hybrid metric-Palatini gravity

The rapid advancement of gravitational wave astronomy in recent years has paved the way for the burgeoning development of black hole spectroscopy, which enhances the possibility of testing black holes by their quasinormal modes (QNMs). In this paper, the axial gravitational perturbations and the QNM frequencies of black holes in the hybrid metric-Palatini gravity (HMPG) are investigated. Additionally, the HMPG theory is characterized by a dynamical scalar degree of freedom and is able to explain the late-time accelerating expansion of the universe without introducing any ad hoc screening mechanism to preserve the dynamics at the Solar System scale. We obtain the master equation governing the axial gravitational perturbations of the HMPG black holes and calculate the QNM frequencies. Moreover, in the scrutiny of the black holes and their QNMs, we take into account the constraints on the model parameters based on the post-Newtonian analysis, and show how the QNM frequencies of the HMPG black holes would be altered in the observationally consistent range of parameter space.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Metric isometries, holography, and continuous symmetry operators

In the AdS/CFT correspondence, a topological symmetry operator of the boundary conformal field theory (CFT) is dual to a dynamical brane in the gravitational bulk. Said differently, this predicts a dynamical brane for every global symmetry of the boundary CFT. We analyze this correspondence for continuous symmetries which arise from a consistent truncation of isometries on the “internal” factor 𝑋 of AdS × 𝑋. In the extra-dimensional geometry, these branes are associated with various metric singularities and do not arise from wrapped D-branes. Boosts relate configurations interpreted as topological symmetry operators and heavy defects in the CFT. From the perspective of the AdS factor, with gravity and bulk gauge fields, these are codimension-2 Gukov-Witten-like vortex configurations which are the gravity duals of 0-form symmetry operators. These effective branes come with an asymptotic tension and size which is also fully fixed by bulk dynamics. We use this higher-dimensional perspective to determine properties of the worldvolume theory for these branes. We also discuss how these considerations generalize to more general quantum field theories engineered via string theory which need not possess a semiclassical gravity dual.

anomalies↗
DOE OSTI2022

An Operational Resilience Metric to Evaluate Inertia and Inverter-based Generation on the Grid

In an effort to reduce carbon emissions and curtail the effects of climate change there has been considerable effort to increase the penetration of inverter-based renewable energy sources. The adoption of renewable generation over conventional inertia-based generation sources is forming considerable challenges for the operation and stability of the power system. The power system has been designed around generation units characterized by high inertia and primary frequency response (PFR), allowing them to respond to disturbances such as faults or generators tripping off line. In contrast, the modern inverter-based assets are characterized by no contribution to inertia and they typically provide stochastic generation at their maximum output, thus having no contribution to PFR during low-frequency disturbance events. Because of this, inertia in power systems is reducing, resulting in a faster rate of frequency change after a disturbance occurs. As more inverter-based generation units are added to the grid it is important to understand the stability of the system and the size of disturbance a system is capable of withstanding. This paper presents a resilience metric that evaluates the maximum size of disturbance a systems can withstand based on the system inertia and the primary frequency control of inverter and inertia-based generation. The results are shown visually and are based on the real-time operation of generation units and their characteristics such as latency, ramp rates, and energy constraints. It is demonstrated that the real-time positioning or bias of the generating units has an effect of the size of disturbance that a system can withstand, i.e. its resilience. It is expected that this type of analysis can help operators increase the resilience of power systems in the future.

13 HYDRO ENERGY↗
DOE OSTI2024

Comfort and Safety Metrics to Evaluate Customer Centric Resilience Enhancement Strategies

As the coincident events of extreme weather and major power outages continue to rise there is an increased need to implement resilience solutions. Many of these solutions are customer-centric, requiring the flexibility of demand, and many of the standard economic evaluations of these solutions do not include the benefits of resilience that are not easily quantified and monetized. Indoor air temperature has a large impact on the comfort and safety of building occupants during an extreme weather event. This work proposes metrics that can be used to compare the performance of resilience solutions in the context of comfort and safety.

Cost benefit analysis, Demand Side Management, Pow↗