Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “COMPARATIVE EVALUATIONS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 991 records · Page 55
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Oak Ridge National Laboratory Modernizing the Kokkos Build System: Using CMake to Encapsulate the Complexity of Build Instructions for Performance Portable Libraries

Kokkos, a C++ library focused on performance portability, requires a build system that can work with a variety of compilers and hardware. Ideally, users need only select the compiler and architecture and should not have to know or specify how programs using Kokkos are built. CMake can be used to create a flexible, robust build system and automatically configures compilers and settings based on the user’s inputs. Nevertheless, Kokkos’ requirements as a performance portability library for the build system exceed CMake’s current capabilities. This report describes the requirements, solutions, and testing of various implementations to create a CMake-based build system suitable for Kokkos. It compares the strengths and shortcomings of the approaches and evaluates the implementations with respect to the requirements. Because no solution was found to meet all of the requirements, the Kokkos team engaged with the CMake development team to discuss and plan a path toward support for performance-portable build systems in CMake in the future.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Using Host Galaxy Photometric Redshifts to Improve Cosmological Constraints with Type Ia Supernovae in the LSST Era

We perform a rigorous cosmology analysis on simulated Type Ia supernovae (SNe Ia) and evaluate the improvement from including photometric host galaxy redshifts compared to using only the "z spec " subset with spectroscopic redshifts from the host or SN. We use the Deep Drilling Fields (~50 deg 2 ) from the Photometric LSST Astronomical Time-Series Classification Challenge (PLAsTiCC) in combination with a low-z sample based on Data Challenge2. The analysis includes light-curve fitting to standardize the SN brightness, a high-statistics simulation to obtain a bias-corrected Hubble diagram, a statistical+systematics covariance matrix including calibration and photo-z uncertainties, and cosmology fitting with a prior from the cosmic microwave background. Compared to using the z spec subset, including events with SN+host photo-z results in (i) more precise distances for z > 0.5, (ii) a Hubble diagram that extends 0.3 further in redshift, and (iii) a 50% increase in the Dark Energy Task Force figure of merit (FoM) based on the w 0 w a CDM model. Analyzing 25 simulated data samples, the average bias on w 0 and w a is consistent with zero. The host photo-z systematic of 0.01 reduces FoM by only 2% because (i) most z < 0.5 events are in the z spec subset, (ii) the combined SN+host photo-z has ×2 smaller bias, and (iii) the anticorrelation between fitted redshift and color self-corrects distance errors. To prepare for analyzing real data, the next SN Ia cosmology analysis with photo-zs should include non–SN Ia contamination and host galaxy misassociations.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

CoCoMET v1.0: a unified open-source toolkit for atmospheric object tracking and analysis

Advances in performance and analysis capabilities have accelerated the development of object tracking algorithms for atmospheric research. This has resulted in a growing number of studies using Lagrangian tracking techniques to analyze the evolution of atmospheric phenomena and the underlying processes. However, the increasing complexity and variety of tracking algorithms present a steep learning curve for new users and make it difficult for existing users to compare algorithm performance. We introduce CoCoMET (Community Cloud Model Evaluation Toolkit), an open-source toolkit that addresses these issues. CoCoMET simplifies the process of running multiple tracking algorithms simultaneously and analyzing objects in both model and observational datasets by specifying parameters in a single configuration file. It standardizes input data from different sources into a consistent format and unifies the tracking output across algorithms. CoCoMET enhances the functionality of existing tracking methods by calculating additional properties such as cell growth and dissipation rates, perimeter, surface area, convexity, and irregularity. In addition, CoCoMET includes a novel method for identifying mergers and splits in 2D and 3D tracks and supports the integration of Eulerian/stationary datasets external to the tracking data for process studies. Its potential utility is demonstrated through examples of model intercomparison, model evaluation against observations, and comparisons between tracking algorithms. Designed for open-source environments, CoCoMET will continue to expand with future releases, incorporating more input data types and tracking algorithms.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Constraining Cosmology with Simulation-based inference and Optical Galaxy Cluster Abundance

We test the robustness of simulation-based inference (SBI) in the context of cosmological parameter estimation from galaxy cluster counts and masses in simulated optical datasets. We construct ``simulations'' using analytical models for the galaxy cluster halo mass function (HMF) and for the observed richness (number of observed member galaxies) to train and test the SBI method. We compare the SBI parameter posterior samples to those from an MCMC analysis that uses the same analytical models to construct predictions of the observed data vector. The two methods exhibit comparable performance, with reliable constraints derived for the primary cosmological parameters, ($\Omega_m$ and $\sigma_8$), and richness-mass relation parameters. We also perform out-of-domain tests with observables constructed from galaxy cluster-sized halos in the Quijote simulations. Again, the SBI and MCMC results have comparable posteriors, with similar uncertainties and biases. Unsurprisingly, upon evaluating the SBI method on thousands of simulated data vectors that span the parameter space, SBI exhibits worsened posterior calibration metrics in the out-of-domain application. We note that such calibration tests with MCMC is less computationally feasible and highlight the potential use of SBI to stress-test limitations of analytical models, such as in the use for constructing models for inference with MCMC.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

SimPoint++: Less Simulation Points

We propose SimPoint++, which replaces the BIC method by combining WCSS and Silhouette to find the optimal cluster. The new Python framework of SimPoint++ provides a dimension reduction pipeline for effective clustering and supports multi-thread application analysis. We evaluate SimPoint++ with Spec CPU 2017 benchmarks. SimPoint++ achieves comparable or higher accuracy with significantly fewer simulation points, resulting in a 5x speed-up in simulation time compared to state-of-the-art solutions.

Chen, Si↗
DOE OSTI2024

Regularized Differentiation for Bioburden Density Estimation in Planetary Protection

In this paper, we propose and investigate the performance of two novel shrinkage estimators for bioburden density estimation in planetary protection. The estimators are based on the regularized differentiation of a cumulative count of colony forming units collected throughout the data collecting session or the life cycle of the entire mission. The regularized differentiation recasts the problem of bioburden density estimation as a linear least squares problem. The least squares problem is then solved through regularization techniques, such as truncated singular value decomposition and penalized least squares. The regularization is necessary to avoid noise amplification during the differentiation of noisy data. The two regularization estimators are compared with four other commonly used estimators to simultaneously evaluate the means of multivariable independent Poisson distributions: the maximum likelihood, noninformative Bayes estimator with Jeffreys prior, Empirical Bayes using conjugate gamma-Poisson model with gamma parameters selected by method of moments, and the Clevenson-Zidek estimator. It is shown through computer-simulated data that the regularized differentiation based on ridge regression has the smallest mean-squared error among all estimators. The analysis of shrinkage mechanism implemented by regularized differentiation is performed, and it is shown that the regularized differentiation amounts to performing a weighted averaging of all the samples. The weights are determined by the regularization parameter automatically selected by the L-curve technique. Since the method of least squares makes no distributional assumptions about the data, it presents an attractive technique for bioburden density estimation when there are concerns about the misspecification of the distributional model. The paper concludes with the analysis of the bioburden data collected during InSight mission and directions for future work.

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Cyber-Power Co-Simulation for End-to-End Synchrophasor Network Analysis and Applications

The resiliency, reliability and security of the next generation cyber-power smart grid depend upon efficiently leveraging advanced communication and computing technologies. Also, developing real-time data-driven applications is critical to enable wide-area monitoring and control of the cyber-power grid given high-resolution data from Phasor Measurement Units (PMUs). North American Synchrophasor Initiative Network (NASPlnet) provides guidance for PMU data exchanges. With the advancement in networking and grid operation, it is necessary to evaluate the performance of different data flow architectures suggested by NASPInet and analyze the impact on applications. Therefore, we need a cyber-power co-simulation framework that supports very large-scale co-simulation capable of running in parallel, high-performance computing platforms and capturing real-life network behavior. This work presents an end-to-end automated and user-driven cyber-power co-simulation using NS3 to model communication networks, GridPACK to model the power grid, and HELICS as a co-simulation engine. Comparative analysis of latency in synchrophasor networks and a performance evaluation of a power system stabilizer application utilizing PMU data in an IEEE 39 bus test system is presented using this cosimulation testbed.

Mustafa, Hussain M.↗
DOE OSTI2020

Investigation of a Lignin-Based Deep Eutectic Solvent Using p -Hydroxybenzoic Acid for Efficient Woody Biomass Conversion

Deep eutectic solvents (DESs) are effective solvents for biomass conversion and have been proposed as alternatives to ionic liquids (ILs). In this paper, we first report an effective pretreatment of woody biomass using a novel hardwood lignin-based DES prepared from p -hydroxybenzoic acid (PB) and choline chloride (ChCl), which are used as the hydrogen bond donor and acceptor, respectively. The impacts of the ChCl-PB DES on structural properties and enzymatic hydrolysis of poplar wood were comprehensively evaluated. The performance of ChCl-PB DES was also compared with two other DESs with p -coumaric acid (PCA) and 4-hydroxybenzaldehyde (PHA) as the hydrogen bond donors, which have been successfully applied to herbaceous biomass conversion in previous studies. The results showed that hemicellulose and lignin were effectively fractionated during the proposed ChCl-PB DES pretreatment under a relatively mild temperature. The ChCl-PB DES pretreatment resulted in up to 69% of delignification, and the pretreated poplar residues had over 90% of glucose yield by a 72 h-enzymatic hydrolysis. Transformation of poplar biomass during the DES pretreatment was evaluated by gel permeation chromatography (GPC), two-dimensional heteronuclear single quantum coherence (2D-HSQC), and 31 P nuclear magnetic resonance (NMR) spectroscopies. The recovered lignin showed relatively high purity, narrow molecular weight distribution (PDI < 1.6), and relatively low molecular weight (~1400 g/mol for M w ). A sustainable process was achieved by recycling DES as well as the utilization of PB, which is a producible aromatic compound from hardwood lignin, for the proposed DES formation in the system. This study indicates that the proposed novel DES with a hardwood lignin-based PB compound is a promising pretreatment solvent to achieve an economically feasible biomass conversion process.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Multifamily Air Leakage Evaluation: A Modular Case Study

The purpose of this case study is to compare the air leakage rates of modular and site-built multifamily dwelling units. The methods, materials, and equipment were observed to be very similar in the modular and site-constructed units in this case study. The installation quality of building envelope measures such as insulation and air barrier appeared to be better for modular construction, because they were installed in a controlled, factory setting. Through field observations, we identified cosmetic damage to the envelope of modular units following transport to the building site, but with no resulting significant air leakage pathways. However, we did see air leakage pathways resulting from field modifications to the envelope of modular units to accommodate structural and mechanical connections. We found that the extensive use of through-wall HVAC systems, combined with the transport, placement, and rework of modular units may compromise the high-quality envelope installation and airtightness observed in the factory without careful planning and/or design. Opportunities for improvement identified from the tested modular dwelling units include minimizing and optimally locating penetrations, pre-cutting and detailing penetrations at the factory where possible, properly sealing field modifications, and using split HVAC systems in place of through-wall packaged systems.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

The effect of geographic sampling on evaluation of extreme precipitation in high-resolution climate models

Traditional approaches for comparing global climate models and observational data products typically fail to account for the geographic location of the underlying weather station data. For modern global high-resolution models with a horizontal resolution of tens of kilometers, this is an oversight since there are likely grid cells where the physical output of a climate model is compared with a statistically interpolated quantity instead of actual measurements of the climate system. In this paper, we quantify the impact of geographic sampling on the relative performance of high-resolution climate model representations of precipitation extremes in boreal winter (December–January–February) over the contiguous United States (CONUS), comparing model output from five early submissions to the HighResMIP subproject of the CMIP6 experiment. We find that properly accounting for the geographic sampling of weather stations can significantly change the assessment of model performance. Across the models considered, failing to account for sampling impacts the different metrics (extreme bias, spatial pattern correlation, and spatial variability) in different ways (both increasing and decreasing). We argue that the geographic sampling of weather stations should be accounted for in order to yield a more straightforward and appropriate comparison between models and observational data sets, particularly for high-resolution models with a horizontal resolution of tens of kilometers. While we focus on the CONUS in this paper, our results have important implications for other global land regions where the sampling problem is more severe.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Hydropower Evaluation Framework for Wildfire Resilient Microgrids

This paper presents a framework for characterizing hydropower plants based on plant and site attributes, assessing their feasibility to function within microgrids during periods of wildfire-induced outages. A set of nine metrics is developed to assign scores to hydropower plants, considering their suitability for forming wildfire-resilient microgrids, their capability to operate within such microgrids, and their simulated performance during wildfire events. A comprehensive database is constructed, comparing hydropower plants according to their suitability and capability metrics. To evaluate the performance score of a specific hydropower plant, namely the Hills Creek plant situated in a wildfire-prone region of Oregon, a case study is conducted, simulating a wildfire scenario. The results of steady-state and dynamic simulations demonstrate that the Hills Creek hydropower plant can effectively provide crucial microgrid services and power nearby communities during a prolonged wildfire-related outages.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Predicting nepheline precipitation in waste glasses using ternary submixture model and machine learning

Nepheline precipitation in nuclear waste glasses during vitrification can be detrimental due to its negative effect on chemical durability. Developing models to accurately predict nepheline precipitation from compositions is important to increase waste loading since existing models can be overly conservative. In this study, an expanded dataset containing 955 glasses was compiled from literature data, where 355 glasses are for high-level waste (HLW). Previously developed submixture models were refitted using the new dataset, where a misclassification rate of 7.8% was achieved. Nine machine learning (ML) algorithms (e.g., k-nearest neighbor, Gaussian process regression, artificial neural network, support vector machine, decision tree, etc.) were applied to evaluate their ability of predicting nepheline precipitation from compositions. Model accuracy, precision, recall/sensitivity, and F1 score were systemically compared between different ML algorithms and modeling protocols. Good model prediction with an accuracy ~0.9 (misclassification rate of ~10%) was observed with different algorithms under certain protocol. This study evaluated various ML models to predict nepheline precipitations in waste glasses, highlighting the importance of data preparation, modeling protocol, and their effect on model stability and reproducibility. The results provide insights into applying ML to predict glass properties and suggest areas for future research on modeling nepheline precipitations.

Lu, Xiaonan↗
DOE OSTI2024

The first ensemble of kilometer-scale simulations of a hydrological year over the third pole

An accurate understanding of the current and future water cycle over the Third Pole is of great societal importance, given the role this region plays as a water tower for densely populated areas downstream. An emerging and promising approach for skillful climate assessments over regions of complex terrain is kilometer-scale climate modeling. As a foundational step towards such simulations over the Third Pole, we present a multi-model and multi-physics ensemble of kilometer-scale regional simulations for the hydrological year of October 2019 to September 2020. The ensemble consists of 13 simulations performed by an international consortium of 10 research groups, configured with a horizontal grid spacing ranging from 2.2 to 4 km covering all of the Third Pole region. These simulations are driven by ERA5 and are part of a Coordinated Regional Climate Downscaling EXperiment Flagship Pilot Study on Convection-Permitting Third Pole. The simulations are compared against available gridded and in-situ observations and remote-sensing data, to assess the performance and spread of the model ensemble compared to the driving reanalysis during the cold and warm seasons. Although ensemble evaluation is hindered by large differences between the gridded precipitation datasets used as a reference over this region, we show that the ensemble improves on many warm-season precipitation metrics compared with ERA5, including most wet-day and hour statistics, and also adds value in the representation of wet spells in both seasons. As such, the ensemble will provide an invaluable resource for future improvements in the process understanding of the hydroclimate of this remote but important region.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

scPlantAnnotate: an accurate and robust transformer-based model for plant cell type annotation

Accurate cell type annotation remains a major bottleneck in plant single-cell RNA sequencing (scRNA-seq), where existing tools are often adapted from animal studies and perform sub-optimally on plant data. The lack of plant-specific computational frameworks limits the construction of plant cell atlases and downstream biological discovery. We develop and evaluate scPlantAnnotate, a Transformer-based reference annotation framework tailored for plant scRNA-seq data, and benchmark it against state-of-the-art deep learning and conventional methods across multiple plant species. Species-specific scPlantAnnotate models were trained using curated datasets from Arabidopsis thaliana, Zea mays, Oryza sativa, and Glycine max. We compared scPlantAnnotate with leading baselines under both standard random-split evaluation and a more stringent leave-one-dataset-out setting, which tests robustness to completely unseen datasets and tissue types. scPlantAnnotate consistently outperforms existing approaches across all four species under random-split evaluation. In the leave-one-dataset-out setting for A. thaliana, where performance drops markedly for all methods due to strong batch effects and dataset heterogeneity, scPlantAnnotate nonetheless achieves the highest Accuracy, Macro-F1, Balanced Accuracy, and Macro-AUROC on average and ranks first on most held-out datasets. These results demonstrate improved robustness to dataset shifts, a critical yet underexplored challenge in plant scRNA-seq analysis. A freely accessible web server enables users to annotate their own datasets using pretrained models. scPlantAnnotate provides a plant-specific, Transformer-based framework for single-cell annotation that delivers state-of-the-art performance and enhanced robustness to unseen datasets. By addressing limitations of existing tools and enabling scalable reference-based annotation, scPlantAnnotate supports the development of comprehensive plant cell atlases and facilitates broader use of single-cell genomics in plant biology.

Bioinformatics↗
DOE OSTI2025

Equitable Urban Electric Vehicle Charging: Feasibility and Benefits of Streetlight Charging in Kansas City Right-of-Way

With an increasing global emphasis on sustainability, electric vehicles (EVs) play a crucial role in reducing urban pollution and carbon emissions. For EVs to be widely adopted, equitable and convenient access to charging infrastructure is essential. Equity in this paper refers to the proactive engagement with the community to ensure that the benefits of streetlight charging are distributed equitably across diverse neighborhoods in Kansas City, providing fair charging opportunities and resources to all community members. This research explores the potential of utilizing streetlights—ubiquitous elements of urban electrical infrastructure—as low-cost, equitable EV charging solutions. Compared with conventional chargers, streetlight charging offers several notable advantages, including proximity to roadways, potential boosts to the local economy, and easier usage due to city ownership. These chargers also leverage existing power setups to minimize costs and maximize efficiency by reutilizing existing structures. In this manuscript, we introduce a systematic framework to develop, analyze, and evaluate a scalable and cost-effective streetlight charging solution. Initially, we employ a two-tiered site selection framework that accounts for both charging demand and equity considerations to identify optimal locations for streetlight chargers. We then assess the feasibility of these chargers through observational data from 23 units installed in Kansas City, Missouri, comparing their performance with traditional chargers. Here, our evaluation extends to the environmental impact, comparing reduced gasoline consumption and greenhouse gas (GHG) emission reductions between streetlights and regular charging stations. Our findings reveal that streetlight charging stations offer faster charging speeds than conventional stations, validating their viability for EV charging. Additionally, the duration of stay at streetlight chargers tends to be shorter, likely due to parking constraints or associated costs. Furthermore, streetlight-powered chargers demonstrate considerable environmental advantages, achieving 11.94% greater avoided gasoline consumption and 11.24% higher GHG reductions compared with regular charging stations, highlighting their substantial environmental benefits.

42 ENGINEERING↗
DOE OSTI2022

Comparative Assessment of Severe Acute Respiratory Syndrome Coronavirus 2 Variants in the Ferret Model

The continued spread of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) in humans necessitates evaluation of variants for enhanced virulence and transmission. We used the ferret model to perform a comparative analysis of four SARS-CoV-2 strains, including an early pandemic isolate from the United States (WA1), and representatives of the Alpha, Beta, and Delta lineages. While Beta virus was not capable of pronounced replication in ferrets, WA1, Alpha, and Delta viruses productively replicated in the ferret upper respiratory tract, despite causing only mild disease with no overt histopathological changes. Strain-specific transmissibility was observed; WA1 and Delta viruses transmitted in a direct contact setting, whereas Delta virus was also capable of limited airborne transmission. Viral RNA was shed in exhaled air particles from all inoculated animals but was highest for Delta virus. Prior infection with SARS-CoV-2 offered varied protection against reinfection with either homologous or heterologous variants. Notable genomic variants in the spike protein were most frequently detected following WA1 and Delta virus infection.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Multilayer Electrodes with Metalized Polymer Current Collector for High-Energy Lithium-Ion Batteries with Extreme-Fast-Charging Capability

The pursuit of batteries capable of extreme fast charging (XFC), that also satisfy high energy and safety criteria, poses a significant challenge to current lithium-ion battery technologies. Additionally, the increasing demand for aluminum (Al) and copper (Cu) in electrification, and vehicle light weighting is driving these metals towards near-critical status in the medium term. This study introduced metalized polymer films by depositing an Al or Cu thin layer onto two sides of a polyethylene terephthalate (PET) film – named mPET/Al and mPET/Cu, as lightweight, cost-effective alternatives to traditional metal current collectors in LIBs. We have utilized current collectors that significantly reduce weight (by 73%), thickness (by 33%), and cost (by 85%) compared to traditional metal foil counterparts. We conducted an extensive evaluation of their mechanical and electrical properties, including in-plane and through-plane resistivities, affirming their suitability for the roll-to-roll battery manufacturing process. Additionally, a novel XFC testing protocol was employed to thoroughly assess the cells' (both half and full-cell) performance across various C-rates and under long-term tests. These advancements have the potential to enhance energy density to 280 Wh/kg at the electrode level under 10-minute charging at 6C. Through testing, including a novel XFC protocol across various C-rates and long-term cycling (up to 1000 cycles) in different cell configurations, we have demonstrated the superior performance of these metalized polymer films. Notably, mPET/Cu and mPET/Al foils exhibited comparable capacities to conventional cells under XFC, with the mPET cells showing a 27% improvement in energy density at 6C and maintaining significant energy density after 1000 cycles. This study underscored the potential of mPET foils to revolutionize the roll-to-roll battery manufacturing process and significantly advance the performance metrics of LIBs in EV applications. Moreover, our results suggest that there is potential to enhance the performance of mPET foils, especially mPET/Al, by optimizing the manufacturing process to achieve higher conductivity.

99 GENERAL AND MISCELLANEOUS↗