Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,387 records · Page 77

Smart Mobility in the Cloud: Enabling Real-Time Situational Awareness and Cyber-Physical Control Through a Digital Twin for Traffic

This article presents the design, implementation, and use cases of the Chattanooga Digital Twin (CTwin) towards the vision for next-generation smart city applications for urban mobility management. CTwin is an end-to-end web-based platform that incorporates various aspects of the decision-making process for optimizing urban transportation systems in Chattanooga, Tennessee, to reduce traffic congestion, incidents, and vehicle fuel consumption. The platform serves as a cyberinfrastructure to collect and integrate multi-domain urban mobility data from various online repositories and Internet of Things (IoT) sensors, covering multiple urban aspects (e.g., traffic, natural hazards, weather, and safety) that are relevant to urban mobility management. The platform enables advanced capabilities for: (a) real-time situational awareness on traffic and infrastructure conditions on highways and urban roads, (b) cyber-physical control for optimizing traffic signal timing, and (c) interactive visual analytics on big urban mobility data and various metrics for traffic prediction and transportation performance evaluation. The platform is designed using a multi-level componentization paradigm and is implemented using modular and adaptive architecture, rendering it as a generalizable and extendable prototype for other urban management applications. We present several use cases to demonstrate CTwin's core capabilities for supporting decision-making in smart urban mobility management.

33 ADVANCED PROPULSION SYSTEMS↗

A Ce-Doped LiI Scintillator Film-Based High Rate, High Spatial Resolution Neutron Anger Camera for Neutron Scattering Facilities

The 2-D position sensitive neutron detectors featuring a significantly improved count rate capacity and a sub-mm spatial resolution are in high demand by neutron scattering facilities, especially the next generation high-flux spallation neutron sources (SNSs). They are anticipated to play a crucial role in fully utilizing the unprecedentedly high neutron brightness offered by these sources. In this work, a high rate and high spatial resolution neutron Anger camera has been successfully developed based on a Ce-doped microcolumnar LiI scintillator film and the PETsys TOFPET2 ASIC readout electronics. The performance evaluation was conducted in a standard laboratory environment as well as the High Flux Isotope Reactor (HFIR) at Oak Ridge National Laboratory (ORNL) with regard to light yield, γ-ray sensitivity, neutron detection efficiency, count rate capability, spatial resolution, and position linearity. The LiI:Ce scintillator was found to have a higher light yield and a lower γ-ray sensitivity than GS20 (i.e., 11729 versus 6000 photons/n and 1.67 × 10 −5 versus on the order of 10 −4 ). The neutron detection efficiency was measured to be 63% at 4.2 Å. This camera demonstrated an exceptional count rate capability, up to at least 481 kHz without rate loss. The spatial resolution was as good as 0.47 mm. Here, the position linearity was also enhanced.

High rate↗

Reduce Operations: Send Volume Balancing While Minimizing Latency

Communication hypergraph model was introduced in a two-phase setting for encapsulating multiple communication cost metrics (bandwidth and latency), which are proven to be important in parallelizing irregular applications. In the first phase, computational-task-to-processor assignment is performed with the objective of minimizing total volume while maintaining computational load balance. In the second phase, communication-task-to-processor assignment is performed with the objective of minimizing total number of messages while maintaining communication-volume balance. The reduce-communication hypergraph model suffers from failing to correctly encapsulate send-volume balancing. We propose a novel vertex weighting scheme that enables part weights to correctly encode send-volume loads of processors for send-volume balancing. The model also suffers from increasing the total communication volume during partitioning. To decrease this increase, we propose a method that utilizes the recursive bipartitioning framework and refines each bipartition by vertex swaps. For performance evaluation, we consider column-parallel SpMV, which is one of the most widely known applications in which the reduce-task assignment problem arises. Extensive experiments on 313 matrices show that, compared to the existing model, the proposed models achieve considerable improvements in all communication cost metrics. Furthermore, these improvements lead to an average decrease of 30% in parallel SpMV time on 512 processors for 70 matrices with high irregularity.

97 MATHEMATICS AND COMPUTING↗

Community-Based Transactive Coordination Mechanism for Enabling Grid Edge Systems

The changing landscape of the electricity industry, characterized by a surge in distributed energy resources (DERs) and proactive customers, necessitates practical solutions for coordinated operations especially at the distribution-level. This paper introduces a community-based transactive coordination mechanism designed to incentivize customers for providing localized and system-level services reflected through real-time prices. The work presents a bidding approach for communities with DERs, such as solar photovoltaic (PV) and battery energy storage systems (BESS), to formulate their price-responsiveness for retail energy coordination, emphasizing a community-centric model. By sending bidding curves to a third-party, the mechanism enables customers with DER assets to actively participate in localized coordination with the load serving entity (LSE), thereby supplementing each other’s and even the utilities needs through a shared energy economy. The proposed transactive mechanism is implemented leveraging a co-simulation framework that integrates a distribution grid simulator and Python-based agents for performance evaluation. Collaboration with a local utility to access real distribution feeder models and consumption profiles yields simulation results demonstrating the potential to reduce costs by 12\% for communities with DERs like PV and BESS.

Community-based coordination, grid-edge systems, R↗

Data-driven Quasi-static Surrogate Model for Nuclear-powered Integrated Energy Systems

The integration of nuclear power into energy systems presents a promising avenue to address the growing global energy demands while minimizing greenhouse gas emissions. In this paper, we introduce a data-driven quasi-static surrogate model for nuclear-powered Integrated Energy Systems (IES) that comprises various components, including a small modular reactor (SMR), energy manifold (EM), balance of plant (BOP), high-temperature steam electrolysis (HTSE), and district heating (DH) system. Traditional physics-based models for these components often entail significant computational overhead and time consumption, necessitating the development of efficient surrogate models. The development of a complete surrogate model for the IES involves the creation of individual surrogate models for each component, leveraging machine learning techniques and simulated data. These isolated surrogate models are subsequently integrated, enabling a holistic view of the IES and reducing the computational burden associated with detailed physics-based simulations. This paper outlines the development process, validation, and the performance evaluation of the surrogate models. The findings shed light on the accuracy and applicability of the surrogate models in practical scenarios, demonstrating their potential to expedite the analysis of nuclear-powered IES and inform future research and development efforts.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A Scalable Multi-Modal Framework for High-Fidelity Distributed Human Mobility Simulations

The development of data-driven models for human mobility in urban settings requires access to substantial and diverse real-world data. However, existing historical data often presents challenges such as limited volume, variety, and veracity, as well as missing data and privacy preservation concerns. Also, urban mobility modeling is inherently time-variant, complex, and multi-modal, encompassing everything from individual walking and running to private road travel and large-scale public transportation. These challenges call for innovative solutions to overcome data limitations and compute needs to model mobility behaviors accurately. To address these challenges, we propose a distributed, co-simulation-based architecture DURMOSim that integrates real-world data with scalable, high-fidelity simulations, demonstrating distributed co-simulation feasibility with existing mobility models. DURMOSim underpins a modular integration that would enable using any available mobility simulators for greater extensibility and scalability in performing various urban scenarios. In this paper, we present the design, implementation, and performance evaluation of DURMOSim, highlighting its capability to model population-scale mobility patterns. Our initial results show its ability to dynamically synchronize multiple simulation models at runtime with negligible computational overhead. We believe DURMOSim could be a robust tool for advancing urban mobility research and intelligent transportation systems.

Yoginath, Srikanth [ORNL] (ORCID:0000000184236050)↗

Scalability Analysis of Quantum Models for Stress and Emotion Detection

Stress and emotion detection from high-dimensional physiological signals is a challenging task, particularly when aiming for accurate classification across diverse behavioral states. Quantum machine learning (QML) is promising for modeling such high-dimensional data, but scalability is limited by qubit resources and the exponential cost of classical statevector simulation. This work studies the scalability of quantum support vector machines (QSVMs) for binary stress detection and three-class emotion recognition (Negative/Neutral/Positive) under varying qubit counts and angle-encoding strategies. We also present a comparison study with one-feature-per-qubit (1:1) and two-features-per-qubit (2:1) mappings. Experiments are executed on HPC infrastructure using NVIDIA CUDA-Q to evaluate performance, variance, and class-dependent separability at higher-qubit setups. Results show that larger Hilbert spaces can improve peak accuracy but may increase instability. At the same time, dense 2:1 encoding yields more consistent stress detection performance. For emotion recognition, scaling improves discrimination for classes like Negative and Positive more than Neutral. We find that effective QML scaling is task-dependent and benefits more from encoding design than simply increasing qubit count.

Onim, Md. Saif Hassan [University of Tennessee, Kn↗

Assessing Nonlinear Polarization in Electrochemical Cells using AC Impedance Spectroscopy

AC impedance spectroscopy is widely used to evaluate performance limitations in energy storage and conversion devices (e.g., batteries, supercapacitors, and fuel cells). This work shows that integrating the resistive elements in an equivalent circuit as functions of steady-state current enables one to recover overpotentials associated with different processes (e.g., ion migration, charge transfer, and diffusion) in nonlinear electrochemical power supplies. Closed form expressions for diffusion overpotentials are derived using this method for transmissive and reflective boundary conditions and three electrode symmetries (planar, cylindrical, and spherical). Discussion is also extended to macroscopically homogenous porous electrodes which are relevant for most real-world devices. Overall, the approach described herein is a powerful tool to identify rate-limiting steps and guide material/component design.

25 ENERGY STORAGE↗

Correlations between Texture Profile Analysis and Sensory Evaluation of Cured Largemouth Bass Meat (Micropterus salmoides)

Texture is an important factor in evaluating the quality of aquatic products. To evaluate the texture properties of cured large mouth bass, edible sodium chloride (0, 1.0, 2.0, and 3.0%) was smeared to the bass meat. Texture profile analysis (TPA) and sensory evaluation were performed to evaluate the quality of the cured samples, and the correlations of the indexes in the two methods were analyzed. Two principal components were obtained from the TPA indexes and sensory evaluation indexes, and the cumulative variance contribution rates were 73.87% and 72.99%, respectively. Results from the principal component analysis showed that the main indicators that affected the TPA were gumminess and springiness, while those that affected sensory evaluation were chewiness and adhesiveness. The TPA index and sensory evaluation could be effectively improved when the sodium chloride added to the bass meat was 1%. In the correlation analysis, sensory springiness was negatively correlated with TPA hardness ( P < 0.05 , r = −0.553) but positively correlated with TPA chewiness ( P < 0.05 , r = 0.596). After stepwise regression analysis, the prediction equation between the sensory springiness and TPA hardness was obtained as SSp=5.770−0.002Ha. These results provide a basis for predicting the quality of large mouth bass cured products.

Li, Meijin↗

Serial2Parallel

In the era of machine learning, we often need to run the same code/script many times with little or no variations (e.g., performance evaluation, data preprocessing, data generation, hyperparameter tuning, etc.). It is not a problem when you just need to do that a few times, but when the number of repetitions becomes very large, it can be a daunting task. The code “Serial2Parallel” provides an easy way for users to be able to run many numbers of any serial code/scripts in a parallel manner across multiple nodes in an message passing interface (MPI) cluster. The code includes the server program that deals with task pool management and client program that processes task. The server gets the tasks ready and waits for clients' connections. The client code pulls tasks from the server and processes them. The client code will run in parallel.

Sangkeun, MattLee↗

Multi-Channel Time-Frequency Analysis

This software contains models for multi-channel time series data. The models are time-frequency descriptions of the data. Also included are prediction performance evaluation tools. These models can be applied to electrophysiology data such as electrocorticography.

Kaplan, AlanD↗

CLIP Representation Enhanced Predicate Estimation

This software provides functions to perform visual predicate estimation by leveraging the pre-trained vision-language model CLIP. In addition to training the prediction estimator with a labeled dataset, it also performs performance evaluation and visualization of results.

Jayaraman Thiagarajan, Jayaraman↗

Pooling Data Improves Multimodel IDF Estimates over Median-Based IDF Estimates: Analysis over the Susquehanna and Florida

Traditional multimodel methods for estimating future changes in precipitation intensity, duration, and frequency (IDF) curves rely on mean or median of models’ IDF estimates. Such multimodel estimates are impaired by large estimation uncertainty, shadowing their efficacy in planning efforts. Here, assuming that each climate model is one representation of the underlying data generating process, i.e., the Earth system, we propose a novel extension of current methods through pooling model data: (i) evaluate performance of climate models in simulating the spatial and temporal variability of the observed annual maximum precipitation (AMP), (ii) bias-correct and pool historical and future AMP data of reasonably performing models, and (iii) compute IDF estimates in a nonstationary framework from pooled historical and future model data. Pooling enhances fitting of the extreme value distribution to the data and assumes that data from reasonably performing models represent samples from the “true” underlying data generating distribution. Through Monte Carlo simulations with synthetic data, we show that return periods derived from pooled data have smaller biases and lesser uncertainty than those derived from ensembles of individual model data. We apply this method to NA-CORDEX models to estimate changes in 24-h precipitation intensity–frequency (PIF) estimates over the Susquehanna watershed and Florida peninsula. Our approach identifies significant future changes at more stations compared to median-based PIF estimates. The analysis suggests that almost all stations over the Susquehanna and at least two-thirds of the stations over the Florida peninsula will observe significant increases in 24-h precipitation for 2–100-yr return periods.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A Statistical Evaluation of WRF-LES Trace Gas Dispersion Using Project Prairie Grass Measurements

In recent years, new measurement systems have been deployed to monitor and quantify methane emissions from the natural gas sector. Large-eddy simulation (LES) has complemented measurement campaigns by serving as a controlled environment in which to study plume dynamics and sampling strategies. However, with few comparisons with controlled-release experiments, the accuracy of LES for modeling natural gas emissions is poorly characterized. In this paper, we evaluate LES from the Weather Research and Forecasting (WRF) Model against Project Prairie Grass campaign measurements and surface layer similarity theory. Using WRF-LES, we simulate continuous emissions from 30 near-surface trace gas sources in two stability regimes: strong convection and weak convection. We examine the impact of grid resolutions ranging from 6.25 to 52 m in the horizontal dimension on model results. We evaluate performance in a statistical framework, calculating fractional bias and conducting Welch’s t tests. WRF-LES accurately simulates observed surface concentrations at 100 m and beyond under strong convection; simulated concentrations pass t tests in this region irrespective of grid resolution. However, in weakly convective conditions with strong winds, WRF-LES substantially overpredicts concentrations—the magnitude of fractional bias often exceeds 30%, and all but one t test fails. The good performance of WRF-LES under strong convection correlates with agreement with local free convection theory and a minimal amount of parameterized turbulent kinetic energy. The poor performance under weak convection corresponds to misalignment with Monin–Obukhov similarity theory and a significant amount of parameterized turbulent kinetic energy.

17 WIND ENERGY↗

Clacc: OpenACC for C/C++ in Clang

The Clacc project has developed OpenACC compiler, runtime, and profiling interface support for C/C++ by extending Clang and LLVM. A key Clacc design feature is that it translates OpenACC to OpenMP to leverage the OpenMP offloading support that is actively being developed for Clang and LLVM. A benefit of this design is support for two compilation modes: traditional compilation mode produces a binary, and source-to-source mode produces OpenMP source. Clacc has been deployed on Oak Ridge National Laboratory’s (ORNL’s) Frontier, on which Clacc is the only OpenACC implementation for C/C++. Clacc supports x86_64, POWER9, AMD GPUs, and NVIDIA GPUs. Clacc’s OpenACC profiling interface support has been integrated with TAU, which is also deployed on Frontier. While Clacc has always supported C as a base language, Clacc also has increasing C++ support, including support for Kokkos’s OpenACC back end. Clacc itself is hosted publicly on GitHub. In this paper, we describe Clacc’s design and mapping from OpenACC directives to OpenMP. We also present a performance evaluation on ORNL’s Frontier (AMD MI250x GPU offload) and Argonne National Laboratory’s (ANL’s) Polaris (NVIDIA A100 GPU offload) for various SPEC ACCEL and Kokkos OpenACC back end benchmarks.

97 MATHEMATICS AND COMPUTING↗

Predicting potential adverse events using safety data from marketed drugs

Abstract Background While clinical trials are considered the gold standard for detecting adverse events, often these trials are not sufficiently powered to detect difficult to observe adverse events. We developed a preliminary approach to predict 135 adverse events using post-market safety data from marketed drugs. Adverse event information available from FDA product labels and scientific literature for drugs that have the same activity at one or more of the same targets, structural and target similarities, and the duration of post market experience were used as features for a classifier algorithm. The proposed method was studied using 54 drugs and a probabilistic approach of performance evaluation using bootstrapping with 10,000 iterations. Results Out of 135 adverse events, 53 had high probability of having high positive predictive value. Cross validation showed that 32% of the model-predicted safety label changes occurred within four to nine years of approval (median: six years). Conclusions This approach predicts 53 serious adverse events with high positive predictive values where well-characterized target-event relationships exist. Adverse events with well-defined target-event associations were better predicted compared to adverse events that may be idiosyncratic or related to secondary target effects that were poorly captured. Further enhancement of this model with additional features, such as target prediction and drug binding data, may increase accuracy.

Daluwatte, Chathuri↗

Groundwater Remediation with Pump-and-Treat Technology

Pump-and-treat (P&T) is a widely used remediation technology that involves pumping groundwater from extraction wells in the subsurface, removing contaminants of concern from the groundwater in an aboveground treatment system, reintroducing treated water into the environment – often by injection back into the groundwater aquifer or by discharge to the surface–, and groundwater monitoring to evaluate performance. In this chapter we explore how the Hanford Site uses the P&T remediation approach to treat contaminated groundwater. Six P&T facilities currently operate at the Hanford Site; however, this chapter uses the 100 Area DX and HX P&T facilities' treatment of hexavalent chromium as a case study to discuss this remediation approach. Located in the River Corridor, HX and DX P&T facilities are much closer to reaching closure than the younger 200W P&T facility located in the Central Plateau’s 200W Area. As such, one can follow the historical design, operation, and optimization steps that have led these facilities closer to closure.

Saslow, Sarah A.↗

Enhanced Surgical Decision-Making Tools in Breast Cancer: Predicting 2-Year Postoperative Physical, Sexual, and Psychosocial Well-Being following Mastectomy and Breast Reconstruction (INSPiRED 004)

Background: We sought to predict clinically meaningful changes in physical, sexual, and psychosocial well-being for women undergoing cancer-related mastectomy and breast reconstruction 2 years after surgery using machine learning (ML) algorithms trained on clinical and patient-reported outcomes data. Patients and Methods: We used data from women undergoing mastectomy and reconstruction at 11 study sites in North America to develop three distinct ML models. We used data of ten sites to predict clinically meaningful improvement or worsening by comparing pre-surgical scores with 2 year follow-up data measured by validated Breast-Q domains. We employed ten-fold cross-validation to train and test the algorithms, and then externally validated them using the 11th site’s data. We considered area-under-the-receiver-operating-characteristics-curve (AUC) as the primary metric to evaluate performance. Results: Overall, between 1454 and 1538 patients completed 2 year follow-up with data for physical, sexual, and psychosocial well-being. In the hold-out validation set, our ML algorithms were able to predict clinically significant changes in physical well-being (chest and upper body) (worsened: AUC range 0.69–0.70; improved: AUC range 0.81–0.82), sexual well-being (worsened: AUC range 0.76–0.77; improved: AUC range 0.74–0.76), and psychosocial well-being (worsened: AUC range 0.64–0.66; improved: AUC range 0.66–0.66). Baseline patient-reported outcome (PRO) variables showed the largest influence on model predictions. Conclusions: Machine learning can predict long-term individual PROs of patients undergoing postmastectomy breast reconstruction with acceptable accuracy. This may better help patients and clinicians make informed decisions regarding expected long-term effect of treatment, facilitate patient-centered care, and ultimately improve postoperative health-related quality of life.

60 APPLIED LIFE SCIENCES↗