Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Evaluation Framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Charge Transport in Solvated Donor–Acceptor Functionalized Peptoids: Molecular Dynamics and Rate Theory

Scalable solar-energy conversion requires photoactive materials that combine the efficiency of natural photosynthetic systems with the stability and processability needed for practical applications. Achieving reliable charge transport in soft, self-assembled organic materials remains challenging, as structural fluctuations and environmental effects strongly influence charge-transfer (CT) rates. Here, we present a broadly applicable computational framework for evaluating CT rates in the condensed phase, combining Fermi’s golden rule rate theory with inputs from all-atom molecular dynamics (MD) simulations and first-principles electronic-structure calculations. The approach does not rely on system-specific parametrization and is applicable to a wide range of soft and disordered materials. We demonstrate the applicability and usefulness of the framework on redox-active peptoids functionalized with iron–porphyrin (Fe–P) complexes, a bioinspired platform with programmable donor–acceptor units and tunable three-dimensional organization. The calculated CT rates exhibit strong sensitivity to molecular conformation, with variations spanning several orders of magnitude. This dependence is shown to arise from the pronounced variation in diabatic electronic coupling with the relative orientations and separations of the Fe–P complexes across the conformational ensemble. The framework provides a consistent route for connecting atomistic structure to CT kinetics in the condensed phase and enables analysis of structure–rate relations in organic semiconducting systems.

Charge transfer↗

A General Framework for Error-controlled Unstructured Scientific Data Compression

Data compression plays a key role in reducing storage and I/O costs. Traditional lossy methods primarily target data on rectilinear grids and cannot leverage the spatial coherence in unstructured mesh data, leading to suboptimal compression ratios. We present a multi-component, error-bounded compression framework designed to enhance the compression of floating-point unstructured mesh data, which is common in scientific applications. Our approach involves interpolating mesh data onto a rectilinear grid and then separately compressing the grid interpolation and the interpolation residuals. This method is general, independent of mesh types and typologies, and can be seamlessly integrated with existing lossy compressors for improved performance. We evaluated our framework across twelve variables from two synthetic datasets and two real-world simulation datasets. The results indicate that the multi-component framework consistently outperforms state-of-the-art lossy compressors on unstructured data, achieving, on average, a 2.3 − 3.5× improvement in compression ratios, with error bounds ranging from 1 × 10 the −6 to 1×10−2. We further investigate impact of hyperparameters, such as grid spacing and error allocation, to deliver optimal compression ratios in diverse datasets.

Gong, Qian↗

Evaluating Energy Efficiency Opportunities from Connected and Automated Vehicle Deployments Coupled with Shared Mobility in California

Connected and Automated Vehicles (CAVs) can be considered to be a disruptive transportation technology, with the potential to significantly improve overall transportation system efficiency; however, CAVs may increase induce vehicle miles traveled (VMT) and bring on greater energy consumption. Further, shared mobility is another disruptive transportation event that is reshaping our travel patterns. The primary goal of this project was to extensively collect data from vehicles and associated infrastructure equipped with CAV technologies from both real-world experiments and simulation studies mainly deployed in California, and develop a comprehensive framework for evaluating energy efficiency opportunities from large-scale (e.g., statewide) introduction of CAVs and a wide deployment of shared mobility systems in a variety of scenarios. To quantify the combined impact of CAV and shared mobility on travel behavior, traffic performance, and energy efficiency, a unique mesoscopic simulation-based model was developed for mobility and energy efficiency evaluation considering these disruptive transportation technologies. As a complement to existing studies on nationwide evaluation of CAVs’ energy impacts, this project was focused on data collection efforts and CAV applications under congested traffic environments that are frequently experienced on a massive scale across the major metropolitan areas in California. Extensive real-world data collection supplemented with simulation studies were conducted to cover a variety of CAV and shared mobility scenarios, particularly on scenarios less-explored in the existing research. Another key component of this project was to consider the interaction between different CAV technologies and shared mobility models, and the compound effect on energy efficiency. A comprehensive modeling suite was developed to quantify the impact of new mobility technologies on travel behavior and traffic performance. The developed modeling framework includes an energy intensity module, mode choice module and activity generation module that are integrated into an agent-based BEAM simulation platform to perform impact analysis based on a variety of scenarios. In addition, the RouteE model has been upgraded to incorporate the impact of CAVs on traffic flow, VMT and energy intensity, using micro-simulation data collected from both freeways and urban arterials. A novel fundamental influencing factor (FIF) mode choice model was developed to link CAV and shared mobility components with travel behaviors, and adapted into the BEAM-centered model framework. A statewide energy inventory was constructed under various CAV technology deployment scenarios by incorporating datasets and models for predicting vehicle market share and vehicle usage, which are tightly associated with the penetration of shared mobility systems. Based applying this modeling suite to a calibrated network in Riverside California, it was found that cooperative automated driving in general will improve mobility, but automated vehicles, even when deployed in a shared autonomous fleet, will likely bring an increase of VMT (up to 36%) due to mode shifts and deadheading. Ride-hailing vehicles typically have better energy efficiency and a higher share of electric vehicles, which helps offset the negative impact from VMT increases when estimating the system-level energy consumption. In general, simulation results show a 6% increase in energy consumption for the scenarios with an increasing shift to ride-hailing modes. The statewide analysis based on the National Household Travel Survey (NHTS) sample data is consistent with the findings from the Riverside network and validate the developed clustering-prediction modeling methodology. The outcomes from this project will help close the knowledge gap on recognizing the potential performance and energy impacts of a broad deployment of CAV and shared mobility technologies across a wide range of roadway infrastructure with varying levels of congestion. Results from this project: 1) will support policymakers in steering CAV development and deployment towards an energy favorable direction; 2) reduce uncertainties in estimating energy saving opportunities from new mobility technologies and services; 3) increase the confidence of CAV technology investors both on the infrastructure side (i.e., transportation agencies) and on the vehicle side (i.e., OEMs); and 4) expedite the deployment of energy-efficient CAV and shared mobility applications.

33 ADVANCED PROPULSION SYSTEMS↗

The Policy Mullet: Good Intentions in the Front, Bad Policy in the Back

To achieve important policy goals like decarbonization, energy efficiency, and social justice, it is important to translate high-level policy into operational practice. Establishing sustainable purchasing goals has been one important part of this translation. However, not all sustainable purchasing policies are equally effective for organizations. In this study, we analyze sustainable purchasing policies collected from 30 public-sector organizations. We discuss a theoretical framework of optimal policy language and use that framework to evaluate the policies we collected. We believe that an ideal sustainable purchasing policy can increase the likelihood of implementation success by providing more product-specific guidance, giving authority to procurement staff, setting performance targets, and requiring reporting to account for progress. In our review of public sector sustainable purchasing policies, we found that policy language is less than ideal when measured against the framework. Based on our findings, we highlight the best practice language organizations can use in their sustainable purchasing policies to meet sustainability goals. While there is more work needed to inform best practices with sustainable purchasing policies, we recommend that organizations utilize existing frameworks when developing a sustainable purchasing policy to encourage better implementation.

99 GENERAL AND MISCELLANEOUS↗

Exact statistics of helical wormlike chains with twist-bend coupling

Here, we present a solution for the Green's function for the general case of a helical wormlike chain with twist-bend coupling and demonstrate the applicability of our solution for evaluating general structural and mechanical chain properties. We find that twist-bend coupling renormalizes the persistence length and the force-extension curves relative to wormlike chains. Analysis of intrinsically twisted polymers shows that incorporation of twist-bend coupling results in the oscillatory behavior in principal tangent correlations that are observed in some studies of synthetic polymers. The exact nature of our solution provides a framework to evaluate the role of twist-bend coupling on polymer properties, such as DNA bound to histones and motivates the reinterpretation of existing biopolymer experimental data.

Ghosh, Ashesh [University of California, Berkeley,↗

Autoencoder-Based Sensor Drift Detection and Mitigation for Resilient Charging Systems

This work presents an autoencoder-based approach for sensor signal reconstruction and drift detection for charging systems. The proposed strategy is implemented within a Simulink-based system framework and evaluated under multiple operating conditions. An autoencoder with 8 neurons in the bottleneck layer is adopted, achieving accurate reconstruction across 10 variables and strong agreement with the physical sensor readings under normal conditions. In the case of a sensor fault, the autoencoder reconstruction remains closer to the expected true value compared to the corrupted measurement. Furthermore, feeding the autoencoder-reconstructed signal value back into the control framework in place of the faulty sensor signal leads to improved power monitoring. These results highlight the potential of autoencoder-based virtual sensing to extend the concept of resiliency to all components of the charging system, including sensors.

Rezende Da Costa Reis Kimpara, Renata [ORNL] (ORCI↗

Evaluating Stage Motion for Automated Electron Microscopy

Abstract Precise control is an essential and elusive quality of emerging self-driving transmission electron microscopes (TEMs). It is widely understood these instruments must be capable of performing rapid, high-volume, and arbitrary movements for practical self-driving operation. However, stage movements are difficult to automate at scale, owing to mechanical instability, hysteresis, and thermal drift. Such difficulties pose major barriers to artificial intelligence-directed microscope designs that require repeatable, precise movements. To guide design of emerging instruments, it is necessary to understand the behavior of existing mechanisms to identify rate limiting steps for full autonomy. Here, we describe a general framework to evaluate stage motion in any TEM. We define metrics to evaluate stage degrees of freedom, propose solutions to improve performance, and comment on fundamental limits to automated experimentation using present hardware.

47 OTHER INSTRUMENTATION↗

Beyond Contrast Transfer: Spectral SNR as a Finite-Dose Metric for STEM Phase Retrieval

The contrast transfer function (CTF) is widely used to evaluate phase retrieval methods in scanning transmission electron microscopy (STEM), including center-of-mass imaging, parallax imaging, direct ptychography, and iterative ptychography. However, the CTF reflects only the maximum usable signal, neglecting the effects of finite electron fluence and the Poisson-limited nature of detection. As a result, it can significantly overestimate practical performance, especially in low-dose regimes. Here, we employ the spectral signal-to-noise ratio (SSNR), as a finite-dose statistical framework to evaluate the recoverable signal as a function of spatial frequency. Using numerical reconstructions of white-noise objects, we show that center-of-mass, parallax, and direct ptychography exhibit dose-independent SSNRs, with close-form analytic expressions. In contrast, iterative ptychography exhibits a surprising dose dependence: at low fluence, its SSNR converges to that of direct ptychography; at high fluence, it saturates at a value consistent with the maximum detective quantum efficiency predicted by recent quantum Fisher information bounds. The results highlight the limitations of CTF-based evaluation and motivate SSNR as a more accurate, finite-dose metric for assessing STEM phase retrieval methods.

STEM phase retrieval↗

A unified large language model–based framework for heterogeneous PV image diagnosis

With advances in imaging technologies, modern photovoltaic (PV) systems generate large volumes of heterogeneous image data, including visible, electroluminescence (EL), and infrared (IR) images. Existing PV image analysis models, particularly deep learning approaches, are typically task-specific and lack cross-modality generalization. To address this limitation, this paper proposes an open-source large language model (LLM)–based unified framework for heterogeneous PV image diagnostics. Through task-aware diagnostic prompting, the framework enables analysis of visible, EL, and IR images within a single pipeline, supporting both zero-shot and few-shot inference and binary and multiclass classification. It is compatible with state-of-the-art multimodal LLMs, including ChatGPT, Gemini, Claude, Qwen, and CLIP. The framework is evaluated on PV module condition classification (clean, soiling, snow, hail, and bird droppings) using visible images, cell crack detection using EL images, and hotspot detection using IR images. GPT-5.1 in few-shot mode achieves the best performance, with classification accuracy exceeding 97.3%. Open-source models such as Qwen and CLIP also deliver competitive results on visible images (around 90% accuracy), though their performance is more limited on EL and IR modalities. On the full ELPV dataset, the framework achieves 83.5% zero-shot accuracy, within 2.8% of the supervised CNN baseline, confirming scalability to larger benchmarks. Practical aspects such as reproducibility, response latency, and confidence estimation are systematically analyzed. The framework operates across PV image modalities without modality- or task-specific training, making it well suited as a rapid pre-screening tool to support downstream detailed diagnostics. A benchmark dataset of diverse labeled PV images is also released.

Li, Baojie↗

pyQuARC: Open Source Library for Earth Observation Metadata Quality Assessment

Metadata quality is essential to effective data discovery and has become increasingly vital as more Earth Science data sets become available. The Common Metadata Repository (CMR) hosts metadata describing NASA’s Earth Observation data products, which are archived across 12 Distributed Active Archive Centers (DAACs). The Analysis and Review of CMR (ARC) Team, located at Marshall Space Flight Center, conducts metadata quality assessments to ensure that these data products are discoverable, accessible, and usable. To achieve these goals, the ARC team has developed a metadata quality assessment framework to evaluate metadata completeness, correctness, and consistency. ARC uses a combination of manual and automated methods to assess these three components and identify areas of improvement; the team then collaborates with the DAACs to resolve any findings. To streamline this process, ARC is currently developing a host of scripts, known as pyQuARC, to automate metadata quality assessments as much as possible. pyQuARC is an open source library for Earth Observation Metadata Quality Assessment, and the tool utilizes ARC’s metadata quality assessment framework to make basic validation checks, pinpoint inconsistencies between dataset-level (i.e. collection) and file-level (i.e. granule) metadata, and identify opportunities for more descriptive and robust information. Since pyQuARC is also customizable, other users can make modifications as needed, and future metadata standards can also be implemented. Once pyQuARC is fully developed, it will support multiple schema types to serve the broader EOSDIS metadata community. This presentation will provide an overview of pyQuARC and its process of development while showcasing the tool’s valuable features and uses.

Jenny Wood↗

Evaluation of NASA's High-Resolution Global Composition Simulations: Understanding a Pollution Event in the Chesapeake Bay During the Summer 2017 OWLETS Campaign

Recirculation of pollutants due to a bay breeze effect is a key meteorological mechanism impacting air quality near urban coastal areas, but regional and global chemical transport models have historically struggled to capture this phenomenon. We present a case study of a high ozone (O3) episode observed over the Chesapeake Bay during the NASA Ozone Water-Land Environmental Transition Study (OWLETS) in summer 2017. OWLETS included a complementary suite of ground-based and airborne observations, with which we characterize the meteorological and chemical context of this event and develop a framework to evaluate model performance. Two publicly-available NASA global high-resolution coupled chemistry-meteorology models (CCMMs) are investigated: GEOS-CF and MERRA2-GMI. The GEOS-CF R squared value for comparisons between the NASA Sherpa C-23 aircraft measurements to the GEOS-CF resulted in good agreement (R squared: 0.67) on July 19th and fair agreement (R squared: 0.55) for July 20th. Compared to surface observations, we find the GEOS-CF product with a 25 x 25 km squared grid box, at an hourly (R squared: 0.62 to 0.87) and 15-minute (R squared: 0.64 to 0.87) interval for six regional sites outperforms the hourly nominally 50 x 50 km squared gridded MERRA2-GMI (R squared: 0.53 to 0.76) for four of the six sites, suggesting it is better capable of simulating complex chemical and meteorological features associated with ozone transport within the Chesapeake Bay airshed. When the GEOS-CF product was compared to the TOLNet LiDAR observations at both NASA Langley Research Center (LaRC) and the Chesapeake Bay Bridge Tunnel (CBBT), the median differences at LaRC were -6 to 8% and at CBBT were ± 7% between 400 to 2000 m ASL. This indicates that, for this case study, the GEOS-CF is able to simulate surface level ozone diurnal cycles and vertical ozone profiles at small scales between the surface level and 2000 m ASL. Evaluating global chemical model simulations at sub-regional scales will help air quality scientists understand the complex processes occurring at small spatial and temporal scales within complex surface terrain changes, simulating nighttime chemistry and deposition, and the potential to use global chemical transport simulations in support of regional and sub-regional field campaigns.

NASA Ozone Water-Land Environmental Transition Stu↗

Developing and Evaluating Energy Justice Metrics for Early-Stage Materials Research

Materials science is a central component of early-stage research and development of virtually all clean energy technologies. But as much as material breakthroughs often hold the key to high efficiencies, long lifetimes, and high stability in eventual devices, early-stage choices about material types, structures, and processing can also serve to lock in long-term social and equity impacts of deployed energy technologies. Thus, to achieve a just and sustainable energy transition, tools to assess the energy justice impacts of early-stage materials research are critical. Here, we discuss development of the Justice Underpinning Science and Technology Research (JUST-R) metrics framework - a suite of metrics targeted at early-stage researchers to assess energy justice considerations in their work. The framework is evaluated for its appeal to researchers and effectiveness at promoting integration of energy justice into research through case studies, which reveal its ability to broaden researcher perspectives and key avenues for future improvement.

energy justice↗

A Comparative Study of Electrical Double Layer Effects for CO Reduction Reaction Kinetics

Solvation models describe how the interactions between the solutes and solvents affect the reactivity and selectivity in electrochemical processes. In this study, we developed a framework for evaluating the effects of applied potential and electrical double layer on CO reduction (COR), comparing fully explicit, implicit, and hybrid solvation models at the standard hydrogen electrode (SHE) scale. We analyzed all crucial intermediates leading to the production of C 1 and C 2 products and found good agreement across these models. Some notable differences were observed in the implicit description of *C and *CO adsorption at higher overpotentials and overall trends in the adsorption energies within the hybrid model. Using this unified SHE framework, we built comparable microkinetic models for COR kinetics and rates. Despite small differences in thermodynamics, solvation-model-based microkinetic simulations showed good agreement for onset potentials against the benchmark experiment. Only qualitative difference was observed for C 1+ versus hydrogen evolution at high overpotentials for the implicit model. Finally, we constructed a generalized C 2 selectivity map in descriptor space (U SHE , ΔG electrolyte CO ), which highlights the limitations of a copper-based COR catalyst and guides the search for optimal descriptor parameters to maximize C 2 selectivity. In conclusion, these findings demonstrate the importance of considering electrical double layer effects in reduction reactions and offer a useful framework for comparing solvation models and predicting optimal electrochemical conditions for specific applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Dynamic analysis of fully constrained Cable-Driven Parallel Robots for automated prefabricated component installation

This paper presents a dynamic analysis and validation framework to assess a fully constrained six-anchor Cable-Driven Parallel Robot (CDPR) for automated installation of prefabricated facade components. Compared with conventional eight-anchor systems, the six-anchor configuration simplifies setup and reduces cost, but it also reduces control authority, shrinks the wrench-feasible workspace, and tightens orientation limits. Consequently, it is unclear a priori whether dynamically feasible trajectories exist to move the end effector from pickup to the facade. A constrained trajectory optimization is formulated to enforce the system dynamics, cable-tension bounds, and pose/velocity limits, and the framework is evaluated in simulation at three levels: (i) an idealized reference model, (ii) a lab-scale prototype model incorporating measured anchor misalignments and identified damping, and (iii) a full-scale three-story building model with load decomposition for structural feasibility checks. Across these scenarios, the analysis shows that optimal, constraint-satisfying trajectories exist that move the end effector from pickup to installation while maintaining a near-plumb, level orientation at the final pose. Collectively, this multi-scale dynamic analysis and validation framework supports the deployment readiness of the six-anchor CDPR and provides a prototype-based sensitivity case study of how measured anchor placement deviations affect feasibility.

CDPR↗

Business Case Analysis for Artificial Intelligence-Large Language Model Technology Integration

AI-assisted processes are expected to enhance operational efficiency and improve decision-making, supporting the long-term economic viability of nuclear power plants. However, detailed business analyses of AI-generated cost savings are rarely performed. Given the recent industry interest in Large Language Model (LLM), the U.S. Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) Program has conducted a comprehensive business case analysis of LLM Artificial Intelligence (AI) implementation in nuclear plant engineering workflows. The research employed three complementary business case approaches to evaluate impact of an LLM, using three representative engineering processes as use-cases: Boric Acid Corrosion (BAC) Evaluations, Maintenance Rule Evaluations, and 10 CFR 50.59 Screenings. Through detailed workload analyses and structured interviews, the study quantified significant efficiency improvements ranging from 11% to 59% across these processes. The research further considers how these efficiency gains could translate into tangible reliability improvements through enhanced engineering capacity. Analysis of historical plant trip data indicates that enabling engineers to focus on proactive reliability activities could provide substantial financial benefits through avoided outages, potentially generating greater value than the direct efficiency improvements alone. By documenting successful applications, implementation challenges, and strategic opportunities, this research provides nuclear utilities with a practical framework for evaluating the value of AI technology to support long-term operations through advanced digital technologies.

97 MATHEMATICS AND COMPUTING↗

Hardware-in-the-Loop Evaluation for Potential High Limit Estimation-Based PV Plant Active Control: Preprint

This paper validates the effectiveness of an Artificial Intelligence (AI)-driven PV plant control and optimization approach, namely, the Automated Learner for Intermittency Control by Extrapolation (ALICE), in empowering PV plant as a dependable grid reliability service provider. The validation is performed in a realistic laboratory controller-hardware-in-the-loop (CHIL) environment, leveraging accurate PV plant modeling and standard industrial communication protocol. Simulation results, considering both varying weather conditions and active control scenarios, demonstrate the superior performance of ALICE in improving the grid service delivery precision and reducing the over-curtailment compared to a state-of-the-art approach, i.e., reference-control grouping based approach. Such a work could help mitigate risks and provide practical guidance during the field deployment of ALICE, while establishing a standardized testing framework for evaluating various PV active control strategies.

hardware-in-the-loop↗

Assessment of Precipitating Marine Stratocumulus Clouds in the E3SMv1 Atmosphere Model: A Case Study from the ARM MAGIC Field Campaign

This paper presents a process-oriented evaluation of precipitating stratocumulus and its transition to cumulus in version 1 of the Energy Exascale Earth System Model (E3SMv1) using comprehensive case-study observations from a field campaign of the Atmospheric Radiation Measurement program (ARM). The E3SMv1 single-column model (SCM) of the marine boundary layer and its low clouds and precipitation are compared to observations including subcloud drizzle retrievals from a combination of Doppler radar and lidar backscatter measurements. Additionally, the SCM is also compared to a large-eddy simulation (LES) of the same case. The combination of advanced remote sensing observations and LES is a powerful framework to evaluate the physical parameterizations of large-scale models. Given the observed large-scale environment, the E3SMv1 SCM realistically represents the evolution of clouds and boundary layer structure during the stratocumulus-to-cumulus transition. The model well simulates the liquid water path and its diurnal cycle in the stratocumulus period as well as the two-layer vertical thermodynamic structure and lower cloud fraction in the transition period. E3SMv1’s success in simulating the cloud in the stratocumulus period permitted examination of its precipitation processes. Here problems were identified with E3SMv1 producing an unrealistically small subcloud precipitation fraction, an unrealistic double peak in the vertical profiles of precipitation mass, and drizzle that evaporates too close to the surface. Further model diagnostics determined that these unrealistic characteristics resulted from an overly long microphysics time step and an unrealistic parameterization of the precipitation fraction. These results imply that careful consideration of these issues is needed in order to better simulate precipitation processes in marine stratocumulus.

54 ENVIRONMENTAL SCIENCES↗

Poster: Responsible Adoption of Artificial Intelligence (AI) in Electric Grid Operations

The rapid integration of artificial intelligence (AI) in the utility transmission and distribution (T&D) sector is revolutionizing traditional grid management practices. As utilities encounter complexities from evolving consumer behaviors and energy integration, AI becomes a critical solution for enhancing grid monitoring, fault detection, and operational optimization. However, increased reliance on interconnected technologies introduces significant cybersecurity risks, regulatory compliance challenges, and human factors concerns. This study proposes a strategic, responsible and consequence-driven approach to AI implementation, examining the dual nature of AI adoption by highlighting its transformative benefits for utilities and associated risks. It provides utilities with a framework for evaluating AI integration, enabling them to navigate challenges and capitalize on opportunities to achieve greater reliability, efficiency, and resilience in an increasingly complex energy landscape.

24 - POWER TRANSMISSION AND DISTRIBUTION↗