SEARCH · Engineering Papers

Results for “evaluation framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,171 records · Page 65

All sources NASA NTRS DOE OSTI

DOE OSTI2026

Voltage Service Limits Smart Contract Using Distributed Ledger Technology for Electrical Utility Grid with Customer-Owned Generator

Modern electrical grids face growing stability risks from customer-owned generators, especially at points of common couplings (PCCs). Disruptive behavior from power-electronic sources can cause protective relays to isolate problematic generators, making measurement integrity critical. This article presents a distributed ledger technology (DLT) approach that uses smart contracts to evaluate PCC voltage measurements and trigger backup breaker operations. The approach is framed as a verifiable, multi-organization attestation and audit layer, not as a real-time control security mechanism. In the proposed architecture, voltage measurements from a hardware protective relay are anchored on a DLT through the Cyber Grid Guard (CGG) system for attestation by both the grid utility and customer-owned generator. A Voltage Service Limits (VSLs) smart contract evaluates the on-chain measurements against allowable phase-voltage limits derived from the ANSI C84.1 standard. The framework is validated in a hardware-relay-in-the-loop test bed under sustained-undervoltage, sustained-overvoltage, and transient line-to-line fault scenarios. The results show that the VSL smart contract can process these measurements and issue backup breaker actions consistent with the defined service-limit criteria, demonstrating the DLT potential as a verifiable audit layer at the PCC that complements primary protection.

cyber security↗

DOE OSTI2026

RTN-117: Image Calibration and Instrument Signal Removal for the First Year of the LSST

The NSF-DOE Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) requires calibration products that provide uniform, stable, and accurate photometric and astrometric performance across the 3.2 gigapixel focal plane and throughout the 10-year survey. This paper details the algorithms and workflows used to produce instrument calibrations and remove instrumental artifacts for Data Preview 2 (DP2)---the first end-to-end processing demonstration using on-sky data with the LSST Camera (LSSTCam). We describe the verification, acceptance, and certification framework used to assess calibration quality and quantify residual systematics. We show baseline metrics on calibrated science images to evaluate the robustness of the calibration and instrument signature removal (ISR) data processing pipelines for DP2. Finally, we summarize the known limitations observed in DP2 production and outline expected algorithmic improvements for the first public LSST data release (Data Release~1, DR1).

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2021

Seeding picoscale solutions for social macro goals: complex thinking in projects for vulnerable communities

This chapter presents lessons learned from two experiences of implementing sociopoliticalsustainability strategies to achieve environmental and economic sustainability.The projects were carried out in rural communities in Guinea-Bissau andJamaica, which are both vulnerable to climate change. Each experience, developedfrom a systemic perspective and under two frameworks (the water–food–energynexus and ‘Appropriate Technology’), is described in four phases (problemcharacterization, solution design, solution pre-evaluation, and implementation),with the significant findings made by the team in terms of challenges, rewards, andessential conditions for development. Both deal with environment-friendly solutionsthat solve the problems of water and energy provision. Based on complex thinking,the experiences are analyzed from the social inclusion, participation, empowerment,and learning theory viewpoints. Finally, the insights gained by the team arehighlighted: communication requirements, the level of dependency of industrializedsolutions, budget constraints, training, testing, and planning recommendations, thediversity of interaction with the communities, and partners’ skills. As a result, futureactions can exploit these experiences and contribute to the success of subsequentprojects.

Pereira Pinto, Joao↗

DOE OSTI2024

SimPoint++: Less Simulation Points

We propose SimPoint++, which replaces the BIC method by combining WCSS and Silhouette to find the optimal cluster. The new Python framework of SimPoint++ provides a dimension reduction pipeline for effective clustering and supports multi-thread application analysis. We evaluate SimPoint++ with Spec CPU 2017 benchmarks. SimPoint++ achieves comparable or higher accuracy with significantly fewer simulation points, resulting in a 5x speed-up in simulation time compared to state-of-the-art solutions.

Chen, Si↗

DOE OSTI2023

Templates of expected measurement uncertainties

The covariance committee of CSEWG (Cross Section Evaluation Working Group) established templates of expected measurement uncertainties for neutron-induced total, (n,γ), neutron-induced charged-particle, and (n,xn) reaction cross sections as well as prompt fission neutron spectra, average prompt and total fission neutron multiplicities, and fission yields. Templates provide a list of what uncertainty sources are expected for each measurement type and observable, and suggest typical ranges of these uncertainties and correlations based on a survey of experimental data, associated literature, and feedback from experimenters. Information needed to faithfully include the experimental data in the nuclear-data evaluation process is also provided. These templates could assist (a) experimenters and EXFOR compilers in delivering more complete uncertainties and measurement information relevant for evaluations of new experimental data, and (b) evaluators in achieving a more comprehensive uncertainty quantification for evaluation purposes. This effort might ultimately lead to more realistic evaluated covariances for nuclear-data applications. In this topical issue, we cover the templates coming out of this CSEWG effort–typically, one observable per paper. This paper here prefaces this topical issue by introducing the concept and mathematical framework of templates, discussing potential use cases, and giving an example of how they can be applied (estimating missing experimental uncertainties of 235 U(n,f) average prompt fission neutron multiplicities), and their impact on nuclear-data evaluations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2022

The locational value of distributed energy resources: A parcel-level evaluation of solar and wind potential in New York state

We report distributed energy resources (DERs) are poised to play a significant role in evolving power systems because of their flexibility to be sited in areas of high value to the grid. Traditional DER compensation frameworks, specifically net energy metering (NEM), inadequately communicate differences in the locational and temporal value of DER generation to the grid. As a transition from NEM, New York State's (NYS's) Value of Distributed Energy Resources (VDER) framework provides a methodology for calculating different value components that DERs offer the grid. To study the impacts of VDER frameworks on DER deployment, we developed a model to assess the value of distributed solar and wind systems configured as either a behind-the-meter system or a front-of-the-meter system for each parcel of land in NYS. Using parcel-level granularity, we can closely evaluate DER locational value and siting availability, particularly in urban and suburban settings. Our analysis finds while most DER generators would be modestly compensated for deferred transmission and distribution infrastructure upgrades (~0.01 $\$$/kWh for solar PV), a subset of projects receive significant value from this component (0.035 to 0.089 $\$$/kWh for top 5% of parcels for solar PV). Finally, our analysis finds VDER provides less overall compensation than NEM to the average DER generator, however, it increases access to compensation for front-of-the-meter DERs - a large and emerging market.

14 SOLAR ENERGY↗

DOE OSTI2022

Evaluation of Physical Security Risk for Potential Implementation of FLEX using Dynamic Simulation Methods

The requirements for United States nuclear power plants to maintain a large onsite physical security force contribute to their large operational costs. The cost of maintaining the current physical security posture is approximately 10% of the overall operation and maintenance budget for commercial nuclear power plants. The goal of the Light Water Reactor Sustainability Program Physical Security Pathway is to develop tools, methods, and technologies and provide the technical basis for an optimized physical security posture. This pathway will analyze and minimize the conservatisms built into current security postures in order to reduce security costs while still ensuring adequate security and operational safety. The research performed at Idaho National Laboratory within this pathway has successfully developed a dynamic force-on-force (FOF) modeling framework using various computer simulation tools and integrated them with the dynamic assessment Event Modeling Risk Assessment using Linked Diagrams (EMRALD) tool. This document provides an overview of lessons learned in applying a dynamic computational framework that links results from a commercially available FOF simulation tool, a commercially available thermal-hydraulic tool, and EMRALD to an operating commercial nuclear power plant. This process of including plant procedures and multiple analysis results is being called Modeling and Analysis for Safety Security using Dynamic EMRALD Framework. Previous reports described how a user could integrate their plant-specific FOF models with the dynamic simulation tool EMRALD, model operator actions, integrate with probabilistic risk assessment tools, such as Computer Aided Fault Tree Analysis System or Systems Analysis Programs for Hands-on Integrated Reliability Evaluations, and with thermal-hydraulic tools, such as RELAP-5. Previous reports applied various combinations of available simulations codes with EMRALD using generic plant models to demonstrate how to perform the analysis. This report documents the results of applying the dynamic computational framework to an actual nuclear facility using their security scenarios and timelines. The purpose of this study was to verify that results achieved using generic models are similar to actual plant results and to refine our guidance of the use of the framework. Such an assessment enables further analysis, such as what-if scenarios and staff-reduction evaluation, thereby optimizing physical security at plants. NOTE: The work performed in this report is based on a generic EMRALD model with actual plant data used for the analysis. However, only the generic model and general results of the analysis are in the report. No plant’s sensitive information is discussed in this report. The discussion shows examples of insights that can be obtained from the MASS-DEF methodology.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2024

Techno-Economic Optimization of Fixed Bed and Moving Bed Contactors for CO2 Capture from NGCC Plants Using a Functionalized Metal-Organic Framework

Amine-appended metal–organic frameworks (MOFs) have strong potential for post-combustion CO2 capture from NGCC plants. In this work, a specific tetramine-appended MOF, Mg2(dobpdc)(3-4-3) (dobpdc4− = 4,4′-dioxidobiphenyl-3,3′dicarboxylate; 3-4-3 = N,N′bis(3-aminopropyl)-1,4-diaminobutane), is evaluated due to its superior performance compared to other candidate diamine-appended and tetraamine-appended MOFs. Techno-economic optimization is performed to minimize the cost of capture by using the Framework for Optimization, Quantification of Uncertainty, and Surrogates (FOQUS), which is capable of optimizing systems by using derivative-free optimization solvers where process models are built using numerous modeling platforms. The technical and economic performances of both fixed bed and moving bed processes are compared with state-of-the-art amine-based solvent systems.

Hughes, Ryan↗

DOE OSTI2025

Corral Summit Pumped Storage Hydropower Hybrid: Site Suitability Assessment

In 2024, Idaho National Laboratory (INL) and Pacific Northwest National Laboratory (PNNL) initiated a technical-assistance project to support Cat Creek Energy, LLC, (CCE) in evaluating site suitability for the proposed Corral Summit Pumped Storage Hydropower (PSH) project in south-central Idaho near Mackay Reservoir. The Corral Summit facility incorporates battery storage and photovoltaic (PV) solar arrays in a Trybrid configuration to deliver large-volume long-duration (LVLD) storage solutions for rural electric cooperatives in eastern Idaho. The evaluation process focused on determining the most-suitable location for the upper reservoir of the PSH system, guided by a comprehensive assessment framework spanning multiple categories, including physical characteristics, environmental constraints, building infrastructure, regulatory constraints, cultural resources and sensitivity, social factors, and power market and grid integration. Each site was analyzed based on a ranking scale (0–1), which scores ranging from “severely disfavored” to “highly favored,” allowing detailed comparisons of site-specific conditions. Categories such as hydraulic head, utilities corridor, land ownership, and transmission-grid limitations emerged as key contributors to the overall assessment. Site 2 (Idaho Trust) demonstrated a slight advantage over Site 1 (Bureau of Land Management) primarily due to favorable outcomes in regulatory constraints, building infrastructure, and power-market integration. However, Site 1 outperformed Site 2 in factors related to physical characteristics and social factors. The report emphasizes the need for further evaluation of both sites before clear determination of which site is preferred, due to the limited information available on either site at the time of this report. Key areas of evaluation to clearly define the preferred site are ecological impacts, cultural-resource surveys, and economic-feasibility assessments. For successful project execution, recommended follow-up actions include seismic and geotechnical surveys, groundwater and habitat monitoring, regulatory reviews of water rights and right-of-way agreements, cultural engagement with local tribal governments, and enhanced stakeholder strategies. These efforts will ensure the Corral Summit Trybrid facility meets local energy needs while balancing environmental, social, and regulatory responsibilities.

13 - HYDRO ENERGY↗

DOE OSTI2025

Corral Summit Pumped Storage Hydropower Hybrid Site Suitability Assessment (Rev.1)

13 - HYDRO ENERGY↗

DOE OSTI2023

A projection-based analytical Jacobian framework for chemical kinetics applications

A major challenge in simulating complex combustion systems with detailed chemical kinetic models is the cost of integrating the chemical source terms, often done using stiff ODE solvers that require frequent Jacobian evaluations. Using analytically derived Jacobian matrices instead of divided-difference-based numerical Jacobian approximations can significantly reduce the associated computational cost. However, ambiguities arise in the formulation of analytical Jacobians because the chemical state of the system, or state vector, can be expressed in multiple ways, involving variables that are typically not independent from one another. Here, in this work, the consequences of those ambiguities on practical calculations are characterized in detail, and a generalized, projection-based framework is proposed as a mitigation strategy. Performances are assessed in a series of test cases involving a variety of configurations and numerical solution approaches. Results show that with proper treatment, commonly used analytical Jacobian formulations can be considered as equivalent for practical purposes, thereby alleviating concerns that the state vector chosen to express the governing equations and corresponding analytical Jacobian may significantly impact the accuracy of the simulations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2020

FPDeep: Scalable Acceleration of CNN Training on Deeply-Pipelined FPGA Clusters

In this paper, we propose a framework called FPDeep, which uses a hybrid of model and layer paral- lelism to configure distributed reconfigurable clusters to train DNNs. This approach has numerous benefits. First, the design does not suffer from batch size growth. Second, novel workload and weight partitioning leads to balanced loads of both among nodes. And third, the entire system is fine-grained pipeline. This leads to high parallelism and utilization and also minimizes the time features need to be cached while waiting for back-propagation.

Wang, Tianqi↗

DOE OSTI2021

Comparative evaluation of deep learning workloads for leadership-class systems

Deep learning (DL) workloads and their performance at scale are becoming important factors to consider as we design, develop and deploy next-generation high-performance computing systems. Since DL applications rely heavily on DL frameworks and underlying compute (CPU/GPU) stacks, it is essential to gain a holistic understanding from compute kernels, models, and frameworks of popular DL stacks, and to assess their impact on science-driven, mission-critical applications. At Oak Ridge Leadership Computing Facility (OLCF), we employ a set of micro and macro DL benchmarks established through the Collaboration of Oak Ridge, Argonne, and Livermore (CORAL) to evaluate the AI readiness of our next-generation supercomputers. In this paper, we present our early observations and performance benchmark comparisons between the Nvidia V100 based Summit system with its CUDA stack and an AMD MI100 based testbed system with its ROCm stack. We take a layered perspective on DL benchmarking and point to opportunities for future optimizations in the technologies that we consider.

Yin, Junqi↗

DOE OSTI2023

Robust Vector BOTDA Signal Processing with Probabilistic Machine Learning

This paper presents a novel probabilistic machine learning (PML) framework to estimate the Brillouin frequency shift (BFS) from both Brillouin gain and phase spectra of a vector Brillouin optical time-domain analysis (VBOTDA). The PML framework is used to predict the Brillouin frequency shift (BFS) along the fiber and to assess its predictive uncertainty. We compare the predictions obtained from the proposed PML model with a conventional curve fitting method and evaluate the BFS uncertainty and data processing time for both methods. The proposed method is demonstrated using two BOTDA systems: (i) a BOTDA system with a 10 km sensing fiber and (ii) a vector BOTDA with a 25 km sensing fiber. The PML framework provides a pathway to enhance the VBOTDA system performance.

47 OTHER INSTRUMENTATION↗

DOE OSTI2026

Guideline for Characterizing and Evaluating a Candidate Project Site for Solar Thermal Applications

This document presents a structured procedure for characterizing and evaluating candidate project sites for concentrating solar power (CSP) and solar heat for industrial processes (SHIP) applications. The objective is to provide project developers, researchers, and other stakeholders with a consistent, technology-agnostic framework for early-stage site assessment, enabling informed decision-making prior to significant investment in project development. Site selection is a critical factor in project success or failure for both CSP and SHIP projects. Key factors such as solar resource availability, land characteristics, environmental and regulatory constraints, infrastructure availability, and community context are determined by the choice of project site and can materially impact project performance, cost, schedule, and overall viability. This procedure is designed to systematically evaluate these factors, identify potential fatal flaws, and prioritize the most favorable candidate sites for further development. The process begins with rapid screening-level evaluation, using publicly available data to assess solar resource, land availability and suitability, zoning and land-use compatibility, and exclusion zones such as protected lands or sensitive habitats. Sites that meet the minimum screening criteria advance to a more detailed characterization. Subsequent sections of this report provide guidance for a next-level assessment of the most important technical and environmental parameters, including: 1) Solar resource quality, variability, and uncertainty using multiyear datasets and, where appropriate, on-site measurement campaigns; 2) Meteorological conditions such as wind, temperature, extreme weather events, and soiling impacts; 3) Land characteristics including slope, shading, and geotechnical conditions; and 4) Environmental and regulatory considerations, including permitting processes, endangered species, cultural resources, and visual impacts. The procedure also addresses infrastructure and integration considerations, including: 1) Grid interconnection requirements for CSP power generation projects; 2) Electrical and operational integration for SHIP facilities; 3) Water availability, quality, and permitting constraints, which are particularly critical for CSP in arid regions; and 4) Site access, construction logistics, and availability of workforce and supporting services. Recognizing the importance of social and economic context, the procedure includes evaluation of community engagement factors, such as stakeholder sentiment, proximity to sensitive visual receptors, workforce development opportunities, and local economic incentives. The outputs of these assessments are synthesized in a cost and risk evaluation, translating site characteristics into expected impacts on capital cost, operating cost, schedule, and technical risk. This is complemented by screening-level performance modeling, including 8760 simulations and long-term projections, to quantify expected energy or thermal output, assess variability thereof, and support comparison between candidate sites. Finally, the procedure provides high-level guidance on a structured go/no-go decision framework, categorizing sites based on identified risks and constraints, and outlining a clear path forward to feasibility studies and front-end engineering design for viable projects. By standardizing the site characterization process across both CSP and SHIP applications, this guideline aims to: 1) Improve consistency and transparency in early-stage project evaluation; 2) Reduce development risk and avoid investment in nonviable project sites; 3) Support collaboration between developers, researchers, and public agencies; and 4) Accelerate successful deployment of concentrating solar technologies for both power generation and industrial process heat.

14 SOLAR ENERGY↗

DOE OSTI2022

Southeast Regional CO 2 Utilization and Storage Acceleration Partnership (SECARB-USA): Needs Assessment Framework for Storage Complexes Contributed to EDX (Work Product 2.1.c)

On September 30, 2021, a Needs Assessment Framework for Storage Complexes was completed for the SECARB-USA region by the Southern States Energy Board (SSEB) and The University of Texas at Austin Bureau of Economic Geology (UT-BEG). The Needs Assessment Framework for Storage Complexes documented a region-wide assessment to identify data needed to advance storage projects at sites of relevance to industrial, academic, and government stakeholders. The region-wide assessment addresses the needs of CO2 source, storage, and utilization stakeholders, finance and insurance institutions, state and local government agencies, local stakeholders at prospective storage complexes, environmental non-governmental organizations (NGOs), and others as identified by the Partners. This assessment was tested against various potential storage sites and modified to include site-specific issues, such as surface or pore space rights. The framework was provided to stakeholders for review and then used in other tasks, such as the ML initiative (Subtask 3.4) and storage complex readiness evaluation (Subtask 4.2). In accordance with the SOPO, this assessment satisfied completion of Work Product 2.1.b. The OSTI ID is 3015803, and the DOI link is https://doi.org/10.2172/3015803. On February 28, 2022, SSEB uploaded Work Product 2.1.b to NETL’s Energy Data eXchange (EDX). As such, Work Product 2.1.c is completed as documented below.

42 ENGINEERING↗

DOE OSTI2021

Cyber-Power Co-Simulation for End-to-End Synchrophasor Network Analysis and Applications

The resiliency, reliability and security of the next generation cyber-power smart grid depend upon efficiently leveraging advanced communication and computing technologies. Also, developing real-time data-driven applications is critical to enable wide-area monitoring and control of the cyber-power grid given high-resolution data from Phasor Measurement Units (PMUs). North American Synchrophasor Initiative Network (NASPlnet) provides guidance for PMU data exchanges. With the advancement in networking and grid operation, it is necessary to evaluate the performance of different data flow architectures suggested by NASPInet and analyze the impact on applications. Therefore, we need a cyber-power co-simulation framework that supports very large-scale co-simulation capable of running in parallel, high-performance computing platforms and capturing real-life network behavior. This work presents an end-to-end automated and user-driven cyber-power co-simulation using NS3 to model communication networks, GridPACK to model the power grid, and HELICS as a co-simulation engine. Comparative analysis of latency in synchrophasor networks and a performance evaluation of a power system stabilizer application utilizing PMU data in an IEEE 39 bus test system is presented using this cosimulation testbed.

Mustafa, Hussain M.↗

DOE OSTI2025

Speeding-up fuzzing through directional seeds

Abstract Fuzzing is an automated process for discovering inputs in a program that may trigger unexpected behavior. Today, fuzzing has become a standard practice for the discovery of bugs and security vulnerabilities. However, the main issue with such practices is that the exploration of the input space of programs can often be prohibitively expensive. Therefore, several alternative fuzzing strategies have been introduced during the last few years. Some fuzzing techniques rely on human expertise to provide a plausible set of initial input examples, namely, seeds. However, the process of handcrafting seeds for fuzzing purposes often becomes strenuous for humans as it requires a deeper understanding of the Program-Under-Test (PUT). Also, the use of known inputs to programs often does not trigger vulnerable program behavior or may not reach potentially vulnerable code locations. To address those issues, we propose a seed generation framework that enables Human-In-The-Loop (HITL) directed fuzzing where the human assumes a more active role in the creation of seeds that can penetrate and assess desired locations of the PUT. Our proposed framework uses Symbolic Execution (SE) to generate seeds that exercise paths to target program locations. Moreover, our framework enables the visualization of the explored execution paths in the binary of the PUT for the generated seeds. We evaluated our approach on a set of 12 carefully designed C programs with diverse characteristics that mimic real-world programs. The experimental results show the effectiveness of the proposed approach in improving the performance of standard fuzzing tools such as the American Fuzzy Lop ("Image missing" <#comment/> ). Specifically, our solution can generate seeds that substantially enhance the performance of the fuzzer, achieving speedups ranging from $$1.46\times $$ 1.46 × to $$68.53\times $$ 68.53 × for branch conditions, $$1.39\times $$ 1.39 × to $$254.62\times $$ 254.62 × for branch depths, $$14,879.59\times $$ 14 , 879.59 × to $$30,295.88\times $$ 30 , 295.88 × for branch widths over traditional seeds. Additionally, the speedup increases with the number of target function ranging from $$12,260\times $$ 12 , 260 × to $$22,856.07\times $$ 22 , 856.07 × over traditional seeds while only requiring less than 15 seconds on average for the seed generation step.

97 MATHEMATICS AND COMPUTING↗