Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,693 records · Page 94
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Cybersecurity Center for Offshore Wind Energy (Final Project Report)

This project establishes a Cybersecurity Center for Offshore Wind Energy with the objective of designing and operating a cyber-physical testbed for wind energy farms (WEFs) that enables comprehensive cybersecurity research. The testbed incorporates a Supervisory Control and Data Acquisition (SCADA) system connected to turbine models via industrial-grade programmable logic controllers (PLCs) and remote terminal units (RTUs). It supports side-channel data acquisition, implementation and analysis of various cyberattack scenarios, and development of attack detection, mitigation, and best-practice guidance tailored to wind energy systems. During the project, the team expanded the number and fidelity of mathematical turbine models (MTMs), integrated these models with SCADA infrastructure, and deployed a scaled physical turbine and associated sensors. High-resolution operational and side-channel data streams were collected and used to refine machine-learning (ML)-based attack detection systems and to extend the WindCRAFT framework to multi-turbine threat scenarios. The project demonstrated a realistic, scalable environment for evaluating cyber threats, validated attack detection approaches using enriched datasets, and identified new multi-turbine and inter-turbine communication attack vectors. The resulting testbed, models, and security mechanisms provide a foundation for ongoing R&D and deployment of cyber-resilient offshore wind energy systems.

17 WIND ENERGY↗
DOE OSTI2024

An Analysis of the Spatial Variations in the Relationship Between Built Environment and Severe Crashes

Traffic crashes significantly contribute to global fatalities, particularly in urban areas, highlighting the need to evaluate the relationship between urban environments and traffic safety. This study extends former spatial modeling frameworks by drawing paths between global models, including spatial lag (SLM), and spatial error (SEM), and local models, including geographically weighted regression (GWR), multi-scale geographically weighted regression (MGWR), and multi-scale geographically weighted regression with spatially lagged dependent variable (MGWRL). Utilizing the proposed framework, this study analyzes severe traffic crashes in relation to urban built environments using various spatial regression models within Leon County, Florida. According to the results, SLM outperforms OLS, SEM, and GWR models. Local models with lagged dependent variables outperform both the global and generic versions of the local models in all performance measures, whereas MGWR and MGWRL outperform GWR and GWRL. Local models performed better than global models, showing spatial non-stationarity; so, the relationship between the dependent and independent variables varies over space. The better performance of models with lagged dependent variables signifies that the spatial distribution of severe crashes is correlated. Finally, the better performance of multi-scale local models than classical local models indicates varying influences of independent variables with different bandwidths. According to the MGWRL model, census block groups close to the urban area with higher population, higher education level, and lower car ownership rates have lower crash rates. On the contrary, motor vehicle percentage for commuting is found to have a negative association with severe crash rate, which suggests the locality of the mentioned associations.

Alisan, Onur (ORCID:0000000193113984)↗
DOE OSTI2026

Estimating Return on Investment for Energy Technical Assistance Programs

The U.S. Department of Energy's Office of State and Community Energy Programs engaged the National Laboratory of the Rockies to assess the return on investment (ROI) of technical assistance (TA) programs that support state, local, and Tribal energy planning. Although TA delivers value through capacity building, stakeholder engagement, and knowledge transfer, these benefits are often intangible and challenging to monetize. This study reviews existing ROI frameworks and synthesizes the most relevant elements into a hybrid approach tailored to energy TA programs. The proposed framework integrates monetary and non-monetary outcomes through early logic model development, baseline data collection, and the use of proxies for intangible benefits. As a case study, this paper applies this approach to the Communities Local Energy Action Program (Communities LEAP), demonstrating how ROI can inform program design, data strategy, and performance assessment. Findings underscore that ROI should be applied selectively and planned from the outset to ensure data alignment and attribution accuracy. The framework offers TA practitioners a structured approach that can be leveraged for future programs to evaluate and communicate the multifaceted value of TA investments.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2019

A Flexible Framework for Building Occupancy Detection Using Spatiotemporal Pattern Networks: Preprint

This paper presents a reliable, scalable, and transferable framework to predict occupancy in a building utilizing diverse, multi-modal information. We propose a new methodology for learning-driven occupancy detection built on the concepts of probabilistic graphical modeling and observable Markov chain modeling. To capture the relationship between multi-sensor data and occupancy, we propose this Occ-STPN framework that is flexible to support both multivariate and univariate formulations. While the multivariate Occ-STPN performs feature-level fusion of multiple predictors and occupancy time-series data, the univariate Occ-STPN involves decision fusion of occupancy predictions using individual predictors based on a mutual information weighted fusion scheme. We also propose a new metric to evaluate the performance of occupancy prediction algorithms. Two popular datasets are used to validate our approach and demonstrate that our framework is scalable in terms of the number of information sources (e.g., sensors) as well as it is possible to transfer trained models from one building to another without significant reduction in performance. Reliability of the algorithm is also tested by injecting noise into the datasets.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2019

A Flexible Framework for Building Occupancy Detection Using Spatiotemporal Pattern Networks

This paper presents a reliable, scalable, and transferable framework to predict occupancy in a building utilizing diverse, multi-modal information. We propose a new methodology for learning-driven occupancy detection built on the concepts of probabilistic graphical modeling and observable Markov chain modeling. To capture the relationship between multi-sensor data and occupancy, we propose this Occ-STPN framework that is flexible to support both multivariate and univariate formulations. While the multivariate Occ-STPN performs feature-level fusion of multiple predictors and occupancy time-series data, the univariate Occ-STPN involves decision fusion of occupancy predictions using individual predictors based on a mutual information weighted fusion scheme. We also propose a new metric to evaluate the performance of occupancy prediction algorithms. Two popular datasets are used to validate our approach and demonstrate that our framework is scalable in terms of the number of information sources (e.g., sensors) as well as it is possible to transfer trained models from one building to another without significant reduction in performance. Reliability of the algorithm is also tested by injecting noise into the datasets.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

WETO Resilience Research: Microgrids, Infrastructure Resilience, and Advanced Controls Launchpad (MIRACL)

INL focuses on resilience and cybersecurity for distributed wind under the Microgrids, Infrastructure Resilience, and Advanced Controls Launchpad (MIRACL) project. Following the development of a resilience framework, INL has developed an application for resilience planning that includes automated hazard simulations to evaluate performance of various configurations. Additionally, INL is exploring the resilience of advanced distributed wind systems that leverage advanced controls and hybrid resources.

17 WIND ENERGY↗
DOE OSTI2021

"Hybrid fracture/matrix modeling for well completion options evaluation"

Orientation and completion for well pairs that have been subjected to multi-zonal stimulation play a critical role in the long-term performance of an Enhanced Geothermal Reservoir. Here we present the development of a methodology to rapidly and efficiently numerically simulate mixed fracture-matrix flow systems for evaluation of well design and completion options. The methodology is based on a loose coupling framework, allowing the fracture and matrix systems to be meshed separately. The fracture system includes the integration of fracture growth and aperture data from well stimulation simulations of stochastically generated fracture networks. Automatic mesh refinement is used in the matrix simulation to resolve heat transfer near the fracture network. This simulation framework is used to efficiently determine optimal production and injection well placement using adaptive sampling.

15 GEOTHERMAL ENERGY↗
DOE OSTI2025

Machine Learning-Based Energy Estimation for Sterile Neutrino Searches in the NOνA Experiment

This dissertation presents a search for sterile neutrinos using Monte Carlo datasets and experimental data from the NOνA experiment. This work introduces novel machine learning techniques for energy reconstruction in neutral current events. A deep learning-based energy estimator was developed and integrated into the analysis framework. Using this new energy estimator, the sensitivity to sterile neutrino-induced oscillations is evaluated and presented. Furthermore, the dissertation explores potential methods for further improvement of the analysis.

43 PARTICLE ACCELERATORS↗
DOE OSTI2026

Poisson Log-Normal Process for Count Data Prediction

Modeling count data is important in physics and other scientific disciplines, where measurements often involve discrete, non-negative quantities such as photon or neutrino detection events. Traditional parametric approaches can be trained to generate integer-count predictions but may struggle with capturing complex, non-linear dependencies often observed in the data. Gaussian process (GP) regression provides a robust non-parametric alternative to modeling continuous data; however, it cannot generate integer outputs. We propose the Poisson Log-Normal (PoLoN) process, a framework that employs GP to model Poisson log-rates. As in GP regression, our approach relies on the correlations between data points captured via GP kernel structure rather than explicit functional parameterizations. We demonstrate that the PoLoN predictive distribution is Poisson-LogNormal and provide an algorithm for optimizing kernel hyperparameters. Furthermore, we adapt the PoLoN approach to the problem of detecting weak localized signals superimposed on a smoothly varying background - a task of considerable interest in many areas of science and engineering. Our framework allows us to predict the strength, location and width of the detected signals. We evaluate PoLoN's performance using both synthetic and real-world datasets, including the open dataset from CERN which was used to detect the Higgs boson at the Large Hadron Collider. Our results indicate that the PoLoN process can be used as a non-parametric alternative for analyzing, predicting, and extracting signals from integer-valued data.

Saha, Anushka [Rutgers U., Piscataway]↗
DOE OSTI2025

Cooperative On-Ramp Merging with Time-Varying Vehicle-to-Vehicle Communication Delay Compensation via a Model-Free Approach

Cooperative merging strategies enabled by vehicle-to-vehicle (V2V) communication have shown promise in addressing congestion, fuel inefficiency, and collision risks. However, their performance can be severely degraded by time-varying and uncertain communication delays-an issue often overlooked in existing research, which primarily focuses on merging sequence determination and trajectory planning. Furthermore, practical considerations such as heterogeneous vehicle dynamics, varying road conditions, and real-time implementation complexities are frequently neglected. This paper presents a model-free, online planning framework for cooperative on-ramp merging of connected and automated vehicles (CAVs), explicitly accounting for time-varying V2V communication delays. Without relying on detailed vehicle dynamics, the proposed method introduces a data-driven delay compensation scheme. A co-simulation platform integrating high-fidelity vehicle dynamics, traffic simulation (SUMO), and V2V communication within MATLAB/Simulink is developed to evaluate the proposed method. Simulation results demonstrate that unaddressed V2V communication delays significantly impair merging performance. In contrast, the proposed framework enhances intervehicle distance tracking and maintains low CO2 emissions and fuel consumption, under communication delay across different communication frequencies. In conclusion, its lightweight design also facilitates real-time implementation, making it well-suited for deployment in practical CAV systems.

Accounting↗
DOE OSTI2022

4.2.1.31 Integrated Life Cycle Sustainability Analysis

This project provides the Department of Energy's Bioenergy Technologies Office (BETO) with strategic decision-support for the evaluation of its R&D portfolio by developing, validating, and applying a coherent methodology and consistent model framework to quantify the net effects of an expanding US bioeconomy. The framework fills an analysis gap previously identified by Peer Review and supports a related milestone in BETO's Multi-Year Program Plan. The framework was scoped with inputs from practitioners in academia, national laboratories, and federal agencies. The model is a top-down, economy-wide framework using a coherent methodology to compute environmental and socio-economic metrics. It is purposefully complementary to existing bottom-up, process-based techno-economic and life cycle assessment BETO tools and uses their data as inputs. Presently, the model covers several commercial and near-commercial biofuel routes and an emerging pathway for plastics upcycling. It covers temporal detail across four time-steps and is currently being expanded with a prospective modeling capability. The model has provided analyses for the Third Triennial Report to Congress (RtC3) on the environmental impacts of the Renewable Fuel Standard (RFS2), among others. As part of this project, NREL also provides scientific support to BETO in the International Energy Agency's Technology Collaboration Program on Bioenergy (IEA Bioenergy) Task 45 on Sustainability. Here, NREL evaluates and synthesizes activities that develop, compare, or apply metrics, methods, and tools to quantify sustainability effects of bioeconomy products. NREL also coordinates related national lab involvement and a BETO Working Group on Sustainable Land Management.

bioeconomy↗
DOE OSTI2021

Emerging Frameworks for Advancing Scientific Workflows Research, Development, and Education

Lightning talks of the Workflows in Support of Large-Scale Science (WORKS) workshop are a venue where the workflow community (researchers, developers, and users) can discuss work in progress, emerging technologies and frameworks, and training and education materials. This paper summarizes the WORKS 2021 lightning talks, which cover four broad topics: (i) libEnsemble, a Python library to coordinate the concurrent evaluation of dynamic ensembles of calculations; (ii) Edu WRENCH, a set of online pedagogic modules that provides simulation-driven hands-on activity in the browser; (iii) VisDict, an envisioned visual dictionary framework that will translate terms, jargon, and concepts between research domains and workflow providers; and (iv) Pegasus Kickstart, a lightweight tool for capturing workflow tasks' performance, including performance metrics from Nvidia GPUs.

Casanova, Henri↗
DOE OSTI2014

Adaptation policies to increase terrestrial ecosystem resilience. Potential utility of a multicriteria approach

Climate change is rapidly undermining terrestrial ecosystem resilience and capacity to continue providing their services to the benefit of humanity and nature. Because of the importance of terrestrial ecosystems to human well-being and supporting services, decision makers throughout the world are busy creating policy responses that secure multiple development and conservation objectives- including that of supporting terrestrial ecosystem resilience in the context of climate change. This article aims to advance analyses on climate policy evaluation and planning in the area of terrestrial ecosystem resilience by discussing adaptation policy options within the ecology-economy-social nexus. The paper evaluates these decisions in the realm of terrestrial ecosystem resilience and evaluates the utility of a set of criteria, indicators, and assessment methods, proposed by a new conceptual multi-criteria framework for pro-development climate policy and planning developed by the United Nations Environment Programme. Potential applications of a multicriteria approach to climate policy vis-A -vis terrestrial ecosystems are then explored through two hypothetical case study examples. The paper closes with a brief discussion of the utility of the multi-criteria approach in the context of other climate policy evaluation approaches, considers lessons learned as a result efforts to evaluate climate policy in the realm of terrestrial ecosystems, and reiterates the role of ecosystem resilience in creating sound policies and actions that support the integration of climate change and development goals.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2012

An Overview of Public Domain Tools for Measuring the Sustainability of Environmental Remediation - 12060

The application of sustainability principles to the investigation and remediation of contaminated sites is an area of rapid development within the environmental profession, with new business practices, tools, and performance standards for identifying, evaluating, and managing the 'collateral' impacts of cleanup projects to the environment, economy and society coming from many organizations. Guidelines, frameworks, and standards of practice for 'green and sustainable remediation' (GSR) have been released and are under development by the Sustainable Remediation Forum (SURF), the American Society for Testing Materials (ASTM), the Interstate Technology Roundtable Commission (ITRC) and other organizations in the U.S. and internationally. In response to Executive Orders from the President, Federal government agencies have developed policies, procedures and guidelines for evaluating and reporting the sustainability of their environmental restoration projects. Private sector companies in the petroleum, utility, manufacturing, defense, and other sectors are developing their own corporate GSR programs to improve day-to-day management of contaminated sites and to support external reporting as part of their corporate social responsibility (CSR) efforts. The explosion of mandates, policy, procedures and guidance raises the question of how to determine whether a remediation technology or cleanup approach is green and/or sustainable. The environmental profession has responded to this question by designing, developing and deploying a wide array of tools, calculators, and databases that enable regulatory agencies, site managers and environmental professionals to calculate the collateral impacts of their remediation projects in the environmental, social, and economic domains. Many of these tools are proprietary ones developed by environmental engineering/consulting firms for use in their consulting engagements and/or tailored specifically to meet the needs of their clients. When it comes to the public domain, Federal government agencies are spearheading the development of software tools to measure and report emissions of air pollutants (e.g., carbon dioxide, other greenhouse gases, criteria air pollutants); consumption of energy, water and natural resources; accident and safety risks; project costs and other economic metrics. Most of the tools developed for the Government are available to environmental practitioners without charge, so they are growing in usage and popularity. The key features and metrics calculated by the available public-domain tools for measuring the sustainability of environmental remediation projects share some commonalities but there are differences amongst the tools. The SiteWise{sup TM} sustainability tool developed for the Navy and US Army will be compared with the Sustainable Remediation Tool (SRT{sup TM}) developed for the US Air Force (USAF). In addition, the USAF's Clean Solar and Wind Energy in Environmental Programs (CleanSWEEP), a soon-to-be-released tool for evaluating the economic feasibility of utilizing renewal energy for powering remediation systems will be described in the paper. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2021

Enhanced Data Efficiency Using Deep Neural Networks and Gaussian Processes for Aerodynamic Design Optimization

Adjoint-based optimization methods are attractive for aerodynamic shape design primarily due to their computational costs being independent of the dimensionality of the input space and their ability to generate high-fidelity gradients that can then be used in a gradient-based optimizer. This makes them very well suited for high-fidelity simulation based aerodynamic shape optimization of highly parametrized geometries such as aircraft wings. However, the development of adjoint-based solvers involve careful mathematical treatment and their implementation require detailed software development. Furthermore, they can become prohibitively expensive when multiple optimization problems are being solved, each requiring multiple restarts to circumvent local optima. In this work, we propose a machine learning enabled, surrogate-based framework that replaces the expensive adjoint solver, without compromising on predicting predictive accuracy. Specifically, we first train a deep neural network (DNN) from training data generated from evaluating the high-fidelity simulation model on a model-agnostic design of experiments on the geometry shape parameters. The optimum shape may then be computed by using a gradient-based optimizer coupled with the trained DNN. Subsequently, we also perform a gradient-free Bayesian optimization, where the trained DNN is used as the prior mean. We observe that the latter framework (DNN-BO) improves upon the DNN-only based optimization strategy for the same computational cost. Overall, this framework predicts the true optimum with very high accuracy, while requiring far fewer high-fidelity function calls compared to the adjoint-based method. Furthermore, we show that multiple optimization problems can be solved with the same machine learning model with high accuracy, to amortize the offline costs associated with constructing our models. Our methodology finds applications in the early stages of aerospace design. (C) 2021 Published by Elsevier Masson SAS.

Renganathan, S. Ashwin↗
DOE OSTI2016

Feasibility studies of time-like proton electromagnetic form factors at $\overline{\rm P}$ANDA at FAIR

Simulation results for future measurements of electromagnetic proton form factors at $\overline{\rm P}$ANDA (FAIR) within the PandaRoot software framework are reported. The statistical precision with which the proton form factors can be determined is estimated. The signal channel p¯p → e + e – is studied on the basis of two different but consistent procedures. The suppression of the main background channel, i.e. p¯p → π + π – , is studied. Furthermore, the background versus signal efficiency, statistical and systematical uncertainties on the extracted proton form factors are evaluated using two different procedures. The results are consistent with those of a previous simulation study using an older, simplified framework. Furthermore, a slightly better precision is achieved in the PandaRoot study in a large range of momentum transfer, assuming the nominal beam conditions and detector performance.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Applying 3D Geologic Modeling Workflows to the Argillite Reference Case (Rev. 1)

The objective of this short report is to document the application of our 3D geologic modeling workflow to an argillite (shale) host rock. Over the past four years, our team at Los Alamos National Laboratory has developed a geologic modeling workflow that can be applied to generic alluvial basins such as those found in the western United States. In “frontier” or “exploratory” basins where data are sparse, the first steps are to collect, evaluate and integrate available subsurface data into conceptual geologic models. Those models form the basis for constructing the geologic framework model, a 3D geocellular model ideally constrained by seismic and borehole data. To date we have constructed our models using “synthetic” well data derived from conceptual models, without the prospect of validating our workflow using “real” subsurface data. We were tasked to investigate whether our workflow designed for alluvial basin sediments could be applied to other potential repository host rocks. This task also provided the opportunity to work with high-quality subsurface data collected specifically for siting and evaluating a nuclear waste repository. Nagra, the Swiss governmental agency responsible for the disposal of the nation’s radioactive waste, generously provided us with data from two deep boreholes drilled through their argillaceous target formation. The aim of our proof-of-concept demonstration is to evaluate whether geostatistical methods offer a viable approach to property modeling in argillaceous rocks. Nagra provided us with the well data on the condition that we maintain confidentiality with all transferred information and results. Fortunately, Nagra posts numerous technical reports on its public website that describe the subsurface geology in great detail. All of the information and illustrations in this report related to the Swiss repository enterprise are taken from the Nagra public website.

58 GEOSCIENCES↗
DOE OSTI2015

Explicitly representing soil microbial processes in Earth system models: Soil microbes in earth system models

Microbes influence soil organic matter (SOM) decomposition and the long-term stabilization of carbon (C) in soils. Herein, we contend that by revising the representation of microbial processes and their interactions with the physicochemical soil environment, Earth system models (ESMs) may make more realistic global C cycle projections. Explicit representation of microbial processes presents considerable challenges due to the scale at which these processes occur. Thus, applying microbial theory in ESMs requires a framework to link micro-scale process-level understanding and measurements to macro-scale models used to make decadal- to century-long projections. Here, we review the diversity, advantages, and pitfalls of simulating soil biogeochemical cycles using microbial-explicit modeling approaches. We present a roadmap for how to begin building, applying, and evaluating reliable microbial-explicit model formulations that can be applied in ESMs. Drawing from experience with traditional decomposition models we suggest: (1) guidelines for common model parameters and output that can facilitate future model intercomparisons; (2) development of benchmarking and model-data integration frameworks that can be used to effectively guide, inform, and evaluate model parameterizations with data from well-curated repositories; and (3) the application of scaling methods to integrate microbial-explicit soil biogeochemistry modules within ESMs. With contributions across scientific disciplines, we feel this roadmap can advance our fundamental understanding of soil biogeochemical dynamics and more realistically project likely soil C response to environmental change at global scales.

59 BASIC BIOLOGICAL SCIENCES↗