SEARCH · Engineering Papers

Results for “COMPARATIVE EVALUATIONS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

All sources NASA NTRS DOE OSTI

DOE OSTI2024

StructuredFuzzer: Fuzzing Structured Text-Based Control Logic Applications

Rigorous testing methods are essential for ensuring the security and reliability of industrial controller software. Fuzzing, a technique that automatically discovers software bugs, has also proven effective in finding software vulnerabilities. Unsurprisingly, fuzzing has been applied to a wide range of platforms, including programmable logic controllers (PLCs). However, current approaches, such as coverage-guided evolutionary fuzzing implemented in the popular fuzzer American Fuzzy Lop Plus Plus (AFL++), are often inadequate for finding logical errors and bugs in PLC control logic applications. They primarily target generic programming languages like C/C++, Java, and Python, and do not consider the unique characteristics and behaviors of PLCs, which are often programmed using specialized programming languages like Structured Text (ST). Furthermore, these fuzzers are ill suited to deal with complex input structures encapsulated in ST, as they are not specifically designed to generate appropriate input sequences. This renders the application of traditional fuzzing techniques less efficient on these platforms. To address this issue, this paper presents a fuzzing framework designed explicitly for PLC software to discover logic bugs in applications written in ST specified by the IEC 61131-3 standard. The proposed framework incorporates a custom-tailored PLC runtime and a fuzzer designed for the purpose. We demonstrate its effectiveness by fuzzing a collection of ST programs that were crafted for evaluation purposes. We compare the performance against a popular fuzzer, namely, AFL++. The proposed fuzzing framework demonstrated its capabilities in our experiments, successfully detecting logic bugs in the tested PLC control logic applications written in ST. On average, it was at least 83 times faster than AFL++, and in certain cases, for example, it was more than 23,000 times faster.

47 OTHER INSTRUMENTATION↗

DOE OSTI2023

A Theoretical Open Architecture Framework and Technology Stack for Digital Twins in Energy Sector Applications

Digital twin is often viewed as a technology that can assist engineers and researchers make data-driven system and network-level decisions. Across the scientific literature, digital twins have been consistently theorized as a strong solution to facilitate proactive discovery of system failures, system and network efficiency improvement, system and network operation optimization, among others. With their strong affinity to the industrial metaverse concept, digital twins have the potential to offer high-value propositions that are unique to the energy sector stakeholders to realize the true potential of physical and digital convergence and pertinent sustainability goals. Although the technology has been known for a long time in theory, its practical real-world applications have been so far limited, nevertheless with tremendous growth projections. In the energy sector, there have been theoretical and lab-level experimental analysis of digital twins but few of those experiments resulted in real-world deployments. There may be many contributing factors to any friction associated with real-world scalable deployment in the energy sector such as cost, regulatory, and compliance requirements, and measurable and comparable methods to evaluate performance and return on investment. Those factors can be potentially addressed if the digital twin applications are built on the foundations of a scalable and interoperable framework that can drive a digital twin application across the project lifecycle: from ideation to theoretical deep dive to proof of concept to large-scale experiment to real-world deployment at scale. This paper is an attempt to define a digital twin open architecture framework that comprises a digital twin technology stack (D-Arc) coupled with information flow, sequence, and object diagrams. Those artifacts can be used by energy sector engineers and researchers to use any digital twin platform to drive research and engineering. This paper also provides critical details related to cybersecurity aspects, data management processes, and relevant energy sector use cases.

Gourisetti, Sri, Nikhil Gupta (ORCID:0000000188778↗

DOE OSTI2023

Solvent-Producing Clostridia Revisited

The review provides an overview of the current status of the solvent-producing clostridia. The origin and development of industrial clostridial species, as well as the history of the industrial Acetone Butanol Ethanol fermentation process, is reexamined, and the recent resurgence of interest in the production of biobutanol is reviewed. Over 300 fully sequenced genomes for solvent-producing and closely related clostridial species are currently available in public databases. These include 270 genomes sourced from the David Jones culture collection. These genomes were allocated arbitrary DJ codes, and a conversion table to identify the species and strains has now been provided. The expanded genomic database facilitated new comparative genomic and phylogenetic analysis. A synopsis of the common features, molecular taxonomy, and phylogeny of solvent-producing clostridia and the application of comparative phylogenomics are evaluated. A survey and analysis of resident prophages in solvent-producing clostridia are discussed, and the discovery, occurrence, and role of novel R-type tailocins are reported. Prophage genomes with R-type tailocin-like features were detected in all 12 species investigated. The widespread occurrence of tailocins in Gram-negative species is well documented; this survey has indicated that they may also be widespread in clostridia.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2024

Towards Next-Generation Urban Decision Support Systems through AI-Powered Construction of Scientific Ontology Using Large Language Models—A Case in Optimizing Intermodal Freight Transportation

The incorporation of Artificial Intelligence (AI) models into various optimization systems is on the rise. However, addressing complex urban and environmental management challenges often demands deep expertise in domain science and informatics. This expertise is essential for deriving data and simulation-driven insights that support informed decision-making. In this context, we investigate the potential of leveraging the pre-trained Large Language Models (LLMs) to create knowledge representations for supporting operations research. By adopting ChatGPT-4 API as the reasoning core, we outline an applied workflow that encompasses natural language processing, Methontology-based prompt tuning, and Generative Pre-trained Transformer (GPT), to automate the construction of scenario-based ontologies using existing research articles and technical manuals of urban datasets and simulations. From these ontologies, knowledge graphs can be derived using widely adopted formats and protocols, guiding various tasks towards data-informed decision support. The performance of our methodology is evaluated through a comparative analysis that contrasts our AI-generated ontology with the widely recognized pizza ontology, commonly used in tutorials for popular ontology software. We conclude with a real-world case study on optimizing the complex system of multi-modal freight transportation. Our approach advances urban decision support systems by enhancing data and metadata modeling, improving data integration and simulation coupling, and guiding the development of decision support strategies and essential software components.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

DOE OSTI2022

Micro Baselines for Operational Technology Environments

Critical infrastructure stakeholders need to baseline their networks to understand expected communications. Top-down approaches to baselining rely on observables that are generally available but lack properties upon which traditional statistical tools depend. We propose to construct micro-baselines: signatures within operational networks based on observables associated with specific events. Such observables are informed by precursor analysis reports of historical cyber attacks on operational environments developed by Cybersecurity for Operational Technology Environments (CyOTE). Baseline measurements depend upon context beyond the cyber domain. An energy plant's baseline running in the summer may statistically differ from a similar facility in a colder region. Domain knowledge must be integrated to apply general micro-baselining algorithms to a facility-specific context. Therefore, we propose to explore the feasibility of transferring micro baselining algorithms across different facilities. Facilities that implement the same processes in different geographic locations will be compared relative to observable measurements used in micro-baselining for comparable events. One evaluation approach would condition or augment dynamic observables measured within a facility network testbed with additional observables derived from geographic context or infrastructure dependencies such as those provided by the All-Hazards Analysis tool.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Conflict Detection in Open RAN with Recurrent Neural Networks Using Geometric Manifolds

Allowing third-party applications on Radio Access Network (RAN) Intelligent Controllers (RICs) within the OpenRAN (O-RAN) framework introduces conflicting interactions that are often difficult to detect in advance. These conflicts, occurring between third-party applications in the Near RealTime RIC (Near-RT RIC), known as xApps, can lead to performance degradation and instability in O-RAN if not identified early. Existing conflict detection and mitigation solutions in the literature assume that the conflicts are known beforehand, which is not always accurate due to the complex and often hidden relationships between control parameters and Key Performance Indicators (KPIs). In this paper, we propose a novel Recurrent Neural Network (RNN) to detect both known and unknown conflicts in O-RAN xApps as specified in the O-RAN standards. We model the xApps, control parameters, and KPIs with nodes and edges to create graph structures and use the hidden nonEuclidean geometric properties of the Riemannian manifold to train the RNN model. The performance of this proposed model is validated using evaluation metrics and compared with benchmarks. Results demonstrate that the proposed RNN model, leveraging Riemannian geometric properties, can achieve 100% of the F1-score provided by an optimal solution in just 20 iterations.

5G↗

DOE OSTI2025

Conflict Detection in Open RAN with Recurrent Neural Networks Using Geometric Manifolds

5G↗

DOE OSTI2022

The Use of Thermal Cameras for Pedestrian Detection

Visible-range camera sensors have been widely used for pedestrian detection. However, most of the methods, which employ visible-range color cameras, do not perform well under low-light and no-light conditions, e.g. during night time. Since the working principle of thermal camera sensors is mainly based on temperature and not light, they have been employed for person detection to overcome the drawbacks of visible-range sensors under these conditions. Every object gives off thermal energy, which is captured by a thermal camera sensor. When an object becomes hotter, it emits more thermal energy, and is therefore captured as much brighter or vice versa. Yet, compared to visible-range cameras, there are many additional challenges that need to be addressed when detecting pedestrians from thermal camera images. These challenges include bright hot objects close to humans, similar pixel values in an image due to weather conditions, or objects that block thermal cameras such as concrete or glass. Glass acts like a mirror for infrared radiation and reflects whatever is in front of the camera. Thus, novel methods are still required to accomplish pedestrian detection task from thermal camera images. To contribute to these efforts, we propose a new method and a modified object detection network incorporating saliency maps of thermal camera images. The features obtained from thermal images and their corresponding saliency maps are combined to obtain richer representations of pedestrian regions, and better detection performance. We perform extensive evaluations on five different datasets to compare the performance of the proposed approach with two baselines. Moreover, we evaluate and compare the transferability of these approaches by doing leave-one-out cross validation across different datasets. Furthermore, the results show that the proposed approach outperforms the baselines, and has better transferability properties across different thermal image datasets.

47 OTHER INSTRUMENTATION↗

DOE OSTI2020

Analytic evaluation of hydrogen neutron elastic scattering moments with free-gas thermal treatment compared to NJOY

In this article, we present an analytic approach to evaluate Legendre moments of hydrogen neutron elastic scattering differential cross section, with and without free-gas thermal treatment. The results for the zero-th (P 0 ) and first (P 1 ) moments are given and compared against a 138-group cross sections produced by NJOY. An MCNP thin-wire test was employed as an independent verification for our analytic model for the free-gas zero-th moment. Excellent agreement was observed between the analytic result and MCNP prediction. They both suggest that an increased thermal cut-off in NJOY THERMR module is advisable for higher accuracy. Discrepancy was also found between the analytic model and NJOY multi-group cross section for the first order Legendre moments of the differential cross section, which might indicate a numerical anomaly in NJOY.

NJOY↗

DOE OSTI2023

Power Supply Options for the Marpi Landfill, Saipan: Feasibility Study

The Marpi Landfill, located on the northern end of the island of Saipan in the Commonwealth of the Northern Mariana Islands (CNMI), is powered by an on-site diesel generator that only operates when the landfill is open and staffed. The CNMI Office of Planning and Development (OPD) aspires to provide the Marpi Landfill with 24-hour power availability despite its remote location and to increase the use of sustainable energy within the CNMI. CNMI has a 20% target for renewable energy consumption, as documented in Sustainable Development Goal #7 in the Comprehensive Sustainable Development Plan (OPD 2021) and the renewable portfolio standard (GPO 2014). To accomplish these goals, the U.S. Department of Energy, through its Interagency Reimbursable Work Agreement with the Federal Emergency Management Agency, funded this feasibility study to assess and prioritize power supply options for the landfill. The availability of solar and wind resources varies seasonally, as does the load. A BESS can help to balance mismatches between generation and load on short (hourly or daily) timescales, but not across seasons. The microgrid scenarios evaluated for Marpi consider options for technology combinations that will both meet the load and utilize available resources, despite the challenge presented by higher loads and lower solar and wind availability during the rainy season, depicted in Figure ES-2. The seven scenarios evaluated are summarized in Table ES-1. Each scenario’s configuration was optimized to include component capacities that reduce capital and operating costs, meet the load, and minimize carbon emissions, as feasible. The costs and levelized cost of energy (LCOE) shown do not assume the use of any grant funding or incentives, although these options were also evaluated. To assist with decision-making, a prioritization matrix (Table ES-3) was created to compare the microgrid scenarios evaluated in this feasibility study according to various stakeholder priorities. The prioritization metrics were chosen based on discussions with OPD and will be finalized through stakeholder feedback. The scenarios were given a score between 1 and 7 for each prioritization metric (the lower the score, the higher the priority), and total scores were calculated using assigned weights based on the relative priority of each metric. The total scores were then ranked to produce a prioritized list of microgrid scenarios based on the metrics most important to the project stakeholders. As shown, scenario 4 (100 kW of solar PV, a 75 kW/300 kWh BESS, and 160 kW of diesel generation) ranks highest.

14 SOLAR ENERGY↗

DOE OSTI2026

Reliability of Digital Communications in Nuclear Facilities and Operations

A comprehensive evaluation of methods to compare the reliability of wired and wireless digital communication networks for use in nuclear power plants. The study underscores the critical role of communication reliability in ensuring operational safety in nuclear power plants. Key objectives include developing a methodology to assess communication technologies’ reliability, particularly for comparing wireless and wired networks, for nuclear facility applications. The framework focuses on technology-agnostic evaluations and emphasizes the importance of reliability metrics spanning safety, security, and monitoring functions. The framework emphasizes that the key performance indicators are application dependent and provides a hierarchy of different network types that will have different reliability requirements. The report considers both existing plants and advanced reactors, including small modular reactors.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2023

A Field Study of Nonintrusive Load Monitoring Devices and Implications for Load Disaggregation

Evaluations of nonintrusive load monitoring (NILM) algorithms and technologies have mostly occurred in constrained, artificial environments. However, few field evaluations of NILM products have taken place in actual buildings under normal operating conditions. This paper describes a field evaluation of a state-of-the-art NILM product, tested in eight homes. The match rate metric—a technique recommended by a technical advisory group—was used to measure the NILM’s success in identifying specific loads and the accuracy of the energy consumption estimates. A performance assessment protocol was also developed to address common issues with NILM mislabeling and ground-truth comparisons that have not been sufficiently addressed in past evaluations. The NILM product’s estimates were compared to the submetered consumption of eight major appliances. Overall, the product had good performance in disaggregating the energy consumption of the electric water heaters, which included both electric resistance and heat-pump water heaters, but only a fair accuracy with refrigerators, dryers, and air conditioners. The performance was poor for cooking equipment, furnace fans, clothes washers, and dishwashers. Moreover, the product was often unable to detect major loads in homes. Typically, two or more appliances were not detected in a home. At least two dryers, furnace fans, and air conditioners went undetected across the eight homes. On the other hand, the dishwasher was detected in all homes where available or monitored. The key findings were qualitatively compared to those of past field evaluations. Potential areas for improvement in NILM product performance were determined along with areas where complementary technologies may be able to aid in load-disaggregation applications.

47 OTHER INSTRUMENTATION↗

DOE OSTI2022

Avoiding excess computation in asynchronous evolutionary algorithms

Abstract Asynchronous evolutionary algorithms are becoming increasingly popular as a means of making full use of many processors while solving computationally expensive search and optimization problems. These algorithms excel at keeping large clusters fully utilized, but may sometimes inefficiently sample an excess of fast‐evaluating solutions at the expense of higher‐quality, slow‐evaluating ones. We have previously introduced a steady‐state parent selection strategy, SWEET (“Selection whilE EvaluaTing”), that sometimes selects individuals that are still being evaluated and allows them to reproduce early. We perform a takeover‐time analysis that confirms that this strategy gives slow‐evaluating individuals that have higher fitnesses an increased ability to multiply in the population. We also find that SWEET appears effective at improving optimization performance on problems in which solution quality is positively correlated with evaluation time. We evaluate our approach on six simulated real‐valued optimization problems and three real‐world applications: an autonomous vehicle controller problem that involves tuning a spiking neural network and two adversarial EA problems. We further evaluate SWEET versus a basic asynchronous process in a simulated setting. We present evidence that SWEET outperforms basic asynchronous processes in a use‐case in which performance is positively correlated with evaluation time, and performs comparably (and often better) than basic asynchronous processes in several use‐cases where performance is negatively correlated with evaluation time. That said, in the cases where performance and evaluation time are negatively correlated the variance of outcomes for SWEET is notably high.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Evaluation and development of surface layer scheme representation of temperature inversions over boreal forests in Arctic wintertime conditions

Abstract. In this study, the Noah land surface model used in conjunction with the Mellor–Yamada–Janjić surface layer scheme (hereafter, Noah-MYJ) and the Noah multiphysics scheme (Noah-MP) from the Weather Research and Forecasting (WRF) 4.5.1 mesoscale model are evaluated with regard to their performance in reproducing positive temperature gradients over forested areas in the Arctic winter. First, simplified versions of the WRF schemes, recoded in Python, are compared with conceptual models of the surface layer in order to gain insight into the dependence of the temperature gradient on the wind speed at the top of the surface layer. It is shown that the WRF schemes place strong limits on the turbulent collapse, leading to lower surface temperature gradient at low wind speeds than in the conceptual models. We implemented modifications to the WRF schemes to correct this effect. The original and modified versions of Noah-MYJ and Noah-MP are then evaluated compared to long-term measurements at the Ameriflux Poker Flat Research Range, a forest site in interior Alaska. Noah-MP is found to perform better than Noah-MYJ because the former is a two-layer model which explicitly takes into account the effect of the forest canopy. Indeed, a non-negligible temperature gradient is maintained below the canopy at high wind speeds, leading to overall larger gradients than in the absence of vegetation. Furthermore, the modified versions are found to perform better than the original versions of each scheme because they better reproduce strong temperature gradients at low wind speeds.

Geology↗

DOE OSTI2022

Development of a high-fidelity multi-physics coupling between MCNP6.2 and CTF4.0 for VVER applications

Ensuring system safety in the design, licensing, and operation phases is a priority in the nuclear industry. Performing extensive, full-scale reactor safety experiments is often prohibitive due to the large associated costs. Computational simulations offer an alternative safety analysis method, typically with significant cost reductions. Recent high-level developments in technology and increased availability of computational resources have allowed the development of high-fidelity, high-resolution multi-physics coupled codes. Such developments may be used to generate reference models for deterministic core calculations. Under this framework, the high-fidelity continuous energy Monte Carlo-based neutron transport code MCNP6.2 was coupled externally with the state-of-the-art thermal-hydraulics subchannel code, CTF4.0 for VVER (Water-Water Energetic Reactor) applications. A VVER-1000 fuel assembly model was used to demonstrate the capability of the coupled code. The converged coupled solution is compared to initial results, consisting of the first MCNP evaluation and first CTF evaluation after initialization. The VVER-1000 type assembly results are compared to other evaluations of the same assembly model. The findings indicate good agreement with expectations and reference cases, where available. The initial results of the coupled MCNP6.2/CTF4.0 calculations at the assembly level for steady-state calculations are presented in this study, which may support future work toward high-fidelity coupled full-core modeling capabilities. The multi-physics model may be further improved, enhanced, and expanded for both cycle depletion and transient applications. Such a multi-physics system will also be applicable to the VVER-1200 and other triangular lattice designs and support their deployment and operation safely and economically. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2025

A new biogeochemical modelling framework (FLaMe-v1.0) for lake methane emissions on the regional scale: development and application to the European domain

This study presents a new physical-biogeochemical modelling framework for simulating lake methane (CH 4 ) emissions at regional scales. The new model, FLaMe-v1.0 (Fluxes of Lake Methane), rests on an innovative, computationally efficient lake clustering approach that enables the simulation of CH 4 emissions across a large number of lakes. Building on the Canadian Small Lake Model (CSLM) that simulates the lake physics, we develop a suite of biogeochemical modules to simulate transient dynamics of organic Carbon (C), Oxygen (O 2 ), and CH 4 . We first test the performance of FLaMe-v1.0 by analyzing physical and biogeochemical processes in two theoretical lakes with characteristics that can be considered representative for many lakes (an oligotrophic, deep lake driven by cold climate versus a eutrophic, shallow lake driven by warm climate). Next, we evaluate the model by comparing simulated and observed timeseries of CH 4 emissions in four well-surveyed lakes. We then apply FLaMe-v1.0 at the European scale to evaluate simulated diffusive and ebullitive lake CH 4 fluxes against in-situ measurements in both boreal and central European regions. Finally, we provide a first assessment of the spatio-temporal variability in CH 4 emissions from European lakes with a surface area comprised between 0.1–1000 km 2 (n= 108 407, total area = 1.33 × 105 km 2 ), indicating a total emission of 0.97 ± 0.23 Tg CH 4 yr −1 , with the uncertainty constrained by combining FLaMe-v1.0 and machine learning techniques. Moreover, 30 % and 70 % of these CH 4 emissions are through diffusive and ebullitive pathways, respectively. Annually averaged CH 4 emission rates per unit lake area during 2010–2016 have a South-to-North decreasing gradient, resulting in a mean over the European domain as 7.39 g CH 4 m −2 yr −1 . Our simulations reveal a strong seasonality (with ice-blocking effects accounted for) in European lake CH 4 emissions, with nearly ten times higher emissions during late summer than during winter. This pronounced seasonal variation highlights the importance of accounting for the sub-annual variability in CH 4 emissions to accurately constrain regional CH 4 budgets. In the future, FLaMe-v1.0 could be embedded into Earth System Models to investigate the feedback between climate warming and global lake CH 4 emissions.

Maisonnier, Manon [Free Univ. of Brussels (Belgium↗

DOE OSTI2022

Evaluation of Heat Exchanger Technology for Integrated Energy System: Methodology and Preliminary Application

This report proposes a novel heat exchanger evaluation method, based on integrated QFD-AHP technique, to support strategic optimal selection of heat exchanger (HX) technology for integrated energy systems. The term “optimal selection” is defined as selecting a product (i.e., HX) that best meets various aspects of end user demand, including both technical and economic requirements. Compared to previous HX evaluation methods, the proposed approach allows decision makers to explicitly take into account the practical demand of customers (i.e., HX end users) which may vary depending on the HX application target. In addition, the proposed evaluation method can be used not only for high-level decisions to select HX type, but also for low-level decisions such as the selection of the key components including HX material or heat transfer fluid. The focus of this study is to describe the new HX evaluation method and to illustrate the overall HX evaluation and selection processes using the three nuclear heat application cases that represent the thermal integration between advanced nuclear reactors and industrial processes. As a preliminary study, three different types of HX, i.e., shell-and-tube heat exchanger, printed circuit heat exchanger, and heat pipe heat exchanger, were compared.

42 ENGINEERING↗

DOE OSTI2022

High bias machine learning for antineutrino-based safeguards for small reactors

The statistical methods used for antineutrino detection will need to be improved to effectively monitor the inventory of next-generation nuclear reactors. In this sensitivity study, we evaluate machine learning models compared to previously used statistical approaches to identify diversion scenarios in a simulated Advanced Fast Reactor (AFR)-100. A chi-square goodness-of-fit technique, which individually compares the simulated antineutrino yields to the expected antineutrino yield, resulted in precise but low diversion detection probability. Various support vector machine (SVM) models were applied with diverse training datasets to evaluate the robustness of the method towards unexpected or “unseen” diversion scenarios. Furthermore, our results indicate that while the SVM models significantly improved the detection probability of near-field antineutrino-based safeguards, up to a probability of ~0.04, for the simulated small reactor, the detection system still needs improvements to reach the 0.2 detection limit established by the International Atomic Energy Agency.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗