Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “protocol (computers)”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

1,165 records · Page 65

Studies of Vestibular Neurons in Normal, Hyper- and Hypogravity

During the past year, pre-, in- and postflight studies were conducted in association with the Axon project for Bion 10 (Cosmos 2229). Recordings were made during pre- and postflight studies, from 118 horizontal semicircular canal afferents and 27 vestibular nucleus neurons in 7 rhesus monkeys; 137 pulse rotation protocols alone were executed (548 acceleration and deceleration responses were curve fit). Usable data was obtained from 127 horizontal afferents concerning their spontaneous discharge. Curve fits and analysis was made of sinusoidal and sum of sinusoidal responses from 42 and 35 horizontal afferents, respectively. Also recordings were made from neurons inflight from the two flight animals. The mean spontaneous rate varied from 128 spikes/sec. during preflight to 92 spikes/sec during postflight (day 5) - a change of 28%. In direct contrast to the results of Cosmos 2044, the best fitted neural adaptation operator (k) and the gain of the pulse response were decreased during post flight when compared to preflight. Surprisingly, the best fitted gain and k values for the sum of sines were slightly elevated during post flight tests. The gain and phase of single sine responses were compared for pre- and post flight tests and compared to a larger population of afferents. In contrast to Cosmos 2044 results where on the first day of post flight testing the gains of the best fitted sine response were skewed toward the higher values of the Miles and Braitman distribution, the gain of the best fitted sine responses during the first day of post flight testing (day 2) during Cosmos 2229 were exactly on the mode of the Miles and Braitman distribution. Thus, at least for the periodic stimuli, (pulses and sine waves) we found no change in gain and neural adaptation during post flight testing following Cosmos 2229. This conclusion is different from the one derived following the Cosmos 2044 flight. Cosmos flight 2229 differed from Cosmos flight 2044 in several significant ways: For example, during preflight, (1) The animals preflight training was different (less well trained on the gaze task) and (2) the animals were exposed to more experimental manipulations (surgical and rotational). Inflight, (1) the animals were required to make a pointing gesture (motor response) in association with eye movements to obtain reward, (2) the inflight diet was different (more balanced), (3) the feeder for one of the animals clogged following 9 days of flight resulting in evident dehydration and probably less head motion exposure in that monkey and (4) there was limited video taping of the monkeys in space. During postflight, (1) we were unable to test the flight animals until 26 hours postflight as compared to 14.5 hours during Cosmos 2044, (2) the animals received significantly more exposure to motion stimuli during postflight testing than during Cosmos 2044. These differences in the vestibular environment will require analysis of several parameters other than just neural and eye movement responses. For example, computer programs will have to be written and used to recover and quantify the number of head movements made by each animal during flight. This activity is critical to the production of neural adaptation and increased gain.

Correia, Manning J.↗

Mitigation of birefringence in cavity-based quantum networks using frequency-encoded photons

Atom-cavity systems offer unique advantages for building large-scale distributed quantum computers by providing strong atom-photon coupling while allowing for high-fidelity local operations of atomic qubits. However, in prevalent schemes where the photonic state is encoded in polarization, cavity birefringence introduces an energy splitting of the cavity eigenmodes and alters the polarization states, thus limiting the fidelity of remote entanglement generation. To address this challenge, we propose a scheme that encodes the photonic qubit in the frequency degree-of-freedom. The scheme relies on resonant coupling of multiple transverse cavity modes to different atomic transitions that are well-separated in frequency. We numerically investigate the temporal properties of the photonic wavepacket, two-photon interference visibility, and atom-atom entanglement fidelity under various cavity polarization-mode splittings and find that our scheme is less affected by cavity birefringence. Finally, we propose practical implementations in two trapped ion systems, using the fine structure splitting in the metastable D state of 40 Ca + , and the hyperfine splitting in the ground state of 225 Ra + . Furthermore, our study presents an alternative approach for cavity-based quantum networks that is less sensitive to birefringent effects, and is applicable to a variety of atomic and solid-state emitter-cavity interfaces.

Cavity quantum electrodynamics↗

Facilitating Data Collection of Maintenance Events to Populate the Hydrogen Component Reliability Database (HyCReD)

The Hydrogen Component Reliability Database (HyCReD) is a collaborative project between the National Renewable Energy Laboratory, the University of Maryland, and hydrogen stakeholders to improve safety and reliability for hydrogen facilities by implementing component reliability data taxonomies that support hydrogen infrastructure failure rate analysis. The project aims to quantify failure rates of hydrogen components through high-quality data collection and analysis on root causes and maintenance needed. HyCReD provides a common database for cataloging hydrogen component failures which exists for reliability research in many other mature industries [2]. The database fills a gap for the hydrogen community by providing a scientifically rigorous approach to quantitative risk assessment (QRA), prognostic health management (PHM), and reliability-centered maintenance (RCM) analysis. High level results will be aggregated and anonymized to protect company sensitive information; detailed results will be used to help address issues of hydrogen components. These advanced analytics will support accelerated deployment of hydrogen infrastructure by enabling better: design and safety of projects (safety codes and standards development), infrastructure reliability and cost (component failure rates, maintenance protocols), and component R&D needs (robust supply chain). A key to a successful HyCReD implementation is facilitating the ease of reporting and data quality in the database that can be used for analysis. Maintenance data was a previously identified gap in initial efforts to populate and validate the database taxonomies [3]. Collection of maintenance data will be instrumental in identifying failure modes and rates, identifying incipient component failures or reduced performance, cataloging best practices for maintenance routines and methods for prognostic health management, and quantifying the risk and effect of different failure modes. Several key priorities are identified for streamlined data collection to achieve quality and detailed failure data: Applicability, Ease of Use, Accessibility, and Information Security. The HyCReD team has now begun deployment of the database to several companies and groups that have signed non-disclosure agreements to facilitate the data collection of failures in industry hydrogen refueling station infrastructure. This paper will provide an update into the process of HyCReD deployment including the development of a coding guide for facility personnel to reference and ensure data quality and consistency from one station to another as well as implementation of contextually dependent data fields of system taxonomy and formatted entries to provide ease of use. The goal is to communicate the lessons learned from the roll-out to technicians and engineers in the field, and the addition of need for high level of security to protect all stakeholders.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

A Centralized AI Lakehouse Framework for Brain Tumor MRI Classification and Segmentation, University KPI Forecasting, and Water Potability Prediction

In many university and healthcare projects, models are built for very different data types such as tables, institutional time series, and medical images, but they are deployed as separate applications. In this work, that separation made testing and maintenance difficult because each module had its own pipeline and runtime requirements. This paper presents an integrated AI lakehouse-style implementation that runs three model pipelines inside one containerized backend. For medical imaging, we used MRI datasets from IEEE DataPort: a four-class classification set with 7012 images (5708 train/1304 test) and a segmentation set with 3063 image–mask pairs. The classification model (ResNet50 transfer learning) is evaluated using a proper train–validation–test protocol across multiple splits (80/10/10, 70/10/20, 60/10/30, and 10/30/60), achieving a test accuracy of 99.00% under the standard 80/10/10 split. Additionally, a patient-level evaluation is conducted using an external glioma dataset to provide a more realistic assessment without data leakage. The segmentation model (DeepLabV3-ResNet50) achieved 83.09% validation mIoU and 88.79% Dice score. For university KPI forecasting, we used annual IPEDS and NSF HERD data from 2010 to 2023 for three universities (BSU, EOU, and UAB). To examine the effect of preprocessing on forecasting performance, two case studies are conducted. In the first case, linear interpolation is applied to generate semester-level data. In the second case, the original annual data is used directly without interpolation. Random Forest regression and ARIMA models are evaluated using MAE, RMSE, MAPE, and R 2 . The results showed that interpolation improved apparent forecasting performance due to smoothing, while evaluation on the original annual data provided a more realistic assessment of model behavior. To further validate the framework on a larger dataset, an additional case study is conducted using a student dropout dataset. For water potability, we trained and compared multiple tabular classifiers on a large dataset (1,048,575 samples). A Random Forest model (100 trees, max depth 10) achieved 85.86% test accuracy and high recall for unsafe samples (0.8447). All modules are served via FastAPI and deployed together using Docker, with workflow automation routing requests to the correct endpoint. System-level benchmarking indicates that the backend maintains stable throughput and latency under concurrent requests.

97 MATHEMATICS AND COMPUTING↗

Autonomous System Inference, Trojan, and Adversarial Reprogramming Attack and Defense (Final)

In the world of ever-advancing technology, Autonomous Systems (AS) find extensive application, bolstering functionalities of critical infrastructures such as nuclear power plants. These systems, however, are increasingly becoming a target for nefarious activities, namely through inference attacks, trojan attacks, and adversarial reprogramming. This paper delves into a comprehensive exploration of machine learning (ML)-driven autonomous control systems within advanced nuclear reactor designs, revealing the vulnerabilities and proposing strategies for defense against potential cyber-attacks. Advanced cyber-attacks against critical infrastructure and the energy sector are becoming more common. With the invention of autonomous control systems (ACS) within advanced nuclear reactor designs, system designers, reactor operators, and regulators must consider cybersecurity during the design and operational phases. This article provides a cyber threat assessment of machine learning (ML)- based digital twinning (DT) technologies in the context of advanced reactor ACS. A cyber-physical testbed was created to emulate nuclear reactor digital instrumentation and controls (I&C) and act as a basis for the ACS. The ACS was designed as two plant-level DTs predicting reactor malfunctions and determining control actions and two component-level DTs responsible for classifying component states and forecasting component inputs and outputs (I/O). Two duplicate ACS designs– one using a traditional ML framework and one using an automated ML (AutoML) framework– were created and tested against cyber-attacks on training data, real-time process data, and ML model architectures to determine their respective qualitative cyber-risk in terms of likelihood and impact. Both frameworks showed similar cyber-resilience against training, real-time, and ML architecture attacks, proving that neither is inherently more secure. Recommended safeguard and security measures are posed to system designers, reactor operators, and regulators to maintain the cybersecurity of ML-based DT technologies such as ACS, prompting a holistic view of shared responsibility for maintaining cyber-secure ML-based systems. As global reliance on generation III reactors begins to be critically assessed, the evolution towards advanced reactor systems utilizing digital instrumentation and controls (I&C) becomes not merely preferable, but essential. The integration of semi and fully autonomous control systems (ACS), powered by digital I&C and machine learning (ML)-based digital twinning (DT) technologies, emerges as a potent strategy to mitigate operations and maintenance costs, thereby enhancing the economic feasibility of novel reactor designs. However, with a staggering 500% and 380% increase in cyber-attacks reported against the energy sector by the United States Department of Energy (DoE) and the European Union respectively, a surge in cyber vulnerabilities specifically targeting the nuclear industry has been 2 markedly observed. Notable incidents, such as the W32.Ramnit spyware infiltration at the Gundremmingen nuclear power plant in Germany and the Dtrack spyware intrusion at the Kudankulam nuclear power plant in India, while not directly compromising core industrial control systems (ICS), underscore a compelling necessity to fortify cybersecurity protocols in safeguarding reactor systems against increasingly adept digital adversaries. In light of this, our investigation extends beyond conventional cybersecurity parameters, diving into the intricate web of potential vulnerabilities woven into ML-based DTs and ACS in advanced reactor systems. A crafted cyber-physical testbed and preliminary ACS were devised to act as a mirror, reflecting potential configurations of advanced reactor control designs. Moreover, this study is intertwined with a scrutinization of ML models, developed either through conventional, manually tuned methodologies or via automated means through AutoML, probing into their cyber-risk profiles within operational technology (OT) environments. Expanding on this, two distinct ACS blueprints were forged – one navigating through the corridors of traditional ML and the other traversing the path of AutoML – in an effort to holistically encapsulate the considerations pivotal to ML-based DT control system design. Employing the SANS Institute Industrial Control System (ICS) Kill Chain and the MITRE ATT&CK Tactics, Techniques, and Procedures (TTP) framework, a structured analysis was conducted, launching three targeted attacks against the training dataset, real-time dataset, and ML models, therein dissecting the potential cyber-attack implications against both ML frameworks within an ACS milieu. It is essential to note that three distinct categories of attacks were conducted against both ACS configurations, each encompassing three distinct ML-based DTs, cumulating in a total of 18 varied attacks. This exploration extends into the realms of Autonomous System Inference, Trojan, and Adversarial Reprogramming Attack and Defense, unraveling vulnerabilities, and opportunities for fortified defenses against such intrusions, particularly where ML-driven technologies, and by extension, ACS, are deployed. Final recommendations, articulated through a lens of security, safeguard, and implementation considerations, are presented for both traditional and AutoML models, anchoring upon the existing knowledge landscape and ML-based DT modeling for ACS, and are offered as a beacon to guide the nuclear industry through the intricate cybersecurity challenges that lie ahead.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Advancing Multi-Hazard Risk and Safety Considerations for Aging Nuclear Facilities (Revision 1)

This project will demonstrate a multi-hazard time-dependent probabilistic risk assessment (PRA) approach for nuclear facilities considering aging-related deterioration of structures. A generic pressurized water reactor (PWR) reactor subjected to seismic mainshock-aftershock sequences considering the aging of the containment structure will be used as a case study to demonstrate the multi-hazard PRA approach. Using advanced modeling and simulation, seismic mainshock-aftershock fragility functions will be simulated for the containment structure considering aging effects. A multi-hazard PRA model for a generic PWR reactor will be built to quantify the multi-hazard core damage frequency (CDF) and large early release frequency (LERF) with explicit time-dependent modeling of event sequences. To date, the cascading impacts of multi-hazards are not adequately accounted for in the PRA models for nuclear facilities. In addition, for both initial and periodic evaluation of facilities to withstand natural phenomena hazards (NPH), deterioration of the SSCs due to aging and other effects is not adequately considered. By advancing multi-hazard considerations accounting for aging effects, this project will contribute to improved understanding of the safety of aging nuclear facilities. Project outcomes such as the multi-hazard CDF and LERF will also allow facility owners to optimize upgrade and retrofit protocols. This project is divided into two components: (1) advanced modeling and simulations; and (2) multi-hazard PRA. For the first component, Idaho National Laboratory’s (INL) Multi-hazard Analysis for STOchastic time-DOmaiN phenomena (MASTODON) and BlackBear codes will be used to simulate the seismic response and damage of a containment structure under cascading mainshock-aftershock sequences with aging effects. Uncertainties related to the seismic inputs, material parameters, and environmental factors such as temperature and humidity will be identified and propagated to the fragility functions. These fragility functions, which consider aging effects, will be time dependent. The second component will take the fragility information from the first component to build a multi-hazard time-dependent PRA model starting from a generic PWR model to evaluate the multi-hazard CDF and LERF and characterize the associated consequences. For this component, OpenPRA Web Application and SAPHIRE code will be used. Events such as the Fukushima Daiichi accident have highlighted the importance of considering the cascading impacts of multi-hazards for PRA. Moreover, many of the reactors in the current nuclear fleet in the United States (US) are already operating well beyond their initially planned design life, and applications for further extensions to operating licenses are being considered. Therefore, considering multi-hazard effects and aging deterioration in the NPH risk assessment process will contribute to the safety of both existing and future nuclear facilities. Outcomes of this project will thus directly benefit the standards DOE-STD-1020-16 and DOE-HDBK-1224-18.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Subtask 1.3 – Integrated Carbon Capture and Storage for North Dakota Ethanol Production

The Energy & Environmental Research Center (EERC), in partnership with Red Trail Energy, LLC (RTE), a North Dakota ethanol producer; the North Dakota Industrial Commission (NDIC) Renewable Energy Program (REP); and the U.S. Department of Energy (DOE), conducted a feasibility and implementation study for a commercial carbon capture and storage (CCS) effort. This subtask provided technical support and developed recommended practices of how small-scale industrial CO2 emitters (<1,000,000 tonnes of CO2 emitted annually) may economically deploy CCS. The 64-million-gallon dry mill RTE ethanol facility, emitting an average 180,000 tonnes of CO2 annually, was the subject of the case study. The positive outcome of this research, which shows technical and economic potential for ethanol–CCS in North Dakota, has resulted in RTE acquiring an approved Permit to Drill on December 2, 2019, for a stratigraphic test well in early 2020, a necessary step toward a North Dakota CO2 Storage Facility Permit (SFP) for the RTE CCS effort. Outcomes include 1) validating the Broom Creek Formation as a regional target for CCS, 2) determining the full carbon life cycle of an industrial fuel production facility with CCS, 3) developing a field implementation plan (FIP) for small-scale CCS, and 4) determining the validity and pathway for using CCS to meet low-carbon fuel (LCF) standards. The technical team included the EERC, RTE, Trimeric Corporation, Schlumberger Carbon Services, and Computer Modelling Group (CMG). Findings from activities conducted November 2016 – May 2020 are summarized as follows. Several key steps have been accomplished toward validating the Broom Creek Formation as a CO2 injection and storage target at the RTE CCS site, including verification of the presence and structure of sandstone layers that may comprise the potential CO2 storage reservoir and the several thousand feet of overlying confining zone. Work included site characterization using existing data, interpretation of seismic data within the study area, and geologic modeling simulation of CO2 injection. Interpreted results estimate 3000 feet of confining zone between the Broom Creek Formation (storage target) and the lowermost underground source of drinking water (e.g., the Fox Hills Formation). The thickness of the Broom Creek injection target varies 230–420 ft within the survey area. Results were used to inform the location of a stratigraphic test well and associated characterization test program. No impediments were identified within the targeted CO2 storage complex that would prevent the project from moving forward. A stratigraphic test well is the next step to validate these results and to acquire remaining data necessary to develop a North Dakota CO2 SFP application. The EERC generated full carbon life cycle estimates for CCS integration with the RTE ethanol facility. Results indicated that an average 40% reduction in CO2 emissions is possible through CCS implementation. Approximately half of the carbon in the overall life cycle for a dry mill ethanol plant is generated through the fermentation process and emitted to the atmosphere; this is the CO2 stream targeted for CCS. The remaining carbon is attributed to corn feedstock farming (diesel, fertilizer), energy for fuel processing (natural gas, electricity), and transportation (diesel) of the fuel product. Life cycle carbon estimates are also affected by the anticipated energy consumption of a potential capture facility, which depend on the type of CO2 product generated. For example, a 30%–40% net CO2 emission reduction is estimated if a liquefied CO2 facility were incorporated compared to a 40%–50% net CO2 reduction if a supercritical “injection-grade” CO2 product is generated; i.e., more energy is required to further refine the CO2 stream, affecting the full carbon life cycle estimates. A CCS FIP was developed and initiated at the RTE CCS site, resulting in the development of several guidance documents: a CO2 Capture Process Design Package, a North Dakota CO2 geologic Storage Permits Template, and a Public Outreach Package for CCS in North Dakota. General FIP components include CO2 capture system, pipeline and well designs; monitoring, verification, and accounting (MVA) plans; geologic characterization and testing programs; and permitting and outreach plans. Vendor bids were also acquired for the CO2 liquefaction facility. Near-surface characterization (groundwater and soil gas sampling) and geologic characterization (seismic survey) were initiated to inform development of a UIC Class VI-compliant MVA plan compliant with a North Dakota CO2 SFP. Designs (well and geologic testing) were completed for a stratigraphic test well compliant with a North Dakota CO2 SFP. In addition, the outreach plan was executed, including community open houses, meetings with city/county/state officials, and development of public materials. Although other entities continued to mature incentive programs in 2019–2020, California and the Internal Revenue Service (IRS) currently provide the most advanced economic opportunities for CCS integrated with fuel production. The California Low-Carbon Fuel Standard (LCFS) adopted a CCS Protocol in January 2019, allowing submittal of a design-based pathway (DBP) application for an approved temporary (not certified) carbon intensity value for a fully engineered facility. An ethanol–CCS DBP application to the California LCFS Program (officially approved February 28, 2020) was developed to show that the RTE CCS effort meets LCFS requirements. The approved DBP provides confidence to advance the project and supports potential investments. Other entities continue to mature incentive programs. The IRS issued guidance in February 2020 that addresses the definition of beginning of construction and revenue procedure on partnerships for the Enhancement of Carbon Dioxide Sequestration Credit (a.k.a. Section 45Q) CCS tax credit program; the IRS anticipates issuing further guidance on issues such as secure geologic storage, utilization qualifications, and recapture of claimed credits. Maturing incentive programs coupled with workable permitting regulations provide confidence to advance CCS projects in North Dakota and support financial investment to proceed with designing, constructing, and implementing CCS projects at small-scale fuel production facilities. The largest hurdles for CCS implementation at small-scale industrial systems are often business/economic-related (i.e., not technical). Market uncertainty already exists for agriculture-based alternative fuels such as corn ethanol, for which production has increased by ~33%, and prices have correspondingly lowered since 2015. Passing the Section 45Q tax credit program improves economic feasibility for CCS but may require external investors for a small business to achieve maximum benefits. Public–private partnerships with NDIC and DOE have resulted in foundational technical and regulatory knowledge, growing stakeholder confidence, and a pathway to implementation that enables similar industrial CCS projects in the region to advance. This subtask was funded through the EERC–DOE Joint Program on Research and Development for Fossil Energy-Related Resources Cooperative Agreement No. DE-FE0024233. Nonfederal funding was provided by NDIC and RTE. The authors would also like to thank CMG, ESRI, IHS, Neuralog, and Schlumberger for allowing the use of their software packages in support of this work.

42 ENGINEERING↗

Development of the IES Plug-and-Play Framework

This report discusses the status of the flexible plug-and-play framework development currently ongoing that aims to integrate Modelica/Dymola with the Risk Analysis and Virtual ENvironment (RAVEN) software in terms of both Functional Mock-Up Interface (FMI)/Functional Mock-Up Unit (FMU) construction and repository structures that aim to ease the sharing and simulation of complex dynamic models. This report aims to provide an overview of all the performed activities resolving around the deployment of methods, software infrastructures, guidelines and workflow for the construction and usage of models, encapsulated using the FMI/FMU protocols and standards. In particular, the report is organized in three main macro-subjects, which are connected to each other: - FMI/FMU adaptors for modelica models - HYBRID repository new structure and open-source deployment - RAVEN FMI/FMU exporting capabilities and Artificial Intelligence (AI)-based analysis acceleration. The first part of the report discusses the FMI/FMU adaptors that have been created within the HYBRID repository to allow users to quickly export models, such as FMUs. Several examples are shown that highlight the step-by-step process of converting an existing Modelica model into an FMU for use within the Dymola platform. Simulation results demonstrate that, while minor differences may occur, the overall control, trends, and solution integrity are maintained between standard Modelica simulation and FMU simulation results. However, it is worth noting that, for small systems, the FMU results have a slower simulation time than the Modelica only simulation. Using this process, a company can provide models that contain proprietary information to entities without disclosing any of the information about the model that could be considered business sensitive. Such an ability would allow institutions to bypass the necessity of “whitewashing” data. In the second part of the report, the new structure of the HYBRID repository is discussed with a major focus on the series of updates that has been completed. These updates include the addition of Modelica system-level regression tests and software quality assurance documentation that ensure that modifications to the Modelica models do not alter system-level model results. The third and final part of the report aims to report the work that has been performed for the deployment of methods and workflows for the construction of RAVEN AI-based models compliant with the FMI/FMU standard. Such development represents the key for the deployment of the concept of “Flexible ecosystem” since it allows for the replacement of high-fidelity modelica models (or any other FMI/FMU compliant model) with RAVEN generated AI surrogate models. Overall, extensive work has been completed on developing FMUs and FMIs from existing models, understanding the requirements and limitations of FMUs, and open-sourcing the HYBRID repository with an integrated regression system.

42 ENGINEERING↗

Precursor Analysis Report: Industroyer Targeting Ukraine Electric Power Transport Utility (Ukrenergo) 2016

The Industroyer Targeting Ukraine Electric Power Transport Utility (Ukrenergo) 2016 Precursor Analysis Report leverages publicly available information about the December 2016 cyber attack against the Ukrainian Ukrenergo electric transmission utility and catalogs anomalous observables for each technique employed in the attack. This analysis is based upon the methodology of the Cybersecurity for the Operational Technology Environment (CyOTE) program. Industroyer is a modular malware framework designed to deploy several Industrial Control System (ICS) protocol-specific attack payloads to disrupt electricity distribution. Adversaries deployed Industroyer within the target network on a Microsoft Windows endpoint capable of directly manipulating or communicating with ICS. Industroyer abuses the functionality of a targeted ICS’s legitimate control system to achieve its intended impact. Adversaries likely first gained access to Ukrenergo enterprise networks in early 2016 after a successful spearphishing campaign against organizations in the electric power sector. Adversaries then began capturing credentials beginning on 1 December 2016. This allowed access to the ICS environment at the Pivnichna electric transmission substation outside Kyiv through a device dual-homed on the Information Technology (IT) and ICS networks. Adversaries conducted discovery, targeting, and access to this device using information and previously captured credentials from compromised enterprise IT machines. Finally, the adversaries deployed and launched the Industroyer malware just before midnight on 17 December. By midnight, Ukrenergo had lost control of a targeted substation, resulting in electric power outages for over an hour in the city of Kyiv and the Kyiv region. Researchers and analysts identified 31 unique techniques (used in a sequence of 33 steps) utilized during the attack with a total of 846 observables using MITRE ATT&CK® for Industrial Control Systems. The CyOTE program assesses observables accompanying techniques used prior to the triggering event to identify opportunities to detect malicious activity. If observables accompanying the attack techniques are perceived and investigated prior to the triggering event, earlier comprehension of malicious activity can take place. Twenty-nine of the identified techniques used during the Industroyer cyber attack were precursors to the triggering event. Analysis identified 548 observables associated with these precursor techniques, 353 of which were assessed to have an increased likelihood of being perceived in the 300 days preceding the triggering event. The response and comprehension time could have been reduced if the observables had been identified earlier. The information gathered in this report contributes to a library of observables tied to a repository of artifacts, data sources, and technique detection references for practitioners and developers to support the comprehension of indicators of attack. Asset owners and operators can use these products if they experience similar observables or to prepare for comparable scenarios.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Development of the IES Plug-and-Play Framework

This report discusses the status of the flexible plug-and-play framework development currently ongoing that aims to integrate Modelica/Dymola with the Risk Analysis and Virtual ENvironment (RAVEN) software in terms of both Functional Mock-Up Interface (FMI)/Functional Mock-Up Unit (FMU) construction and repository structures that aim to ease the sharing and simulation of complex dynamic models. This report aims to provide an overview of all the performed activities resolving around the deployment of methods, software infrastructures, guidelines and workflow for the construction and usage of models, encapsulated using the FMI/FMU protocols and standards. In particular, the report is organized in three main macro-subjects, which are connected to each other: - FMI/FMU adaptors for modelica models - HYBRID repository new structure and open-source deployment - RAVEN FMI/FMU exporting capabilities and Artificial Intelligence (AI)-based analysis acceleration. The first part of the report discusses the FMI/FMU adaptors that have been created within the HYBRID repository to allow users to quickly export models, such as FMUs. Several examples are shown that highlight the step-by-step process of converting an existing Modelica model into an FMU for use within the Dymola platform. Simulation results demonstrate that, while minor differences may occur, the overall control, trends, and solution integrity are maintained between standard Modelica simulation and FMU simulation results. However, it is worth noting that, for small systems, the FMU results have a slower simulation time than the Modelica only simulation. Using this process, a company can provide models that contain proprietary information to entities without disclosing any of the information about the model that could be considered business sensitive. Such an ability would allow institutions to bypass the necessity of “whitewashing” data. In the second part of the report, the new structure of the HYBRID repository is discussed with a major focus on the series of updates that has been completed. These updates include the addition of Modelica system-level regression tests and software quality assurance documentation that ensure that modifications to the Modelica models do not alter system-level model results. The third and final part of the report aims to report the work that has been performed for the deployment of methods and workflows for the construction of RAVEN AI-based models compliant with the FMI/FMU standard. Such development represents the key for the deployment of the concept of “Flexible ecosystem” since it allows for the replacement of high-fidelity modelica models (or any other FMI/FMU compliant model) with RAVEN generated AI surrogate models. Overall, extensive work has been completed on developing FMUs and FMIs from existing models, understanding the requirements and limitations of FMUs, and open-sourcing the HYBRID repository with an integrated regression system.

14 SOLAR ENERGY↗

Traceable random numbers from a non-local quantum advantage

The unpredictability of random numbers is fundamental to both digital security and applications that fairly distribute resources. However, existing random number generators have limitations—the generation processes cannot be fully traced, audited and certified to be unpredictable. The algorithmic steps used in pseudorandom number generators are auditable, but they cannot guarantee that their outputs were a priori unpredictable given knowledge of the initial seed. Device-independent quantum random number generators can ensure that the source of randomness was unknown beforehand, but the steps used to extract the randomness are vulnerable to tampering. Here we demonstrate a fully traceable random number generation protocol based on device-independent techniques. Our protocol extracts randomness from unpredictable non-local quantum correlations, and uses distributed intertwined hash chains to cryptographically trace and verify the extraction process. This protocol forms the basis for a public traceable and certifiable quantum randomness beacon that we have launched. Over the first 40 days of operation, we completed the protocol 7,434 out of 7,454 attempts—a success rate of 99.7%. Each time the protocol succeeded, the beacon emitted a pulse of 512 bits of traceable randomness. The bits are certified to be uniform with error multiplied by actual success probability bounded by 2−64. Further, the generation of certifiable and traceable randomness represents a public service that operates with an entanglement-derived advantage over comparable classical approaches.

97 MATHEMATICS AND COMPUTING↗

AI Model Benchmarking for Nonproliferation Applications: Steel Thread Benchmarking Task Force Technical Report (Rev. 2)

Steel Thread is a NA-22 venture that seeks to build trustworthy, reliable AI models that can be used in a wide variety of nonproliferation tasks. A key aspect of building these models is developing appropriate benchmarks and evaluation methods, which will enable the venture to identify and adapt models to provide the most value in the nonproliferation domain. Benchmarks must be relevant to key tasks in this domain, such as question answering, information retrieval, document summarization and classification, consensus analysis, and image and data analysis. This report 1) provides an overview of benchmark design, evaluation, and challenges; 2) reviews a variety of open benchmarks, with a focus on language models and tasks; and 3) identifies benchmarks that are most relevant to Steel Thread. This report is intended to serve as a basis for further efforts to classify and evaluate benchmarks and their correlation with success on nonproliferation-specific tasks. The Steel Thread venture has defined benchmarks to be a particular combination of a dataset (or datasets) and a metric (or metrics) conceptualized as representing one or more specific tasks or sets of abilities for a specific modality. It is adopted by a research community as a shared framework for comparing methods.1 It includes 1) Data: Labeled (a designated subset not used for training, which could be all the data), 2) Metric: A way to quantify performance, 3) Task/Ability: What the benchmark is testing, 4) Protocol: A structured and repeatable evaluation process, 5) Baseline/Reference Model: For comparison; could be statistical, rule-based, SME-derived, or another model, and 6) Maintenance Plan: to update with new information over time; important for long-term utility. For further clarity, the definition includes what a benchmark, in this context, is not. It is not a corpus of training data, specific to a model (it is intended to apply to a range of models), a universal evaluation of performance, a guarantee that the ‘top’ model on the leaderboard will be the best fit for every specific use case, an all-encompassing proof of a model’s universal quality, nor is it a one-size-fits-all measure of success. It does not cover every real-world constraint (like operational, ethical, or cost considerations), a systems integration test, or a unit test. This definition was inspired by and resulted from discussions within the Steel Thread Benchmarking Task Force. This group was formed to define what we would mean as a benchmark within Steel Thread but persisted as the need to develop a thorough understanding of the large and expanding existing benchmarking space. This technical report is a result of the group’s divide and conquer approach to exploring this space. The release of benchmarks might not be progressing as quickly as model development, but it is moving very fast, as many benchmarks quickly become saturated, when state-of-the-art models score so close to the benchmark’s ceiling that their results are virtually indistinguishable. At that point, the test no longer differentiates between new systems, so researchers usually stop reporting scores as the benchmark no longer informs about improvements from the next generation of models. In the OpenAI announcement of GPT-5, they reported results on six flagship public benchmarks (AIME 2025, SWE-bench Verified, Aider Polyglot, MMMU, HealthBench Hard, GPQA) but the full system-card covers roughly thirty-five separate evaluations, comprising hundreds of test task items in total. There have been some efforts to summarize benchmarks in specific fields, like for text-to-image generation, but these surveys have had a narrow methodology scope. Therefore, a comprehensive survey of all benchmarks or even all benchmarks that could be relevant to Steel Thread is outside of the scope of this report. We chose some specific benchmarks to investigate in detail.

97 MATHEMATICS AND COMPUTING↗

Support for Reactor Operators in Case of Cyber-Security Threats (NEUP Final Report)

Increasing use of digital technology in nuclear power plants (NPPs) poses cyber-security as a crucial threat to public safety and to continuous energy production. Cyber-security risks are comprised of complex known and unknown interactions between various entities, system vulnerabilities, network protocols, human users and malicious attacks. There is little understanding or research geared towards plant operators’ response under cyber-security threats and operational procedures to cope with such threats. This is particularly critical when a cyber-security event masquerades as a safety incident or an evolving accident. Instead of leading operators to the remediation of the accident, the masked cyber event may lead them to circumvent the safety mechanisms of the plant. Given these challenges, the objective of this project is to develop a tool to characterize abnormal NPP events as “cyber” or “safety” incidents, and to further develop this tool as a real-time operator aid to assist in response to the incident. This NEUP Final Report summarizes the research efforts towards the above goals and the results in the following three aspects. First, a methodology for classifying abnormal NPP events as cyber-attacks or safety incidents was developed. This provides the basis for responding to potential cyber-attacks. In this methodology, the causal relationships between various variables (i.e., physical variables, network variables, and control variables) for a nuclear system under consideration are modeled using dynamic Bayesian networks. Based on observations of certain variables (i.e., the evidence), inference is performed to identify the state of hidden variables, which helps indicate the occurrence of cyber-attacks or safety incidents. The proposed methodology was applied to the full scope NPP simulator system at The Ohio State University as a case study. The result shows that the proposed methodology is capable of distinguishing between cyber-attacks and safety incidents. Second, a game-theoretic approach for responding to cyber-attacks on nuclear power plants was developed. This is the second major goal of the project, and the method is used to recommend optimal responses to reactor operators in the case of cyber-attacks. We consider two cases in this research. In the first case, the interaction between the defender (i.e., the reactor operator) and the attacker is modeled as a two-player, nonzero-sum, Markov game with an infinite time horizon. In the second case, we consider a semi-Markov game between the defender and the attacker within a finite time horizon. The model in the second case enables us to consider the time sensitive response of the defender. In each case, the method for deriving the Nash equilibrium is developed. The Nash Equilibrium of the game provides the valid prediction of both players’ actions because no single player can benefit from unilaterally deviating from the equilibrium policy if the other player adheres to his/hers, hence it provides the best response of the defender to cyber-attacks. The proposed method in each case is demonstrated through a simplified benchmark digital feedwater control system. Third, a prototype display is developed to integrate the above information. The prototype display depicts the communication information to the operator and incorporates the cyber-security tool developed by the team into the interface. It consists of the regular display in current control rooms, as well as a panel used to indicate the occurrence of cyber-attacks or safety events and a panel used to guide the operator’s response to detected cyber-attacks.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗