Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “unreliable”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

The Orbital Drift Impact on the Monthly Regional TOA Flux Assuming Constant Meteorology

The NASA Clouds and the Earth's Radiant Energy System (CERES) gridded Single Scanner Footprint (SSF1deg) product provides TOA SW and LW monthly 1° regional all-sky fluxes, which are used to monitor the Earth’s energy balance. The CERES long-term climate data record relies on Terra and Aqua satellite sun-synchronous orbits that are maintained at 10:30 and 1:30 local equator crossing times (LECT), respectively. The Terra and Aqua satellites are expected to drift outside of their respective LECT during mid 2022. Both Terra and Aqua will drift over several years towards sunrise and sunset, respectively, and eventually will be deorbited. The CERES SSF1deg product monthly regional fluxes are based on the well calibrated and stable CERES observed fluxes and are temporally interpolated assuming constant meteorology between measurements to resolve the regional diurnal flux cycle to obtain a daily averaged flux. The drifting orbits may impact the monthly regional TOA flux over regions with systematic diurnal cycles, because the observations will shift in local time. The CERES project would like to determine the maximum Terra and Aqua LECT time shift before the monthly regional fluxes are diurnally impacted and become unreliable for long-term climate monitoring. To determine the impact of the drifting orbits on the SSF1deg monthly regional fluxes,15-minute Geostationary Earth Radiation Budget (GERB) broadband observed fluxes over the Meteosat geostationary satellite domain (±60° in longitude and latitude) are used as proxy CERES observations. The drifting orbit sampling pattern is achieved by simply incrementing the observation time by steps of 15 minutes from the CERES footprint time. For each 15-minute time interval, the CERES observed fluxes are replaced by the GERB observed fluxes. The-15 minute incremented monthly regional fluxes based on constant meteorology are compared to the reference 10:30 and 1:30 LECT fluxes. Regions with systematic diurnal cycles, include morning maritime stratus, where the clouds dissipate during the morning, and land afternoon convection, where clouds increase in the afternoon will impact the regional flux differences. Based on January and July 2010 GERB data, even a 15-minute LECT change caused regional monthly flux differences that would impact long term regional trend analysis. Results will be shown at the conference.

D R Doelling↗

Earth Independent Medical Operations (EIMO) Datascope: Challenges and Potential Solutions

Data flows and storage/retrieval capacity are severely constrained during missions in space and challenges will become even greater during exploration class missions. There is a need for an artificial intelligence (AI)-based clinical decision support system (CDSS) to monitor and analyze data to provide real-time consultative support for crew medical officer (CMO) decision-making. EIMO is defined as the gradual transition of medical care and decision making from terrestrial to space-based assets, enabling support of astronaut health and performance and reducing overall mission risk. While a hallmark of this paradigm shift from low-earth orbit is that on-board care will increasingly become the responsibility of the astronauts for primary management and decision making, terrestrial assets will continue to be paramount in pre-mission screening and planning, as well as prevention, health maintenance and long-term care contingencies. New capabilities and systems that enable progressively more robust and resilient systems and crews will be necessary to reduce risk and increase probability of deep space exploration mission success. An aspiration for EIMO is to develop AI-enhanced solutions for analysis of crew health & performance data and to facilitate clinical decision support for autonomous medical operations. A “system of systems” approach is envisioned whereby EIMO will deploy AI-supported natural language processing and machine learning (ML) techniques to utilize embedded reference databases and real-time data streams [input vectors] from multiple data sources. Constituent input vectors may include environmental controls, countermeasures data, behavioral data, physiologic wearables, point-of-care laboratory tests, personalized medical records, inventory trade space risk assessments, COTS medical databases, and ground support inputs. An ideal AI capability would possess trained fusion algorithms to cross reference input vectors with medical ‘knowledge’ [cultivated database] to stratify relevant data streams for predictive and actionable capabilities. In addition, EIMO will feature mobility, in that it can be accessed and can push/pull data within and between multiple vehicles/habitats. Large amounts and variable sources of data can be leveraged to diagnose, inform treatment strategies, and potentially predict medical events and performance decrements. Inclusion of advanced training tools using extended reality will enable increasingly autonomous medical care to aid a CMO when ground support is unavailable or time-delayed beyond required action window, e.g., emergent medical situations. EIMO CDSS would require very large datasets to train pre-flight and significant amounts of data are needed to support ML via in-flight CDSS operations. An additional challenge will be to find sufficient data to train a model relevant to astronaut demographics. The rapid, accelerating evolution of this field creates a propitious solution space to leverage multi-modal AI through public-private partnership(s). The status of multi-modal AI systems today would preclude their use for long duration missions as they remain unreliable and are subject to “digital hallucinations” and other errors that could pose operational risk. A federated labs structure is being considered to test and optimize data flow from the multiple input vectors leading to field testing in suitable ground/flight analogs. Critical to the success of an EIMO CDSS will be integration and interoperability and success will be defined by a system that can serve as an in-flight medical consult for the CMO providing critical support during medical contingencies. Benefits to terrestrial medicine may be significant as an outflow of the EIMO medical system, particularly for remote areas and communities lacking significant infrastructure, personnel and resources.

J Lemery↗

Earth Independent Medical Operations (EIMO) Datascope: Challenges and Potential Solutions

Data flows and storage/retrieval capacity are severely constrained during missions in space and challenges will become even greater during exploration class missions. There is a need for an artificial intelligence (AI)-based clinical decision support system (CDSS) to monitor and analyze data to provide real-time consultative support for crew medical officer (CMO) decision-making. EIMO is defined as the gradual transition of medical care and decision making from terrestrial to space-based assets, enabling support of astronaut health and performance and reducing overall mission risk. While a hallmark of this paradigm shift from low-earth orbit is that on-board care will increasingly become the responsibility of the astronauts for primary management and decision making, terrestrial assets will continue to be paramount in pre-mission screening and planning, as well as prevention, health maintenance and long-term care contingencies. New capabilities and systems that enable progressively more robust and resilient systems and crews will be necessary to reduce risk and increase probability of deep space exploration mission success. An aspiration for EIMO is to develop AI-enhanced solutions for analysis of crew health & performance data and to facilitate clinical decision support for autonomous medical operations. A “system of systems” approach is envisioned whereby EIMO will deploy AI-supported natural language processing and machine learning (ML) techniques to utilize embedded reference databases and real-time data streams [input vectors] from multiple data sources. Constituent input vectors may include environmental controls, countermeasures data, behavioral data, physiologic wearables, point-of-care laboratory tests, personalized medical records, inventory trade space risk assessments, COTS medical databases, and ground support inputs. An ideal AI capability would possess trained fusion algorithms to cross reference input vectors with medical ‘knowledge’ [cultivated database] to stratify relevant data streams for predictive and actionable capabilities. In addition, EIMO will feature mobility, in that it can be accessed and can push/pull data within and between multiple vehicles/habitats. Large amounts and variable sources of data can be leveraged to diagnose, inform treatment strategies, and potentially predict medical events and performance decrements. Inclusion of advanced training tools using extended reality will enable increasingly autonomous medical care to aid a CMO when ground support is unavailable or time-delayed beyond required action window, e.g., emergent medical situations. EIMO CDSS would require very large datasets to train pre-flight and significant amounts of data are needed to support ML via in-flight CDSS operations. An additional challenge will be to find sufficient data to train a model relevant to astronaut demographics. The rapid, accelerating evolution of this field creates a propitious solution space to leverage multi-modal AI through public-private partnership(s). The status of multi-modal AI systems today would preclude their use for long duration missions as they remain unreliable and are subject to “digital hallucinations” and other errors that could pose operational risk. A federated labs structure is being considered to test and optimize data flow from the multiple input vectors leading to field testing in suitable ground/flight analogs. Critical to the success of an EIMO CDSS will be integration and interoperability and success will be defined by a system that can serve as an in-flight medical consult for the CMO providing critical support during medical contingencies. Benefits to terrestrial medicine may be significant as an outflow of the EIMO medical system, particularly for remote areas and communities lacking significant infrastructure, personnel and resources.

Medical Operations↗

Impacts of Non-Simultaneous Global Photospheric Magnetic Measurements on Coronal and Solar Wind Modeling

The intensity and arrival time of coronal mass ejections (CMEs) can be significantly influenced by the background solar wind encountered as they propagate outward from the Sun into the interplanetary medium. In addition, solar energetic particles (SEPs) race ahead of CME shock fronts and flare regions along magnetic field lines largely determined by the background solar wind. Predicting the solar wind accurately is therefore critical for improving forecasts of CMEs, SEPs, and high-speed streams. Modeling of the corona and solar wind is challenging in general, as it is highly dependent on global photospheric magnetic field maps, which serve as the boundary conditions to all coronal models that drive solar wind models. Unfortunately, less than half of the Sun’s photospheric magnetic field is reliably measured from any given vantage point and thus it is common for the maps to have highly dated and unreliable measurements in them. While Solar Obiter (SolO) now provides for the first time the opportunity to have simultaneous measurements of nearly the entire surface magnetic field of Sun (e.g., when SolO/PHI measurements are combined with those from SDO/HMI), the required alignment to accomplish this occurs only occasionally. Further, coronal models are extremely sensitive to the strengths of the polar magnetic fields of the Sun, which remain poorly observed. Recently, efforts to mitigate this problem include using flux transport models such as the Air Force Data Assimilative Photospheric Flux Transport (ADAPT) model, which evolves the field forward in time using well known transport processes occurring on the Sun. However, it cannot account for the emergence of new magnetic flux without direct observations. The ESA VIGIL mission will eventually provide continuous observations from the L5, and the proposed SunCHASER mission will likewise do this at the L4 vantage point should it be funded. Ultimately, what is needed is a constellation of spacecraft distributed around the Sun with magnetographs that continuously measure the global surface magnetic field. In this talk, we discuss how the lack of simultaneous global measurements of the photospheric magnetic field adversely impacts the predictive performance of coronal and solar wind models.

C. Nick Arge↗

Madidrop for Passive Silver Dosing

Madidrop is a rectangular ceramic tablet originally designed to dose a 10-20-liter volume of water with silver to act as a biocide for remote communities with unreliable water sources. Silver as a biocide is a proposed method to control bacteria on the International Space Station or future Artemis missions. This would replace iodine currently used due to issues with a dual biocide system in place between Russian and US segments and the extra cost of iodine removal required before consumption. NASA has been reviewing this Madidrop technology and its potential application with a water reclamation system on orbit to dose silver after purifying the water. While there are a couple alternative methods to dosing silver on station, this method is like the existing passive dosing method used currently to dose iodine. Tests conducted characterize the manufacturer’s original intent to leave the tablet in a tank for a specified amount of time before removing and testing alternative passive flow-through methods. Passive flow testing involved two options: keeping the tablet intact or crushing the tablet into smaller particle sizes to increase the surface area while varying particle sizes. The results of these tests revealed a large amount of silver output at first that quickly reduced to a constant lower output within a reasonable dosing concentration range. The initial high concentration peaks after a couple days of quiescence and could be useful for shocking the initial tank water contents. Madidrop used as a passive particle doser could act as a stand-in replacement for iodine in future spaceflight water reclamation systems.

Ryan Ogilvie↗

High-Lift Prediction Workshops: Retrospective, Lessons Learned, and Future Prospects

A series of workshops focused on high lift, ongoing since 2010, is discussed. The series goal is to improve computational fluid dynamics prediction of high-lift flowfields, which has historically been very unreliable. The workshops center on CFD verification and validation exercises addressed in common by experts from organizations around the world, thereby enabling more rapid learning and improvement than would be possible with independent research alone. The workshop goals and structure are described, lessons learned to date are summarized, and potential future prospects for high-lift prediction are given.

high lift↗

Madidrop for Passive Silver Dosing

Madidrop is a rectangular ceramic tablet originally designed to dose a 10-20-liter volume of water with silver to act as a biocide for remote communities with unreliable water sources. Silver as a biocide is a proposed method to control bacteria on the International Space Station or future Artemis missions. This would replace iodine currently used due to issues with a dual biocide system in place between Russian and US segments and the extra cost of iodine removal required before consumption. NASA has been reviewing this Madidrop technology and its potential application with a water reclamation system on orbit to dose silver after purifying the water. While there are a couple alternative methods to dosing silver on station, this method is like the existing passive dosing method used currently to dose iodine. Tests conducted characterize the manufacturer’s original intent to leave the tablet in a tank for a specified amount of time before removing and testing alternative passive flow-through methods. Passive flow testing involved two options: keeping the tablet intact or crushing the tablet into smaller particle sizes to increase the surface area while varying particle sizes. The results of these tests revealed a large amount of silver output at first that quickly reduced to a constant lower output within a reasonable dosing concentration range. The initial high concentration peaks after a couple days of quiescence and could be useful for shocking the initial tank water contents. Madidrop used as a passive particle doser could act as a stand-in replacement for iodine in future spaceflight water reclamation systems.

Ryan Ogilvie↗

Sensing Small Uncrewed Aerial Vehicles with Distributed Radars for Advanced Air Mobility Surveillance

In the context of Advanced and Urban Air Mobility major attention is being reserved to the development of sensing strategies for small Uncrewed Aerial Vehicles (sUAVs) to enable their safe operations in and around urban areas. Such strategies should rely on non-cooperative distributed sensors to strengthen the surveillance solution towards the unreliability of Global Navigation Satellite System (GNSS) positioning information, which is typical for low-altitude-flying platforms in urban regions, and increase the monitored airspace volume. To this aim, this paper proposes a fusion solution for a network of distributed ground-based radars, which can be exploited to not only increase the coverage over large airspace volumes but also improve the overall detectability and traceability of sUAVs by leveraging on multiple views over the same area. The solution exploits a centralized fusion scheme in which measurements collected by each radar are shared with a Fusion Center where Kalman Filtering is exploited to build a unique, fused track. Tests conducted on experimental data collected using two sUAVs as flying targets and three distributed radars showed that the proposed solution can produce an increase in coverage from about 20 % (single radar configuration) to about 80 % of the targets’ flight path, as well as a finer accuracy yielding meter and meter-per-second root mean square error values on position and velocity components.

Federica Vitiello↗

The Lunar Explorer Instrument for Space Biology Applications (LEIA) Pre-Flight Tests: Mechanical Considerations​

The BioSensor payload on the upcoming LEIA platform aboard the CLPS (CP-22) lander will carry yeast to the Moon's south pole to study the effects of lunar radiation and gravity. From Earth, BioSensor will transport desiccated yeast within 16 fluidic cards, each containing 16 fluidic wells of 100 microliters volume. At the start of the experiment, these microbes will be autonomously rehydrated on the Moon, and optical absorbance measurements at three wavelengths will be performed across all 256 wells. Absorbance measurements in fluidic wells are susceptible to noise and artifacts due to bubble formation during well rehydration and microbial growth. BioSensor, as a biofluidics system, faces significant data anomalies caused by payload vibrations, particularly from the operation of the co-located PROSPECT’s ProSEED drill, to assess lunar resources by penetrating the subsurface. To evaluate the impact of drill vibrations, fully assembled and filled fluidic cards were subjected to sine sweep signals in the x, y, z planes, ranging from 5 - 2560 Hz at g-loads of 0.25 and 0.5, with on-board accelerometer for localized vibration measurement. Wells with various fill conditions, including partial fills with different bubble sizes and completely filled wells, were tested. Results indicated that small bubbles adhered to well walls at high frequencies but were dislodged at low frequencies, causing data anomalies. Medium and large bubbles exhibited higher interference with optical data due to lower surface tension and variable bubble surface flexion. Overall, it was found that irrespective of the fill type, low-frequency vibrations were most detrimental to optical readings. Understanding the drill schedule and correlating it with BioSensor timestamps will help identify periods when BioSensor data is unreliable, a crucial step for accurately interpreting the microbial response data and ensuring the validity of the BioSensor's scientific measurements on the lunar surface.

Chinmayee Govinda Raj↗

Swift Mission Gyro Patch and Re-Calibration Without A Calibration Campaign

The Swift spacecraft has three Two-Axis-Rate-Assemblies (TARAs) (designated as TARA 1, TARA 2, and TARA 3, and generically referred to as gyros) which until March of 2024 were all used in rate estimation as an operational workaround (dubbed “corrector-gyro”) of a software defect discovered in 2007. TARA 1 performance degraded throughout 2023 and 2024, making it an unreliable rate source. It was determined that shifting TARA 1 to be the corrector-gyro and using mainly TARAs 2 and 3, with the existing flight software (FSW) defect, would not meet performance requirements for science operations. Rather the FSW was patched to remove the defect found in 2007. This patch was delivered by the vendor in 2009, but was not fully tested or installed at that time. A decision was made in 2024 to install the patch despite limited simulation and testing capabilities. The problem facing the team was to come up with a set of alignment parameters that would work with the new patch, using data from the spacecraft operating normally in the old configuration. Calibration activities would have been possible in either the old or new FSW configuration, but were ultimately deemed unnecessary, saving staff time and pre-serving time on the spacecraft for science data collection. This paper describes the old and new FSW configurations related to gyro processing and alignment, and how the raw gyro and star tracker data from normal operation were used with a multidimensional unconstrained nonlinear minimization in MATLAB (Nelder-Mead1) to produce a fully calibrated set of gyro alignment parameters compatible with the patched FSW. Flight data is presented showing that not only did the process work, it improved performance significantly, rivaling the best slew performance of the mission to date.

MATLAB↗

Systematic Evaluation of Backdoor Data Poisoning Attacks on Image Classifiers

Backdoor data poisoning attacks have recently been demonstrated in computer vision research as a potential safety risk for machine learning (ML) systems. Traditional data poisoning attacks manipulate training data to induce unreliability of an ML model, whereas backdoor data poisoning attacks maintain system performance unless the MLmodel is presented with an input containing an embedded“trigger” that provides a predetermined response advantageous to the adversary. Our work builds upon prior back-door data-poisoning research for ML image classifiers and systematically assesses different experimental conditions including types of trigger patterns, persistence of trigger patterns during retraining, poisoning strategies, architectures (ResNet-50, NasNet, NasNet-Mobile), datasets (Flowers, CIFAR-10), and potential defensive regularization techniques (Contrastive Loss, Logit Squeezing, Manifold Mixup,Soft-Nearest-Neighbors Loss). Experiments yield four key findings. First, the success rate of backdoor poisoning at-tacks varies widely, depending on several factors, including model architecture, trigger pattern and regularization technique. Second, we find that poisoned models are hard to detect through performance inspection alone. Third, regularization typically reduces backdoor success rate, although it can have no effect or even slightly increase it, depending on the form of regularization. Finally, backdoors inserted through data poisoning can be rendered ineffective after just a few epochs of additional training on a small set of clean data without affecting the model’s performance.

Truong, Loc T.↗

Archival, anonymization and presentation of HTCondor logs with GlideinMonitor

GlideinWMS is a pilot framework to provide uniform and reliable HTCondor clusters using heterogeneous and unreliable resources. The Glideins are pilot jobs that are sent to the selected nodes, test them, set them up as desired by the user jobs, and ultimately start an HTCondor schedd to join an elastic pool. These Glideins collect information that is very useful to evaluate the health and efficiency of the worker nodes and invaluable to troubleshoot when something goes wrong. This data, including local stats, the results of all the tests, and the HTCondor log files, is packed and sent to the GlideinWMS Factory. To access this information, developers and troubleshooters must exchange emails with Factory operators and dig manually into files. Furthermore, these files contain also information like email and IP addresses, and user IDs, that we want to protect and limit access to. GlideinMonitor is a Web application to make these logs more accessible and useful: it organizes the logs in an efficient compressed archive; it allows to search, unpack, and inspect them, all in a convenient and secure Web interface; via plugins like the log anonymizer, it can redact protected information preserving the parts useful for troubleshooting.

Mambelli, Marco↗

Bio-project “derisking” through development of systematic methodologies and frameworks for risk assessment

One of the primary hindrances to producing a viable, sustainable domestic biomass industry for renewable biofuels, bio-products and bio-power is the lack of understanding and quantification of the risks associated with both the biomass supply chain and preprocessing and conversion technologies. Currently a consistent method for assessing, comparing, and quantifying risks in biomass supply chains does not exist, creating a major investment barrier to bioenergy projects in the U.S. The lack of a standardized approach has resulted in bioenergy stakeholders independently using inconsistent approaches and evaluation criteria, leading to unreliable and incomparable assessments of risks and financing barriers to bio-project development. Along with the challenges of inconsistent risk assessment for supply chain risk, technology specific risks based on variability in biomass properties are not fully understood and can pose significant unforeseen challenges for bioenergy projects. In many cases these properties have not yet been identified and the impacts on the proposed technology and products unquantified. This is particularly challenging for emerging preprocessing and conversion technologies. Without a firm understanding of the preprocessing/conversion technology-specific critical properties, the risk of a proposed bio-project cannot be fully evaluated. To address inconsistent risk evaluation in the biomass supply chain supporting project financing, a Biomass Supply Chain Risk Standards (BSCRS) framework was developed. The BSCRS framework includes a comprehensive list of known and perceived risks (Risk Indicators) to the supply chain developed through 100’s of interviews with bioenergy industry experts spanning from feedstock growers and suppliers to representatives from the financial sector. These risks have been organized into a manageable hierarchy of Risk Categories and Risk Factors that can be practically assessed. This BSCRS framework also provides mitigation strategies for multiple Risk Indicators from best available industry practices and research findings. Additionally, a risk quantification methodology for each Risk Factor, Risk Category, and the bio-project as a whole was developed to enable capital markets to assess feedstock risk more efficiently and more accurately. Multiple case studies representing existing bio-projects have been used to evaluate and verify the BSCRS framework and scoring methodology. To address technological risk along with the supply chain risk captured in the developed BSCRS framework, this work also focuses on development of a systematic criticality assessment tool using well-accepted, quantitative risk analysis methods to evaluate bioenergy feedstock critical properties impacting system unit operations. The proposed Failure Mode and Effect Analysis (FMEA) approach uses a team of subject area experts (SAEs) for each targeted unit operation within a system. Collectively, the team will develop and use a quantitative scoring system to assess the material attributes, process parameters, and quality attributes for key unit operations that have already been identified. The FMEA process generates Risk Priority Numbers (RPNs) for the various failures and predominant causes for each material/process unit/product combination resulting in a semi-quantitative, standardized methodology for assessing technological risk and biomass properties contributing to that risk.

09 BIOMASS FUELS↗

Application of Orthogonal Defect Classification for Software Reliability Analysis

The modernization of existing and new nuclear power plants with digital instrumentation and control systems (DI&C) is a recent and highly trending topic. However, there lacks strong consensus on best-estimate reliability methodologies by both the United States (U.S.) Nuclear Regulatory Commission (NRC) and the industry. This has resulted in hesitation for further modernization projects until a more unified methodology is realized. In this work, we develop an approach called Orthogonal-defect Classification for Assessing Software Reliability (ORCAS) to quantify probabilities of various software failure modes in a DI&C system. The method utilizes accepted industry methodologies for software quality assurance that are also verified by experimental or mathematical formulations. In essence, the approach combines a semantic failure classification model with a reliability growth model to predict (and quantify) the potential failure modes of a DI&C software system. The semantic classification model is used to address the question: How do latent defects in software contribute to different software failure root causes? The use of reliability growth models is then used to address the question: Given the connection between latent defects and software failure root causes, how can we quantify the reliability of the software? A case study was conducted on a representative I&C platform (ChibiOS) running a smart sensor acquisition software developed by Virginia Commonwealth University (VCU). The testing and evidence collection guidance in ORCAS was applied, and defects were uncovered in the software. Qualitative evidence, such as condition coverage, was used to gauge the completeness and trustworthiness of the assessment while quantitative evidence was used to determine the software failure probabilities. The reliability of the software was then estimated and compared to existing operational data of the sensor device. It is demonstrated that by using ORCAS, a semantic reasoning framework can be developed to justify if the software is reliable (or unreliable) while still leveraging the strength of the existing methods.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Application of Orthogonal Defect Classification for Software Reliability Analysis

The modernization of existing and new nuclear power plants with digital instrumentation and control systems (DI&C) is a recent and highly trending topic. However, there lacks strong consensus on best-estimate reliability methodologies by both the United States (U.S.) Nuclear Regulatory Commission (NRC) and the industry. This has resulted in hesitation for further modernization projects until a more unified methodology is realized. In this work, we develop an approach called Orthogonal-defect Classification for Assessing Software Reliability (ORCAS) to quantify probabilities of various software failure modes in a DI&C system. The method utilizes accepted industry methodologies for software quality assurance that are also verified by experimental or mathematical formulations. In essence, the approach combines a semantic failure classification model with a reliability growth model to predict (and quantify) the potential failure modes of a DI&C software system. The semantic classification model is used to address the question: How do latent defects in software contribute to different software failure root causes? The use of reliability growth models is then used to address the question: Given the connection between latent defects and software failure root causes, how can we quantify the reliability of the software? A case study was conducted on a representative I&C platform (ChibiOS) running a smart sensor acquisition software developed by Virginia Commonwealth University (VCU). The testing and evidence collection guidance in ORCAS was applied, and defects were uncovered in the software. Qualitative evidence, such as condition coverage, was used to gauge the completeness and trustworthiness of the assessment while quantitative evidence was used to determine the software failure probabilities. The reliability of the software was then estimated and compared to existing operational data of the sensor device. It is demonstrated that by using ORCAS, a semantic reasoning framework can be developed to justify software reliability (or unreliability) while still leveraging the strength of the existing methods.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Nanoscale Three-Dimensional Imaging of Degradation in Composite Si-Containing Anodes

The use of silicon (Si) in next-generation lithium-ion battery (LIB) anodes has the potential to dramatically improve electrochemical performance over current LIB graphite (Gr) anodes, due to silicon’s higher specific capacity.1 However, widespread implementation of Si-containing anodes is inhibited by issues such as significant Si volume expansion during lithiation and an unstable solid-electrolyte interphase (SEI), resulting in unreliable performance and poor cycle life. Currently, composite anodes with both Si and graphite active materials are used to increase capacity and mitigate some of the limitations associated with Si. In composite electrodes with a heterogeneous distribution of components with varying electrical properties (including Si, Gr, conductive carbon additive, and binder), it is important to understand the local distribution of each component to correlate with electrochemical processes, particularly localized degradation and heterogeneous aging, and to optimize performance. To investigate Si-containing composite anodes in the nanoscale, we use scanning spreading resistance microscopy (SSRM), a form of scanning probe microscopy (SPM) that probes local electronic resistivity. By examining the intrinsic electronic resistivity contrast between the anode components, separate phases can be distinguished and understood within the composite structure.2 This work studies the effect of electrochemical cycling in two different electrolytes on component distribution and aging by comparing the electrical and structural evolution of composite Si-graphite electrodes and SEI before and after charge-discharge cycling. 1. W. J. Zhang. A review of the electrochemical performance of alloy anodes for lithium-ion batteries J. Power Sources 196 13–24 (2011). 2. C. Stetson, Z. Huey, A. Downard, Z. Li, B. To, A. Zakutayev, C.-S. Jiang, M. Al-Jassim, D. Finegan, S.-D. Han and S. DeCaluwe: Three-Dimensional Mapping of Resistivity and Microstructure of Composite Electrodes for Lithium-Ion Batteries. ACS Nano Letters Accepted (2020).

ADVANCED PROPULSION SYSTEMS↗

Cyber risk assessment and investment optimization using game theory and ML-based anomaly detection and mitigation for wide-area control in smart grids

The electric power grid is increasingly becoming susceptible to cyber attacks that exploit vulnerabilities in the smart grid control, information, and physical layers. Successful cyber attacks can have catastrophic impacts on the social and economic well-being of any nation all over the globe. It has, thus, become imperative to secure the smart grid against such adversarial actions to ensure stable, secure, and reliable operation of the grid. The existing research and industry practices prove to be inadequate in terms of providing pragmatic and effective defense methodologies and measures for long-term cybersecurity planning and real-time cybersecurity for grid operation. For example, existing works lack models that incorporate uncertain behavior of cyber-attackers and pragmatic defense measures for cyber risk assessment and cybersecurity investment optimization which often provide unreliable and strictly qualitative solutions to these problems. At the same time, with the growing number of cyber incidents in the grid, there still exists a need to develop attack-resilient algorithms for wide-area monitoring, protection, and control (WAMPAC) applications like the wide-area voltage control systems (WAVCS) for Flexible AC Transmissions Systems (FACTS) that lack in scalable and feasible solutions from the cybersecurity perspective. This dissertation proposes novel models and methodologies for: (1) Cybersecurity planning, and (2) Cybersecurity for system operation. The cybersecurity planning is achieved through cyber risk assessment and cybersecurity resource investment optimization for long-term cybersecurity of the grid using game theory and attack-defense trees. Cybersecurity for system operation consists of development of cyber anomaly detection and mitigation algorithms for flexible AC transmission system (FACTS) controller-based wide-area voltage control systems (WAVCS) using machine learning (ML), and software defined networking-based moving target defense network routing for achieving real-time cyber-physical security for grid operations. This is followed by hardware-in-the-loop (HIL) implementation and evaluation of these attack prevention, detection, and mitigation algorithms and methodologies showcasing their feasibility in a close to real-world environment. For cybersecurity planning, a novel approach involving a combination of game theory and attack defense trees (ADT) for optimal cybersecurity resource allocation in the smart grid is proposed. This methodology involves modeling of the cyber-physical smart grid substations as ADTs, defining attacker costs, defense costs, and attack probabilities for attack access points. Using game theoretical formulation, optimal defense strategies for the defender of the system to invest cybersecurity resources in the grid are obtained. Additionally, a game-theoretic framework is developed for quantitative cyber-physical risk assessment of the grid under a dynamically changing cyber threat space and uncertain behavior of cyber attackers which is further used to optimize investments in the smart grid's cybersecurity resources. The attacker, defender, and the smart grid system are modeled while incorporating attacker-stochasticity and federal guidelines for smart grid cybersecurity. This allows quantification of threat, vulnerabilities, and attack impact of the grid for quantitative risk assessment. The defender's budget to invest in the security resources in the grid is optimized based on the strategies leading to minimum system risk. The evaluation of the proposed solutions highlight the feasibility for practical implementation of these methodologies and algorithms in the smart grid, while taking the federal requirements and guidelines for smart grid security into consideration. For achieving cybersecurity for system operation, attack prevention, detection, and mitigation algorithms and methodologies are developed specifically for FACTS-based WAVCS. Anomaly detection and mitigation in the WAVCS are achieved using algorithms based on machine learning which involves offline training and testing of ML models with CPS datasets incorporating physics-based features that allow accurate distinction between system faults and cyber attacks. For attack prevention, a methodology based on software defined network (SDN)-based moving target defense (MTD) network routing is proposed that enables prevention of Denial of Service (DoS) type attacks on the smart grid communication system. Subsequently, these methodologies and algorithms are implemented and evaluated on an HIL testbed that allows for real-time attack prevention, detection, and mitigation of emulated cyber attacks on the WAVCS in a close to real-world environment. The results show highly accurate and efficient performance of the implemented algorithms and methodologies with the smart grid system operating within the NERC's system operation limits even in the presence of DoS and data integrity cyber attacks. This work opens up future research opportunities in other directions such as (1) Expanding cybersecurity planning methodologies to real-time cyber contingency analysis with different game formulations; and (2) Applying the cybersecurity for system operation algorithms to broader categories of wide-area control applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Accurate Prediction of Algal Biomass Lipid, Protein, and Carbohydrate Composition with Machine Learning Regression Modelling of Near-IR Spectra

During large scale algal biomass cultivation, it is difficult to reliably control relative composition to target levels. Rapid determination of chemical composition is feasible by using near infrared (NIR) spectral data. We sought to build and improve on reliable high-throughput screening prediction method based on partial least squares regression (PLSR) by the application of artificial neural networks (ANN) and associated optimization strategies. The algal biomass sample set was designed and created in an iterative process of culturing in physiologically diverse conditions at the GAI field site, followed by compositional analyses at NREL. The workflow allowed us to identify gaps in compositional space for informing the subsequent cultivation and sampling efforts and generated a high quality set of 210 unique samples with chemical analysis results, spectral scanning data, and cultivation metadata. We observed a significant improvement in the performance of carbohydrate content predictions using an optimized ANN model compared to PLSR, with > 16% reduction in mean absolute percent error (MAPE) when tested on the same set of reserved data. The optimized ANN models for FAME and protein prediction performed exceptionally well with 5.99% and 5.09% MAPE, respectively. Application of these methods to detection and quantification of minor biomass constituents that are relevant to certain product streams has shown positive preliminary results, opening the possibility for extensions to the outputs of this powerful data type. All models are accompanied by prediction uncertainties and unsupervised spectral outlier detection to alert an operator to unreliable spectral data. These tools can be deployed for rapid determination of algal culture status, and cultivation and biomass quality improvement.

algal biofuels↗