SEARCH · Engineering Papers

Results for “Sensor anomaly detection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Layer-wise Imaging Dataset from Powder Bed Additive Manufacturing Processes for Machine Learning Applications (Peregrine v2022-10.1)

This release consists of six datasets which together include multi-modal layer-wise powder bed images from two different powder bed printing technologies. These datasets are designed primarily to facilitate the development and testing of new computer vision and machine learning based anomaly and defect detection algorithms. The authors provide both training data with corresponding ground truth pixel masks and evaluation data with corresponding baseline prediction pixel masks made by a trained neural network. The laser powder bed fusion (L-PBF) datasets are sourced from EOS M290 and AddUp FormUp 350 printers and the binder jet (BJ) dataset is sourced from an ExOne M-Flex printer. The materials represented in these datasets include 17-4 PH Stainless Steel, GammaPrint-700, Inconel 718, Maraging Steel, and H13 Steel. The sensor imaging modalities represented include visible-light (VL), temporally-integrated (i.e., long duration exposure) near-infrared (TI-NIR), and wide-band infrared (IR). To download the dataset: (1) Create a Globus account. (2) Create a Globus Endpoint on your computer. (3) Transfer the dataset from the OLCF DOI-DOWNLOADS Collection to your Collection. Common troubleshooting steps: (a) Confirm that the transfer is going from OLCF DOI-DOWNLOADS to your Collection. (b) Create an exception for Globus in your antivirus software so that it can create an Endpoint. (c) Manually create a Globus access directory (where the data will be downloaded) by going to the Preferences > Access tab.

36 MATERIALS SCIENCE↗

NASA NTRSDate not supplied

Enabling Mission Flexibility to Battery Driven Deep Space Endeavors With Generalized Battery-Health-Monitoring Using Physics-Based and Data-Driven Reduced-Order Models

The needs and requirements for an electrochemical energy storage for deep space exploration is well explored. It is often understood that different mission sites and environmental conditions require different battery chemistries or technologies. Additionally, various engineering solutions are deployed to overcome specific chemical challenges. One often overlooked need is the “health” monitoring of an electrochemical storage system. The term generalized health monitoring, as envisioned in this work, refers to the monitoring of various aspects such as electrode health, electrolyte health, reaction pathway health, cooling system health, sensor health, and BMS health [1]. Generalized health monitoring allows mission leads, engineers, and scientists to incorporate flexibility in mission designs, make on-the-fly mission changes, and extend the duration of science missions. Moreover, it enables automation and data-driven decision-making without compromising safety and performance. Recently, our group developed a hierarchy of thermal reduced-order models (TROM) by combining a physics-based modeling approach and data-driven model reduction techniques applied to flight data [2]. The resulting TROMs were found to be not only accurate but also identifiable from the flight data. Consequently, the coefficient of variance of the model parameters is small over the course of hundreds of flights, allowing for monitoring the parameter evolution trajectories as the battery ages and degrades. These parameters constitute the metrics of the generalized health of a battery. Monitoring their evolution allows such models to be used for anomaly detection and prognostics, improving early detection of abnormal behavior and thus enabling timely maintenance, longer battery life, and enhanced battery safety. For this presentation, the practicality of the thermal model will be validated on a pack of 14cells under various topology configurations such as 1S14P, 2P7S, 7S2P, and 1P14S. It is well known that manufacturing and non-uniform aging lead to variability in the performance of a cell, which is exacerbated by cell balancing during active load. Additionally, in extreme scenarios, the paramount objective is to complete the mission, regardless of the stresses on the battery. Topology-induced balancing issues further stress the battery. The goal of this study is to determine if the noise (identifiability) in the reduced-order thermal model parameters is sensitive to topology, cell spacing, cooling strategy, and manufacturing or age variability. The variability in cells is considered by assuming a multimodal distribution for microscopic parameters of a cell (such as porosity, tortuosity, reaction kinetics, volumetric thermal conductivity, and volumetric heat capacity). The compounded effect of manufacturing variability, topological selection, cooling strategies, and cell balancing ages each cell in a battery differently. The study aims to clarify whether the challenge in extracting maximum information depends on the minimum number of sensors or models used for data extraction.

Automation↗

NASA NTRS2010

General Purpose Data-Driven Online System Health Monitoring with Applications to Space Operations

Modern space transportation and ground support system designs are becoming increasingly sophisticated and complex. Determining the health state of these systems using traditional parameter limit checking, or model-based or rule-based methods is becoming more difficult as the number of sensors and component interactions grows. Data-driven monitoring techniques have been developed to address these issues by analyzing system operations data to automatically characterize normal system behavior. System health can be monitored by comparing real-time operating data with these nominal characterizations, providing detection of anomalous data signatures indicative of system faults, failures, or precursors of significant failures. The Inductive Monitoring System (IMS) is a general purpose, data-driven system health monitoring software tool that has been successfully applied to several aerospace applications and is under evaluation for anomaly detection in vehicle and ground equipment for next generation launch systems. After an introduction to IMS application development, we discuss these NASA online monitoring applications, including the integration of IMS with complementary model-based and rule-based methods. Although the examples presented in this paper are from space operations applications, IMS is a general-purpose health-monitoring tool that is also applicable to power generation and transmission system monitoring.

Iverson, David L.↗

DOE OSTI2021

Holes in Optical Lightning Flashes: Identifying Poorly Transmissive Clouds in Lightning Imager Data

Space-based optical lightning sensors including the lightning imaging sensor (LIS) and geostationary lightning mapper (GLM) are pixelated imagers that detect lightning as transient increases in cloud top illumination. Detection requires optical emissions to escape the cloud top to space with sufficient energy to trigger a pixel on the imaging array. Through scattering and absorption, certain clouds are able to block most light from reaching the instrument, causing a reduction in detection efficiency (DE) and possibly location accuracy (LA). Radiant lightning emissions that illuminate large cloud top areas are used to examine scenarios where clouds block light from reaching orbit. In some cases, these anomalies in the spatial radiance distribution from the lightning pulse lead to “holes” in the optical lightning flash where certain pixels fail to trigger. Such holes are identified algorithmically in the Tropical Rainfall Measuring Mission satellite LIS record and the microphysical properties of the coincident storm region are queried. We find that holes primarily occur in tall (IR T b < 235 K) convection (87%) and overhanging anvil clouds (10%). The remaining 3% of holes occur in moderate-to-weak convection or in clear air breaks between stormclouds. We further demonstrate how an algorithm that assesses the spatial radiance patterns from energetic lightning pulses might be used to construct an optical transmission gridded stoplight product for GLM that could help operators identify clouds with a potentially reduced DE and LA.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS1992

Automated screening of propulsion system test data by neural networks, phase 1

The evaluation of propulsion system test and flight performance data involves reviewing an extremely large volume of sensor data generated by each test. An automated system that screens large volumes of data and identifies propulsion system parameters which appear unusual or anomalous will increase the productivity of data analysis. Data analysts may then focus on a smaller subset of anomalous data for further evaluation of propulsion system tests. Such an automated data screening system would give NASA the benefit of a reduction in the manpower and time required to complete a propulsion system data evaluation. A phase 1 effort to develop a prototype data screening system is reported. Neural networks will detect anomalies based on nominal propulsion system data only. It appears that a reasonable goal for an operational system would be to screen out 95 pct. of the nominal data, leaving less than 5 pct. needing further analysis by human experts.

Hoyt, W. Andes↗

NASA NTRS2000

The 1997-98 El Nino Event and Related Wintertime Lightning Variations in the Southeastern United States

The El Nino Southern Oscillation (ENSO) is a climate anomaly responsible for worldwide weather impacts ranging from droughts to floods. In the United States, warm episode years are known to produce above normal rainfall along the Southeast U.S. Gulf Coast and into the Gulf of Mexico, with the greatest response observed in the October-March period of the warm episode year. The 1997-98 warm episode is notable for being the strongest event since 198283. With the recent launch of a lightning sensor on NASA's Tropical Rainfall Measuring Mission (TRMM) in November 1997 and the detailed coverage of the U.S. National Lightning Detection Network (NLDN), such interannual changes in lightning activity can be examined with far greater detail than ever before. For the 1997-98 ENSO event the most significant year-to-year changes in lightning frequency worldwide occurred along the Gulf Coast and within the Gulf of Mexico basin during the Northern Hemisphere winter. Within a broad swath across the northern Gulf of Mexico basin there is a 100-150% increase in lightning days year-to-year (a peak of 33 days in the winter of 1997-98 vs. only 15 days or fewer in both the 1996-97 and 1998-99 winter). In addition, there is a nearly 200% increase in lightning hours (a peak of 138 hours in 1996-97 vs. 50 hours in both 1996-97 and 1998-99). The increase in lightning activity during ENSO occurs in association with a 100% increase in the number of synoptic scale cyclones that developed within or moved through the Gulf basin. The primary variables controlling these enhancements in thunderstorm activity are the position and strength of the jet stream.

Goodman, S. J.↗

DOE OSTI2022

A Simple and Accurate Energy-Detector-Based Transient Waveform Detection for Smart Grids: Real-World Field Data Performance

Integration of distributed energy sources, advanced meshed operation, sensors, automation, and communication networks all contribute to autonomous operations and decision-making processes utilized in the grid. Therefore, smart grid systems require sophisticated supporting structures. Furthermore, rapid detection and identification of disturbances and transients are a necessary first step towards situationally aware smart grid systems. This way, high-level monitoring is achieved and the entire system kept operational. Even though smart grid systems are unavoidably sophisticated, low-complexity algorithms need to be developed for real-time sensing on the edge and online applications to alert stakeholders in the event of an anomaly. In this study, the simplest form of anomaly detection mechanism in the absence of any a priori knowledge, namely, the energy detector (also known as radiometer in the field of wireless communications and signal processing), is investigated as a triggering mechanism, which may include automated alerts and notifications for grid anomalies. In contrast to the mainstream literature, it does not rely on transform domain tools; therefore, utmost design and implementation simplicity are attained. Performance results of the proposed energy detector algorithm are validated by real power system data obtained from the DOE/EPRI National Database of power system events and the Grid Signature Library.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2025

Online and Offline Data Quality Monitoring for the Mu2e Calorimeter

This thesis presents the design, implementation, and validation of a calorimeter Data Quality Monitoring (DQM) toolchain for the Mu2e experiment at Fermilab. Mu2e searches for charged lepton flavor violation via coherent muon-to-electron conversion in the field of an aluminum nucleus, $\mu^- Al \rightarrow e^-Al$, a process whose observation would constitute clear evidence of physics beyond the Standard Model. Achieving target sensitivity requires stringent control of detector performance and data integrity during acquisition, as subtle issues in readout configuration, data formatting, or electronics behavior can compromise reconstruction and bias downstream analyzes. To address these challenges, this work develops a multi-layer DQM approach spanning both raw data validation and reconstructed digi-level diagnostics. At the low level, a fragment analysis component performs word- and bit-field decoding of calorimeter readout blocks, enabling sanity checks of the expected structure and producing detailed error and integrity statistics useful for commissioning and troubleshooting. At the digi level, the CaloDigiDQM analyzer is implemented within the art framework and transforms each CaloDigiCollection into a structured hierarchy of ROOT histograms designed for fast drill-down diagnostics. The module generates coherent monitoring views at global, disk, board, and channel granularity, including occupancy, waveform-derived features (baseline, RMS, peak amplitude and position), and left-right sensor consistency metrics. Detector-aware channel-to-electronics mapping is performed through the conditions system (CaloDAQMap), ensuring that diagnostics remain aligned with hardware identifiers used in operations. For end-to-end testing without reliance on live DAQ data, a synthetic CaloDigi producer is developed to generate realistic waveforms with controlled noise and pulse shapes. The resulting system supports both offline ROOT-file production and online operation, including optional histogram streaming through otsdaq via ots::HistoSender. This toolchain provides a practical and scalable foundation for calorimeter commissioning and stable data collection, enabling early detection of anomalies and reducing operational risk for Mu2e.

Vakulenko, Mark [Drew U.] (ORCID:0009000276197818)↗

NASA NTRS1999

The 1997-98 El Nino Event and Related Wintertime Lightning Variations in the Southeastern United States

The El Nino Southern Oscillation (ENSO) is a climate anomaly responsible for world-wide weather impacts ranging from droughts to floods. In the United States, warm episode years are known to produce above normal rainfall along the Southeast US Gulf Coast and into the Gulf of Mexico, with the greatest response observed in the October-March period of the latest warm-episode year. The 1997-98 warm episode is notable for being the strongest event since 1982-83. With the recent launch of a lightning sensor on NASA's Tropical Rainfall Measuring Mission (TRMM) in November 1997 and the expanded coverage of the National Lightning Detection Network (NLDN), such year-to-year changes in lightning activity can be examined with far greater detail than ever before. For the recent ENSO event the greatest year-to-year changes in lightning frequency occur within a broad swath across the northern Gulf of Mexico basin where there is nearly a 200% increase in lightning days year-to-year (35 days in 1997-98 vs. 13 days in 1996-97) and a 200% increase in lightning hours (150 hours vs. 50). These changes occur in association with a 100% increase in the number of synoptic scale cyclones and an anomalously strong jet stream encompassing much of the Gulf basin.

Goodman, S. J.↗

DOE OSTI2021

The case for digital twins in metal additive manufacturing

The digital twin (DT) is a relatively new concept that is finding increased acceptance in industry. A DT is generally considered as comprising a physical entity, its virtual replica, and two-way digital data communications in-between. Its primary purpose is to leverage the process intelligence captured within digital models—or usually their faster-solving surrogates—towards generating increased value from the physical entities. The surrogate models are created using machine learning based on data obtained from the field, experiments and digital models, which may be physics-based or statistics-based. Anomaly detection and correction, and diagnostic closed-loop process control are examples of how a process DT can be deployed. In the manufacturing industry, its use can achieve improvements in product quality and process productivity. Metal additive manufacturing (AM) stands to gain tremendously from the use of DTs. This is because the AM process is inherently chaotic, resulting in poor repeatability. However, a DT acting in a supervisory role can inject certainty into the process by actively keeping it within bounds through real-time control commands. Closed-loop feedforward control is achieved by observing the process through sensors that monitor critical parameters and, if there are any deviations from their respective optimal ranges, suitable corrective actions are triggered. The type of corrective action (e.g. a change in laser power or a modification to the scanning speed) and its magnitude are determined by interrogating the surrogate models. Because of their artificial intelligence (AI)-endowed predictive capabilities, which allow them to foresee a future state of the physical twin (e.g. the AM process), DTs proactively take context-sensitive preventative steps, whereas traditional closed-loop feedback control is usually reactive. Apart from assisting a build process in real-time, a DT can help with planning the build of a part by pinpointing the optimum processing window relevant to the desired outcome. Again, the surrogate models are consulted to obtain the required information. In this article, we explain how the application of DTs to the metal AM process can significantly widen its application space by making the process more repeatable (through quality assurance) and cheaper (by getting builds right the first time).

36 MATERIALS SCIENCE↗

NASA NTRS1995

Automated Propulsion Data Screening demonstration system

A fully-instrumented firing of a propulsion system typically generates a very large quantity of data. In the case of the Space Shuttle Main Engine (SSME), data analysis from ground tests and flights is currently a labor-intensive process. Human experts spend a great deal of time examining the large volume of sensor data generated by each engine firing. These experts look for any anomalies in the data which might indicate engine conditions warranting further investigation. The contract effort was to develop a 'first-cut' screening system for application to SSME engine firings that would identify the relatively small volume of data which is unusual or anomalous in some way. With such a system, limited and expensive human resources could focus on this small volume of unusual data for thorough analysis. The overall project objective was to develop a fully operational Automated Propulsion Data Screening (APDS) system with the capability of detecting significant trends and anomalies in transient and steady-state data. However, the effort limited screening of transient data to ground test data for throttle-down cases typical of the 3-g acceleration, and for engine throttling required to reach the maximum dynamic pressure limits imposed on the Space Shuttle. This APDS is based on neural networks designed to detect anomalies in propulsion system data that are not part of the data used for neural network training. The delivered system allows engineers to build their own screening sets for application to completed or planned firings of the SSME. ERC developers also built some generic screening sets that NASA engineers could apply immediately to their data analysis efforts.

Hoyt, W. Andes↗

NASA NTRS1980

Magsat - A new satellite to survey the earth's magnetic field

The Magsat satellite was launched on Oct. 30, 1979 into a sun-synchronous dawn-dusk orbit, of 97 deg inclination, 350 km perigee, and 550 km apogee. It contains a precision vector magnetometer and a cesium-vapor scalar magnetometer at the end of a 6-m long graphite epoxy scissors boom. The magnetometers are accurate to 2 nanotesla. A pair of star cameras are used to define the body orientation to 10 arc sec rms. An 'attitude transfer system' measures the orientation of the magnetometer sensors relative to the star cameras to approximately 5 arc sec rms. The satellite position is determined to 70 meters rms by Doppler tracking. The overall objective is to determine each component of the earth's vector magnetic field to an accuracy of 6 nanotesla rms. The Magsat satellite gathers a complete picture of the earth's magnetic field every 12 hours. The vector components are sampled 16 times per second with a resolution of 0.5 nanotesla. The data will be used by the U.S. Geological Survey to prepare 1980 world magnetic field charts and to detect large-scale magnetic anomalies in the earth's crust for use in planning resource exploration strategy.

Mobley, F. F.↗

DOE OSTI2022

Use of Machine Learning for Signature Development in a Multi-Sensor Environment for Safeguard Applications of Solvent Extraction Processes

Idaho National Laboratory is constructing the Special Nuclear Material test bed (Beartooth) for research and development pertaining to nuclear fuel processing operations using centrifugal contactors. Beartooth will enable give researchers the opportunity to study the dissolution, separation, and conversion of special nuclear materials (e.g., plutonium, enriched uranium, and thorium). As a lead-in to Beartooth, this project constructed a test bed to study the process and equipment behavior with real time series data collection using a variety of non-traditional sensors, in order to identify process failures and label them as either accidental or purposeful, thus enhancing nuclear nonproliferation stewardship. The measurement sources in this test bed include vibration, acoustic, current, flow, colorimetric, and thermal data. These measurements vary in terms of magnitude, frequency, and location. This information will be combined and used within data-driven machine-learning methods to detect operation condition changes that are either intentional (i.e., changes in operating set points) or malicious (i.e., flow diversion) in nature. This presentation covers the data processing and signature development activities necessary for utilizing this heterogeneous dataset to classify process anomalies.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2026

Characterization of Precipitation-Induced Radon Progeny Deposition Events Using a City-Scale Sensor Network

Networks of radiation detectors provide a platform for real-time radioactive source detection and identification in urban environments. Detection algorithms in these systems must adapt to naturally-occurring changes in background, which requires well-characterized relationships between precipitation events and their corresponding radiological signature. Here, we present a quantitative and qualitative description of rain-induced radon progeny deposition events occurring in Chicago from September 2023 to February 2024. We measure ambient gamma radiation levels, precipitation rate, temperature, pressure, and relative humidity in a network of sensor nodes. For each identified precipitation period, we decompose spectra into static- and radon-associated components as defined by a non-negative matrix factorization (NMF) algorithm. We find a consistent power-law relationship between a precipitation-dependent peak of the radon progeny proxy (RPP) and the peak strength of the radon-associated NMF component for most precipitation events. We conduct a case study of a rainfall period with abnormally high levels of implied radon progeny concentration and describe its temporal and spatial evolution. We hypothesize that this phenomenon is due to the air mass path that intersects a uranium-rich region of Wyoming. Finally, we cluster precipitation events into three distinct categories. One category roughly corresponds to events with deep low-pressure systems and high relative radon concentration, while another is characteristic of light stratiform rain with slightly higher temperatures and intermediate relative radon concentration. The third category appears to contain weak-gradient or lake breeze convection showers with intermittent precipitation and low relative radon concentration. These findings suggest that radiological anomaly detection could be improved by training unique background models corresponding to each category of meteorological event.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

NASA NTRS1998

Polar Hydra Data Analysis

The science activities are: 1) Hydra is still operating successfully on orbit. 2) A large amount of analysis and discovery has occurred with the Hydra ground data processing this past year. 3) Full interdetector calibration has been implemented and documented. This intercalibration was necessitated by the incorrect installation of bias resistors in the pre-acceleration stage to the electron channeltrons. This had the effect of making the counting efficiency for electrons energy dependent as well as channeltron specific. The nature of the error had no impact on the ion detection efficiency since they have a different bias arrangement. This intercalibration is so effective, that the electron and ion moment densities are routinely produced with a level of agreement better than 20%. 4) The data processing routinely removes glint in the sensors and produces public energy time spectrograms on the web overnight. 6) Routine, but more intensive computer processing codes are operational that determine for electrons and ions, the density, the flow vector, the pressure tensor and the heat flux by numerical integration. These codes use the magnetic field to sustain the quality of their output. To gain access to this high quality magnetic field within our data stream we have monitored Russell's web page for zero levels and timing files (since his data acquisition is not telemetry synchronous) and have a local reconstruction of B for our use. We have also detected a routine anomaly in the magnetometer data stream that we have documented to Chris Russell and developed an editing algorithm to intercept these "hits" and remove them from the geophysical analysis.

Scudder, J. D.↗

DOE OSTI2023

PRIMED for the Future: Purposing Raw Intake for Machine Learning-Enabled Detection

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2023

PRIMED for the Future: Purposing Raw Intake for Machine Learning-Enabled Detection (Final Report)

The COVID-19 pandemic demonstrated how a novel, elusive, and diffuse biological threat can engender uncertainty and misinformation, and it underscored the need for flexible analytical modalities agnostic to the identity of biological material. Yet even before the pandemic, recognition of the limitations of the current, list-based approach, which focuses on known pathogens and biotoxins, and of the importance of agent-agnostic biodetection was growing within the biosecurity community. In a 2018 report on “Biodefense in the Age of Synthetic Biology,” for example, the National Academy of Sciences stated that “an overreliance on the Select Agent List is a systematic weakness affecting many aspects of the United States’ current biodefense mitigation capability”. More recently, a group of biodefense researchers proposed the identification and adoption of “bioagent-agnostic signatures (BASs)” as a way of detecting and characterizing not only existing agents but also novel ones, an approach they believe will “enable a more flexible and resilient biodefense posture”. Indeed, the future of biodetection requires us to begin developing novel analytics that can identify anomalies and/or characteristics that indicate a potential threat, whether known or unknown, without looking for a specific signature that has been identified previously. To assess potential threats more rapidly, it is critical to develop agnostic artificial intelligence (AI)/machine learning (ML) systems that can be employed for real-time assessment of the nature and source of a perturbation. Such systems should be multi scale and multi-dimensional, integrating sensor data from a range of biological, chemical, and physical application spaces. Emerging deep learning (DL) models demonstrate exceptional promise for identification of discriminatory features within multi-dimensional datasets. DL models have the capacity to recognize and encode highly complex patterns in a wide range of input data modalities, including images, text, and biological/chemical/physical spectra. As such, they can execute a wide range of assessments and determinations that have traditionally required a human operator. The promise of advances in DL is apparent in the realm of human health and medicine. DL models have been validated for evaluating a variety of clinical threats to human health in a range of contexts, including infection and cancer, and they demonstrated improved performance in predicting stroke relative to human neurologists in some categories of data. Continuously evolving advances in AI/ML are expected to support more efficient evaluation of raw sequence, spectroscopy, and spectrometry data. For instance, recent advances and deployment of large language models (LLM) such as Generative Pre training Transformer (GPT) and Bidirectional Encoder Representations from Transformers (BERT) have already motivated application of these models for biological function prediction. As frameworks such as LLMs become larger and more complex in their representations, their capacity to serve as pre-trained models that can be fine-tuned for biological/biodetection purposes will similarly be amplified. While existing and emerging AI/ML have found broad applicability and use cases in the clinical sciences, development for environmental evaluation and biodetection has been limited. Functionalizing such capabilities for this purpose requires an understanding of the existing technical landscape and how the respective tools and algorithms are currently being employed. This landscape awareness then allows an assessment of the current practical capabilities of existing models and the anticipated requirements and development efforts that will be needed to adapt available algorithms for biodetection applications relevant to DHS. Leveraging expertise in biodetection, ML, and operational biodetection, the effort described in this report is comprised of a systematic landscape assessment (Subtask 2.1), comparative evaluation (Subtask 2.2), and formulation of a value proposition (Subtask 2.3) for the prospect of ML-enabled, agnostic biodetection from raw, or minimally-processed, datasets.

59 BASIC BIOLOGICAL SCIENCES↗

NASA NTRSDate not supplied

Quality Assurance of ISS LIS lightning Data

Optical lighting detection from space has been ongoing since 1995 from the Optical Transient detector (1995-2000), then later by the Lightning Imaging Sensors (LIS) on the Tropical Rainfall Measuring Mission (TRMM) satellite (1997-2015) and the International Space Station (ISS) (ISS 2017-present). A rapid readout (2 ms) 128x128 pixel CCD (Charge-coupled Device) array detects optical transients from lightning (events) and transmits the observations to ground. Ground processing determines whether individual events are likely due to lightning or noise. Likely lightning events are then grouped into groups, flashes, and areas and their location on the earth are determined. The lightning data are saved in orbit files; each file containing the time, location, and intensity of the lightning events, groups, flashes, and areas detected during one orbit. Even after this processing anomalies may exist in some of the orbits. A manual quality assurance (QA) procedure is performed monthly to assess the data and omit orbits with obvious anomalies from the dataset. These files are not included in the final dataset that has undergone QA. The manual QA was developed during the OTD mission to identify artifacts that made it through ground processing algorithms. The manual QA process was continued for the TRMM and ISS LIS missions. Many anomalies have been identified and software updates now address many of them. However, some anomalies still occur in the processed datasets. The manual QA process examines the data for obvious issues in the lightning files that passed through the processing algorithms. These files are considered anomalous and are not included in the final QA dataset. Some issues that may cause an orbit to be considered anomalous include: obvious noise (excess events that make it through the processing), suspect geolocation, and excessive missing data packets. As an example, one way noise manifests is as “streaks” in lightning climatology plots. These streaks are especially apparent in low lightning rate regions (eg., over oceans). Since there is no method at present to extract these anomalies during processing, orbit files with significant anomalies are identified and removed from the final QA ISS LIS dataset. The final QA dataset can be obtained files from the Global Hydrometeorological Resource Center (GHRC). This presentation will provide examples of the various anomalies and examine how often the various anomalies occur and how much data is lost due to the omission of the anomalous orbits. Comparisons with OTD and TRMM LIS will also be examined.

ISS↗