SEARCH · Engineering Papers

Results for “evaluation datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,081 records · Page 60

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Fast physics-based launcher optimization for electron cyclotron current drive

With the increased urgency to design fusion pilot plants, fast optimization of electron cyclotron current drive (ECCD) launchers is paramount. Traditionally, this is done by coarsely sampling the 4D parameter space of possible launch conditions consisting of (1) the launch location (constrained to lie along the reactor vessel), (2) the launch frequency, (3) the toroidal launch angle, and (4) the poloidal launch angle. For each initial condition, a ray-tracing simulation is performed to evaluate the ECCD efficiency. Unfortunately, this approach often requires a large number of simulations (sometimes millions in extreme cases) to build up a dataset that adequately covers the plasma volume, which must then be repeated every time the design point changes. Here we adopt a different approach. Rather than launching rays from the plasma periphery and hoping for the best, we instead directly reconstruct the optimal ray for driving current at a given flux surface using a reduced physics model coupled with a commercial ray-tracing code. Repeating this throughout the plasma volume requires only hundreds of simulations, constituting a significant speedup. The new method is validated on two separate example tokamak profiles, and is shown to reliably drive localized current at the specified flux surface with the same optimal efficiency as obtained from the traditional approach.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2021

An Overview of Argonne’s Advanced Mobility Technology Laboratory Vehicle Systems Instrumentation and Evaluation Methodology

This report will provide a general overview of the testing facilities, research equipment, and general testing methodologies Argonne utilizes to conduct vehicle technology evaluations of advanced technology research vehicles. Data is captured from vehicle evaluations that provide powertrain operation and corresponding energy consumption based on a combination of in-depth instrumentation and focused testing. This resulting dataset of hundreds of time-resolved vehicle signals provide a basis for direct analysis and model validation of vehicle specific technologies. Argonne has attempted to standardize the approach to vehicle instrumentation and testing at Argonne, but it should be noted that each vehicle, and the corresponding assessment, remains unique. It is suggested that the reader reference vehicle specific testing reports for an overview of the unique aspects for each test vehicle. Additionally, the datasets for research vehicles are made publicly available through the Advanced Mobility Technology Laboratory’s Downloadable Driving Database (D3) at www.anl.gov/d3.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2022

Multi-Site Observational Study to Assess Biomarkers for Susceptibility or Resilience to Chronic Pain: The Acute to Chronic Pain Signatures (A2CPS) Study Protocol

Chronic pain has become a global health problem contributing to years lived with disability and reduced quality of life. Advances in the clinical management of chronic pain have been limited due to incomplete understanding of the multiple risk factors and molecular mechanisms that contribute to the development of chronic pain. The Acute to Chronic Pain Signatures (A2CPS) Program aims to characterize the predictive nature of biomarkers (brain imaging, high-throughput molecular screening techniques, or “omics,” quantitative sensory testing, patient-reported outcome assessments and functional assessments) to identify individuals who will develop chronic pain following surgical intervention. The A2CPS is a multisite observational study investigating biomarkers and collective biosignatures (a combination of several individual biomarkers) that predict susceptibility or resilience to the development of chronic pain following knee arthroplasty and thoracic surgery. This manuscript provides an overview of data collection methods and procedures designed to standardize data collection across multiple clinical sites and institutions. Pain-related biomarkers are evaluated before surgery and up to 3 months after surgery for use as predictors of patient reported outcomes 6 months after surgery. The dataset from this prospective observational study will be available for researchers internal and external to the A2CPS Consortium to advance understanding of the transition from acute to chronic postsurgical pain.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2023

Performance Comparison of Object Detection Networks for Shrapnel Identification in Ultrasound Images

Ultrasound imaging is a critical tool for triaging and diagnosing subjects but only if images can be properly interpreted. Unfortunately, in remote or military medicine situations, the expertise to interpret images can be lacking. Machine-learning image interpretation models that are explainable to the end user and deployable in real time with ultrasound equipment have the potential to solve this problem. We have previously shown how a YOLOv3 (You Only Look Once) object detection algorithm can be used for tracking shrapnel, artery, vein, and nerve fiber bundle features in a tissue phantom. However, real-time implementation of an object detection model requires optimizing model inference time. Here, we compare the performance of five different object detection deep-learning models with varying architectures and trainable parameters to determine which model is most suitable for this shrapnel-tracking ultrasound image application. We used a dataset of more than 16,000 ultrasound images from gelatin tissue phantoms containing artery, vein, nerve fiber, and shrapnel features for training and evaluating each model. Every object detection model surpassed 0.85 mean average precision except for the detection transformer model. Overall, the YOLOv7tiny model had the higher mean average precision and quickest inference time, making it the obvious model choice for this ultrasound imaging application. Other object detection models were overfitting the data as was determined by lower testing performance compared with higher training performance. In summary, the YOLOv7tiny object detection model had the best mean average precision and inference time and was selected as optimal for this application. Next steps will implement this object detection algorithm for real-time applications, an important next step in translating AI models for emergency and military medicine.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2023

Performance of methods for SARS-CoV-2 variant detection and abundance estimation within mixed population samples

The accurate identification of SARS-CoV-2 (SC2) variants and estimation of their abundance in mixed population samples (e.g., air or wastewater) is imperative for successful surveillance of community level trends. Assessing the performance of SC2 variant composition estimators (VCEs) should improve our confidence in public health decision making. Here, we introduce a linear regression based VCE and compare its performance to four other VCEs: two re-purposed DNA sequence read classifiers (Kallisto and Kraken2), a maximum-likelihood based method (Lineage deComposition for Sars-Cov-2 pooled samples (LCS)), and a regression based method (Freyja). We simulated DNA sequence datasets of known variant composition from both Illumina and Oxford Nanopore Technologies (ONT) platforms and assessed the performance of each VCE. We also evaluated VCEs performance using publicly available empirical wastewater samples collected for SC2 surveillance efforts. Bioinformatic analyses were performed with a custom NextFlow workflow (C-WAP, CFSAN Wastewater Analysis Pipeline). Relative root mean squared error (RRMSE) was used as a measure of performance with respect to the known abundance and concordance correlation coefficient (CCC) was used to measure agreement between pairs of estimators. Based on our results from simulated data, Kallisto was the most accurate estimator as it had the lowest RRMSE, followed by Freyja. Kallisto and Freyja had the most similar predictions, reflected by the highest CCC metrics. We also found that accuracy was platform and amplicon panel dependent. For example, the accuracy of Freyja was significantly higher with Illumina data compared to ONT data; performance of Kallisto was best with ARTICv4. However, when analyzing empirical data there was poor agreement among methods and variations in the number of variants detected (e.g., Freyja ARTICv4 had a mean of 2.2 variants while Kallisto ARTICv4 had a mean of 10.1 variants). This work provides an understanding of the differences in performance of a number of VCEs and how accurate they are in capturing the relative abundance of SC2 variants within a mixed sample (e.g., wastewater). Such information should help officials gauge the confidence they can have in such data for informing public health decisions.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2024

Metagenomes and Metagenome-Assembled Genomes from Microbial Communities in the Hamptons Road Sanitary District (HRSD) Biological Nutrient Removal Pilot Plant Operated with High and Low Dissolved Oxygen Conditions

In this study, we aimed to evaluate BNR and investigate microbial community changes when the DO is reduced in the aerated portions of wastewater treatment trains. We present a dataset of metagenomes obtained from activated sludge collected from the Hamptons Road Sanitary District treatment plant at the beginning of operation, when the DO was high, and at the end of operation, when the DO was low

dissolved oxgyen↗

NASA NTRS2009

Tropical Cyclone Information System

The JPL Tropical Cyclone Infor ma tion System (TCIS) is a Web portal (http://tropicalcyclone.jpl.nasa.gov) that provides researchers with an extensive set of observed hurricane parameters together with large-scale and convection resolving model outputs. It provides a comprehensive set of high-resolution satellite (see figure), airborne, and in-situ observations in both image and data formats. Large-scale datasets depict the surrounding environmental parameters such as SST (Sea Surface Temperature) and aerosol loading. Model outputs and analysis tools are provided to evaluate model performance and compare observations from different platforms. The system pertains to the thermodynamic and microphysical structure of the storm, the air-sea interaction processes, and the larger-scale environment as depicted by ocean heat content and the aerosol loading of the environment. Currently, the TCIS is populated with satellite observations of all tropical cyclones observed globally during 2005. There is a plan to extend the database both forward in time till present as well as backward to 1998. The portal is powered by a MySQL database and an Apache/Tomcat Web server on a Linux system. The interactive graphic user interface is provided by Google Map.

Li, P. Peggy↗

NASA NTRSDate not supplied

A Survey of ISS and Visiting Vehicle Returned Surfaces for Environmental Characterization and Computer Model Development

The Orbital Debris Engineering Model (ORDEM) developed by the NASA Orbital Debris Program Office (ODPO) is a data-driven model — extensive radar, optical, laboratory, and in situ measurement data sets have been used to build the model since its earliest versions. A salient aspect of professional software development is the verification and validation (V&V) process. Verification answers the question “Is the model built correctly?” while validation addresses the question “Did we build the correct model?” Less extensive, reserved, or independent data sets serve the validation requirement. Due to the dynamic nature of the orbital debris environment, it is critical to use contemporaneous data sources that represent the current environment to support ORDEM development and validation. ORDEM has utilized in situ data collected from Space Shuttle and Hubble Space Telescope surface inspections, now over a decade old. This historical dataset is fundamental for providing baseline in situ measurement data for sizes between 10 to 300 microns, but new data sources are being evaluated using returned surfaces from or near the International Space Station (ISS). This paper reviews a general microscopic survey of ISS soft goods, the Pressurized Mating Adapter 2 (PMA-2) blanket, and a limited-scope feasibility study conducted on the Space Exploration Technologies Corporation (SpaceX) Dragon capsule’s Thermal Protection System (TPS) material. The PMA-2 blanket, exposed to the space environment between 09 July 2013 and 25 February 2015, is an approximately 3.7 m2-area blanket composed of a betacloth outer layer and multiple ballistic fabric inner layers. The SpaceX Cargo Dragon capsule regularly visited the ISS from 2012 through 2020 and potentially provides a timely and well-characterized source of data for modeling purposes. The capsule’s lateral surfaces use SpaceX Proprietary Ablative Material (SPAM) TPS material, a syntactic foam, for thermal management during all mission phases. Seven SPAM extracted samples have been analyzed to date. This paper will provide an overview of the characterization completed for impact features by size, depth, impactor diameter, and the impactor residues chemical analyses, allowing a differentiation between micrometeoroids and orbital debris and a categorization by mass density and density class. Impactor diameter is estimated using damage equations generated from ground-based hypervelocity impact testing. The orbital debris impactors are compared to the current ORDEM 3.2 model of the environment at ISS altitudes. We briefly discuss the meteoroid impactors, including constituents and mass densities, in the general context of current models.

Phillip Anz-meador↗

NASA NTRSDate not supplied

A Survey of ISS and Visiting Vehicle Returned Surfaces for Environmental Characterization and Computer Model Development

Phillip Anz-Meador↗

NASA NTRS2024

3D Cloud Masking Across A Broad Swath Using Multi-Angle Polarimetry and Deep Learning

Understanding the 3-dimensional structure of clouds is of crucial importance to modeling our changing climate. Active sensors, such as radar and lidar, provide accurate vertical cloud profiles, but are mostly restricted to along-track sampling. Passive sensors can capture a wide swath, but struggle to see beneath cloud tops. In essence, both types of products are restricted to two dimensions: as a cross-section in the active case, and an image in the passive case. However, multi-angle sensor configurations contain implicit information about 3D structure, due to parallax and atmospheric path differences. Extracting that implicit information can be challenging, requiring computationally expensive radiative transfer techniques. Machine learning, as an alternative, may be able to capture some of the complexity of a full 3D radiative transfer solution with significantly less computational expense. In this work, we make three contributions towards understanding 3D cloud structure from multi-angle polarimetry. First, we introduce a large-scale, publicly available dataset that fuses existing cloud products into a format more amenable to machine learning. This dataset treats multi-angle polarimetry as an input, and radar-based vertical cloud profiles as an output. Second, we describe and evaluate strong baseline machine learning models based that predict these profiles from the passive imagery. Notably, these models are trained only on center-swath labels, but can predict cloud profiles over the entire passive imagery swath. Third, we leverage the information-theoretic nature of machine learning to draw conclusions about the relative utility of various sensor configurations, including spectral channels, viewing angles, and polarimetry. These findings have implications for Earth-observing missions such as NASA’s Plankton, Aerosol, Cloud-ocean Ecosystem (PACE) and Atmosphere Observing System (AOS) missions, as well as in informing future applications of computer vision to atmospheric remote sensing.

clouds↗

NASA NTRS2026

Hydrology Copilot: A Cloud-Native Ai System for Hydrological Data Analysis

The emergence of AI-driven Earth observation systems promises to broaden access to petabyte-scale geospatial data beyond domain specialists. However, translating this vision into operational scientific infrastructure requires addressing fundamental challenges in data virtualization, code transparency, and domain-specific reasoning. We present Hydrology Copilot, a cloud-native AI framework for natural-language-driven analysis of Earth observation data. To demonstrate operational capabilities at scale, we implement the system using NASA's North American Land Data Assimilation System version 3 (NLDAS-3), which provides surface meteorological forcing and land-surface model output across North and Central America at 1-km resolution, from which drought diagnostics are derived. The system integrates five core contributions: (1) scalable data virtualization using Kerchunk-based cloud optimized access, achieving a 1.5 to 4.6 times improvement in I/O latency across benchmark queries spanning regional single-day extractions (4.6 times speedup) to continental monthly aggregations (1.5 times speedup); (2) transparent code generation through Microsoft Azure AI Foundry agents that expose executable Python workflows for scientific verification; (3) persistent conversational memory enabling multi-turn analytical discourse across sessions; (4) intelligent query validation that enforces dataset boundaries and resolves ambiguous requests before execution; and (5) a multi-agent architecture coordinating query parsing, code generation, and visualization. We evaluate the system through drought-monitoring workflows, demonstrating reliable code generation, accurate results validated against reference computations and the operational U.S. Drought Monitor, and efficient operation across increasingly complex tasks. By bridging natural-language interfaces with rigorous hydrological analysis, Hydrology Copilot advances beyond proof-of-concept demonstrations to provide a deployable framework for operational Earth science applications.

Data virtualization↗

DOE OSTI2026

Intern-Artificial Intelligence Benchmarking

Benchmarks provide a standardized method for evaluating different AI models, enabling reproducibility and comparison between models, and facilitating scientific progress. As AI models continue to develop rapidly, incorporating new datasets, capabilities, and architectures becomes more complicated. Therefore, the current static benchmarks become increasingly irrelevant. The MLCommons team argues that to make AI benchmarks more relevant, it involves making the benchmarks themselves more dynamic, as well as technical innovations that make it easier for scientists and researchers at all levels to use and contribute to the benchmarks. The current progress in technical innovation is a software that allows for a detailed view of a collection of AI benchmarks to be output in various formats that are easily readable and accessible.

Krishnan, Anjay [Fermilab]↗

DOE OSTI2024

Algorithmically detected rain-on-snow flood events in different climate datasets: a case study of the Susquehanna River basin

Abstract. Rain-on-snow (RoS) events in regions of ephemeral snowpack – such as the northeastern United States – can be key drivers of cool-season flooding. We describe an automated algorithm for detecting basin-scale RoS events in gridded climate data by generating an area-averaged time series and then searching for periods of concurrent precipitation, surface runoff, and snowmelt exceeding predefined thresholds. When evaluated using historical data over the Susquehanna River basin (SRB), the technique credibly finds RoS events in published literature and flags events that are followed by anomalously high streamflow as measured by gauge data along the river. When comparing four different datasets representing the same 21-year period, we find large differences in RoS event magnitude and frequency, primarily driven by differences in estimated surface runoff and snowmelt. Using dataset-specific thresholds improves agreement between datasets but does not account for all discrepancies. We show that factors such as meteorological forcing and coupling frequency, as well as choice of land surface model, play roles in how data products capture these compound extremes and suggest care is to be taken when climate datasets are used by stakeholders for operational decision-making.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Fabrication and Testing of Solid-Solution Strengthened Corrosion Resistant Alloys For Service in Molten Fluoride Environments

The demand for higher system thermal efficiencies requires the operation of power generation cycles and heat conversion systems at progressively higher temperatures. As the system operating temperature increases, existing materials may not provide adequate mechanical properties or environmental compatibility or both. There is an increasing commercial interest in the development and deployment of liquid-fueled Molten Salt Reactors (MSRs). Hastelloy®N, the highest performing candidate MSR structural alloy, is not capable of operations at temperatures above 700°C, thus limiting the performance of these systems. Using an Integrated Computational Materials Engineering (ICME)-approach and small laboratory scale heats, ORNL developed a class of patented alloys covered by U.S. Patent 9, 435, 011 B2, “Creep-resistant, Cobalt-free alloys for high temperature, liquid-salt heat exchanger systems,” similar to Hastelloy®N in that they are primarily solid solution strengthened. In contrast to precipitation strengthened alloys, the microstructure of solid solution alloys and hence the high temperature mechanical properties are stable for extended periods of time allowing long reactor operating life. The new alloys have shown to possess good resistance to liquid fluorides at temperatures up to 850°C and have significantly improved creep properties when compared to Hastelloy®N. The purpose of the CRADA project was for ORNL to collaborate with Haynes International- a materials producer, MetalTek International- a foundry, and Kairos Power – an advanced reactor developer – to scale-up selected alloys, evaluate their properties, and identify one solid solution strengthened alloy that can meet the property requirements for the reactor being developed by Kairos Power and other similar liquid fluoride-salt cooled reactors. As part of the project, eight alloys were down-selected and fabricated in larger industrial scale heats by Haynes International. Resistance to molten salt was evaluated in flowing FLiNaK and FLiBe by Kairos Power using their Rotating Cage Loop (RCL) system. Accounting for iron deposition during these tests, the new alloys displayed very low net mass change showing excellent corrosion performance in molten salt. Creep properties evaluated at ORNL were found to be better than that of Hastelloy®N and 316 stainless steel. Long-term stabilities of the alloys evaluated by Haynes International showed that these alloys have excellent thermal stability in the temperature range 704.4-815.6°C, with the change in strength and ductility being less than 10-15% after a 4000-hour exposure at 815.6°C. Autogenously Gas Tungsten Arc Welding (GTAW) welded samples showed less than 10% change in yield strength / ultimate tensile strength / total elongation compared to the basemetal, indicating that the alloys have excellent weldability. Three parts were successfully investment-cast using one alloy with very little voiding showing feasibility of fabricating parts using the casting process. This project enabled extensive interaction between the material producer Haynes International, casting supplier MetalTek, and reactor developer Kairos Power. This facilitated testing of materials and components produced using the newly developed alloys by the end-user. This allowed the generation of critical dataset required for down-selection of a few promising alloys for further development. This data is also currently being shared with other reactor designers for them to evaluate the suitability of this alloy for their reactor design. The availability of this alloy will ultimately enable the design and development and deployment of MSRs with increased temperature of operation and thus, improved efficiencies.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2025

Fabrication and Testing of Solid-Solution Strengthened Corrosion Resistant Alloys For Service in Molten Fluoride Environments

The demand for higher system thermal efficiencies requires the operation of power generation cycles and heat conversion systems at progressively higher temperatures. As the system operating temperature increases, existing materials may not provide adequate mechanical properties or environmental compatibility or both. There is an increasing commercial interest in the development and deployment of liquid-fueled Molten Salt Reactors (MSRs). Hastelloy®N, the highest performing candidate MSR structural alloy, is not capable of operations at temperatures above 700°C, thus limiting the performance of these systems. Using an Integrated Computational Materials Engineering (ICME)-approach and small laboratory scale heats, ORNL developed a class of patented alloys covered by U.S. Patent 9,435,011 B2, “Creep-resistant, Cobalt-free alloys for high temperature, liquid-salt heat exchanger systems,” similar to Hastelloy®N in that they are primarily solid solution strengthened. In contrast to precipitation strengthened alloys, the microstructure of solid solution alloys and hence the high temperature mechanical properties are stable for extended periods of time allowing long reactor operating life. The new alloys have shown to possess good resistance to liquid fluorides at temperatures up to 850°C and have significantly improved creep properties when compared to Hastelloy®N. The purpose of the CRADA project was for ORNL to collaborate with Haynes International- a materials producer, MetalTek International- a foundry, and Kairos Power – an advanced reactor developer – to scale-up selected alloys, evaluate their properties, and identify one solid solution strengthened alloy that can meet the property requirements for the reactor being developed by Kairos Power and other similar liquid fluoride-salt cooled reactors. As part of the project, eight alloys were down-selected and fabricated in larger industrial scale heats by Haynes International. Resistance to molten salt was evaluated in flowing FLiNaK and FLiBe by Kairos Power using their Rotating Cage Loop (RCL) system. Accounting for iron deposition during these tests, the new alloys displayed very low net mass change showing excellent corrosion performance in molten salt. Creep properties evaluated at ORNL were found to be better than that of Hastelloy®N and 316 stainless steel. Long-term stabilities of the alloys evaluated by Haynes International showed that these alloys have excellent thermal stability in the temperature range 704.4-815.6°C, with the change in strength and ductility being less than 10-15% after a 4000-hour exposure at 815.6°C. Autogenously Gas Tungsten Arc Welding (GTAW) welded samples showed less than 10% change in yield strength / ultimate tensile strength / total elongation compared to the basemetal, indicating that the alloys have excellent weldability. Three parts were successfully investment-cast using one alloy with very little voiding showing feasibility of fabricating parts using the casting process. This project enabled extensive interaction between the material producer Haynes International, casting supplier MetalTek, and reactor developer Kairos Power. This facilitated testing of materials and components produced using the newly developed alloys by the end-user. This allowed the generation of critical dataset required for down-selection of a few promising alloys for further development. This data is also currently being shared with other reactor designers for them to evaluate the suitability of this alloy for their reactor design. The availability of this alloy will ultimately enable the design and development and deployment of MSRs with increased temperature of operation and thus, improved efficiencies.

36 MATERIALS SCIENCE↗

DOE OSTI2023

The underappreciated importance of solar radiation in constraining spring phenology of temperate ecosystems in the Northern and Eastern United States

Spring phenology of temperate ecosystems is highly sensitive to climate change, generating various impacts on many important terrestrial surface biophysical processes. Although various prognostic models relying on environmental variables of temperature and photoperiod have been developed for spring phenology, comprehensive ecosystem-scale evaluations over large landscapes and long-time periods remain lacking. Further, environmental variables other than temperature and photoperiod might also importantly constrain spring phenology modelling but remain under-investigation. To address these issues, we leveraged around 20-years datasets of environmental variables (from Daymet and GLDAS products) and the spring phenology metric (i.e., the greenup date) respectively derived from MODIS and PhenoCams across 108 sites in the Northern and Eastern United States. We firstly cross-compared MODIS-derived greenup date with official PhenoCams product with high accuracy (R 2 = 0.70). Then, we evaluated the three prognostic models (i.e., Growing Degree Date (GDD), Sequential (SEQ) and optimality-based (OPT)) with MODIS-derived spring phenology, assessed the model residuals and their associations with soil moisture, rainfall, and solar radiation, and revised the two photoperiod-relevant models (SEQ, OPT) by replacing the daylength variable with solar radiation, which was found to contribute the most to model residuals. We found that 1) all models demonstrated good capability in characterizing spring phenology, with OPT performing the best (RMSE = 8.04 ± 5.05 days), followed by SEQ (RMSE = 10.57 ± 7.77 days) and GDD (RMSE = 10.84 ± 8.42 days), 2) all models displayed high model residuals showing tight correlation with solar radiation (r = 0.45–0.75), and 3) the revised models that included solar radiation significantly performed better with an RMSE reduction by 22.08%. Such results are likely because solar radiation better constrains early growing season plant photosynthesis than photoperiod, supporting the hypothesis of spring phenology as an adaptive strategy to maximize photosynthetic carbon gain (approximated by solar radiation) while minimizing frost damage risk (captured by temperature). Collectively, our study here reveals the underappreciated importance of solar radiation in constraining spring phenology of temperate ecosystems, and suggests ways to improve spring phenology modelling and other phenology-related ecological processes.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2017

Information Theoretic Evaluation of Satellite Soil Moisture Retrievals

Microwave radiometry has a long legacy of providing estimates of remotely sensed near surfacesoil moisture measurements over continental and global scales. A consistent assessment of theerrors and uncertainties associated with these retrievals is important for their effective utilization in modeling, data assimilation and end-use application environments. This article presents an evaluationof soil moisture retrieval products from AMSR-E, ASCAT, SMOS, AMSR2 and SMAPinstruments using information theory-based metrics. These metrics rely on time series analysis ofsoil moisture retrievals for estimating the measurement error, level of randomness (entropy) andregularity (complexity) of the data. The results of the study indicate that the measurement errors inthe remote sensing retrievals are significantly larger than that of the ground soil moisture measurements.The SMAP retrievals, on the other hand, were found to have reduced errors (comparable to Preprint submitted to Remote Sensing of Environment October 1, 2017those of in-situ datasets), particularly over areas with moderate vegetation. The SMAP retrievals also demonstrate high information content relative to other retrieval products, with higher levelsof complexity and reduced entropy. Finally, a joint evaluation of the entropy and complexity ofremotely sensed soil moisture products indicates that the information content of the AMSR-E, ASCAT,SMOS and AMSR2 retrievals is low, whereas SMAP retrievals show better performance. The use of information theoretic assessments is effective in quantifying the required levels of improvements needed in the remote sensing soil moisture retrievals to enhance their utility and information content.

Information theory↗

DOE OSTI2021

Considerations regarding the Use of Computer Vision Machine Learning in Safety-Related or Risk-Significant Applications in Nuclear Power Plants

With the advancements made to date in the field of artificial intelligence (AI), significant potential exists to utilize AI capabilities for nuclear power plant (NPP) applications. AI can replicate human decision making and it is usually faster and more accurate than humans. For implementations that impact critical NPP applications (e.g., safety-related or non-safety systems that potentially affect overall plant risk), a deeper safety analysis of the AI methods is necessary. AI applied to NPP operations could resemble the use of digital I&C (DI&C) because such applications involve digital computer hardware and custom-designed software that input plant data, execute complex software algorithms, and output the results to a system or licensed human operator to potentially provoke an action. For AI methods to be compliant with current safety requirements for DI&C, AI compatibility must be evaluated, and AI-related gaps may exist that prevent the prompt deployment of AI in NPPs. This effort aims to evaluate how example AI technologies align with the DI&C safety framework, and discusses how they could be analyzed, modeled, tested, and validated in a manner similar to typical DI&C technologies. Because AI is a broad field that encompasses areas such as machine learning (ML), natural language processing, and computer vision, this research focused on a subset of methods categorized as the computer vision ML (CVML) methods. This report explores two CVML use cases, gauge reading and fire watch, considered relevant to the DI&C standards, as they could play a safety-critical role. For the gauge reading use case, a CVML-enabled technology that can read gauges at oblique angles is utilized. For the fire watch use case, a CVML-enabled technology is utilized that migrates fire watch from a manual (human) approach to automated fire detection. These use cases are mainly intended to give context to the CVML system discussion. This effort assumes the worst-case scenario, with the CVML system being used to replace a safety-related or risk-significant system, thus requiring evaluation. Evaluating CVML against most of the relevant safety requirements for DI&C yielded several CVML-specific considerations due to the uniqueness of its characteristics in comparison with typical DI&C systems. For example, CVML models often employ commonly used (open-source) datasets, and it is not always possible to determine the level of overlap among open-source datasets. Therefore, the independence of the developed CVML models when demonstrating diversity is questionable, therefore creating vulnerability to common cause failure (CCF). The design verification process is also impacted since the data overlap could result in overestimation of the software validation and verification (V&V) performance results. Section 2 of this report evaluates a list of the identified CVML-specific characteristics and discusses the resulting considerations and potential solutions in the context of each referenced requirement. A summation is provided in Section 3. This report is not to be used as a guideline. It was developed to identify and consider issues in the implementation of ML technologies used to augment activities that may have a bearing on plant operation. The report draws parallels to the use of DI&C technologies, for which many standards are available to guide their use in nuclear plant operation. It considers the technologies and some of the potential implications of their use in safety-related applications but is not intended to address regulatory or licensing related issues.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗