Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Validation Analysis Data Evaluation Resource”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Kenya Food Security & Agriculture II: Utilizing NASA Earth Observations to Enhance Drought Warning Systems and Develop Capacity to Use the RHEAS Model in Kenya

Twenty-three counties in Kenya experience frequent drought, which damages agricultural productivity and threatens the health and well being of millions. NASA DEVELOP partnered with NASA SERVIR, the Regional Centre for Mapping of Resources for Development (RCMRD) and Kenya’s National Drought Management Authority (NDMA) to enhance drought-detection capacity using NASA Earth observations. Currently, the NDMA publishes monthly Early Warning Bulletins with drought conditions for each arid or semi-arid county in Kenya. These bulletins utilize the Vegetation Condition Index (VCI) from the Moderate Resolution Imaging Spectroradiometer (MODIS) as well as a variety of biophysical, social and economic drought indicators, but do not allow for advanced forecasting. To improve drought-monitoring capabilities, the team created a Combined Drought Indicator (CDI) using the Regional Hydrologic Extremes Assessment System (RHEAS) model and data from Aqua and Terra MODIS and the National Centers for Environmental Prediction.The CDI combined precipitation anomalies, soil moisture anomalies, evaporative stress, and VCI according to weights determined by principal component analysis. To evaluate the performance of the CDI across Kenya, the team compiled a dataset of drought events from historical reports and the NDMA’s records. Results suggested that the CDI detected drought earlier than VCI alone. However, more validation is needed to ensure that the CDI accurately and consistently detects drought earlier than current warning systems. In order to better understand the behavior of individual indices and the potential for earlier drought detection, the team also conducted a time-lag analysis. The team found that VCI responds to drought, on average, one month later than most other indices included in the CDI, suggesting that incorporating additional indices could improve early drought warning systems in Kenya.

Food Security & Agriculture↗

Application of artificial intelligence methods in the international roughness index prediction of rigid and composite pavements: a systematic review

The International Roughness Index (IRI) is a widely adopted metric for quantifying pavement roughness, directly influencing vehicle safety, ride comfort, and overall roadway performance. In recent years, the use of Machine Learning (ML) models for IRI prediction has gained momentum, with the goal of improving the allocation of maintenance and rehabilitation resources by enabling accurate assessments of pavement conditions. Most prior reviews, however, have concentrated on flexible pavements, leaving a notable gap regarding rigid and composite pavements. To address this gap, the present study conducts a systematic review of Artificial Intelligence (AI) methods applied to IRI prediction for rigid and composite pavements. Literature published between 2004 and 2025 is synthesized to highlight prevailing trends, methodological contributions, and directions for future research. Particular attention is given to the types of models employed, the datasets used for training and validation, and the role of input variables and data-processing strategies. Across the included studies, ensemble learning methods (especially gradient boosting variants such as XGBoost), artificial neural networks, and hybrid architectures frequently achieved high predictive skill, with several models reporting test-set coefficients of determination approaching 0.9–0.96, indicating strong potential for capturing the influence of traffic, pavement structure, and climatic factors. Since these results are obtained from heterogeneous datasets and evaluation protocols, they are interpreted qualitatively rather than as strict cross-study rankings. Analysis of input variables revealed that pavement age and initial IRI were included in 91% (21 of 23) and 78% (18 of 23) of studies, respectively. Climatic variables such as the freezing index appeared in 57% (13 of 23), while traffic-related factors were considered in 65% (15 of 23). The findings underscore the importance of standardized, high-quality datasets, such as those from the Long-Term Pavement Performance (LTPP) program, along with data consistency, model interpretability, computational efficiency, and replicability in enhancing IRI prediction. Future research should focus on incorporating input variable selection techniques to identify the most influential predictors, thereby improving accuracy and robustness. Integrating these approaches with advanced non-linear data-driven models, coupled with robust hyperparameter optimization, holds considerable promise for strengthening the reliability of IRI prediction and supporting resilient pavement management strategies.

42 ENGINEERING↗

Affordable Development and Demonstration of a Small NTR Engine and Stage: A Preliminary NASA, DOE, and Industry Assessment

In FY11, NASA formulated a plan for Nuclear Thermal Propulsion (NTP) development that included Foundational Technology Development followed by system-level Technology Demonstrations. The ongoing NTP project, funded by NASA's Advanced Exploration Systems (AES) program, is focused on Foundational Technology Development and includes 5 key task activities: (1) Fuel element fabrication and non-nuclear validation testing of heritage fuel options; (2) Engine conceptual design; (3) Mission analysis and engine requirements definition; (4) Identification of affordable options for ground testing; and (5) Formulation of an affordable and sustainable NTP development program. Performance parameters for Point of Departure designs for a small criticality-limited and full size 25 klb (sub f) (kip, or 1000 pound-force)-class engine were developed during FYs 13-14 using heritage fuel element designs for both Rover NERVA (Nuclear Engine for Rocket Vehicle Applications) Graphite Composite (GC) and Ceramic Metal (Cermet) fuel forms. To focus the fuel development effort and maximize use of its resources, the AES program decided, in FY14, that a leader-follower down-selection between GC and cermet fuel was required. An Independent Review Panel (IRP) was convened by NASA and tasked with reviewing the available fuel data and making a recommendation to NASA. In February 2015, the IRP recommended and the AES program endorsed GC as the leader fuel In FY14, a preliminary development schedule DDTE (Design Development Test and Evaluation) plan was produced by GRC (Glenn Research Center), DOE (Department of Energy) and industry for the AES program. Assumptions, considerations and key task activities are presented here. At the direction of NASA HQ (32515), NASA and DOE are to work together to formulate a detailed development plan and schedule allowing the affordable development of a small (7.5-16.5 klbf) GC engine for possible flight technology demonstration (FTD) mission within a 10-year timeframe.

Lunar Flyby Mission↗

Regional Analysis of the 2015–16 Lower Mekong River Basin Drought Using NASA Satellite Observations

Study region Lower Mekong River Basin (LMRB) Study focus Satellite remote sensing products are widely used for monitoring droughts. Using NASA satellite sensors of precipitation (Global Measurement Mission, GPM), soil moisture (Soil Moisture Active and Passive, SMAP), and terrestrial water storage (Gravity Recovery and Climate Experiment, GRACE), this study evaluates the historical drought in the LMRB during 2015–16. SMAP soil moisture was validated against in-situ soil moisture, and GPM precipitation and SMAP soil moisture were cross-validated with streamflow observations. The spatiotemporal dynamics of soil moisture were also examined in different ranges of catchment areas. In performing the analysis, we used lagged correlations between hydrological variables and the indices of the Standardized Precipitation Index (SPI) and Standardized Streamflow Index (SSI). New hydrological insights for the regions Spatio-temporal patterns of drought in 2015–16 were examined from the entire basin to small watersheds. A mismatch occurs when using GRACE data to study droughts in small watersheds (many of the small watersheds would be a fraction of the few 100 km2 spatial resolutions of GRACE pixel). In smaller watersheds, hydrological drought (SSI) was closely defined with SMAP soil moisture downscaled to 1 km rather than the meteorological drought index (SPI). By leveraging satellite-based observations across a range of spatial scales, this study highlights the utility of Earth observations in informing water resources and land management decisions at the regional scale.

Mekong↗

National Virtual Biotechnology Laboratory: Report on Rapid R&D Solutions to the COVID-19 Crisis

With funding from the CARES Act, the U.S Department of Energy (DOE) established the National Virtual Biotechnology Laboratory (NVBL) in March 2020 to address key challenges associated with the COVID-19 crisis. NVBL brought together the broad scientific and technical expertise and resources of DOE’s 17 national laboratories to help tackle medical supply short ages, discover potential drugs to fight the virus, develop and validate COVID-19 testing methods, model disease spread and impact across the nation, and understand virus transport in buildings and the environment. National laboratory resources leveraged for this effort include a suite of world-leading user facilities broadly available to the research community, such as light and neutron sources, nanoscale science research centers, sequencing and biocharacterization facilities, and high-performance computing facilities. Within months, NVBL teams produced innovations in materials and advanced manufacturing that mitigated shortages in test kits and personal protective equipment (PPE), creating nearly 1,000 new jobs. They used DOE’s high-performance computers and light and neutron sources to identify promising candidates for antibodies and antivirals that universities and drug companies are now evaluating. NVBL researchers also developed new diagnostic targets and sample collection approaches, and supported U.S. Food and Drug Administration (FDA), Centers for Disease Control and Prevention (CDC), and U.S. Department of Defense (DoD) efforts to establish national guidelines used in administering millions of tests. Researchers used artificial intelligence and high-performance computing to produce near-real-time data analysis to forecast disease transmission, stress on public health infrastructure, and economic impact, which supported decision-makers at the local, state, and national levels. NVBL teams also studied how to control indoor virus movement to minimize uptake and protect human health. NVBL’s accomplishments demonstrate not only the powerful resource represented by DOE’s national laboratories working together to meet national needs, but also the effectiveness of the integrated NVBL framework for rapidly responding to emergencies with research and development (R&D) solutions. As the fight against COVID continues, sustained efforts are needed to confront this pandemic as well as future threats. Examples include: 1) Establishing “supply chains on demand” to meet emergency production needs by leveraging the materials and manufacturing expertise of DOE national laboratories and developing advances in electronics, sensing, robotics, and automation capabilities; 2) Improving the speed and robustness of drug discovery by integrating experimental platforms with DOE’s computational and experimental user facilities, which provide unique resources to support the discovery of high-potential therapeutic agents; 3) Protecting public, environmental, and animal health by developing new testing protocols and instrumentation adaptable to diverse sample types (both physiological and environmental) to quickly detect a wide range of pathogens and monitor other biorisks; 4) Supporting near-real-time data needs of decision-makers at the local, regional, state, and national levels by advancing data curation, analysis, and modeling using artificial intelligence and new data science tools for managing and evaluating large diverse datasets; 5) Harnessing DOE’s expertise in environmental modeling to design rooms and air handling for offices, classrooms, restaurants, and other structures to minimize biorisk transmissions. Going forward, NVBL is poised to apply the unique capabilities and expertise of the national laboratory complex to future national and international emergencies, both natural and engineered. Through this framework, the Office of Science will continue to be an integral component of agency wide efforts to prepare for and respond to biorisks and other crises.

42 ENGINEERING↗

Asymptotically Compatible Reproducing Kernel Collocation and Meshfree Integration for Nonlocal Diffusion

Reproducing kernel (RK) approximations are meshfree methods that construct shape functions from sets of scattered data. We present an asymptotically compatible (AC) RK collocation method for nonlocal diffusion models with Dirichlet boundary condition. The numerical scheme is shown to be convergent to both nonlocal diffusion and its corresponding local limit as nonlocal interaction vanishes. The analysis is carried out on a special family of rectilinear Cartesian grids for a linear RK method with designed kernel support. The key idea for the stability of the RK collocation scheme is to compare the collocation scheme with the standard Galerkin scheme, which is stable. In addition, assembling the stiffness matrix of the nonlocal problem requires costly computational resources because high-order Gaussian quadrature is necessary to evaluate the integral. We thus provide a remedy to the problem by introducing a quasi-discrete nonlocal diffusion operator for which no numerical quadrature is further needed after applying the RK collocation scheme. The quasi-discrete nonlocal diffusion operator combined with RK collocation is shown to be convergent to the correct local diffusion problem by taking the limits of nonlocal interaction and spatial resolution simultaneously. The theoretical results are then validated with numerical experiments. We additionally illustrate a connection between the proposed technique and an existing optimization based approach based on generalized moving least squares.

97 MATHEMATICS AND COMPUTING↗

Composite Overwrapped Pressure Vessels (COPV): Developing Flight Rationale for the Space Shuttle Program

Introducing composite vessels into the Space Shuttle Program represented a significant technical achievement. Each Orbiter vehicle contains 24 (nominally) Kevlar tanks for storage of pressurized helium (for propulsion) and nitrogen (for life support). The use of composite cylinders saved 752 pounds per Orbiter vehicle compared with all-metal tanks. The weight savings is significant considering each Shuttle flight can deliver 54,000 pounds of payload to the International Space Station. In the wake of the Columbia accident and the ensuing Return to Flight activities, the Space Shuttle Program, in 2005, re-examined COPV hardware certification. Incorporating COPV data that had been generated over the last 30 years and recognizing differences between initial Shuttle Program requirements and current operation, a new failure mode was identified, as composite stress rupture was deemed credible. The Orbiter Project undertook a comprehensive investigation to quantify and mitigate this risk. First, the engineering team considered and later deemed as unfeasible the option to replace existing all flight tanks. Second, operational improvements to flight procedures were instituted to reduce the flight risk and the danger to personnel. Third, an Orbiter reliability model was developed to quantify flight risk. Laser profilometry inspection of several flight COPVs identified deep (up to 20 mil) depressions on the tank interior. A comprehensive analysis was performed and it confirmed that these observed depressions were far less than the criterion which was established as necessary to lead to liner buckling. Existing fleet vessels were exonerated from this failure mechanism. Because full validation of the Orbiter Reliability Model was not possible given limited hardware resources, an Accelerated Stress Rupture Test of a flown flight vessel was performed to provide increased confidence. A Bayesian statistical approach was developed to evaluate possible test results with respect to the model credibility and thus flight rationale for continued operation of the Space Shuttle with existing flight hardware. A non-destructive evaluation (NDE) technique utilizing Raman Spectroscopy was developed to directly measure the overwrap residual stress state. Preliminary results provide optimistic results that patterns of fluctuation in fiber elastic strains over the outside vessel surface could be directly correlated with increased fiber stress ratios and thus reduced reliability.

Kezirian, Michael T.↗

The influence of cloud cover on the reliability of satellite-based solar resource data

Satellite-based solar resource data are often developed and validated by using binary cloudiness categories: clear sky or overcast cloudy sky. To investigate the reliability of solar resource data in partially cloudy conditions, we estimate cloud fraction using two distinct algorithms: a physical retrieval model using surface observed global horizontal irradiance (GHI) and direct normal irradiance (DNI) and a temporal average of cloud mask data estimated by the observed DNI. Our analysis reveals a significant presence of scattered clouds, broken clouds, and mismatches between satellite- and surface-based cloud data at 17 surface sites across the contiguous United States, though confidently clear and cloudy conditions collectively account for more than 70 % of the data. Solar radiation is computed using the National Solar Radiation Database (NSRDB) algorithm and validated using surface observations. Here, our findings suggest that, in the presence of scattered clouds, NSRDB data for clear-sky conditions can be subject to significant overestimation. In cloudy-sky conditions classified by satellite data, DNI computed by the Fast All-sky Radiation Model for Solar applications with DNI (FARMS-DNI) can be underestimated when limited clouds are detected by surface observations. The bias observed in several cloudiness categories indicates that the NSRDB is exceptionally accurate in confidently clear conditions. However, clear-sky conditions with scattered clouds and mismatched cloud data contribute significantly to the overall uncertainties in the NSRDB. Therefore, future improvements in solar resource data should involve development and implementation of satellite-derived cloud fraction and should consider a novel radiative transfer model accounting for amplified cloud reflection. The evaluation within cloudiness categories also provides a physical rationale for the superior performance of FARMS-DNI compared to the Direct Insolation Simulation Code (DISC) in both cloudy-sky and all-sky conditions.

14 SOLAR ENERGY↗

Midwest Water Resources II: Evaluating Evapotranspiration with NASA Earth Observations and In Situ Observations to Understand Water Balance in Midwest Agriculture

Seasonal water variability in the midwestern United States extensively affects the agricultural community, as it impacts irrigation schedules, growing seasons, and overall ecosystem function. Evapotranspiration (ET) is a critical climatic variable in the water cycle and is used to evaluate spatiotemporal trends in drought and flood conditions. The NASA DEVELOP team partnered with the United States Department of Agriculture (USDA) Midwest Climate Hub, the Minnesota Department of Agriculture, the Illinois State Water Survey, and Michigan State University to compare remotely sensed ET products with in situ observations from January 2001 through December 2020. Remotely sensed actual ET (aET) data were sourced from NASA’s Terra Moderate Resolution Imaging Spectroradiometer (MODIS), and reference ET (refET) data were derived from the Gridded Surface Meteorological (gridMET) dataset. For in situ comparison, aET data were downloaded from the AmeriFlux database while refET data were collected from the Illinois Climate Network and Michigan State University’s Enviro-weather database. For a holistic assessment of ET, this project generated comparisons between remotely sensed and in situ observations, calculated descriptive statistics for validation between refET datasets, and spatially produced statistical validation maps regarding in situ sites. The temporal and spatial gaps of AmeriFlux data limited aET analysis. This comparative assessment of ET products across the Midwest can be used by project partners to assess regional water trends and guide future land management decisions.

Addison Pletcher↗

Towards an Indian Land Data Assimilation System (ILDAS): A Coupled Hydrologic-Hydraulic System for Water Balance Assessments

Effective management of water resources requires reliable estimates of land surface states and fluxes, including water balance components. But most land surface models run in uncoupled mode and do not produce river discharge at catchment scales to be useful for water resources management applications. Such integrated systems are also rare over India where hydrometeorological extremes have wreaked havoc on the economy and people. So, an Indian Land Data Assimilation System (ILDAS) with a coupled land surface and a hydrodynamic model has been developed and driven by multiple meteorological forcings (0.1°, daily) to estimate land surface states, channel discharge, and floodplain inundation. ILDAS benefits from an integrated framework as well as the largest suite of observation records collected over India and has been used to produce a reanalysis product for 1981–2021 using four forcing datasets, namely, Modern-Era Retrospective Analysis for Research and Applications, Version 2 (MERRA-2), Climate Hazards Group InfraRed Precipitation with Station data (CHIRPS), ECMWF’s ERA-5, and Indian Meteorological Department (IMD) gridded precipitation. We assessed the uncertainty and bias in these precipitation datasets and validated all major components of the terrestrial water balance, i.e., surface runoff, soil moisture, terrestrial water storage anomalies, evapotranspiration, and streamflow, against a combination of satellite and in situ observation datasets. Our assessment shows that ILDAS can represent the hydrological processes reasonably well over the Indian landmass with IMD precipitation showing the best relative performance. Evaluation against ESA-CCI soil moisture shows that MERRA-2 based estimates outperform the others, whereas ERA-5 performs best in simulating evapotranspiration when evaluated against MODIS ET. Evaluations against observed records show that CHIRPS-based estimates have the highest performance in reconstructing surface runoff and streamflow. Once operational, this system will be useful for supporting transboundary water management decision making in the region.

Indian Land Data Assimilation System (ILDAS)↗

UNF-ST&DARDS Enhancements for RCCA Data in As-loaded Dual Purpose Cask Models

This report summarizes the work performed to enable detailed modeling of rod cluster control assembly (RCCAs) in dual purpose canisters (DPCs) in as-loaded configurations using the Used Nuclear Fuel – Storage, Transportation & Disposal Analysis Resource and Data System (UNF-ST&DARDS). The goal of this project was to evaluate the reactivity impact that RCCAs have on k eff of DPCs with pressurized water reactor (PWR) fuel to potentially use the additional margin in future post-closure criticality safety analysis. This preliminary evaluation determined the number of DPCs that currently require compensatory actions prior to emplacement in a repository because of their high reactivity under post-closure criticality scenarios, which could be made acceptable by including the as-loaded RCCAs as specified in the Unified Database (UDB). This report briefly describes the modeling methods currently used within UNF-ST&DARDS and the modifications made to automate inclusion of the as-loaded RCCAs in the DPCs for post-closure criticality calculations for the loss of neutron absorber (NA) scenarios, or NA models. For the Zion site, the loss of basket scenarios, or degraded basket (DB) models, are also included. Discussion is also provided regarding the UDB data compared to available site-specific loading map data for the sites, which are specifically evaluated herein. This report compares the modifications to a similar evaluation for the Zion by site conducted by Walker as an initial validation. After the partial validation, all existing PWR sites with applicable NA models within the UDB were evaluated.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

EXERGETIC: De-Risking Next-Generation Resilient Geothermal Hybrids via At-Scale Evaluation Using Virtual Emulation Digital Twin Environment for Efficient Operation

The DOE-GTO-funded project, award number 5.1.2.12, entitled "EXERGETIC - De-risking Next Generation Resilient Geothermal Hybrids via at-Scale Evaluation Using a Virtual Emulation Digital Twin Environment for Efficient Operation," advances the solution to these challenges by developing and validating a geothermal co-emulation environment implemented at the National Laboratory of the Rockies (NLR)'s Advanced Research on Integrated Energy Systems (ARIES) platform. This framework enables the de-risking of next-generation geothermal and geothermal hybrid systems through high-fidelity modeling, real-time digital emulation, advanced control strategies, and techno-economic assessment. The project focused on geothermal hybrid configurations that integrate geothermal power plants with concentrated solar power and underground thermal energy storage, enabling enhanced efficiency, flexibility, and grid support capabilities. The main goal of this project was the development of a geothermal digital co-emulation environment to demonstrate the technical and economic value of geothermal hybrid systems and their contribution to grid stability and flexibility. The EXERGETIC framework combined physics-based models, controls, and real assets at ARIES, including digital real-time simulators (DRTS), a 20-MW-scale controllable grid interface (CGI), and a 2-MW conventional generator. Detailed transient models were developed for the key subsystems of a hybrid geothermal plant, including parabolic trough solar collectors, reservoir thermal energy storage (RTES), and a binary Organic Rankine Cycle (ORC) power plant. The ORC model explicitly captured thermal inertia and off-design operation and integrated control strategies to dynamically respond to electric load profiles. The models were validated against published experimental and numerical studies, demonstrating strong agreement and confirming the accuracy and robustness of the modeling approach. The resulting digital twin represents geothermal-solar-storage systems at multiple scales (1 MW to 100 MW) and enables realistic emulation of grid-connected operation. The control architecture allows the geothermal resource to provide stable baseload generation, while solar and stored thermal energy supply flexible, dispatchable support during periods of high demand or variable grid conditions. A key contribution of the EXERGETIC project is the demonstration that geothermal hybrid systems can be designed to be active grid assets rather than passive baseload generators. Using the ARIES platform, the digital twin was evaluated under multiple grid scenarios, including load following, voltage support at the distribution level, and frequency response at the transmission level. Results show that hybrid geothermal systems can respond effectively to dynamic grid conditions, providing inertia-like behavior, primary frequency support, and voltage regulation through coordinated control. In addition to the performance and grid services capability analysis of geothermal and hybrid geothermal systems, the EXERGETIC project also focused on scalability and techno-economic analysis of geothermal hybrid plants. In particular, for the scalability analysis, machine-learning (ML)-based surrogate models were trained using data generated from the geothermal digital twin under different grid-connected scenarios and plant capacities. These ML models demonstrated strong interpolation and extrapolation capabilities across plant sizes, accurately reproducing both steady-state and transient responses with very low errors. Regarding the techno-economic analysis, plant performance results were integrated with cost models for hybrid geothermal systems, and the levelized cost of electricity (LCOE) was used as the main economic metric to evaluate system performance across a range of system capacities, solar shares, solar multiples, and storage durations. Results indicate that economies of scale significantly reduce geothermal LCOE as plant capacity increases, with large-scale systems (25-100 MW) achieving substantially lower costs than small plants. Hybridization with solar thermal energy and storage further improves economic performance by increasing capacity utilization and enabling flexible dispatch. In addition, thermal storage plays a critical role in reducing LCOE by maximizing geothermal, solar, and stored energy resources. In summary, the results from this project demonstrate that geothermal hybrid systems represent a promising alternative for increasing the energy conversion efficiency of geothermal technologies, contributing to the preservation of geothermal resources, and supporting the transition of geothermal plants from traditional baseload resources into flexible, resilient, and cost-competitive energy conversion technologies.

15 GEOTHERMAL ENERGY↗

Model Assisted Probability of Detection for NASA Space Missions

Model assisted probability of detection (MAPOD) uses data from simulations to improve a traditional probability of detection (POD) study. This could include extending the parameter space to reduce uncertainty or substituting experimental data with simulated data to reduce the time and cost of a POD study. In the past MAPOD was difficult due to limited computational resources, but recent innovations in simulation tools and high-performance computing have made this type of high-degree-of-freedom modelling possible, and complex structures have made it necessary. This presentation will summarize the work done by the computational nondestructive evaluation (CNDE) group at NASA Langley Research Center (LaRC) to complete a MAPOD study for phased array ultrasound testing (PAUT) of a friction stir welding (FSW) method to be used on Space Launch System (SLS) structures. The three critical needs for a MAPOD study are a validated and verified model of the inspection technique for the structure being inspected, some experimental POD data, and an uncertainty model for both the model and the experimental data. PAUT was simulated using Extende CIVA’s UT module. The model was validated using laboratory inspection data from NASA Marshall Space Flight Center (MSFC) for a Hit/Miss POD for FSW in 2219-T87 aluminum panels representative of those used in the SLS. This model was then used to simulate flaw sizes that were originally omitted from the original POD study. The results of this new MAPOD study will be presented along with a discussion of the methods and processes used to analyze the original data, selected simulation parameters, and development of the uncertainty model used for the statistical analysis. The goal of this effort is not just to improve the POD study but to demonstrate the value of MAPOD and provide a roadmap for application of MAPOD on future projects.

Elizabeth Gregory↗

Predictive analytics of selections of russet potatoes

We explore the application of machine learning algorithms specifically to enhance the selection process of Russet potato (Solanum tuberosum L.) clones in breeding trials by predicting their suitability for advancement. This study addresses the challenge of efficiently identifying high-yield, disease-resistant, and climate-resilient potato varieties that meet processing industry standards. Leveraging manually collected data from trials in the state of Oregon, we investigate the potential of a wide variety of state-of-the-art binary classification models. The dataset includes 1086 clones, with data on 38 attributes recorded for each clone, focusing on yield, size, appearance, and frying characteristics, with several control varieties planted consistently across four Oregon regions from 2013 to 2021. We conduct a comprehensive analysis of the dataset that includes preprocessing, feature engineering, and imputation to address missing values. We focus on several key metrics such as accuracy, F1-score, and Matthews correlation coefficient (MCC) for model evaluation. The top-performing models, namely a feedforward neural network classifier (Neural Net), a histogram-based gradient boosting classifier (HGBC), and a support vector machine classifier (SVM), demonstrate consistent and significant results. To further validate our findings, we conducted a simulation study using the aims, data-generating mechanisms, estimands, methods, and performance measures (ADEMP) framework, simulating different data-generating scenarios to assess model robustness and performance through true positive, true negative, false positive, and false negative distributions, area under the receiver operating characteristic curve (AUC-ROC) and MCC. The simulation results highlight that non-linear models like SVM and HGBC consistently show higher AUC-ROC and MCC than logistic regression, thus outperforming the traditional linear model across various distributions, and emphasizing the importance of model selection and tuning in agricultural trials. Variable selection further enhances model performance and identifies influential features in predicting trial outcomes. The findings emphasize the potential of machine learning in streamlining the selection process for potato varieties, offering benefits such as increased efficiency, substantial cost savings, and judicious resource utilization. Our study contributes insights into precision agriculture and showcases the relevance of advanced technologies for informed decision-making in breeding programs.

60 APPLIED LIFE SCIENCES↗

Model Assisted Probability of Detection for NASA Space Missions

Model assisted probability of detection (MAPOD) uses data from simulations to improve a traditional probability of detection (POD) study. This could include extending the parameter space to reduce uncertainty or substituting experimental data with simulated data to reduce the time and cost of a POD study. In the past MAPOD was difficult due to limited computational resources, but recent innovations in simulation tools and high-performance computing have made this type of high-degree-of-freedom modeling possible, and complex structures have made it necessary. This presentation will summarize the work done by the computational nondestructive evaluation (CNDE) specialists within the Nondestructive Evaluation Sciences branch at NASA Langley Research Center (LaRC) to complete a MAPOD study for phased array ultrasound testing (PAUT) of a friction stir welding (FSW) method to be used on Space Launch System (SLS) structures. The three critical needs for a MAPOD study are a validated and verified model of the inspection technique for the structure being inspected, some experimental POD data, and an uncertainty model for both the model and the experimental data. PAUT was simulated using Extende CIVA’s UT module. The model was validated using laboratory inspection data from NASA Marshall Space Flight Center (MSFC) for a Hit/Miss POD for FSW in 2219-T87 aluminum panels representative of those used in the SLS. This model was then used to simulate flaw sizes that were originally omitted from the original POD study. The results of this new MAPOD study will be presented along with a discussion of the methods and processes used to analyze the original data, selected simulation parameters, and development of the uncertainty model used for the statistical analysis. The goal of this effort is not just to improve the POD study but to demonstrate the value of MAPOD and provide a roadmap for application of MAPOD on future projects.

Elizabeth Gregory↗

North Dakota Integrated Carbon Storage Complex Feasibility Study. Final report

In spring 2017, the Energy & Environmental Research Center (EERC) initiated an effort to determine the feasibility of developing a commercial-scale CO 2 geologic storage complex able to store 50+ million tonnes (Mt) of CO 2 in central North Dakota safely, permanently, and economically. The objective was to fulfill the goals of the U.S. Department of Energy (DOE) Carbon Storage Assurance Facility Enterprise (CarbonSAFE) Initiative and address technical and nontechnical challenges specific to commercial-scale deployment of a CO2 storage project. The findings clearly show that the concept of capturing CO 2 from a lignite-fired electrical generation facility in central North Dakota and safely and permanently storing the CO 2 in the deep subsurface is indeed technically, economically, and socially feasible. This project evaluated two study areas and their respective geologic storage complexes located adjacent to separate coal-fired facilities in North Dakota: the Basin Electric Power Cooperative (BEPC)-owned Great Plains Synfuels Plant (GPSP) and the Minnkota Power Cooperative (Minnkota)-owned Milton R. Young Station (MRYS). These locations, one with CO 2 capture in place and an existing CO 2 pipeline, are bolstered by progressive North Dakota pore space ownership and long-term liability laws. These elements and a motivated team created an ideal synergistic scenario for ensuring success of the CarbonSAFE Initiative and promoting North Dakota’s statewide vision for carbon management. The project included drilling two new geologic characterization wells, integrating an existing 3-D seismic survey, creating a geologic model subsequently used for injection simulation, a risk assessment, public outreach, and generating a site development plan based on results. In addition, the performance of select National Risk Assessment Partnership tools was evaluated. The geologic characterization wells were drilled ~5600 feet deep to the Broom Creek Formation; ~350 feet of core was retrieved from each well. The core included the Broom Creek (targeted injection zone) and a portion of the overlying Opeche Shale (seal). The Flemmer-1 well, west of Beulah, North Dakota, yielded 169 feet of sandstone. The BNI-1 well located south of Center, North Dakota, yielded 124 feet of sandstone. In each case, laboratory analysis of the sandstone showed permeability in the 300–1000-mD range, with porosity of 20%–30%. The Flemmer-1 well was sited within the boundaries of an existing 3-D seismic survey. Colocating the well with the seismic survey maximized the relationship between new and legacy data and developed a first-of-its-kind interpretation of the geologic fabric of the Broom Creek. Geologic characterization data were integrated into a 5544-mi 2 geocellular model that encompassed both new wells and stratigraphy from the surface to the Amsden Formation (underlying the Broom Creek). The model was later expanded vertically to include the deeper Black Island–Deadwood interval to examine its potential viability as a storage target. The geocellular model provided the foundation for dynamic simulation of CO 2 into the Broom Creek. Results of the simulation suggest that the Broom Creek could accept the DOE target rate of 2 Mt/yr of CO 2 into as few as two wells. To bracket the expected capture from MRYS, simulations were also investigated for a 4-Mt/yr rate near MRYS. Although more wells are needed (two additional), the Broom Creek still has the storage resource to accept the CO 2 at the increased rate. A risk assessment exercise was conducted to identify and assess technical and nontechnical risks that could prevent potential candidate storage complexes within the study area from serving as commercial storage sites. The assessment identified and evaluated six technical risk categories: 1) CO 2 injectivity, 2) storage capacity, 3) lateral migration of CO 2 , 4) lateral pressure propagation, 5) vertical migration of CO 2 or formation brine, and 6) induced seismicity. Following two rounds of analysis and scoring, no risks were determined to preclude continued efforts to develop carbon capture, utilization, and storage (CCUS) in central North Dakota. The risk assessment results will be used to guide future site characterization, modeling and simulation, and monitoring activities. A specific nontechnical strategic risk based on challenges that may be realized in amalgamation of pore space resulted in vertically expanding the geologic model to incorporate the potential for stacked storage in multiple saline reservoirs. By including the Black Island–Deadwood interval (the basal sedimentary reservoir in this region), the amalgamated areal extent could be reduced by as much as 45%. Working with a smaller geographic area reduces risks and costs associated with monitoring and pore space leasing. An economic evaluation incorporating capture; transport (<5 mi); Class VI wells; permitting; and monitoring, verification, and accounting suggests implementing commercial-scale CCUS is economically attractive if the federal tax benefits of 45Q are included. This is validated by Minnkota’s continued pursuit of CO 2 capture and geologic storage at MRYS through its Project Tundra initiative, indicating that there is a business case for CCUS in central North Dakota. Currently, North Dakota is the only state with underground injection control (UIC) Class VI primacy. Built into the North Dakota Century Code is a series of regulatory requirements that guide the process to obtain a Class VI CO 2 storage facility permit. As part of this project, a site development plan was compiled to assure compliance with North Dakota’s requirements to permit a commercial-scale CO 2 storage operation and includes a prospective time line encompassing a general breakdown of activities. In total, an estimated 30 months would be needed to execute the necessary steps to attain a North Dakota CO 2 storage facility permit. Outreach was an integral part of the project and encompassed any project-related activity that had contact or exposure beyond the project team. The goals of outreach were to foster an environment from which stakeholders could make informed decisions about the project and gauge community receptiveness to a CCUS project. A consistent set of messages and outreach products were developed in conjunction with an outreach advisory board that integrated project partners and team members. To gauge public acceptability of geologically storing CO 2 , 5611 households in the project area were invited to participate in an online survey. The survey results indicate that the public attitude regarding CCUS is neutral to positive, with strong sentiment that CO 2 capture and storage may be an approach to maintain the economic vitality of the region. To achieve project objectives, critical support in the form of financial backing, engineering evaluations, site access, outreach collaboration, operations data, risk assessment/evaluation, and software access was provided by BEPC, the North Dakota Industrial Commission Lignite Research Council, ALLETE Clean Energy, BNI Energy, North American Coal Corporation, Minnkota, Prairie Public Broadcasting, Computer Modelling Group Ltd., and Schlumberger.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Application of Cyber-Informed Engineering for Protecting BESS

This white paper synthesizes an array of crucial grid services provided by BESS technology, assesses its architecture and communications, and presents a case study for analysis against the principles introduced by Cyber-Informed Engineering (CIE). Furthermore, in walking through the analysis, this paper presents a framework to evaluate risks and solutions when considering BESS components. Asset owners and buyers could perform this analysis to assess their BESS product implementations, alternative inverter-based resources (IBR), and energy management systems (EMS). Battery systems fulfill various roles contingent on the unique market demands and the specific challenges presented by regional grid infrastructures. These roles also vary due to the differing utility models for ownership and operation, which are adapted to meet regional and local capabilities and requirements. Concerns have been raised regarding the potential for adversaries to exploit knowledge of battery operational patterns to orchestrate decisive attacks. However, the security of operational data for these systems may not be the primary vulnerability, as much of this information is already well-understood within the community. Applying a modest degree of subject matter expertise can often yield valuable predictions regarding how a battery will respond under certain conditions, such as grid emergencies, high or low-temperature days, Public Safety Power Shutoff (PSPS) events, and outages. The operational characteristics of batteries are well-documented, and their capabilities, including the risks associated with misoperation and the resulting consequences, are published and understood within the industry. CIE practices represent the next step in gaining functional assurance and providing an acceptable level of risk, regardless of whether a battery vendor can support a trusted and validated supply chain. While this issue has exacerbated supply chain challenges, it is not an isolated condition. This foreign supply route is the primary source of BESS for the U.S. market. Significant efforts are underway through the Bipartisan Infrastructure Law (BIL) to change that. Still, strategic short-term operational mitigations are needed to ensure the security of our operational technology (OT) systems, which are enhanced by instilling trust and are separate from vendors implementing CIE principles.

25 ENERGY STORAGE↗

Evaluation of historical precipitation interannual variability in CMIP6 over the United States

Interannual precipitation variability profoundly influences society via its effects on agriculture, water resources, infrastructure, and disaster risks. In this study, we use daily in situ precipitation observations from the global historical climatology network-daily (GHCN-D) to assess the ability of 21 Coupled Model Intercomparison Project Phase 6 (CMIP6) models, including the 50-member fifth-generation Canadian Earth System Model single model initial-condition large ensemble (CanESM5_SMILE), to realistically simulate historical interannual precipitation variability trends within 17 regions of the contiguous United States (CONUS). We assess how accurately the CMIP6 simulations align with observational data across annual, summer, and winter periods, focusing on four key hydrometeorological metrics, including interannual precipitation variability, relative interannual precipitation variability (coefficient of variation), annual mean precipitation, and annual wet day frequency. Our findings reveal that CMIP6 ensemble members generally reproduce the spatial patterns of observed trends in annual mean precipitation. In most regions, models agree well with the signs of observed changes in annual mean precipitation, though discrepancies in trend magnitude are evident. Further, observed trends in winter mean precipitation broadly exhibit a spatial pattern similar to that of the observed annual mean. However, analysis of the CanESM5_SMILE shows that trends in precipitation variability may primarily be the result of model-simulated internal variability, suggesting caution in interpreting multi-model single-realization ensemble results. Challenges in accurately simulating interannual precipitation variability underscore the need for ongoing model refinement and validation to enhance climate projections, especially in regions vulnerable to extreme precipitation events.

54 ENVIRONMENTAL SCIENCES↗