Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Validation Analysis Data Evaluation Resource”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS2005

Update on Rover Sequencing and Visualization Program

The Rover Sequencing and Visualization Program (RSVP) has been updated. RSVP was reported in Rover Sequencing and Visualization Program (NPO-30845), NASA Tech Briefs, Vol. 29, No. 4 (April 2005), page 38. To recapitulate: The Rover Sequencing and Visualization Program (RSVP) is the software tool to be used in the Mars Exploration Rover (MER) mission for planning rover operations and generating command sequences for accomplishing those operations. RSVP combines three-dimensional (3D) visualization for immersive exploration of the operations area, stereoscopic image display for high-resolution examination of the downlinked imagery, and a sophisticated command-sequence editing tool for analysis and completion of the sequences. RSVP is linked with actual flight code modules for operations rehearsal to provide feedback on the expected behavior of the rover prior to committing to a particular sequence. Playback tools allow for review of both rehearsed rover behavior and downlinked results of actual rover operations. These can be displayed simultaneously for comparison of rehearsed and actual activities for verification. The primary inputs to RSVP are downlink data products from the Operations Storage Server (OSS) and activity plans generated by the science team. The activity plans are high-level goals for the next day s activities. The downlink data products include imagery, terrain models, and telemetered engineering data on rover activities and state. The Rover Sequence Editor (RoSE) component of RSVP performs activity expansion to command sequences, command creation and editing with setting of command parameters, and viewing and management of rover resources. The HyperDrive component of RSVP performs 2D and 3D visualization of the rover s environment, graphical and animated review of rover predicted and telemetered state, and creation and editing of command sequences related to mobility and Instrument Deployment Device (robotic arm) operations. Additionally, RoSE and HyperDrive together evaluate command sequences for potential violations of flight and safety rules. The products of RSVP include command sequences for uplink that are stored in the Distributed Object Manager (DOM) and predicted rover state histories stored in the OSS for comparison and validation of downlinked telemetry. The majority of components comprising RSVP utilize the MER command and activity dictionaries to automatically customize the system for MER activities.

Cooper, Brian↗
NASA NTRS2005

Rover Sequencing and Visualization Program

The Rover Sequencing and Visualization Program (RSVP) is the software tool for use in the Mars Exploration Rover (MER) mission for planning rover operations and generating command sequences for accomplishing those operations. RSVP combines three-dimensional (3D) visualization for immersive exploration of the operations area, stereoscopic image display for high-resolution examination of the downlinked imagery, and a sophisticated command-sequence editing tool for analysis and completion of the sequences. RSVP is linked with actual flight-code modules for operations rehearsal to provide feedback on the expected behavior of the rover prior to committing to a particular sequence. Playback tools allow for review of both rehearsed rover behavior and downlinked results of actual rover operations. These can be displayed simultaneously for comparison of rehearsed and actual activities for verification. The primary inputs to RSVP are downlink data products from the Operations Storage Server (OSS) and activity plans generated by the science team. The activity plans are high-level goals for the next day s activities. The downlink data products include imagery, terrain models, and telemetered engineering data on rover activities and state. The Rover Sequence Editor (RoSE) component of RSVP performs activity expansion to command sequences, command creation and editing with setting of command parameters, and viewing and management of rover resources. The HyperDrive component of RSVP performs 2D and 3D visualization of the rover s environment, graphical and animated review of rover-predicted and telemetered state, and creation and editing of command sequences related to mobility and Instrument Deployment Device (IDD) operations. Additionally, RoSE and HyperDrive together evaluate command sequences for potential violations of flight and safety rules. The products of RSVP include command sequences for uplink that are stored in the Distributed Object Manager (DOM) and predicted rover state histories stored in the OSS for comparison and validation of downlinked telemetry. The majority of components comprising RSVP utilize the MER command and activity dictionaries to automatically customize the system for MER activities. Thus, RSVP, being highly data driven, may be tailored to other missions with minimal effort. In addition, RSVP uses a distributed, message-passing architecture to allow multitasking, and collaborative visualization and sequence development by scattered team members.

Cooper, Brian↗
NASA NTRS2012

Characterization of Turbulent Latent and Sensible Heat Flux Exchange Between the Atmosphere and Ocean in MERRA

Turbulent fluxes of heat and moisture across the atmosphere-ocean interface are fundamental components of the Earth's energy and water balance. Characterizing both the spatiotemporal variability and the fidelity of these exchanges of heat and moisture is critical to understanding the global water and energy cycle variations, quantifying atmosphere-ocean feedbacks, and improving model predictability. This study examines the veracity of the recently completed NASA Modern-Era Retrospective analysis for Research and Applications (MERRA) product with respect to its representation of the surface turbulent heat fluxes. A validation of MERRA turbulent heat fluxes and near-surface bulk variables at local, high-resolution space and time scales is achieved by making comparisons to a large suite of direct observations. Both in situ and satellite-observed gridded surface heat flux estimates are employed to investigate the spatial and temporal variability of the surface fluxes with respect to their annual mean climatologies, their seasonal covariability of near-surface bulk parameters, and their representation of extremes. The impact of data assimilation on the near-surface parameters is assessed through evaluation of incremental analysis update tendencies produced by the assimilation procedure. It is found that MERRA turbulent surface heat fluxes are relatively accurate for typical conditions but have systematically weak vertical gradients in moisture and temperature and have a weaker covariability between the near-surface gradients and wind speed than found in observations. This results in an underestimate of the surface latent and sensible heat fluxes over the western boundary current and storm track regions. The assimilation of observations mostly acts to bring MERRA closer to observational products by increasing moisture and temperature near the surface and decreasing the near-surface wind speeds. The major patterns of spatial and temporal variability of the turbulent heat fluxes produced by MERRA compare favorably to observationally based estimates. However, MERRA is distinct in terms of amplitude. These results suggest that MERRA is likely to be a valuable resource for a number of research applications though, as with all turbulent flux estimates, systematic issues should be taken into account

Robert, J. Brent↗
NASA NTRS2012

Characterization of Turbulent Latent and Sensible Heat Flux Exchange Between the Atmosphere and Ocean in MERRA

Turbulent fluxes of heat and moisture across the atmosphere-ocean interface are fundamental components of the Earth s energy and water balance. Characterizing both the spatiotemporal variability and the fidelity of these exchanges of heat and moisture is critical to understanding the global water and energy cycle variations, quantifying atmosphere-ocean feedbacks, and improving model predictability. This study examines the veracity of the recently completed NASA Modern-Era Retrospective analysis for Research and Applications (MERRA) product with respect to its representation of the surface turbulent heat fluxes. A validation of MERRA turbulent heat fluxes and near-surface bulk variables at local, high-resolution space and time scales is achieved by making comparisons to a large suite of direct observations. Both in situ and satellite-observed gridded surface heat flux estimates are employed to investigate the spatial and temporal variability of the surface fluxes with respect to their annual mean climatologies, their seasonal covariability of near-surface bulk parameters, and their representation of extremes. The impact of data assimilation on the near-surface parameters is assessed through evaluation of incremental analysis update tendencies produced by the assimilation procedure. It is found that MERRA turbulent surface heat fluxes are relatively accurate for typical conditions but have systematically weak vertical gradients in moisture and temperature and have a weaker covariability between the near-surface gradients and wind speed than found in observations. This results in an underestimate of the surface latent and sensible heat fluxes over the western boundary current and storm track regions. The assimilation of observations mostly acts to bring MERRA closer to observational products by increasing moisture and temperature near the surface and decreasing the near-surface wind speeds. The major patterns of spatial and temporal variability of the turbulent heat fluxes produced by MERRA compare favorably to observationally based estimates. However, MERRA is distinct in terms of amplitude. These results suggest that MERRA is likely to be a valuable resource for a number of research applications though, as with all turbulent flux estimates, systematic issues should be taken into account.

Roberts, J. Brent↗
DOE OSTI2022

U.S. Department of Energy: National Virtual Biotechnology Laboratory (Technical Report)

With funding from the CARES Act, the U.S Department of Energy (DOE) established the National Virtual Biotechnology Laboratory (NVBL) in March 2020 to address key challenges associated with the COVID-19 crisis. The NVBL brought together the broad scientific and technical expertise and resources of DOE’s 17 national laboratories to help tackle medical supply shortages, discover potential drugs to fight the virus, develop and validate COVID-19 testing methods, model disease spread and impact across the nation, and understand virus transport in buildings and the environment. National laboratory resources leveraged for this effort include a suite of world-leading user facilities broadly available to the research community, such as light and neutron sources, nanoscale science research centers, sequencing and biocharacterization facilities, and high-performance computing facilities. As part of the NVBL framework, DOE rapidly assembled five project teams to (1) identify new targets for medical therapeutics; (2) develop innovations in testing capabilities; (3) provide epidemiological and logistical support; (4) understand viral fate and transport in the environment; and (5) address supply chain bottlenecks by harnessing extensive additive manufacturing capabilities. Each research team was charged with defining high-impact projects that could be completed in a 6-month sprint while coordinating their developments with academia, other government agencies, and the private sector. Within months, NVBL teams used DOE’s high-performance computers and light and neutron sources to identify promising candidates for antibodies and antivirals that universities and drug companies are now evaluating. NVBL researchers also developed new diagnostic targets and sample collection approaches, and supported efforts by the U.S. Food and Drug Administration, Centers for Disease Control and Prevention, and U.S. Department of Defense to establish national guidelines used in administering millions of tests. Researchers used artificial intelligence and high-performance computing to produce near-real-time data analysis to forecast disease transmission, stress on public health infrastructure, and economic impact, which supported decision-makers at the local, state, and national levels. To minimize virus uptake and protect human health, NVBL teams studied how to control indoor virus movement. Researchers also produced innovations in materials and advanced manufacturing that mitigated shortages in test kits and personal protective equipment, creating nearly 1,000 new jobs. Through its NVBL framework, DOE has contributed significantly to the nation’s COVID response, demonstrating in only a few months the critical impact of its national laboratories. NVBL’s accomplishments demonstrate not only the powerful resource represented by DOE’s national laboratories working together to meet national needs, but also the effectiveness of the integrated NVBL framework for rapidly responding to emergencies with research and development solutions. Going forward, the NVBL is poised to apply the unique capabilities and expertise of the national laboratory complex to future national and international emergencies, both natural and engineered. Through this framework, DOE will continue to be an integral component of agency-wide efforts to prepare for and respond to biorisks and other crises. This technical report describes the goals, progress, and results of NVBL’s five project teams—Molecular Design for COVID-19 Therapeutics, COVID-19 Testing, Epidemiological Modeling, Viral Fate and Transport, and Materials and Manufacturing of Critical Supplies—and lists each team’s publications and research output.

42 ENGINEERING↗
NASA NTRS2011

NASA's UAS NAS Access Project

The vision of the Unmanned Aircraft System (UAS) Integration in the National Airspace System (NAS) Project is "A global transportation system which allows routine access for all classes of UAS." The goal of the UAS Integration in the NAS Project is to "contribute capabilities that reduce technical barriers related to the safety and operational challenges associated with enabling routine UAS access to the NAS." This goal will be accomplished through a two-phased approach based on development of system-level integration of key concepts, technologies and/or procedures, and demonstrations of integrated capabilities in an operationally relevant environment. Phase 1 will take place the first two years of the Project and Phase 2 will take place the following three years. The Phase 1 and 2 technical objectives are: Phase 1: Developing a gap analysis between current state of the art and the Next Generation Air Transportation System (NextGen) UAS Concept of Operations . Validating the key technical areas identified by this Project . Conducting initial modeling, simulation, and flight testing activities . Completing Sub-project Phase 1 deliverables (spectrum requirements, comparative analysis of certification methodologies, etc.) and continue Phase 2 preparation (infrastructure, tools, etc.) Phase 2: Providing regulators with a methodology for developing airworthiness requirements for UAS, and data to support development of certifications standards and regulatory guidance . Providing systems-level, integrated testing of concepts and/or capabilities that address barriers to routine access to the NAS. Through simulation and flight testing, address issues including separation assurance, communications requirements, and human systems integration in operationally relevant environments. The UAS in the NAS Project will demonstrate solutions in specific technology areas, which will address operational/safety issues related to UAS access to the NAS. Since the resource allocation for this Project is limited ($150M over the five years), the focus is on reducing the technical barriers where NASA has unique capabilities. As a result, technical areas, such as Sense and Avoid (SAA) and beyond line of sight command and control will not be addressed. While these are critical barriers to UAS access, currently, there is a great deal of global effort being exercised to address these challenge areas. Instead, specific technology development in areas where there is certainty that NASA can advance the research to high technology readiness levels will be the Project's focus. Specific sub-projects include Separation Assurance, Human Systems Integration, Communications, Certification, and Integrated Test and Evaluation. Each sub-project will transfer technologies to relevant key stakeholders and decision makers through research transition teams, technology forums, or through other analogous means.

Johnson, Charles W.↗
DOE OSTI2026

Integrative Modeling and Analysis of Fungal Central Carbon Metabolism

Over a thousand fungal genomes have been sequenced, yet manually curated genome-scale metabolic models (GEMs) are available for only a limited number of species. Moreover, these models have often been developed independently, leading to inconsistencies in namespaces, compartment definitions, and pathway representations that hinder comparative analysis, the systematic reuse of prior curation efforts, and the integration of consolidated metabolic knowledge. Here, we present the Consolidated Fungal Core Metabolism Model (CFCMM), constructed by integrating thirteen published fungal models spanning Ascomycota, Mucoromycota, and both Crabtree-positive and Crabtree-negative yeasts. We harmonized metabolites and reactions into a non-redundant shared ModelSEED ontological space, standardized compartmentalization, and refined gene–protein–reaction (GPR) rules. Using pathway-level visualization and systematic gap detection, we further improved the integrated network through literature-guided curation to correct stoichiometry, stereospecificity, and pathway architecture. Orthologous protein family reconstruction and functional annotation workflows were used to validate and inform GPR associations, with particular emphasis on ambiguous enzyme superfamilies and membrane-associated components. Using the resulting CFCMM, we built high-quality central carbon core models for each fungus and performed flux balance analysis to quantify ATP-yield variation under aerobic and anaerobic conditions, explicitly evaluating scenarios driven by differences in electron transport chain (ETC) composition. Simulations reproduced the expected fermentative yield of approximately 2 mmol ATP per mmol glucose under anaerobic conditions and separated the thirteen fungi into two bioenergetic groups under aerobic respiration based on Complex I status, with predicted yields of approximately 30 versus 22 mmol ATP per mmol glucose. Forcing flux through the alternative oxidase bypass further reduced ATP yields to approximately 12 and 4 mmol ATP per mmol glucose in Complex I-containing and Complex I-lacking fungi, respectively. Collectively, this work provides a manually curated, ModelSEED-consistent, and extensible fungal core metabolic template, deployed in DOE KBase as a resource for automated reconstruction of central carbon core models from any sequenced fungal genome. In addition, the CFCMM provides modular components for developing GEMs with more accurate energy predictions and enables robust comparative analyses of fungal bioenergetics and core metabolic diversity

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Assessing data change in scientific datasets

Summary Scientific datasets are growing rapidly and becoming critical to next‐generation scientific discoveries. The validity of scientific results relies on the quality of data used and data are often subject to change, for example, due to observation additions, quality assessments, or processing software updates. The effects of data change are not well understood and difficult to predict. Datasets are often repeatedly updated and recomputing derived data products quickly becomes time consuming and resource intensive and may in some cases not even be necessary, thus delaying scientific advance. Despite its importance, there is a lack of systematic approaches for best comparing data versions to quantify the changes, and ad‐hoc or manual processes are commonly used. In this article, we propose a novel hierarchical approach for analyzing data changes, including real‐time (online) and offline analyses. We employ a variety of fast‐to‐compute numerical analyses, graphical data change representations, and more resource‐intensive recomputations of a subset of the data product. We illustrate the application of our approach using three scientific diverse use cases, namely, satellite, cosmological, and x‐ray data. The results show that a variety of data change metrics should be employed to enable a comprehensive representation and qualitative evaluation of data changes.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Data-driven Community-centered Resilient Assessment and Planning Toolkit for Nexus of Energy and Water (DCRAPT-NEW)

Urban areas, including Detroit and Pittsburgh, have suffered significant dual outages of the electrical and water infrastructure in the past decade due, in part, to the increasing number of extreme weather events. With increasing temperatures and rainfall intensity, these regions need to prepare for increasing extreme events through community-based energy and water resilience analysis, planning, and enhancement. This project developed a suite of open-source, open-access, community-centered, data-driven assessment and distributed energy resource (DER) and planning tools for energy and water resilience enhancement in urban areas. Through establishing a multi-level community awareness and engagement mechanism and a comprehensive collection of power outage and flooding data, an innovative group of community energy and water resilience assessment and planning tools have been developed for a wide range of users with differing and variable sets of data available to them. The developed tools include (1) DOE EAGLE-I data-driven, deep-learning assisted resilience assessment and DER planning tools at the county level with socioeconomic factors incorporated; (2) Utility annual power outage data-driven tools for long term resilience assessment and DER planning and 15-min power outage data-driven tools for short term resilience assessment and planning; (3) Detailed engineering tools for energy and water systems resilience assessment and planning when the system topology and component fragility curves are available; (4) Alternative Resiliency Metric Calculation that extracts and separates outage and restoration processes; and (5) Co-optimization tools that evaluate the resilience of the power and sewage system and allow users to conduct joint planning with energy and wastewater systems. The developed tools provide planners, decision-makers, and stakeholders with powerful capabilities to systematically evaluate system/community resilience and optimal and actionable guidance for enhancing resilience while prioritizing DER investments. The tools have been used and validated in Detroit and Pittsburgh and can be used in other areas of the nation. In addition, this project will (1) advance the knowledge and applications of machine-learning methods in analyzing and fusing different layers of information and generating meaningful data points such as generating rare weather events; (2) significantly improve the energy and water resilience of the identified communities in Detroit and Pittsburgh and prepare for more frequent and severe weather conditions; (3) help communities assess extreme weather event impacts and address short-term and long-term resilience-related issues The developed tools have been made public via GitHub and demonstrated to community stakeholders and utility companies via the two annual workshops and numerous community engagement meetings. The project outcomes are also disseminated through publications in various journals and conference proceedings, and presentations at top conferences.

13 HYDRO ENERGY↗
NASA NTRS2009

An Analysis of Rocket Propulsion Testing Costs

The primary mission at NASA Stennis Space Center (SSC) is rocket propulsion testing. Such testing is generally performed within two arenas: (1) Production testing for certification and acceptance, and (2) Developmental testing for prototype or experimental purposes. The customer base consists of NASA programs, DOD programs, and commercial programs. Resources in place to perform on-site testing include both civil servants and contractor personnel, hardware and software including data acquisition and control, and 6 test stands with a total of 14 test positions/cells. For several business reasons there is the need to augment understanding of the test costs for all the various types of test campaigns. Historical propulsion test data was evaluated and analyzed in many different ways with the intent to find any correlation or statistics that could help produce more reliable and accurate cost estimates and projections. The analytical efforts included timeline trends, statistical curve fitting, average cost per test, cost per test second, test cost timeline, and test cost envelopes. Further, the analytical effort includes examining the test cost from the perspective of thrust level and test article characteristics. Some of the analytical approaches did not produce evidence strong enough for further analysis. Some other analytical approaches yield promising results and are candidates for further development and focused study. Information was organized for into its elements: a Project Profile, Test Cost Timeline, and Cost Envelope. The Project Profile is a snap shot of the project life cycle on a timeline fashion, which includes various statistical analyses. The Test Cost Timeline shows the cumulative average test cost, for each project, at each month where there was test activity. The Test Cost Envelope shows a range of cost for a given number of test(s). The supporting information upon which this study was performed came from diverse sources and thus it was necessary to build several intermediate databases in order to understand, validate, and manipulate data. These intermediate databases (validated historical account of schedule, test activity, and cost) by themselves are of great value and utility. For example, for the Project Profile, we were able to merged schedule, cost, and test activity. This kind of historical account conveys important information about sequence of events, lead time, and opportunities for improvement in future propulsion test projects. The Product Requirement Document (PRD) file is a collection of data extracted from each project PRD (technical characteristics, test requirements, and projection of cost, schedule, and test activity). This information could help expedite the development of future PRD (or equivalent document) on similar projects, and could also, when compared to the actual results, help improve projections around cost and schedule. Also, this file can be sorted by the parameter of interest to perform a visual review of potential common themes or trends. The process of searching, collecting, and validating propulsion test data encountered a lot of difficulties which then led to a set of recommendations for improvement in order to facilitate future data gathering and analysis.

Ramirez-Pagan, Carmen P.↗
DOE OSTI2023

Seasonal forecasting skill for the High Mountain Asia region in the Goddard Earth Observing System

Seasonal variability of the global hydrologic cycle directly impacts human activities, including hazard assessment and mitigation, agricultural decisions, and water resources management. This is particularly true across the High Mountain Asia (HMA) region, where availability of water resources can change depending on local seasonality of the hydrologic cycle. Forecasting the atmospheric states and surface conditions, including hydrometeorologically relevant variables, at subseasonal-to-seasonal (S2S) lead times of weeks to months is an area of active research and development. NASA's Goddard Earth Observing System (GEOS) S2S prediction system has been developed with this research goal in mind. Here, we benchmark the forecast skill of GEOS-S2S (version 2) hydrometeorological forecasts at 1–3-month lead times in the HMA region, including a portion of the Indian subcontinent, during the retrospective forecast period, 1981–2016. To assess forecast skill, we evaluate 2 m air temperature, total precipitation, fractional snow cover, snow water equivalent, surface soil moisture, and terrestrial water storage forecasts against the Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2) and independent reanalysis data, satellite observations, and data fusion products. Anomaly correlation is highest when the forecasts are evaluated against MERRA-2 and particularly in variables with long memory in the climate system, likely due to the similar initial conditions and model architecture used in GEOS-S2S and MERRA-2. When compared to MERRA-2, results for the 1-month forecast skill range from an anomaly correlation of R anom =0.18 for precipitation to R anom =0.62 for soil moisture. Anomaly correlations are consistently lower when forecasts are evaluated against independent observations; results for the 1-month forecast skill range from R anom =0.13 for snow water equivalent to R anom =0.24 for fractional snow cover. We find that, generally, hydrometeorological forecast skill is dependent on the forecast lead time, the memory of the variable within the physical system, and the validation dataset used. Overall, these results benchmark the GEOS-S2S system's ability to forecast HMA hydrometeorology.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2023

Seasonal Forecasting Skill for the High Mountain Asia Region in the Goddard Earth Observing System

Seasonal variability of the global hydrologic cycle directly impacts human activities, including hazard assessment and mitigation, agricultural decisions, and water resources management. This is particularly true across the High Mountain Asia (HMA) region, where availability of water resources can change depending on local seasonality of the hydrologic cycle. Forecasting the atmospheric states and surface conditions, including hydrometeorological relevant variables, at subseasonal-to-seasonal (S2S) lead times of weeks-to-months is an area of active research and development. NASA’s 15 Goddard Earth Observing System (GEOS) S2S prediction system has been developed with this research goal in mind. Here, we benchmark the forecast skill of GEOS-S2S (version 2) hydrometeorological forecasts at 1-3 month lead times in the HMA region, including a portion of the Indian Subcontinent, during the retrospective forecast period, 1981-2016. To assess forecast skill, we evaluate 2-m air temperature, total precipitation, fractional snow cover, snow water equivalent, surface soil moisture, and terrestrial water storage forecasts against the Modern-Era Retrospective analysis for Research and 20 Applications, Version 2 (MERRA-2) and independent reanalysis data, satellite observations, and data fusion products. Anomaly correlation is highest when the forecasts are evaluated against MERRA-2 and particularly in variables with long memory in the climate system, likely due to similar initial conditions and model architecture used in GEOS-S2S and MERRA-2. When compared to MERRA-2, results for the 1-month forecast skill range from anomaly correlation of R anom =0.18 for precipitation to R anom =0.62 for soil moisture. Anomaly correlations are consistently lower when forecasts are 25 evaluated against independent observations; results for the 1-month forecast skill range from R anom =0.13 for snow water equivalent to R anom =0.24 for fractional snow cover. We find that, generally, hydrometeorological forecast skill is dependent on the forecast lead time, the memory of the variable within the physical system, and the validation dataset used. Overall, these results benchmark the GEOS-S2S system’s ability to forecast HMA hydrometeorology.

GEOS↗
NASA NTRS2006

Solutions Network Formulation Report. Integration of OMI and TES Aerosol Products into the EPA Regional Planning Organizations' FASTNET Aerosol Tracking and Analysis Tool

Every year, more than 280 million visitors tour our Nation s most treasured parks and wilderness areas. Unfortunately, many visitors are unable to see the spectacular vistas they expect because of white or brown haze in the air. Most of this haze is not natural; it is air pollution, carried by the wind often hundreds of miles from its origin. Some of the pollutants have been linked to serious health problems, such as asthma and other lung disorders, and even premature death. In addition, nitrates and sulfates contribute to acid rain formation, which contaminates rivers and lakes and erodes buildings and historical monuments. The U.S. Environmental Protection Agency RPOs (Regional Planning Organizations) have been tasked with monitoring and determining the nature and origin of haze in Class I scenic areas, and finding ways to reduce haze in order to improve visibility in these areas. The RPOs have developed an Internet-based air quality DST (Decision Support Tool) called FASTNET (Fast Aerosol Sensing Tools for Natural Event Tracking). While FASTNET incorporates a few satellite datasets, most of the data utilized by this DST comes from ground-based instrument networks. The problem is that in many areas the sensors are sparsely located, with long distances between them, causing difficulties in tracking haze over the United States, determining its source, and analyzing its content. Satellite data could help to fill in the data gaps and to supplement and verify ground-recorded air quality data. Although satellite data are now being used for air quality research applications, such data are not routinely used for environmental decision support, in part because of limited resources, difficulties with interdisciplinary data interpretation, and the need for advanced inter-agency partnerships. As a result, the validation and verification of satellite data for air quality operational system applications has been limited This candidate solution evaluates the usefulness of OMI (Ozone Monitoring Instrument) and TES (Tropospheric Emission Spectrometer) air quality data for the RPOs by comparing OMI and TES data with ground-based data that are acquired during identified episodes of air pollution. The air quality data from OMI and TES are of different spectral ranges than data from satellites currently included in FASTNET, giving them potential advantages over the existing satellites. If the OMI and TES data are shown to be useful to the RPOs, they would then be integrated into the FASTNET DST for use on an operational basis.

Knowlton, Kelly↗
DOE OSTI2024

Advanced Laboratory and Field Arrays (ALFA)/Lab Collaboration Project (LCP) for Marine Energy (Final Scientific/Technical Report)

The objective of the Advanced Laboratory and Field Arrays (ALFA) project was to reduce the Levelized Cost of Energy (LCOE) of Marine and Hydrokinetic (MHK) energy by leveraging research, development, and testing capabilities at Oregon State University, University of Washington, and the University of Alaska, Fairbanks. ALFA is a project within the Pacific Marine Energy Center (PMEC; formerly NNMREC), a multi-institution entity with a diverse funding base that focuses on research and development for marine renewables. The ALFA project aimed to accelerate the development of next-generation arrays of wave energy conversion (WEC) and tidal energy conversion (TEC) devices through a suite of field-focused R&D activities spanning a broad range of strategic opportunity areas identified in the Funding Opportunity Announcement: • Device and/or array operation and maintenance (O&M) logistics development; • High-fidelity resource characterization and/or modeling technique development and validation; • Array-specific component technology development (e.g. moorings and foundations, transmission, and other offshore grid components); • Array performance testing and evaluation; and • Novel cost-effective environmental monitoring techniques and instrumentation testing and evaluation. The objective of the Lab Collaboration Project (LCP) was to accelerate the development of next-generation marine energy conversion systems. The LCP aimed to achieve these project objectives in collaboration with the national laboratories by: • Developing concept generation and assessment tools; • Improving access to existing testing resources; • Validating collision risk models between fish and turbines; and • Advancing analysis and simulation capabilities for wave-WEC interactions and PTO analysis in nonlinear ocean waves. The ALFA portion of the project was comprised of six overarching technical tasks: • Task 1: Debris Modeling, Detection and Mitigation; • Task 2: Autonomous Monitoring & Intervention; • Task 3: Resource Characterization for Extreme Conditions; • Task 4: Robust Models for Design of Offshore Anchoring and Mooring Systems; • Task 5: Performance Enhancement for Marine Energy Converter (MEC) Arrays; and • Task 6: Evaluating Sampling Techniques for MHK Biological Monitoring. The LCP was divided into four overarching technical tasks: • Task 7: Project Management and Reporting • Task 8: Novel Design and Assessment Methodologies for Wave Energy Converter Design (Wave- SPARC) • Task 9: Testing Access for Commercial Marine Renewable Energy Technology Developers • Task 10: Quantifying Collision Risk for Fish and Turbines • Task 11: Nonlinear Ocean Waves and PTO Control Strategy Each ALFA/LCP task listed above functioned as a separate and discreet project. A final Technical Report was written for each individual task and these reports were uploaded to OSTI, after receiving DOE approval. The following document is a compilation of each of these final, approved reports arranged as individual chapters.

13 HYDRO ENERGY↗
DOE OSTI2022

High-Resolution Wind Resource Data Set of the Greater Puerto Rico Region

In February 2022, the U.S. Department of Energy and six national laboratories launched the Puerto Rico Grid Resilience and Transitions to 100% Renewable Energy Study (PR100). PR100 aims to provide a comprehensive analysis of possible pathways for Puerto Rico's energy future, with a goal of 100% renewable energy by 2050. As a part of the renewable energy potential assessment in this project, we developed 20 years (2001-2020) of data using a numerical weather prediction (NWP) model for onshore and offshore wind resource assessment for the Puerto Rico. The research steps in developing the long-term wind resource data sets based on the NWP model were: 1. Model wind resource based on the Weather Research and Forecasting (WRF) model. 2. Develop WRF model configurations for Puerto Rico. 3. Test WRF with 11 different physics parameterizations for planetary boundary layer (PBL). 4. Assess WRF output from the different PBL schemes against observations. 5. Select a final model configuration which can produce the modeled wind speed with sufficient accuracy. 6. Produce 20 years wind resource data sets for Puerto Rico region. In the first stage of our framework for developing wind resource data, we developed a WRF model configuration using two nested domains (9 km and 3 km) to cover Puerto Rico and U.S. Virgin Islands and downscale the ERA5 reanalysis data (0.25 degrees x 0.25 degrees; hourly interval) to a 3-km domain. For the second stage, we implemented one-year simulations focused on using 11 different PBL physics parameterizations to find a combination of WRF physics parameterizations that could provide accurately modeled wind speed for Puerto Rico. We also analyzed the sensitivity of the modeled wind speed to PBL schemes for onshore and offshore locations. The WRF output resulting from the 11 WRF experiments using different PBL parameterizations were evaluated against observations obtained from the National Data Buoy Center (NDBC) as well as at hub height for a location for which measurements were available. A final model setup selected through the validation with observational data was used to produce 20 years of data with 3-km spatial and 5-minute temporal resolution. The WRF model output was post-processed to include wind profiles and basic atmospheric variables in a format that can be easily used for downstream modeling. The 20 years of wind resource data will be made available through NREL and support the estimation of wind energy development costs for the PR100 study.

17 WIND ENERGY↗
DOE OSTI2023

Computationally Accelerated Discovery and Experimental Demonstration of High-Performance Materials for Advanced Solar Thermochemical Hydrogen Production

This project achieved its overarching goal of accelerating the discovery and validation of solar thermochemical hydrogen (STCH) materials through a tightly integrated approach that combined high-throughput computational screening, advanced machine learning (ML), and experimental testing. Guided by the objectives outlined in the Statement of Project Objectives (SOPO), our work fulfilled all major milestones across four technical tasks and delivered scientific breakthroughs and practical tools that significantly exceeded the original scope of the project. We began by addressing the challenge of predicting material phase stability through machine learning. A novel Python module was developed to generate thousands of meaningful features from composition, structure, and electronic properties, enabling rapid and reproducible ML model development. Using these tools, we trained a model to predict temperature-dependent Gibbs energies (G(T)) for inorganic crystalline materials with near-chemical accuracy—roughly 40 meV/atom—marking the first such descriptor of its kind. We also introduced a new machine-learned tolerance factor, τ, that accurately predicted perovskite formability with over 90% success, outperforming traditional heuristic models, such as the Goldschmidt tolerance factor. These capabilities allowed for rapid and accurate predictions of phase stability across a vast oxide composition space, setting the stage for high-throughput thermodynamic screening. Building on this foundation, we conducted an extensive computational screening of candidate STCH oxide materials. Over 1.1 million perovskite compositions were evaluated using the τ descriptor, leading to the identification of more than 27,000 predicted stable structures. Using density functional theory (DFT), we refined over 68,000 multinary perovskite structures and computed oxygen vacancy formation energies for over 1,300 ternary and double perovskites. These calculations enabled us to isolate compounds with redox behavior consistent with STCH requirements and resulted in a public dataset now hosted on the Materials Project. Recognizing that thermodynamic screening alone is insufficient, we addressed kinetic limitations by developing a suite of tools to estimate transition state (TS) energies for key redox reactions. We implemented a novel bounding approach that provides lower and upper estimates of TS energies with dramatically reduced computational cost, requiring less than 10% of the CPU time of a full nudged elastic band (NEB) calculation while maintaining high accuracy. This enabled rapid evaluation of over 200 reaction pathways across 90 materials. To further accelerate screening, we developed a SISSO-based ML model to predict diffusion barriers with a 96.7% success rate in classifying fast vs. slow materials, supporting a robust, data-driven framework for assessing redox kinetics. Experimental validation was critical to confirming the predictive power of our models. We synthesized and tested a wide array of candidate materials, including Mn-doped hercynite and several Gd- and La-based perovskites. Notably, Sr 0.4 Gd 0.6 Mn 0.6 Al 0.4 O 3 (SGMA) and Gd 0.5 La 0.5 Co 0.5 Fe 0.5 O 3 (GLCF) emerged as leading STCH materials, exhibiting robust redox cycling and high hydrogen yields exceeding 150 µmol H 2 /g per cycle. These materials also retained over 50% of their hydrogen productivity under high-conversion conditions (H 2 O:H 2 = 1333:1), demonstrating strong thermodynamic favorability and promising performance under industrially relevant scenarios. Additional candidates, such as La 2 MnNiO 6 (L2MN), were found to produce even higher yields than ceria under standard STCH conditions. Our collaborators at Sandia National Laboratories confirmed these findings using high-temperature X-ray diffraction and thermogravimetric analysis, observing stable phase evolution and reversible redox activity. In several respects, the project went beyond the goals initially outlined in the SOPO. We published 17 peer-reviewed articles, including a large dataset of over 66,000 theoretical perovskites and a new structure prediction method (SPuDS-DFT) that accurately identifies ground-state structures at a fraction of the cost of traditional DFT. We demonstrated that our machine-learned G(T) model offers accuracy rivaling quasiharmonic calculations while being orders of magnitude faster. In partnership with the Materials Project, we made our datasets openly available, providing a powerful new resource for the broader materials science community. The combined computational and experimental advances of this project represent a significant advance in STCH materials discovery. By creating a robust, generalizable, and open workflow for thermodynamic and kinetic screening, and validating key findings through synthesis and reactor testing, we have provided a practical and scalable pathway for the rapid identification of new redox-active materials. The tools, data, and materials developed under this project are already supporting ongoing research and have laid the groundwork for the next generation of solar fuel technologies.

08 HYDROGEN↗
NASA NTRS2015

The Suomi National Polar-Orbiting Partnership (SNPP): Continuing NASA Research and Applications

The Suomi National Polar-orbiting Partnership (SNPP) satellite was successfully launched into a polar orbit on October 28, 2011 carrying 5 remote sensing instruments designed to provide data to improve weather forecasts and to increase understanding of long-term climate change. SNPP provides operational continuity of satellite-based observations for NOAA's Polar-orbiting Operational Environmental Satellites (POES) and continues the long-term record of climate quality observations established by NASA's Earth Observing System (EOS) satellites. In the 2003 to 2011 pre-launch timeframe, NASA's SNPP Science Team assessed the adequacy of the operational Raw Data Records (RDRs), Sensor Data Records (SDRs), and Environmental Data Records (EDRs) from the SNPP instruments for use in NASA Earth Science research, examined the operational algorithms used to produce those data records, and proposed a path forward for the production of climate quality products from SNPP. In order to perform these tasks, a distributed data system, the NASA Science Data Segment (SDS), ingested RDRs, SDRs, and EDRs from the NOAA Archive and Distribution and Interface Data Processing Segments, ADS and IDPS, respectively. The SDS also obtained operational algorithms for evaluation purposes from the NOAA Government Resource for Algorithm Verification, Independent Testing and Evaluation (GRAVITE). Within the NASA SDS, five Product Evaluation and Test Elements (PEATEs) received, ingested, and stored data and performed NASA's data processing, evaluation, and analysis activities. The distributed nature of this data distribution system was established by physically housing each PEATE within one of five Climate Analysis Research Systems (CARS) located at either at a NASA or a university institution. The CARS were organized around 5 key EDRs directly in support of the following NASA Earth Science focus areas: atmospheric sounding, ocean, land, ozone, and atmospheric composition products. The PEATES provided the system level interface with members of the NASA SNPP Science Team and other science investigators within each CARS. A sixth Earth Radiation Budget CARS was established at NASA Langley Research Center (NASA LaRC) to support instrument performance, data evaluation, and analysis for the SNPP Clouds and the Earth's Radiant Budget Energy System (CERES) instrument. Following the 2011 launch of SNPP, spacecraft commissioning, and instrument activation, the NASA SNPP Science Team evaluated the operational RDRs, SDRs, and EDRs produced by the NOAA ADS and IDPS. A key part in that evaluation was the NASA Science Team's independent processing of operational RDRs and SDRs to EDRs using the latest NASA science algorithms. The NASA science evaluation was completed in the December 2012 to April 2014 timeframe with the release of a series of NASA Science Team Discipline Reports. In summary, these reports indicated that the RDRs produced by the SNPP instruments were of sufficiently high quality to be used to create data products suitable for NASA Earth System science and applications. However, the quality of the SDRs and EDRs were found to vary greatly when considering suitability for NASA science. The need for improvements in operational algorithms, adoption of different algorithmic approaches, greater monitoring of on-orbit instrument calibration, greater attention to data product validation, and data reprocessing were prominent findings in the reports. In response to these findings, NASA, in late 2013, directed the NASA SNPP Science Team to use SNPP instrument data to develop data products of sufficiently high quality to enable the continuation of EOS time series data records and to develop innovative, practical applications of SNPP data. This direction necessitated a transition of the SDS data system from its pre-launch assessment mode to one of full data processing and production. To do this, the PEATES, which served as NASA's data product testing environment during the prelaunch and early on-orbit periods, were transitioned to Science Investigator-led Processing Systems (SIPS). The distributed data architecture was maintained in this new system by locating the SIPS at the same institutions at which the CARS and PEATES were located. The SIPS acquire raw SNPP instrument Level 0 (i.e. RDR) data over the full SNPP mission from the NOAA ADS and IDPS through the NASA SDS Data Distribution and Depository Element (SD3E). The SIPS process those data into NASA Level 1, Level 2, and global, gridded Level 3 standard products using peer-reviewed algorithms provided by members of the NASA Science Team. The SIPS work with the NASA SNPP Science Team in obtaining enhanced, refined, or alternate real-time algorithms to support the capabilities of the Direct Readout Laboratory (DRL). All data products, algorithm source codes, coefficients, and auxiliary data used in product generation are archived in an assigned NASA Distributed Active Archive Center (DAAC).

remote sensing↗
DOE OSTI2026

Systematic Benchmarking of Climate Models: Methodologies, Applications, and New Directions

As climate models become increasingly complex, there is a growing need to comprehensively and systematically assess model performance with respect to observations. Given the increasing number and diversity of climate model simulations in use, the community has moved beyond simple model intercomparison and toward developing methods capable of benchmarking a large number of simulations against a suite of climate metrics. Here, we present a detailed review of evaluation and benchmarking methods and approaches developed in the last decade, focusing primarily on scientific implications for Coupled Model Intercomparison Project (CMIP) simulations and CMIP6 results that contributed to the Intergovernmental Panel on Climate Change (IPCC) Sixth Assessment Report (AR6). Based on this review, we explain the resulting contemporary philosophy of model benchmarking, and provide clear distinctions and definitions of the terms model verification, process validation, evaluation, and benchmarking. While significant progress has been made in model development based on systematic evaluation and benchmarking efforts, some climate system biases still remain. The development of open‐source community software packages has played a fundamental role in identifying areas of significant model improvement and bias reduction. We review the key features of several software packages that have been commonly used over the past decade to evaluate and benchmark global and regional climate models. Additionally, we discuss best practices for the selection of evaluation and benchmarking metrics and for interpreting the obtained results, the importance of selecting suitable sources of reference data and accurate uncertainty quantification.

Environmental sciences↗