SEARCH · Engineering Papers

Results for “Needs Assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51

All sources NASA NTRS DOE OSTI

NASA NTRS1984

A view of future technology needs for space transportation

This paper addresses an independent assessment of space transportation requirements within the NASA and Military Space Systems Technology Models. A critical examination is made of the system needs of the various flight elements with the models as compared to independent technology forecasts and possible technology deficiencies are discussed. These deficits impact the requisite developments needed for chemical propulsion, thermal protection systems, fuel cells, guidance, avionics and data processing for both launch vehicles and orbital transfer vehicles. Also addressed are potential alternative propellant technologies and their impact upon transfer vehicle systems. The primary focus of these anticipated technology developments will be to reduce operational costs, expand flexibility, and increase the payload capability of space transportation.

Gartrell, C. F.↗

NASA NTRS1980

Titan probe technology assessment and technology development plan study

The need for technology advances to accomplish the Titan probe mission was determined by defining mission conditions and requirements and evaluating the technology impact on the baseline probe configuration. Mission characteristics found to be technology drivers include (1) ten years dormant life in space vacuum; (2) unknown surface conditions, various sample materials, and a surface temperature; and (3) mission constraints of the Saturn Orbiter Dual Probe mission regarding weight allocation. The following areas were identified for further development: surface sample acquisition system; battery powered system; nonmetallic materials; magnetic bubble memory devices, and the landing system. Preentry science, reliability, and weight reduction and redundancy must also be considered.

Castro, A. J.↗

NASA NTRS2000

The Spacecraft Materials Selector: An Artificial Intelligence System for Preliminary Design Trade Studies, Materials Assessments, and Estimates of Environments Present

Institutions need ways to retain valuable information even as experienced individuals leave an organization. Modern electronic systems have enough capacity to retain large quantities of information that can mitigate the loss of experience. Performance information for long-term space applications is relatively scarce and specific information (typically held by a few individuals within a single project) is often rather narrowly distributed. Spacecraft operate under severe conditions and the consequences of hardware and/or system failures, in terms of cost, loss of information, and time required to replace the loss, are extreme. These risk factors place a premium on appropriate choice of materials and components for space applications. An expert system is a very cost-effective method for sharing valuable and scarce information about spacecraft performance. Boeing has an artificial intelligence software package, called the Boeing Expert System Tool (BEST), to construct and operate knowledge bases to selectively recall and distribute information about specific subjects. A specific knowledge base to evaluate the on-orbit performance of selected materials on spacecraft has been developed under contract to the NASA SEE program. The performance capabilities of the Spacecraft Materials Selector (SMS) knowledge base are described. The knowledge base is a backward-chaining, rule-based system. The user answers a sequence of questions, and the expert system provides estimates of optical and mechanical performance of selected materials under specific environmental conditions. The initial operating capability of the system will include data for Kapton, silverized Teflon, selected paints, silicone-based materials, and certain metals. For situations where a mission profile (launch date, orbital parameters, mission duration, spacecraft orientation) is not precisely defined, the knowledge base still attempts to provide qualitative observations about materials performance and likely exposures. Prior to the NASA contract, a knowledge base, the Spacecraft Environments Assistant (SEA,) was initially developed by Boeing to estimate the environmental factors important for a specific spacecraft mission profile. The NASA SEE program has funded specific enhancements to the capability of this knowledge base. The SEA qualitatively identifies over 25 environmental factors that may influence the performance of a spacecraft during its operational lifetime. For cases where sufficiently detailed answers are provided to questions asked by the knowledge base, atomic oxygen fluence levels, proton and/or electron fluence and dose levels, and solar exposure hours are calculated. The SMS knowledge base incorporates the previously developed SEA knowledge base. A case history for previous flight experiment will be shown as an example, and capabilities and limitations of the system will be discussed.

Pippin, H. G.↗

NASA NTRS2009

X-48B Flight Research - Test Progress and Instrumentation Needs for the Future

Program Objectives: I. Assess stability & control characteristics of a BWB class vehicle in free-flight conditions: a) Assess dynamic interaction of control surfaces; b) Assess control requirements to accommodate asymmetric thrust; and c) Assess stability and controllability about each axis at a range of flight conditions. II. Assess flight control algorithms designed to provide desired flight characteristics: a) Assess control surface allocation and blending; b) Assess edge of envelope protection schemes; c) Assess takeoff and landing characteristics; and d) Test experimental control laws and control design methods III. Evaluate prediction and test methods for BWB class vehicles: a) Correlate flight measurements with ground-based predictions and measurements.

Risch, Tim↗

DOE OSTI2021

Making a Water Data System Responsive to Information Needs of Decision Makers

Evidence-based environmental management requires data that are sufficient, accessible, useful and used. A mismatch between data, data systems, and data needs for decision making can result in inefficient and inequitable capital investments, resource allocations, environmental protection, hazard mitigation, and quality of life. In this paper, we examine the relationship between data and decision making in environmental management, with a focus on water management. We focus on the concept of decision-driven data systems —data systems that incorporate an assessment of decision-makers' data needs into their design. The aim of the research was to examine the process of translating data into effective decision making by engaging stakeholders in the development of a water data system. Using California's legislative mandate for state agencies to integrate existing water and other environmental data as a case study, we developed and applied a participatory approach to inform data-system design and identify unmet data needs. Using workshops and focused stakeholder meetings, we developed 20 diverse use cases to assess data sources, availability, characteristics, gaps, and other attributes of data used for representative decisions. Federal and state agencies made up about 90% of the data sources, and could readily adapt to a federated data system, our recommended model for the state. The remaining 10% of more-specialized data, central to important decisions across multiple use cases, would require additional investment or incentives to achieve data consistency, interoperability, and compatibility with a federated system. Based on this assessment, we propose a typology of different types of data limitations and gaps described by stakeholders. We also propose technical, governance, and stakeholder engagement evaluation criteria to guide planning and building environmental data systems. Data-system governance involving both producers and users of data was seen as essential to achieving workable standards, stable funding, convenient data availability, resilience to institutional change, and long-term buy-in by stakeholders. Our work provides a replicable lesson for using decision-maker and stakeholder engagement to shape the design of an environmental data system, and inform a technical design that addresses both user and producer needs.

Cantor, Alida↗

NASA NTRS2019

Artificial Intelligence: Powering Human Exploration of the Moon and Mars

Artificial Intelligence (AI) is a growing field of computa- tional science techniques designed to mimic functions per- formed by people. Advancements in autonomy will depend on a portfolio of AI technologies. Automated planning and scheduling is a venerable field of study in AI, and is needed for a variety of mission planning functions. Plan execution technology is less well studied, but important for auton- omy and robotics. Specialized forms of automated reason- ing and machine learning are key technologies to enable fault management. Over the past decade, the NASA Au- tonomous Systems and Operations (ASO) project has devel- oped and demonstrated numerous autonomy enabling tech- nologies employing AI techniques. Our work has employed AI in three distinct ways to enable autonomous mission op- erations capabilities. Crew Autonomy gives astronauts tools to assist in the performance of each of these mission oper-ations functions. Vehicle System Management uses AI tech- niques to turn the astronaut's spacecraft into a robot, allow- ing it to operate when astronauts are not present, or to reduce astronaut workload. AI technology also enables Autonomous Robots as crew assistants or proxies when the crew are not present. When these capabilities are used to enable astro- nauts to operate autonomously, they must be integrated with user interfaces, introducing numerous human factors con- siderations; when these capabilities are used to enable vehi- cle system management, they must be integrated with flight software, and run on embedded processors under the control of real-time operating systems.We first describe human spaceflight mission operations capabilities. The remainder of the paper will describe the ASO project, and the development and demonstration per- formed by ASO since 2011. We will describe the AI tech- niques behind each of these demonstrations, which include a variety of symbolic automated reasoning and machine learn- ing based approaches. Finally, we conclude with an assess- ment of future development needs for AI to enable NASA's future Exploration missions.

Mission Operations↗

NASA NTRS2004

Access from Space: A New Perspective on NASA's Space Transportation Technology Requirements and Opportunities

The need for robust and reliable access from space is clearly demonstrated by the recent loss of the Space Shuttle Columbia; as well as the NASA s goals to get the Shuttle re-flying and extend its life, build new vehicles for space access, produce successful robotic landers and s a q k ret~rr? ~llisrions, and maximize the science content of ambitious outer planets missions that contain nuclear reactors which must be safe for re-entry after possible launch aborts. The technology lynch pin of access from space is hypersonic entry systems such the thermal protection system, along with navigation, guidance and control (NG&C). But it also extends to descent and landing systems such as parachutes, airbags and their control systems. Current space access technology maturation programs such as NASA s Next Generation Launch Technology (NGLT) program or the In-Space Propulsion (ISP) program focus on maturing laboratory demonstrated technologies for potential adoption by specific mission applications. A key requirement for these programs success is a suitable queue of innovative technologies and advanced concepts to mature, including mission concepts enabled by innovative, cross cutting technology advancements. When considering space access, propulsion often dominates the capability requirements, as well as the attention and resources. From the perspective of access from space some new cross cutting technology drivers come into view, along with some new capability opportunities. These include new miniature vehicles (micro, nano, and picosats), advanced automated systems (providing autonomous on-orbit inspection or landing site selection), and transformable aeroshells (to maximize capabilities and minimize weight). This paper provides an assessment of the technology drivers needed to meet future access from space mission requirements, along with the mission capabilities that can be envisioned from innovative, cross cutting access from space technology developments.

Rasky, Daniel J.↗

NASA NTRS1997

Existing and Required Modeling Capabilities for Evaluating ATM Systems and Concepts

ATM systems throughout the world are entering a period of major transition and change. The combination of important technological developments and of the globalization of the air transportation industry has necessitated a reexamination of some of the fundamental premises of existing Air Traffic Management (ATM) concepts. New ATM concepts have to be examined, concepts that may place more emphasis on: strategic traffic management; planning and control; partial decentralization of decision-making; and added reliance on the aircraft to carry out strategic ATM plans, with ground controllers confined primarily to a monitoring and supervisory role. 'Free Flight' is a case in point. In order to study, evaluate and validate such new concepts, the ATM community will have to rely heavily on models and computer-based tools/utilities, covering a wide range of issues and metrics related to safety, capacity and efficiency. The state of the art in such modeling support is adequate in some respects, but clearly deficient in others. It is the objective of this study to assist in: (1) assessing the strengths and weaknesses of existing fast-time models and tools for the study of ATM systems and concepts and (2) identifying and prioritizing the requirements for the development of additional modeling capabilities in the near future. A three-stage process has been followed to this purpose: 1. Through the analysis of two case studies involving future ATM system scenarios, as well as through expert assessment, modeling capabilities and supporting tools needed for testing and validating future ATM systems and concepts were identified and described. 2. Existing fast-time ATM models and support tools were reviewed and assessed with regard to the degree to which they offer the capabilities identified under Step 1. 3 . The findings of 1 and 2 were combined to draw conclusions about (1) the best capabilities currently existing, (2) the types of concept testing and validation that can be carried out reliably with such existing capabilities and (3) the currently unavailable modeling capabilities that should receive high priority for near-term research and development. It should be emphasized that the study is concerned only with the class of 'fast time' analytical and simulation models. 'Real time' models, that typically involve humans-in-the-loop, comprise another extensive class which is not addressed in this report. However, the relationship between some of the fast-time models reviewed and a few well-known real-time models is identified in several parts of this report and the potential benefits from the combined use of these two classes of models-a very important subject-are discussed in chapters 4 and 7.

Odoni, Amedeo R.↗

NASA NTRSDate not supplied

Objective Structured Clinical Evaluation (OSCE) of an Artificial Intelligence (AI) Clinical Decision Support System (CDSS) Tool

BACKGROUND Objective Structured Clinical Evaluations (OSCEs) have long been established as a robust methodology for summative assessment of clinical skills and decision-making during medical education. The recent integration of Artificial Intelligence (AI) into clinical decision-making processes has prompted the need for novel evaluation frameworks to assess the efficacy and reliability of AI clinical decision support system (CDSS) tools. This abstract outlines the process of quantitatively evaluating a novel CDSS (“Doc in a Box” Google 2024) trained on curated medical spaceflight data in the psychomotor domain as it interfaces with a human volunteer acting as the crew medical officer (CMO). PURPOSE The AI CDSS under review was developed as part of the Lunar Command and Control Interoperability (LuCCI) project, which is intended to address a gap in how Lunar Surface Systems (LSS) would interoperate across multiple programs, commercial partners, and international partners. The project objective is to define, prototype, integrate, and evaluate an interoperable lunar command, control, data, and software reference architecture to enable autonomy and informatics capability through common standards across LSS. A multi-modal AI-based CDSS compatible with Federated LSS will assist clinicians in diagnosing and managing complex medical conditions by providing evidence-based recommendations through predictive analytics. Given the critical role of decision-support as NASA continues to evolve its Earth-independent medical operations (EIMO), it is imperative to ensure that such AI tools perform reliably and align with clinical standards during progressive lunar and Martian exploration class missions. METHODS The OSCE framework, traditionally used for evaluating human clinicians, was adapted to assess the AI tool's decision-making capabilities in simulated clinical scenarios. In this adapted OSCE, the AI CDSS was tested across a series of structured clinical scenarios designed to mimic real-life spaceflight patient cases. These scenarios included a range of conditions and complexities, allowing for comprehensive assessment of the tool's performance. Key evaluation metrics included accuracy of diagnosis, timeliness of decision-making, and appropriate recommendations for therapies. The OSCE was scored by human physician evaluators who assessed the AI's recommendations in comparison with expert clinicians' medical decision making to ensure alignment with best practices and the standard of care. RESULTS Preliminary results indicate that the AI CDSS demonstrated high accuracy in diagnostic recommendations and decision support across various scenarios. However, certain limitations were noted, such as occasional discrepancies in handling complex or nuanced cases that required a more contextual understanding. Additionally, the tool scored higher on the diagnostic portion of the rubric, with lower scores in the therapeutic recommendations. These findings highlight the importance of continuous refinement and validation of AI tools through rigorous evaluation frameworks like the OSCE. The adaptation of OSCEs for AI tools presents several advantages, including a structured and reproducible approach to evaluation, the ability to test AI systems in diverse clinical scenarios, and the opportunity to benchmark AI performance against established clinical standards to permit charting of future progress as aerospace medicine evolves as a discipline. Remaining challenges include ensuring that these evaluations capture the full spectrum of clinical decision-making scenarios that will be confronted by CMOs during missions and adequately reflecting real-world variability of the austere spaceflight environment. CONCLUSION Employing OSCEs to evaluate AI clinical decision support tools offers a promising approach to validating their clinical utility and efficacy. This methodology not only provides insights into the tool's performance but also fosters ongoing improvement and alignment with standard of care practices. Future research should focus on refining these evaluation processes and addressing limitations to enhance the integration of AI tools in clinical spaceflight settings. REFERENCES Scott S, Hearns V, Barker MA. Testing Clinical Skills: A Look at the OSCE and USMLE Clinical Skills Exams. S D Med. 2019 Oct;72(10):451-453. Majumder MAA, Kumar A, Krishnamurthy K, Ojeh N, Adams OP, Sa B. An evaluative study of objective structured clinical examination (OSCE): students and examiners perspectives. Adv Med Educ Pract. 2019 Jun 5;10:387-397. Karam VY, Park YS, Tekian A, Youssef N. Evaluating the validity evidence of an OSCE: results from a new medical school. BMC Med Educ. 2018 Dec 20;18(1):313.

Ariana M Nelson↗

NASA NTRS1989

Probability of failure and risk assessment of propulsion structural components

Because of the increasing need to account for the uncertainties in material properties, loading conditions, geometry, etc., a methodology was developed to determine structural reliability and to assess the associated risk. The methodology consists of a probabilistic structural analysis by a probabilistic finite element computer code, numerical evaluation of stochastic structures under stress (NESSUS), and a generic probabilistic material property model. The methodology is versatile and is equally applicable to structures operating at high and cryogenic temperature environments. Results obtained demonstrate that the issues of structural reliability and risk can be formally evaluated by using the methodology developed which is inclusive of the uncertainties in material properties, structural parameters, and loading conditions. The methodology is described in some detail with illustrative examples.

Shiao, Michael C.↗

DOE OSTI2024

Short-Run Marginal Emission Factors Neglect Impactful Phenomena and are Unsuitable for Assessing the Power Sector Emissions Impacts of Hydrogen Electrolysis

This comment reacts to Ruhnau and Schiele's (2023) assessment of the cost and emissions impacts of electrolytic hydrogen production operating under different green hydrogen certification requirements in the EU. We critique the paper's use of short-run marginal emissions rates to estimate emissions impacts, a methodology which the literature has shown to be inadequate for assessing the full lifecycle emissions impacts of electricity sector interventions. We hope that our response clarifies the need to consider induced structural change when assessing the greenhouse gas emissions impacts of electricity sector decisions at all scales.

electricity↗

DOE OSTI2025

Environmental DNA as a tool for hydropower impact assessments: current status, special considerations, and future integration

Globally there is an urgent need to find sustainable solutions to balance energy production with the protection of vulnerable species and conservation of biodiversity. This is particularly critical for freshwater ecosystems, habitats, and species that may be impacted by hydropower development and operations needed to meet energy grid demands. Reliable and accurate environmental impact assessments (EIAs) that identify the biological, physical, or social impacts of hydropower are key to ensure biodiversity, ecosystem, and societal sustainability. The analysis of environmental DNA (eDNA) has the potential to transform hydropower EIAs, management and mitigation planning, and decision-making procedures. Further, the incorporation of eDNA surveys into EIAs during both hydropower planning and continued operations may streamline regulatory processes by improving our understanding of potentially impacted biota and habitats and evaluating environmental impacts mitigation. Here, we: (i) highlight current understanding and use of eDNA in freshwater environments; (ii) examine critical considerations for eDNA integration into hydropower EIAs and biological monitoring; (iii) identify knowledge gaps in eDNA analysis and applications unique to hydropower-regulated systems; and (iv) discuss future opportunities to bolster the incorporation of eDNA into hydropower research including regulatory acceptance and public engagement. While we acknowledge that there are several factors that may complicate the broad adoption of eDNA as a tool for assessing the impacts of hydropower, we anticipate that growing confidence in eDNA through hydropower-specific protocols, calibrations, and validations will overcome these inherent uncertainties.

aquatic biodiversity↗

NASA NTRS1990

Sea ice-atmosphere interaction: Application of multispectral satellite data in polar surface energy flux estimates

The application of multi-spectral satellite data to estimate polar surface energy fluxes is addressed. To what accuracy and over which geographic areas large scale energy budgets can be estimated are investigated based upon a combination of available remote sensing and climatological data sets. The general approach was to: (1) formulate parameterization schemes for the appropriate sea ice energy budget terms based upon the remotely sensed and/or in-situ data sets; (2) conduct sensitivity analyses using as input both natural variability (observed data in regional case studies) and theoretical variability based upon energy flux model concepts; (3) assess the applicability of these parameterization schemes to both regional and basin wide energy balance estimates using remote sensing data sets; and (4) assemble multi-spectral, multi-sensor data sets for at least two regions of the Arctic Basin and possibly one region of the Antarctic. The type of data needed for a basin-wide assessment is described and the temporal coverage of these data sets are determined by data availability and need as defined by parameterization scheme. The titles of the subjects are as follows: (1) Heat flux calculations from SSM/I and LANDSAT data in the Bering Sea; (2) Energy flux estimation using passive microwave data; (3) Fetch and stability sensitivity estimates of turbulent heat flux; and (4) Surface temperature algorithm.

Steffen, K.↗

DOE OSTI2023

Interactions between U.S. biofuels policy and the Endangered Species Act

The Renewable Fuel Standard (RFS) is the primary policy governing the use of biofuels in the United States. Following the 2007 enactment of the RFS, there has been substantial expansion in the use of cropland to produce biofuel feedstocks, including corn and soybeans. Both the conversion of land and the ongoing cultivation of these crops can, depending on management practices, lead to negative environmental outcomes including degraded water quality, increased water use, increased greenhouse gas emissions, and loss or degradation of wildlife habitat. These outcomes have the potential to affect threatened and endangered species protected under the U.S. Endangered Species Act (ESA). The ESA requires federal agencies to consult with the U.S. Fish and Wildlife Service or the National Marine Fisheries Service to ensure that an agency's actions are not likely to jeopardize the existence of imperiled species, nor result in the destruction or adverse modification of their habitat. However, formal consultation has not yet been completed between the U.S. Environmental Protection Agency—the agency charged with implementing the RFS—and the wildlife services, thereby hindering mitigation or remediation of potential impacts. This analysis explores the likely effects of the RFS on land use changes and critical habitat, illustrates example pathways by which threatened and endangered species may be affected, and proposes solutions to help redress this harm. The findings suggest a need for further consultation and assessment of the interactions between the RFS and ESA as well as additional research to support the species-conservation and policymaking processes.

09 BIOMASS FUELS↗

DOE OSTI2025

High-performance windows improve thermal survivability of occupants during cold snaps

Exposure to low indoor air temperature is a major contributor to temperature-related mortality during extreme cold events, especially when power outages disrupt operation of space heating systems. This study explores the impact of high-performance windows on the thermal resilience of residential buildings during extreme cold weather and grid power outages, as well as their long-term benefits through energy efficiency and reduced risk of property damage. Building performance simulations were conducted for reference residential buildings in three construction vintages and two major U.S. cities located in cold climate zones, considering two types of extreme cold events: short and severe, and long and milder. Our research found that even houses compliant with current energy codes struggle to maintain safe indoor temperatures for more than a few hours during power outages, necessitating rapid evacuations. High-performance windows can extend the thermal survivability time by up to 3.8 days within a 7-day cold snap and significantly reduce risk of bursting frozen water pipes, depending on the building’s insulation and infiltration level, cold event severity, and occupant vulnerability. This extended thermal safety time is crucial in scenarios where reduced mobility complicates emergency responses in senior housing. In addition to boosting thermal resilience, upgrading older homes with high-performance windows can reduce heating energy consumption by over 18% and cooling energy by 15%. Our findings highlight the need to incorporate thermal resilience assessments into new designs or major retrofits, including the use of typical and extreme weather scenarios and advanced technologies like high-performance windows.

Krelling, Amanda F↗

DOE OSTI2024

Evaluating direct vessel injection accident-event progression of AP1000 and key figures of merit to support the design and development of water-cooled small modular reactors

The passive safety systems (PSSs) within water-cooled reactors are meticulously engineered to function autonomously, requiring no external power source or manual intervention. They depend exclusively on inherent natural forces and the fundamental principles of reactor physics, such as gravity, natural convection, and phase changes, to manage, alleviate, and avert the release of radioactive materials into the environment during accident scenarios like a loss-of-coolant accident (LOCA). PSSs are already integrated into such operating commercial reactors as the Advanced Pressurized Reactor-1000 MWe (AP1000) and the Water-Water Energetic Reactor-1200 MWe (WWER-1200) are adopted in most of the upcoming small modular reactor (SMR) designs. Examples of water-cooled SMR PSSs are the passive emergency core-cooling system (ECCS), passive containment cooling system (PCCS), and passive decay-heat removal system, the designs of which vary based on reactor system-design requirements. However, understanding the accident-event progression and phases of a LOCA is pivotal for adopting a specific PSS for a new SMR design. This study covers the accident-event progression for direct vessel injection (DVI) small-break loss-of-coolant accident (SB-LOCA), associated physics phenomena, knowledge gaps, and important figures of merit (FOMs) that may need to be evaluated and assessed to validate thermal-hydraulics models with an available experimental dataset to support new SMR design and development.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2025

Consequence analyses of sabotage-induced radiological releases in sodium-cooled fast microreactors

Analysis of three sodium-cooled fast microreactors (SFMs) with thermal powers of 10, 30, and 50 MWt showed that smaller reactors result in lower radiological consequences during a postulated sabotage-induced event because of their reduced core inventory. All SFMs used U-10Zr metal fuel enriched to 15 wt% high-assay low-enriched uranium and operated until their respective effective multiplication factor (k eff ) reduced to less than 1 or until the end of their operational lifespan. Sabotage scenarios were simulated at this point, when the fuel inventory within the core contains the highest-level of radioactivity. Radionuclide core inventories were calculated using the SCALE code at shutdown and 3 days post-shutdown. Dose consequence analyses were performed for three sabotage scenarios using the RASCAL tool. As microreactor developers plan for minimal on-site or complete off-site emergency response, it remains essential to evaluate their physical protection needs and potential hazards, including assessing postulated sabotage-induced events that could become more relevant. SFM licensees should identify a credible worst-case, major accident, estimate release source terms, and perform dose consequence analyses to evaluate site-specific physical protection measures. In conclusion, this recommendation supports a risk-informed, performance-based approach, aligning with applicable regulatory requirements, i.e., 10 CFR Parts 100 and 53 rulemaking in the United States.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

DOE OSTI2026

Systematic Benchmarking of Climate Models: Methodologies, Applications, and New Directions

As climate models become increasingly complex, there is a growing need to comprehensively and systematically assess model performance with respect to observations. Given the increasing number and diversity of climate model simulations in use, the community has moved beyond simple model intercomparison and toward developing methods capable of benchmarking a large number of simulations against a suite of climate metrics. Here, we present a detailed review of evaluation and benchmarking methods and approaches developed in the last decade, focusing primarily on scientific implications for Coupled Model Intercomparison Project (CMIP) simulations and CMIP6 results that contributed to the Intergovernmental Panel on Climate Change (IPCC) Sixth Assessment Report (AR6). Based on this review, we explain the resulting contemporary philosophy of model benchmarking, and provide clear distinctions and definitions of the terms model verification, process validation, evaluation, and benchmarking. While significant progress has been made in model development based on systematic evaluation and benchmarking efforts, some climate system biases still remain. The development of open‐source community software packages has played a fundamental role in identifying areas of significant model improvement and bias reduction. We review the key features of several software packages that have been commonly used over the past decade to evaluate and benchmark global and regional climate models. Additionally, we discuss best practices for the selection of evaluation and benchmarking metrics and for interpreting the obtained results, the importance of selecting suitable sources of reference data and accurate uncertainty quantification.

Environmental sciences↗