SEARCH · Engineering Papers

Results for “holistic system model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

All sources NASA NTRS DOE OSTI

DOE OSTI2025

In-device Battery Failure Analysis

Lithium-ion batteries are indispensable power sources for a wide range of modern electronic devices. However, battery lifespan remains a critical limitation, directly affecting the sustainability and user experience. Conventional battery failure analysis in controlled lab settings may not capture the complex interactions and environmental factors encountered in real-world, in-device operating conditions. Here, this study analyzes the failure of commercial wireless earbud batteries as a model system within their intended usage context. Through multiscale and multimodal characterizations, the degradations from the material level to the device level are correlated, elucidating a failure pattern that is closely tied to the specific device configuration and operating conditions. The findings indicate that the ultimate failure mode is determined by the interplay of battery materials, cell structural design, and the in-device microenvironment, such as temperature gradients and their fluctuations. This holistic, in-device perspective on environmental influences provides critical insights for battery integration design, enhancing the reliability of modern electronics.

36 MATERIALS SCIENCE↗

DOE OSTI2021

A Technical and Economic Assessment of LWR Flexible Operation for Generation and Demand Balancing to Optimize Plant Revenue

With increased penetration of subsidized variable renewable energy (VRE) resources and competition from low natural gas prices, existing light water reactor (LWR) nuclear power plants (NPPs) are struggling to remain economically competitive. This work examines the potential economic competitiveness of various thermal energy storage (TES) technologies when coupled directly or indirectly with a NPP. To highlight their relative economic competitiveness, we contrast several energy storage solutions in stochastic dispatch optimization. We leverage data from recent work analyzing a range of TES technologies with varying capital costs, performance, and technology readiness level (TRL) to establish our case. We explore inserting these technologies into an electricity market with existing nuclear generation and large projected variable renewable energy (VRE) penetration. Although these technologies' projected capital costs may make them unlikely candidates in their current state, this analysis demonstrates a high-fidelity techno-economic analysis of energy storage. Furthermore, as the projected cost of energy storage technologies evolves, this analysis sets a precedent for similar future investigations. One region with projected trends that may be unfavorable for existing nuclear capacity is the New York Independent System Operator (NYISO) market. New York state’s baseload generation has been historically provided by fossil-fired and nuclear assets. However, amid economic pressures from subsidized VREs and low natural gas prices, the state has recently deactivated Indian Point nuclear power plant units 2 and 3. Furthermore, the state plans to meet its zero-emission generation target by 2040 by replacing fossil-fired capacity with significant investments in VRE resources like wind and solar photovoltaic (PV) and battery storage. Increased intermittent resource penetration lowers the baseload power requirement, adding further economic pressure to the state’s three remaining NPPs still in operation. With three NPPs still in operation in New York, this work analyzes potential economic benefits to NPPs on the New York grid when directly or indirectly coupled with various TES technologies. This work requires two modeling steps to analyze the potential economic benefits of various system configurations of the TES directly or indirectly coupled with nuclear. First, this analysis leverages capacity expansion modeling by experts at the Electric Power Research Institute (EPRI). Using their deterministic capacity expansion model, U.S. Regional Economy, Greenhouse Gas, and Energy (US-REGEN), EPRI analysts evaluated the capacity and generation evolution of the New York state energy market under four projection scenarios. These four projection scenarios were developed to represent the potential evolution of the capacity and generation in NYISO from 2015 to 2050 under various economic, technology, and policy constraints. The results from these capacity expansion models are then used as boundary conditions in the second modeling step. The second modeling step uses the Holistic Energy Resource Optimization Network (HERON) for a set of stochastic techno-economic analyses (STEAs) to investigate the potential increase in the economic viability of various configurations of the TES. With no current capacity expansion capabilities, HERON takes the data generated from US-REGEN for 2050 to generate synthetic load, solar, and wind data. Then HERON economically optimizes the capacity and dispatch of the various TES configurations. The potential economic benefit is the differential net present value (NPV) of the TES configurations from the no-TES baseline. As a stochastic techno-economic analysis package, HERON introduces uncertainty into the economic metrics, while US-REGEN trades resolution for reduced computational complexity. Using HERON also allows the modeling of direct thermal coupling, a feature not common in capacity and dispatch models. As expected, with high capital costs, the costs of introducing energy storage for all the technologies considered outweighed the potential economic benefit of this strategy for flexible plant operation. The benefit of this analysis is primarily in demonstrating a workflow that examines innovative solutions to increase NPP revenue via TES coupling. HERON’s stochastic capacity and dispatch optimization process used in this work has proven an effective tool in observing and evaluating the impact of introducing storage technologies in a grid energy system.

25 ENERGY STORAGE↗

DOE OSTI2024

Computational and Systems Biology Advances to Enable Bioagent Agnostic Signatures

Enumerated threat agent lists have long driven biodefense priorities. The global SARS-CoV-2 pandemic demonstrated the limitations of searching for known threat agents as compared to a more agnostic approach. Recent technological advances are enabling agent-agnostic biodefense, especially through the integration of multi-modal observations of host-pathogen interactions directed by a human immunological model. Although well-developed technical assays exist for many aspects of human-pathogen interaction, the analytic methods and pipelines to combine and holistically interpret the results of such assays are immature and require further investments to exploit new technologies. In this manuscript, we discuss potential immunologically based bioagent-agnostic approaches and the computational tool gaps the community should prioritize filling.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2023

A scalable framework for quantifying field-level agricultural carbon outcomes

Agriculture contributes nearly a quarter of global greenhouse gas (GHG) emissions, which is motivating interest in adopting certain farming practices that have the potential to reduce GHG emissions or sequester carbon in soil. The related GHG emission (including N 2 O and CH 4 ) and changes in soil carbon stock are defined here as “agricultural carbon outcomes”. Accurate quantification of agricultural carbon outcomes is the basis for achieving emission reductions for agriculture, but existing approaches for measuring carbon outcomes (including direct measurements, emission factors, and process-based modeling) fall short of achieving the required accuracy and scalability necessary to support credible, verifiable, and cost-effective measurement and improvement of these carbon outcomes. Here we propose a foundational and scalable framework to quantify field-level carbon outcomes for farmland, which is based on the holistic carbon balance of the agroecosystem: Agroecosystem Carbon Outcomes = Environment (E) × Management (M) × Crop (C). Following a comprehensive review of the scientific challenges associated with existing approaches, as well as their tradeoffs between cost and accuracy, we propose that the most viable path for the quantification of field-level carbon outcomes in agricultural land is through an effective integration of various approaches (e.g. diverse observations, sensor/in-situ data, and modeling), defined as the “System-of-Systems” solution. Such a “System-of-Systems” solution should simultaneously comprise the following components: (1) scalable collection of ground truth data and cross-scale sensing of environment variables (E), management practices (M), and crop conditions (C) at the local field level; (2) advanced modeling with necessary processes to support the quantification of carbon outcomes; (3) systematic Model-Data Fusion (MDF), i.e. robust and efficient methods to integrate sensing data and models at each local farmland level; (4) high computation efficiency and artificial intelligence (AI) to scale to millions of individual fields with low cost; and (5) robust and multi-tier validation systems and infrastructures to ensure solution fidelity and true scalability, i.e. the ability of a solution to perform robustly with accepted accuracy on all targeted fields. In this regard, we provide here the detailed scientific rationale, current progress, and future research and development (R&D) priorities to achieve different components of the “System-of-Systems” solution, thus accomplishing the Environment×Management×Crop framework to quantify field-level agricultural carbon outcomes.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Characterization and identification of HPC applications at leadership computing facility

High Performance Computing (HPC) is an important method for scientific discovery via large-scale simulation, data analysis, or artificial intelligence. Leadership-class supercomputers are expensive, but essential to run large HPC applications. The Petascale era of supercomputers began in 2008, with the first machines achieving performance in excess of one petaflops, and with the advent of new supercomputers in 2021 (e.g., Aurora, Frontier), the Exascale era will soon begin. However, the high theoretical computing capability (i.e., peak FLOPS) of a machine is not the only meaningful target when designing a supercomputer, as the resources demand of applications varies. A deep understanding of the characterization of applications that run on a leadership supercomputer is one of the most important ways for planning its design, development and operation. In order to improve our understanding of HPC applications, user demands and resource usage characteristics, we perform correlative analysis of various logs for different subsystems of a leadership supercomputer. This analysis reveals surprising, sometimes counter-intuitive patterns, which, in some cases, conflicts with existing assumptions, and have important implications for future system designs as well as supercomputer operations. For example, our analysis shows that while the applications spend significant time on MPI, most applications spend very little time on file I/O. Combined analysis of hardware event logs and task failure logs show that the probability of a hardware FATAL event causing task failure is low. Combined analysis of control system logs and file I/O logs reveals that pure POSIX I/O is used more widely than higher level parallel I/O. Based on holistic insights of the application gained through combined and co-analysis of multiple logs from different perspectives and general intuition, we engineer features to "fingerprint" HPC applications. We use t-SNE (a machine learning technique for dimensionality reduction) to validate the explainability of our features and finally train machine learning models to identify HPC applications or group those with similar characteristic. To the best of our knowledge, this is the first work that combines logs on file I/O, computing, and inter-node communication for insightful analysis of HPC applications in production.

Liu, Zhengchun↗

NASA NTRS2012

An Integrated Biomechanical Model for Microgravity-Induced Visual Impairment

When gravitational unloading occurs upon entry to space, astronauts experience a major shift in the distribution of their bodily fluids, with a net headward movement. Measurements have shown that intraocular pressure spikes, and there is a strong suspicion that intracranial pressure also rises. Some astronauts in both short- and long-duration spaceflight develop visual acuity changes, which may or may not reverse upon return to earth gravity. To date, of the 36 U.S. astronauts who have participated in long-duration space missions on the International Space Station, 15 crew members have developed minor to severe visual decrements and anatomical changes. These ophthalmic changes include hyperopic shift, optic nerve distension, optic disc edema, globe flattening, choroidal folds, and elevated cerebrospinal fluid pressure. In order to understand the physical mechanisms behind these phenomena, NASA is developing an integrated model that appropriately captures whole-body fluids transport through lumped-parameter models for the cerebrospinal and cardiovascular systems. This data feeds into a finite element model for the ocular globe and retrobulbar subarachnoid space through time-dependent boundary conditions. Although tissue models and finite element representations of the corneo-scleral shell, retina, choroid and optic nerve head have been integrated to study pathological conditions such as glaucoma, the retrobulbar subarachnoid space behind the eye has received much less attention. This presentation will describe the development and scientific foundation of our holistic model.

Nelson, Emily S.↗

DOE OSTI2024

Leveraging generative AI for urban digital twins: a scoping review on the autonomous generation of urban data, scenarios, designs, and 3D city models for smart city advancement

The digital transformation of modern cities by integrating advanced information, communication, and computing technologies has marked the epoch of data-driven smart city applications for efficient and sustainable urban management. Despite their effectiveness, these applications often rely on massive amounts of high-dimensional and multi-domain data for monitoring and characterizing different urban sub-systems, presenting challenges in application areas that are limited by data quality and availability, as well as costly efforts for generating urban scenarios and design alternatives. As an emerging research area in deep learning, Generative Artificial Intelligence (GenAI) models have demonstrated their unique values in content generation. This paper aims to explore the innovative integration of GenAI techniques and urban digital twins to address challenges in the planning and management of built environments with focuses on various urban sub-systems, such as transportation, energy, water, and building and infrastructure. The survey starts with the introduction of cutting-edge generative AI models, such as the Generative Adversarial Networks (GAN), Variational Autoencoders (VAEs), Generative Pre-trained Transformer (GPT), followed by a scoping review of the existing urban science applications that leverage the intelligent and autonomous capability of these techniques to facilitate the research, operations, and management of critical urban subsystems, as well as the holistic planning and design of the built environment. Based on the review, we discuss potential opportunities and technical strategies that integrate GenAI models into the next-generation urban digital twins for more intelligent, scalable, and automated smart city development and management.

3D city modeling↗

DOE OSTI2021

Operating Reserves in ReEDS

This presentation provides an overview of the formulation for operating reserves in the Regional Energy Deployment System (ReEDS), a capacity expansion model. It describes the three reserve products modeled in ReEDS--regulation, spinning (contingency), and flexibility--and highlights recent updates to the modeling approach, including modifications to how storage provides reserves, the constraints on commitment for generators that provide reserves, and the costs for thermal units to provide spinning reserve. The presentation benchmarks operating reserve provision in ReEDS against comparable simulations in PLEXOS, finding that the improved formulation is different but yields results that are holistically similar to those in production cost modeling. In this presentation we also investigate the impact of different reserve options in the model (e.g., allowing wind and solar to provide operating reserves) on the solution. The results thus far indicate that most switches related to operating reserves exert little influence on the outcome on the results. Future work will continue to explore operating reserves in capacity expansion models, particularly for models with different temporal resolution.

14 SOLAR ENERGY↗

DOE OSTI2024

The Triple Effect: Unraveling the Joint Impact of Electric Vehicles, Solar Panels, and Work-From-Home Patterns on Household Electricity Costs

Solutions for deep decarbonization need to be sustainable as well as affordable to garner widespread adoption. The past two decades have seen the introduction of new technologies and paradigms such as electric vehicles (EVs), solar photovoltaics (PVs), and increased work-from-home (WFH), which impact the overall energy consumption and cost of a household in different ways. However, much attention has not been paid to explore the joint impact these technologies have on a household's energy (electricity cost) burden. Leveraging Residential Energy Consumption Survey (RECS), this study presents an integrated model to unravel the extent to which the bundled adoption of EV-PV and stay-at-home decisions impact the total electricity cost of households. RECS data revealed that, compared to the baseline (i.e., households that did not own any of these technologies), households that own EVs, PVs, and engage in WFH observed a 13.5% decline in their electricity bills, despite a 25% increase in electricity consumption. The model results indicated that bundled adoption of EVs-PVs reduces electricity costs more significantly for a household, compared to the increased costs imposed by more household members staying at home. This holistic assessment presents an opportunity for decision makers to contextualize the changing energy costs and design effective strategies to foster a sustainable and affordable future. Policies such as bundled incentivization to motivate co-adoption, education about energy-management strategies, and add-on subsidies to adopt energy-efficient appliances, will not only accelerate decarbonization but increase household financial savings.

ADVANCED PROPULSION SYSTEMS,SOLAR ENERGY↗

DOE OSTI2026

Stakeholder-guided holistic, Adaptive Framework for enhancing community Energy Resilience (SAFER) (Final Technical Report)

The Stakeholder-guided holistic, Adaptive Framework for enhancing community Energy Resilience (SAFER) project advances resilience science and engineering by addressing challenges in rural Kansas communities where aging infrastructure, extreme weather, and socioeconomic disparities heighten vulnerability to energy disruptions. Traditional approaches often focus on technical performance while overlooking community concerns and priorities. SAFER responds by integrating community perspectives with advanced analytical frameworks to create a holistic model for measuring and improving resilience. Project objectives included developing novel resilience metrics, advancing modeling frameworks that capture interdependencies across infrastructures, and embedding community-centric indicators directly into planning processes for distributed energy resources. The key technical innovations included the creation of self-organizing map (SOM)-based indices for objective resilience quantification, hetero-functional graph theory (HFGT) models linking power, water, transportation, and community assets, and graph neural network (GNN) tools for identifying critical nodes in complex systems. Community-centric energy planning was demonstrated through optimal siting and sizing of (photovoltaic) PV and battery storage, ensuring resilience enhancements also addressed energy burden and energy insecurity. SAFER engaged community partners in Dodge City and Ford County through surveys, focus groups, and workshops, generating more than 600 responses that established baseline measures of energy burden, financial insecurity, and willingness-to-pay to avoid outages. This data, organized in terms of a community capitals framework, informed the development of weighted reliability indices that better reflect community costs than traditional utility metrics. SAFER’s GNN-based critical node identification framework identified expert-labelled critical nodes with over 99% accuracy, while also uncovering additional functionalities essential for proactive resilience planning. The project’s models demonstrated that optimal PV and storage deployment could improve resilience indices by over 11 percent, with dispatch strategies further enhancing outcomes, confirming both the technical effectiveness and economic feasibility of these approaches. Through its combined emphasis on rigorous modeling, community-focused planning, and community engagement, SAFER advances the state of resilience research while delivering direct benefits to rural communities. The project provides tools, guidelines, and resilience heatmaps that help utilities, local governments, and residents better anticipate disruptions, prioritize investments, and strengthen the capacity to withstand and recover from energy-related hazards. Furthermore, the developed HFG and GNN frameworks are designed for transferability, allowing them to be adapted for resilience planning in other communities with minimal retraining. This inductive learning capability provides a scalable pathway to extend the SAFER project’s impact. Thus, creating a foundation for a nationally applicable model of infrastructure resilience. Additionally, the HFG can also be extended to include other FEMA community lifelines.

14 SOLAR ENERGY↗

NASA NTRS1984

Characterizing land processes in the biosphere

NASA long-term planning for the satellite remote sensing of land areas is discussed from the perspective of a holistic interdisciplinary approach to the study of the biosphere. The earth is characterized as a biogeochemical system; the impact of human activity on this system is considered; and the primary scientific goals for their study are defined. Remote-sensing programs are seen as essential in gaining an improved understanding of energy budgets, the hydrological cycle, other biogeological cycles, and the coupling between these cycles, with the construction of a global data base and eventually the development of predictive simulation models which can be used to assess the impact of planned human activities. Current sensor development at NASA includes a multilinear array for the visible and IR and the L-band Shuttle Imaging Radar B, both to be flown on Shuttle missions in the near future; for the 1990s, a large essentially permanent man-tended interdisciplinary multisensor platform connected to an advanced data network is being planned.

Erickson, J. D.↗

NASA NTRS2021

Towards a holistic sulfate-water-O2 triple oxygen isotope systematics

Triple oxygen isotope (∆^(17)O with δ^(18)O) signals of H2O and O2 found in sulfate of oxidative weathering origin offer promising constraints on modern and ancient weathering, hydrology, atmospheric gas concentrations, and bioproductivity. However, interpretations of the sulfate-water-O2 system rely on assuming fixed oxygen-isotope fractionations between sulfate and water, which, contrastingly, are shown to vary widely in sign and amplitude. Instead, here we anchor sulfate-water-O2 triple oxygen isotope systematics on the homogeneous composition of atmospheric O2 with empirical constraints and modeling. Our resulting framework does not require a priori assumptions of the O2- versus H2O-oxygen ratio in sulfate and accounts for the signals of mass dependent and mass independent fractionation in the ∆^(17)O and δ^(18)O of sulfate's O2-oxygen source. Within this framework, new ∆^(17)O measurements of sulfate constrain ~2.3Ga Paleoproterozoic gross primary productivity to between 6 and 160 times present-day levels, with important implications for the biological carbon cycle response to high CO2concentrations prevalent on the early Earth.

sulfate, oxygen isotopes, atmospheric oxygen, sulf↗

DOE OSTI2020

Assessing CLUBB PDF Closure Assumptions for a Continental Shallow-to-Deep Convective Transition Case Over Multiple Spatial Scales

Assumed-PDF (probability density function) higher-order turbulence closures (APHOCs) are now widely used for parameterizing boundary layer turbulence and shallow convection in Earth system models (ESMs). A better understanding of the resolution-dependent behavior of APHOCs is essential for improving the performance of next-generation ESMs with intended horizontal resolutions finer than 10 km. In this study, we evaluate the PDF family of Analytic double-Gaussian 1 implemented in Cloud Layers Unified By Binormals (CLUBB) over a range of spatial scales (Dx) from 2 to 100 km. A 120-km-wide large eddy simulation (LES) for a continental convection case during 2016 Holistic Interactions of Shallow Clouds, Aerosols, and Land-Ecosystems (HI-SCALE) field campaign serves as benchmark to evaluate the PDF closure using an off-line approach. We find during the shallow convection period, the CLUBB PDF closure tends to produce positive biases of cloud properties and liquid water flux near cloud base for all scales of analysis. It produces negative biases for these variables near cloud top that are more severe for Dx larger than 25 km. Results show that replacing the CLUBB-parameterized moisture and temperature skewnesses with LES-derived ones can fix most of the biases if clipping of input moments is allowed to prevent the occurrence of unrealizable solutions. Overall, the performance of the PDF closure is better for smaller Dx = 2–5 km than for larger Dx = 50–100 km; for a given grid spacing, it is better when the convective clouds become deeper in the late afternoon. Likely causes for the resolution dependence and implications for improving the PDF closure are discussed.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Complete Demonstration of a Prototype Version of FORCE User Interface and Conduct Analyst Survey Collecting Feedback on Interface Features and Usability

In 2024 the US Department of Energy (DOE) Office of Nuclear Energy (NE) Integrated Energy System (IES) program continued to develop the Framework for Optimization of Resources and Economics (FORCE) analysis ecosystem into a more traditional toolset with simplified software installation, automated workflows, and interactive results visualization. The DOE-NE Nuclear Energy Advanced Modeling and Simulation (NEAMS) Workbench continued to be leveraged for user input, application workflow and runtime environment, and interactive results visualization capabilities. This report documents the demonstration of a FORCE User Interface (UI) prototype and the results of a survey of analysts’ using the Holistic Energy Resource Optimization Network (HERON) tool in FORCE with the prototype UI.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

FORCE Regression Testing

Via programs including the Light Water Reactor Sustainability and Integrated Energy Systems, the U.S. Department of Energy has invested in the Framework for Optimization of ResourCes and Economics (FORCE) software framework (Idaho National Laboratory 2024a) for the technical and economic analysis of nuclear-integrated energy systems (IES). Nuclear IES expand the use of nuclear from traditional baseload electricity generation to a flexible and adaptive source of combined heat and power. Nuclear heat can be used in the production of a variety of energy currencies such as hydrogen and ammonia as well as other heat applications including water desalination and district heating. FORCE is designed with the intent to provide interconnected analysis tools that enable the accurate technical and economic assessment of specific nuclear IES configurations for individual energy markets. FORCE consists of three main analysis pathways: HYBRID (Idaho National Laboratory 2024b), which contains high-resolution physical models for IES; Holistic Energy Resource Optimization Network (HERON) (Idaho National Laboratory 2024c), which analyzes IES long-term economic viability; and Optimization of Real-time Capacity Allocation (ORCA) (Idaho National Laboratory 2024d), designed for real-time control of IES via digital twins and optimal decision making, including autonomous and remote operation research. Development of the FORCE ecosystem is guided by three pillars: capability, which assures that the computational requirements of IES analysis are met by the software tools; reliability, which provides for consistent code performance and expected behaviors; and accessibility, which lowers the barrier to entry for using the software and accelerates analysis by users beyond the FORCE primary developers. Reliability of the FORCE ecosystem is established according to the American Nuclear Society?s Nuclear Quality Assurance (NQA-1) program [American Society of Mechanical Engineers 1982], with specific levels of software quality assurance (SQA) within NQA-1 applied to each software tool in FORCE. As the tools within FORCE have matured, some integration algorithms to accurately connect the software tools for holistic analysis have been developed and deployed within the FORCE software repository. In accordance with NQA-1 standards, regression tests are required to guarantee the software performs consistently even when new capabilities are added to the software. In this report, we document the deployment of both unit tests, which test the consistent behavior of small pieces of the FORCE code base, as well as integration tests, which test the consistent performance of full use cases for the FORCE integration algorithms. We further document the encapsulation of these tests within a test harness, which collectively checks for each successful test completion on demand. Finally, we document the automation of the test harness using GitHub Actions [GitHub 2024], which require all tests succeed before any new capability or other changes can be added to the FORCE integration software

97 MATHEMATICS AND COMPUTING↗

NASA NTRSDate not supplied

An Analytic Collaborative Framework for the Earth System Observatory

NASA's Earth System Observatory groundbreaking observations will provide critical measurements to address societal relevant problems in climate change, natural hazard mitigation, fighting forest fires, and improving real-time agricultural processes. Central to the ESO vision is the notion of Open-Source Science (OSS), a collaborative culture enabled by technology that promotes the open sharing of data, information, and knowledge aiming to facilitate and accelerate scientific understanding, and the agile development of applications for the benefit of society. The larger vision of an Earth System Digital Twin (ESDT) calls for integrated Earth science frameworks that mirror the Earth by a proxy digital construct that includes km-scale resolution Earth system models and data assimilation systems along with an integrated set of analytic tools to enable the next generation of science discoveries and evidence-based decision making. The goal of this project is to develop an Analytic Collaborative Framework for ESO missions, based on realistic, science-based observing system simulations and the Program of Record (PoR). Tying it all together is a cloud-based cyberinfrastructure that will enable each uniquely designed satellite in the Earth System Observatory to work in tandem to create a 3D, holistic view of Earth. In this presentation, we lay the technological groundwork for enabling such a vision. Our approach consists of the 3 main interconnected building blocks: 1. Cloud-optimized representative datasets for ESO missions and the PoR to serve as basis for developing and prototyping an Analytic Collaborative Framework. 2. An Algorithm Workbench for enabling experimentation and exploration of synergistic algorithms not only for instruments within a mission, but also including the PoR and other ESO missions. 3. A series of concrete Open-Source Science demonstrations including use cases that span science discovery and end-user applications with direct societal impact. While our ultimate goal is to include all of the main missions comprising the Earth System Observatory, in our initial 2 years we will focus on AOS and SBG, two missions for which specific synergisms have been identified in a recent workshop. In this presentation we will describe our approach and discuss some illustrative examples of our framework.

Arlindo da SIlva↗

NASA NTRSDate not supplied

An Analytic Collaborative Framework for the Earth System Observatory

Arlindo da SIlva↗

DOE OSTI2022

Resilience Design Patterns: A Structured Approach to Resilience at Extreme Scale (V.2.0)

Reliability is a serious concern for future extreme-scale high-performance computing (HPC) systems. Projections based on the current generation of HPC systems and technology roadmaps suggest the prevalence of very high fault rates in future systems. The errors resulting from these faults will propagate and generate various kinds of failures, which may result in outcomes ranging from result corruptions to catastrophic application crashes. Therefore, the resilience challenge for extreme-scale HPC systems requires coordination between various hardware and software technologies that are capable of handling a broad set of fault models at accelerated fault rates. Also, due to practical limits on power consumption in future HPC systems, they are likely to embrace innovative architectures, increasing the levels of hardware and software complexities. Therefore, the techniques that seek to improve resilience must navigate the complex trade-off space between resilience and the overheads to power consumption and performance. While the HPC community has developed various resilience solutions, application-level techniques as well as system-based solutions, the solution space of HPC resilience techniques remains fragmented. There are no formal methods to integrate the various HPC resilience techniques into composite solutions, nor are there methods to holistically evaluate the adequacy and efficacy of such solutions in terms of their protection coverage, and their performance & power efficiency characteristics. Additionally, few implementations of current resilience solutions are portable to newer architectures and software environments that will be deployed on future systems. We developed a new structured approach to the management of HPC resilience using the concept of resilience-based design patterns. In general, a design pattern is a repeatable solution to a commonly occurring problem. We identified the well-known solutions that are commonly used to deal with faults, errors and failures in HPC systems. In the initial design patterns specification (version 1.0), we described the various solutions, which address specific problems in the design of resilient HPC environments, in the form of patterns. Each pattern describes a problem caused by a fault, error or failure event in an HPC environment, and then describes the core of the solution of the problem in such a way that this solution may be adapted to different systems and implemented at different layers of the system stack. The catalog of these resilience design patterns provides designers with a collection of design elements. To construct complete resilience solutions using combinations of various patterns, we defined a framework that enhances HPC designers' understanding of the important constraints and the opportunities for the design patterns to be implemented and deployed at various layers of the system stack. The design framework is also useful for establishing interfaces and mechanisms to coordinate flexible fault management across hardware and software components, as well as to consider the trade-off between performance, resilience, and power consumption when constructing a solution. The resilience design patterns specification version 1.1 included more detailed explanations of the pattern solutions, the context in which the patterns are applicable, and the implications for hardware or software design. It also provided several additional examples and detailed case studies to demonstrate the use of patterns to build realistic solutions. In version 1.2 of the specification document, we have improved the pattern descriptions, including graphical representations of the pattern components. These improvements are largely based on critical comments, feedback and suggestions received from pattern experts and readers of the previous versions of the specification. The pattern classification has been modified to further clarify the relationships between pattern categories. This version of the specification also introduces a pattern language for resilience design patterns. The pattern language presents the patterns in the catalog as a network, revealing the relations among the resilience patterns. The language provides designers with the means to explore alternative techniques for handling a specific fault model that may have different efficiency and complexity characteristics. Using the pattern language also enables the design and implementation of comprehensive resilience solutions as a set of interconnected resilience patterns that can be instantiated across layers of the system stack. The overall goal of this work is to provide hardware and software designers, as well as the users and operators of HPC systems, a systematic methodology for the design and evaluation of resilience technologies in HPC systems that keep scientific applications running to a correct solution in a timely and cost-efficient manner despite frequent faults, errors, and failures of various types. Version 2.0 expands the resilience design pattern classification and catalog to include self-stabilization patterns and reliability, availability and performance models for each structural pattern.

97 MATHEMATICS AND COMPUTING↗