Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “constraint handling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

SODAs: sparse optimization for the discovery of differential and algebraic equations

Differential-algebraic equations (DAEs) integrate ordinary differential equations (ODEs) with algebraic constraints, providing a fundamental framework for developing models of dynamical systems characterized by time-scale separation, conservation laws and physical constraints. While sparse optimization has revolutionized model development by allowing data-driven discovery of parsimonious models from a library of possible equations, existing approaches for dynamical systems assume DAEs can be reduced to ODEs by eliminating variables before model discovery. This assumption limits the applicability of such methods for DAE systems with unknown constraints and time scales. We introduce sparse optimization for differential-algebraic systems (SODAs), a data-driven method for the identification of DAEs in their explicit form. By discovering the algebraic and dynamic components sequentially without prior identification of the algebraic variables, this approach leads to a sequence of convex optimization problems. It has the advantage of discovering interpretable models that preserve the structure of the underlying physical system. To this end, SODAs improves since SODAs is singular numerical stability when handling high correlations between library terms, caused by near-perfect algebraic relationships, by iteratively refining the conditioning of the candidate library. We demonstrate the performance of our method on biological, mechanical and electrical systems, showcasing its robustness to noise in both simulated time series and real-time experimental data.

DAE↗
DOE OSTI2025

EMPDF : inferring the Milky Way mass with data-driven distribution function in phase space

We introduce the emPDF (empirical distribution function), a novel dynamical modelling method that infers the gravitational potential from kinematic tracers with optimal statistical efficiency under the minimal assumption of steady state. emPDF determines the best-fitting potential by maximizing the similarity between instantaneous kinematics and the time-averaged phase-space distribution function (DF), which is empirically constructed from observation upon the theoretical foundation of oPDF (Han et al. 2016). This approach eliminates the need for presumed functional forms of DFs or orbit libraries required by conventional DF- or orbit-based methods. emPDF stands out for its flexibility, efficiency, and capability in handling observational effects, making it preferable to the popular Jeans equation or other minimal assumption methods, especially for the Milky Way (MW) outer halo where tracers often have limited sample size and poor data quality. We apply emPDF to infer the MW mass profile using Gaia DR3 data of satellite galaxies and globular clusters, obtaining enclosed masses of M (,r) = 26±8, 46±8, 90±13⁠, and 149±40 x 10 10 M ⊙ at r = 30, 50, 100⁠, and 200 kpc, respectively. These are consistent with the updated constraints from simulation-informed DF fitting (Li et al. 2020). While the simulation-informed DF offers superior precision owing to the additional information extracted from simulations, emPDF is independent of such supplementary knowledge and applicable to general tracer populations. emPDF is currently implemented for tracers with complete 6D kinematics within spherical potentials, but it can potentially be extended to address more general problems.

Astrophysics of Galaxies (astro-ph.GA)↗
DOE OSTI2022

A deep learning-enhanced framework for multiphysics joint inversion

Joint inversion has drawn considerable attention due to the availability of multiple geophysical data sets, ever-increasing computational resources, the development of advanced algorithms, and its ability to reduce inversion uncertainty. A key issue of joint inversion is to develop effective strategies to link different geophysical data in a unified mathematical framework, in which the information obtained from different models can complement each other. We have developed a deep learning-enhanced joint inversion framework to simultaneously reconstruct different physical models by fusing different types of geophysical data. Traditionally, structure similarity constraints are pursued by joint inversion algorithms using manually crafted formulations (e.g., cross gradient). The constraint is constructed by a deep neural network (DNN) during the learning process. The framework is designed to combine the DNN and a traditional independent inversion workflow and improve the joint inversion result iteratively. The network can be easily extended to incorporate multiphysics without structural changes. Numerical experiments on the joint inversion of 2D DC resistivity data and seismic traveltime are used to validate our method. In addition, this learning-based framework demonstrates excellent generalization abilities when tested on data sets using different geologic structures. It also can handle different sensing configurations and nonconforming discretization.

Geochemistry & Geophysics↗
DOE OSTI2021

What are the Impacts on the HVAC System when it Provides Frequency Regulation? – A Comprehensive Case Study with a Multi-Zone Variable Air Volume (VAV) System

Heating, ventilation, and air-conditioning (HVAC) systems in commercial buildings have proven to be a great asset for providing secondary frequency regulation (FR) service to the power grid. However, how the provision of FR service affects the HVAC system Quality of Service (QOS) is still largely unknown. In particular, there exists a controversy regarding the energy efficiency impact. This paper investigates how a HVAC system performance and its associated controls are impacted during and after the FR service. For the assessment, we developed a dynamic Modelica-based medium office building model as a virtual testbed with the Air Handling Unit (AHU) fans providing the FR service. Different regulation capacities (demand levels) and standard test signals under various load profiles in the U.S. are considered. The results show that FR has little or no impact on the HVAC operation and occupant thermal comfort while the building is providing the service if an appropriate regulation capacity is pre-determined. However, if the regulation capacity is overestimated, the quality of the FR service provided by the HVAC system and the HVAC energy efficiency will be affected due to the equipment operating constraints. In addition, the AHU supply air temperature fluctuates, and the controller cannot maintain the desired setpoint as the FR magnitude is increased. After the FR service time, the system takes a certain period to return to normal operation. The recovery period extends with the increase in the FR magnitude. For this case study, there exists a control conflict between the FR control and the existing HVAC control (from ASHRAE Guideline 36-2018) during high load conditions, causing the fan speed to saturate. The fan power consumption could increase significantly; up to 77% increase compared to the baseline was observed. This case study demonstrates that the HVAC system controls need to be enhanced and adapted to minimize the interaction between the FR controller and the indoor environmental controls in order to preserve the HVAC system QOS while (during and after) providing satisfactory FR service.

Lu, Xing↗
DOE OSTI2025

A Review of Tank 48H Treatment of Tetraphenylborate with Permanganate

Tank 48H contains roughly 270,000 gallons of radioactive waste material. The waste stored in this tank was to be processed in multiple stages utilizing facilities at the Savannah River Site (SRS) almost 30 years ago. The In-Tank Precipitation Process (ITP) was initiated in Tank 48H, which precipitated highly radioactive cesium-137 using sodium tetraphenylborate (NaTPB). While the process succeeded in precipitating the Cs, Sr, and other actinides, it also generated an unexpectedly large amount of benzene. The evolved benzene created a safety concern and made the waste incompatible with further downstream processing. This halted the ITP, and a new method of treatment was required to continue processing the legacy waste contained in Tank 48H. A myriad of treatment options have been proposed with multiple teams of researchers assembled to work on this highly complex issue over the last few decades. This review investigated one potentially viable treatment option, in-tank oxidation with sodium permanganate. Permanganate has been well known in literature as a strong oxidizing agent for organic compounds, as well as being utilized at the Savannah River Site (SRS) in other processes. A small number of studies have been conducted utilizing waste simulants to evaluate the use of permanganate as an oxidant for tetraphenylborate (TPB). A search of the literature and data from these studies indicates that permanganate could be a viable treatment for destruction of TPB in Tank 48H. While the scoping studies had a small number of individual experiments and nonideal conditions, the permanganate decomposed up to 90% of the TPB. A free hydroxide concentration above 1.0 M is required for tank corrosion control. Simulant studies indicate no decrease in TPB decomposition by permanganate until pH 14. The simulant studies show an increase in TPB decomposition as the temperature of the solution is increased to 40 °C. The post-reaction analysis of previous simulant tests did not look at all of the organic degradation products. Investigations into what these organic products are and in what quantity will help guide determinations as to whether the downstream processing facilities are able to handle the material that will be generated. Study on the time frame for the reaction between permanganate and TPB should be investigated as the literature reports only extend out to two weeks reaction time. The permanganate treatment conditions indicate no corrosion control concerns and a longer timescale reaction may be needed for in-tank treatment. In addition, further study would be useful to identify a lower boundary condition for the ratio of TPB and oxidant. The simulant tests applied large excesses of permanganate, and this may be unnecessary. The size constraint of the tank means that there will be practical limitations on the amount of sodium permanganate that can be added to the tank. The amount of permanganate should be minimized as much as possible while still ensuring decomposition of the TPB to minimize the amount of manganese dioxide solids generated.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2026

Spherical tokamak physics research in preparation for the operation of NSTX-U

The National Spherical Torus Experiment Upgrade (NSTX-U) is preparing to resume operation, representing a crucial step toward realizing compact, cost-effective fusion pilot plants. In advance of this, extensive modeling and data analysis have been conducted to advance the physics basis for low-aspect-ratio, high-performance plasma regimes, focusing on three core objectives: confinement and stability, power and particle handling, and steady-state operation. Significant progress has been made in understanding the electron temperature flattening in high-β plasmas, which is shown to be driven by a complex interplay of magnetohydrodynamic instabilities (e.g. non-resonant infernal modes), fast-ion-driven Alfvén eigenmodes, and electron and ion-scale micro-instabilities, particularly Kinetic Ballooning Modes (KBMs), whose destabilization is strongly dependent on parallel magnetic field fluctuations (δB ∥ ). Furthermore, a new gyrokinetic critical pedestal model was developed, accurately predicting pedestal structure by identifying KBMs as the primary stability limit, offering a critical constraint for future high-confinement scenarios. To address the challenge of high heat flux, novel liquid lithium plasma-facing components were modeled. The analysis confirmed that lithium vapor shielding is a self-regulating mechanism for heat mitigation, while also emphasizing that strong main ion parallel flow is essential to minimize core lithium contamination. Finally, progress toward steady-state operation was anchored by developing the required physics basis and control tools. This includes predictive modeling for reversed magnetic shear sustainment, demonstrating that magnetic island-induced bootstrap current reduction is negligible in STs, and advancing real-time control and disruption avoidance capabilities. The development of high-speed surrogate models (e.g. MMMNet) provides computationally efficient tools vital for non-inductive scenario optimization and integrated, low-disruptivity operations planned for NSTX-U.

NSTX-U↗
DOE OSTI2025

Light in the dark forest. Part I. An efficient optimal estimator for 3D Lyman-alpha forest power spectrum

The highly anisotropic nature of the Lyman-alpha (Lyα) forest data introduces a complex survey window function that complicates the measurement of the three-dimensional power spectrum ( P 3D ). In this paper, we present the first fully optimal estimator for P 3D , which exactly deconvolves the survey window function and marginalizes contaminated modes that distort the power spectrum. Our approach adapts optimal estimator techniques developed for the 2D cosmic microwave background data to the 3D case. To achieve computational feasibility, we employ the conjugate gradient method and implement the P 3 M formalism to handle large-scale and small-scale operations separately and efficiently. We validate our estimator using Monte Carlo mocks and Gaussian simulations, demonstrating its accuracy and computational efficiency. We confirm that mode marginalization eliminates distortions arising from quasar continuum errors and delivers robust power spectrum estimation, though it also inflates errors at large scales. This first implementation works in the flat-sky case; we discuss the remaining steps needed to generalize it to the curved-sky case. This formalism offers a foundation for the Lyα forest P 3D measurements and a new path toward cosmological constraints from the Lyα forest data.

Lyman alpha forest↗
DOE OSTI2025

Dynamic Modeling, Trajectory Optimization, and Linear Control of Cable-Driven Parallel Robots for Automated Panelized Building Retrofits

The construction industry faces a growing need for automation to reduce costs, improve accuracy and productivity, and address labor shortages. One area that stands to benefit significantly from automation is panelized prefabricated building envelope retrofits, which can improve a building’s energy efficiency in heating and cooling interior spaces. In this paper, we propose using cable-driven parallel robots (CDPRs), which can effectively lift and handle large objects, to install these panels. However, implementing CDPRs presents significant challenges because of their nonlinear dynamics, complex trajectory planning, and precise control requirements. To tackle these challenges, this work focuses on a new application of established control and trajectory optimization theories in a CDPR simulation of a building envelope retrofit under real-world conditions. We first model the dynamics of CDPRs, highlighting the critical role of damping in system behavior. Building on this dynamic model, we formulate a trajectory optimization problem to generate feasible and efficient motion plans for the robot under operational and environmental constraints. Given the high precision required in the construction industry, accurately tracking the optimized trajectory is essential. However, challenges such as partial observability and external vibrations complicate this task. To address these issues, a Linear Quadratic Gaussian control framework is applied, enabling the robot to track the optimized trajectories with precision. Simulation results show that the proposed controller enables precise end effector positioning with errors under 4 mm, even in the presence of external wind disturbances. Through comprehensive simulations, our approach allows for an in-depth exploration of the system’s nonlinear dynamics, trajectory optimization, and control strategies under controlled yet highly realistic conditions. The results demonstrate the feasibility of CDPRs for automating panel installation and provide insights into their practical deployment.

CDPR↗
DOE OSTI2024

A portable application framework for energy management and information systems (EMIS) solutions using Brick semantic schema

This paper introduces a portable framework for developing, scaling and maintaining energy management and information systems (EMIS) applications using an ontology-based approach. Key contributions include an interoperable layer based on Brick schema, the formalization of application constraints pertaining metadata and data requirements, and a field demonstration. The framework allows for querying metadata models, fetching data, preprocessing, and analyzing data, thereby offering a modular and flexible workflow for application development. Its effectiveness is demonstrated through a case study involving the development and implementation of a data-driven anomaly detection tool for the photovoltaic systems installed at the Politecnico di Torino, Italy. During eight months of testing, the framework was used to tackle practical challenges including: (i) developing a machine learning-based anomaly detection pipeline, (ii) replacing data-driven models during operation, (iii) optimizing model deployment and retraining, (iv) handling critical changes in variable naming conventions and sensor availability (v) extending the pipeline from one system to additional ones.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

A Review of Remote Welding and Nondestructive Examination Technologies for the DOE Standard Canister

The U.S. Department of Energy (DOE) manages a wide variety of spent nuclear fuel (SNF) that poses a unique management challenge. To help address this challenge, the DOE Standard Canister (DOESC), designed to remain sealed during handling, storage, transportation, and disposal, was conceptualized as a standardized containment vessel to accommodate DOE-managed SNF. Since 1999, several welding and examination processes have been independently developed for the DOESC’s closure welds. However, neither the DOESC nor these processes have been realized in an operational capacity. This review paper seeks to present and compare previously developed DOESC closure weld, nondestructive examination, and repair processes and technologies. Specific processes developed for the Idaho Spent Fuel Facility, in preparation for the Yucca Mountain geological repository, and the recent Road-Ready Demonstration Project are discussed. Further, specific focus is given to how different operating constraints and the American Society of Mechanical Engineers Boiler and Pressure Vessel Code (BPVC) have driven certain welding and nondestructive examination requirements. Historical DOESC welding and examination strategies are assessed against current regulatory and BPVC requirements. The comparison of welding processes, technologies, and DOESC designs presented in this review paper will inform further construction efforts for other commercial and DOE-managed SNF containments, including the DOESC.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

Toward a persistent event-streaming system for high-performance computing applications

High-performance computing (HPC) applications have traditionally relied on parallel file systems and file transfer services to manage data movement and storage. Alternative approaches have been proposed that use direct communications between application components, trading persistence and fault tolerance for speed. Event-driven architectures, as popularized in enterprise contexts, present a compelling middle ground, avoiding the performance cost and API constraints of parallel file systems while retaining persistence and offering impedance matching between application components. However, adapting streaming frameworks to HPC workloads requires addressing challenges unique to HPC systems. This paper investigates the potential for a streaming framework designed for HPC infrastructures and use cases. We introduce Mofka, a persistent event-streaming framework designed specifically for HPC environments. Mofka combines the capabilities of a traditional streaming service with optimizations tailored to the HPC context, such as support for massively multicore nodes, efficient scaling for large producer-consumer workflows, RDMA-enabled high-performance network communications, specialized network fabrics with multiple links per node, and efficient handling of large scientific data payloads. Built using the Mochi suite of HPC data service components, Mofka provides a lightweight, modular, and high-performance solution for persistent streaming in HPC systems. We present the architecture of Mofka and evaluate its performance against Kafka and Redpanda using benchmarks on diverse platforms, including Argonne's Polaris and Oak Ridge's Frontier supercomputers, showing up to 8× improvement in throughput in some scenarios. We then demonstrate its utility in several real-world applications: a tomographic reconstruction pipeline, a workflow for the discovery of metal-organic frameworks for carbon capture, and the instrumentation of Dask workflows for provenance tracking and performance analysis.

HPC↗
DOE OSTI2026

L'Arlesienne de ROOT

Over many years, ROOT users have repeatedly stumbled over—and loudly rediscovered—the infamous 1 GB limit on individual I/O operations, a constraint that somehow survived long past the era when anyone thought a gigabyte was “a lot.” As experiments embraced ever-larger objects and collections, this limit became an increasingly unavoidable rite of passage. This contribution recounts the sustained, multi-year quest by ROOT I/O developers to finally retire this relic, navigating a maze of legacy APIs, memory-management assumptions, and integer boundaries that seemed determined to preserve the status quo. We describe how internal interfaces were carefully modernized to introduce fully 64-bit–capable code paths without breaking the mountains of existing user code that would definitely have noticed. With the limit now lifted, ROOT can finally handle multi-gigabyte objects in a single read or write operation, even when splitting them into an RNTuple is not an option (we’re looking at you, large RooWorkspaces and giant histograms), liberating users from yet another “fun” debugging adventure and clearing the way for the massive analyses of the HL-LHC and beyond.

Canal, Philippe G. [Fermilab] (ORCID:0000000277487↗
DOE OSTI2026

L'Arlesienne de ROOT

Over many years, ROOT users have repeatedly stumbled over—and loudly rediscovered—the infamous 1 GB limit on individual I/O operations, a constraint that somehow survived long past the era when anyone thought a gigabyte was “a lot.” As experiments embraced ever-larger objects and collections, this limit became an increasingly unavoidable rite of passage. This contribution recounts the sustained, multi-year quest by ROOT I/O developers to finally retire this relic, navigating a maze of legacy APIs, memory-management assumptions, and integer boundaries that seemed determined to preserve the status quo. We describe how internal interfaces were carefully modernized to introduce fully 64-bit–capable code paths without breaking the mountains of existing user code that would definitely have noticed. With the limit now lifted, ROOT can finally handle multi-gigabyte objects in a single read or write operation, even when splitting them into an RNTuple is not an option (we’re looking at you, large RooWorkspaces and giant histograms), liberating users from yet another “fun” debugging adventure and clearing the way for the massive analyses of the HL-LHC and beyond.

Canal, Philippe G. [Fermilab] (ORCID:0000000277487↗
DOE OSTI2022

Energy and mobility impacts of connected autonomous vehicles with co-optimization of speed and powertrain on mixed vehicle platoons

Intersections are known to be traffic bottlenecks where a significant amount of energy consumption could be caused due to deceleration/acceleration in the presence of red signals. With an increased level of connectivity and automation of intelligent transportation systems, connected autonomous vehicles (CAVs) are expected to be able to proactively adjust their driving strategies subject to constraints imposed by the predicted future traffic. As a result, many potential benefits can be achieved, such as improved energy efficiency, enhanced traffic safety, among many others. Notably, the way CAVs are controlled affects the following legacy vehicles (LVs) due to complex traffic dynamics. Here, we are particularly interested in studying the energy and mobility impact of CAVs with an improved traffic prediction method on mixed vehicle platoons at various market penetration rates. Leveraging traffic prediction, CAVs are controlled with co-optimization of their speed and gear position. Specifically, a traffic prediction framework in a rolling horizon fashion is employed based upon a modified Payne–Whitham (PW) model capable of handling mixed traffic consisting of CAVs and LVs. The prediction error of the modified PW model is reduced by 53.62% compared to that of the standard PW model under test scenarios. According to the predicted traffic conditions, speed and gear position of CAVs are co-optimized with the primary goal of minimizing energy consumption when driving on a signalized arterial. The energy benefits achieved by CAVs and the impact of CAVs on LVs behind are studied comprehensively for mixed vehicle platoons. The lead LV follows a real-world speed profile collected on TH-55 in Minnesota. Numerical results show that energy benefits achieved by the vehicle platoon range from 2% to 16%, and a 1% to 5% reduction in travel time for LVs behind CAVs is also observed, at different penetration rates of CAVs in various traffic scenarios. Furthermore, it is observed that CAVs using the proposed eco-driving approach appear to have a positive impact on the LVs behind in terms of energy consumption, regardless of the driving styles of the LVs ahead.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2022

Enabling cooperative adaptive cruise control on strings of vehicles with heterogeneous dynamics and powertrains

Recent studies have shown that positive impact of Cooperative Adaptive Cruise Control (CACC) can only be guaranteed as market penetration rate increases. Removing the string homogeneity constraint is essential to encourage widespread adoption. In this work, a hierarchical architecture is proposed to enable CACC on vehicles with not only mixed dynamics but also different powertrain types. A low-level layer deals with the vehicle and powertrain dynamics to provide accurate and consistent reference speed tracking response. The high-level layer uses: (1) a Linear Parameter Varying feedback system to provide loop stability, robustness and enforce a variable time gap policy and (2) a feedforward system that processes Vehicle-to-Vehicle information to enhance string stability and response bandwidth, by dealing with the string heterogeneity. A gap management strategy is built on top of the CACC architecture to handle gap setting changes or cut-in/out situations, via a dynamics constrained time gap trajectory planning algorithm. We report the proposed work has been designed, developed and validated on three different real passenger vehicles on public highways and test tracks, showing the potential of the proposed algorithm to enable robust string stable CACC, despite the different dynamics and powertrains considered.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2024

ILAW Container Cost Reduction and Optimization Study

This study, performed on behalf of Washington River Protection Solutions (WRPS), examines the potential for making cost savings for the Immobilized Low Active Waste (ILAW) containers over the mission life of the Waste Treatment and Immobilization Plant (WTP). it builds on earlier study assessments 24590-LAW-RPT-M-01-001 Rev 0 ILAW Product Container Specifications Optimization Study and DOE/ORP-2013-02 Rev 0 Decision Analysis of Low-Active Waste Container Finishing Handling System Alternatives. The WTP design and installed equipment has evolved over an extended period ~20 years. Consequently, some of the existing requirements relating the ILAW containers may no longer be applicable under current mission plans where the glass filled containers are placed into the Integrated Disposal Facility (IDF) rather than stacked in an engineered purpose-built ventilated store as originally envisioned. The study team reviewed available WTP project reference documents to establish the functions the container must perform and assign requirements against each of these functions. With the assumptions that some of the existing WTP contract restrictions would not necessarily apply to the subsequent facility operations contract the container requirements were reviewed to identify those which were ‘hard constraints‘, imposed by regulatory requirements. Initially each of these hard constraints were reviewed, evaluated and documented to see if they precluded the use of an alternate less expensive material of construction, carbon steel, to the existing 304 L stainless steel in the current container specification. That review did not generate any fatal flaws for a change in material of construction to carbon steel allowing the study team to examine the impacts of material cost savings, potential changes to the design and requirements and impacts on interfaces of the containers with the existing WTP process equipment from container receipt, transfers, glass filling, cooling and export. In addition, a change in container target fill level was evaluated and qualitative, and quantitative where feasible, impacts to the container fabrication process assessed. Lastly, additional follow on development or testing activities to support the use of carbon steel were assessed and a recommended path forward with a ROM cost and timescale developed.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2022

Resilience Design Patterns: A Structured Approach to Resilience at Extreme Scale (V.2.0)

Reliability is a serious concern for future extreme-scale high-performance computing (HPC) systems. Projections based on the current generation of HPC systems and technology roadmaps suggest the prevalence of very high fault rates in future systems. The errors resulting from these faults will propagate and generate various kinds of failures, which may result in outcomes ranging from result corruptions to catastrophic application crashes. Therefore, the resilience challenge for extreme-scale HPC systems requires coordination between various hardware and software technologies that are capable of handling a broad set of fault models at accelerated fault rates. Also, due to practical limits on power consumption in future HPC systems, they are likely to embrace innovative architectures, increasing the levels of hardware and software complexities. Therefore, the techniques that seek to improve resilience must navigate the complex trade-off space between resilience and the overheads to power consumption and performance. While the HPC community has developed various resilience solutions, application-level techniques as well as system-based solutions, the solution space of HPC resilience techniques remains fragmented. There are no formal methods to integrate the various HPC resilience techniques into composite solutions, nor are there methods to holistically evaluate the adequacy and efficacy of such solutions in terms of their protection coverage, and their performance & power efficiency characteristics. Additionally, few implementations of current resilience solutions are portable to newer architectures and software environments that will be deployed on future systems. We developed a new structured approach to the management of HPC resilience using the concept of resilience-based design patterns. In general, a design pattern is a repeatable solution to a commonly occurring problem. We identified the well-known solutions that are commonly used to deal with faults, errors and failures in HPC systems. In the initial design patterns specification (version 1.0), we described the various solutions, which address specific problems in the design of resilient HPC environments, in the form of patterns. Each pattern describes a problem caused by a fault, error or failure event in an HPC environment, and then describes the core of the solution of the problem in such a way that this solution may be adapted to different systems and implemented at different layers of the system stack. The catalog of these resilience design patterns provides designers with a collection of design elements. To construct complete resilience solutions using combinations of various patterns, we defined a framework that enhances HPC designers' understanding of the important constraints and the opportunities for the design patterns to be implemented and deployed at various layers of the system stack. The design framework is also useful for establishing interfaces and mechanisms to coordinate flexible fault management across hardware and software components, as well as to consider the trade-off between performance, resilience, and power consumption when constructing a solution. The resilience design patterns specification version 1.1 included more detailed explanations of the pattern solutions, the context in which the patterns are applicable, and the implications for hardware or software design. It also provided several additional examples and detailed case studies to demonstrate the use of patterns to build realistic solutions. In version 1.2 of the specification document, we have improved the pattern descriptions, including graphical representations of the pattern components. These improvements are largely based on critical comments, feedback and suggestions received from pattern experts and readers of the previous versions of the specification. The pattern classification has been modified to further clarify the relationships between pattern categories. This version of the specification also introduces a pattern language for resilience design patterns. The pattern language presents the patterns in the catalog as a network, revealing the relations among the resilience patterns. The language provides designers with the means to explore alternative techniques for handling a specific fault model that may have different efficiency and complexity characteristics. Using the pattern language also enables the design and implementation of comprehensive resilience solutions as a set of interconnected resilience patterns that can be instantiated across layers of the system stack. The overall goal of this work is to provide hardware and software designers, as well as the users and operators of HPC systems, a systematic methodology for the design and evaluation of resilience technologies in HPC systems that keep scientific applications running to a correct solution in a timely and cost-efficient manner despite frequent faults, errors, and failures of various types. Version 2.0 expands the resilience design pattern classification and catalog to include self-stabilization patterns and reliability, availability and performance models for each structural pattern.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Explicit physics-informed neural networks for nonlinear closure: The case of transport in tissues

In upscaling methods, closures for nonlinear problems present a well-known challenge. While a number of theoretical methods have been proposed for handling such closures, nonlinearities still remain a significant obstacle for many problems. In this work, we use a combination of formal upscaling and data-driven machine learning for explicitly closing a nonlinear transport and reaction process in multiscale tissues. The classical effectiveness factor model is used to formulate the macroscale reaction kinetics. We train a multilayer perceptron network using training data generated by direct numerical simulations over microscale examples. Once trained, the network is used in an algorithm for numerically solving the upscaled (coarse-grained) differential equation describing mass transport and reaction in two example tissues. The network is described as being explicit in the sense that the network is trained using macroscale concentrations and gradients of concentration as components of the feature space rather than incorporating them as part of a constraint in the optimization process. Network training and solutions to the macroscale transport equations were computed for two different tissues. The two tissue types (brain and liver) exhibit markedly different geometrical complexity and spatial scale (cell size and sample size). The upscaled solutions for the average concentration are compared with numerical solutions derived from the microscale concentration fields by a posteriori averaging. There are three outcomes of this work of particular note. 1) Our overall approach results in an upscaled nonlinear PDE. The PDE is closed using a neural network, and our approach results in the definition of the classical effectiveness factor for effecting closure. 2) We identify particular source terms for the closure problem that are important for representing the structure of the closure. These source terms involve macroscale concentrations and their gradients. We adopt these source terms to use as explicit features in the learning algorithm. We find the trained networks that include the macroscale source terms generate models that are able to predict the correction factor with increased fidelity over those that do not. 3) We find that the trained network exhibits good generalizability, and it is able to predict the effectiveness factor with high fidelity for realistically-structured tissues despite the significantly different scale and geometrical complexity of the two example tissue types. This latter result emphasizes our purposeful connection between conventional averaging methods with the use of machine learning for closure; this contrasts with some machine learning methods for upscaling where the exact form of the macroscale equation remains unknown.

97 MATHEMATICS AND COMPUTING↗