Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Clustered patterns”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,009 records · Page 56
All sourcesNASA NTRSDOE OSTI
NASA NTRS1993

Testing approximations for non-linear gravitational clustering

The accuracy of various analytic approximations for following the evolution of cosmological density fluctuations into the nonlinear regime is investigated. The Zel'dovich approximation is found to be consistently the best approximation scheme. It is extremely accurate for power spectra characterized by n = -1 or less; when the approximation is 'enhanced' by truncating highly nonlinear Fourier modes the approximation is excellent even for n = +1. The performance of linear theory is less spectrum-dependent, but this approximation is less accurate than the Zel'dovich one for all cases because of the failure to treat dynamics. The lognormal approximation generally provides a very poor fit to the spatial pattern.

Coles, Peter↗
DOE OSTI2019

Global Disease Outbreaks Associated with the 2015–2016 El Niño Event

Interannual climate variability patterns associated with the El Niño-Southern Oscillation phenomenon result in climate and environmental anomaly conditions in specific regions worldwide that directly favor outbreaks and/or amplification of variety of diseases of public health concern including chikungunya, hantavirus, Rift Valley fever, cholera, plague, and Zika. We analyzed patterns of some disease outbreaks during the strong 2015–2016 El Niño event in relation to climate anomalies derived from satellite measurements. Disease outbreaks in multiple El Niño-connected regions worldwide (including Southeast Asia, Tanzania, western US, and Brazil) followed shifts in rainfall, temperature, and vegetation in which both drought and fooding occurred in excess (14–81% precipitation departures from normal). These shifts favored ecological conditions appropriate for pathogens and their vectors to emerge and propagate clusters of diseases activity in these regions. Our analysis indicates that intensity of disease activity in some ENSO-teleconnected regions were approximately 2.5–28% higher during years with El Niño events than those without. Plague in Colorado and New Mexico as well as cholera in Tanzania were significantly associated with above normal rainfall (p<0.05); while dengue in Brazil and southeast Asia were significantly associated with above normal land surface temperature (p<0.05). Routine and ongoing global satellite monitoring of key climate variable anomalies calibrated to specific regions could identify regions at risk for emergence and propagation of disease vectors. Such information can provide sufficient lead-time for outbreak prevention and potentially reduce the burden and spread of ecologically coupled diseases.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

A GPU-based compressible combustion solver for applications exhibiting disparate space and time scales

High-speed chemically active flows pose significant computational challenges due to their disparate space and time scales, with stiff chemistry often dominating simulation time. While modern scientific computing programs achieve exascale performance by leveraging graphics processing units (GPUs), existing GPU-based compressible combustion solvers face critical limitations in memory management, load balancing, and handling the highly localized nature of chemical reactions. To this end, we present a high-performance compressible reacting flow solver built on the AMReX framework and optimized for multi-GPU settings. Here, our approach addresses three GPU performance bottlenecks: memory access patterns through column-major storage optimization, computational workload variability via a bulk-sparse integration strategy for chemical kinetics, and multi-GPU load distribution for adaptive mesh refinement applications. The solver adapts existing matrix-based chemical kinetics formulations to multi-grid contexts. Using representative combustion applications, including 2D and 3D detonations and a 3D jet-in-crossflow configuration, we demonstrate 1.4–5× performance improvements over initial implementations on an in-house cluster of NVIDIA H100 GPUs, and near-ideal weak scaling on the Frontier supercomputer (Oak Ridge Leadership Computing Facility) with up to 1024 AMD Instinct MI250X GPUs. Roofline analysis reveals substantial improvements in arithmetic intensity for both convection (∼ 10 ×) and chemistry (∼ 4 ×) routines, confirming efficient utilization of GPU memory bandwidth and computational resources.

42 ENGINEERING↗
NASA NTRS2019

Global Disease Outbreaks Associated with the 2015-2016 El Niño Event

Interannual climate variability patterns associated with the El Niño-Southern Oscillation phenomenon result in climate and environmental anomaly conditions in specific regions worldwide that directly favor outbreaks and/or amplification of variety of diseases of public health concern including chikungunya, hantavirus, Rift Valley fever, cholera, plague, and Zika. We analyzed patterns of some disease outbreaks during the strong 2015–2016 El Niño event in relation to climate anomalies derived from satellite measurements. Disease outbreaks in multiple El Niño-connected regions worldwide (including Southeast Asia, Tanzania, western US, and Brazil) followed shifts in rainfall, temperature, and vegetation in which both drought and flooding occurred in excess (14–81% precipitation departures from normal). These shifts favored ecological conditions appropriate for pathogens and their vectors to emerge and propagate clusters of diseases activity in these regions. Our analysis indicates that intensity of disease activity in some ENSO-teleconnected regions were approximately 2.5–28% higher during years with El Niño events than those without. Plague in Colorado and New Mexico as well as cholera in Tanzania were significantly associated with above normal rainfall (p < 0.05); while dengue in Brazil and southeast Asia were significantly associated with above normal land surface temperature (p < 0.05). Routine and ongoing global satellite monitoring of key climate variable anomalies calibrated to specific regions could identify regions at risk for emergence and propagation of disease vectors. Such information can provide sufficient lead-time for outbreak prevention and potentially reduce the burden and spread of ecologically coupled diseases.

El Nino↗
NASA NTRS1985

Venus global radar reflectivity and correlations with elevation

A geological analysis of the global radar reflectivity data for Venus is presented. The statistical and map pattern distribution of the radar reflectivity rho is first analyzed in the context of the porosity structure of the surface. Rho is then correlated with elevation in order to examine the degree of topographic control on material properties which could depend on PT-sensitive chemical weathering phenomena. Comparison of the rms slope alpha and rho correlations with elevation demonstrates that there are distinct topographic zones defined on the basis of the rho and alpha trends. Finally, hierarchical clustering analysis is applied to the global rho, alpha, and 100-km baseline regional slope data sets in order to define radar property-related subregions.

Garvin, J. B.↗
NASA NTRS1987

Transonic Navier-Stokes solutions for a fighter-like configuration

The Transonic Navier-Stokes wing code is extended to a 16-zone TNS wing-fuselage code and used to solve the transonic viscous flow over a modified F-16A. The computer code, called Transonic Navier-Stokes Wing/Fuselage uses a zonal approach to solve the three-dimensional Euler and Navier-Stokes equations. With the zonal implementation, clustering suitable for viscous calculations is achieved on all solid surfaces. The transonic case has flow conditions of free-stream M = 0.9, alpha = 4.12 deg, and a Reynolds number based on root chord of 4.5 million. This case required about 3,000 iterations to reduce the L2-norm of the residual by three orders, which takes about 15 hr of cpu time on the Cray X-MP/48 processor. Pressure distributions, as well as separaton patterns, compare favorably with experiment for this transonic case.

Flores, Jolen↗
NASA NTRS2018

Trajectory Design Considerations for Exploration Mission 1

Exploration Mission 1 (EM-1) will be the first mission to send an uncrewed Orion Multi-Purpose Crew Vehicle (MPCV) to cislunar space in the fall of 2019. EM-1 was originally conceived as a lunar free-return mission, but was later changed to a Distant Retrograde Orbit (DRO) mission as a precursor to the Asteroid Redirect Mission. To understand the required mission performance (i.e., propellant requirement), a series of trajectory optimization runs was conducted using JSC's Copernicus spacecraft trajectory optimization tool. In order for the runs to be done in a timely manner, it was necessary to employ a parallelization approach on a computing cluster using a new trajectory scan tool written in Python. Details of the scan tool are provided and how it is used to perform the scans and post-process the results. Initially, a scan of daily due east launched EM-1 DRO missions in 2018 was made. Valid mission opportunities are ones that do not exceed the useable propellant available to perform the required burns. The initial scan data showed the propellant and delta-V performance patterns for each launch period. As questions were raised from different subsystems (e.g., power, thermal, communications, flight operations, etc.), the mission parameters or data that were of interest to them were added to the scan output data file. The additional data includes: (1) local launch and landing times in relation to sunrise and sunset, (2) length of eclipse periods during the in-space portion of the mission, (3) Earth line of sight from cislunar space, (4) Deep Space Network field of view looking towards cislunar space, and (5) variation of the downrange distance from Earth entry interface to splashdown. Mission design trades can also be performed based on the information that the additional data shows. For example, if the landing is in darkness, but the recovery operations team desires a landing in daylight, then an analysis is performed to determine how to change the mission design to meet this request. Also, subsystems request feasibility of alternate or contingency mission designs, such as adding an Orion main engine checkout burn or Orion completing all of its burns using only its auxiliary thrusters. This paper examines and presents the evolving trade studies that incorporate subsystem feedback and demonstrate the feasibility of these constrained mission trajectory designs and contingencies.

Dawn, Timothy F.↗
DOE OSTI2019

Evidence for Highly Variable, Region-Specific Patterns of T-Cell Epitope Mutations Accumulating in Mycobacterium tuberculosis Strains

Vaccines that confer protection through induction of adaptive T-cell immunity rely on understanding T-cell epitope (TCE) evolution induced by immune escape. This is poorly understood in tuberculosis (TB), an ancient, chronic disease, where CD4 T-cell immunity is of recognized importance. We probed 905 functionally validated, curated human CD4 T cell epitopes in 79 Mycobacterium tuberculosis (Mtb) whole genomes from India. This screen resulted in identifying 64 mutated epitopes in these strains initially using a computational pipeline and subsequently verified by single nucleotide polymorphism (SNP) analysis. SNP based phylogeny revealed the 79 Mtb strains to cluster to East African Indian (EAI), Central Asian Strain (CAS), and Beijing (BEI) lineages. Eighty-nine percent of the mutated T-cell epitopes (mTCEs) identified in the 79 Mtb strains from India has not previously been reported. These mTCEs were encoded by genes with high nucleotide diversity scores including seven mTCEs encoded by six antigens in the top 10% of rapidly divergent Mtb genes encoded by these strains. Using a T cell functional assay readout, we demonstrate 62% of mTCEs tested to significantly alter CD4 T-cell IFNγ and/or IL2 secretion with associated changes in predicted HLA-DR binding affinity: the gain of function mutations displayed higher predicted HLA-DR binding affinity and conversely mutations resulting in loss of function displayed lower predicted HLA-DR binding affinity. Most mutated antigens belonged to the cell wall/cell processes, and, intermediary metabolism and respiration families though all known Mtb proteins encoded mutations. Analysis of the mTCEs in an SNP database of 5,310 global Mtb strains identified 82% mTCEs to be significantly more prevalent in Mtb strains isolated from India, including 36 mTCEs identified exclusively in strains from India. These epitopes had a significantly higher predicted binding affinity to HLA-DR alleles that were highly prevalent in India compared to HLA-DR alleles rare in India, highlighting HLA-DR maybe an important driver of these mutations. This first evidence of region-specific TCE mutations potentially employed by Mtb to escape host immunity has important implications for TB vaccine design.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2017

Reconstruction of Central European daily weather types back to 1763

Weather type classifications (WTCs) are a simple tool to analyse variations in weather patterns. Long series of WTCs could be used to address decadal changes in weather as a basis for studying changes in variability or extremes or for addressing contributions of sea-surface temperature or external forcings using climate models. However, there is no long series of daily objective weather types (WTs). A new method (Shortest Mahalanobis Distance, SMD) using daily European weather data is developed to reconstruct WTCs back in time. Here the SMD method is applied on the Cluster Analysis of Principal Components (CAP9) classification used by MeteoSwiss. The CAP9 daily WT time series (computed with ERA-40) is used as reference over the 1958–1998 period. Daily data (temperature, mean sea level pressure and pressure tendency) from 13 European stations covering the period 1763–2009 are used for the reconstruction. The reference CAP9 is reduced from nine to seven types so the new daily WTC is called CAP7. As an assessment, CAP7 is compared to the original classification CAP9 and to the same WTs computed with the Twentieth Century Reanalysis (20CR and 20CRv2c). Over the reference period up to 90% of all the daily WTs can be correctly reproduced in the new WTC compared to the original series, with higher reliability in winter than in summer. In addition, the reliability of the classification is increasing from 1763 onward. The annual occurrence of each type reveals some trends, mostly a decrease in the number of cyclonic days and an increase of cyclonic days.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2018

Mechanistic Understanding of the Growth Kinetics and Dynamics of Nanoparticle Superlattices by Coupling Interparticle Forces from Real-Time Measurements

Superlattice structures formed by nanoparticle (NP) self-assembly have attracted increasing attention due to their potential as a novel class of nanomaterials with enhanced physicochemical properties tailored by the assembly structure. However, many key questions remain regarding the correlation between the dynamics of individual NPs and the emerging superlattice patterns. Here we investigated the self-assembly of gold NPs by employing in situ transmission electron microscopy equipped with direct detection camera capabilities, which enabled us to track the rapid motion of individual nanoparticles in real time. By calculating the contributions of Brownian, van der Waals, hydrodynamic, and steric hindrance forces, we obtained a quantitative evaluation of the competitive interactions that drive the assembly process. Such competition between forces over various separations is critical for the kinetics of cluster growth, as well as the superlattice formation. Brownian motion resulted in random particle motions to form small-sized clusters, whose growth dynamics was characterized as reaction-limited aggregation. Subsequently, at relative short-range particle separation, van der Waals force overrode the Brownian force and dominantly drove the assembly process. In the close proximity, a delicate balance between van der Waals and steric hindrance forces surprisingly led to a unique dynamic nature of the assembled superlattice. Our study provides a fundamental understanding of coupling energetics and dynamics of NPs involved in the assembly process, enabling the control and design of the structure of nanoparticle superlattices.

Lee, Jaewon↗
DOE OSTI2023

Lagrangian Characterization of Surface Transport From the Equatorial Atlantic to the Caribbean Sea Using Climatological Lagrangian Coherent Structures and Self‐Organizing Maps

Abstract This study presents an assessment of the transport of suspended material by surface ocean currents, which have a critical role in determining the connectivity and distribution of living and non‐living material. Lagrangian experiments reveal pathways from the Equatorial Atlantic to 10 strategic regions within the Caribbean Sea, determined by considering the space‐time variability of climatological Lagrangian Coherent Structures, which act as recurrent attracting pathways and transport barriers. Due to windage or Stokes drift, wind forcing is a significant factor in determining the spatial locations where particles cluster and the time needed to reach the Caribbean from the Equatorial Atlantic. Pathways shift westward within the Caribbean and take less time to arrive with increasing wind influence. Depending on the wind effect, the particles show higher confluence in different areas of the Caribbean. A case study is presented for the Mexican Caribbean nearshore area, isolated from ocean‐current trajectories. Here, wind weakens the transport barrier responsible for this isolation and causes particle confluence toward that region. Spatial patterns of the Eulerian velocity identified through Self‐Organizing Maps, with time dependence given by their best matching units, can reproduce the characteristic Lagrangian patterns of surface current climate variability. Our study demonstrates the application of tools from dynamical systems and unsupervised neural networks to understand Lagrangian patterns and identify the processes that drive them. These findings improve our understanding of transport mechanisms of suspended material by surface ocean currents in the Western Atlantic and the Caribbean Sea, which is essential for managing and conserving marine ecosystems.

Allende‐Arandía, Ma. Eugenia↗
DOE OSTI2017

Analysis of InGaN nanodots grown by droplet heteroepitaxy using grazing incidence small-angle X-ray scattering and electron microscopy

We present a detailed structural investigation of self-assembled indium gallium nitride nanodots grown on c-plane aluminum nitride templates by the droplet heteroepitaxy technique in a plasma-assisted molecular beam epitaxy reactor. Various growth parameters, including the total coverage of the metal species, relative and total metal effusion fluxes, and nitridation temperature were investigated. Analyses of in situ reflection high-energy electron diffraction patterns and comparison with simulations showed that the resulting crystal structure was a mixture of wurtzite and twinned zinc blende phases, with the zinc blende phase increasingly dominant for lower metal coverages and lower nitridation temperatures, and the wurtzite phase increasingly dominant for higher nitridation temperature. Studies by field emission scanning electron microscopy and atomic force microscopy revealed that the nanodots exhibit trimodal size distributions, with the dot morphologies of the intermediate size mode often resembling aggregations of distinct clusters. Nanodots grown at higher nitridation temperatures had larger inter-dot spacings, with hexagonal in-plane ordering observable at a sufficiently high temperature. Using grazing incidence small angle X-ray scattering, we determined the nanodots to be approximately truncated cone shaped, and extracted the mean radius, height, and inter-dot distance for each distribution. Microstructural investigations of the nanodots by cross-sectional transmission electron microscopy indicated that the majority of the dots were formed in dislocation-free regions, and confirmed that the intermediate size dots were approximately truncated cone shaped and consisted of both zinc blende and wurtzite regions. Mapping of the elemental distributions by energy dispersive X-ray spectroscopy in scanning transmission electron microscopy mode indicated highly nonuniform indium distributions within both small and intermediate size dots which are potentially indicative of indium clustering and kinetically controlled nanoscale phase separation rather than the spinodal decomposition associated with bulk diffusion. In conclusion, the observed enrichment in indium concentration towards the tops of the nanodot layers could be ascribed to the compositional pulling effect.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2016

The Phenazine 2-Hydroxy-Phenazine-1-Carboxylic Acid Promotes Extracellular DNA Release and Has Broad Transcriptomic Consequences in Pseudomonas chlororaphis 30–84

Enhanced production of 2-hydroxy-phenazine-1-carboxylic acid (2-OH-PCA) by the biological control strain Pseudomonas chlororaphis 30–84 derivative 30-84O* was shown previously to promote cell adhesion and alter the three-dimensional structure of surfaceattached biofilms compared to the wild type. The current study demonstrates that production of 2-OH-PCA promotes the release of extracellular DNA, which is correlated with the production of structured biofilm matrix. Moreover, the essential role of the extracellular DNA in maintaining the mass and structure of the 30–84 biofilm matrix is demonstrated. To better understand the role of different phenazines in biofilm matrix production and gene expression, transcriptomic analyses were conducted comparing gene expression patterns of populations of wild type, 30-84O* and a derivative of 30–84 producing only PCA (30-84PCA) to a phenazine defective mutant (30-84ZN) when grown in static cultures. RNA-Seq analyses identified a group of 802 genes that were differentially expressed by the phenazine producing derivatives compared to 30-84ZN, including 240 genes shared by the two 2-OH-PCA producing derivatives, the wild type and 30-84O*. A gene cluster encoding a bacteriophage- derived pyocin and its lysis cassette was upregulated in 2-OH-PCA producing derivatives. A holin encoded in this gene cluster was found to contribute to the release of eDNA in 30–84 biofilm matrices, demonstrating that the influence of 2-OH-PCA on eDNA production is due in part to cell autolysis as a result of pyocin production and release. The results expand the current understanding of the functions different phenazines play in the survival of bacteria in biofilm-forming communities.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1975

/Ar-40/-/Ar-39/ dating of Apollo 16 and 17 rocks

The reported study is a continuation of an investigation begun by Alexander and Kahl (1974), with primary emphasis on (Ar-40)-(Ar-39) dating of lunar breccias. A primary objective of the study was related to the resolution of small plateau-age differences between Apollo 16 and 17 samples which have been irradiated in the same irradiation. This objective was not realized because (1) neither of the considered Apollo 16 samples has a well-defined plateau, and (2) the release patterns of the two Apollo 17 samples with plateaux (73235 and 77017) are sufficiently complex to suggest caution in interpretation of fine-scale differences among apparent ages. The plateau age of 73235 agrees well with plateau ages measured for a nearby boulder at the South Massif. The plateau age of 77017, on the other hand, agrees well with plateau ages measured in an nearby boulder at the base of the North Massif. These rock and boulder ages are tightly clustered about 3.99 b.y., and this clustering suggests that the North and South Massifs were made in the same basin-forming event, presumably Serenitatis.

Phinney, D.↗
DOE OSTI2024

Using Knowledge-Guided Machine Learning To Assess Patterns of Areal Change in Waterbodies across the Contiguous United States

Lake and reservoir surface areas are an important proxy for freshwater availability. Advancements in machine learning (ML) techniques and increased accessibility of remote sensing data products have enabled the analysis of waterbody surface area dynamics on broad spatial scales. However, interpreting the ML results remains a challenge. While ML provides important tools for identifying patterns, the resultant models do not include mechanisms. Thus, the “black-box” nature of ML techniques often lacks ecological meaning. Using ML, we characterized temporal patterns in lake and reservoir surface area change from 1984 to 2016 for 103,930 waterbodies in the contiguous United States. We then employed knowledge-guided machine learning (KGML) to classify all waterbodies into seven ecologically interpretable groups representing distinct patterns of surface area change over time. Many waterbodies were classified as having “no change” (43%), whereas the remaining 57% of waterbodies fell into other groups representing both linear and nonlinear patterns. This analysis demonstrates the potential of KGML not only for identifying ecologically relevant patterns of change across time but also for unraveling complex processes that underpin those changes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

The foxtail millet ( Setaria italica ) terpene synthase gene family

Terpenoid metabolism plays vital roles in stress defense and the environmental adaptation of monocot crops. Here, we describe the identification of the terpene synthase (TPS) gene family of the panicoid food and bioenergy model crop foxtail millet (Setaria italica). The diploid S. italica genome contains 32 TPS genes, 17 of which were biochemically characterized in this study. Unlike other thus far investigated grasses, S. italica contains TPSs producing all three ent-, (+)- and syn-copalyl pyrophosphate stereoisomers that naturally occur as central building blocks in the biosynthesis of distinct monocot diterpenoids. Conversion of these intermediates by the promiscuous TPS SiTPS8 yielded different diterpenoid scaffolds. Additionally, a cytochrome P450 monooxygenase (CYP99A17), which genomically clustered with SiTPS8, catalyzes the C19 hydroxylation of SiTPS8 products to generate the corresponding diterpene alcohols. The presence of syntenic orthologs to about 19% of the S. italica TPSs in related grasses supports a common ancestry of selected pathway branches. Among the identified enzyme products, abietadien-19-ol, syn-pimara-7,15-dien-19-ol and germacrene-D-4-ol were detectable in planta, and gene expression analysis of the biosynthetic TPSs showed distinct and, albeit moderately, inducible expression patterns in response to biotic and abiotic stress. In vitro growth-inhibiting activity of abietadien-19-ol and syn-pimara-7,15-dien-19-ol against Fusarium verticillioides and Fusarium subglutinans may indicate pathogen defensive functions, whereas the low antifungal efficacy of tested sesquiterpenoids supports other bioactivities. Together, these findings expand the known chemical space of monocot terpenoid metabolism to enable further investigations of terpenoid-mediated stress resilience in these agriculturally important species.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Classification of River Catchments in the Contiguous United States: Code, Dataset, Similarity Patterns, and Resulting Classes

This dataset serves as supplementary information for the paper by Ciulla F. and Varadharajan C. A Network Approach for Multiscale Catchment Classification using Traits (see reference 1). It contains environmental and physical catchment traits, such as temperatures, precipitation, land use and human interference, from 9067 sites across the contiguous United States (CONUS). The purpose of this dataset is to provide information for a better trait-based categorization of river catchments in the CONUS using networks as an analytical tool. The traits variables match the ones present in the GAGES-II dataset and the preprocessing steps are described in the Methods section (processed_dataset.csv). Additionally we include the topologies (nodes, edges and clusters, also referred as classes) of the catchment network and traits network generated by said dataset (csv and json files). A series of tables support the information carried by the network providing more detailed descriptions of cluster components (SI1.pdf). A summary of all the plots of clusters of catchments with at least 50 nodes is provided (SI2.pdf). The characteristic traits for each cluster of catchments is presented as z-score (traits_categories_zscores_per_catchment_class.csv). The link to the hydrological behavior of clusters of catchments is displayed by boxplots, each describing a particular river discharge index (SI3.pdf). Both csv and json files can be read by common text editors but the data contained into them can be better handled using programming languages like python and database oriented libraries like pandas. Pdf files can be read by any pdf reader software.[02-23-2024] Update: The code and datasets necessary to reproduce the results of the study are available as a zipped repository (code_datasets_catchments_similarity.zip).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

Application health monitoring for extreme-scale resiliency using cooperative fault management

Resiliency is and will be a critical factor in determining scientific productivity on current and exascale supercomputers, and beyond. Applications oblivious to and incapable of handling transient soft and hard errors could waste supercomputing resources or, worse, yield misleading scientific insights. In this work, we introduce a novel application-driven silent error detection and recovery strategy based on application health monitoring. Our methodology uses application output that follows known patterns, as indicators of an application's health and knowledge that violation of these patterns could be indication of faults. Information from system monitors that report hardware and software health status is used to corroborate faults. Collectively, this information is used by a fault coordinator agent to take preventive and corrective measures by applying computational steering to an application between checkpoints. This cooperative fault management system uses the Fault Tolerance Backplane as a communication channel. The benefits of this framework are demonstrated with two real application case studies, molecular dynamics, and quantum chemistry simulations, on scalable clusters with simulated memory and I/O corruptions. Lastly, the developed approach is general and can be easily applied to other applications.

97 MATHEMATICS AND COMPUTING↗