Engineering Papers⌕ Search

Engineering topics

Nguyen, Bao

Publications and source records attributed to Nguyen, Bao.

Enforcing End-to-end I/O Policies for Scientific Workflows using Software-Defined Storage Resource Enclaves

Data-intensive knowledge discovery requires scientific applications to run concurrently with analytics and visualization codes executing in situ for timely output inspection and knowledge extraction. Consequently, I/O pipelines of scientific workflows can be long and complex because they comprise many stages of analytics across different layers of the I/O stack of high-performance computing systems. Performance limitations at any I/O layer or stage can cause an I/O bottleneck resulting in greater than expected end-to-end I/O latency. In this paper, we present the design and implementation of a novel data management infrastructure called Software-Defined Storage Resource Enclaves (SIREN) at system level to enforce end-to-end policies that dictate an I/O pipeline's performance. SIREN provides an I/O performance interface for users to specify the desired storage resources in the context of in-situ analytics. If suboptimal performance of analytics is caused by an I/O bottleneck when data are transferred between simulations and analytics, schedulers in different layers of the I/O stack automatically provide the guaranteed lower bounds on I/O throughput. Lastly, our experimental results demonstrate that SIREN provides performance isolation among scientific workflows sharing multiple storage servers across two I/O layers (burst buffer and parallel file systems) while maintaining high system scalability and resource utilization.

97 MATHEMATICS AND COMPUTING↗

Persistent Octrees for Parallel Mesh Refinement Through Non-Volatile Byte-Addressable Memory

We report that octree-based mesh adaptation has enabled simulations of complex physical phenomena. Existing meshing algorithms were proposed with the assumption that computer memory is volatile. Consequently, for failure recovery, the in-core algorithms need to save memory states as snapshots with slow file I/Os. The out-of-core algorithms store octants on disks for persistence. However, neither of them was designed to leverage unique characteristics of non-volatile byte-addressable memory (NVBM). In this paper, we propose a novel data structure Distributed Persistent Merged octree (DPM-octree) for both meshing and in-memory storage of persistent octrees using NVBM. It is a multi-version data structure and can recover from failures using its earlier persistent version stored in NVBM. In addition, we design a feature-directed sampling approach to help dynamically transform the DPM-octree layout for reducing NVBM-induced memory write latency. DPM-octree uses parity trees which are created using erasure coding and stored in NVBM to support low-latency in-memory octant recovery after data loss. DPM-octree has been successfully integrated with Gerris software for simulation of fluid dynamics. Finally, our experimental results with real-world scientific workloads show that DPM-octree scales up to 1.1 billion mesh elements with 1000 processors on the Titan supercomputer.

97 MATHEMATICS AND COMPUTING↗

DeStager: feature guided in-situ data management in distributed deep memory hierarchies

In-situ analytics have been increasingly adopted by leadership scientific applications to gain fast insights into massive output data of simulations. With the current practice, systems buffer the output data in DRAM for analytics processing, constraining it to DRAM capacity un-used by the simulation. The rapid growth of data size requires alternative approaches to accommodating data-rich analytics, such as using solid-state disks to increase effective memory capacity. For this purpose, this paper explores software solutions for exploring the deep memory hierarchies expected on future high-end machines. Leveraging the fact that many analytics are sensitive to data features (regions-of-interest) hidden in the data being processed, the approach incorporates the knowledge of the data features into in-situ data management. It uses adaptive index creation/refinement to reduce the overhead of index management. In addition, it uses data features to predict data skew and improve load balance through controlling data distribution and placement on distributed staging servers. The experimental results show that such feature-guided optimizations achieve substantial improvements over state-of-the-art approaches for managing output data in-situ.

Computer Science↗

Compositional shifts in root-associated bacterial and archaeal microbiota track the plant life cycle in field-grown rice

Bacterial communities associated with roots impact the health and nutrition of the host plant. The dynamics of these microbial assemblies over the plant life cycle are, however, not well understood. Here, we use dense temporal sampling of 1,510 samples from root spatial compartments to characterize the bacterial and archaeal components of the root-associated microbiota of field grown rice ( Oryza sativa ) over the course of 3 consecutive growing seasons, as well as 2 sites in diverse geographic regions. The root microbiota was found to be highly dynamic during the vegetative phase of plant growth and then stabilized compositionally for the remainder of the life cycle. Bacterial and archaeal taxa conserved between field sites were defined as predictive features of rice plant age by modeling using a random forest approach. The age-prediction models revealed that drought-stressed plants have developmentally immature microbiota compared to unstressed plants. Further, by using genotypes with varying developmental rates, we show that shifts in the microbiome are correlated with rates of developmental transitions rather than age alone, such that different microbiota compositions reflect juvenile and adult life stages. These results suggest a model for successional dynamics of the root-associated microbiota over the plant life cycle.

59 BASIC BIOLOGICAL SCIENCES↗

Application of Human-Autonomy Teaming to an Advanced Ground Station for Reduced Crew Operations

Within human factors there is burgeoning interest in the "human-autonomy teaming" (HAT) concept as a way to address the challenges of interacting with complex, increasingly autonomous systems. The HAT concept comes out of an aspiration to interact with increasingly autonomous systems as a team member, rather than simply use automation as a tool. The authors, and others, have proposed core tenets for HAT that include bi-directional communication, automation and system transparency, and advanced coordination between human and automated teammates via predefined, dynamic task sequences known as "plays." It is believed that, with proper implementation, HAT should foster appropriate teamwork, thus increasing trust and reliance on the system, which in turn will reduce workload, increase situation awareness, and improve performance. To this end, HAT has been demonstrated and/or studied in multiple applications including search and rescue operations, healthcare and medicine, autonomous vehicles, photography, and aviation. The current paper presents one such effort to apply HAT. It details the design of a HAT agent, developed by Human Automation Teaming Solutions, Inc., to facilitate teamwork between the automation and the human operator of an advanced ground dispatch station. This dispatch station was developed to support a NASA project investigating a concept called Reduced Crew Operations (RCO); consequently, we have named the agent R-HATS. Part of the RCO concept involves a ground operator providing enhanced support to a large number of aircraft with a single pilot on the flight deck. When assisted by R-HATS, operators can monitor and support or manage a large number of aircraft and use plays to respond in real-time to complicated, workload-intensive events (e.g., an airport closure). A play is a plan that encapsulates goals, tasks, and a task allocation strategy appropriate for a particular situation. In the current implementation, when a play is initiated by a user, R-HATS determines what tasks need to be completed and has the ability to autonomously execute them (e.g., determining diversion options and uplinking new routes to aircraft) when it is safe and appropriate. R-HATS has been designed to both support end users and researchers in RCO and HAT. Additionally, R-HATS and its underlying architecture were developed with generalizability in mind as a modular software applicable outside of RCO/aviation domains. This paper will also discuss future further development and testing of RHATS.

automation↗

Cryotank Skin/Stringer Bondline Analysis

The need for light weight structure for advanced launch systems have presented great challenges and led to the usage of composites materials in a variety of structural assemblies where joining of two or more components is imperative. Although joints can be mechanically bolted, adhesive bonding has always been a very desirable method for joining the composite components, particularly for the cryotank systems, to achieve maximum structural efficiency. This paper presents the analytical approach resulted from the conceptual development of the DC-Y composite cryotank, conducted under the NASA/Boeing NRA 8-12 Partnership, to support the continued progress of SSTO (Single-Stage-To-Orbit) concepts. One of the critical areas of design was identified as the bonded interface between the skin (tank wall) and stringer. The approach to analyze this critical area will be illustrated through the steps which were used to evaluate the structural integrity of the bondline. Detailed finite element models were developed and numerous coupon test data were also gathered as part of the approach. Future plan is to incorporate this approach as a building block in analyzing bondline for the cryotank systems of RLVs (Reusable Launch Vehicles).

Nguyen, Bao↗