Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed architecture”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49

Traffic information computing platform for big data

Big data environment create data conditions for improving the quality of traffic information service. The target of this article is to construct a traffic information computing platform for big data environment. Through in-depth analysis the connotation and technology characteristics of big data and traffic information service, a distributed traffic atomic information computing platform architecture is proposed. Under the big data environment, this type of traffic atomic information computing architecture helps to guarantee the traffic safety and efficient operation, more intelligent and personalized traffic information service can be used for the traffic information users.

97 MATHEMATICS AND COMPUTING↗

Accelerating the Global Arrays ComEx Runtime using Multiple Progress Ranks

Partitioned Global Address Space (PGAS) models are part of system software that are being designed to support communication runtime for exascale applications. Suitability of using MPI as a scalable PGAS communication subsystem has been shown as a viable option due to its standardization and higher performance. We used MPI two-sided semantics with a combination of automatic and user defined splitting of MPI communicators to achieve asynchronous progress. Our implementation can make use of multiple asynchronous progress ranks (PR) per node that can be mapped to the computing architecture of a node in a distributed cluster. We are able to show significant speed up of over 2.0X and scaling of communication bound computational chemistry application over 1024 nodes of state- of-the-art HPC clusters. Our results show that while running a communication bound application workload on a certain number of cluster nodes, a use of optimum number of ranks dedicated for communication may be used to achieve asynchronous communication progress and obtain highest performance.

PGAS, global-arrays, NWCHEM, NWChemEx, HPC, GPGPU↗

Accelerating the Customer-Driven Microgrid Through Real-Time Digital Simulation

Comprehensive design and testing of realistic customer-driven microgrids requires a high performance simulation platform capable of incorporating power system and control models with external hardware systems. Traditional non real-time simulation is unable to fully capture the level of detail necessary to expose real-world implementation issues. With a real-time digital simulator as its foundation, a high-fidelity simulation environment that includes a robust electrical power system model, advanced control architecture, and a highly adaptable communication network is introduced. Hardware-in-the-loop implementation approaches for the hardware-based control and communication systems are included. An overview of the existing power system model and its suitability for investigation of autonomous island formation within the microgrid is additionally presented. Further test plans are also documented.

99 GENERAL AND MISCELLANEOUS↗

Enabling the High Level Synthesis of Data Analytics Accelerators

Conventional High Level Synthesis (HLS) tools mainly tar- get compute intensive kernels typical of digital signal pro- cessing applications. We are developing techniques and ar- chitectural templates to enable HLS of data analytics appli- cations. These applications are memory intensive, present fine-grained, unpredictable data accesses, and irregular, dy- namic task parallelism. We discuss an architectural tem- plate based around a distributed controller to efficiently ex- ploit thread level parallelism. We present a memory in- terface that supports parallel memory subsystems and en- ables implementing atomic memory operations. We intro- duce a dynamic task scheduling approach to efficiently ex- ecute heavily unbalanced workload. The templates are val- idated by synthesizing queries from the Lehigh University Benchmark (LUBM), a well know SPARQL benchmark.

Data Analytics↗

interactEM v1.0

An interactive, container-based workflow tool for creating and spawning directed acyclic graphs (DAGs) of operators in a distributed environment. It has a microservices architecture, and flow-based programming model. Current tools like this do not enable streaming of data directly between operators.

Welborn, Sam [Lawrence Berkeley National Laborator↗

Position Papers for the ASCR Workshop on Cybersecurity and Privacy for Scientific Computing Ecosystems

At the request of the Department of Energy's (DOE) Office of Advanced Scientific Computing Research (ASCR), this program committee has been tasked with organizing a workshop to identify basic research needs in cybersecurity and privacy to better support DOE's science and energy mission. As part of the process, the program committee is soliciting community input in the form of position papers to help identify significant use cases, facility issues, and other barriers to enabling verifiably trustworthy computational science while preserving data confidentiality as appropriate for scientific workflows of interest to DOE. The program committee will review these position papers and based on the fit of their area of expertise and interest, selected contributors will have the opportunity to participate in the workshop currently planned as a virtual event November 3-5th, 2021. The thrust areas that will be explored by this workshop are the following: (1) Algorithms for secure, scalable, privacy-enhancing technologies and frameworks, including: Federated AI/ML, Differential privacy, Randomized algorithms, Adversarial modeling & simulation, Graph algorithms, and Formal methods; (2) Platforms to support the entire scientific-computing ecosystem, including edge computing for large-scale experiments, focusing on heterogeneous systems and distributed systems, including: Heterogeneous computing systems, Distributed computing systems, and Secure data architectures; and (3) Data workflows to allow agile use of data while preserving integrity and privacy, making the important properties verifiable either at runtime or post-computation, including: Integrity and provenance and Data management infrastructure. Topics that are out-of-scope for the workshop include discussing specific proposed solutions or areas that are clearly out of DOE's fundamental and applied-sciences mission scope, e.g., cryptography, enterprise security, and general-operations technology.

97 MATHEMATICS AND COMPUTING↗

High-Power Electric Vehicle Charging Hub Integration Platform (eCHIP): Design Guidelines and Specifications for DC Distribution-Based Charging Hub

Managed under U.S. Department of Energy (DOE)-funded EVs@Scale Consortium, High-Power Electric Vehicle Charging Hub Integration Platform (eCHIP) project aims to design and develop a high-power, interoperable charging experimental platform to research, develop, and demonstrate the integration and control approaches for a DC distribution-based high-power charging (HPC) system. The eCHIP project addresses the crucial need to design and validate efficient, low-cost, reliable, and interoperable solutions for DC-coupled charging hub ('DC hub' for short). This report explains the design, development, and implementation process of the experimental platform for the DC hub. The utilization of DC distribution holds significant potential for enhancing the operation of an HPC station architecture. However, there are challenges establishing the DC hub, including interoperability, commoditization, distributed energy resource integration, stability, DC protection, and lack of common system level controllers. To address these challenges, a testing setup is required that accommodates commercial off-the-shelf (COTS) products as well as novel, in-house designed solutions to evaluate different use cases at rated power and voltage levels.

33 ADVANCED PROPULSION SYSTEMS↗

Captan+X Data Converter Integration

Fermi National Accelerator Laboratory's CAPTAN (Compact And Programmable daTa Acquisition Node) series provides a flexible hardware platform for data acquisition across a range of experiments and facilities. The latest iteration, CAPTAN+X, is built around a Kintex-7 FPGA supporting four FPGA Mezzanine Card (FMC) connections. As part of a broader laboratory effort to bring facility systems under a Model-Based Systems Engineering (MBSE) framework, CAPTAN+X is one of several systems slated to be incorporated into this modeling environment in the near term. A necessary step toward that goal is incorporating the platform's core functionality, which centers on integration with the LXD31K4 FMC, a data converter module combining dual AD9652 analog-to-digital converters and dual AD9142A digital-to-analog converters. Achieving compatibility required resolving pin-mapping conflicts between the LXD31K4's High Pin Count connector and the CAPTAN+X's available pin types, adapting a Board Support Project originally written for an UltraScale-class evaluation board to the Kintex-7 architecture, replacing incompatible primitives, restructuring clock distribution, and manually configuring chip initialization in place of an unsupported soft-processor-based approach. Functional verification of the ADC and DAC channels, followed by closed-loop testing combining both converters with real-time filtering, confirmed correct operation of the integrated system. These results establish a working hardware and firmware baseline for the CAPTAN+X platform, positioning it for future inclusion in the laboratory's growing MBSE modeling effort.

Espinoza, David [Illinois U., Urbana (main)]↗

Microprocessor utilization in satellite-borne packet switching

The application of a bit slice microprocessor to a satellite-borne packet switch, serving geographically distributed users, is discussed. A system architecture that employs this packet switch is examined, and the performance of the switch is evaluated by obtaining an upper bound on the system throughput.

Burnell, J. F.↗

Government Information Locator Service (GILS). Draft report to the Information Infrastructure Task Force

This is a draft report on the Government Information Locator Service (GILS) to the National Information Infrastructure (NII) task force. GILS is designed to take advantage of internetworking technology known as client-server architecture which allows information to be distributed among multiple independent information servers. Two appendices are provided -- (1) A glossary of related terminology and (2) extracts from a draft GILS profile for the use of the American National Standard Information Retrieval Application Service Definition and Protocol Specification for Library Applications.

Source record↗

SAVA 3: A testbed for integration and control of visual processes

The development of an experimental test-bed to investigate the integration and control of perception in a continuously operating vision system is described. The test-bed integrates a 12 axis robotic stereo camera head mounted on a mobile robot, dedicated computer boards for real-time image acquisition and processing, and a distributed system for image description. The architecture was designed to: (1) be continuously operating, (2) integrate software contributions from geographically dispersed laboratories, (3) integrate description of the environment with 2D measurements, 3D models, and recognition of objects, (4) capable of supporting diverse experiments in gaze control, visual servoing, navigation, and object surveillance, and (5) dynamically reconfiguarable.

Crowley, James L.↗

Validating spatial structure in canopy water content using geostatistics

Heterogeneity in ecological phenomena are scale dependent and affect the hierarchical structure of image data. AVIRIS pixels average reflectance produced by complex absorption and scattering interactions between biogeochemical composition, canopy architecture, view and illumination angles, species distributions, and plant cover as well as other factors. These scales affect validation of pixel reflectance, typically performed by relating pixel spectra to ground measurements acquired at scales of 1m(exp 2) or less (e.g., field spectra, foilage and soil samples, etc.). As image analysis becomes more sophisticated, such as those for detection of canopy chemistry, better validation becomes a critical problem. This paper presents a methodology for bridging between point measurements and pixels using geostatistics. Geostatistics have been extensively used in geological or hydrogeolocial studies but have received little application in ecological studies. The key criteria for kriging estimation is that the phenomena varies in space and that an underlying controlling process produces spatial correlation between the measured data points. Ecological variation meets this requirement because communities vary along environmental gradients like soil moisture, nutrient availability, or topography.

Sanderson, E. W.↗

Mapping Rock and Soil Units in the MPF IMP SuperPan Using a Kohonen Self Organizing Map

The 1997 Mars Pathfinder mission provided information on a site in the Ares Vallis floodplain. Initial analysis of multispectral data from the Imager for Mars Pathfinder (IMP) indicated the presence of only a single rock type, the 'gray rock' spectral class and various coated variants thereof (e.g., 'maroon rock'). Continued analysis of the IMP 'SuperPan' mosaic has confirmed multiple examples of a second 'black rock' spectral class existing as small cobbles in the near field and as boulders in the far field. These results are consistent with recent analysis of MGS Thermal Emission Spectrometer (TES) data which indicates that there is likely a mix of both 'Surface Type 1' (ST1) and 'Surface Type 2' (ST2) spectral classes at the MPF landing site. Nominally, the black rock spectral class would correspond to ST1 (basalts) and 'gray rock' would correspond to ST2 (andesites). Orbital remote sensing has also revealed the pervasive presence of layering on Mars. Recently it was suggested that there are extensive outcrops of the black rock spectral class in the SuperPan far field on the flanks of the Twin Peaks and on the rim of Big Crater. These authors suggested that these exposures represented outcrops of black rock from beneath a surficial, flood deposited layer. In this work, we have reexamined the MPF IMP SuperPan mosaic using an artificial neural network self organizing map (SOM) processing architecture in order to classify the distribution of spectral classes within the SuperPan. In this paper, we present initial results from that work and draw specific attention to a subset of the identified spectral classes in order to address questions relating to whether there are extensive exposures of black rock in the IMP far field, what other materials might be exposed in the far field, and what evidence there is for subsurface layering at the MPF landing site.

Farrand, W.↗

Making Sense of Rocket Science - Building NASA's Knowledge Management Program

The National Aeronautics and Space Administration (NASA) has launched a range of KM activities-from deploying intelligent "know-bots" across millions of electronic sources to ensuring tacit knowledge is transferred across generations. The strategy and implementation focuses on managing NASA's wealth of explicit knowledge, enabling remote collaboration for international teams, and enhancing capture of the key knowledge of the workforce. An in-depth view of the work being done at the Jet Propulsion Laboratory (JPL) shows the integration of academic studies and practical applications to architect, develop, and deploy KM systems in the areas of document management, electronic archives, information lifecycles, authoring environments, enterprise information portals, search engines, experts directories, collaborative tools, and in-process decision capture. These systems, together, comprise JPL's architecture to capture, organize, store, and distribute key learnings for the U.S. exploration of space.

knowledge management organizational learning NASA ↗

A Global Repository for Planet-Sized Experiments and Observations

Working across U.S. federal agencies, international agencies, and multiple worldwide data centers, and spanning seven international network organizations, the Earth System Grid Federation (ESGF) allows users to access, analyze, and visualize data using a globally federated collection of networks, computers, and software. Its architecture employs a system of geographically distributed peer nodes that are independently administered yet united by common federation protocols and application programming interfaces (APIs). The full ESGF infrastructure has now been adopted by multiple Earth science projects and allows access to petabytes of geophysical data, including the Coupled Model Intercomparison Project (CMIP) output used by the Intergovernmental Panel on Climate Change assessment reports. Data served by ESGF not only include model output (i.e., CMIP simulation runs) but also include observational data from satellites and instruments, reanalyses, and generated images. Metadata summarize basic information about the data for fast and easy data discovery.

Earth Systems Grid Federation (ESGFC)↗

Bioinspired multilayered cellular composites with enhanced energy absorption and shape recovery

Inspired by the multiscale configuration of the microstructure of cork, the paper describes the design, 3D printing, and evaluation of a new type of multilayered cellular composite (MCC) structure composed of hard brittle and soft flexible phases. The mechanical behavior of 3D printed MCC structures have been investigated both experimentally and numerically. The experiments show that the MCC structure absorbs four times the amount of energy of a conventional cellular configuration under compressive strains up to 70%. Finite element simulations and 2D digital image correlation (DIC) also show that the multilayered architecture provides a more uniform strain distribution and higher stress transfer efficiency, with a resulting progressive failure mode rather than a catastrophic one. Cyclic loading tests demonstrate that the MCC structure also possesses exceptional shape recoverability under compressive deformations up to 40%. These remarkable performance characteristics result from synergies between the properties of the two constituent materials and the chosen multilayered cellular microstructure. The soft phase, in particular, plays a pivotal role in absorbing elastic energy during loading and then releasing the stored energy while unloading. The volume fraction of the soft phase is also essential to control energy absorption and the transition of failure modes. The deformation mechanisms demonstrated here are robust and applicable to other architected cellular materials across multiple length scales and suggest new ways to design lightweight and high-resilience structural materials.

bioinspired composites↗

Process Modeling of Woven Textiles

Woven polymer matrix composites offer numerous advantages over traditional unidirectional laminates. Processing conditions affect residual stress that builds up during manufacturing. This work proposes the analysis of three curing parameters on the local residual stress distribution of a plain weave textile architecture, including chemical shrinkage, the temperature cool down, and the evolution of matrix properties as a function of curing. Virtual curing is applied to the inter-tow matrix material of the plain weave Repeating Unit Cell (RUC) modeled in TexGen. Curing is implemented through user-written subroutines within the commercial software suite Abaqus. Results from process modeling are compared with a linear-elastic thermal cool down in Abaqus. A boundary conditions study is also conducted to compare the residual stress build up predicted by Flat(FBCs) and Periodic Boundary Conditions (PBCs). Preliminary results indicate that a thermal cool down over-estimates the end-of-cure stresses in the matrix. Process modeling is conducted with and without chemical shrinkage, then compared with a thermal cool down. Results show that 11.32% of the final stress state is due to chemical shrinkage. Material property evolution during curing also has a non-negligible effect on the end stress.

woven composites↗

Integration experiments and performance studies of a COTS parallel archive system

Current and future Archive Storage Systems have been asked to (a) scale to very high bandwidths, (b) scale in metadata performance, (c) support policy-based hierarchical storage management capability, (d) scale in supporting changing needs of very large data sets, (e) support standard interface, and (f) utilize commercial-off-the-shelf (COTS) hardware. Parallel file systems have been asked to do the same thing but at one or more orders of magnitude faster in performance. Archive systems continue to move closer to file systems in their design due to the need for speed and bandwidth, especially metadata searching speeds such as more caching and less robust semantics. Currently the number of extreme highly scalable parallel archive solutions is very small especially those that will move a single large striped parallel disk file onto many tapes in parallel. We believe that a hybrid storage approach of using COTS components and innovative software technology can bring new capabilities into a production environment for the HPC community much faster than the approach of creating and maintaining a complete end-to-end unique parallel archive software solution. In this paper, we relay our experience of integrating a global parallel file system and a standard backup/archive product with a very small amount of additional code to provide a scalable, parallel archive. Our solution has a high degree of overlap with current parallel archive products including (a) doing parallel movement to/from tape for a single large parallel file, (b) hierarchical storage management, (c) ILM features, (d) high volume (non-single parallel file) archives for backup/archive/content management, and (e) leveraging all free file movement tools in Linux such as copy, move, Is, tar, etc. We have successfully applied our working COTS Parallel Archive System to the current world's first petafiop/s computing system, LANL's Roadrunner machine, and demonstrated its capability to address requirements of future archival storage systems.

99 GENERAL AND MISCELLANEOUS↗