Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data flow”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

Implementation of ATLAS Distributed Computing monitoring dashboards using InfluxDB and Grafana

For the last 10 years, the ATLAS Distributed Computing project has based its monitoring infrastructure on a set of custom designed dashboards provided by CERN. This system functioned very well for LHC Runs 1 and 2, but its maintenance has progressively become more difficult and the conditions for Run 3, starting in 2021, will be even more demanding; hence a more standard code base and more automatic operations are needed. A new infrastructure has been provided by CERN, based on InfluxDB as the data store and Grafana as the display environment. ATLAS has adapted and further developed its monitoring tools to use this infrastructure for data and workflow management monitoring and accounting dashboards, expanding the range of previous possibilities with the aim to achieve a single, simpler, environment for all monitoring applications. This document describes these tools and the data flows for monitoring and accounting.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Concept of Operations of Next-Generation Traffic Control Utilizing Infrastructure-Based Cooperative Perception

This paper provides a system architecture for an infrastructure-based cooperative perception fusion engine for next-generation traffic control. This engine will provide a complete state-space digital representation with measurable accuracy to support a wide-range of applications. The architecture includes inputs, functional flow, data standardization recommendations, outputs, and supported applications. The cooperative perception engine addresses critical needs with respect to accelerating the benefits of automation through intelligent roadway infrastructure, which complements and accelerates connected and automated vehicle (CAV) technology. The cooperative perception acquires and fuses information from sensors (radar, LiDAR, and cameras) and CAVs to perceive roadway traffic states of moving objects, creates a complete 3D digital representation of that state-space, and communicates it to downstream application such as intelligent signal control, safety and energy applications, and cooperate driving applications. The intelligent roadway infrastructure approach, as opposed to a vehicle-centric approach, is more scalable because it can be deployed to the roughly 300,000 signalized intersections more readily than over 300 million vehicles in the United States, and accrues early-stage benefits equitable to all roadway users addressing safety, equity, fuel efficiency, and greenhouse gas reduction.

ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2024

Time calibration and synchronization of the scintillation light detection system in ICARUS-T600

The ICARUS-T600 Liquid Argon (LAr) Time Projection Chamber (TPC) is presently taking data in the Short Baseline Neutrino (SBN) program at Fermilab (U.S.A.) to search for a possible LSND-like sterile neutrino signal at Δm 2 ≈ 1 eV 2 with the Booster Neutrino Beam (BNB). A light detection system, based on 360 large area Photo-Multiplier Tubes (PMTs), has been realized for ICARUS-T600 to detect VUV photons produced by the passage of ionizing particles in LAr. This system is fundamental for the TPC operation, providing an efficient trigger and contributing to the 3D reconstruction of events. Moreover, since the detector is exposed to a huge flux of cosmic rays due to its shallow depths installation, the light detection system allows for the time reconstruction of events, contributing to the identification and to the selection of genuine neutrino interactions. The correct time reconstruction of events requires the precise knowledge of the delay of each PMT channel and a good synchronization of recording electronics, this last based on fast sampling digitizers. To achieve a time resolution better than 1 ns, we perform three consecutive timing corrections deployed at different stages of the optical data flow. Results demonstrate the capability of the ICARUS-T600 light detection system to allow a precise reconstruction of the temporal evolution of each event occurring in the detector and the association of neutrino events with the bunched structure of BNB.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Sensitivity of Au + Au collisions to the symmetric nuclear matter equation of state at 2–5 nuclear saturation densities

We demonstrate that proton and pion flow measurements in heavy-ion collisions at incident energies ranging from 1 to 20 GeV per nucleon in the fixed target frame can be used for an accurate determination of the symmetric nuclear matter equation of state at baryon densities equal 2–4 times nuclear saturation density n 0 . We simulate Au + Au collisions at these energies using a hadronic transport model with an adjustable vector mean-field potential dependent on baryon density n B . Here, we show that the mean field can be parametrized to reproduce a given density dependence of the speed of sound at zero temperature $c$$^{2}_{s}$ (n B , T = 0), which we vary independently in multiple density intervals to probe the differential sensitivity of heavy-ion observables to the equation of state at these specific densities. Recent flow data from the STAR experiment at the center-of-mass energies √ s NN = {3.0, 4.5} GeV can be described by our model, and a Bayesian analysis of these data indicates a hard equation of state at n B ϵ (2, 3)n 0 and a possible phase transition at n B ϵ (3, 4)n 0 . More data at √ s NN = 2–5 GeV, as well as a more thorough analysis of the model systematic uncertainties will be necessary for a more precise conclusion.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Advances in Secure 5G Network for a Nationwide Drone Corridor

Recent research has validated the proposal to add a separate set of antennas for 5G coverage in the air, while the conventional set of antennas continues to provide coverage on the ground, for a nationwide drone corridor for 5G cellular drones. More importantly, this drone corridor can be made secure and reliable by adapting the drone trajectories to avoid interference and security attacks, and with advanced precoding and physical layer security. Energy efficiency can also be improved with low-resolution massive multiple-input multiple-output (MIMO) systems that utilize low resolution digital to analog converters. This paper describes additional research findings to further support the creation of this nationwide drone corridor. We design optimal drone trajectory within the drone corridor to improve safety for pedestrians and vehicles on the ground. We derive the optimum antenna uptilt angle to minimize outage probability for a given drone corridor. We also study the placement of intelligent reflector surfaces in an urban drone corridor in order to improve the multi-path scattering and hence the spatial multiplexing gains for serving drones. We calculate trajectories to maximize data rate in the presence of smart interference when drones are used as relays and each drone may be deployed in the paths of data flows from multiple BSs to multiple UEs. Next we demonstrate how the use of the additional set of antennas along with the 3GPP standard based subframe blanking method can minimize the interference from ground reflection of the radio frequency (RF) radiation from the downtilted antennas. The paper concludes with plans to continue with experimental studies to advance this work further.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2014

Compiler Optimization for Extreme-Scale Scripting

The data-driven task parallelism execution model can support parallel programming models that are well suited for large-scale distributed-memory parallel computing, for example, simulations and analysis pipelines running on clusters and clouds. We describe a novel compiler intermediate representation and optimizations for this execution model, including adaptions of standard techniques alongside novel techniques. These techniques are applied to Swift/T, a high-level scripting language for flexible data flow composition of functions, which may be serial or use lower-level parallel programming models such as MPI and OpenMP. This paper presents preliminary results, indicating that our compiler optimizations reduce communication overhead by 70% to 93% on distributed-memory systems.

Armstrong, Timothy G.↗
DOE OSTI2019

An Evaluation of An Asynchronous Task Based Dataflow Approach For Uintah

The challenge of running complex physics code on the largest computers available has led to dataflow paradigms being explored. While such approaches are often applied at smaller scales, the challenge of extreme-scale data flow computing remains. The Uintah dataflow framework has consistently used dataflow computing at the largest scales on complex physics applications. At present Uintah contains two main dataflow models. Both are based upon asynchronous communication. One uses a static graph-based approach with asynchronous communication and the other uses a more dynamic approach that was introduced almost a decade ago. Subsequent changes within the Uintah runtime system combined with many more large scale experiments, has necessitated a reevaluation of these two approaches, comparing them in the context of large scale problems. While the static approach has worked well for some large-scale simulations, the dynamic approach is seen to offer performance improvements over the static case for a challenging fluid-structure interaction problem at large scale that involves fluid flow and a moving solid represented using particle method on an adaptive mesh.

Humphrey, Alan↗
DOE OSTI2016

A Scientific Data Provenance API for Distributed Applications

Data provenance has been an active area of research as a means to standardize how the origin of data, process event history, and what or who was responsible for influencing results is explained. There are two approaches to capture provenance information. The first approach is to collect observed evidence produced by an executing application using log files, event listeners, and temporary files that are used by the application or application developer. The provenance translated from these observations is an interpretation of the provided evidence. The second approach is called disclosed because the application provides a firsthand account of the provenance based on the anticipated questions on data flow, process flow, and responsible agents. Most observed provenance collection systems collect lot of provenance information during an application run or workflow execution. The common trend in capturing provenance is to collect all possible information, then attempt to find relevant information, which is not efficient. Existing disclosed provenance system APIs do not work well in distributed environment and have trouble finding where to fit the individual pieces of provenance information. This work focuses on determining more reliable solutions for provenance capture. As part of the Integrated End-to-end Performance Prediction and Diagnosis for Extreme Scientific Workflows (IPPD) project, an API was developed, called Producer API (PAPI), which can disclose application targeted provenance, designed to work in distributed environments by means of unique object identification methods. The provenance disclosure approach used adds additional metadata to the provenance information to uniquely identify the pieces and connect them together. PAPI uses a common provenance model to support this provenance integration across disclosure sources. The API also provides the flexibility to let the user decide what to do with the collected provenance. The collected provenance can be sent to a triple store using REST services or it can be logged to a file.

Raju, Bibi↗
DOE OSTI2011

Pulse mode readout techniques for use with non-gridded industrial ionization chambers

Highly sensitive readout technique for precision long-term radiation measurements has been developed and tested in the Radiation Control Department at Jefferson Lab. The new electronics design is used to retrieve ionization data in a pulse mode. The dedicated data acquisition system works with M=Audio Audiophile 192 High-Definition 24-bit/192 kHz audio cards, taking data in continuous waveform recording mode. The on-line data processing algorithms extract signals of the ionization events from the data flow and measure the ionization value for each event. Two different ion chambers are evaluated. The first is a Reuter-Stokes Argon-filled (at 25 atm) High Pressure Ionization Chamber (HPIC), commonly used as a detector part in many GE Reuter-Stokes instruments of the RSS series. The second is a VacuTec Model 70181, 5 atm Xenon-filled ionization chamber. Results for both chambers indicate that the techniques allow using industrial ICs for high sensitivity and precision long-term radiation measurements, while at the same time providing information about spectral characteristics of the radiation fields.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Performance Testing and Assessment of Protection Scheme Using Real-Time Hardware-in-the-Loop and IEC 61850 Standard

The main challenge of the microgrid is to design a suitable protection scheme due to the complexity of the architecture of the microgrid. The importance of the proposed protection technique is threefold. First, it presents a co-simulation platform to integrate between a simulated model on power system computer aided design (PSCAD)/real time digital simulator computer aided design (RSCAD) software’s and physical devices schweitzer engineering laboratories (SEL) 421-7 relays to protect the microgrid that includes different resources connected based on inverter interface. Second, it presents a comprehensive hardware/software setup to test the protective relays in a closed loop system and shows how to configure the protective relay’s International Electrotechnical Commission 61850 communications. Third, IEEE 1588 standard is used to provide sub nanoseconds latency between the simulated model that emulated on real time digital simulator (RTDS) and the external devices. Also, the measurement signals are synchronized between RTDS and the external devices using giga-transceiver synchronization card (GTSYNC) interface card and SEL-2488 satellite-synchronized network clock. The results showed that the co-simulation infrastructure introduces a highly dependable design, analysis, and testing environment for cyber and physical data flow in the system. Besides that, the voltages at ac/dc sides and frequency at fault condition were maintained due to the energy storage device contributions at different modes of operation.

42 ENGINEERING↗
DOE OSTI2022

Crash Risks Evaluation of Urban Expressways: A Case Study in Shanghai

We report that proactive traffic safety management systems can reduce crashes by identifying crash precursors, evaluating real-time crash risks, and implementing suitable interventions. The basic prerequisite for developing such a system is to propose a reliable crash risk evaluation model that takes real-time traffic flow data as input. Previous studies have primarily focused on real-time crash prediction using some statistical or machine-learning methods. However, further quantitative evaluation and classification of crash risks have been ignored. In this study, we conduct a systematic crash risk evaluation workflow, including crash risk prediction, crash risk quantification, and crash risk classification. Specifically, the crash risk prediction using an extended logit model is proposed, from which CAS, CSD, UAS, DAS, DTV are identified to be contributing factors of crash risks. Then a crash risk quantification model based on the parameter evaluation of the extended logit model is developed. The crash risks of urban expressways and their spatial-temporal evolution trends are quantified. Finally, the crash risks are classified into high crash risk level, moderate crash risk level, and low crash risk level by the k-means cluster algorithm. Then the threshold boundaries of different crash risk levels are determined. The research results provide a proactive guidance for traffic safety management of urban expressways.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2015

The CNAO dose delivery system for modulated scanning ion beam radiotherapy

Purpose: This paper describes the system for the dose delivery currently used at the Centro Nazionale di Adroterapia Oncologica (CNAO) for ion beam modulated scanning radiotherapy. Methods: CNAO Foundation, Istituto Nazionale di Fisica Nucleare and University of Torino have designed, built, and commissioned a dose delivery system (DDS) to monitor and guide ion beams accelerated by a dedicated synchrotron and to distribute the dose with a full 3D scanning technique. Protons and carbon ions are provided for a wide range of energies in order to cover a sizable span of treatment depths. The target volume, segmented in several layers orthogonally to the beam direction, is irradiated by thousands of pencil beams which must be steered and held to the prescribed positions until the prescribed number of particles has been delivered. For the CNAO beam lines, these operations are performed by the DDS. The main components of this system are two independent beam monitoring detectors, called BOX1 and BOX2, interfaced with two control systems performing the tasks of real-time fast and slow control, and connected to the scanning magnets and the beam chopper. As a reaction to any condition leading to a potential hazard, a DDS interlock signal is sent to the patient interlock system which immediately stops the irradiation. The essential tasks and operations performed by the DDS are described following the data flow from the treatment planning system through the end of the treatment delivery. Results: The ability of the DDS to guarantee a safe and accurate treatment was validated during the commissioning phase by means of checks of the charge collection efficiency, gain uniformity of the chambers, and 2D dose distribution homogeneity and stability. A high level of reliability and robustness has been proven by three years of system activity needing rarely more than regular maintenance and working with 100% uptime. Four identical and independent DDS devices have been tested showing comparable performances and are presently in use on the CNAO beam lines for clinical activity. Conclusions: The dose delivery system described in this paper is one among the few worldwide existing systems to operate ion beam for modulated scanning radiotherapy. At the time of writing, it has been used to treat more than 350 patients and it has proven to guide and control the therapeutic pencil beams reaching performances well above clinical requirements. In particular, in terms of dose accuracy and stability, daily quality assurance measurements have shown dose deviations always lower than the acceptance threshold of 5% and 2.5%, respectively.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

PolyCheck: Dynamic Verification of Iteration Space Transformations on Affine Programs

High-level compiler transformations, especially loop transformations, are widely recognized as critical optimizations to restructure programs to improve data locality and expose parallelism. Guaranteeing the correctness of program transformations is essential, and to date three main approaches have been developed: proof of equivalence of affine programs, matching the execution traces of programs, and checking bit-by-bit equivalence of the outputs of the programs. Each technique suffers from limitations in either the kind of transformations supported, space complexity, or the sensitivity to the testing dataset. In this paper, we take a novel approach addressing all three limitations to provide an automatic bug checker to verify any iteration reordering transformations on affine programs, including non-affine transformations, with space consumption proportional to the original program data, and robust to arbitrary datasets of a given size. We achieve this by exploiting the structure of affine program control- and data-flow to generate at compile-time lightweight checker code to be executed within the transformed program. Experimental results assess the correctness and effectiveness of our method, and its increased coverage over previous approaches.

affine programs↗
DOE OSTI2017

Situational Awareness of Network System Roles (SANSR)

In a large enterprise it is difficult for cyber security analysts to know what services and roles every machine on the network is performing (e.g., file server, domain name server, email server). Using network flow data, already collected by most enterprises, we developed a proof-of-concept tool that discovers the roles of a system using both clustering and categorization techniques. The tool's role information would allow cyber analysts to detect consequential changes in the network, initiate incident response plans, and optimize their security posture. The results of this proof-of-concept tool proved to be quite accurate on three real data sets. We will present the algorithms used in the tool, describe the results of preliminary testing, provide visualizations of the results, and discuss areas for future work. Without this kind of situational awareness, cyber analysts cannot quickly diagnose an attack or prioritize remedial actions.

cyber security↗
DOE OSTI2018

LADR: low-cost application-level detector for reducing silent output corruptions

Applications running on future high performance computing (HPC) systems are more likely to experience transient faults due to technology scaling trends with respect to higher circuit density, smaller transistor size and near-threshold voltage (NTV) operations. A transient fault could corrupt application state without warning, possibly leading to incorrect application output. Such errors are called silent data corruptions (SDCs). In this paper, we present LADR, a low-cost application-level SDC detector for scientific applications. LADR protects scientific applications from SDCs by watching for data anomalies in their state variables (those of scientific interest). It employs compile-time data-flow analysis to minimize the number of monitored variables, thereby reducing runtime and memory overheads while maintaining a high level of fault coverage with low false positive rates. We evaluated LADR with 4 scientific workloads and results show that LADR achieved < 80% fault coverage with only ∼ 3% runtime overheads and ∼ 1% memory overheads. As compared to prior state-of-the-art anomaly-based detection methods, SDC achieved comparable or improved fault coverage, but reduced runtime overheads by 21% ∼ 75%, and memory overheads by 35% ∼ 55% for the evaluated workloads. We believe that such an approach with low memory and runtime overheads coupled with attractive detection precision makes LADR a viable approach for assuring the correct output from large-scale high performance simulations.

Chen, Chao↗
DOE OSTI2024

SmartFuse: Reconfigurable Smart Switches to Accelerate Fused Collectives in HPC Applications

Communication switches have sometimes been augmented to process collectives (e.g., the IBM BlueGene project and the Mellanox SHArP switch). In this work, we find that there is a great acceleration opportunity through the further augmentation of switches to accelerate more complex functions that combine communication with computation. We consider three types of such functions. The first is fully-fused collectives built by fusing multiple existing collectives like Allreduce with Alltoall. The second is semi-fused collectives built by combining a collective with another computation. The third we refer to as higher-order collectives built by combining multiple computations and communications, such as to perform matrix-matrix multiply (PGEMM). In this work, we propose a framework called SmartFuse to accelerate fused collective functions. The core of SmartFuse is a reconfigurable smart switch to support these operations. The semi/fully fused collectives are implemented with a CGRAlike architecture, while higher-order collectives are implemented with a more specialized computational unit that can also schedule communication. Supporting our framework is software to evaluate and translate relevant parts of the input program, compile them into a control data flow graph, and then map this graph to the switch hardware. The proposed framework, once deployed, has the strong potential to accelerate existing HPC applications transparently by encapsulation within an MPI implementation. Experimental results show that this approach improves the performance of the PGEMM kernel, MINIFE, and AMG by, on average, 94%, 15%, and 13%, respectively.

Haghi, Pouya↗
DOE OSTI2020

Indira: intent-based networking and rendering for networks (Indira) v1

Intelligent Network Deployment Intent Renderer Application an interactive network assistant that will help us configure a data path between two scientific end-point groups (EPGs) to optimize the transfer of elephant data flows. This tool is able to talk to scientists gather network requirements and then convert to network programming code and automate the end-to-end provisioning.

Pouyoul, Eric↗
DOE OSTI2022

Deep Lynx Unidirectional Network Connector

The Deep Lynx UNC is a small utility written in Python that uses only basic Python libraries and the Deep Lynx Python Software Development Kit (SDK). It queries Deep Lynx for tasks that indicate some data to be run in the UNC's environment. Once a task is acquired, the UNC retrieves the associated data and provides it to some other application for processing, waits for output, and sends the output from the other application to Deep Lynx. As data flows only from the UNC to Deep Lynx, this software solves the problem of connecting Deep Lynx with applications and resources that exist in a network where the network can reach Deep Lynx, but Deep Lynx cannot reach that network (unidirectional network).

Browning, JerenM↗