Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data transfer”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Remote Instrumentation and Data Acquisition: An Internship Research Report

This report outlines the development and implementation of a remote data acquisition system for waveform analysis using a Rohde & Schwarz oscilloscope. The project involved capturing waveform data, and transferring it to a local machine for visualization and analysis. The core logic was developed in C++ with a focus on object oriented programming and the use of polymorphism so the main application can interact with any instrument without knowing its exact type, simplifying the overall logic and making it easier to add or swap out components without changing the rest of the codebase.. The system issues Standard Commands for Programmable Instruments (SCPI) via a socket connection and parses the oscilloscope’s ASCII waveform data. The C++ application was containerized using Docker for ease of portability, and reproducibility. Emphasis was placed on secure networking practices, error handling, and effective data capture. The report describes the technical steps taken, challenges encountered, and lessons learned, providing insight into the practical integration of hardware interfacing with remote computational environments.

Parikh, Jaymil [Fermilab]↗

TEMPI: An Interposed MPI Library with Canonical Representation of MPI Datatypes [Poster]

TEMPI provides a transparent non-contiguous data-handling layer compatible with various MPIs. MPI Datatypes are a powerful abstraction for allowing an MPI implementation to operate on non-contiguous data. CUDA-aware MPI implementations must also manage transfer of such data between the host system and GPU. The non-unique and recursive nature of MPI datatypes mean that providing fast GPU handling is a challenge. The same noncontiguous pattern may be described in a variety of ways, all of which should be treated equivalently by an implementation. This work introduces a novel technique to do this for strided datatypes. Methods for transferring non-contiguous data between the CPU and GPU depends on the properties of the data layout. This work shows that a simple performance model can accurately select the fastest method. Unfortunately, the combination of MPI software and system hardware available may not provide sufficient performance. The contributions of this work are deployed on OLCF Summit through an interposer library which does not require privileged access to the system to use

97 MATHEMATICS AND COMPUTING↗

User-Oriented Improvements in the MOOSE framework in support of Multiphysics Simulation

The MOOSE Framework is a foundational capability used by NEAMS to create over 15 different simulation tools for advanced nuclear reactors. Due to this ubiquity, improvements to the framework in support of modeling and simulation goals are critical to the program. These improvements can take many forms including optimization, improved user experience, streamlined APIs, parallelism, and new capability. The work transcribed in the report was in direct support of the simulation tools and is already deployed or will be deployed in the coming months. The capabilities implemented were, in the same order as this report, chainable execution objects or executors, support for transfers between applications at the same level in a coupling scheme, support for boundary/subdomain restricted transfers, support for transfers between applications with different coordinate or unit systems, support for MOOSE applications in the NEAMS workbench, deployment of MOOSE application of the INL HPC OnDemand platform, addition of a triangular meshing library in libMesh and increased support of face variables.

97 MATHEMATICS AND COMPUTING↗

ThunderSecure: deploying real-time intrusion detection for 100G research networks by leveraging stream-based features and one-class classification network

Nowadays, data generated by large-scale scientific experiments are on the scale of petabytes per month. These data are transferred through dedicated high-bandwidth networks (40/100G) across distributed sites for processing, storage, and analysis. Like general purpose networks, research networks experience intrusions. However, monitoring anomalies in such high-speed network traffics is challenging given current cyber-infrastructure. Moreover, traditional network intrusion detection systems (NIDS) are signature based. However, anomaly patterns are difficult to define and that rulesets are often not updated frequently enough to reflect the changes of attack behaviors. We present ThunderSecure, a high-throughput, unsupervised learning-based intrusions detection system for 100G research networks. ThunderSecure implements an efficient packet processing and detection pipeline using multi-cores and GPUs. It extracts statistical and temporal features from real-time network data streams and feeds them to a one-class anomaly detection network. A baseline of normal distribution will be created based on the training observation. Testing traffic deviated from the learned profile will be marked as anomalies. We trained ThunderSecure on hundreds of billions of science data packets mirrored from two 100G network connections at Fermi National Accelerator Laboratory. The detection performance was evaluated on traffic captured from the same research network days and weeks after the training with different types of attack flows injected. Results show that ThunderSecure can recognize science data traffic captured long after the training and made nearly certain detection on the segment of the streams where anomalous flows were injected.

100G research network↗

Distributed ADMM Using Private Blockchain for Power Flow Optimization in Distribution Network With Coupled and Mixed-Integer Constraints

The optimization problem for scheduling distributed energy resources (DERs) and battery energy storage systems (BESS) integrated with the power grid is important to minimize energy consumption from conventional sources in response to demand. Conventionally this optimization problem is solved in a centralized manner, limiting the size of the problem that can be solved and creating a high communication overhead because all the data is transferred to the central controller. These limitations are addressed by the proposed distributed consensus-based alternating direction method of multiplier (DC-ADMM) optimization algorithm, which decomposes the optimization problem into subproblems with private cost function and constraints. The distribution feeder is partitioned into low coupling subnetworks/regions, which solves the private subproblem locally and exchanges information with the neighboring regions to reach consensus. The relaxation strategy is employed for mixed-integer and coupled constraints introduced in the optimal power flow (OPF) problem by stationary and transportable BESS because DC-ADMM convergence is only guaranteed for strict convex problems. The information exchange and synchronization between subnetworks/regions are vital for distributed optimization. In this work, both of these aspects are addressed by the blockchain. The smart contract deployed on the blockchain network acts as a mediator for secure data exchange and synchronization in distributed computation. The blockchain-based distributed optimization problem’s effectiveness is tested for a 0.5-MW laboratory microgrid for one hour ahead and day-ahead for the IEEE 123-bus and EPRI J1 test feeders, and results are compared with a centralized solution.

25 ENERGY STORAGE↗

Transfer-Learnt Energy Models for Predicting Electricity Consumption in Buildings with Limited and Sparse Field Data

Modeling energy consumption is critical for energy-efficient utilization of the electric appliances in a building, smart grid programs (like demand-response), and many other smart home applications. State-of-the-art energy modeling techniques either rely on theoretical models, or extensive instrumentation of the building envelope to gather ``big" data to train a deep neural network. While theoretical models are often limited by their estimation accuracy, it is not always feasible to gather a significant amount of field data. In this paper, we explore transfer learning-based strategies to train much more accurate model for energy estimation when using a sparse field data. We transferred knowledge, in the form of data and parameters, from the simulation framework to the field data. We evaluated the efficacy of our approach on field data collected from six commercial buildings and our results indicate that transfer learning-based models trained over one month data can perform comparative (and in some cases better) than the state-of-the-art machine learning and deep learning solutions.

Jain, Milan↗

A Novel Technique for Distributed Measuring of Strain in the Vadose Zone

Characterizing water content and pressure changes in the vadose zone is important to understanding a variety of geologic processes, ranging from permeability, to evapotranspiration, and aquifer recharge. Changes in water content, or pressure, cause strain in the solid porous medium of the vadose zone, and it is possible that measuring those strains could be used a characterization tool. The Coherence-length-gated Microwave Photonics Interferometry (CMPI) technique measures strain at high resolution along many intervals defined by pairs of reflectors distributed along an optical fiber. This technique has recently been developed at Clemson University, and it has the spatial, and temporal resolution to characterize the strains that are expected to occur with hydrologic changes in the vadose zone. However, the technique has never been used to measure strain in porous media, so its capabilities remain uncertain. The objective of this thesis is to evaluate the ability of using CMPI to measure strain changes in the vadose zone. The research approach consists of conducting laboratory tests using a column filled with sand that was subjected to changes in water content and pressure. An optical fiber with CMPI reflectors was deployed in a high surface area ribbon and used to measure strain along the axis of the column. The column was made from 8-inch, Schedule 40 PVC pipe (75 cm tall, 20 cm inner diameter) and filled with medium-grained sand (K = 2.5x10-6 m/s, porosity = 0.28, Coefficient of Uniformity = 2, van Genuchten (n = 4.34 and  = 0.00039 m-1), Young’s Modulus = 18 – 47 MPa). Five pressure and four temperature sensors attached to probes inserted into the wall. The optical fiber includes five reflectors spaced 10 cm apart on the inside and outside of the column along the vertical axis. Strain measurements are made between pairs of reflectors. The reflectors are created in 250-micron-diameter acrylate-coated single mode Corning SMF28e+ optical fiber using a femtosecond laser. The optical fiber was laminated between two pieces of polyester film creating a large surface area to transfer strain from the porous media to the optical fiber. The experiments were conducted by filling the column from the bottom or infiltrating water from the top. The water was allowed to equilibrate to room temperature prior to each test in order to limit thermoelastic strain. Five injection tests with a rate of 250 ml/min and three infiltration tests at varying rates were conducted, and the results show patterns of strain and pressure are generally similar. Hydrologic conditions define three zones based on the pressure magnitude and distribution. 1.) Ambient Zone where the pressure heads are quasi-static and the pressure gradient is roughly unity (head gradient of zero). This is the uppermost zone and is characterized by negative pressures. 2.) Transition Zone where the pressures increase from ambient to zero, are changing relatively rapidly and the pressure gradient is relatively steep (pressure head gradients of 2). The Transition zone is 10 to 15 cm thick. 3.) Positive Pressure Zone where the pressure is positive, the rate of change is slower than in the transition zone and the gradient is flatter (pressure head gradient 1.1 to 1.2). This is the lowest zone in the column. Injection of water causes the pressure to increase and the three zones to move upward. The Transition zone moves at a rate of approximately 0.0002 m/s +/- .00005, according to analyses of pressure profiles. This is the same as the average velocity of the water calculated as volumetric flux/effective porosity =5.4x10-5 m/s/0.28. Strain signals in the range of 10s  were observed with a noise level of generally less than 0.1  (signal to noise ratio of greater than 100) during injection and drainage. The spatial and temporal distributions of strain caused by injection depend on the location of the moving pressure zones. The locations of the different pressure zones were determined from pressure profiles at different times and these data were transferred to strain time series. This showed that strain in the Ambient pressure zone is either unchanged or slightly compressive, whereas strain in Transition zone is tensile and roughly proportional to the pressure change, and strain ranges from tensile to compressive in the Positive Pressure zone. In general, the strain is variable at the top of the Positive Pressure zone, but it appears to be consistently tensile lower in the zone. The spatial distribution of strain causes three distinct stages in the strain times series measured between pairs of CMPI reflectors. The strain is unchanged or slightly compressive during Stage 1, it increases (positive strain is tensile) approximately linearly at a rate of 0.02 to 0.03 μ/s during the Stage 2, and then flattens out in Stage 3. The strain increases again during Stage 4 of the time series. The pressure also changes in stages. It is unchanged during Stage 1 and then increases relatively rapidly at a rate of between 4 and 10 Pa/s during Stage 2 and continues to increase during Stages 3 and 4, but at a rate slightly slower than during Stage 2 (from 2.5 to 3.5 Pa/s). The rates of pressure and strain change are consistent with basic analyses. The rate of pressurization is similar to the calculated velocity of flow in the saturated zone, and this is similar to the measured velocity of the strain increase. The ratio of the pressurization rate and strain rate during Stage 2 (2.5 (Pa/s) /0.03 (μ/s)) is 80 MPa, which is approximately equal to the upper range expected considering the uniaxial compression and the Young’s Modulus of the sand. An interesting effect occurs when the upper surface of the sand becomes saturated. Significant compression (several 10s of ) occurs as the pressure and saturation increase at the upper surface. Compression occurs throughout the column, but the effect is greatest at the top of the column. The rate of compression is fastest slightly before ponding occurs, but it slows markedly and nearly stops when water starts to accumulate at the surface (ponding). This effect reverses when the surface of the sand is drained, resulting in tension throughout the column. The compression caused by this effect can be as large or larger than the tensile strain that accumulated during filling. This effect was unexpected because increasing pressure is normally associated with tensile strain. Nevertheless, this effect was observed consistently in all tests where the pressure changes at the upper surface, including tests where water was injected from below or infiltrated from above. This effect behaves as if the pore pressure at the upper surface of the sand exerts a normal force on the boundary (increasing pore pressure exerts a downward compression on the boundary). The results of these laboratory experiments indicate that CMPI can measure strain caused by fluid pressure changes in the vadose zone with a signal to noise ratio of 100 or more. Injection and drainage cause a strain signal that is complex, but repeatable. The magnitudes of the strain signal are consistent with magnitudes that are expected based on poroelastic calculations using independently measured properties of the sand. These results indicate that the CMPI technique with an optical fiber laminated in a polyester ribbon generates data that represent the strain distribution during hydrologic processes of imbibition and drainage in variably saturated sand. This suggests that distributed strain measurements using CMPI could be a viable approach for evaluating processes in the vadose zone, laying the groundwork for future field implementation.

47 OTHER INSTRUMENTATION↗

Federated Learning with Frequency Estimation for Smart Meter Systems

Federated learning (FL) is a powerful framework that enables multiple distributed clients to collaborate without the need to transfer their data to a central server. However, FL does not inherently guarantee the level of privacy that clients often require. In our review of recent studies on privacy-enhancing techniques in FL, we found that frequency estimation (FE) methods remain underexplored. To address this gap, we developed and integrated FE techniques on the client side, further examining the effects of incorporating an adaptive range and a shuffled model. We also analyzed the impact of varying hyper-parameters on privacy preservation. Our results provide clear guidance on the algorithms and configurations that are most effective for enhancing privacy in FL, particularly when using long short-term memory (LSTM) architectures.

Kotevska, Olivera [ORNL] (ORCID:0000000316772243)↗

First STAX detector installation at the National Institute for Radioelements (IRE)

The Source Term Analysis of Xenon (STAX) project has been installing stack detectors at medical isotope production facilities to measure radioxenon emissions to investigate the effect of radioxenon releases on nuclear explosion monitoring. This paper outlines the installation of the first STAX detection system at the National Institute for Radioelements (IRE) in Fleurus, Belgium which has been operating for over three years and transferring collected data to the STAX repository. Information about the equipment installed, the data flow established, and calculations for determination of radioxenon releases from the facility are presented. Further. data quality was investigated to confirm values reported by STAX automated data processing and in a comparison of collected STAX data with data collected by IRE for regulatory reporting.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Real-Time Monitoring of Gas-Phase and Dissolved CO 2 Using a Mixed-Matrix Composite Integrated Fiber Optic Sensor for Carbon Storage Application

Novel chemical sensors that improve detection and quantification of CO 2 are critical to ensuring safe and cost-effective monitoring of carbon storage sites. Fiber optic (FO) based chemical sensor systems are promising field-deployable systems for real-time monitoring of CO 2 in geological formations for long-range distributed sensing. Here, a mixed-matrix composite integrated FO sensor system was developed with a purely optical readout that reliably operates as a detector for gas-phase and dissolved CO 2 . A mixed-matrix composite sensor coating consisting of plasmonic nanocrystals and hydrophobic zeolite embedded in a polymer matrix was integrated on the FO sensor. The mixed-matrix composite FO sensor showed excellent reversibility/stability in a high humidity environment and sensitivity to gas-phase CO 2 over a large concentration range. This remarkable sensing performance was enabled by using plasmonic nanocrystals to significantly enhance the sensitivity and a hydrophobic zeolite to effectively mitigate interference from water vapor. The sensor exhibited the ability to sense CO 2 in the presence of other geologically relevant gases, which is of importance for applications in geological formations. A prototype FO sensor configuration which possesses a robust sensing capability for monitoring dissolved CO 2 in natural water was demonstrated. Reproducibility was confirmed over many cycles, both in a laboratory setting and in the field. More importantly, we demonstrated on-line monitoring capabilities with a wireless telemetry system, which transferred the data from the field to a website. The combination of outstanding CO 2 sensing properties and facile coating processability makes this mixed-matrix composite FO sensor a good candidate suitable for practical carbon storage applications.

54 ENVIRONMENTAL SCIENCES↗

Exploring Structure-Sensitive Relations for Small Species Adsorption Using Machine Learning

Accurate prediction of adsorption energies on heterogeneous catalyst surfaces is crucial to predicting reactivity and screening materials. Adsorption linear scaling relations have been developed extensively but often lack accuracy and apply to one adsorbate and a single binding site type at a time. These facts undermine their ability to predict structure sensitivity and optimal catalyst structure. Using machine learning on nearly 300 density functional theory calculations, we demonstrate that generalized coordination number scaling relations hold well for oxygen- and high-valency carbon-binding species but fail for others. Here we reveal that the valency and the electronic coupling of a species with the surface, along with the site type and its coordination environment, are critical for small species adsorption. The model simultaneously predicts the adsorption energy and preferred site and significantly outperforms linear scalings in accuracy. It can expose the structure sensitivity of chemical reactions and enable enhanced catalyst activity via engineering particle shape and facet defects. The generality of our methodology is validated by training the model with transition metal data and transferring it to predict adsorption energies on single-atom alloys.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Deep learning-based predictive models for laser direct drive at the Omega Laser Facility

The rich and complex physics of inertial confinement fusion provides a unique and challenging space for high-fidelity first-principles modeling. Consequently, simulation codes that are used to design experiments are computationally expensive and lack the predictive capability required for extensive parameter exploration in search of a high-performing design for laser direct drive. In this article, we present two deep-learning-based predictive models intended to address these difficulties. The first model (TL DNN) acts as a fast emulator of simulations as well as experiments at the Omega Laser Facility. This model is trained on a simulation database and subsequently calibrated on experimental data using transfer learning. To facilitate the development of this model, an autoencoder is developed to reduce the dimensionality of the input space by compressing the laser pulse input. The model predicts key experimental scalar observables of Omega experiments with high accuracy and minimal computational cost. This deep neural net enables rapid exploration of a high-dimensional input parameter space for an optimal implosion design. The second model (DNN SM+) aims to extend the statistical modeling work of Lees et al. [Phys. Rev. Lett. 127, 105001 (2021)], by increasing the complexity of the model space and allowing for coupling between degradation terms. Since the model capacity of DNN SM+ is higher than the model of Lees et al., DNN SM+ can potentially provide an improvement in predictive capability, and we use this model to provide insight into complicated degradation dependencies.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Regression Analysis with the Directed Infusion of Data

Integrating artificial intelligence and machine learning tools into industry necessitates large-scale collaborative efforts that ensure the robust and accurate execution of downstream analytics such as time series prediction, uncertainty quantification, grid optimization, and condition monitoring. However, concerns related to data privacy pervade the nuclear industry due to the proprietary nature of its data and the possibility of data leakage. Legacy techniques such as encryption often require the explicit transmission of data to trustworthy parties, thereby inviting data leakage concerns. The ideal collaboration scenario avoids the explicit dissemination of data/code while maintaining experimental fidelity, which is currently accomplished using various techniques such as trusted execution environments, homomorphic encryption, differential privacy, and multimatrix masking. These techniques, however, often necessitate a trade-off between trust, efficiency, and utility. This article extends a previously proposed technique called the directed infusion of data (DIOD) that ensures data privacy, allows for scalable obfuscation, and combats the risk of data leakage without compromising utility. The experiments discussed in this article examine a regression-type scenario using DIOD with the goal of preserving the inferential link between two variables. Using the point-kinetics equations, regression experiments compare the performance of a model trained using the original data to that of a model trained using the obfuscated data, which produced identical results. Our claim is further strengthened by an information theoretic proof and experiment, which showed that the inferential content between variables remains the same after obfuscation, thereby avoiding the required communication of the proprietary data.

47 - OTHER INSTRUMENTATION↗

The Artificial Scientist: in-Transit Machine Learning of Plasma Simulations

Large-scale simulations or scientific experiments produce petabytes of data per run. This poses massive challenges for I/O and storage when scientific analysis workflows are run manually offline. Unsupervised deep learning-based techniques to extract patterns and non-linear relations from these large amounts of data provide a way to build scientific understanding from raw data, reducing the need for manual pre-selection of analysis steps, but require exascale compute and memory to process the full dataset available. In this paper, we demonstrate a heterogeneous streaming workflow in which plasma simulation data is streamed directly to a Machine Learning (ML) application training a model on the simulation data in-transit, completely circumventing the capacity-constrained filesystem bottleneck. This workflow employs openPMD to provide a high level interface to describe scientific data and also uses ADIOS2, to transfer volumes of data that exceed the capabilities of the filesystem. We employ experience replay to avoid catastrophic forgetting in learning from this non-steady state process in a continual manner and adapt it to improve model convergence while learning in-transit. As a proof-of-concept, we approach the ill-posed inverse problem of predicting particle dynamics from radiation in a particle-incell (PIConGPU) simulation of the Kelvin-Helmholtz instability (KHI). We detail hardware-software co-design challenges as we scale PIConGPU to full Frontier, the Top-1 system as of June 2024 Top500 list.

Kelling, Jeffrey [Helmholtz-Zentrum Dresden Rossen↗

A Cross-Domain Optimization Framework of PMU and Communication Placement for Multidomain Resiliency and Cost Reduction

Phasor measurement units (PMUs) play a crucial role in real-time monitoring and control of power grids. They rely on a communication network to transfer measurement data to the phasor data concentrator (PDC) for further processing and analysis. In this paper, a resilient cross-domain PMU and communication link placement method for minimizing the overall installation cost of the wide-area measurement system (WAMS) is proposed. Here, the main idea is to break down the barrier between the power grid domain and the communication domain, and consider the impact of one when design the other. The PMU placement in the power grid domain takes into account the cost of communication links by generating multiple solutions with equally minimum PMU costs for communication link placement evaluation. On the other hand, the communication link placement problem reduces the cost by customizing the routing policies based on the different roles of PMUs in grid observability. The proposed WAMS design is capable of withstanding any single component failure in the power domain (PMU failure or power branch failure) or in the communication domain (communication link failure or PDC failure). Numerical study on the IEEE 57-bus system reveals that the developed cross-domain optimization framework can significantly reduce the overall installation cost of WAMS while attaining multi-domain resiliency.

24 POWER TRANSMISSION AND DISTRIBUTION↗

ML–Enabled FPGA Framework for Fast Quantum State Discrimination in Mid-Circuit Measurement Regimes

Accurate and low-latency quantum state discrimination is essential for protocols involving mid-circuit measurement (MCM) and conditional feed-forward. In superconducting quantum systems, conventional readout pipelines transfer measurement data to host processors for post-processing, introducing millisecond-scale delays that far exceed qubit coherence times. To overcome this bottleneck, we present an in-situ machine learning (ML) inference engine implemented on an FPGA for real-time quantum state discrimination. Our design performs inference directly on digitized readout signals with 40 ns latency, supports both qubit and qutrit readout, and enables conditional operations without host-side intervention. This capability is critical for MCM and for feedback-driven protocols such as quantum error correction. We validate the system on superconducting transmon hardware, demonstrating robust discrimination fidelity across multiple qubit and qutrit channels. We further demonstrate conditional qutrit logic driven by FPGA-resident classification, highlighting the potential of low-latency ML-on-FPGA control for NISQ applications and scalable fault-tolerant quantum computing.

Vora, Neel [Lawrence Berkeley National Laboratory ↗