SEARCH · Engineering Papers
Results for “data flow”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
A National Infrastructure for Artificial Intelligence on the Grid (NI4AI) (Final Scientific/Technical Report)
Electric utilities have traditionally taken a very pragmatic yet myopic approach with grid sensors and the resulting collected data. Sensors are purchased and deployed to solve a specific, known problem that has risen to sufficient awareness as to justify the effort of deploying sensors and the needed capital investment. This sensor data flows into proprietary software packages with limited functionality intended only to address the initial problem. This approach aligns with the financial incentives of the utility to deploy capital into fixed hardware assets for which the corporations earn a rate of return. This mentality stands in stark contrast to the big data revolution that started nearly 25 years ago with the rise of Google. In this worldview, data is a fundamental business asset; successful organizations collect, store, explore, merge, and exploit as much data as possible to not only solve problems well understood today but also to tackle new problems that will inevitably rise tomorrow. The ARPA-E Open Innovation 2018 project entitled A National Infrastructure for Artificial Intelligence on the Grid or NI4AI for short was designed to demonstrate this alternative paradigm for using data. To do this, the project was composed of three key thrust areas. The first major component deployed a variety of high-frequency grid sensors and captured terabytes of both wide-scale and localized grid measurements, generating high-value datasets for grid research and algorithm development. The second aspect made available PingThings’ PredictiveGridTM, a horizontally scalable, cloud-based data management and AI platform built for time series data to explore and exploit the collected data. Finally, the project fostered a diverse and open research community composed of experts from numerous fields through focused educational content, code sharing, and data science competitions. Shifting away from “single use” sensors and closed data silos within electric utilities is a major benefit to the public at large. This legacy approach to data is incredibly (1) capital intensive (new sensors must be deployed for each new problem and problems tend to arise continuously) and (2) painfully slow (new problems must be identified first and then new sensors must be deployed to collect data to begin to address the issue). The transition to a carbon neutral grid requires a massive transformation of the existing grid infrastructure and will continue to challenge the legacy grid in unforeseen ways. The only way to make the energy transition cost effective is for utilities to abandon this dated data paradigm and adopt more contemporary approaches. NI4AI has shown that it is technically possible and economically feasible to ingest, explore, and exploit grid data collected from even very high frequency sensing, such as continuous point on wave sensors collecting measurements 10,000 times a second. In fact, the PredictiveGrid platform used is commercially available and deployed at several utilities in the United States. Project accomplishments were numerous and included (1) making available a state of the art time series platform to the community, (2) collecting over 520 streams of time series data from grid sensors totaling over 1 trillion grid measurements, and (3) developing and nurturing a community within the industry focused on the use of data to create value for utilities and, ultimately, end consumers.
Core Model Proposal #410: Updates to Socioeconomic and Macroeconomic Data, Processing Structure, and Visualization
This Core Model Proposal (CMP) comprehensively restructures and updates the macroeconomic and socioeconomic modules in gcamdata. It includes visualizations of key data inputs, accounting identities, and data flows in the context of GCAM-Macro-KLEM. Major improvements include: (1) updating the Penn World Table (PWT) to version 10 and incorporating a new source, the Global Macro Database (GMD); (2) updating the SSP socioeconomics database from version 3.0.1 to 3.2; (3) introducing SSP-specific differentiation of employment and labor force data; (4) improving data integration between national accounts (from PWT, GMD, and GTAP) and GDP/population data from external sources; and (5) general data cleaning and structural refinements. We document the data sources and key assumptions used throughout the processing. These updates establish the foundation for the forthcoming KLEAM version of GCAM-macro.
Real-time streaming tomographic reconstruction with on-demand data capturing and 3D zooming to regions of interest
Complex dynamic tomographic experiments at brilliant X-ray light sources require real-time feedback on the sample changes with respect to environmental conditions, selecting representative regions of interest for high-resolution scanning, and on-demand data saving mechanisms for storing only relevant projections acquired by fast area detectors and reducing data volumes. Here the implementation details of a 3D real-time imaging monitoring instrument, with zooming to a volume of interest with easy-to-use visualization via ImageJ , a tool familiar to most beamline users, is presented. The instrument relies on optimized data flow between the detector and processing machines and is implemented on commodity computers. The instrument has been developed at beamline 2-BM of the Advanced Photon Source, where the automatic lens changing mechanism for zooming is implemented with an Optique Peter microscope. Performance tests demonstrate the ability to process more than 3 GB of projection data per second and generate real-time 3D zooming with different magnification. These new capabilities are essential for new APS Upgrade instruments such as the projection microscope under development at beamline 32-ID. The efficacy of the proposed instrument was demonstrated during an in situ tomographic experiment on ice and gas hydrate formation in porous samples.
AGC-4 Experiment Irradiation Monitoring Data Qualification Final Report
The Graphite Technology Development Program ran a series of six experiments to quantify the effects of irradiation on nuclear grade graphite. This report focuses on the fourth experiment, Advanced Graphite Creep 4 (AGC 4). The Advanced Reactor Development (ARD) Technology Development Office (TDO) Program for research and development activities require documentation of qualified monitoring data to design and license the first high-temperature reactor nuclear plant. Qualified data meets the requirements for use as described in the experiment planning and quality assurance documents. Failed data do not meet the requirements and provide no useable information. Trend data may not meet all requirements but still provide some useable information. Use of Trend data requires assessment of how any deficiencies affect a particular use of the data. AGC-4 began with Advanced Test Reactor (ATR) Cycle 157D on May 30, 2015. After irradiating the graphite for two cycles, the capsule was removed from the reactor after ATR Cycle 158A, which ended on January 2, 2016, due to interference with another experiment. Irradiation was resumed with Cycle 162A on October 7, 2017 after the interfering experiment was removed from the reactor. AGC-4 irradiation completed by the end of Cycle 166B on January 10, 2020. Between Cycles 162A and 166B, AGC-4 capsule was removed from the reactor core during two Powered Axial Locator Mechanism (PALM) Cycles 163A and 165A to avoid overheating. All thermocouples (TCs) have functioned throughout the AGC-4 experiment. A total of 9,256,184 out of all 11,167,213 temperature records (or 82.9%) are Qualified for use by the ARD Program and 1,911,029 missing values are Failed. Argon, helium, and total gas flow data were within expected ranges, except only eight out-of-range values occurred during outages. A total of 21,240,627 out of all 22,288,5103 gas flow rates (or 92.8%) are Qualified for use by the ARD Program and 1,644,476 are Failed records mostly due to missing values. Discharge gas line moisture values were consistently low during full ATR power, except for 162B, when moisture content was increasing to more than 200 ppmv by the end of this cycle. During outages, moisture content reached as high as 700 ppmv. 1,089,941 out of a total of 1,107,331 moisture values (or 98.4%) are within the measurement range of the instrument and are Qualified for use by the ARD Program and 17,390 missing moisture values are Failed. Graphite creep specimens were subjected to one of three loads: 393, 491, or 589 lbf. For a brief period during Cycle 157D between 12:19 on June 2, 2015, and 08:23 on June 11, 2015, the load cells were wired incorrectly, resulting in missing stack load data. Missing stack loads were estimated from measured ram pressures using regression equations developed from the existing data from Cycle 157D. Estimated stack loads during this period are considered to be an accurate representation of actual load applied to the stacks. These loads deviate slightly from the planned loads. This deviation does not prevent the data from being Qualified for use but must be taken into account when analyzing the effect of load on creep. 6,095,728 out of a total of 6,403,985 moisture values (or 95.2%) are within the measurement range of the instrument and are Qualified for use by the ARD Program and 308,257 missing load values are Failed. Stack displacement increased consistently throughout the eight cycles, with total displacement reached highest value of 2.4 in by the end of irradiation. During ATR outages, a set of pneumatic rams raised the stacks of graphite creep specimens to ensure the specimens were not stuck within the test train. This stack raising was performed seven times throughout irradiation. All stacks were raised successfully each time. 4,744,974 out of a total of 6,094,513 displacement values (or 77.9%) are within the measurement range of the instrument and are Qualified for use by the ARD Program and 1,349,539 displacement values are Failed mostly due to missing values. Analyses were conducted on correlations between TCs to look for trends and step changes that might indicate instrument degradation or failure. Correlation analysis was used to identify instances when TCs form short circuits, referred to as virtual junctions, which result in TCs reporting temperatures from some location in the capsule other than the location where they were intended to read. No evidence of virtual junctions was found. Analyses were also conducted on control charts of temperature differences of between two TCs, which are expected to behave consistently throughout the entire irradiation period. Upward or downward trend over time indicates at least one TC in the pair was drifted. Examining control charts for all 66 possible pairs out of twelve TCs installed in the AGC-4 capsules reveal no clear drift failures occurred, except unstable behavior of two TCs in Zone 3, TC-7 and TC-8, over irradiation time. In conclus
Portable interactive visualization of large-scale simulations in geotechnical engineering using Unity3D
Development in large-scale geotechnical engineering simulation places tremendous demand for efficient visualization of such simulation data. This study presents a lightweight software tool, i.e. Geotechnical Interactive Visualization (GIV), as a solution to this challenge, which achieves efficient interactive visualization of large-scale simulations data in geotechnical engineering. Visualization data flow and algorithms specifically optimized for common geotechnical engineering applications are implemented in GIV. GIV can visualize geotechnical structure models with time-varying attributes attached to mesh with fixed topology, and also models with time-varying mesh topologies but no attributes attached, the two most common visualization tasks in geotechnical engineering. Furthermore, challenges for large-scale simulation data visualization, including parallel simulation data redundancy, massive data size, dynamic user interaction, and portability are overcome via specifically designed algorithms for simulation data preprocessing and optimized visualization modules using the powerful 3D rendering and interactive game engine Unity3D. Comparison of GIV with several widely used visualization tools for the visualization of large-scale idealized datasets and realistic geotechnical simulations highlights the visualization efficiency, smooth interactivity, and lightweight features of GIV.
Large-Eddy Simulation Study of Wake Propagation and Power Production in an Array of Tidal-Current Turbines: Preprint
This paper presents our initial work in performing large-eddy simulations of tidal turbine array flows. First, a horizontally-periodic precursor simulation is performed to create turbulent flow data. Then that data is used as inflow into a tidal turbine array two rows deep and infinitely wide. The turbines are modeled using rotating actuator lines, and the finite-volume method is used to solvethe governing equations. In studying the wakes created by the turbines, we observed that the vertical shear of the inflow combined with wake rotation causes lateral wake asymmetry. Also, various turbine configurations are simulated, and the total power production relative to isolated turbines is examined. Staggering consecutive rows of turbines in the simulated configurations allows the greatestefficiency using the least downstream row spacing. Counter-rotating consecutive downstream turbines in a non-staggered array shows a small benefit. This work has identified areas for improvement, such as the use of a larger precursor domain to better capture elongated turbulent structures, the inclusion of salinity and temperature equations to account for density stratification and its effect onturbulence, improved wall shear stress modelling, and the examination of more array configurations.
Size and Distribution of Parr Produced from Natural‐ and Hatchery‐Origin Steelhead Spawning Naturally in a Small Pacific Northwest Coastal Stream
Abstract Recent studies suggest that steelhead Oncorhynchus mykiss produced from local hatchery‐origin (HOR) adults have lower lifetime fitness than their natural‐origin (NOR) counterparts. To increase our understanding of this pattern, we compared age‐1 parr size and distribution produced by a local integrated population of HOR and NOR adults spawning naturally across a range of environmental conditions. Across 8 years, we used genetic parentage assignments and field measurements of parr in conjunction with creek temperature and flow data to find small, nonbiologically significant differences in size between parr of different parent origins. This suggests that parr produced by HOR adults are acquiring enough resources to grow at a rate similar to that of parr produced by NOR adults. In contrast to origin, we found strong positive associations between mean size of parr and annual mean water temperature and summer flow. Additionally, the distribution of parr was similar and HOR‐produced parr were not skewed relative to the location of the hatchery. Parr occupying the full extent of accessible and suitable habitat might be a positive outcome for hatchery programs seeking to supplement an existing population or replace an extirpated population. However, these results also imply that HOR fish could be competing with NOR fish for food and space, which might be less desirable if the goal of the hatchery program is harvest and not supplementation. Our results highlight the importance of clearly articulated goals for the hatchery program, as the observed pattern could be deemed a benefit or a risk depending on the hatchery's purpose. Lastly, projections for higher water temperatures and reduced summer flows, when considered in the context of the correlations we observed for size of parr, imply that coastal steelhead populations could start experiencing negative climate impacts with respect to steelhead parr growth metrics during the summer in the next few decades.
Automated Network Services for Exascale Data Movement
The Large Hadron Collider (LHC) experiments distribute data by leveraging a diverse array of National Research and Education Networks (NRENs), where experiment data management systems treat networks as a “blackbox” resource. After the High Luminosity upgrade, the Compact Muon Solenoid (CMS) experiment alone will produce roughly 0.5 exabytes of data per year. NREN Networks are a critical part of the success of CMS and other LHC experiments. However, during data movement, NRENs are unaware of data priorities, importance, or need for quality of service, and this poses a challenge for operators to coordinate the movement of data and have predictable data flows across multi-domain networks. The overarching goal of SENSE (The Software-defined network for End-to-end Networked Science at Exascale) is to enable National Labs and universities to request and provision end-to-end intelligent network services for their application workflows leveraging SDN (Software-Defined Networking) capabilities. This work aims to allow LHC Experiments and Rucio, the data management software used by CMS Experiment, to allocate and prioritize certain data transfers over the wide area network. In this paper, we will present the current progress of the integration of SENSE, Multi-domain end-to-end SDN Orchestration with QoS (Quality of Service) capabilities, with Rucio, the data management software used by CMS Experiment.
Trace Driven Data Structure Transformations
As the complexity of scientific codes and computational hardware increases it is increasingly important to study the effects of data-structure layouts on program memory behavior. Program structure layouts affect the memory performance differently, therefore we need the capability to effectively study such transformations without the need to rewrite application codes. Trace-driven simulations are an effective and convenient mechanism to simulate program behavior at various granularities. During an application s execution, a tool known as a tracer or profiler, collects program flow data and records program instructions. The trace-file consists of tuples that associate each program instruction with program internal variables. In this paper we outline a proof-of-concept mechanism to apply data-structure transformations during trace simulation and observe effects on memory without the need to manually transform an application s code.
Characterization and Modeling of Hot Deformation Behavior of a Copper-Bearing High-Strength Low-Carbon Steel Microalloyed with Nb
This study investigates hot deformation behavior of a newly developed Cu-bearing high-strength low-carbon steel microalloyed with Nb (Nb-HSLC). A computational method based on experimental data was employed to design the chemical composition of the alloy. Compression tests were carried out in the temperature range of 850-1100 °C as well as strain rates of 0.001-10 s{sup −1} using BAHR Dil 805 A/D thermo-analyzer equipment. The Arrhenius-type constitutive equations were used to model the hot working behavior of the designed steel. Effects of friction and temperature rise during deformation were corrected to obtain the actual stresses. The results showed that the peak flow stress was increased with increasing Zener–Hollomon parameter. The obtained flow curves at strain rates lower than 0.1 s{sup −1} and temperatures above 950 °C represented the typical dynamic recrystallization (DRX) behavior, while the flow curves at temperatures lower than 950 °C at all strain rates were associated with continuous strain hardening. This feature is in good agreement with the precipitation temperature range of Nb(C, N) particles, i.e., 800-1000 °C. Moreover, the flow curves showed the serrations during hot deformation at strain rates of 0.001 and 0.01 s{sup −1}, indicating that the dynamic strain aging (DSA) phenomenon occurred at low strain rates. The best fit between “peak stress” and “deformation conditions” was obtained by a hyperbolic sine-type equation (R{sup 2} = 0.993). Therefore, the average activation energy was determined as 348 kJ mol{sup −1}. The agreement between the achieved model and experimental flow data was verified using the results of additional tests at a strain rate of 5 s{sup −1}. The maximum difference between the measured and predicted “peak stresses” was calculated as 5 Mpa.
Collective Flow and Viscosity in Relativistic Heavy-Ion Collisions
We review collective flow, its anisotropies, and its event-to-event fluctuations in relativistic heavy-ion collisions, as well as the extraction of the specific shear viscosity of quark–gluon plasma from collective flow data collected in heavy-ion collision experiments at RHIC and the LHC. We emphasize the similarities between the Big Bang of our universe and the Little Bangs created in heavy-ion collisions.
Upgrade of High-Energy X-Ray real-time radioscopy for KROTOS experiment
As part of its R and D programs on severe accidents, in particular on understanding of corium-water interaction, CEA is commissioning an update of the KROTOS experiment at Cadarache. The Xray imaging setup (high energy real-time radioscopy) is upgraded to provide the best performances for the new experimental program. In order to fit the performance needs (faster acquisition, smaller detection limit and higher field of view), two radioscopy setups, with two linear accelerators (linacs 9 MV and 6 MV), are placed in the irradiation cell. Having discussed the expected performances in terms of frequency, detection limit and field-of-view, this article details each stage of both radioscopy chains: principles and technical characteristics. Then, linacs and cameras synchronization (at few hundred Hertz), data flows and storage setups are detailed. Finally, experimental characterizations and performance validations on phantom are presented. (authors)
Temporally-consistent koopman autoencoders for forecasting dynamical systems
Absence of sufficiently high-quality data often poses a key challenge in data-driven modeling of high-dimensional spatio-temporal dynamical systems. Koopman Autoencoders (KAEs) harness the expressivity of deep neural networks (DNNs), the dimension reduction capabilities of autoencoders, and the spectral properties of the Koopman operator to learn a reduced-order feature space with simpler, linear dynamics. However, the effectiveness of KAEs is hindered by limited and noisy training datasets, leading to poor generalizability. To address this, we introduce the Temporally-Consistent Koopman Autoencoder (tcKAE), designed to generate accurate long-term predictions even with limited and noisy training data. This is achieved through a consistency regularization term that enforces prediction coherence across different time steps, thus enhancing the robustness and generalizability of tcKAE over existing models. We provide analytical justification for this approach based on Koopman spectral theory and empirically demonstrate tcKAE’s superior performance over state-of-the-art KAE models across a variety of test cases, including simple pendulum oscillations, kinetic plasma, and fluid flow data.
Power Grid Contingency Analysis with Machine Learning: A Brief Survey and Prospects
We briefly review previous applications of machine learning (ML) in power grid analyses and introduce our ongoing effort toward developing a generative-adversarial (GA) model for fast and reliable grid contingency analyses. According to our review, the persisting limitation of traditional ML techniques in grid analyses is the need for an exhaustive amount of training data for model generalization and accurate predictions. GA models overcome this limitation by first learning true data distribution from a small training set, from which new samples assimilating true data are generated with some variations. Subsequently, GA models can transfer learn or super-generalize with increased accuracy, that is, accurately predict n - (k + 2) contingencies from a small n - k training set and generated n - (k + 1) data. The joint effort between Idaho National Lab and Florida State University strives to develop a zero-shot and deep learning-based contingency analysis tool, named Smart Contingency Analysis Neural Network (SCANN), by leveraging the aforementioned advantages of GA models. The basic architecture of SCANN stems from the Latent Encoding of Atypical Perturbations network combined with an adversarial network, and it is designed to generate imbalanced power flow data from learned true data distributions for prediction purposes. Here we also introduce the abstract concept of resilience-chaos plots, a new resilience characterization tool proposed to complement SCANN by aiding in the assessment of large amounts of high-order contingency predictions.
Cape EGS: Frisco Pad Wells Flow Test Microseismic Data
This dataset contains microseismic data acquired during the Frisco pad flow test project led by Fervo Energy, conducted between July 17th - Aug 12th 2024, near the Utah FORGE geothermal site. The microseismic data was collected from various Utah FORGE wells: via Distributed Acoustic Sensing (DAS) fiber in 16B, and two 3-component geophones located in wells 56-32 and 78B. The dataset is structured in SEGY format, where the first six traces represent data from the geophones, and the remaining traces capture DAS data from well 16B. Each SEGY file in this dataset contains triggered microseismic events, with event initiation based on Short-Time Average over Long-Time Average (STA/LTA) detection criteria during the stimulation process. Files are grouped by time intervals and named following the structure "[WellPad][WellName][Month]_[Year]Divine_Trigger[EventNumber].sgy," indicating well pad, well name, date, and event number. Sampling parameters include a spatial sampling of approximately 2 meters for DAS channels and a temporal sampling rate of 2000 Hz, with each data record spanning 1.2 seconds. The files' coordinates are referenced to the location of the FORGE 16A-32 wellhead, positioned at UTM coordinates: Easting 334641.1891 m and Northing 4263443.693 m. The geographic coordinates for this origin are 38.50402147 latitude and -112.8963897 longitude, with an elevation of 1650.0249 meters above sea level.
Reference Inflow Characterization for River Resource Reference Model: Reference Model 2 (RM2)
Sandia National Laboratory (SNL) is leading an effort to develop reference models for marine and hydrokinetic technologies and wave and current energy resources. This effort will allow the refinement of technology design tools, accurate estimates of a baseline levelized cost of energy (LCoE), and the identification of the main cost drivers that need to be addressed to achieve a competitive LCoE. As part of this effort, Oak Ridge National Laboratory was charged with examining and reporting reference river inflow characteristics for reference model 2 (RM2). Published turbulent flow data from large rivers, a water supply canal and laboratory flumes, are reviewed to determine the range of velocities, turbulence intensities and turbulent stresses acting on hydrokinetic technologies, and also to evaluate the validity of classical models that describe the depth variation of the time-mean velocity and turbulent normal Reynolds stresses. The classical models are found to generally perform well in describing river inflow characteristics. A potential challenge in river inflow characterization, however, is the high variability of depth and flow over the design life of a hydrokinetic device. This variation can have significant effects on the inflow mean velocity and turbulence intensity experienced by stationary and bottom mounted hydrokinetic energy conversion devices, which requires further investigation, but are expected to have minimal effects on surface mounted devices like the vertical axis turbine device designed for RM2. A simple methodology for obtaining an approximate inflow characterization for surface deployed devices is developed using the relation u max =(7/6)V where V is the bulk velocity and u max is assumed to be the near-surface velocity. The application of this expression is recommended for deriving the local inflow velocity acting on the energy extraction planes of the RM2 vertical axis rotors, where V=Q/A can be calculated given a USGS gage flow time-series and stage vs. cross-section area rating relationship.
An Energy Efficient Ethernet Strategy Based on Traffic Prediction and Shaping
Recently, different communities in computer science, telecommunication, and control systems have devoted a huge effort towards the design of energy efficient solutions for data transmission and network management. This paper collocates along this research line and presents a novel energy efficient strategy conceived for Ethernet networks. The proposed strategy, which exploits the opportunities offered by the IEEE 802.3az amendment to the Ethernet standard (known as energy efficient Ethernet) is based on the possibility of predicting the future traffic from the analysis of the current data flow. In agreement with the results of such a dynamic prediction, Ethernet links can be forced into a low power consumption state for variable intervals. Theoretical bounds are derived to detail how the performance figures depend on the parameters of the designed strategy and scale with respect to traffic load. Furthermore, simulation results carried out with both real and synthetic traffic traces are presented to prove the effectiveness of the strategy, which leads to considerable energy savings at the cost of only a limited bounded delay in data delivery.