Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data flow”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Data analytics for intermodal freight transportation applications

With the growth of intermodal freight transportation, it is important that transportation planners and decision-makers are knowledgeable about freight flow data to make informed decisions. This is particularly true with Intelligent Transportation Systems (ITS) offering new capabilities for intermodal freight transportation. Specifically, ITS enables access to multiple different data sources, but they have different formats, resolutions, and time scales. Thus, knowledge of data science is essential to be successful in future ITS-enabled intermodal freight transportation systems. This chapter discusses the commonly used descriptive and predictive data analytic techniques in intermodal freight transportation applications. These techniques cover the entire spectrum of univariate, bivariate, and multivariate analyses. In addition to illustrating how to apply these techniques manually, this chapter will also show how to apply them using the statistical software R. Additional exercises are provided for those who wish to apply the described techniques to more complex problems.

Huynh, Nathan↗
DOE OSTI2019

Hillslope subsurface flow and transport data for the PLM transect in East River, Colorado

This file contains data used to calculate subsurface flow and transport at the Pumphouse Lower Montane (PLM) hillslope transect. Information includes locations, weather data, hydraulic conductivities, hydraulic head profiles, soil water profiles, depths to the water table, specific conductance (SC) and dissolved organic carbon (DOC) in pore waters, water isotopic composition, calculated subsurface fluxes, calculated subsurface transport concentrations for SC and DOC, East River discharge and SC, transect soil particle-size distributions, and moisture characteristic curves.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Assessing the ultracentral flow puzzle in hydrodynamic modeling of heavy-ion collisions

An outstanding problem in heavy-ion collisions is the inability for models to accurately describe ultra-central experimental flow data, despite that being precisely the regime where a hydrodynamic description should be most applicable. Here, we reassess the status of this puzzle by computing the flow in ultra-central collisions obtained from multiple recent Bayesian models that were tuned to various observables in different collision systems at typical centralities. While central data can now be described with better accuracy than in previous calculations, tension with experimental observation remains and worsens as one goes to ultra-central collisions. Tuning the model parameters cannot remove this tension without destroying the fit at other centralities. As such, new elements are likely needed in the standard modeling of heavy-ion collisions.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2015

Design for a Soft Error Resilient Dynamic Task-Based Runtime, In: 2015 IEEE International Parallel and Distributed Processing Symposium

As the scale of modern computing systems grows, failures will happen more frequently. On the way to Exactable a generic, low-overhead, resilient extension becomes a desired aptitude of any programming paradigm. In this paper we explore three additions to a dynamic task-based runtime to build a generic framework providing soft error resilience to task-based programming paradigms. The first recovers the application by re-executing the minimum required sub-DAG, the second takes critical checkpoints of the data flowing between tasks to minimize the necessary re-execution, while the last one takes advantage of algorithmic properties to recover the data without re-execution. These mechanisms have been implemented in the PaRSEC task-based runtime framework. Experimental results validate our approach and quantify the overhead introduced by such mechanisms.

Computer Science↗
DOE OSTI2020

Distributed Resources for the Earth System Grid Federation (ESGF) Advanced Management (DREAM). Final Report

Distributed Resources for the Earth System Grid Federation (ESGF) Advanced Management (DREAM) is a proposed system that will enable data from an infinite number of diverse sources to be organized and accessed from anywhere using any handheld or other computer device. The approach offers a powerful roadmap for the creation and integration of a unified knowledge base of an entire ecosystem, including its many geophysical, geographical, social, political, agricultural, energy, transportation, and cyber aspects. The resulting aggregation of data has the potential to generate an informational universe of unprecedented size that has never before been possible due to the prohibitive costs, managerial complexity, and technical barriers associated with ever-changing exponential-growth data flows. We envision that DREAM will accelerate discovery by enabling climate researchers, among other types of researchers, to manage, analyze, and visualize data from earth-scale measurements and simulations. DREAM’s success will be built on proven components that leverage existing services and resources. A key building block for DREAM will be the ESGF, chaired by Dean N. Williams. Expanding on the existing ESGF, the project will ensure that the access, storage, movement, and analysis of the large quantities of data that are processed and produced by diverse science projects can be dynamically distributed with proper resource management. Much of the Office of Science data is currently generated by multiple stand-alone facilities. DREAM can collect data accumulated from these facilities and incorporate it into a fully integrated network accessible from anywhere in the world. The result is a completely new paradigm shift for data management, analysis, and visualization enabling researchers to: Manage their calculations, data, tools, and research results; Ensure that all data are sharable, reproducible and (re)usable—accompanied by appropriate metadata describing its provenance, syntax, and semantics at creation; Advance application performance by selectively adapting APIs and services in response to scientific requirements and architectural complexities; and Provide scalable interactive resource management—navigate data and metadata at multiple levels, provide architecture-aware data integration, analysis and visualization tools. We will engage closely with DOE, NASA, and NOAA science groups working at the leading edge of computing. These engagements—in domains such as biology, climate, and hydrology—will allow us to advance disciplinary science goals and inform our development of technologies that can accelerate discovery across DOE more broadly. We will advertise and promote our technologies via dedicated workshops, tutorials, and sessions at conferences, stand-alone events with broad inter-disciplinary invitation, and engagements with leadership facilities.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Survey of Dynamic Mode Decomposition Methods

Dynamic mode decomposition (DMD) is a data-driven reduced order modeling (ROM) technique used for dynamic systems. The widely adopted algorithm was first introduced and demonstrated on fluid flow data by Schmid. In recent years, various other fields, such as nuclear engineering, have begun to adopt this method. For example, DMD has been used for estimating α-eigenvalues, as an ROM for pulsed neutron problems, for predicting isotopic composition in burnup calculations, as acceleration techniques for iterative methods, and in capturing dynamic behaviors in molten salt reactor transients. This report seeks to demonstrate the capabilities and limits of the standard DMD algorithm, and identify problem spaces where variants may be better suited. The primary variant this report considers is Multi-Resolution DMD (mrDMD). Because this serves as a survey, synthetically produced data is used in lieu of simulation results. The remainder of this report will go into detail on the DMD theory, outline the standard DMD and mrDMD algorithms, present test cases highlighting the applicability of each, and finally present a discussion on how to determine the best suited algorithm for a given problem. All calculations performed in this report are carried out using the open source DMD library, PyDMD.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

EJFAT: Towards Intelligent Compute Destination Load Balancing

To handle increased data flow, Jefferson Lab (JLab) is partnering with ESnet for development of an AI/ML directed compute work Load Balancer (LB) of UDP streamed data. The LB is FPGA based featuring dynamically configurable, low latency and high throughput destination address switching. The LB provides integration of edge and core computing to support JLab experimental programs, the Electron-Ion Collider, as well as data centers of the future. In the ESnet/JLab FPGA Accelerated Transport (EJFAT) initiative, the function of the LB Data Plane (DP) is to redirect data streams to selectable (but unknown to sender) destination hosts based on current worload and within that host to destination ports as a function of sub- stream id. This effects hierarchical scaling, first across compute machines for processing over a series of events and second, across ports so different data source sub-streams may be assigned to different processors for further parallelization. The LB Control Plane (CP) programs the DP using compute farm telemetry to direct and balance workloads across a compute cluster as the operating conditions require. While Proportional/Integrative/Derivative (PID) controllers are often seen in similar applications, here we investigate the feasibility of a Reinforcement Learning (RL) based schedule manager running in the CP to provide dynamic updates to the DP scheduling policy.

Lawrence, David↗
DOE OSTI2026

SULI End of Summer Presentation

This presentation made on Power Point is a brief summary of my work enhancing the Supervisory Control and Data Acquisition (SCADA) architecture for Idaho National Lab’s Critical Infrastructure Test Range Complex (CITRC). This work was part of an on-going project to create a digital twin of CITRC that will be implemented for resiliency research. Resiliency is growing more important as extreme weather, aging infrastructure, and increasing load all exert stress on the United States power grid. This presentation highlights how I documented the existing devices and data flow on site and then updated specific device settings to better support the needs of the project. It also examines future use of this data in the digital twin data warehouse (DeepLynx), and future Artificial Intelligence and Advanced Distribution Management System applications. It will be presented to the B751 Water and Energy Systems Analysis group at INL during my last week.

24 - POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2018

A method for processing the Confidential Carload Waybill Sample for railroad freight analysis

Freight transportation research is often constrained by the availability of appropriate data. Within the context of freight rail research, use of traditional freight datasets present some critical challenges. Aggregating freight data to geographic areas diminishes the ability to perform nuanced analysis. More challenging, the complexity of railroad operations limits the usability of publicly available freight flow data which do not account for which rail company is economically and legally responsible for the movement of the goods or for the contractual arrangements between infrastructure owners and carriers. Finally, detailed data are usually privately owned and not readily-accessible for analysis outside the individual rail companies. As part of their regulatory authority, the Surface Transportation Board has developed the Confidential Carload Waybill Sample, a stratified sample representing 1% to 3% of all rail traffic in the United States for a particular year. While the sample is rich with data, it is limited in spatial information as well as in its implementation in geospatial analysis. This paper introduces a methodology for geospatially enabling the Confidential Carload Waybill Sample which can then be used to generate rail routes based on a topological representation of the U.S. railroad network. As a result, this methodology is applied using two case studies, a freight diversion analysis and transporting hazardous materials.

42 ENGINEERING↗
DOE OSTI2015

Monitoring system for the quality assessment in additive manufacturing

Additive Manufacturing (AM) refers to a process by which a set of digital data -representing a certain complex 3dim design - is used to grow the respective 3dim real structure equal to the corresponding design. For the powder-based EOS manufacturing process a variety of plastic and metal materials can be used. Thereby, AM is in many aspects a very powerful tool as it can help to overcome particular limitations in conventional manufacturing. AM enables more freedom of design, complex, hollow and/or lightweight structures as well as product individualisation and functional integration. As such it is a promising approach with respect to the future design and manufacturing of complex 3dim structures. On the other hand, it certainly calls for new methods and standards in view of quality assessment. In particular, when utilizing AM for the design of complex parts used in aviation and aerospace technologies, appropriate monitoring systems are mandatory. In this respect, recently, sustainable progress has been accomplished by joining the common efforts and concerns of a manufacturer Additive Manufacturing systems and respective materials (EOS), along with those of an operator of such systems (MTU Aero Engines) and experienced application engineers (Carl Metrology), using decent know how in the field of optical and infrared methods regarding non-destructive-examination (NDE). The newly developed technology is best described by a high-resolution layer by layer inspection technique, which allows for a 3D tomography-analysis of the complex part at any time during the manufacturing process. Thereby, inspection costs are kept rather low by using smart image-processing methods as well as CMOS sensors instead of infrared detectors. Moreover, results from conventional physical metallurgy may easily be correlated with the predictive results of the monitoring system which not only allows for improvements of the AM monitoring system, but finally leads to an optimisation of the quality and insurance of material security of the complex structure being manufactured. Both, our poster and our oral presentation will explain the data flow between the above mentioned parties involved. A suitable monitoring system for Additive Manufacturing will be introduced, along with a presentation of the respective high resolution data acquisition, as well as the image processing and the data analysis allowing for a precise control of the 3dim growth-process.

36 MATERIALS SCIENCE↗
DOE OSTI2017

Scalable Metadata Management for a Large Multi-Source Seismic Data Repository

In this work, we implemented the key metadata management components of a scalable seismic data ingestion framework to address limitations in our existing system, and to position it for anticipated growth in volume and complexity. We began the effort with an assessment of open source data flow tools from the Hadoop ecosystem. We then began the construction of a layered architecture that is specifically designed to address many of the scalability and data quality issues we experience with our current pipeline. This included implementing basic functionality in each of the layers, such as establishing a data lake, designing a unified metadata schema, tracking provenance, and calculating data quality metrics. Our original intent was to test and validate the new ingestion framework with data from a large-scale field deployment in a temporary network. This delivered somewhat unsatisfying results, since the new system immediately identified fatal flaws in the data relatively early in the pipeline. Although this is a correct result it did not allow us to sufficiently exercise the whole framework. We then widened our scope to process all available metadata from over a dozen online seismic data sources to further test the implementation and validate the design. This experiment also uncovered a higher than expected frequency of certain types of metadata issues that challenged us to further tune our data management strategy to handle them. Our result from this project is a greatly improved understanding of real world data issues, a validated design, and prototype implementations of major components of an eventual production framework. This successfully forms the basis of future development for the Geophysical Monitoring Program data pipeline, which is a critical asset supporting multiple programs. It also positions us very well to deliver valuable metadata management expertise to our sponsors, and has already resulted in an NNSA Office of Defense Nuclear Nonproliferation commitment to a multi-year project for follow-on work.

58 GEOSCIENCES↗
DOE OSTI2020

Benchmark of interfacial area concentration approaches for the two-fluid model in gas-dispersed condensing flow

Accurate predictions of interfacial area concentration (IAC) are required for closure of the condensation phase change term. The interfacial area transport equation (IATE) can dynamically predict interfacial area concentration and is increasingly being used in the benchmarking of phase change flows over static based correlations which require a flow regime map. For higher flow regimes, the two-group two-fluid IATE model can separately model the transport of spherical bubbles and cap/slug bubbles. Recently, a modified formulation of the one-group and two-group two-fluid model with interfacial area transport equation was proposed for gas-dispersed condensing flows. Three datasets have been used for validation consisting of condensing two-phase flow data in the unheated section of a vertical annulus with conditions spanning a range of pressures, inlet subcoolings and mass fluxes for benchmarking the various IAC approaches. For bubbly flows, the coupled void transport - IATE simulation results in good agreement in the predictions of the void fraction and the interfacial area concentration under nearly all sixty conditions. Considering the proposed two-group two-fluid IATE model formulation, the group-2 Nusselt number correlation is investigated to account for the appropriate heat transfer length scale for group-2 bubbles. Validation of the proposed two-group two-fluid model against the new dataset shows good agreement with experimental data with significant improvement over the one-group IATE model for conditions with substantial group-2 void fraction throughout the simulation domain.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2017

Unique phase identification of trimetallic copper iron manganese oxygen carrier using simultaneous differential scanning calorimetry/thermogravimetric analysis during chemical looping combustion reactions with methane

Chemical looping combustion (CLC) is a promising combustion technology that generates heat and sequestration-ready carbon dioxide that is undiluted by nitrogen from the combustion of carbonaceous fuels with an oxygen carrier, or metal oxide. This process is highly dependent on the reactivity and stability of the oxygen carrier. The development of oxygen carriers remains one of the major barriers for commercialization of CLC. Synthetic oxygen carriers, consisting of multiple metal components, have demonstrated enhanced performance and improved CLC operation compared to single metal oxides. However, identification of the complex mixed metal oxide phases that form after calcination or during CLC reactions has been challenging. Without an understanding of the dominant metal oxide phase, it is difficult to determine reaction parameters and the oxygen carrier reduction pathway, which are necessary for CLC reactor design. This is particularly challenging for complex multi-component oxygen carriers such as copper iron manganese oxide (CuFeMnO 4 ). This study aims to differentiate the unique phase formation of a highly reactive, complex trimetallic oxygen carrier, CuFeMnO 4 , from its single and bimetallic counterparts using thermochemical and reaction data obtained from simultaneous differential scanning calorimetry (DSC) and thermogravimetric analysis (TGA) during temperature programmed reductions (TPR) with methane. DSC/TGA experiments during TPR with methane provides heat flow data and corresponding reaction rate data that can be used to determine reaction routes and mechanisms during methane reduction. Furthermore, non-isothermal TPR data provides the advantage of distinguishing reactions that may not be observable in isothermal analysis. The detailed thermochemical and reaction data, obtained during TPR with methane, distinguished a unique reduction pathway for CuFeMnO 4 that differed from its single and bimetallic counterparts. This is remarkable since X-ray diffraction (XRD) data alone could not be used to distinguish the reactive trimetallic oxide phase due to overlapping peaks from various single and mixed metal oxides. The unique reduction pathway of CuFeMnO 4 was further characterized in this study using in-situ XRD TPR with methane to determine changes in the dominant trimetallic phase that influenced the thermochemical and reaction rate data.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

On detrending stream velocity time series for robust tidal flow turbulence characterization

We investigated the impact of detrending techniques on turbulence quantities from tidal stream flow data, focusing on the autocorrelation function, $ρ_{uu}$, and velocity spectrum, $Φ(f)$. Standard detrending methods, including high-pass frequency-based and polynomial-based techniques, are examined, alongside a proposed alternative method, the empirical mode decomposition (EMD). Our results highlight that intervals of flow acceleration and deceleration, typical in tidal and riverine flows, significantly affect the estimation of turbulence quantities using high-pass frequency filtering and polynomial detrending of varying orders. These methods can strongly influence $ρ_{uu}$ and $Φ(f)$, thereby affecting the accurate estimation of derived quantities. We examine two variations of detrending data using EMD; the first removes only the EMD residue, and the second removes both the residue and the largest scale intrinsic mode function (IMF). By comparing the detrended spectra with the modeled von Kármán spectra, we demonstrate that the second variation (i.e., removing the residue and the largest scale IMF) successfully removed the large-scale trend of the data while retaining the energy of other scales.

Detrend↗
DOE OSTI2014

SU-D-18A-02: Towards Real-Time On-Board Volumetric Image Reconstruction for Intrafraction Target Verification in Radiation Therapy

Purpose: To expedite on-board volumetric image reconstruction from limited-angle kV—MV projections for intrafraction verification. Methods: A limited-angle intrafraction verification (LIVE) system has recently been developed for real-time volumetric verification of moving targets, using limited-angle kV—MV projections. Currently, it is challenged by the intensive computational load of the prior-knowledge-based reconstruction method. To accelerate LIVE, we restructure the software pipeline to make it adaptable to model and algorithm parameter changes, while enabling efficient utilization of rapidly advancing, modern computer architectures. In particular, an innovative two-level parallelization scheme has been designed: At the macroscopic level, data and operations are adaptively partitioned, taking into account algorithmic parameters and the processing capacity or constraints of underlying hardware. The control and data flows of the pipeline are scheduled in such a way as to maximize operation concurrency and minimize total processing time. At the microscopic level, the partitioned functions act as independent modules, operating on data partitions in parallel. Each module is pre-parallelized and optimized for multi-core processors (CPUs) and graphics processing units (GPUs). Results: We present results from a parallel prototype, where most of the controls and module parallelization are carried out via Matlab and its Parallel Computing Toolbox. The reconstruction is 5 times faster on a data-set of twice the size, compared to recently reported results, without compromising on algorithmic optimization control. Conclusion: The prototype implementation and its results have served to assess the efficacy of our system concept. While a production implementation will yield much higher processing rates by approaching full-capacity utilization of CPUs and GPUs, some mutual constraints between algorithmic flow and architecture specifics remain. Based on a careful analysis of the prototype performance, it will be feasible to resolve such issues through appropriate algorithmic modifications or special-purpose hardware, thus enabling target verification in seconds with the LIVE system. This work was partially supported by a research grant from Varian Medical Systems.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Initial use of Nek5000/Cardinal to improve closure models in Pronghorn

Heat transfer coefficient closure models for pebble bed reactors are built using a data-driven approach by leveraging the capabilities of an Evolutionary Algorithm entitled Particle Swarm Optimization (PSO). In the present work, the Computational Fluid Dynamics code nekRS was used in order to collect the high-fidelity flow data for a core with 1,568 pebbles. To characterize the heat transfer, multiple concentric regions were considered to extract the physical quantities of interest, e.g./ the Reynolds number. The PSO algorithm is employed as part of an inverse problem targeting determine what are the coefficients for a Nusselt number correlation to match the collected data. Such correlation should follow any given format that is defined a priori. Finally, two correlations are proposed, one with an implicit dependence on the pebbles’ wall temperatures and another expressed as a fully explicit correlation depending on the flow conditions and the position within the core. Anyway, given the generic nature of the proposed approach, correlations following different formats could be tested. Preliminary results for the high-fidelity simulation of a fast MSR core are presented. The target Reynolds number is currently 20K, with the expectation that this will increase, pending the availability of further computational resources. These simulations will be used to inform lower fidelity models, including a coarse CFD turbulence model in Pronghorn. Additionally, they will serve as a reference for the RANS models in Nek5000/NekRS.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2015

A comprehensive data acquisition and management system for an ecosystem-scale peatland warming and elevated CO 2 experiment

Ecosystem-scale manipulation experiments represent large science investments that require well-designed data acquisition and management systems to provide reliable, accurate information to project participants and third party users. The SPRUCE project (Spruce and Peatland Responses Under Climatic and Environmental Change, http://mnspruce.ornl.gov ) is such an experiment funded by the Department of Energy's (DOE), Office of Science, Terrestrial Ecosystem Science (TES) Program. The SPRUCE experimental mission is to assess ecosystem-level biological responses of vulnerable, high carbon terrestrial ecosystems to a range of climate warming manipulations and an elevated CO 2 atmosphere. SPRUCE provides a platform for testing mechanisms controlling the vulnerability of organisms, biogeochemical processes, and ecosystems to climatic change (e.g., thresholds for organism decline or mortality, limitations to regeneration, biogeochemical limitations to productivity, and the cycling and release of CO 2 and CH 4 to the atmosphere). The SPRUCE experiment will generate a wide range of continuous and discrete measurements. In order to successfully manage SPRUCE data collection, achieve SPRUCE science objectives, and support broader climate change research, the research staff has designed a flexible data system using proven network technologies and software components. The primary SPRUCE data system components are the following; 1. data acquisition and control system – set of hardware and software to retrieve biological and engineering data from sensors, collect sensor status information, and distribute feedback to control components; 2. data collection system – set of hardware and software to deliver data to a central depository for storage and further processing; and 3. data management plan – set of plans, policies, and practices to control consistency, protect data integrity, and deliver data. This publication presents our approach to meeting the challenges of designing and constructing an efficient data system for managing high volume sources of in situ observations in a remote, harsh environmental location. Finally, the approach covers data flow starting from the sensors and ending at the archival/distribution points, discusses types of hardware and software used, examines design considerations that were used to choose them, and describes the data management practices chosen to control and enhance the value of the data.

54 ENVIRONMENTAL SCIENCES↗