SEARCH · Engineering Papers

Results for “big data transfer”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

41 records · Page 3

All sources NASA NTRS DOE OSTI

DOE OSTI2019

Transfer Request from Rutgers University to University of Illinois Urbana Champaign

Shortly after the Big Bang the entire universe was filled with a nearly perfect fluid known as the Quark Gluon Plasma. Relativistic heavy ion collisions can now reproduce this fluid in the laboratory where the Quark Gluon Plasma exhibits a rapid but smooth cross-over phase transition into hadrons at vanishing net-baryon densities. Recent experiments plan to explore finite baryon densities where a critical point is expected. If found, this would mark the first discovery of a critical point in a relativistic system described by a fundamental theory of nature, which would have far reaching consequences for high-energy nuclear physics and nuclear astrophysics (such as in neutron star mergers). Characteristic temperatures of equilibrium (e.g. the inflection point of the entropy density) and transport coefficients (e.g. minimum of the shear viscosity over entropy density) vary widely at a cross-over phase transition but converge at a critical point, and extracting the behavior of these characteristic temperatures is a major focal point of this research. Specifically, the interplay between strange and light hadrons will be exploited to study the flavor hierarchy in the cross-over region. To investigate this, a viscous relativistic hydrodynamics framework with two conserved charges must be developed into a new open-source code along with initial conditions that contain baryon number and strangeness. Flow observables sensitive to the equation of state and transport coefficients will be calculated across beam energies. New techniques will be developed to study this flavor hierarchy from first principles and to extract the characteristic temperatures from experimental data. Through this new dynamical framework, this project will provide essential guidance to the upcoming Beam Energy Scan II runs at Relativistic Heavy-Ion Collider and the future Facility for Antiproton and Ion Research facility in the search for the Quantum Chromodynamic critical point and subsequent investigation of the baryon-rich Quark Gluon Plasma.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2026

Unified Modeling Architecture for Load Management in Extreme Heat: The New York City Case

Integration of renewable resources to meet growing energy demand is becoming a global priority under decarbonization mandates. This study contributes to ongoing efforts on this key subject by assessing the feasibility of using coastal-urban renewable energy resources, namely, offshore wind and rooftop photovoltaic systems, to meet electricity demand of New York City during the intense recent heat wave period of June 2025. A unified modeling framework, based on the urbanized weather research and forecasting model, is used to simulate climate, renewable resources, and energy demand variables. Findings show significant energy load mismatch of approximately 1150 GWh over the month, between the demand and the combined renewable generation outcome. Three storage integration scenarios are analyzed to mitigate the deficits, reducing said deficits by a minimum of approximately 9% over the duration of the month. This study provides a transferable modeling framework tool for evaluating renewable integration in dense urban environments that can be used by grid operators to support grid resilience during extreme heat events.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Characterization of shale using Helium and Argon at high pressures

In order to estimate the shale gas in place and the eventual recovery during shale gas operations, one of the key requirements is to accurately characterize the shale’s petrophysical and transport properties such as porosity, permeability, diffusivity, and storage capacity. Despite the many efforts reported in the technical literature aiming to provide an improved understanding of the complex pore structures and the associated fluid flow in gas shales, complete characterization of organic-rich shale samples still poses a big challenge. Here, we have characterized mass transfer and sorption in shale at different length scales using Helium (He) and Argon (Ar) as probe gases. Thermogravimetric analysis (TGA) with a shale cube of ~1 cm 3 in size and gas expansion experiments with a full-diameter core (3.5” in diameter) were used to measure sorption kinetics/isotherms and mass transfer, respectively. Both samples are from the same depth/location in the Marcellus shale formation. The TGA steady-state technique was initially used to generate excess sorption isotherms for Ar, while dynamic TGA experiments were used to study its sorption kinetics. The TGA experiments demonstrate that Ar, which has a similar sorption potential as Methane, but is generally assumed to be inert, adsorbs onto the surfaces of the mesoporous and microporous regions of the shale samples according to a Langmuir-type behavior. Helium expansion experiments, on the full-diameter core, were used to measure the overall porosity, on the basis that He is a non-sorbing and inert gas as compared to Ar. The He expansion experiments, furthermore, allow us to delineate the mass transfer of gas across the inherent hierarchy of pore sizes, including macropores (macro- and microcracks), mesopores and micropores. Similar expansion experiments were also performed with Ar to study the combined impact of mass transfer and sorption. A triple-porosity model (TPM) was utilized to interpret the He expansion experiments with the shale core and to extract (estimate) relevant transport parameters. We report and compare here the diffusivities and permeabilities of the whole core for both He and Ar, as calculated from the modeling and fitting of the experimental data. On the premise that the shale cube is representative of the matrix region of the core, the Ar sorption kinetics from the cube experiments were subsequently combined with the transport parameters extracted from the He experiments to predict the behavior of the Ar expansion test with the full-diameter core. An excellent agreement is observed between the model predictions and the experimental data. The experimental observations and their interpretation indicate that one must be cautious when using Ar to estimate the true porosity and permeability of shales. In addition, we demonstrate that He and Ar probe gases, when used in tandem, can be employed effectively as a tool to characterize shales in terms of mass transfer and sorption dynamics across scales.

04 OIL SHALES AND TAR SANDS↗

DOE OSTI2022

Optimizing Error-Bounded Lossy Compression for Scientific Data With Diverse Constraints

Vast volumes of data are produced by today's scientific simulations and advanced instruments. These data cannot be stored and transferred efficiently because of limited I/O bandwidth, network speed, and storage capacity. Error-bounded lossy compression can be an effective method for addressing these issues: not only can it significantly reduce data size, but it can also control the data distortion based on user-defined error bounds. In practice, many scientific applications have specific requirements or constraints for lossy compression, in order to guarantee that the reconstructed data are valid for post hoc analysis. For example, some datasets contain irrelevant data that should be isolated in particular and users often have intuition regarding value ranges, geospatial regions, and other data subsets that are crucial for subsequent analysis. Existing state-of-the-art error-bounded lossy compressors, however, do not consider these constraints during compression, resulting in inferior compression ratios with respect to user's post hoc analysis, due to the fact that the data itself provides little or no value for post hoc analysis. In this work we address this issue by proposing an optimized framework that can preserve diverse constraints during the error-bounded lossy compression, e.g., cleaning the irrelevant data, efficiently preserving different precision for multiple value intervals, and allowing users to set diverse precision over both regular and irregular regions. We perform our evaluation on a supercomputer with up to 2,100 cores. Experiments with six real-world applications show that our proposed diverse constraints based error-bounded lossy compressor can obtain a higher visual quality or data fidelity on reconstructed data with the same or even higher compression ratios compared with the traditional state-of-the-art compressor SZ. Furthermore, our experiments also demonstrate very good scalability in compression performance compared with the I/O throughput of the parallel file system.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2019

Challenges in Long-Term Records Preservation and Access - 19549

The US Department of Energy Office of Legacy Management (LM) mission includes preserving records and information about the nation's Cold War-era weapons projects and making that information available for years to come. As LM assumes responsibility for each project, records documenting operations and cleanup activities are absorbed into a central recordkeeping system. Each record category is governed by a federal retention requirement. Routine administrative records are kept just a few years, while the most important records have 'permanent' retention requirements and are transferred to the National Archives typically within 25 years of creation. It is relatively easy for LM to meet retention requirements for these routine and permanent records. LM's big preservation challenge is with records with tremendously long retention requirements. Records with 75-year retention requirements are common, and a small subset of LM records pertaining to waste disposal requires 150-year retention periods. LM must consider the best format for maintaining each of its records collections. Should physical records be boxed up for long-term storage, or should they be digitized? Each option has associated benefits, costs, and risks. Keeping records in paper format avoids digitizing expense and preserves the original media, but the paper must be maintained in a certified storage facility. A vermin infestation or sprinkler malfunction at a certified facility may be rare but could easily destroy records. Keeping the paper and making reference or backup electronic copies reduces the risk of loss but requires diligence and resources to keep the physical records and electronic versions synchronized. This becomes an overwhelming task in a database with millions of records. Entirely replacing paper records with digitized versions as electronic records introduces the risk that records could be lost due to a cybersecurity incident or made inaccessible by evolving technology. LM's early electronic records management efforts were limited to documents saved to PDF format. More recently, LM has embraced the benefits of maintaining records in native formats. (A spreadsheet includes formulas and other details lost when converted to a PDF file.) But whether the file is saved as a Microsoft Excel spreadsheet or PDF document, how do we ensure the file is readable in 75 or 150 years when these records meet their retention requirement? We have no way of knowing for sure from our 2019 vantage point-no more than we would expect to get good technology advice from someone 150 years ago. We cannot predict the technological future, but we can make sure our current electronic records environment is healthy and future ready. This includes making sure the electronic recordkeeping system is built on a modern platform and ensuring that each record in the system is saved in a current format. Quality standards are critical for electronic records to be future ready. Implementing quality involves an organization-wide approach to having consistently formatted file names and complete and descriptive metadata. Quality PDF documents are scanned to settings that ensure characters are machine-readable (with optical character recognition, or OCR). LM is currently replacing its electronic recordkeeping system and simultaneously modernizing its organizational approach to data management; it is replacing a traditional electronic records repository with a system that also manages records stored anywhere across the computer network. This new records management approach will require new thinking in how LM manages a dramatically increased volume of information across the network while not losing focus on its responsibility for long-term records preservation and access. (author)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗