Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data formats”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30
All sourcesNASA NTRSDOE OSTI
NASA NTRS2014

Proto-Examples of Data Access and Visualization Components of a Potential Cloud-Based GEOSS-AI System

Once a research or application problem has been identified, one logical next step is to search for available relevant data products. Thus, an early component of a potential GEOSS-AI system, in the continuum between observations and end point research, applications, and decision making, would be one that enables transparent data discovery and access by users. Such a component might be effected via the systems data agents. Presumably, some kind of data cataloging has already been implemented, e.g., in the GEOSS Common Infrastructure (GCI). Both the agents and cataloging could also leverage existing resources external to the system. The system would have some means to accept and integrate user-contributed agents. The need or desirability for some data format internal to the system should be evaluated. Another early component would be one that facilitates browsing visualization of the data, as well as some basic analyses.Three ongoing projects at the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) provide possible proto-examples of potential data access and visualization components of a cloud-based GEOSS-AI system. 1. Reorganizing data archived as time-step arrays to point-time series (data rods), as well as leveraging the NASA Simple Subset Wizard (SSW), to significantly increase the number of data products available, at multiple NASA data centers, for production as on-the-fly (virtual) data rods. SSWs data discovery is based on OpenSearch. Both pre-generated and virtual data rods are accessible via Web services. 2. Developing Web Feature Services to publish the metadata, and expose the locations, of pre-generated and virtual data rods in the GEOSS Portal and enable direct access of the data via Web services. SSW is also leveraged to increase the availability of both NASA and non-NASA data.3.Federating NASA Giovanni (Geospatial Interactive Online Visualization and Analysis Interface), for multi-sensor data exploration, that would allow each cooperating data center, currently the NASA Distributed Active Archive Centers (DAACs), to configure its own Giovanni deployment, while also allowing all the deployments to incorporate each others data. A federated Giovanni comprises Giovanni Virtual Machines, which can be run on local servers or in the cloud.

access↗
DOE OSTI2013

ACHILLES: Heat Transfer in PWR Core During LOCA Reflood Phase

1. NAME AND TITLE OF DATA LIBRARY ACHILLES -Heat Transfer in PWR Core During LOCA Reflood Phase. 2. NAME AND TITLE OF DATA RETRIEVAL PROGRAMS N/A 3. CONTRIBUTOR AEA Technology, Winfrith Technology Centre, Dorchester DT2 8DH United Kingdom through the OECD Nuclear Energy Agency Data Bank, Issy-les-Moulineaux, France. 4. DESCRIPTION OF TEST FACILITY The most important features of the Achilles rig were the shroud vessel, which contained the test section, and the downcomer. These may be thought of as representing the core barrel and the annular downcomer in the reactor pressure vessel. The test section comprises a cluster of 69 rods in a square array within a circular shroud vessel. The rod diameter and pitch (9.5 mm and 12.6 mm) were typical of PWR dimensions. The internal diameter of the shroud vessel was 128 mm. Each rod was electrically heated over a length of 3.66 m, which is typical of the nuclear heated length in a PWR fuel rod, and each contained 6 internal thermocouples. These were arranged in one of 8 groupings which concentrated the thermocouples in different axial zones. The spacer grids were at prototypic PWR locations. Each grid had two thermocouples attached to its trailing edge at radial locations. The axial power profile along the rods was an 11 step approximation to a "chopped cosine". The shroud vessel had 5 heating zones whose power could be independently controlled. 5. DESCRIPTION OF TESTS The Achilles experiments investigated the heat transfer in the core of a Pressurized Water Reactor during the re-flood phase of a postulated large break loss of coolant accident. The results provided data to validate codes and to improve modeling. Different types of experiments were carried out which included single phase cooling, re-flood under low flow conditions, level swell and re-flood under high flow conditions. Three series of experiments were performed. The first and the third used the same test section but the second used another test section, similar in all respects except that it contained a partial blockage formed by attaching sleeves (or "balloons") to some of the rods. 6. SOURCE AND SCOPE OF DATA Phenomena Tested - Heat transfer in the core of a PWR during a re-flood phase of postulated large break LOCA. Test Designation - Achilles Rig. The programme includes the following types of experiments: - on an unballooned cluster: -- single phase air flow -- low pressure level swell -- low flooding rate re-flood -- high flooding rate re-flood - on a ballooned cluster containing 80% blockage formed by 16 balloon sleeves -- single phase air flow -- low flooding rate re-flood 7. DISCUSSION OF THE DATA RETRIEVAL PROGRAM N/A 8. DATA FORMAT AND COMPUTER Many Computers (M00019MNYCP00). 9. TYPICAL RUNNING TIME N/A 11. CONTENTS OF LIBRARY The ACHILLES package contains test data and associated data processing software as well as the documentation listed above. 12. DATE OF ABSTRACT November 2013. KEYWORDS: DATABASES, BENCHMARKS, HEAT TRANSFER, LOSS-OF-COLLANT ACCIDENT, PWR REACTORS, REFLOODING

Source record↗
DOE OSTI2019

ATLAS Data Carousel

The ATLAS experiment at CERN's LHC stores detector and simulation data in raw and derived data formats across more than 150 Grid sites world-wide, currently in total about 200PB on disk and 250PB on tape. Data have different access characteristics due to various computational workflows, and can be accessed from different media, such as remote I/O, disk cache on hard disk drives or SSDs. Also, larger data centers provide the majority of offline storage capability via tape systems. For the High-Luminosity LHC (HL-LHC), the estimated data storage requirements are several factors bigger than the present forecast of available resources, based on a flat budget assumption. On the computing side, ATLAS Distributed Computing was very successful in the last years with high performance and high throughput computing integration and in using opportunistic computing resources for the Monte Carlo simulation. On the other hand, equivalent opportunistic storage does not exist. ATLAS started the "Data Carousel" project to increase the usage of less expensive storage, i.e. tapes or even commercial storage, so it is not limited to tape technologies exclusively. Data Carousel orchestrates data processing between workload management, data management, and storage services with the bulk data resident on offline storage. The processing is executed by staging and promptly processing a sliding window of inputs onto faster buffer storage, such that only a small percentage of input data are available at any one time. With this project, we aim to demonstrate that this is the natural way to dramatically reduce our storage cost. The first phase of the project was started in the fall of 2018 and was related to I/O tests of the sites archiving systems. Phase II now requires a tight integration of the workload and data management systems. Additionally, the Data Carousel studies the feasibility to run multiple computing workflows from tape. The project is progressing very well and the results presented in this document will be used before the LHC Run 3.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

On-Demand Column Joining for High Energy Physics

As the Large Hadron Collider (LHC) transitions into the High-Luminosity LHC (HL-LHC) era, the volume of data to be processed is expected to increase significantly. The CMS Experiment currently utilizes various data formats, including AOD, MiniAOD, and NanoAOD, each with different levels of detail and storage requirements. This paper addresses the challenges of data duplication and storage inefficiencies in high-energy physics (HEP) analyses by proposing an on-demand column-joining solution. This approach aims to reduce data duplication by enabling the dynamic combination of NanoAOD data with auxiliary information from larger data tiers, such as MiniAOD. The proposed solution leverages Trino, a high-performance distributed SQL query engine, to perform efficient and scalable data joins. Benchmarks using CMS OpenData demonstrate the feasibility of this approach, showing that it can handle large datasets with low latency. Integration with the scikit-hep ecosystem and the coffea analysis framework is also discussed, highlighting the potential for seamless end-to-end data processing and analysis. Ongoing and future work focuses on expanding benchmarks, integrating ServiceX for data transformation, and exploring the use of native object storage solutions.

Manganelli, Nicholas [Northeastern U.]↗
DOE OSTI2024

The Foundational Industrial Energy Dataset (FIED): Open-Source Data on Industrial Facilities

The state of data on industrial energy use has co-evolved over several decades with the demands of industrial energy analysis. The most recent development - analysis in support of decarbonizing the industrial sector - has changed the characteristics of industrial data that are useful for analysts and model developers. Although data and its collection processes may be cast from a conventional viewpoint as objective and free from the influence of social dynamics, this provides an incomplete picture of not only the processes by which information is generated, but also the limitations and opportunities of data to be useful for analysis. The foundational industry energy data set (FIED) is a result of the confluence of trends in open data and the demand for higher resolution industrial energy analysis. The general approach to compiling the FIED involves accessing, filtering, and formatting data published by federal organizations on the Internet for public use. Unlike most industrial energy datasets, which are published by the U.S. Energy Information Administration (EIA), the FIED relies on core datasets from the U.S. Environmental Protection Agency (EPA). The FIED addresses several of the areas of growing disconnect between the demands of industrial energy analysis and the state of industrial energy data by providing unit-level characterization - including estimates of energy use, greenhouse gas emissions, and design capacities - for facilities that are identified by latitude and longitude. This enables local-level analysis of existing combustion equipment, as well as regional comparisons with traditional industrial energy data estimates. The report summarizes the general logic behind compiling the FIED. The FIED itself and its Python code are available from OpenEI and GitHub, respectively.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2026

Enhanced HLW glass property-composition models - phase 3

During the present phase (Phase 3) of work to enhance and expand the HLW glass property-composition models, test data for 137 glasses were collected and incorporated into the combined WTP/ORP database. The new data include those collected on glasses from two statistically designed matrices to augment the moderate alumina region (the HLW16-MA matrix covering the region of 9 wt% < Al2O3 < 12 wt% with 16 glasses) and the ultra-high alumina region (the HLW16-UHA matrix covering the region of 26 wt% < Al2O3 < 29 wt% with 29 glasses). The addition of ORP glasses over the different phases of testing has significantly expanded the combined WTP/ORP database. The compiled data include glass compositions, PCT (B, Li and Na) releases, spinel T1%, electrical conductivity, viscosity, TCLP-Cd releases, and nepheline formation upon CCC. With the exception of the CCC spinel formation data – the CCC data will be used to support the further development of nepheline models for Hanford HLW glasses.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
NASA NTRS1981

MAGSAT data processing: A report for investigators

The in-flight attitude and vector magnetometer data bias recovery techniques and results are described. The attitude bias recoveries are based on comparisons with a magnetic field model and are thought to be accurate to 20 arcsec. The vector magnetometer bias recoveries are based on comparisons with the scalar magnetometer data and are thought to be accurate to 3 nT or better. The MAGSAT position accuracy goals of 60 m radially and 300 m horizontally were achieved for all but the last 3 weeks of Magsat lifetime. This claim is supported by ephemeris overlap statistics and by comparisons with ephemerides computed with an independent orbit program using data from an independent tracking network. MAGSAT time determination accuracy is estimated at 1 ms. Several errors in prelaunch assumptions regarding data time tags, which escaped detection in prelaunch data tests, and were discovered and corrected postlaunch are described. Data formats and products, especially the Investigator-B tapes, which contain auxiliary parameters in addition to the basic magnetometer and ephemeris data, are described.

Langel, R. A.↗
NASA NTRS1982

Geometric verification

Present LANDSAT data formats are reviewed to clarify how the geodetic location and registration capabilities were defined for P-tape products and RBV data. Since there is only one geometric model used in the master data processor, geometric location accuracy of P-tape products depends on the absolute accuracy of the model and registration accuracy is determined by the stability of the model. Due primarily to inaccuracies in data provided by the LANDSAT attitude management system, desired accuracies are obtained only by using ground control points and a correlation process. The verification of system performance with regards to geodetic location requires the capability to determine pixel positions of map points in a P-tape array. Verification of registration performance requires the capability to determine pixel positions of common points (not necessarily map points) in 2 or more P-tape arrays for a given world reference system scene. Techniques for registration verification can be more varied and automated since map data are not required. The verification of LACIE extractions is used as an example.

Grebowsky, G. J.↗
NASA NTRS1989

An interactive, discipline-independent data visualization system

The data visualization techniques used by National Space Science Data Center Graphics System are discussed. The system includes a self-describing data abstraction for the storage and manipulation of multidimensional data for discipline-independent scientific applications. The system's data format and graphics display are described. Consideration is given to techniques developed for the rapid display and manipulation of large, complex data sets and for manipulating algorithms with portable implementations which can operate on any data object or geometry. The processes of operating the system are given and examples are presented from applying the system to various types of data, including TOMS data, data from the International Satellite Cloud Climatology Project, and IRAS data.

Treinish, Lloyd A.↗
NASA NTRS2009

Simulation and Interpretation of the Genesis of Tropical Storm Gert (2005) as Part of the NASA Tropical Cloud Systems and Processes Experiment

Several hypotheses have been put forward for the how tropical cyclones (tropical storms and hurricanes in the Atlantic) first develop circulation at the surface, a key event that needs to occur before a storm can begin to draw energy from the warm ocean. One hypothesis suggests that the surface circulation forms from a "top-down" approach in which a storm s rotating circulation begins at middle levels of the atmosphere and builds down to the surface through processes related to light "stratiform" (horizontally extensive) precipitation. Another hypothesis suggests a bottom-up approach in which deep thunderstorm towers (convection) play the major role in spinning up the flow at the surface. These "hot towers" form in the area of the mid-level circulation and strongly concentrate this rotation at low levels within their updrafts. Merger of several of these hot towers then intensifies the surface circulation to the point in which a storm forms. This paper examines computer simulations of Tropical Storm Gert (2005), which formed in the Gulf of Mexico during the National Aeronautics and Space Administration s (NASA) Tropical Cloud Systems and Processes (TCSP) Experiment, to investigate the development of low-level circulation and, in particular, whether stratiform or hot tower processes were responsible for the storm s formation. Data from NASA satellites and from aircraft were used to show that the model did a good job of reproducing the formation and evolution of Gert. The simulation shows that a mix of both stratiform and convective rainfall occurred within Gert. While the stratiform rainfall clearly acted to increase rotation at middle levels, the diverging outflow beneath the stratiform rain worked against spinning up the low-level winds. The hot towers appeared to dominate the low-level flow, producing intense rotation within their cores and often being associated with significant pressure falls at the surface. Over time, many of these hot towers merged, with each merger adding to the rotation of the storm and the pressure falls at the surface. This process continued to increase the strength of the storm until the storm made landfall on the east coast of Mexico. These results support the bottom-up hypothesis for development.

Braun, Scott A.↗
NASA NTRS1995

Compendium of NASA data base for the global tropospheric experiment's Transport and Atmospheric Chemistry Near the Equator-Atlantic (TRACE-A)

This compendium describes aircraft data that are available from NASA's Transport and Atmospheric Chemistry near the Equator - Atlantic (TRACE-A) conducted in September/October 1992. The broad objectives of TRACE-A were to study chemical processes and long-range transport associated with South American and African continental outflow during periods of widespread vegetation burning, and to understand the ozone enhancements observed from satellite data measured over the southern tropical Atlantic Ocean during the September/October time period. Flight experiments were conducted from Brazil, South Africa, Namibia, and the Ascension Island. This document provides a representation of aircraft data that are available from NASA Langley's Distributed Active Archive Center (DAAC). The data format of time series and altitude profile plots is not intended to support original analyses, but to assist the reader in identifying data that are of interest. This compendium is for only the NASA aircraft data. The DAAC data base includes numerous supporting data-meteorological products, results from surface studies, satellite observations, and data from sonde releases.

Gregory, Gerald L.↗
NASA NTRS2007

XML Flight/Ground Data Dictionary Management

A computer program generates Extensible Markup Language (XML) files that effect coupling between the command- and telemetry-handling software running aboard a spacecraft and the corresponding software running in ground support systems. The XML files are produced by use of information from the flight software and from flight-system engineering. The XML files are converted to legacy ground-system data formats for command and telemetry, transformed into Web-based and printed documentation, and used in developing new ground-system data-handling software. Previously, the information about telemetry and command was scattered in various paper documents that were not synchronized. The process of searching and reading the documents was time-consuming and introduced errors. In contrast, the XML files contain all of the information in one place. XML structures can evolve in such a manner as to enable the addition, to the XML files, of the metadata necessary to track the changes and the associated documentation. The use of this software has reduced the extent of manual operations in developing a ground data system, thereby saving considerable time and removing errors that previously arose in the translation and transcription of software information from the flight to the ground system.

Wright, Jesse↗
DOE OSTI2022

Leaf C and N content by leaf age, Feb2017, PA-SLZ: Panama

This dataset contains carbon, hydrogen and nitrogen content measurements of sunlit canopy leaves of Apeiba membranacea (APEIME), Guatteria dumetorum (GUATDU), Miconia borealis (MICOBO), Terminalia amazonia (TERMAM), Virola multiflora (VIROSP) and Vochysia ferruginea (VOCHFE) species. Data was collected from the NGEE-Tropics Bosque Protector San Lorenzo (PA-SLZ) site in Panama in February of 2017 as part of the 2017 Brookhaven National Lab–Smithsonian Tropical Research Institute leaf traits by age campaign. A PDF with full sapling protocol is included in this dataset, along with metadata files in Excel file format. Data is in both CSV (Panama2017_CHN.csv) and Excel file formats. See related datasets for further sample details, leaf spectra, sap flow, leaf water potential, leaf mass per area (LMA), and gas exchange measurements.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Demand-Side Grid (dsgrid) TEMPO Light-Duty Vehicle Charging Profiles v2022

Simulated hourly electric vehicle charging profiles for light-duty household passenger vehicles in the contiguous United States, 2018-2050. Profiles are differentiated by scenario, county, household and vehicle types, and charging type. Data was produced in 2022 using the Transportation Energy & Mobility Pathway Options (TEMPO) model and published in demand-side grid (dsgrid) toolkit format. Data are available for three adoption scenarios: "AEO Reference Case", which is aligned with the U.S. EIA Annual Energy Outlook 2018 (linked below), "EFS High Electrification", which is aligned with the High Electrification scenario of the Electrification Futures Study (linked below), and "All EV Sales by 2035", which assumes that average passenger light-duty EV sales reach 50% in 2030 and 100% in 2035. The charging shapes are derived from two key assumptions of which data users should be aware: "ubiquitous charger access", meaning that drivers of vehicles are assumed to have access to a charger whenever a trip is not in progress, and "immediate charging", meaning that immediately after trip completion, vehicles are plugged in and charge until they are either fully recharged or taken on another trip. These assumptions result in a bounding case in which vehicles' state of charge is maximized at all times. This bounding case would minimize range anxiety, but is unrealistic from the point of view of both electric vehicle service equipment (EVSE) (i.e., charger) access, and plug-in behavior as it can result in dozens of charging sessions per week for battery electric vehicles (BEVs) that in reality are often only plugged in a few times per week.

Array↗
NASA NTRS1988

Radar observations of the inner solar system

Concurrent objectives involve dynamical information: maintenance of Mars ephemeris accuracy, Mercury closure-point ranging for relativity theory testing, and refinement of spin-vector estimates for Venus and Mercury. This task has been renamed to reflect accurately the research it supports. The backlog of unprocessed Venus data has been sharply reduced; most images from the 1980 to 1982 conjunctions, and half of those from 1986, are essentially finished. Suitably formatted data have been distributed to (non-JPL) scientific collaborators for geologic analysis, and to the Magellan project.

Jurgens, Raymond F.↗
NASA NTRS1989

Prototype architecture for a VLSI level zero processing system

The prototype architecture and implementation of a high-speed level zero processing (LZP) system are discussed. Due to the new processing algorithm and VLSI technology, the prototype LZP system features compact size, low cost, high processing throughput, and easy maintainability and increased reliability. Though extensive control functions have been done by hardware, the programmability of processing tasks makes it possible to adapt the system to different data formats and processing requirements. It is noted that the LZP system can handle up to 8 virtual channels and 24 sources with combined data volume of 15 Gbytes per orbit. For greater demands, multiple LZP systems can be configured in parallel, each called a processing channel and assigned a subset of virtual channels. The telemetry data stream will be steered into different processing channels in accordance with their virtual channel IDs. This super system can cope with a virtually unlimited number of virtual channels and sources. In the near future, it is expected that new disk farms with data rate exceeding 150 Mbps will be available from commercial vendors due to the advance in disk drive technology.

Shi, Jianfei↗
NASA NTRS2008

The Future is Hera! Analyzing Astronomical Over the Internet

Hera is the data processing facility provided by the High Energy Astrophysics Science Archive Research Center (HEASARC) at the NASA Goddard Space Flight Center for analyzing astronomical data. Hera provides all the pre-installed software packages, local disk space, and computing resources need to do general processing of FITS format data files residing on the users local computer, and to do research using the publicly available data from the High ENergy Astrophysics Division. Qualified students, educators and researchers may freely use the Hera services over the internet of research and educational purposes.

Valencic, L. A.↗
DOE OSTI2022

Community Based Data of Uranium Adsorption onto Quartz

This data upload includes a compilation of experiments for quantifying uranium adsorption onto quartz. The provided .csv file has been compiled from the literature in a findable, accessible, interoperable, reusable (FAIR) data format. This was accomplished using the Lawrence Livermore National Laboratory Surface Complexation Database Converter (SCDC) code written in the R programming language (free licensing available at https://ipo.llnl.gov/technologies/software/llnl-surface-complexation-database-converter-scdc). This constitutes all current data compiled on uranium-quartz interactions in the L-SCIE (LLNL Surface Complexation/Ion Exchange) database (as of 02/28/2022). This data was used to develop surface complexation models that fit the global community dataset (https://doi.org/10.1021/acs.est.1c07109). The FAIR-formatted dataset also enables the implementation of alternative machine-learning approaches that can be explored in the future.

54 ENVIRONMENTAL SCIENCES↗