Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data formats”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

ESS-DIVE reporting format for leaf-level gas exchange data and metadata

Here we present documentation of the ESS-DIVE reporting format for leaf-level gas exchange data and metadata. This reporting format provides guidance to data contributors on how to store data to maximize their discoverability, facilitate their efficient reuse, and add value to individual datasets. For data users, the reporting format will better allow data repositories to optimize data search and extraction, and more readily integrate similar data into harmonized synthesis products. The reporting format specifies data table variable naming and unit conventions, as well as metadata characterizing experimental conditions and protocols. For common data types that were the focus of this initial version of the reporting format, i.e., survey measurements, dark respiration, carbon dioxide and light response curves, and parameters derived from those measurements, we took a further step of defining required additional data that would maximize the potential reuse of those data types. To aid data contributors and the development of data ingest tools by data repositories we provided a translation table comparing the outputs of common gas exchange instruments. The reporting format presented here is intended to form a foundation for future development that will incorporate additional data types and variables as gas exchange systems and measurement approaches advance in the future. The reporting format documentation is maintained and updated on the ESS-DIVE Community Space GitHub. This data package is the first published version of this reporting format, and comprises a zip file of the complete content of https://github.com/ess-dive-community/essdive-leaf-gas-exchange v1.0. The zip contains the reporting format description, guidelines, variable tables and instructions in GitHub markdown language (*.md) and 2 metadata templates as spreadsheets with drop down options (*.xlsx files, also function in GoogleSheets).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2016

Evaluation of Advanced Signal Processing Techniques to Improve Detection and Identification of Embedded Defects

By the end of 1996, 109 Nuclear Power Plants were operating in the United States, producing 22% of the Nation’s electricity [1]. At present, more than two thirds of these power plants are more than 40 years old. The purpose of the U.S. Department of Energy Office of Nuclear Energy’s Light Water Reactor Sustainability (LWRS) Program is to develop technologies and other solutions that can improve the reliability, sustain the safety, and extend the operating lifetimes of nuclear power plants (NPPs) beyond 60 years [2]. The most important safety structures in an NPP are constructed of concrete. The structures generally do not allow for destructive evaluation and access is limited to one side of the concrete element. Therefore, there is a need for techniques and technologies that can assess the internal health of complex, reinforced concrete structures nondestructively. Previously, we documented the challenges associated with Non-Destructive Evaluation (NDE) of thick, reinforced concrete sections and prioritized conceptual designs of specimens that could be fabricated to represent NPP concrete structures [3]. Consequently, a 7 feet tall, by 7 feet wide, by 3 feet and 4-inch-thick concrete specimen was constructed with 2.257-inch-and 1-inch-diameter rebar every 6 to 12 inches. In addition, defects were embedded the specimen to assess the performance of existing and future NDE techniques. The defects were designed to give a mix of realistic and controlled defects for assessment of the necessary measures needed to overcome the challenges with more heavily reinforced concrete structures. Information on the embedded defects is documented in [4]. We also documented the superiority of Frequency Banded Decomposition (FBD) Synthetic Aperture Focusing Technique (SAFT) over conventional SAFT when probing defects under deep concrete cover. Improvements include seeing an intensity corresponding to a defect that is either not visible at all in regular, full frequency content SAFT, or an improvement in contrast over conventional SAFT reconstructed images. This report documents our efforts in four fronts: 1) Comparative study between traditional SAFT and FBD SAFT for concrete specimen with and without Alkali-Silica Reaction (ASR) damage, 2) improvement of our Model-Based Iterative Reconstruction (MBIR) for thick reinforced concrete [5], 3) development of a universal framework for sharing, reconstruction, and visualization of ultrasound NDE datasets, and 4) application of machine learning techniques for automated detection of ASR inside concrete. Our comparative study between FBD and traditional SAFT reconstruction images shows a clear difference between images of ASR and non-ASR specimens. In particular, the left first harmonic shows an increased contrast and sensitivity to ASR damage. For MBIR, we show the superiority of model-based techniques over delay and sum techniques such as SAFT. Improvements include elimination of artifacts caused by direct arrival signals, and increased contrast and Signal to Noise Ratio. For the universal framework, we document a format for data storage based on the HDF5 file format, and also propose a modular Graphic User Interface (GUI) for easy customization of data conversion, reconstruction, and visualization routines. Finally, two techniques for ASR automated detection are presented. The first technique is based on an analysis of the frequency content using Hilbert Transform Indicator (HTI) and the second technique employees Artificial Neural Network (ANN) techniques for training and classification of ultrasound data as ASR or non-ASR damaged classes. The ANN technique shows great potential with classification accuracy above 95%. These approaches are extensible to the detection of additional reinforced, thick concrete defects and damage.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2019

Multifidelity Information Fusion with Machine Learning: A Case Study of Dopant Formation Energies in Hafnia

Cost versus accuracy trade-offs are frequently encountered in materials science and engineering, where a particular property of interest can be measured/computed at different levels of accuracy or fidelity. Naturally, the most accurate measurement is also the most resource and time intensive, while the inexpensive quicker alternatives tend to be noisy. In such situations, a number of machine learning (ML) based multifidelity information fusion (MFIF) strategies can be employed to fuse information accessible from varying sources of fidelity and make predictions at the highest level of accuracy. In this work, we perform a comparative study on traditionally employed single-fidelity and three MFIF strategies, namely, (1) Δ-learning, (2) low-fidelity as a feature, and (3) multifidelity cokriging (CK) to compare their relative prediction accuracies and efficiencies for accelerated property predictions and high throughput chemical space explorations. We perform our analysis using a dopant formation energy data set for hafnia, which is a well-known high- k material and is being extensively studied for its promising ferroelectric, piezoelectric, and pyroelectric properties. We use a dopant formation energy data set of 42 dopants in hafnia—each studied in six different hafnia phases—computed at two levels of fidelities to find merits and limitations of these ML strategies. The findings of this work indicate that the MFIF based learning schemes outperform the traditional SF machine learning methods, such as Gaussian process regression and CK provides an accurate, inexpensive and flexible alternative to other MFIF strategies. While the results presented here are for the case study of hafnia, they are expected to be general. Furthermore, materials discovery problems that involve huge chemical space explorations can be studied efficiently (or even made feasible in some situations) through a combination of a large number of low-fidelity and a few high-fidelity measurements/computations, in conjunction with the CK approach.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Enabling event-by-event precision in γ-ray cascades for neutron-induced reactions

Neutron-induced γ-ray spectra provide key inputs for modern active interrogation applications. A precise modeling of the nuclear reaction and subsequent emission of γ rays is challenging and often impossible due to limitations on evaluated data file formats and nuclear transport simulation codes. We present a framework that addresses these challenges by combining experimental data and reaction-model calculation outputs into an extended candidate version of the Generalized Nuclear Data Structure (GNDS) file, the successor format for the legacy Evaluated Nuclear Data File (ENDF-6). This proposed GNDS hierarchical format contains all the necessary ingredients for inline γ-ray cascade reproduction with event-by-event precision, including continuum–continuum and continuum–discrete transitions following neutron-capture and inelastic neutron scattering reactions. Cascade-event generation based on our approach demonstrates improved energy conservation on an event-by-event basis and permits the use of γ-γ coincidences in applications. This work offers, for the first time, a method to generate neutron-capture and inelastic neutron-scattering γ-ray cascades where energy conservation, correlations, and experimental primaries are fully accounted for.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

AmeriFlux BASE Flux/Met Data QA/QC and Processing (AMF-BASE-QAQC) v1.0.0

The AmeriFlux BASE Flux/Met Data QA/QC and Processing (AMF-BASE-QAQC) code provides tools to review and prepare continuous flux/met data submitted to the AmeriFlux Management Project for publication as the AmeriFlux BASE data product. The code provides 3 core functionalities: Format QA/QC assesses submitted data files for compliance with the required submission format; Data QA/QC assesses the data quality; BASE Publish prepares the data for publication.

Christianson, Danielle↗
DOE OSTI2017

Temperature-dependent self-assembly and rheological behavior of a thermoreversible pmma-P n BA-PMMA triblock copolymer gel

Self-assembly and mechanical properties of triblock copolymers in a mid-block selective solvent are of interest in many applications. Herein, we report physical assembly of an ABA triblock copolymer, [PMMA–PnBA–PMMA] in two different mid-block selective solvents, n-butanol and 2-ethyl-1-hexanol. Gel formation resulting from end-block associations and the corresponding changes in mechanical properties have been investigated over a temperature range of -80 °C to 60 °C, from near the solvent melting points to above the gelation temperature. Shear-rheometry, thermal analysis, and small-angle neutron scattering data reveal formation and transition of structure in these systems from a liquid state to a gel state to a percolated cluster network with decrease in temperature. The aggregated PMMA end-blocks display a glass transition temperature. Our results provide new understanding into the structural changes of a self-assembled triblock copolymer gel over a large length scale and wide temperature range.

36 MATERIALS SCIENCE↗
NASA NTRS1984

Energetic ion mass composition as observed at near-geosynchronous and low altitudes during the storm period of February 21 and 22, 1979

Mass composition data acquired during the storm period of February 21 and 22, 1979 are presented and analyzed. Near-geosynchronous data from the SCATHA spacecraft are described, giving the data in spectrogram format. Low-altitude data from the S3-3 spacecraft are presented, and it is shown that they raise questions concerning the evolution of the low-altitude, 0.5-16 keV/q plasma population after the main phase of magnetic storms. The importance of convection as an explanation of the signatures found in the low-altitude S3-3 data is considered. Some work concerning steady state convection models is summarized, pointing out those aspects of the theory relevant to the S3-3 data. Results from the theory are applied to those data, which are also displayed in spectrogram format. The results are discussed, using the geosynchronous composition data as a monitor of the source of the injected plasma.

Strangeway, R. J.↗
DOE OSTI2024

ROOT’s RNTuple I/O Subsystem: The Path to Production

The RNTuple I/O subsystem is ROOT’s future event data file format and access API. It is driven by the expected data volume increase at upcoming HEP experiments, e.g. at the HL-LHC, and recent opportunities in the storage hardware and software landscape such as NVMe drives and distributed object stores. RNTuple is a redesign of the TTree binary format and API and has shown to deliver substantially faster data throughput and better data compression both compared to TTree and to industry standard formats. In order to let HENP computing workflows benefit from RNTuple’s superior performance, however, the I/O stack needs to connect efficiently to the rest of the ecosystem, from grid storage to (distributed) analysis frameworks to (multithreaded) experiment frameworks for reconstruction and ntuple derivation. With the RNTuple binary format soon arriving at its first production release, we present RNTuple’s feature set, integration efforts, and its performance impact on the time-to-solution. We show the latest performance figures of RDataFrame analysis code of realistic complexity, comparing RNTuple and TTree as data sources. We discuss RNTuple’s approach to functionality critical to the HENP I/O (such as multithreaded writes, fast data merging, schema evolution) and we provide an outlook on the road to its use in production.

Blomer, Jakob↗
DOE OSTI2025

Fostering Geothermal Machine Learning Success: Elevating Big Data Accessibility and Automated Data Standardization in the Geothermal Data Repository

The Department of Energy's (DOE's) Geothermal Data Repository (GDR) has implemented improvements to both its data lakes and its data standards and automated data pipelines. The GDR data lakes have reduced storage and compute-related barriers to using large geothermal datasets, enabling these large datasets to be accessed by anyone with a modern computer and internet access. More recently, the GDR has been working to further reduce barriers through streamlining the data intake process, educating users on the process and requirements, and helping users access data from the data lakes. These improvements have augmented the quantity of datasets the GDR is able to accept into its data lakes and have enabled users who are new to cloud tools to access these datasets more easily, overall increasing the accessibility of big geothermal data for use in machine learning and other projects. In addition, the GDR now has built-in data standards and pipelines for drilling data, geospatial data, and distributed acoustic sensing (DAS) data. These standardization efforts aim to enhance the real-world applicability of geothermal machine learning outcomes by improving the quality of training data. Specifically, through standardizing high-value datasets, the GDR is reducing project-specific data curation requirements, thus allowing more time for actual research. By automating this process, the burden of standardization is lifted from the user, ultimately increasing the availability of standardized data. This paper provides an update on recent improvements made to the GDR's data lakes and automated data pipelines, including: (1) streamlining the data lake intake process, (2) better educating users on the process and requirements through a new data lakes page, (3) adding data lake direct access links to GDR data lake submission pages, (4) implementing a DAS data pipeline to convert DAS data uploaded in SEG-Y format to a standardized hierarchical data format v5 (HDF5), (5) extending this pipeline to encompass data in the GDR data lake, (6) adding metadata requirements for geospatial data, (7) making user interface/user experience (UX) enhancements to the data pipelines' documentation pages, and (8) improving the GDR's data standards and pipelines pages to better guide users in ensuring that their data is standardized by the GDR's automated data pipelines. 2024 Geothermal Resources Council. All rights reserved.

accessibility↗
DOE OSTI2018

The NOvA power distribution system

We describe the power distribution systems and grounding schemes built for the near and far detectors of the NOvA long-baseline neutrino experiment. They are used to power the avalanche photodiodes and their thermoelectric coolers, the front-end boards that read out, digitize and time stamp the signals from the avalanche photodiodes, and the data concentrator modules used to receive and format the data from the front-end boards before sending them to a farm of computers used to build the events. Furthermore, the system powers 344,064 readout channels in the far detector and 20,192 channels in the near detector.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2015

Three Dimensional Thermal Model of Newberry Volcano, Oregon

Final results of a 3D finite difference thermal model of Newberry Volcano, Oregon. Model data are formatted as a text file with four data columns (X, Y, Z, T). X and Y coordinates are in UTM (NAD83 Zone 10N), Z is elevation from mean sea level (meters), T is temperature in deg C. Model is 40km X 40km X 12.5 km, grid node spacing is 100m in X, Y, and Z directions. A symmetric cylinder shaped magmatic heat source centered on the present day caldera is the modeled heat source. The center of the modeled body is a -1700 m (elevation) and is 600m thick with a radius of 8700m. This is the best fit results from 2D modeling of the west flank of the volcano. The model accounts for temperature dependent thermal properties and latent heat of crystallization. For additional details, assumptions made, data used, and a discussion of the validity of the model see Frone, 2015 (Link below).

15 GEOTHERMAL ENERGY↗
DOE OSTI2024

FY 2024 Multidimensional Data Correlation Platform Data Management Infrastructure Progress: Materials Laboratory

This report provides an inventory of the equipment available at the ORNL Manufacturing Demonstration Facility (MDF) for sample preparation and material characterization, including both destructive and non-destructive techniques that generate critical data to support the development of the Multi-Dimensional Data Correlation (MDDC) framework. The success of the MDDC framework depends heavily on the quality and completeness of the data it can access. Therefore, it is essential to establish a comprehensive inventory of the technologies available to the Advanced Materials and Manufacturing Technologies (AMMT) multi-laboratory team. This starts by gathering information about the types of data they produce, the data collection and transfer protocols used, file formats, and data storage requirements for experiments. This information is then carefully evaluated to create the operations and trackables elements of the Damara Tern platform, which is the foundation of the MDDC framework.

36 MATERIALS SCIENCE↗
NASA NTRS2010

Asbestos Exposure Assessment Database

Exposure to particular hazardous materials in a work environment is dangerous to the employees who work directly with or around the materials as well as those who come in contact with them indirectly. In order to maintain a national standard for safe working environments and protect worker health, the Occupational Safety and Health Administration (OSHA) has set forth numerous precautionary regulations. NASA has been proactive in adhering to these regulations by implementing standards which are often stricter than regulation limits and administering frequent health risk assessments. The primary objective of this project is to create the infrastructure for an Asbestos Exposure Assessment Database specific to NASA Johnson Space Center (JSC) which will compile all of the exposure assessment data into a well-organized, navigable format. The data includes Sample Types, Samples Durations, Crafts of those from whom samples were collected, Job Performance Requirements (JPR) numbers, Phased Contrast Microscopy (PCM) and Transmission Electron Microscopy (TEM) results and qualifiers, Personal Protective Equipment (PPE), and names of industrial hygienists who performed the monitoring. This database will allow NASA to provide OSHA with specific information demonstrating that JSC s work procedures are protective enough to minimize the risk of future disease from the exposures. The data has been collected by the NASA contractors Computer Sciences Corporation (CSC) and Wyle Laboratories. The personal exposure samples were collected from devices worn by laborers working at JSC and by building occupants located in asbestos-containing buildings.

Arcot, Divya K.↗
NASA NTRS2010

Integrating Variances into an Analytical Database

For this project, I enrolled in numerous SATERN courses that taught the basics of database programming. These include: Basic Access 2007 Forms, Introduction to Database Systems, Overview of Database Design, and others. My main job was to create an analytical database that can handle many stored forms and make it easy to interpret and organize. Additionally, I helped improve an existing database and populate it with information. These databases were designed to be used with data from Safety Variances and DCR forms. The research consisted of analyzing the database and comparing the data to find out which entries were repeated the most. If an entry happened to be repeated several times in the database, that would mean that the rule or requirement targeted by that variance has been bypassed many times already and so the requirement may not really be needed, but rather should be changed to allow the variance's conditions permanently. This project did not only restrict itself to the design and development of the database system, but also worked on exporting the data from the database to a different format (e.g. Excel or Word) so it could be analyzed in a simpler fashion. Thanks to the change in format, the data was organized in a spreadsheet that made it possible to sort the data by categories or types and helped speed up searches. Once my work with the database was done, the records of variances could be arranged so that they were displayed in numerical order, or one could search for a specific document targeted by the variances and restrict the search to only include variances that modified a specific requirement. A great part that contributed to my learning was SATERN, NASA's resource for education. Thanks to the SATERN online courses I took over the summer, I was able to learn many new things about computers and databases and also go more in depth into topics I already knew about.

Sanchez, Carlos↗
NASA NTRS2019

Bringing Analysis Closer to Data: Developing a Visualization Tool for L2 Earth Science Satellite Data

Earth Science satellite missions provide a unique opportunity for scientists to visualize complex and multifaceted observations projected geospatially across maps of the Earth. While visualization tools can help scientists comprehend, analyze, and share data, visualizing Level-2 Earth Sciences data poses its own specific set of challenges. Since the geospatial information in Level-2 data files is stored as independent variables, the plotting process involves matching dimensional information from latitude and longitude with a desired variable. Variables are stored in different ways across various Earth Science data file formats, which complicates the process of extracting data and plotting variables from a given file without requiring extensive user input and prerequisite familiarity with the file type variable structure. In coordination with NASA’s Goddard Earth Sciences Data Information Services Center (GES DISC), the team developed a Level-2 Earth Science data visualization tool that aims to address some of the complexities associated with plotting Level-2 data. This tool offers command-line and user interface support for file and variable selection to accommodate varying use cases and degrees of user familiarity with the structure of a given file. The visualization tool is written in Python 3 and utilizes a modular approach to facilitate continued expansion and reuse. In addressing some common complications involved in plotting Level-2 Earth Sciences data, the tool aims to help to link the process of analysis more directly with data acquisition and visualization, bringing analysis closer to data across levels of processing.

Li, Angela W.↗
NASA NTRS2021

Time-Resolved Observations of Precipitation Structure and Storm Intensity with a Constellation of Smallsats: Level-1 Radiance Algorithm Theoretical Basis Document

This Algorithm Theoretical Basis Document (ATBD) describes the theoretical background of the TROPICS native radiance calibration algorithms. It also includes TROPICS payload characteristics and the algorithm’s ancillary data (i.e., data coming from sources other than the TROPICS Space Vehicle). Details of the native radiance (i.e., Level-1a antenna temperatures and Level-1b brightness temperatures) data product format can be found in the TROPICS Data User’s Guide. This ATBD information on the pre-launch testing completed to verify the algorithm. The TROPICS Data User’s Guide will contain the post-launch radiance validation.

TROPICS↗
NASA NTRS2022

Level-2A Unified Resolution Radiometric Product Algorithm Theoretical Basis Document

This Algorithm Theoretical Basis Document (ATBD) describes the theoretical background of the TROPICS Level-2A Unified Resolution Radiometric product (L2A-URRP). It also includes TROPICS payload characteristics and the algorithm’s ancillary data (i.e., data coming from sources other than the TROPICS Space Vehicle). Details of the L2A-URRP data product format can be found in the TROPICS Data User’s Guide. This ATBD will also contain the pre-launch testing completed to verify the algorithm. The TROPICS Data User’s Guide will contain the post-launch validation.

TROPICS↗
NASA NTRS2023

TROPICS -Atmospheric Vertical Temperature and Moisture Profiles: Algorithm Theoretical Basis Document

This Algorithm Theoretical Basis Document (ATBD) describes the theoretical background of the TROPICS Atmospheric Vertical Temperature and Moisture Profile (AVTP/AVMP) retrieval algorithms. It also includes TROPICS payload characteristics and the algorithm’s ancillary data (i.e., data coming from sources other than the TROPICS Space Vehicle). Details of the AVTP and AVMP, data product format can be found in the TROPICS Data User’s Guide. This ATBD will also contain the pre-launch testing completed to verify the algorithm. The TROPICS Data User’s Guide will contain the post-launch validation.

TROPICS↗