Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data formats”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

FTP-Server for exchange, interpretation, and database-search of ion mobility spectra, literature, preprints and software

To assist current discussion in the field of ion mobility spectrometry, at the Institut fur Spectrochemie und angewandte Spektroskopie, Dortmund, start with 4th of December, 1994 work of an FTP-Server, available for all research groups at univerisities, institutes and research worker in industry. We support the exchange, interpretation, and database-search of ion mobility spectra through data format JCAMP-DS (Joint Committee on Atomic and Molecular Physical Data) as well as literature retrieval, pre-print, notice, and discussion board. We describe in general lines the entrance conditions, local addresses, and main code words. For further details, a monthly news report will be prepared for all common users. Internet email address for subscribing is included in document.

Baumbach, J. I.↗

Visualization of International Solar-Terrestrial Physics Program (ISTP) data

The International Solar-Terrestrial Physics Program (ISTP) is a multispacecraft, multinational program whose objective is to promote further understanding of the Earth's complex plasma environment. Extensive data sharing and data analysis will be needed to ensure the success of the overall ISTP program. For this reason, there has been a special emphasis on data standards throughout ISTP. One of the key tools will be the common data format (CDF), developed, maintained, and evolved at the National Space Science Data Center (NSSDC), with the set of ISTP implementation guidelines specially designed for space physics data sets by the Space Physics Data Facility (associated with the NSSDC). The ISTP guidelines were developed to facilitate searching, plotting, merging, and subsetting of data sets. We focus here on the plotting application. A prototype software package was developed to plot key parameter (KP) data from the ISTP program at the Science Planning and Operations Facility (SPOF). The ISTP Key Parameter Visualization Tool is based on the Interactive Data Language (IDL) and is keyed to the ISTP guidelines, reading data stored in CDF. With the combination of CDF, the ISTP guidelines, and the visualization software, we can look forward to easier and more effective data sharing and use among ISTP scientists.

Kessel, Ramona L.↗

A Long-Term and Reproducible Passive Microwave Sea Ice Concentration Data Record for Climate Studies and Monitoring

A long-term, consistent, and reproducible satellite-based passive microwave sea ice concentration climate data record (CDR) is available for climate studies, monitoring, and model validation with an initial operation capability (IOC). The daily and monthly sea ice concentration data are on the National Snow and Ice Data Center (NSIDC) polar stereographic grid with nominal 25 km × 25 km grid cells in both the Southern and Northern Hemisphere polar regions from 9 July 1987 to 31 December 2007. The data files are available in the NetCDF data format at http://nsidc.org/data/g02202.html and archived by the National Climatic Data Center (NCDC) of the National Oceanic and Atmospheric Administration (NOAA) under the satellite climate data record program (http://www.ncdc.noaa.gov/cdr/operationalcdrs.html). The description and basic characteristics of the NOAA/NSIDC passive microwave sea ice concentration CDR are presented here. The CDR provides similar spatial and temporal variability as the heritage products to the user communities with the additional documentation, traceability, and reproducibility that meet current standards and guidelines for climate data records. The data set, along with detailed data processing steps and error source information, can be found at http://dx.doi.org/10.7265/N5B56GN3.

monitoring↗

TPSAS-NF1676L-16833-DND

Semantic Infrastructure is central to realizing the first goal of the ASDC's Strategic Plan: expanding the ASDC's customer base by improving access to ASDC data. ASDC data comprises a widely heterogeneous set of complex products which presents two significant challenges in data access: Helping customers discover, among many available options, the most suitable data products for their purpose; and Guiding customers to easily and appropriately use products. Data products differ significantly in terms of how the data was collected and processed, even with similar subject matter. Understanding differences is critical to using data effectively. To reach a broader customer range, the ASDC must provide prospective users with enough information to quickly and meaningfully compare and evaluate data products. Data formats and structures also differ among products. Applications displaying and analyzing data need access to federated and semantically disambiguated data. Semantic technologies offer functionality for addressing this issue. Ontologies can provide robust, stable domain models serving as common schema for discovering, evaluating, comparing, and integrating data from disparate products. Reasoning engines and triple stores can leverage ontologies to support intelligent search applications allowing users to discover, query, retrieve, and easily reformat data from a broad spectrum of sources.

Beth Huffer↗

Using Time Series Data Products to Support ASHRAE’s Historic and Future Climate Data Needs through NASA’s POWER Web Services

To address the data needs for resilience and sustainability of building systems within ASHRAE, the NASA Prediction of Worldwide Energy Resource (POWER) project facilitates the use of NASA Earth Science data on a long-term, global scale. Solar data from several NASA projects and meteorological data from NASA assimilation models have been reformatted and disseminated to the public via a user friendly web GIS-enabled based data portal (https://power.larc.nasa.gov) in selectable data formats, immediately amenable to key industry wide decision support tools such as EnergyPlus. Time series of potential climate conditions from downscaled climate simulations are being made available for similar statistics and formats. An emphasis is placed upon obtaining and utilizing time series data to conduct analysis of building system performance for current and planning building systems for energy savings and greenhouse gas emissions. This presentation has the learning following learning objectives for the ASHRAE community: 1) Learn how NASA POWER’s web service suite can provide supplementary solar and surface meteorological data parameters, including a discussion of uncertainty. 2) Learn how downscaled climate scenario information can be provided to evaluate potential future requirements. The presentation is part of a forum entitled, "Weather Data for Large-Scale Building Energy Modeling".

time series↗

Role of Mineralogy in Controlling Fracture Formation

The presence of fractures in caprocks can pose increased risks in subsurface energy systems and processes like CO 2 sequestration by introducing high-permeability leakage paths. Fracture apertures and permeability can be altered through mineral dissolution and precipitation reactions, but the reactive evolution of fractures is not well understood. In fractures, minerals that are otherwise inaccessible to reactive fluids can become exposed, resulting in mineral reactions unpredicted by bulk formation data. This work seeks to understand the relationship between mineralogy and fracture formation to enhance our understanding of reactive fracture evolution and CO 2 leakage potential. Here, the mineral compositions of mechanically induced fracture surfaces in samples of the Mancos and Marcellus shales have been quantified and compared to those of the near-fracture matrices using imaging and bulk X-ray diffraction (XRD) data. In the Mancos shale, the concentrations of clay minerals are enhanced along fracture surfaces with respect to the bulk, and the fracture is most likely to form at kaolinite–kaolinite interfaces. Further, evaluation of the mineralogical spatial variability through cross-correlation analysis of the surrounding matrix in images of samples cut perpendicular to the fracture shows that clay is 16.7 times more likely to be present than carbonate minerals near the fracture surface. The high correlation persists roughly 200 μm into the surrounding matrix for the Mancos sample and implies that the fracture formed within a defined clay-rich lithofacies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Harmonized Database of Western U.S. Water Rights (HarDWR) v.1

Abstract In the arid and semi-arid Western U.S., access to water is regulated through a legal system of water rights. Individuals, companies, organizations, municipalities, and tribal entities have documents that declare their water rights. State water regulatory agencies collate and maintain these records, which can be used in legal disputes over access to water. While these records are publicly available data in all Western U.S. states, the data have not yet been readily available in digital form from all states. Furthermore, there are many differences in data format, terminology, and definitions between state water regulatory agencies. Here, we have collected water rights data from 11 Western U.S. state agencies, harmonized terminology and use definitions, formatted them for consistency, and tied them to a Western U.S.-wide shapefile of water administrative boundaries.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

O(N) Quantum Molecular Dynamics (QMD) Algorithms, Code Requirements, Release Notes, and Library Deployment

The Exascale Computing Project (ECP) Co-design Center for Particle Applications (CoPA) is addressing the challenges for particle applications to run on upcoming exascale computing architectures. This includes short- and long-range molecular dynamics (MD), particle-in-cell (PIC), and quantum molecular dynamics (QMD). This document addresses $\mathcal{O}(N)$ QMD. The goal of this CoPA team is to develop $\mathcal{O}(N)$ linear scaling methods for QMD optimized for new and next generation architectures. This will provide the capability to simulate larger systems and run for longer timeframes than is possible today. Focus is initially on the density matrix construction. This requires efficient matrix formats and linear algebra operations for distributed architectures. A significant reduction in the wallclock time for an MD timestep is necessary to achieve practical large scale QMD. Equally challenging is to develop scalable distributed implementations. This requires the exploration of efficient data formats (dense, sparse, etc.), data decomposition and distribution across compute nodes using block- and graph-based methods. Traditional programming models such as MPI/OpenMP, hybrid MPI/OpenMP/Accelerator, as well as asynchronous task-based models will be explored to achieve maximum parallelism. Parallelism at the level of a matrix operation, solver, and/or application needs to be explored to gain the most benefit on new and emerging architectures. This report serves as a “living document” of the additions and enhancements throughout the ECP CoPA project for $\mathcal{O}(N)$ QMD. The following sections address the applications we are working with, the quantum chemistry libraries (BML and PROGRESS), and our co-design exploration through the use of a proxy application.

36 MATERIALS SCIENCE↗

NASA Test File

Test File is data file containing computer-aided design (CAD) data formatted according to National Bureau of Standards Initial Graphic Exchange Specification (IGES). File created for purpose of conducting NASA tests to determine to what extent dissimilar CAD systems exchange data using the IGES standard formats and IGES translators.

Gordon, S.↗

Data for "Relative Reactivity and Bioavailability of Mercury Sorbed to or Coprecipitated with Aged Iron Sulfides"

The potential for inorganic mercury (Hg) to be converted to methylmercury depends, in part, on the chemical form of Hg and its bioavailability to anaerobic microorganisms that can methylate Hg. In anaerobic settings, Hg can be associated with sulfide phases, including ferrous iron sulfide (FeS), which can sorb or coprecipitated with Hg. The objective of this study was to determine if the aging state of FeS alters the Hg coordination environment as well as the reactivity and bioavailability of sorbed and coprecipitated Hg species. FeS particles were synthesized with and without Hg2+ and aged in anaerobic conditions for multiple time frames spanning from 1 hour to 1 month. For FeS particles synthesized without Hg, Hg2+ was subsequently sorbed to the FeS for 1 day. Analysis of Hg speciation of these materials by X-ray absorption near edge spectroscopy revealed a predominance of 4-coodinate Hg-S species in the sorbed Hg-FeS solids and a mixture of 2- and 4-coordinate Hg-S in the coprecipitated Hg-FeS. The leaching potential of the Hg was assessed by exposing the particles to a solution of dissolved glutathione (a thiolate-based Hg chelator). As expected, the sorbed Hg-FeS released more soluble Hg compared to the co-precipitated Hg-FeS. However, when these particles were exposed to Desulfovibrio desulfuricans ND132 (a known Hg methylator), more Hg was methylated from the co-precipitated Hg-FeS than the sorbed Hg-FeS, consistent with expectations from the Hg-S coordination state and inconsistent with the selective leaching results. Overall, these results suggest that the bioavailability of particulate Hg cannot be easily discerned by leaching potential into bulk solution. Rather, bioavailability entails more subtle interactions at particle-cell interfaces and perhaps correlates with the local Hg-S coordination state in the particles. This data package contains data shown in the referenced publication, including all figures. Each figure is available in the respective *.csv file and a summary of all files are also included in the the xlsx file. Additional formatted data include X-ray diffraction data of the FeS solids are also available in a HPF format (Panalytical software), X-ray absorption spectroscopy data as *.prj files (Athena), and X-ray fluorescence data in its raw data form.

54 ENVIRONMENTAL SCIENCES↗

radkit v1.2

The radkit software suite (python) consists of three primary libraries: stark, trajan, and curie. The trajan library provides the tools to analyze and manipulate data from lidar and inertial measurement unit (IMU) devices as well as trajectories from algorithms such as simultaneous localization and mapping (SLAM). These components allow reading and writing standard data formats, performing rigid affine transformations, discretizing three-dimensional space, and visualizing data products. The curie library comprises a standard set of object-oriented tools for radiation data and analysis in the following modules: (1) listmode and binmode data classes with methods for manipulation, plotting, slicing and file IO; (2) radiological/nuclear source detection/identification analysis results; (3) source encounters of correlated analyses and (4) energy-dependent angular detector response functions. The stark package provides low-level tools that are leveraged by both curie and trajan. The tools are flexible for offline analysis as well as performant for real-time integrations. The radkit libraries have associated Robot Operating System packages for use in real-time and robotic systems.

Joshi, Tenzing↗

radkit base v1.6

The radkit (base) software suite (python) consists of three primary libraries: stark, trajan, and curie. The trajan library provides the tools to analyze and manipulate data from lidar and inertial measurement unit (IMU) devices, cameras, as well as trajectories from algorithms such as simultaneous localization and mapping (SLAM). These components allow reading and writing standard data formats, performing rigid affine transformations, discretizing three-dimensional space, and visualizing data products. The curie library comprises a standard set of object-oriented tools for radiation data and analysis in the following modules: (1) listmode and binmode data classes with methods for manipulation, plotting, slicing and file IO; (2) radiological/nuclear source detection/identification analysis results; (3) source encounters of correlated analyses and (4) energy-dependent angular detector response functions. The stark package provides low-level tools that are leveraged by both curie and trajan. The tools are flexible for offline analysis as well as performant for real-time integrations.

Salathe, Marco [Lawrence Berkeley National Laborat↗

Non-destructive Preirradiation Assessment of UN / U-Si “LANL1” ATF formulation

The goal of the Advanced Non-destructive Fuel Examination (ANDE) work package is the development and application of non-destructive neutron imaging and scattering techniques to ceramic and metallic nuclear fuels, ultimately also to irradiated fuels. The results of these characterizations provide complete pre- and post-irradiation on length scales ranging from mm to nm, guide destructive examination, and inform modelling efforts. Besides technique development and application to samples to be irradiated, the ANDE work package also examines possible technologies to provide these characterization techniques pool-side, e.g. at the Advanced Test Reactor (ATR) at Idaho National Laboratory (INL) using laser-driven intense pulsed neutron and gamma sources. Neutron tomography and neutron diffraction characterizations were performed on nine pellets; four UN/ U-Si composite formulations (two enrichment levels), three pure U 3 Si 5 reference formulations (two enrichment levels), and two reject pellets with visible flaws (to qualify the technique). The 235 U enrichments ranged from 0.2 to 8.8 wt. %. The nitride/silicide composites are candidate compositions for use as Accident Tolerant Fuel (ATF). The monophase U 3 Si 5 material was included as a reference. Pellets from the same fabrication batches will be inserted in the Advanced Test Reactor at Idaho during 2016. We have also proposed a data format to build a database for characterization results of individual pellets. Neutron data reported in this report were collected in the LANSCE run cycle that started in September 2015 and ended in March 2016. This report provides the results for the characterized samples and discussion in the context of ANDE and APIE. We quantified the gamma spectra of several samples in their received state as well as after neutron irradiation to ensure that the neutron irradiation does not add significant activation that would complicate shipment and handling. We demonstrated synchrotron-based 3D X-ray microscopy on the composite fuel materials, providing unparalleled level of detail on the 3D microstructure. Furthermore, we initiated development of shielding containers allowing the characterizations presented herein while allowing handling of irradiated samples.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Demand-Side Grid Model (dsgrid) Data from the Electrification Futures Project (EFS)

This data set contains the full-resolution and state-level data described in the linked technical report (https://www.nrel.gov/docs/fy18osti/71492.pdf). It can be accessed with the NREL-dsgrid-legacy-efs-api, available on GitHub at https://github.com/dsgrid/dsgrid-legacy-efs-api and through PyPI (pip install NREL-dsgrid-legacy-efs-api). The data format is HDF5. The API is written in Python. This initial dsgrid data set, whose description was originally published in 2018, covers electricity demand in the contiguous United States (CONUS) for the historical year of 2012. It is a proof-of-concept demonstrating the feasibility of reconciling bottom-up demand modeling results with top-down information about electricity demand to create a more detailed description than is possible with either type of data source on its own. The result is demand data that is more highly resolved along geographic, temporal, sectoral, and end-use dimensions as may be helpful for conducting electricity sector-wide "what-if" analysis of, e.g., energy efficiency, electrification, and/or demand flexibility. Although we conducted bottom-up versus top-down validation, the final residuals were significant, especially at higher geographic and temporal resolution. Please see the Executive Summary and/or Section 3 of the report to obtain an understanding of the data set limitations before deciding whether these data are suitable for any particular use case. New dsgrid datasets are under development. Please visit https://www.nrel.gov/analysis/dsgrid.html for the latest information which is also linked in the data resources.

analysis↗

Methods for safely sharing dual-use genetic data

Background: Some genetic data has dual-use potential. Sharing pathogen data has shown tremendous value. For example therapeutic development and lineage tracking during the COVID pandemic. This data sharing is complicated by the fact that these data have the potential to be used for harm. The genome sequence of a pathogen can be used to enable malicious genetic engineering approaches or to recreate the pathogen from synthetic DNA. Standard data security methods can be applied to genetic data, but when data is shared between institutions, ensuring appropriate security can be difficult. Sensitive data that is shared internationally among a wide array of institutions can be especially difficult to control. Methods for securely storing and sharing genetic data with potential for dual-use are needed to mitigate this potential harm.Results: Here we propose new methods that allow genetic data to be shared in a data format that prevents a nefarious actor from accessing sensitive aspects of the data. Our methods obfuscate raw sequence data by pooling reads from different samples. This approach can ensure that data is secure while stored and during electronic transfer. We demonstrate that by pooling raw sequence data from multiple samples of the same organism, the ability to fully reconstruct any individual sample is prevented. In the pooled data, most genomic information remains, but reads or mutations cannot be directly attributed to any individual sample. To further restrict access to information, regions of a genome can be removed from the reads.Conclusion: Our methods obscure genomic information within raw sequence reads. This method can allow genetic data to be stored and shared while preventing a nefarious actor from being able to perfectly reconstruct an organism. Broad-scale sequence information remains, while fine scale details about specific samples are difficult or impossible to reconstruct. Our software is available at https://github.com/Geneinfosec-Inc/ReadMixer.

59 BASIC BIOLOGICAL SCIENCES↗

Dynamically Reconfigurable Data Readout of Pixel Detectors for Automatic Synchronization with Data Acquisition Systems

Reconfigurable detectors with dynamically selectable sensing and readout modes are highly desirable for implementing edge computing as well as enabling advanced imaging techniques such as foveation. The concept of a camera system capable of simultaneous passive imaging and dynamic ranging in different regions of the detector is presented. Such an adaptive-autonomous detector with both spatial and temporal control requires programmable window of exposure (time frames), ability to switch between readout modes such as full-frame imaging and zero-suppressed data, modification of the number of pixel data bits and independent programmability for distinct detector regions. In this work, a method is presented for seamlessly changing time frames and readout modes without data corruption while still ensuring that the data acquisition system (DAQ) does not need to stop and resynchronize at each change of setting, thus avoiding significant dead time. Data throughput is maximized by using a minimum unique data format, rather than lengthy frame headers, to differentiate between consecutive frames. A data control and transmitter (DCT) synchronizes data transfer from the pixel to the periphery, reconfigures the data to transmit it serially off-chip, while providing optimized decision support based on a DAQ definable mode. Measurements on a test structure demonstrate that the DCT can operate at 1 GHz in a 65 nm LP CMOS process.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗