Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data processing and standardization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Detecting optical transients using artificial neural networks and reference images from different surveys

ABSTRACT We present a technique to detect optical transients based on an artificial neural networks method. We describe the architecture of two networks capable of comparing images of the same part of the sky taken by different telescopes. One image corresponds to the epoch in which a potential transient could exist; the other is a reference image of an earlier epoch. We use data obtained by the Dr. Cristina V. Torres Memorial Astronomical Observatory and archival reference images from the Sloan Digital Sky Survey. We trained a convolutional neural network and a dense layer network on simulated source samples and then tested the trained networks on samples created from real image data. Autonomous detection methods replace the standard process of detecting transients, which is normally achieved by source extraction of a difference image followed by human inspection of the detected candidates. Replacing the human inspection component with an entirely autonomous method would allow for a rapid and automatic follow-up of interesting targets of opportunity. The toy-model pipeline that we present here is not yet able to replace human inspection, but it might provide useful hints to identify potential candidates. The method will be further expanded and tested on telescopes participating in the Transient Optical Robotic Observatory of the South Collaboration.

79 ASTRONOMY AND ASTROPHYSICS↗

Comparative Assessment of Data-driven Process Models in Health Information Technology

Process mining for conformance analysis consists of comparing a reference process model against a data-driven process model generated via log files from information technology systems. However, in the absence of a complete reference process model, we found no suggested approaches in the literature to address the need for evaluating process conformance among different healthcare facilities to assess standardization of care. Our goal is to find similarities and dissimilarities in data-driven process models among US Veterans Health Administration (VHA) facilities that can be indicative of patient safety issues. Our hypothesis was that the analysis would not produce statistically significant differences in outcome. We present a unique implementation of conformance analysis in process mining that consists of combining process mining, process mapping and statistical metrics. We illustrate our approach by applying it to the analysis of two clinical radiology order process models generated from healthcare data provided by two similar facilities in the VHA. The comparative assessment showed that about 70% of the orders completed successfully and 30% were not completed due to policy and duplications. Our analysis found a good statistical correlation between both facilities, as the Spearman’s correlation coefficient between facilities for the frequency of cases per total hours was 0.87879, for the frequency of cases by state transition was 0.79702 and for the throughput time per state transition was 0.63582. Additional statistical analyses using the Mann-Whitney U test and the root mean square error both produced values that were not significant. The foregoing approach validated our hypothesis by demonstrating a good statistical correlation of data describing the flow of clinical radiology orders absent a credible reference model. Finding good agreement between both facilities was important in confirming that the clinical orders flow in a similar manner, suggesting standardization of care.

97 MATHEMATICS AND COMPUTING↗

Navigation and Meteorological Data from Multiple Sensors on Airborne Platform (NAVMET-AIR) Value-Added Product Report

The Navigation and Meteorological Data from Multiple Sensors on Airborne Platform (NAVMET-AIR) value-added product encompasses the aafnaviwg data set in the ARM Data Center (ADC), known as the IWG file, named for the Inter-Agency Working Group for Airborne Data and Telemetry Systems (IWGADTS). Its purpose is to produce a suite of tools to promote standardization of instrument interface, data format, and data processing. This data set’s contents are navigational and meteorological state variables at 1 Hz. It also contains higher-order data flags created by ARM Aerial Facility (AAF) scientists to aid analysis such as periods when the aircraft is flying level, operating in maneuvers, or flying through cloud. Due to the nature of research flights, the payload of the aircraft consists of many duplicate and overlapping instruments to ensure, in case of instrument failure, there is a backup to record the data. Measurements from multiple instruments are consolidated into a single file. Each variable of this data set is carefully chosen from the onboard instrumentation and quality checked by AAF scientists to create this wholistic and most accurate data set for airborne research. This document is intended to be a hub towards the individual “read me” files produced for each campaign. For reference about what instrument was used for calculations on specific days, the read me files are located in the ARM IOP archive at the addresses listed, or access the IOP (intensive operational period) database at https://www.archive.arm.gov/.

54 ENVIRONMENTAL SCIENCES↗

An Infrared Database of n/k Optical Constants for Calculating Aerosol Spectra for the PICARD Program

The objective of the PICARD Program is to develop fieldable sensing platforms for the rapid chemical identification of aerosol particles in plumes. Standoff detection involves interrogating the aerosol cloud from a distance using optical methods and probing the signal returned from direct backscattering from the aerosol particles or transmitted through the plume after reflection from a retroreflector or surface of opportunity (SOO). The identification of chemical species, however, in aerosols is complicated by their complex compositions and morphologies, chemical interferants, and non-uniform particle sizes. To advance standoff detection of aerosols, modelling the infrared transmittance, reflectance and scattering spectra of aerosolized liquid and solid chemical compounds is required, and then testing that model experimentally via laboratory and field experiments. To perform accurate modeling, the infrared optical constants (n/k), i.e., the complex refractive index, of the compounds of interest are required. Thus, PNNL was tasked to provide the optical constants for a set of analytes relevant to the PICARD program. This report describes the experimental techniques used to derive the optical constants of both liquid and solid compounds using established “gold-standard” protocols, how the experimental data are processed to produce the wavenumber dependent optical constant vectors, and how the data are used in the aerosol absorption spectra modeling.

complex refractive index↗

The DECADE cosmic shear project I: A new weak lensing shape catalog of 107 million galaxies

We present the Dark Energy Camera All Data Everywhere (DECADE) weak lensing dataset: a catalog of 107 million galaxies observed by the Dark Energy Camera (DECam) in the northern Galactic cap. This catalog was assembled from public DECam data including survey and standard observing programs. These data were consistently processed with the Dark Energy Survey Data Management pipeline as part of the DECADE campaign and serve as the basis of the DECam Local Volume Exploration survey (DELVE) Early Data Release 3 (EDR3). We apply the Metacalibration measurement algorithm to generate and calibrate galaxy shapes. After cuts, the resulting cosmology-ready galaxy shape catalog covers a region of $5,\!412 \,\,{\rm deg}^2$ with an effective number density of $4.59\,\, {\rm arcmin}^{-2}$. The coadd images used to derive this data have a median limiting magnitude of $r = 23.6$, $i = 23.2$, and $z = 22.6$, estimated at ${\rm S/N} = 10$ in a 2 arcsecond aperture. We present a suite of detailed studies to characterize the catalog, measure any residual systematic biases, and verify that the catalog is suitable for cosmology analyses. In parallel, we build an image simulation pipeline to characterize the remaining multiplicative shear bias in this catalog, which we measure to be $m = (-2.454 \pm 0.124) \times10^{-2}$ for the full sample. Despite the significantly inhomogeneous nature of the data set, due to it being an amalgamation of various observing programs, we find the resulting catalog has sufficient quality to yield competitive cosmological constraints.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

BICEP/Keck. XVII. Line-of-sight Distortion Analysis: Estimates of Gravitational Lensing, Anisotropic Cosmic Birefringence, Patchy Reionization, and Systematic Errors

We present estimates of line-of-sight distortion fields derived from the 95 and 150 GHz data taken by BICEP2, BICEP3, and the Keck Array up to the 2018 observing season, leading to cosmological constraints and a study of instrumental and astrophysical systematics. Cosmological constraints are derived from three of the distortion fields concerning gravitational lensing from large-scale structure, polarization rotation from magnetic fields or an axion-like field, and the screening effect of patchy reionization. We measure an amplitude of the lensing power spectrum ${A}_{L}^{\phi \phi }=0.95\pm 0.20$. We constrain polarization rotation, expressed as the coupling constant of a Chern–Simons electromagnetic term g aγ ≤ 2.6 × 10 -2 /H I , where H I is the inflationary Hubble parameter, and an amplitude of primordial magnetic fields smoothed over 1 Mpc B 1Mpc ≤ 6.6 nG at 95 GHz. We constrain the rms of optical depth fluctuations in a simple "crinkly surface" model of patchy reionization, finding A τ < 0.19 (2σ) for the coherence scale of L c = 100. We show that all of the distortion fields of the 95 and 150 GHz polarization maps are consistent with simulations including lensed ΛCDM, dust, and noise, with no evidence for instrumental systematics. In some cases, the EB and TB quadratic estimators presented here are more sensitive than our previous map-based null tests at identifying and rejecting spurious B-modes that might arise from instrumental effects. Finally, we verify that the standard deprojection filtering in the BICEP/Keck data processing is effective at removing temperature to polarization leakage.

79 ASTRONOMY AND ASTROPHYSICS↗

Workshop on Using a Git-based Repository for ASTM Committee Technical Knowledge Capture [Slides]

Consensus technical standards maintained by ASTM International rely on individual contributors to act as technical contacts, effectively stewards, for a particular standard. As a particular standard’s technical content evolves over time, the contact must update relevant tables, graphics, and supporting discussion. However, the details of the data sources and/or processes used to perform such updates may be separate enough from the standard such that expert knowledge is required to perform these updates. As a result of this need for expert knowledge, and the desire to capture that knowledge, subcommittee E10.05 (Nuclear Radiation Metrology) has experimented with using a git-based repository to capture data and processes to reproduce figures needed by E10.05 to maintain the ASTM standards under their jurisdiction. This workshop will provide an overview of the git-based repository site’s organization, operation, and outputs. It will then lead interested workshop participants through adding content, not yet already included in the repository to the site.

42 ENGINEERING↗

Fast and Accurate Predictions of Total Energy for Solid Solution Alloys with Graph Convolutional Neural Networks

We use graph convolutional neural networks (GCNNs) to produce fast and accurate predictions of the total energy of solid solution binary alloys. GCNNs allow us to abstract the lattice structure of a solid material as a graph, whereby atoms are modeled as nodes and metallic bonds as edges. This representation naturally incorporates information about the structure of the material, thereby eliminating the need for computationally expensive data pre-processing which would be required with standard neural network (NN) approaches. We train GCNNs on ab-initio density functional theory (DFT) for copper-gold (CuAu) and iron-platinum (FePt) data that has been generated by running the LSMS-3 code, which implements a locally self-consistent multiple scattering method, on OLCF supercomputers Titan and Summit. GCNN outperforms the ab-initio DFT simulation by orders of magnitude in terms of computational time to produce the estimate of the total energy for a given atomic configuration of the lattice structure. We compare the predictive performance of GCNN models against a standard NN such as dense feedforward multi-layer perceptron (MLP) by using the root-mean-squared errors to quantify the predictive quality of the deep learning (DL) models. We find that the attainable accuracy of GCNNs is at least an order of magnitude better than that of the MLP.

Lupo Pasini, Massimiliano↗

4. Geometry Data Storage

3D-printing begins with the design of an object using computer aided design (CAD) software. The geometry of the object must be exported and saved in a data file format that can be used in the slicing process to generate machine instructions for printing. The standard method of saving the data is to tessellate the object as a triangulated mesh stored as a .stl file. Due to the flat triangular faces used to store the data, this mesh is a low-resolution representation of the high-fidelity object designed in CAD. The STL has its limitations with respect to geometrical accuracy, material information, and instances of invalid mesh data, but can still be used for the 3D-printing process. New file variants, such as OBJ, AMF, and 3MF, are being developed to fix some of these issues and increase the capabilities of geometry data storage for 3D-printing.

Roschli, Alex↗

Robust Method to Identify Groundwater Affected By Redox Conditions at Los Alamos National Laboratory Legacy Cleanup Site - 20497

To facilitate the mission of the Department of Energy's (DoE's) Environmental Management Program at Los Alamos National Laboratory (LANL), a significant number of groundwater monitoring wells with depths ranging from 152-396 meter were completed for characterization and monitoring. Groundwater at Los Alamos tends to be oxygen saturated with very low concentrations of organic matter. Drilling fluids can introduce residual carbon causing an increase in microbial activity and local reducing conditions around the well, potentially impacting representativeness of groundwater data quality for redox sensitive constituents. We assert that the redox state of the wells can robustly be identified by aqueous solution concentrations of iron and manganese. An automated review process has been built into a computer-based data management system enabling an efficient screening process for identifying reducing conditions that are not caught using standard data-validation protocol, and ensures that important data quality issues are thoroughly identified and addressed in an efficient and timely manner. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Idaho National Laboratory Data Acquisition And Processing System

The INLDAS data acquisition and processing system is designed to develop prototype measurements and real-time processing techniques. The INLDAS hardware and firmware currently consists of National Instruments • NI-DAQmx 14.1 • cDAQ-9184 • 9205 • 9211 INLDAS can perform of standard data acquisition functions as well as novel functions and real-time processing algorithms. There are 3 acquisition modes to choose from: • Continuous mode runs when the user hits start, processing data and logging it to file • SWTrigger mode waits for one or more predefined triggers before acquiring data. It will buffer data as well, so it can record data that happened shortly before the trigger • Wakeup mode waits on predefined timers. When a time goes off, it acquires a preset amount of data There are also 3 Data Processing Modes • Normal mode does no processing besides the rolling average • FFT Mode Performs an FFT on incoming data every time the time window has elapsed • STFFT mode

Smith, JamesA↗

Challenges in Bioinformatics Workflows for Processing Microbiome Omics Data at Scale

The nascent field of microbiome science is transitioning from a descriptive approach of cataloging taxa and functions present in an environment to applying multi-omics methods to investigate microbiome dynamics and function. A large number of new tools and algorithms have been designed and used for very specific purposes on samples collected by individual investigators or groups. While these developments have been quite instructive, the ability to compare microbiome data generated by many groups of researchers is impeded by the lack of standardized application of bioinformatics methods. Additionally, there are few examples of broad bioinformatics workflows that can process metagenome, metatranscriptome, metaproteome and metabolomic data at scale, and no central hub that allows processing, or provides varied omics data that are findable, accessible, interoperable and reusable (FAIR). Here, we review some of the challenges that exist in analyzing omics data within the microbiome research sphere, and provide context on how the National Microbiome Data Collaborative has adopted a standardized and open access approach to address such challenges.

NMDC, Microbiome↗

Planck 2018 results

We analyse the Planck full-mission cosmic microwave background (CMB) temperature and E -mode polarization maps to obtain constraints on primordial non-Gaussianity (NG). We compare estimates obtained from separable template-fitting, binned, and optimal modal bispectrum estimators, finding consistent values for the local, equilateral, and orthogonal bispectrum amplitudes. Our combined temperature and polarization analysis produces the following final results: f NL local = -0.9 ± 5.1; f NL equil = -26 ± 47; and f NL ortho = -38 ± 24 (68% CL, statistical). These results include low-multipole (4 ≤ ℓ < 40) polarization data that are not included in our previous analysis. The results also pass an extensive battery of tests (with additional tests regarding foreground residuals compared to 2015), and they are stable with respect to our 2015 measurements (with small fluctuations, at the level of a fraction of a standard deviation, which is consistent with changes in data processing). Polarization-only bispectra display a significant improvement in robustness; they can now be used independently to set primordial NG constraints with a sensitivity comparable to WMAP temperature-based results and they give excellent agreement. In addition to the analysis of the standard local, equilateral, and orthogonal bispectrum shapes, we consider a large number of additional cases, such as scale-dependent feature and resonance bispectra, isocurvature primordial NG, and parity-breaking models, where we also place tight constraints but do not detect any signal. The non-primordial lensing bispectrum is, however, detected with an improved significance compared to 2015, excluding the null hypothesis at 3.5 σ . Beyond estimates of individual shape amplitudes, we also present model-independent reconstructions and analyses of the Planck CMB bispectrum. Our final constraint on the local primordial trispectrum shape is g NL local = (-5.8 ± 6.5) × 10 4 (68% CL, statistical), while constraints for other trispectrum shapes are also determined. Exploiting the tight limits on various bispectrum and trispectrum shapes, we constrain the parameter space of different early-Universe scenarios that generate primordial NG, including general single-field models of inflation, multi-field models (e.g. curvaton models), models of inflation with axion fields producing parity-violation bispectra in the tensor sector, and inflationary models involving vector-like fields with directionally-dependent bispectra. Our results provide a high-precision test for structure-formation scenarios, showing complete agreement with the basic picture of the ΛCDM cosmology regarding the statistics of the initial conditions, with cosmic structures arising from adiabatic, passive, Gaussian, and primordial seed perturbations.

79 ASTRONOMY AND ASTROPHYSICS↗

als microct recon (microct) v1

Jupyter notebooks to reconstruct and visualize microCT data from ALS beamline 8.3.2. Relies on standard tomography and image processing tools (astra, tomopy, itk, scikit-image) and ipywidgets (sliders, drop down menus, etc) to make parameter selection and data visualization easy for users.

Parkinson, Dilworth↗

Assessing Uncertainty in Solar Measurements: Key Findings From NLR's SUNI Application Across 89 Stations

The Solar Uncertainty Integrator (SUNI) study was developed by the National Laboratory of the Rockies (NLR's) to provide a standardized "bulk uncertainty processing" method for solar irradiance data, which are essential for the successful deployment of solar energy systems. This poster provides an overview of key findings from NLR's SUNI application across 89 stations.

14 SOLAR ENERGY↗

Mapping of Benthic Habitats at Marine Renewable Energy Sites Using Multibeam Echosounder and Sediment Profile Imaging Technologies

Objectives/Scope: The goal of this work was to develop a consistent and semi-automated seafloor survey method for generating high-resolution, benthic habitat maps for environmental assessments and monitoring of marine renewable energy sites. Sediment profile and plan view imaging (SPI/PV) technology was combined with multibeam bathymetry and acoustic backscatter methods to demonstrate a rapid, cost-effective benthic mapping protocol. A key technical innovation of this project was the development of an image processing platform that automatically measures key features from the images. Methods: Multibeam echosounder (MBES) acoustic and SPI/PV surveys were conducted at three coastal areas off the U.S. west coast, including the PacWave South energy test site off of Newport, Oregon. Point data on physical and biological sediment conditions obtained from the SPI/PV imagery were used to efficiently ground-truth the high-resolution MBES bathymetry and backscatter mosaics. The SPI camera is an optical corer that obtains an undisturbed 21 by 15 cm, high-resolution, cross-sectional image of the sediment–water interface and upper sediment column. The plan view camera attached to the SPI camera frame captures a downward looking view of the seabed immediately before the SPI image is obtained. As part of this project, we developed a computer vision image processing platform (iSPI) that uses deep convolutional neural networks and other approaches to automatically identify and measure key features in the images, such as grain size and surface relief. Results: Detailed benthic habitat maps were generated using this mapping approach for three different marine settings. The sites mapped included a silt-dominated embayment; a sloping, nearshore, transitional very fine to coarse sand bottom; and a medium, sand-dominated continental shelf marine energy test site. In each case, acoustic and imaging surveys were completed in less than week, and detailed benthic habitat maps were generated within 60 days. The results were placed within the Coastal and Marine Ecological Classification Standard (CMECS) habitat mapping framework, and various combinations of the bathymetry, backscatter, and SPI and PV data were used to generate CMECS component maps. Novel Information: This project developed and demonstrated a repeatable and cost-effective approach for efficiently mapping benthic habitat conditions over broad areas of the seafloor by combining state-of-the-art acoustic and imaging techniques. The primary survey tools used in this project have been used previously in both the offshore renewable (wind) and oil and gas sectors to map and monitor benthic environments. This project’s innovations include 1) the focused use of high-resolution SPI/PV imagery to ground-truth acoustic mosaics, and 2) the development of a computer automated image analysis processing tool that both streamlines and standardizes the generation of data from the imagery and makes the data extraction process more cost-effective and repeatable.

13 HYDRO ENERGY↗

Robust Interpretation of Electrochemical Impedance Spectra Using Numerical Complex Analysis

Electrochemical Impedance Spectroscopy (EIS) is a noninvasive technique widely used for understanding charge transfer and charge transport processes in electrochemical systems and devices. Standard approaches for the interpretation of EIS data involve starting with a hypothetical circuit model for the physical processes in the device based on experience/intuition and then fitting the EIS data to this circuit model. This work explores a mathematical approach for extracting key characteristic features from EIS data by relying on fundamental principles of complex analysis. These characteristic features can suggest the presence of inductors and constant phase elements (nonideal capacitors) from impedance data and enable us to answer questions about the identifiability and nonuniqueness of equivalent circuit models. In certain scenarios such as models with only resistors and capacitors, we are able to enumerate all possible families of circuit models. Finally, we apply the mathematical framework presented here to real-world electrochemical systems and highlight results using impedance measurements from a lithium-ion battery coin cell.

charge transfer↗

Data from: “Enabling FAIR data in Earth and environmental science with community-centric (meta)data reporting formats”

This dataset contains supplementary information for a manuscript describing the ESS-DIVE (Environmental Systems Science Data Infrastructure for a Virtual Ecosystem) data repository's community data and metadata reporting formats. The purpose of creating the ESS-DIVE reporting formats was to provide guidelines for formatting some of the diverse data types that can be found in the ESS-DIVE repository. The 6 teams of community partners who developed the reporting formats included scientists and engineers from across the Department of Energy National Lab network. Additionally, during the development process, 247 individuals representing 128 institutions provided input on the formats. The primary files in this dataset are 10 data and metadata crosswalk for ESS-DIVE’s reporting formats (all files ending in _crosswalk.csv). The crosswalks compare elements used in each of the reporting formats to other related standards and data resources (e.g., repositories, datasets, data systems). This dataset also contains additional files recommended by ESS-DIVE’s file-level metadata reporting format. Each data file has an associated dictionary (files ending in _dd.csv) which provide a brief description of each standard or data resource consulted in the data reporting format development process. The flmd.csv file describes each file contained within the dataset.

54 ENVIRONMENTAL SCIENCES↗