Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,495 records · Page 83

Dataset_for_Molecular_Motion_Below_the_Glass_Transition_A_Solid-State_NMR_Study_of_Siloxane_Polymer_Dynamics Study

This dataset contains solid-state 1H and 13C NMR relaxometry data, differential scanning calorimetry (DSC) data, and size exclusion chromatography (SEC/GPC) data supporting the study of sub-glass-transition (sub-Tg) molecular dynamics in a composition- and sequence-controlled series of diphenyl-substituted polysiloxanes (PDMS, 14Ph, 33Ph, 50Ph, 67Ph, and 100Ph; 0–100% diphenylsiloxane content by mole).All solid-state NMR data were acquired on a 200 MHz Bruker Avance III HD spectrometer using a static 7 mm HX probe or a 4 mm HX probe under 4 kHz magic-angle spinning. Raw Bruker TopSpin experiment folders are included for: (1) variable-temperature 1H lineshape measurements used to determine linewidth (FWHM) as a function of temperature across the glass transition; (2) 1H T1 (saturation recovery with solid-echo detection), probing nanosecond-scale dynamics near the 1H Larmor frequency; (3) 1H T1rho (direct spin-lock, 62.5 kHz), probing microsecond-scale segmental dynamics; (4) 13C-detected Lee–Goldburg cross-polarization 1H T1rho (LGCPH T1rho) for 33Ph and 50Ph, resolving aromatic and aliphatic proton environments; and (5) 13C T1 relaxation for 33Ph and 50Ph. Differential scanning calorimetry data (TA Instruments DSC 25, −150 to +120 °C, up to +300 °C for 100Ph, 10 °C/min) are included for all six compositions and support the glass-transition temperatures in Table 1 and Figure 1. Size exclusion chromatography data (Agilent 1200 Series, PL-Gel 300 mixed-C column, THF mobile phase, polystyrene calibration standards) are included for the three synthesized copolymers (33Ph, 50Ph, 67Ph) and support the number-average molecular weights in Table 1. Processed data include per-composition relaxation-time summaries (Excel), curve-fitting and Bloembergen-Purcell-Pound (BPP) model analysis notebooks (Jupyter/Python), and Igor Pro (.pxp) master files used to generate the manuscript's figures.

Bloembergen-Purcell-Pound theory↗

CBRN Situational Awareness Tools for the Modern Age

CBRN Situational awareness (SA) should be a key operational requirement in the CNI area of discussion, not only for the “boots-on-the-ground” warfighter, but at a strategic level. For example, maneuver plans will need to be developed for contamination avoidance and battlefield survivability. Large datasets from instruments dispersed across the battlefield will thus need to be collected and processed into a holistic assessment of the radiological hazard. From there, hazard maps then must be distributed at the tactical level, all while continuing to effectively engage a peer adversary. This vision represents a network of sensors, software tools, data processing algorithms, communications suites, and common operational picture (COP) platforms working in concert to inform warfighters and command echelons alike of evolving nuclear and radiological hazards. This complex system-of-systems and the ultimate goal of effective engagement in a nuclear or radiological-hazard battlefield can be achieved through pursuit of improvement in collaborative SA tools.

Becker, Eric M.↗

Striped Data Server for Scalable Parallel Data Analysis

A columnar data representation is known to be an efficient way for data storage, specifically in cases when the analysis is often done based only on a small fragment of the available data structures. A data representation like Apache Parquet is a step forward from a columnar representation, which splits data horizontally to allow for easy parallelization of data analysis. Based on the general idea of columnar data storage, working on the [LDRD Project], we have developed a striped data representation, which, we believe, is better suited to the needs of High Energy Physics data analysis. A traditional columnar approach allows for efficient data analysis of complex structures. While keeping all the benefits of columnar data representations, the striped mechanism goes further by enabling easy parallelization of computations without requiring special hardware. We will present an implementation and some performance characteristics of such a data representation mechanism using a distributed no-SQL database or a local file system, unified under the same API and data representation model. The representation is efficient and at the same time simple so that it allows for a common data model and APIs for wide range of underlying storage mechanisms such as distributed no-SQL databases and local file systems. Striped storage adopts Numpy arrays as its basic data representation format, which makes it easy and efficient to use in Python applications. The Striped Data Server is a web service, which allows to hide the server implementation details from the end user, easily exposes data to WAN users, and allows to utilize well known and developed data caching solutions to further increase data access efficiency. We are considering the Striped Data Server as the core of an enterprise scale data analysis platform for High Energy Physics and similar areas of data processing. As a result, we have been testing this architecture with a 2TB dataset from a CMS dark matter search and plan to expand it to multiple 100 TB or even PB scale. We will present the striped format, Striped Data Server architecture and performance test results.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Registration of the rotation axis in X-ray tomography

There is high demand for efficient, robust and automated routines for tomographic data reduction, particularly for synchrotron data. Registration of the rotation axis in data processing is a critical step affecting the quality of the reconstruction and is not easily implemented with automation. Existing methods for calculating the center of rotation have been reviewed and an improved algorithm to register the rotation axis in tomographic data is presented. The performance of the proposed method is evaluated using synchrotron-based microtomography data on geological samples with and without artificial reduction of the signal-to-noise ratio. The proposed method improves the reconstruction quality by correcting both the tilting error and the translational offset of the rotation axis. The limitation of this promising method is also discussed.

rotation axis↗

Iterative Stress Reconstruction Algorithm to Estimate Three-Dimensional Residual Stress Fields in Manufactured Components

Residual stress (RS) significantly impacts the mechanical performance of components. Measurement of RS often provides incomplete data in terms of components of stress and spatial density. Employing such fields in finite element simulations results in significant modification of the field to achieve equilibrium and compatibility among strains. To overcome this, an iterative stress reconstruction algorithm (ISRA) is developed to estimate 3D RS fields that satisfy equilibrium, are stress component-wise complete, and represent the characterized data sampled. An Al 7075-T651 plate and an additively manufactured (AM) A36 steel wall are considered for RS reconstruction using measurement data from the literature. A maximum variation of ~2.5 MPa in the Al plate, and ~10 MPa in the steel wall are observed between the reconstructed and measured stresses. Furthermore, unknown stress components emerge and reach significant magnitudes (upto ~2.3 MPa in the Al plate and ~45 MPa in the AM wall) during ISRA. Indeed, it is found that minor errors in measurement or data processing are eliminated through the physical requirements during ISRA. Employing a reconstructed RS field is hence not just more accurate given its compatibility, but it additionally corrects for minor errors in measurement. Furthermore, it is found that spatially dense measurement data result in convergence with fewer iterations. Finally, although ISRA yields a nonunique solution dependent on boundary conditions, measurement errors, fitting errors, and mesh density, it accommodates for uncertainties and inaccuracies in measurement, as opposed to failing to reach a physically realistic converged solution.

42 ENGINEERING↗

Generalized Canonical Polyadic Tensor Decomposition

Tensor decomposition is a fundamental unsupervised machine learning method in data science, with applications including network analysis and sensor data processing. This work develops a generalized canonical polyadic (GCP) low-rank tensor decomposition that allows other loss functions besides squared error. For instance, we can use logistic loss or Kullback--Leibler divergence, enabling tensor decomposition for binary or count data. We present a variety of statistically motivated loss functions for various scenarios. We provide a generalized framework for computing gradients and handling missing data that enables the use of standard optimization methods for fitting the model. Furthermore, we demonstrate the flexibility of the GCP decomposition on several real-world examples including interactions in a social network, neural activity in a mouse, and monthly rainfall measurements in India.

97 MATHEMATICS AND COMPUTING↗

TIDAL TURBULENCE SPECTRA FROM A COMPLIANT MOORING

A compliant mooring to collect high frequency turbulence data at a tidal energy site is evaluated in a series of short demon- stration deployments. The Tidal Turbulence Mooring (TTM) improves upon recent bottom-mounted approaches by suspend- ing Acoustic Doppler Velocimeters (ADVs) at mid-water depths (which are more relevant to tidal turbines). The ADV turbulence data are superior to Acoustic Doppler Current Profiler (ADCP) data, but are subject to motion contamination when suspended on a mooring in strong currents. In this demonstration, passive stabilization is shown to be sufficient for acquiring bulk statistics of the turbulence, without motion correction. With motion cor- rection (post-processing), data quality is further improved; the relative merits of direct and spectral motion correction are dis- cussed.

ADCP↗

ARM Aerosol Measurement Science Group Charter

The Atmospheric Radiation Measurement (ARM) Aerosol Measurement Science Group (AMSG) is tasked with providing enhanced coordination of ARM Climate Research Facility observations of aerosols and atmospheric trace gases with the needs of its users. Its objective is to ensure advanced, well-characterized observational measurements and data products at the spatial and temporal scales necessary for improving climate science and climate model forecasts. The primary function of the AMSG will be to provide strategies to the ARM Technical Director and ARM Chief Operations Officer that can be used to implement a coherent measurement and data processing approach that addresses the priority aerosol science needs of ARM and Atmospheric System Research. The group fulfills the need for an integrated oversight to the planning, coordination, and leadership of aerosol instrumentation selection and deployment, measurement strategy and quality, and data product development from both science and operations perspectives.

Source record↗

Design and impact assessment of watershed investments: An approach based on ecosystem services and boundary work

Watershed investments, whose main aim is to secure water for cities, represent a promising opportunity for large-scale sustainability transitions in the near future. If properly designed, they promote activities in the watershed that enhance ecosystem services while protecting nature and biodiversity, as well as achieving other societal goals. In this paper, we build on the concepts of ecosystem services and boundary work, to develop and test an operative approach for designing and assessing the impact of watershed investments. The approach is structured to facilitate negotiations among stakeholders. Its strategic component includes setting the agenda; defining investment scenarios; and assessing the performance of watershed investments as well as planning for a follow-up. Its technical component concerns data processing; tailoring spatially explicit ecosystem service models; hence their application to design a set of “investment portfolios”, generate future land use scenarios, and model impacts on selected ecosystem services. A case study illustrates how the technical component can be developed in a data scarce context in sub-Saharan Africa in a way that is functional to support the steps of the strategic component. The case study addresses soil erosion and water scarcity-related challenges affecting Asmara, a medium-sized city in Eritrea, and considers urban water security and rural poverty alleviation as two illustrative objectives, within a ten-year planning horizon. The case study results consist in spatially explicit data (investment portfolio, land use scenario, impact on ecosystem services), which were aggregated to quantitatively assess the performance of different watershed investments scenarios, in terms of changes in soil erosion control. By addressing stakeholders' concerns of credibility, saliency, and legitimacy, the approach is expected to facilitate negotiation of objectives, definition of scenarios, and assessment of alternative watershed investments, ultimately, to contribute to implementing an adaptive watershed management.

54 ENVIRONMENTAL SCIENCES↗

A Framework for Compressing Unstructured Scientific Data via Serialization

We present a general framework for compressing unstructured scientific data with known local connectivity. A common application is simulation data defined on arbitrary finite element meshes. The framework employs a greedy topology preserving reordering of original nodes which allows for seamless integration into existing data processing pipelines. This reordering process depends solely on mesh connectivity and can be performed offline for optimal efficiency. However, the algorithm’s greedy nature also supports on-the-fly implementation. The proposed method is compatible with any compression algorithm that leverages spatial correlations within the data. The effectiveness of this approach is demonstrated on a large-scale real dataset using several compression methods, including MGARD, SZ, and ZFP.

Reshniak, Viktor [ORNL] (ORCID:0000000315454462)↗

Deployment of inference as a service at the US CMS Tier-2 data centers

Coprocessors, especially GPUs, will be a vital ingredient of data production workflows at the HL-LHC. At CMS, the GPU-as-a-service approach for production workflows is implemented by the SONIC project (Services for Optimized Network Inference on Coprocessors). SONIC provides a mechanism for outsourcing computationally demanding algorithms, such as neural network inference, to remote servers, where requests from multiple clients are intelligently distributed across multiple GPUs by a load-balancing service. This talk highlights the recent progress in deploying SONIC at selected U.S. CMS Tier-2 data centers. Using realistic CMS Run3 data processing workflows, such as those containing transformer-based algorithms, we demonstrate how SONIC is integrated into the production-like environment to enable accelerated inference offloading. We will present developments from both the client and server sides, including production job and data center configurations for NVIDIA and AMD GPUs. We will also present performance scaling benchmarks and discuss the challenges of operating SONIC in CMS production, such as server discovery, GPU saturation, fallback server logic, etc.

Holzman, Burt↗

Visualizing Solution Structure at Solid-Liquid Interfaces using Three-Dimensional Fast Force Mapping

Amongst the challenges for a variety of research fields are the visualization of solid-liquid interfaces and understanding how they are affected by the solution conditions such as ion concentrations, pH, ligands, and trace additives, as well as the underlying crystallography and chemistry. Here, in this context, three-dimensional fast force mapping (3D FFM) has emerged as a promising tool for investigating solution structure at interfaces. This capability is based on atomic force microscopy (AFM) and allows the direct visualization of interfacial regions in three spatial dimensions with sub-nanometer resolution. Here we provide a detailed description of the experimental protocol for acquiring 3D FFM data. The main considerations for optimizing the operating parameters depending on the sample and application are discussed. Moreover, the basic methods for data processing and analysis are discussed, including the transformation of the measured instrument observables into tip-sample force maps that can be linked to the local solution structure. Finally, we shed light on some of the outstanding questions related to 3D FFM data interpretation and how this technique can become a central tool in the repertoire of surface science.

Nakouzi, Elias↗

Modeling pair distribution functions of rare-earth phosphate glasses using principal component analysis

The use of principal component analysis (PCA) to statistically infer features of local structure from experimental pair distribution function (PDF) data is assessed on a case study of rare-earth phosphate glasses (REPGs). Such glasses, co-doped with two rare-earth ions (R and R’) of different sizes and optical properties, are of interest to the laser industry. The determination of structure-property relationships in these materials is an important aspect of their technological development. Yet, realizing the local structure of co-doped REPGs presents significant challenges relative to their singly-doped counterparts; specifically, R and R’ are difficult to distinguish in terms of establishing relative material compositions, identifying atomic pairwise correlation profiles in a PDF that are associated with each ion, and resolving peak overlap of such profiles in PDFs. This study demonstrates that PCA can be employed to help overcome these structural complications, by statistically inferring trends in PDFs that exist for a restricted set of experimental data on REPGs, and using these as training data to predict material compositions and PDF profiles in unknown co-doped REPGs. The application of these PCA methods to resolve individual atomic pairwise correlations in t(r) signatures is also presented. The training methods developed for these structural predictions are pre-validated by testing their ability to reproduce known physical phenomena, such as the lanthanide contraction, on PDF signatures of the structurally simpler singly-doped REPGs. The intrinsic limitations of applying PCA to analyze PDFs relative to the quality control of source data, data processing, and sample definition, are also considered. Furthermore, while this case study is limited to lanthanide-doped REPGs, this type of statistical inference may easily be extended to other inorganic solid-state materials, and be exploited in large-scale data-mining efforts that probe many t(r) functions.

36 MATERIALS SCIENCE↗

Challenges in solving structures from radiation-damaged tomograms of protein nanocrystals assessed by simulation

Structure-determination methods are needed to resolve the atomic details that underlie protein function. X-ray crystallography has provided most of our knowledge of protein structure, but is constrained by the need for large, well ordered crystals and the loss of phase information. The rapidly developing methods of serial femtosecond crystallography, micro-electron diffraction and single-particle reconstruction circumvent the first of these limitations by enabling data collection from nanocrystals or purified proteins. However, the first two methods also suffer from the phase problem, while many proteins fall below the molecular-weight threshold required for single-particle reconstruction. Cryo-electron tomography of protein nanocrystals has the potential to overcome these obstacles of mainstream structure-determination methods. Here, a data-processing scheme is presented that combines routines from X-ray crystallography and new algorithms that have been developed to solve structures from tomograms of nanocrystals. This pipeline handles image-processing challenges specific to tomographic sampling of periodic specimens and is validated using simulated crystals. The tolerance of this workflow to the effects of radiation damage is also assessed. The simulations indicate a trade-off between a wider tilt range to facilitate merging data from multiple tomograms and a smaller tilt increment to improve phase accuracy. Since phase errors, but not merging errors, can be overcome with additional data sets, these results recommend distributing the dose over a wide angular range rather than using a finer sampling interval to solve the protein structure.

59 BASIC BIOLOGICAL SCIENCES↗

Measurement of the low-energy germanium quenching factor with a small-mass detector

We report on work performed to measure the quenching factor of low kinetic energy germanium recoils, as a collaboration between Sandia National Laboratories (SNL) and Duke University. A small-mass low-noise high purity germanium detector was irradiated by a mono-energetic pulsed neutron beam produced by the Triangle Universities Nuclear Laboratory (TUNL) Van-de-Graaff accelerator. Data was collected to determine the germanium quenching factor as a function of 10 discrete recoil energy values in the range ~ [0.8, 5.0] keVnr. We describe the experiment, present the simulation and data processing for the 10 datasets, and discussed the quenching factor analysis result for one of them. This one result seems to indicate a somewhat large deviation from literature values, though it is still preliminary to claim the presence of a systematic bias in our data or analysis.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Seismic Spatial Gradients and Machine Learning-Based Classifiers for Explosion Monitoring (LDRD 218327)

This final report summarizes the work completed under the Laboratory Directed Research and Development (LDRD) project “Seismic Spatial Gradients as a Machine Learning-Based Classifier for Explosion Monitoring.” The overarching goal of the project was to explore the efficacy of using machine learning-based classification algorithms where the input data are the spatial gradient of the seismic wavefield collected at a single point on the Earth’s surface. The methods that I describe here are in direct contrast to conventional methods of seismic discrimination which typically rely on a spatially extended network of instruments and physics-based wavefield attributes such as, for example, the ratio between $\textit{P}$ and $\textit{S}$ waves. Rather, we use the spatial gradient of the seismic wavefield observed at a single point on the Earth’s surface and data processing approaches inspired by the machine learning community. We tested two algorithms, a neural network and a modified version of principal component analysis termed Spectrally Filtered Principal Component Analysis (SFPCA). To test these algorithms, we first conducted a series of numerical tests using synthetic data and then conducted a small-scale controlled field experiment. The tests using synthetic data showed that both algorithms had high success rates on gradiometric data, even when simulated noise was added to the signal. Furthermore, we found that using seismic spatial gradients increased the performance of our discrimination algorithms when compared to using just the traditional translational motion seismic data. The tests with field data also showed a high degree of discriminative success.

58 GEOSCIENCES↗

Dairy Analytics and Nutrient Analysis (DANA) Prototype System User Manual

This document is a user manual for the Dairy Analytics and Nutrient Analysis (DANA) model. DANA provides an analysis of dairy anaerobic digestion technology and allows users to calculate biogas production, co-product valuation, capital costs, expenses, revenue and financial metrics, for user customizable scenarios, dairy and digester types. The model provides results for three anaerobic digester types; Covered Lagoons, Modified Plug Flow, and Complete Mix, and three main energy production technologies; electricity generation, renewable natural gas generation, and compressed natural gas generation. Additional options include different dairy types, bedding types, backend treatment type as well as numerous production, and economic parameters. DANA’s goal is to extend the National Market Value of Anaerobic Digester Products analysis (informa economics, 2012; Innovation Center, 2011) to include a greater and more flexible set of regional digester scenarios and to provide a modular framework for creation of a tool to support farmer and investor needs. Users can set up scenarios from combinations of existing parameters or add new parameters, run the model and view a variety of reports, charts and tables that are automatically produced and delivered over the web interface. DANA is based in the INL’s analysis architecture entitled Generalized Environment for Modeling Systems (GEMS) , which offers extensive collaboration, analysis, and integration opportunities and greatly speeds the ability construct highly scalable web delivered user-oriented decision tools. DANA’s approach uses server-based data processing and web-based user interfaces, rather a client-based spreadsheet approach. This offers a number of benefits over the client-based approach. Server processing and storage can scale up to handle a very large number of scenarios, so that analysis of county, even field level, across the whole U.S., can be performed. Server based databases allow dairy and digester parameters be held and managed in a single managed data repository, while allows users to customize standard values and perform individual analysis. Server-based calculations can be easily extended, versions and upgrades managed, and any changes are immediately available to all users. This user manual describes how to use and/or modify input database tables, run DANA, view and modify reports.

09 BIOMASS FUELS↗

Magnetic pair distribution function data using polarized neutrons and ad hoc corrections

Here, we report the first example of magnetic pair distribution function (mPDF) data obtained through the use of neutron polarization analysis. Using the antiferromagnetic semiconductor MnTe as a test case, we present high-quality mPDF data collected on the HYSPEC instrument at the Spallation Neutron Source using longitudinal polarization analysis to isolate the magnetic scattering cross section. Clean mPDF patterns are obtained for MnTe in both the magnetically ordered state and the correlated paramagnet state, where only short-range magnetic order is present. We also demonstrate significant improvement in the quality of high-resolution mPDF data through the application of ad hoc corrections that require only minimal human input, minimizing potential sources of error in the data processing procedure. We briefly discuss the current limitations and future outlook of mPDF analysis using polarized neutrons. Overall, this work provides a useful benchmark for mPDF analysis using polarized neutrons and provides an encouraging picture of the potential for routine collection of high-quality mPDF data.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗