Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,459 records · Page 81

3D Reality Energy Modeling Software

The team will combine Bentley Systems’ ContextCapture and extend Oak Ridge National Laboratory’s building energy modeling capabilities in order to create digital twins of buildings that allow simulation-informed improvement for energy efficiency and demand response in the design and operation of the built environment. Bentley Systems’ ContextCapture software processes data from 3D laser scanning and photographs (through photogrammetry) to create a photorealistic, 3D mesh with a scale of individual objects to building to city-sized. This capability easily provides city-level visualization models and platforms where sustainable design alternatives are readily evaluated. Oak Ridge National Laboratory (ORNL) serves the U.S. Dept. of Energy (DOE) as one of three core laboratories developing building energy modeling tools EnergyPlus and OpenStudio. ORNL’s AutoBEM software (bit.ly/AutoBEM) can process imagery (satellite, aerial, and street level), LiDAR, cartographic layers, tax assessor’s data, and other data sources to extract building footprints, height, window-to-wall ratio, building type, vintage, and other building properties. AutoBEM has created 178,368 building energy models that were empirically validated with 15-minute whole-building electrical data from a utility.

97 MATHEMATICS AND COMPUTING↗

The SNS/HFIR Web Portal System for SANS

In a busy world, continuing with the status-quo, to do things the way we are already familiar, often seems to be the most efficient way to conduct our work. We look for the value-add to decide if investing in a new method is worth the effort. How shall we evaluate if we have reached this tipping point for change? For contemporary researchers, understanding the properties of the data is a good starting point. The new generation of neutron scattering instruments being built are higher resolution and produce one or more orders of magnitude larger data than the previous generation of instruments. For instance, we have grown out of being able to perform some important tasks with our laptops – the data are too big and the computations would simply take too long. These large datasets can be problematic as facility users now begin to grapple with many of the same issues faced by more established computing communities. These issues include data access, management, and movement, data format standards, distributed computing, and collaboration among others. The Neutron Science Portal has been architected, designed, and implemented to provide users with an easy-to-use interface for managing and processing data, while also keeping an eye on meeting modern cybersecurity requirements imposed on institutions. The cost of entry for users has been lowered by utilizing a web interface providing access to backend portal resources. Users can browse or search for data which they are allowed to see, data reduction applications can be run without having to load the software, sample activation calculations can be performed for SNS and HFIR beamlines, McStas simulations can be run on TeraGrid and ORNL computers, and advanced analysis applications such as those being produced by the DANSE project can be run. Behind the scenes is a “live cataloging” system which automatically catalogs and archives experiment data via the data management system, and provides proposal team members access to their experiment data. The complexity of data movement and utilizing distributed computing resources has been taken care on behalf of users. Collaboration is facilitated by providing users a read/writeable common area, shared across all experiment team members. To date, these shared areas are the fastest growing data spaces. The portal currently has over 370 registered users, almost 7TB of experiment and user data, approximately 1,000,000 files cataloged, and had almost 10,000 unique visits last year. Future directions for enhancing portal robustness include examining how to mirror data and portal services, better facilitation of collaborations via virtual organizations, enhancing disconnected service via “thick client” applications, and better inter-facility connectivity to support cross-cutting research. The portal has established itself in the SNS/HFIR user community, and the development team strives to continue to improve the quality of features and services provided in order to better serve the community.

data↗

Skopi: a simulation package for diffractive imaging of noncrystalline biomolecules

X-ray free-electron lasers (XFELs) have the ability to produce ultra-bright femtosecond X-ray pulses for coherent diffraction imaging of biomolecules. While the development of methods and algorithms for macromolecular crystallography is now mature, XFEL experiments involving aerosolized or solvated biomolecular samples offer new challenges in terms of both experimental design and data processing. Skopi is a simulation package that can generate single-hit diffraction images for reconstruction algorithms, multi-hit diffraction images of aggregated particles for training machine learning classifiers using labeled data, diffraction images of randomly distributed particles for fluctuation X-ray scattering algorithms, and diffraction images of reference and target particles for holographic reconstruction algorithms. Skopi is a resource to aid feasibility studies and advance the development of algorithms for noncrystalline experiments at XFEL facilities.

59 BASIC BIOLOGICAL SCIENCES↗

High-throughput imaging of heterogeneous cell organelles with an X-ray laser (CXIDB ID 25)

Preprocessed detector images that were used for the paper "High-throughput imaging of heterogeneous cell organelles with an X-ray laser". The CXI file contains the entire recorded data - including both hits and blanks. It also includes down-sampled images and LCLS machine parameters. Additionally, the Cheetah configuration file is attached that was used to create the pre-processed data.

AMO↗

Fusion of Experiments and Simulations for Real-Time Identification of Pipeline Defects

In this study, we explored fusion of experiments and simulations for real time identification of pipeline defects across physical and non-physical domains. The challenges associated to data processing were addressed and a combined classification models was presented via CNN models. In addition, regression model based on XGBOOST is built to determine the defect location and defect dimension from data-driven features of guided wave signals captured by SMS fiber optic sensor.

deep learning↗

metabCombiner 2.0: Disparate Multi-Dataset Feature Alignment for LC-MS Metabolomics

Liquid chromatography–high-resolution mass spectrometry (LC-HRMS), as applied to untargeted metabolomics, enables the simultaneous detection of thousands of small molecules, generating complex datasets. Alignment is a crucial step in data processing pipelines, whereby LC-MS features derived from common ions are assembled into a unified matrix amenable to further analysis. Variability in the analytical factors that influence liquid chromatography separations complicates data alignment. This is prominent when aligning data acquired in different laboratories, generated using non-identical instruments, or between batches from large-scale studies. Previously, we developed metabCombiner for aligning disparately acquired LC-MS metabolomics datasets. Here, we report significant upgrades to metabCombiner that enable the stepwise alignment of multiple untargeted LC-MS metabolomics datasets, facilitating inter-laboratory reproducibility studies. To accomplish this, a “primary” feature list is used as a template for matching compounds in “target” feature lists. We demonstrate this workflow by aligning four lipidomics datasets from core laboratories generated using each institution’s in-house LC-MS instrumentation and methods. We also introduce batchCombine, an application of the metabCombiner framework for aligning experiments composed of multiple batches. metabCombiner is available as an R package on Github and Bioconductor, along with a new online version implemented as an R Shiny App.

97 MATHEMATICS AND COMPUTING↗

Real-time software upgrade

The various technologies presented herein relate to upgrading industrial control software in real-time. During utilization of a first software to control an industrial process, a determination can be made that the first software needs to be replaced (e.g., partially or entirely) owing to a newer version of software is ready to be deployed, a vulnerability in the first software has been determined, etc. Rather than closing the industrial process down while the first software is replaced, a second software can be deployed such that the first software and the second software are operating in parallel (e.g., receiving the same operational data, process states). When a critical point (upgrade location) in the first software has been reached, control of the industrial process can be switched to the second software, thereby enabling control of the industrial process to occur without having to temporarily cease operation and/or monitoring of the industrial process.

97 MATHEMATICS AND COMPUTING↗

Fusion of Experiments and Simulations for Real-Time Identification of Pipeline Defects

In this study, we explored fusion of experiments and simulations for real time identification of pipeline defects across physical and non-physical domains. The challenges associated to data processing were addressed and a combined classification models was presented via CNN models. In addition, regression model based on XGBOOST is built to determine the defect location and defect dimension from data-driven features of guided wave signals captured by SMS fiber optic sensor.

deep learning↗

Effects of error, chimera, bias, and GC content on the accuracy of amplicon sequencing

ABSTRACT Targeted amplicon sequencing is widely used in microbial ecology studies. However, sequencing artifacts and amplification biases are of great concern. To identify sources of these artifacts, a systematic analysis was performed using mock communities comprised of 16S rRNA genes from 33 bacterial strains. Our results indicated that while sequencing errors were generally isolated to low-abundance operational taxonomic units, chimeric sequences were a major source of artifacts. Singleton and doubleton sequences were primarily chimeras. Formation of chimeric sequences was significantly correlated with the GC content of the targeted sequences. Low-GC-content mock community members exhibited lower rates of chimeric sequence formation. GC content also had a large impact on sequence recovery. The quantitative capacity was notably limited, with substantial recovery variations and weak correlation between anticipated and observed strain abundances. The mock community strains with higher GC content had higher recovery rates than strains with lower GC content. Amplification bias was also observed due to the differences in primer affinity. A two-step PCR strategy reduced the number of chimeric sequences by half. In addition, comparative analyses based on the mock communities showed that several widely used sequence processing pipelines/methods, including DADA2, Deblur, UCLUST, UNOISE, and UPARSE, had different advantages and disadvantages in artifact removal and rare species detection. These results are important for improving sequencing quality and reliability and developing new algorithms to process targeted amplicon sequences. IMPORTANCE Amplicon sequencing of targeted genes is the predominant approach to estimate the membership and structure of microbial communities. However, accurate reconstruction of community composition is difficult due to sequencing errors, and other methodological biases and effective approaches to overcome these challenges are essential. Using a mock community of 33 phylogenetically diverse strains, this study evaluated the effect of GC content on sequencing results and tested different approaches to improve overall sequencing accuracy while characterizing the pros and cons of popular amplicon sequence data processing approaches. The sequencing results from this study can serve as a benchmarking data set for future algorithmic improvements. Furthermore, the new insights on sequencing error, chimera formation, and GC bias from this study will help enhance the quality of amplicon sequencing studies and support the development of new data analysis approaches.

59 BASIC BIOLOGICAL SCIENCES↗

Marine Energy Environmental Permitting and Compliance Costs

Costs to permit Marine Energy projects are poorly understood. In this paper we examine environmental compliance and permitting costs for 19 projects in the U.S., covering the last 2 decades. Guided discussions were conducted with developers over a 3-year period to obtain historical and ongoing project cost data relative to environmental studies (e.g., baseline or pre-project site characterization as well as post-installation effects monitoring), stakeholder outreach, and mitigation, as well as qualitative experience of the permitting process. Data are organized in categories of technology type, permitted capacity, pre- and post-installation, geographic location, and funding types. We also compare our findings with earlier logic models created for the Department of Energy (i.e., Reference Models). Environmental studies most commonly performed were for Fish and Fisheries, Noise, Marine Habitat/Benthic Studies and Marine Mammals. Studies for tidal projects were more expensive than those performed for wave projects and the range of reported project costs tended to be wider than ranges predicted by logic models. For eight projects reporting full project costs, from project start to FERC or USACE permit, the average amount for environmental permitting compliance was 14.6%.

16 TIDAL AND WAVE POWER↗

System Engineers and Decisions: It?s All about Knowledge

In order to guarantee that a system meets adequate levels of reliability and availability, system performances are continuously monitored and analyzed thanks to the technological advancements driving the Industry 4.0 revolution. An Industry 4.0 approach is typically based on advanced statistical, big data mining, machine learning, and internet-of-things methods designed to detect anomalies in the behavior of system, detect the most likely failure modes, and provide indications to system engineers on when maintenance activities should be performed before system performance are deemed unacceptable (which can be generated by diagnostic and prognostic methods). However, these analyses, which are designed to automatize and increase the efficacy of the system maintenance program, require large amount of data which can come in various forms: numeric, textual, images, sounds etc. Such data constitutes the historic knowledge benchmark to track system performances and support system engineer decisions. Here we claim that data is not sufficient to support this kind of analyses when applied to systems characterized by complex architectures and behaviors. Robust system engineer decisions require the ability to understand the system operational context that lies behind the observed data elements. In this respect, system models are in fact necessary to “put data in context” and capture relationships between data elements. Industry 4.0 methods require in fact contextual knowledge as a basis upon which hypotheses can be generated and assumptions tested. In our view, for complex systems, model-based system engineering (MBSE) models can afford this contextual knowledge, as they are typically used to describe systems architecture and dynamic behaviors. System knowledge is here intended as the blending of collected data and system architecture which takes the form of a “knowledge graph”. A knowledge graph is a database which consists of a large set of nodes (in our case an entity can be either a data or an MBSE element) which are linked to each other. The types of nodes and links follow a pre-defined topology, sometimes also refers as an ontology, that is designed to fit the actual decisions that needs to be performed. We show here how a knowledge graph can be defined to support system engineer maintenance decisions and how the same graph can be built based on system MBSE models and pre-processed data from numeric (through anomaly detections and diagnostic methods) and textual elements (through technical language processing TLP).

97 - MATHEMATICS AND COMPUTING↗

Determination of monitor unit check tolerances based on a comparison with measurement and treatment planning system data

ABSTRACT: This work describes the experimental validation of treatment planning system monitor unit (MU) calculations against measurement for a range of scenarios. This, together with a comparison of treatment planning system MUs and an independent MU check method, allows the derivation of confidence intervals for the check process. Data were collected for open and 60° motorized wedge fields using an Elekta Synergy linac at 6 and 8 MV using homogeneous and heterogeneous phantoms. Masterplan (Version 4.0) pencil-beam and collapsed cone algorithms were used for the primary MU calculations with full inhomogeneity correction. Results show that both algorithms agree with measurement to acceptable tolerance levels in the majority of the cases studied. The confidence interval for the pencil-beam algorithm MU against an independent check was determined as + 1.6% to −3.4%. This is modified to + 2.3% to −2.5% when data collected with low-density heterogeneities are removed as this algorithm is not used clinically for these cases. The corresponding interval for the collapsed cone algorithm was + 1.2% to −4.3%, indicating that an offset tolerance for the independent check is appropriate. Analysis of clinical conformal treatment plan data generated using the pencil-beam algorithm (1393 beams) returned 93% of beams within the independent check tolerance. Similarly, using the collapsed cone algorithm as the primary MU calculation, 77% (of 1434 beams) were within the confidence interval.

61 RADIATION PROTECTION AND DOSIMETRY↗

Binary interaction parameters from reacting mixture data. Supercritical biodiesel process with CO 2 as cosolvent

A method is presented for the calculation of binary interaction parameters from reacting mixture data. The process studied is the supercritical methanol transesterification of triolein with CO 2 as cosolvent. The reaction proceeds through 3 reversible reactions in series, on a solid catalyst (Nafion(R) SAC-13), for which the kinetics is known. To describe the reactor performance, the kinetic constants and the binary interaction parameters for the Peng-Robinson equation of state, are necessary, and were included in the reactor model. Previously published view-cell observations and thermodynamic calculations indicate that no condensation occurs in the reactor. Kinetic and thermodynamic parameters were determined by a global optimisation procedure. From the rate constants obtained, the process exhibits some reversibility, despite the excess of methanol used. Our methodology allows to obtain the binary interaction coefficients for the intermediate reaction species (dioleins and monooleins) that were unavailable so far. The method is sensitive to the errors in the measured concentrations.

09 BIOMASS FUELS↗

Upstream Measurements of Wind Profiles with Doppler Lidar for Improved Wind Energy Integration

New upstream measurements of wind profiles over the altitude range of wind turbines will be produced using a scanning Doppler lidar. These long range high quality measurements will provide improved wind power forecasts for wind energy integration into the power grid. The main goal of the project is to develop the optimal Doppler lidar operating parameters and data processing algorithms for improved wind energy integration by enhancing the wind power forecasts in the 30 to 60 minute time frame, especially for the large wind power ramps. Currently, there is very little upstream data at large wind farms, especially accurate wind profiles over the full height of the turbine blades. The potential of scanning Doppler lidar will be determined by rigorous computer modeling and evaluation of actual Doppler lidar data from the WindTracer system produced by Lockheed Martin Coherent Technologies, Inc. of Louisville, Colorado. Various data products will be investigated for input into numerical weather prediction models and statistically based nowcasting algorithms. Successful implementation of the proposed research will provide the required information for a full cost benefit analysis of the improved forecasts of wind power for energy integration as well as the added benefit of high quality wind and turbulence information for optimal control of the wind turbines at large wind farms.

17 WIND ENERGY↗

Charged Particle Transport Libraries (Final Report FY2020 Level-2 Milestone #7127)

This document is the final report on the status and developments of the Charged-Particle Transport (CPT) Level-2 (“CP2020”) ASC/PEM Milestone work. This section gives an overview of the CP2020 work partitioned into two subsections: 1) a summary of the code tools used for generating CP (and other) data in Section 1.2; and 2) and library data and codes access information for end users in Section 1.3. Section 2 gives an overview of the status of previous work on charged-particle (CP) nuclear data, particularly focused on the work of the FY2011 CP Level-2 Milestone. New work for CP2020 is detailed in the following Section 3. Section 4 discusses testing and validation of the evaluated and processed data for the CP2020 library. Conclusions based on the experience of this Level-2 work and the outlook for future development of CPT-relevant data are given in the final Section 5. Appendices, detailed throughout the report, are provided for further information. This report, related documentation, codes, and the CPT nuclear data libraries are available via online repository.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

User Manual for MC 2 -3 Gamma Library Generation

This report provides the documentation for the revised procedure to generate the MC 2 -3 gamma library with the latest versions of PreGAMMA and GenGAMMA which have recently been updated to fix the program errors and inconsistent data processing for some isotopes identified in a recent verification and validation study of the MC 2 -3 gamma library. A few associated errors associated with gamma processing were also identified and fixed in the MC 2 -3 code. Addressing the changes in MC 2 -3, the procedure to generate the PMATRX and GAMISO datasets is discussed as well. The input data of PreGAMMA and GenGAMMA are discussed in detail using sample input data. In addition, the structure and formats of the MC 2 -3 gamma library are provided in detail.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

OpenMSI Arrayed Analysis Toolkit: Analyzing Spatially Defined Samples Using Mass Spectrometry Imaging

Mass spectrometry imaging (MSI) has primarily been applied in localizing biomolecules within biological matrices. Although well-suited, the application of MSI for comparing thousands of spatially defined spotted samples has been limited. One reason for this is a lack of suitable and accessible data processing tools for the analysis of large arrayed MSI sample sets. In this paper, the OpenMSI Arrayed Analysis Toolkit (OMAAT) is a software package that addresses the challenges of analyzing spatially defined samples in MSI data sets. OMAAT is written in Python and is integrated with OpenMSI (http://openmsi.nersc.gov), a platform for storing, sharing, and analyzing MSI data. By using a web-based python notebook (Jupyter), OMAAT is accessible to anyone without programming experience yet allows experienced users to leverage all features. OMAAT was evaluated by analyzing an MSI data set of a high-throughput glycoside hydrolase activity screen comprising 384 samples arrayed onto a NIMS surface at a 450 μm spacing, decreasing analysis time >100-fold while maintaining robust spot-finding. The utility of OMAAT was demonstrated for screening metabolic activities of different sized soil particles, including hydrolysis of sugars, revealing a pattern of size dependent activities. Finally, these results introduce OMAAT as an effective toolkit for analyzing spatially defined samples in MSI. OMAAT runs on all major operating systems, and the source code can be obtained from the following GitHub repository: https://github.com/biorack/omaat.

47 OTHER INSTRUMENTATION↗

Data Management at the Advanced Photon Source

Data are crucial to the scientific discoveries enabled by experiments performed at the APS. Presently the APS generates approximately 10 PB of raw experimental data per year from its sixty-six operating beamlines that house over 100 unique instruments. This data is generated as a part of over 6,000 annual experiments performed by over 5,500 facility users each year. Similar to other synchrotrons, the amount of data generated at the APS continues to quickly increase due to beamline advances, such as new measurement techniques, technological advances in detectors, high-throughput instrumentation, multi-modal instruments that can acquire several measurements in a single experiment, and advanced data processing algorithms. This trend is expected to continue in the future. The revolutionized high-energy synchrotron facility proposed in the APS-U project will increase brightness and coherence, leading to further increases in data rates. Successful management of data is of vital importance to the current and future scientific productivity of the APS.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗