Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “science data processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20
All sourcesNASA NTRSDOE OSTI
DOE OSTI2016

Recording Vavilov – Cherenkov radiation in a linear accelerator using a picosecond streak camera

Using a picosecond image converter camera with a linear sweep (PS-1/S1 streak camera developed at GPI RAS, Moscow), we have measured temporal parameters of Vavilov – Cherenkov radiation pulses. The radiation was generated by relativistic electrons passing through a quartz cone mounted on the axis of a vacuum chamber of a linear accelerator, which is a part of the VEPP-5 injection complex at the Budker Institute of Nuclear Physics, Siberian Branch of the Russian Academy of Sciences (BINP SB RAS, Novosibirsk). The data obtained in these experiments provide an insight into the processes of formation of electron bunches and their ‘quality’ in a linear accelerator prior to injection of electrons into the accumulator-cooler. A conclusion is made regarding the advisability of streak camera application in tuning the linear accelerators for optimisation of electron bunch parameters. (Vavilov – Cherenkov radiation)

43 PARTICLE ACCELERATORS↗
DOE OSTI2017

The Hyper Suprime-Cam software pipeline

Here in this article, we describe the optical imaging data processing pipeline developed for the Subaru Telescope’s Hyper Suprime-Cam (HSC) instrument. The HSC Pipeline builds on the prototype pipeline being developed by the Large Synoptic Survey Telescope’s Data Management system, adding customizations for HSC, large-scale processing capabilities, and novel algorithms that have since been reincorporated into the LSST codebase. While designed primarily to reduce HSC Subaru Strategic Program (SSP) data, it is also the recommended pipeline for reducing general-observer HSC data. The HSC pipeline includes high-level processing steps that generate coadded images and science-ready catalogs as well as low-level detrending and image characterizations.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Customs: Inspect and Report Python Imports (customs) v1.0.0

We have developed a simple, minimally invasive monitoring framework that enables us to capture key metrics from Python user processes. This is part of a larger effort to collect data across our entire data-intensive science workload at NERSC. The approach for Python is inspired by a similar framework developed for Blue Waters at NCSA. Both frameworks leverage standard Python features, sitecustomize and atexit, to capture Python imports of interest and other job data. The customs package decomposes the information capture into separate inspection and reporting interfaces.

Thomas, Rollin↗
DOE OSTI2018

ARM Radar Science Recommendations from 2017 6th ARM Radar Workshop

The U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Climate Research Facility’s radar organization was formed to provide an integrated approach to meet the scientific objectives of ARM. The radar organization consists of two groups: Radar Science and Radar Engineering and Operations. The two groups work closely for planning, coordination, and communications to produce high-quality observations and products from the ARM radar network, which consists of complex radars deployed in very challenging environments. In addition, scanning cloud radars are relatively new in the community, with very limited products that are mature enough to be applied for modeling studies. The Radar Science Group and Radar Engineering and Operations Group meet regularly along with researchers and users from the community in a workshop. The overarching objective of the workshop is to maximize the usage of ARM radar data for improving our understanding of processes and, ultimately improving representation of clouds and precipitation in models. The 6th DOE ARM Radar Engineering and Radar Science Workshop was held October 24-26, 2017, at Stony Brook University. Approximately 40 participants were present; a detailed list of participants is listed in Section 5. This report documents recommendations made by members of the science community who attended the workshop. Their recommendations appear italicized in the report. ARM management will consider these recommendations in their future planning and prioritization activities. The topics addressed during the workshop are contained in the agenda (Section 4). Significant action items, recommendations, and comments that came out of the meeting are contained in Section 3. The content in Section 3 presents a path through important discussions that were pursued during the Workshop.

Southern Great Plains, North Slope of Alaska, East↗
DOE OSTI2019

Collaborative Computing Center (C3)

High Performance Computing (HPC) compliments theory and informs experimental processes in support of NE programs Big Data Analytics capabilities aid in the discovery of science-relevant relationships in data The C520 staff is made up of 19 Staff – Engineering, Basic Sciences, Computer Science, Statistics, Data Science, Technology Computer Computing Hardware Operations include: Falcon is fully utilized with an average 3X over subscription of waiting jobs over the past year Lemhi recently deployed in Feb 2019 Sawtooth procurement underway with Fall 2019 delivery 509 HPC accounts, lab, industry, university users 1.2 PB disk storage, 1.0 PB scratch storage, 0.8 PB disaster recovery storage Collaborative Computing Center nearing completion with approximately 200 staff -- Office space and 200 racks -- Data Center space for computer equipment

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2023

Recursive Use of the Short-Time Fast Fourier Transform for Signature Analysis in Continuous Processes

Although a nuclear reactor is a hostile environment for sensing and electrical communications, the reactor core is amenable to acoustic communication. An acoustic measurement infrastructure (AMI) has been installed in the Advanced Test Reactor (ATR) to record acoustic signals that can capture its different operating regimes. AMI uses coolant pumps as continuous signal sources, coolant and structural components as transmission lines, and accelerometers to capture system motion. A recursive signal processing technique based on the short-time fast Fourier transform (STFFT) for continuous processes provides unique signatures for diagnostic and prognostic analyses from the system motion data. Here this article presents a recursive STFFT methodology that processes acoustic signals from continuous industrial processes. The article first discusses the initial STFFT use with simulated data to elucidate the basic principles necessary to understand and interpret the STFFT results from actual pump vibration data. Each repetitive use of the STFFT on pump vibration data using the results from the prior STFFT processing will generate additional complimentary time-frequency-based signatures. These signatures are generated by the coolant pumps operating under different process conditions. After each use of the STFFT, the resulting signatures provide exemplary examples of the diversity and intuitive nature of recursively using the STFFT. This article focuses on recursively using the STFFT to provide numerous complimentary and diverse signatures that will ultimately be inputs for machine learning algorithms that provide predictive data analytics. The intuitive nature of the information and signatures from recursive STFFT processing will also bring intuitive interpretation capabilities to machine learning and predictive data analytic techniques.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2018

Mapping Benthic Habitat Conditions and Seafloor Deposits using Sediment Profile Imaging and a Semiautomated Image Processing System

Objectives/Scope: Sediment profile imaging (SPI) technology characterizes in situ physical, geochemical, and biological seafloor features. SPI was required by Mexico’s Agency for Safety, Energy, and Environment in 2017 for environmental baseline surveys (EBS) of oil lease blocks in the southern Gulf of Mexico. Because of its ability to provide information on benthic community health and the distribution of very thin (down to the centimeter scale) layers of deposited materials, SPI technology is highly effective for mapping drill cuttings or drilling muds released around wellheads during exploration or production and documenting their ecological impacts. SPI technology has not been widely used in the oil and gas industry for EBS or other monitoring activities. A primary objective of this work is to improve the transparency and consistency of the SPI data generation and data management process. Methods, Procedures, Process: The SPI camera works like an inverted periscope and obtains an undisturbed 21x15-cm cross-sectional image of the upper sediment column. The camera is internally powered and can be deployed rapidly from a standard winch in depths to 4,000 m. Many stations can be sampled in a single day by “pogo-sticking” across a survey area. Sediment grain size, penetration depth, surface boundary roughness, natural and anthropogenic depositional layers, depth of the oxidized surface sediment layer, maximum biogenic mixing depth, and infaunal successional stage can be directly measured at sea or immediately following the cruise. Final SPI data sets can be provided within a few weeks of the survey. Results, Observations, Conclusions: Details on the features measured in SPI images and the underlying interpretive paradigms are presented. To standardize the SPI data generation process, Integral Consulting Inc. has developed 1) a semiautomated image analysis platform, and 2) a SPI data-specific database architecture that allows both numerical and non-numerical metrics to be incorporated into a standard database structure. An integrated, software-based SPI analysis platform has been developed that imports image files and metadata and provides a graphical user interface. The software automatically stores the data, which can then be reviewed for quality assurance, plotted, statistically analyzed, and mapped or exported to other platforms (e.g., Esri ArcGIS©) for further evaluation. Image processing algorithms have been developed using a combination of open-source and commercially available software packages (e.g., MATLAB® and OpenCV) to automatically quantify key parameters. Novel/Additive Information: SPI technology’s underutilization in the oil and gas industry may be in part due to a lack of standardization in the measurement of basic features in SPI images. A primary objective of this work is to develop a streamlined, standardized, and transparent process for generating and managing SPI data.

02 PETROLEUM↗
DOE OSTI2025

DMTN-277: The Monster: A reference catalog with synthetic ugrizy-band fluxes for the Vera C. Rubin observatory

In order to facilitate bootstrap photometric calibrations of early Rubin Observatory data we have created an all sky reference catalog called The Monster. This reference catalog uses a rank-ordered set of other reference catalogs to generate synthetic ugrizy-band fluxes that can be used calibrate images processed with the LSST science pipelines. This document describes the methodology used to create The Monster, documents the input external reference catalogs, and performs basic data validation of the first version of The Monster.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2019

Linking pyrometry to porosity in additively manufactured metals

Porosity in additively manufactured metals can reduce material strength which is generally considered undesirable. Although studies have shown relationships between process parameters and porosity, monitoring strategies for defect detection and pore formation are still needed. In this paper, instantaneous anomalous conditions are detected in-situ via pyrometry during laser powder bed fusion additive manufacturing and correlated with voids observed using post-build micro-computed tomography. Large two-color pyrometry data sets were used to estimate instantaneous temperatures, melt pool orientations and aspect ratios. Machine learning algorithms were then applied to processed pyrometry data to detect outlier images and conditions. It is shown that melt pool outliers are good predictors of voids observed post-build. With this approach, real time process monitoring can be incorporated into systems to detect defect and void formation. Alternatively, using the methodology presented here, pyrometry data can be post processed for porosity assessment.

36 MATERIALS SCIENCE↗
DOE OSTI2015

First results of the silicon telescope using an 'artificial retina' for fast track finding

We present the first results of the prototype of a silicon tracker with trigger capabilities based on a novel approach for fast track finding. The working principle of the 'artificial retina' is inspired by the processing of visual images by the brain and it is based on extensive parallelization of data distribution and pattern recognition. The algorithm has been implemented in commercial FPGAs in three main logic modules: a switch for the routing of the detector hits, a pool of engines for the digital processing of the hits, and a block for the calculation of the track parameters. The architecture is fully pipelined and allows the reconstruction of real-time tracks with a latency less then 100 clock cycles, corresponding to 0.25 microsecond at 400 MHz clock. The silicon telescope consists of 8 layers of single-sided silicon strip detectors with 512 strips each. The detector size is about 10 cm x 10 cm and the strip pitch is 183 μm. The detectors are read out by the Beetle chip, a custom ASICs developed for LHCb, which provides the measurement of the hit position and pulse height of 128 channels. The 'artificial retina' algorithm has been implemented on custom data acquisition boards based on FPGAs Xilinx Kintex 7 lx160. The parameters of the tracks detected are finally transferred to host PC via USB 3.0. The boards manage the read-out ASICs and the sampling of the analog channels. The read-out is performed at 40 MHz on 4 channels for each ASIC that corresponds to a decoding of the telescope information at 1.1 MHz. We report on the first results of the fast tracking device and compare with simulations. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Quantifying Uncertainties of Microscopic Nuclear Theories

The goal of this project was to produce modernized nuclear data libraries of light ion fusion reactions and actinide fission product yields. Such libraries are essential input in both stockpile science but also fundamental science (nucleosynthesis, superheavy nuclei). When such libraries are used to model complex processes involving exotic, very short-lived nuclei that have not been measured experimentally, the underlying nuclear data come from theoretical models, the predictive power of which needs to be quantified, together with its uncertainties. By teaming up nuclear theorists and statisticians, we built comprehensive theoretical frameworks based on the most fundamental theories of fusion and fission that we coupled for the first time with a Bayesian framework with machine learning techniques for uncertainty quantification. Our results include: (1) statistical emulators for neutron-alpha scattering, and the fission product mass yields of neutron-induced fission of 239 Pu, which will enable developers to generate random realizations of the corresponding data for uncertainty quantification (UQ) in applications; (2) the first complete and most accurate ab initio prediction of the S-factor for proton capture on 7 Be, which – combined with UQ – may become the recommended value at solar energies in the next review of solar fusion cross sections; (3) statistical emulators for fission mass yields in the neutron-induced fission of 239 Pu; (4) the first quantification of how uncertainties in nuclear forces impact fission properties that are relevant in nucleosynthesis simulations to explain how heavy elements are formed in the Cosmos.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2017

Independent Verification Activities Assessing the Open-Air Readiness of Building H2/G2 Combined Tunnel Floor, Characterization Zone 6, at the Separations Process Research Unit Niskayuna, New York

The U.S. Department of Energy (DOE) Separations Process Research Unit (SPRU) Field Office (DOE-SPRU) in Niskayuna, New York, requested that the Oak Ridge Institute for Science and Education (ORISE) perform on-site independent verification (IV) activities in conjunction with the decommissioning of the H2 Building at the SPRU facility. The scope of the ORISE IV effort was independent data reviews, in-process verification, and the collection of independent survey data and volumetric structural concrete samples.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

Announcing the launch of Protein Data Bank China as an Associate Member of the Worldwide Protein Data Bank Partnership

The Protein Data Bank (PDB) is the single global archive of atomic-level, three-dimensional structures of biological macromolecules experimentally determined by macromolecular crystallography, nuclear magnetic resonance spectroscopy or three-dimensional cryo-electron microscopy. The PDB is growing continuously, with a recent rapid increase in new structure depositions from Asia. In 2022, the Worldwide Protein Data Bank (wwPDB; https://www.wwpdb.org/) partners welcomed Protein Data Bank China (PDBc; https://www.pdbc.org.cn) to the organization as an Associate Member. PDBc is based in the National Facility for Protein Science in Shanghai which is associated with the Shanghai Advanced Research Institute of Chinese Academy of Sciences, the Shanghai Institute for Advanced Immunochemical Studies and the iHuman Institute of ShanghaiTech University. This letter describes the history of the wwPDB, recently established mechanisms for adding new wwPDB data centers and the processes developed to bring PDBc into the partnership.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2015

Real time capable infrared thermography for ASDEX Upgrade

Infrared (IR) thermography is widely used in fusion research to study power exhaust and incident heat load onto the plasma facing components. Due to the short pulse duration of today’s fusion experiments, IR systems have mostly been designed for off-line data analysis. For future long pulse devices (e.g., Wendelstein 7-X, ITER), a real time evaluation of the target temperature and heat flux is mandatory. This paper shows the development of a real time capable IR system for ASDEX Upgrade. A compact IR camera has been designed incorporating the necessary magnetic and electric shielding for the detector, cooler assembly. The camera communication is based on the Camera Link industry standard. The data acquisition hardware is based on National Instruments hardware, consisting of a PXIe chassis inside and a fibre optical connected industry computer outside the torus hall. Image processing and data evaluation are performed using real time LabVIEW.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Software-defined network for end-to-end networked science at the exascale

Domain science applications and workflow processes are currently forced to view the network as an opaque infrastructure into which they inject data and hope that it emerges at the destination with an acceptable Quality of Experience. There is little ability for applications to interact with the network to exchange information, negotiate performance parameters, discover expected performance metrics, or receive status/troubleshooting information in real time. The work presented here is motivated by a vision for a new smart network and smart application ecosystem that will provide a more deterministic and interactive environment for domain science workflows. The Software-Defined Network for End-to-end Networked Science at Exascale (SENSE) system includes a model-based architecture, implementation, and deployment which enables automated end- to-end network service instantiation across administrative domains. An intent based interface allows applications to express their high-level service requirements, an intelligent orchestrator and resource control systems allow for custom tailoring of scalability and real-time responsiveness based on individual application and infrastructure operator requirements. This allows the science applications to manage the network as a first-class schedulable resource as is the current practice for instruments, compute, and storage systems. Deployment and experiments on production networks and testbeds have validated SENSE functions and performance. Emulation based testing verified the scalability needed to support research and education infrastructures. Key contributions of this work include an architecture definition, reference implementation, and deployment. This provides the basis for further innovation of smart network services to accelerate scientific discovery in the era of big data, cloud computing, machine learning and artificial intelligence.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

Software-Defined Network for End-to-end Networked Science at the Exascale

Domain science applications and workflow processes are currently forced to view the network as an opaque infrastructure into which they inject data and hope that it emerges at the destination with an acceptable Quality of Experience. There is little ability for applications to interact with the network to exchange information, negotiate performance parameters, discover expected performance metrics, or receive status/troubleshooting information in real time. The work we presen here is motivated by a vision for a new smart network and smart application ecosystem that will provide a more deterministic and interactive environment for domain science workflows. The Software-Defined Network for End-to-end Networked Science at Exascale (SENSE) system includes a model-based architecture, implementation, and deployment which enables automated end-to-end network service instantiation across administrative domains. An intent based interface allows applications to express their high-level service requirements, an intelligent orchestrator and resource control systems allow for custom tailoring of scalability and real-time responsiveness based on individual application and infrastructure operator requirements. This allows the science applications to manage the network as a first-class schedulable resource as is the current practice for instruments, compute, and storage systems. Deployment and experiments on production networks and testbeds have validated SENSE functions and performance. Emulation based testing verified the scalability needed to support research and education infrastructures. Key contributions of this work include an architecture definition, reference implementation, and deployment. This provides the basis for further innovation of smart network services to accelerate scientific discovery in the era of big data, cloud computing, machine learning and artificial intelligence.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Leveraging Environmental Research and Observation Networks to Advance Soil Carbon Science

Soil organic matter (SOM) is a critical ecosystem variable regulated by interacting physical, chemical, and biological processes. Collaborative efforts to integrate perspectives, data, and models from interdisciplinary research and observation networks can significantly advance predictive understanding of SOM. We outline how integrating three networks—the Long-Term Ecological Research with a focus on ecological dynamics, the Critical Zone Observatories with strengths in landscape/geologic context, and the National Ecological Observatory Network with standardized multiscale measurements—can advance SOM knowledge. This integration requires improved data dissemination and sharing, coordinated data collection activities, and enhanced collaboration between empiricists and modelers within and across networks.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2017

A Collimated CZT Detector for Quantitative Gamma Assays - 17250

Cadmium-Zinc-Telluride [CZT] detectors for gamma spectroscopic measurements and room-temperature operation have had a long history of promising good performance. Very small detectors [0.05-0.5 cm{sup 3}] have been commercially available for many years, but their small size creates problems for spectroscopy because of very low photopeak efficiency, especially at medium and high energies. Large CZT [4-6 cm{sup 3}] detectors have been shown to work nicely in a research environment when complicated electronic and data processing algorithms are applied. We report here test results from a commercially available 1 cubic centimeter CZT detector housed in a portable custom Tungsten shield with a set of collimators with different apertures. The detector has 2-2.5% FWHM resolution at Cs-137 energies, and near-Gaussian shaped peaks. Efficiency calibrations can be quickly made for a wide variety of geometries using the ISOCS mathematical efficiency software. We show successful validation tests comparing accuracy of measurements on reference calibration point sources, line sources, and 200 liter drums. The low weight of the device [9 kg including the shield and collimator] and low power [powered via USB from the PC] makes these devices particularly suitable for human-deployed in-situ measurements of large objects containing medium levels of activity - e.g. characterization of objects encountered during decommissioning, emergency response, truck alarm investigation, or waste being shipped to a disposal facility. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗