Robust Lidar Data Processing and Quality Control Methods Developed for the SWiFT Wake Steering Experiment.
Abstract not provided.
Herges, Thomas↗
SEARCH · Engineering Papers
Results for “Data Processing”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Planck 2013 results. II. Low Frequency Instrument data processing
We describe the data processing pipeline of the Planck Low Frequency Instrument (LFI) data processing centre (DPC) to create and characterize full-sky maps based on the first 15.5 months of operations at 30, 44, and 70 GHz. In particular, we discuss the various steps involved in reducing the data, from telemetry packets through to the production of cleaned, calibrated timelines and calibrated frequency maps. Data are continuously calibrated using the modulation induced on the mean temperature of the cosmic microwave background radiation by the proper motion of the spacecraft. Sky signals other than the dipole are removed by an iterative procedure based on simultaneous fitting of calibration parameters and sky maps. Noise properties are estimated from time-ordered data after the sky signal has been removed, using a generalized least squares map-making algorithm. A destriping code (Madam) is employed to combine radiometric data and pointing information into sky maps, minimizing the variance of correlated noise. Noise covariance matrices, required to compute statistical uncertainties on LFI and Planck products, are also produced. Main beams are estimated down to the ≈-20 dB level using Jupiter transits, which are also used for the geometrical calibration of the focal plane.
79 ASTRONOMY AND ASTROPHYSICS↗
High-Resolution Mass Spectrometry Quantification: Impact of Differences in Data Processing of Centroid and Continuum Data
High-resolution mass spectrometry (HRMS) in full scan mode acquires all ions present in the sample of interest offering a lot of qualitative information. This, in combination with the improved performance of the new generation HRMS systems, triggers more (bio) analysts to switch from triple quad MS systems to HRMS for quantitative analysis. Quantitative processing of HRMS data is performed based on narrow mass extraction windows rather than on nominal mass product ion chromatograms (SRM or MRM). Optimal processing of HRMS data requires different considerations and software tools and can have an impact on data processing and final results. The selection of centroid versus continuum/profile data for processing, selection of the optimal narrow mass extraction window, using theoretical versus measured accurate mass for the extraction of the ion chromatograms as well as differences in calculations and data handling residing in the different vendor software packages are tackled in the presented manuscript. These differences are illustrated on HRMS data acquired for the same plasma samples on three different platforms, i.e., a Sciex QToF, a Waters QToF, and a Thermo Orbitrap system, and processed in four different software packages, i.e., Sciex Analyst® TF, Waters Masslynx, Waters Unifi, and Thermo Xcalibur. The impact of these differences on quantitative HRMS performance was evaluated on calibration curves of eight small molecule compounds in plasma using four different ways of processing. Simple guidelines are provided for the selection of an optimal mass extraction window for continuum and centroided data. .
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
Method and apparatus for fast context cloning in a data processing system
A data processing system includes a memory system, a first processing element, a first address translator that maps virtual addresses to system addresses, a second address translator that maps system address to physical addresses, and a task management unit. A first program task uses a first virtual memory space that is mapped to a first system address range using a first table. The context of the first program task includes an address of the first table and is cloned by creating a second table indicative of a mapping from a second virtual address space to a second range of system addresses, where the second range is mapped to the same physical addresses as the first range until a write occurs, at which time memory is allocated and the mapping of the second range is updated. The cloned context includes an address of the second table.
Beard, Jonathan Curtis↗
EGS Collab Experiment 1: Circulation Testing Processed data
This submission includes processed and reduced data for circulation testing that was conducted at the 164' fracture on the 4850 ft level of the Sanford Underground Research Facility. The circulation tests were done to test the flow through the 164' fracture in the EGS Collab Experiment 1 testbed on the 4850 ft level of the Sanford Underground Research Facility in order to validate computer models concerned with flow processes and heat exchange processes in EGS. This data was processed from raw data that is available in the GDR submission linked below: "EGS Collab Circulation Testing Raw Data and Documentation." Python scripts used to process and reduce the data are included. The scripts also serve as "documentation" as well as examples for data processing. More information about the test itself as well as the rationale and process of data processing is available at wiki page linked below.
15 GEOTHERMAL ENERGY↗
LiDAR-Based Point Cloud Data Processing
The presentation includes the procedures of utilizing LiDAR-based point cloud data in WebGL applications, such as capturing data, processing data, importing point cloud into Unity software, and improving application performance. It uses IRC BLD 603 Lab B-12 as an example. It'll be presented at Viz n Learn workshop which is a collaboration series between INL's Applied Visualization Laboratory (AVL) and University of Wyoming (UW)'s Shell 3D Visualization center. Each session will highlight 2 projects from each institution monthly, followed by discussion on areas of collaborative interest and action.
3D↗
Development of nuclear data processing code FRENDY version 2
Nuclear data processing is an important interface between an evaluated nuclear data library and neutronics calculation codes. JAEA has been developed the new nuclear data processing code FRENDY from 2013. FRENDY version 1 generates the ACE files used for the continuous-energy Monte Carlo codes including PHITS, Solomon, Serpent,and MCNP and it was released as the open-source software under the 2-clause BSD license in 2019.After we released FRENDY version 1, many functions, e.g., the multi-group neutron cross-section library generation, the statistical uncertainty quantification of the probability tables for unresolved resonance cross-section, the 'perturbation' of the ACE file for uncertainty quantification, and the modification of the ENDF-6 formatted nuclear data file, have been developed. We released FRENDY version 2 including these functions. The present paper gives an overview of FRENDY and presents features of new functions implemented in FRENDY version 2. (authors)
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
Data processing and analysis with the autoPROC toolbox
Typical topics and problems encountered during data processing of diffraction experiments are discussed and the tools provided in the autoPROC software are described. A typical diffraction experiment will generate many images and data sets from different crystals in a very short time. This creates a challenge for the high-throughput operation of modern synchrotron beamlines as well as for the subsequent data processing. Novice users in particular may feel overwhelmed by the tables, plots and numbers that the different data-processing programs and software packages present to them. Here, some of the more common problems that a user has to deal with when processing a set of images that will finally make up a processed data set are shown, concentrating on difficulties that may often show up during the first steps along the path of turning the experiment (i.e. data collection) into a model (i.e. interpreted electron density). Difficulties such as unexpected crystal forms, issues in crystal handling and suboptimal choices of data-collection strategies can often be dealt with, or at least diagnosed, by analysing specific data characteristics during processing. In the end, one wants to distinguish problems over which one has no immediate control once the experiment is finished from problems that can be remedied a posteriori. A new software package, autoPROC, is also presented that combines third-party processing programs with new tools and an automated workflow script that is intended to provide users with both guidance and insight into the offline processing of data affected by the difficulties mentioned above, with particular emphasis on the automated treatment of multi-sweep data sets collected on multi-axis goniostats.
75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
A Discrete Hankel Transform Approach to Nuclear Data Processing for Fusion Applications
This study introduces advancements to the numerical solutions employed in the processing of nuclear data for fusion applications. It leverages the convolution theorem and Fourier transform techniques to enhance computational efficiency and broaden applicability. Building upon a previously reported discrete Hankel transform approach for Doppler broadening, this work refines the solution of convolution integrals central to these applications. The methodology provides a general and unified framework for evaluating any convolution operation, regardless of whether the underlying problem involves temperature effects in nuclear reactions. The applicability to the nuclear data processing for fusion is demonstrated by deriving the convolution integrals for some of the fusion-related quantities. As before, the convolution operation utilizes a Gaussian-based kernel; however, the discrete Hankel transform of order $𝛼$ = $\frac{1}{2}$ is now applied to the forward Fourier transform of the nonkernel argument, rather than the inverse Fourier transform. This modification eliminates the need for the integration of the nonkernel, cross section–based function, which is a step that posed challenges for certain pointwise cross-section representations. It also removes the requirement for cross-section linearization. Optimized for graphics processing unit architectures, the approach significantly improves computational performance. These advancements are currently under evaluation as the foundation for the next-generation thermonuclear data file processing codes being developed at Lawrence Livermore National Laboratory.
Nuclear science and engineering↗
Isolated data processing modules
This disclosure relates to computer systems that isolate data processing modules and methods of operating the same. In one embodiment of a method, a computer system receives a first data processing request for a first data file. The computer system may determine that a first data type of the first data file is supported by an encapsulated data processing module and determine a first communication protocol from a set of communication protocols that can be used to receive the first data file. The computer system can then receive the first data file from the first storage location in accordance with the first communication protocol and the encapsulated data processing module may be executed to convert the first data file in the first data format into second data in a second data format.
Penton, Joshua Michael↗
Observational process data analytics using causal inference
Voluminous process data are available with the paradigm shift toward smart manufacturing. However, most historical data are observational, containing noncausal correlations due to confounders and mediators. Estimating causal effects from observational data remains a bottleneck in leveraging them for active applications such as optimization and control. Further, this work aims to introduce a causal modeling framework for analyzing observational process data and extracting quantitative causal information. We demonstrate a real-world application in steel manufacturing where causal inference is used to analyze observational production data and improve the steelmaking process. Additionally, we propose a novel formulation for identifying critical process parameters from observational data, where causal inference is combined with variance-based methods to estimate corresponding risks of interventions to the manufacturing system. The proposed methods are compared with statistical ones to illustrate that causally interpreting statistical correlation leads to problematic results, while the provided workflow generates satisfactory strategies for process improvement.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
The power of event-driven analytics in Large Scale Data Processing
FeedZai is a software company specialized in creating high-‐throughput low-‐latency data processing solutions. FeedZai develops a product called "FeedZai Pulse" for continuous event-‐driven analytics that makes application development easier for end users. It automatically calculates key performance indicators and baselines, showing how current performance differ from previous history, creating timely business intelligence updated to the second. The tool does predictive analytics and trend analysis, displaying data on real-‐time web-‐based graphics. In 2010 FeedZai won the European EBN Smart Entrepreneurship Competition, in the Digital Models category, being considered one of the "top-‐20 smart companies in Europe". The main objective of this seminar/workshop is to explore the topic for large-‐scale data processing using Complex Event Processing and, in particular, the possible uses of Pulse in the scope of the data processing needs of CERN. Pulse is available as open-‐source and can be licensed both for non-‐commercial and commercial applications. FeedZai is interested in exploring possible synergies with CERN in high-‐volume low-‐latency data processing applications. The seminar will be structured in two sessions, the first one being aimed to expose the general scope of FeedZai's activities, and the second focused on Pulse itself: 10:00-11:00 FeedZai and Large Scale Data Processing; Introduction to FeedZai; FeedZai Pulse and Complex Event Processing; Demonstration; Use-Cases and Applications; Conclusion and Q&A. 11:00-11:15 Coffee break 11:15-12:30 FeedZai Pulse Under the Hood; A First FeedZai Pulse Application; PulseQL overview; Defining KPIs and Baselines; Conclusion and Q&A. About the speakers Nuno Sebastião is the CEO of FeedZai. Having worked for many years for the European Space Agency (ESA), he was responsible the overall design and development of Satellite Simulation Infrastructure of the agency. Having left ESA to found FeedZai, Nuno is currently responsible for the whole operations of the company. Nuno holds an M.Eng. in Informatics Engineering for the University of Coimbra, and an MBA from the London Business School. Paulo Marques is the CTO of FeedZai, being responsible for product development. Paulo is an Assistant Professor at the University of Coimbra, in the area of Distributed Data Processing, and an Adjunct Associated Professor at Carnegie Mellon, in the US. In the past Paulo lead a large number of projects for institutions like the ESA, Microsoft Research, SciSys, Siemens, among others, being now fully dedicated to FeedZai. Paulo holds a Ph.D. in Distributed Systems from the University of Coimbra.
97 MATHEMATICS AND COMPUTING↗
Data free inference with processed data products
Here, we consider the context of probabilistic inference of model parameters given error bars or confidence intervals on model output values, when the data is unavailable. We introduce a class of algorithms in a Bayesian framework, relying on maximum entropy arguments and approximate Bayesian computation methods, to generate consistent data with the given summary statistics. Once we obtain consistent data sets, we pool the respective posteriors, to arrive at a single, averaged density on the parameters. This approach allows us to perform accurate forward uncertainty propagation consistent with the reported statistics.
97 MATHEMATICS AND COMPUTING↗
2K-Capture in {sup 124}Хе: Results of Data Processing for an Exposure of 37.7 kg day
The results of the experimental search for two-neutrino 2K-capture in {sup 124}Xe with a large copper proportional counter obtained by processing the data for an exposure of 37.7 kg day are presented. The experimental setup is located at the Underground Low-Background: Laboratory of the Baksan Neutrino Observatory at a depth of 4900 m.w.e. The combination of methods of selection of useful signals with a unique set of characteristics and the event topology taken into account allowed us to suppress the background in the energy region of interest. A new half-life limit for 2K(2ν)-capture in {sup 124}Xe was determined: T{sub 1/2} ≥ 7.7 × 10{sup 21} years (90% CL).
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
FRONT END DATA PROCESSING IN THE SLD DATA ACQUISITION SYSTEM
Explore the source record for details and available documents.
Nielsen, B.↗
Geometric conditions for saturating the data processing inequality
Abstract The data processing inequality (DPI) is a scalar inequality satisfied by distinguishability measures on density matrices. For some distinguishability measures, saturation of the scalar DPI implies an operator equation relating the arguments of the measure. These results are typically derived using functional analytic techniques. In a complementary approach, we use geometric techniques to derive a formula that gives an operator equation from DPI saturation for any distinguishability measure; moreover, for a broad class of distinguishability measures, the derived operator equation is sufficient to imply saturation as well. Our operator equation coincides with known results for the sandwiched Rényi relative entropies, and gives new results for α - z Rényi relative entropies and a family of of quantum f -divergences, which we compute explicitly.
Physics↗
Site C1 UTD Sonic Anemometer / Processed Data
This dataset contains processed data from the Site C1 UTD Sonic Anemometer.
17 WIND ENERGY↗
ARM Site E36 - CLAMPS 2 Microwave Radiometer / Processed Data
This dataset contains processed data from the CLAMPS 2 Humidity And Temperature PROfiler (HATPRO) Microwave Radiometer and its associated meteorology tower. CLAMPS 2 deployed during fall-winter 2022 (10/3/22-12/27/23) and summer-fall 2023 (6/16/23-10/1/23).
17 WIND ENERGY↗