SEARCH · Engineering Papers

Results for “Data Processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Online Monitoring of Radiochemical Processing Streams for the Plutonium-238 Supply Program

Online monitoring with spectrophotometry is being developed to improve the timeliness of analytical measurements for the Plutonium-238 Supply Program at Oak Ridge National Laboratory. A commercially available online monitoring software was used to calculate and view process data in real time to help identify process deviations and optimize system performance. Monitoring detailed process data will improve processing efficiency and help technicians make decisions during hot-cell operations.

Sadergaski, Luke↗

DOE OSTI2021

Processed Lab Data for Neural Network-Based Shear Stress Level Prediction

Machine learning can be used to predict fault properties such as shear stress, friction, and time to failure using continuous records of fault zone acoustic emissions. The files are extracted features and labels from lab data (experiment p4679). The features are extracted with a non-overlapping window from the original acoustic data. The first column is the time of the window. The second and third columns are the mean and the variance of the acoustic data in this window, respectively. The 4th-11th column is the the power spectrum density ranging from low to high frequency. And the last column is the corresponding label (shear stress level). The name of the file means which driving velocity the sequence is generated from. Data were generated from laboratory friction experiments conducted with a biaxial shear apparatus. Experiments were conducted in the double direct shear configuration in which two fault zones are sheared between three rigid forcing blocks. Our samples consisted of two 5-mm-thick layers of simulated fault gouge with a nominal contact area of 10 by 10 cm^2. Gouge material consisted of soda-lime glass beads with initial particle size between 105 and 149 micrometers. Prior to shearing, we impose a constant fault normal stress of 2 MPa using a servo-controlled load-feedback mechanism and allow the sample to compact. Once the sample has reached a constant layer thickness, the central block is driven down at constant rate of 10 micrometers per second. In tandem, we collect an AE signal continuously at 4 MHz from a piezoceramic sensor embedded in a steel forcing block about 22 mm from the gouge layer The data from this experiment can be used with the deep learning algorithm to train it for future fault property prediction.

15 GEOTHERMAL ENERGY↗

DOE OSTI2022

Idaho National Laboratory Data Acquisition And Processing System

The INLDAS data acquisition and processing system is designed to develop prototype measurements and real-time processing techniques. The INLDAS hardware and firmware currently consists of National Instruments • NI-DAQmx 14.1 • cDAQ-9184 • 9205 • 9211 INLDAS can perform of standard data acquisition functions as well as novel functions and real-time processing algorithms. There are 3 acquisition modes to choose from: • Continuous mode runs when the user hits start, processing data and logging it to file • SWTrigger mode waits for one or more predefined triggers before acquiring data. It will buffer data as well, so it can record data that happened shortly before the trigger • Wakeup mode waits on predefined timers. When a time goes off, it acquires a preset amount of data There are also 3 Data Processing Modes • Normal mode does no processing besides the rolling average • FFT Mode Performs an FFT on incoming data every time the time window has elapsed • STFFT mode

Smith, JamesA↗

DOE OSTI2015

NJOY21: Making NJOY Suitable for the 21. Century - 14409

NJOY has a long history of nuclear data processing. NJOY began as a successor to MINX (Multigroup Interpretation of Nuclear X-Sections), a Los Alamos code and was first publicly released in the summer of 1977. The initial version included modules such as RECONR for resonance reconstruction on a union energy grid, BROADR for Doppler broadening plus a new Multigroup averaging program, GROUPR and an associated output module, DTR. Soon thereafter the HEATR, ERRORR, and THERMR modules were added to NJOY. By the mid 1980's, NJOY had a worldwide user community. The current version of NJOY2012 was released in December 2012. NJOY2012 builds on the success of more than 45 years of nuclear data processing at Los Alamos National Laboratory. NJOY2012 was rewritten using Fortran 90/95, utilizing among other things the concepts of public and private variables, eliminating common blocks in lieu of Fortran modules and taking advantage of allocatable arrays. A new version of NJOY is being developed at Los Alamos National Laboratory; NJOY21: NJOY for the 21. Century. NJOY21 uses modern programming standards of quality, reliability, and maintainability. It is being designed from the ground up to utilize modern methods of interacting with computer codes by providing an interactive and scripting (e.g., Python) interface. This will allow scientists the ability to more easily work with the results of the various steps in the processing of nuclear data. NJOY21 will continue the legacy of NJOY by providing a trusted and verified processing code that is fast, flexible, easy to use and customize and capable of handling both modern and established nuclear data formats. This paper introduces NJOY21 by first relating the history of NJOY; the majority of the paper will discuss NJOY21. NJOY21 will take advantage of the many decades of nuclear data processing experience that is contained in NJOY2012 and previous versions of NJOY and extend the capabilities and convenience of processing nuclear data. We will discuss how NJOY21 will remain backwards compatible with NJOY2012 - i.e., how current NJOY2012 input decks will continue to work with NJOY21. We will also discuss the verification and validation of the NJOY21 code base. Finally we will discuss new features in NJOY21 that do not exist in NJOY2012. These features include changes in how a scientist can interact with NJOY to process and verify and validate nuclear data; and the ability to read and write new nuclear data formats. (authors)

42 ENGINEERING↗

DOE OSTI2016

Exploring the Performance of Spark for a Scientific Use Case

We present an evaluation of the performance of a Spark implementation of a classification algorithm in the domain of High Energy Physics (HEP). Spark is a general engine for in-memory, large-scale data processing, and is designed for applications where similar repeated analysis is performed on the same large data sets. Classification problems are one of the most common and critical data processing tasks across many domains. Many of these data processing tasks are both computation- and data-intensive, involving complex numerical computations employing extremely large data sets. We evaluated the performance of the Spark implementation on Cori, a NERSC resource, and compared the results to an untuned MPI implementation of the same algorithm. While the Spark implementation scaled well, it is not competitive in speed to our MPI implementation, even when using significantly greater computational resources.

Sehrish, Saba↗

DOE OSTI2015

Enabling X-ray free electron laser crystallography for challenging biological systems from a limited number of crystals

Abstract not provided

Uervirojnangkoorn, Monarin↗

DOE OSTI2015

Enabling X-ray free electron laser crystallography for challenging biological systems from a limited number of crystals

There is considerable potential for X-ray free electron lasers (XFELs) to enable determination of macromolecular crystal structures that are difficult to solve using current synchrotron sources. Prior XFEL studies often involved the collection of thousands to millions of diffraction images, in part due to limitations of data processing methods. We implemented a data processing system based on classical post-refinement techniques, adapted to specific properties of XFEL diffraction data. When applied to XFEL data from three different proteins collected using various sample delivery systems and XFEL beam parameters, our method improved the quality of the diffraction data as well as the resulting refined atomic models and electron density maps. Moreover, the number of observations for a reflection necessary to assemble an accurate data set could be reduced to a few observations. These developments will help expand the applicability of XFEL crystallography to challenging biological systems, including cases where sample is limited.

43 PARTICLE ACCELERATORS↗

DOE OSTI2019

Temporal data system

A method for processing data is provided. Data is identified by a computer system. The data is processed in parallel by the computer system using temporal transformations to form pieces of temporal data. The pieces of temporal data are placed by the computer system in an order as the pieces of temporal data are generated by the temporal transformations to form a sequence of temporal data. The order of the sequence is based on a priority of when the pieces of temporal data should be processed, enabling performing an action.

Naegle, John H.↗

DOE OSTI2015

Practices and Standards for Data and Processing at the APS

The handling of datasets at scientific user facilities is becoming progressively more challenging as advances in sources and detectors drive increasingly aggressive data acquisition rates. The ability to share and process these data depends on the ability of the originator of the data and the persons making use of that data to unequivocally agree on what these data mean. This understanding is driven by use of standardized data formats.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

DOE OSTI2012

Atmospheric Radiation Measurement Climate Research Facility Operations Quarterly Report July 1–September 30, 2012

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2013

Atmospheric Radiation Measurement Climate Research Facility Operations Quarterly Report October 1–December 31, 2012

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2016

Atmospheric Radiation Measurement Climate Research Facility Operations Quarterly Report October 1-December 31, 2015

Research Facility fixed and mobile research sites are collected and routed to the Data Management Facility (DMF) for processing in near-real-time. Instrument and processed data are then delivered approximately daily to the ARM Data Archive, where they are made freely available to the research community. For each instrument, ARM calculates the ratio of the actual number of processed data records received daily at the ARM Data Archive to the expected number of data records. The results are tabulated by 1) individual datastream, site, and month for the current year, and 2) site and fiscal year dating back to 1998.

Source record↗

DOE OSTI2017

Atmospheric Radiation Measurement Climate Research Facility Operations Quarterly Report July 1-September 30, 2016

Individual datastreams from instrumentation at the Atmospheric Radiation Measurement (ARM) Climate Research Facility fixed and mobile research sites are collected and routed to the Data Management Facility (DMF) for processing in near-real time. Instrument and processed data are then delivered approximately daily to the ARM Data Archive, where they are made freely available to the research community. For each instrument, ARM calculates the ratio of the actual number of processed data records received daily at the ARM Data Archive to the expected number of data records. The results are tabulated by 1) individual datastream, site, and month for the current year, and 2) site and fiscal year dating back to 1998. The U.S. Department of Energy requires national user facilities to report time-based operating data. The requirements involve the: Actual hours of operation (ACTUAL) – 24 hours per day, 92 days or 2208 hours for this quarter Estimated maximum operation or uptime target (TARGET) Variance (VARIANCE), which is equal to (1 – [ACTUAL/TARGET]) TARGET and VARIANCE numbers account for unplanned downtime. Differences in TARGET performance reflect the complexity of local logistics and the frequency of extreme weather events. It is impractical to measure TARGET for each instrument or datastream. Data availability reported here refers to the average of the individual, continuous datastreams received by the ARM Data Archive. Therefore, data availability is directly related to individual instrument uptime expressed in hours. Data not at the ARM Data Archive are caused by downtime (scheduled or unplanned) of the individual instruments. Missing data caused by scheduled downtime are not included in the metrics. Thus, the average percentage of data in the ARM Data Archive represents the average percentage of the time the instruments were operating for the quarter.

Southern Great Plains, North Slope of Alaska, East↗

DOE OSTI2016

Atmospheric Radiation Measurement Climate Research Facility Operations Quarterly Report April 1-June 30, 2016

Individual datastreams from instrumentation at the Atmospheric Radiation Measurement (ARM) Climate Research Facility fixed and mobile research sites are collected and routed to the Data Management Facility (DMF) for processing in near-real time. Instrument and processed data are then delivered approximately daily to the ARM Data Archive, where they are made freely available to the research community. For each instrument, ARM calculates the ratio of the actual number of processed data records received daily at the ARM Data Archive to the expected number of data records. The results are tabulated by 1) individual datastream, site, and month for the current year, and 2) site and fiscal year dating back to 1998. The U.S. Department of Energy requires national user facilities to report time-based operating data. The requirements involve the: Actual hours of operation (ACTUAL) – 24 hours per day, 91 days or 2184 hours for this quarter Estimated maximum operation or uptime target (TARGET) Variance (VARIANCE), which is equal to (1 – [ACTUAL/TARGET]) TARGET and VARIANCE numbers account for unplanned downtime. Differences in TARGET performance reflect the complexity of local logistics and the frequency of extreme weather events. It is impractical to measure TARGET for each instrument or datastream. Data availability reported here refers to the average of the individual, continuous datastreams received by the ARM Data Archive. Therefore, data availability is directly related to individual instrument uptime expressed in hours. Data not at the ARM Data Archive are caused by downtime (scheduled or unplanned) of the individual instruments. Missing data caused by scheduled downtime are not included in the metrics. Thus, the average percentage of data in the ARM Data Archive represents the average percentage of the time the instruments were operating for the quarter.

North Slope of Alaska, Eastern North Atlantic, Sou↗

DOE OSTI2013

THE COORDINATED RADIO AND INFRARED SURVEY FOR HIGH-MASS STAR FORMATION. II. SOURCE CATALOG

The CORNISH project is the highest resolution radio continuum survey of the Galactic plane to date. It is the 5 GHz radio continuum part of a series of multi-wavelength surveys that focus on the northern GLIMPSE region (10 Degree-Sign < l < 65 Degree-Sign ), observed by the Spitzer satellite in the mid-infrared. Observations with the Very Large Array in B and BnA configurations have yielded a 1.''5 resolution Stokes I map with a root mean square noise level better than 0.4 mJy beam{sup -1}. Here we describe the data-processing methods and data characteristics, and present a new, uniform catalog of compact radio emission. This includes an implementation of automatic deconvolution that provides much more reliable imaging than standard CLEANing. A rigorous investigation of the noise characteristics and reliability of source detection has been carried out. We show that the survey is optimized to detect emission on size scales up to 14'' and for unresolved sources the catalog is more than 90% complete at a flux density of 3.9 mJy. We have detected 3062 sources above a 7{sigma} detection limit and present their ensemble properties. The catalog is highly reliable away from regions containing poorly sampled extended emission, which comprise less than 2% of the survey area. Imaging problems have been mitigated by down-weighting the shortest spacings and potential artifacts flagged via a rigorous manual inspection with reference to the Spitzer infrared data. We present images of the most common source types found: H II regions, planetary nebulae, and radio galaxies. The CORNISH data and catalog are available online at http://cornish.leeds.ac.uk.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2015

SU-C-201-04: Quantification of Perfusion Heterogeneity Based On Texture Analysis for Fully Automatic Detection of Ischemic Deficits From Myocardial Perfusion Imaging

Purpose: Texture-based quantification of image heterogeneity has been a popular topic for imaging studies in recent years. As previous studies mainly focus on oncological applications, we report our recent efforts of applying such techniques on cardiac perfusion imaging. A fully automated procedure has been developed to perform texture analysis for measuring the image heterogeneity. Clinical data were used to evaluate the preliminary performance of such methods. Methods: Myocardial perfusion images of Thallium-201 scans were collected from 293 patients with suspected coronary artery disease. Each subject underwent a Tl-201 scan and a percutaneous coronary intervention (PCI) within three months. The PCI Result was used as the gold standard of coronary ischemia of more than 70% stenosis. Each Tl-201 scan was spatially normalized to an image template for fully automatic segmentation of the LV. The segmented voxel intensities were then carried into the texture analysis with our open-source software Chang Gung Image Texture Analysis toolbox (CGITA). To evaluate the clinical performance of the image heterogeneity for detecting the coronary stenosis, receiver operating characteristic (ROC) analysis was used to compute the overall accuracy, sensitivity and specificity as well as the area under curve (AUC). Those indices were compared to those obtained from the commercially available semi-automatic software QPS. Results: With the fully automatic procedure to quantify heterogeneity from Tl-201 scans, we were able to achieve a good discrimination with good accuracy (74%), sensitivity (73%), specificity (77%) and AUC of 0.82. Such performance is similar to those obtained from the semi-automatic QPS software that gives a sensitivity of 71% and specificity of 77%. Conclusion: Based on fully automatic procedures of data processing, our preliminary data indicate that the image heterogeneity of myocardial perfusion imaging can provide useful information for automatic determination of the myocardial ischemia.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2024

HERO WEC Belt Test Data

The following submission includes raw and processed data from the 2024 Hydraulic and Electric Reverse Osmosis Wave Energy Converter (HERO WEC) belt tests conducted using NREL's Large Amplitude Motion Platform (LAMP). A description of the motion profiles run during testing can be found in the run log document. Data was collected using NREL's Modular Ocean Data AcQuisition (MODAQ) system in the form of TDMS files. Data was then processed using Python and MATLAB and converted to MATLAB workspace, parquet, and csv file formats. During Data processing, a low pass filter was applied to each array and the arrays were then resampled to common 10Hz timestamps. A MATLAB data viewer script is provided to quickly visualize these data sets. The following arrays are contained in each test data file: - Time: Unix seconds timestamp - Test_Time: Time in seconds since beginning of test - POS_OS_1001: Encoder position in degrees (the encoder is located on the secondary shaft of the spring return and is driven by the winch after a 4.5:1 gear reduction) - LC_ST_1001: Anchor load cell data in lbf - PRESS_OS_2002: Air spring pressure in psi This data set has been developed by the National Renewable Energy Laboratory, operated by Alliance for Sustainable Energy, LLC, for the U.S. Department of Energy (DOE) under Contract No. DE-AC36-08GO28308. Funding provided by the U.S. Department of Energy Office of Energy Efficiency and Renewable Energy Water Power Technologies Office.

16 TIDAL AND WAVE POWER↗

DOE OSTI2014

Seismic and Infrasound Location

This presentation includes slides on Signal Propagation Through the Earth/Atmosphere Varies at Different Scales; 3D Seismic Models: RSTT; Ray Coverage (Pn); Source-Specific Station Corrections (SSSCs); RSTT Conclusions; SALSA3D (SAndia LoS Alamos) Global 3D Earth Model for Travel Time; Comparison of IDC SSSCs to RSTT Predictions; SALSA3D; Validation and Model Comparison; DSS Lines in the Siberian Platform; DSS Line CRA-4 Comparison; Travel Time Δak135; Travel Time Prediction Uncertainty; SALSA3D Conclusions; Infrasound Data Processing: An example event; Infrasound Data Processing: An example event; Infrasound Location; How does BISL work?; BISL: Application to the 2013 DPRK Test; and BISL: Ongoing Research.

58 GEOSCIENCES↗