Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data processing and logging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

FLEXIBLE APPLICATION OF THE JLAB PANSOPHY INFORMATION SYSTEM FOR PROJECT REPORTS, PROCESS MONITORING, AND R&D SAMPLE TRACKING

The use and features of the JLab SRF Institute IT system Pansophy1,2 continue to expand. In support of the cryomodule rework project for CEBAF a full set of web-based travelers has been implemented and an integrated set of live summary reports has been created. A graphical user interface within the reports enables navigation to either higher-level summaries or drill-down to the original source data. In addition to collection of episodic data, Pansophy is now used to capture, coordinate, and display continuously logged process parameter that relate to technical water systems and clean room environmental conditions. In a new expansion, Pansophy is being used to collect and track process and analytical data sets associated with SRF material samples that are part of the surface creation, processing, and characterization R&D program.

43 PARTICLE ACCELERATORS↗

CVEVOLVE

CVEvolve is an agentic AI system for autonomous algorithm discovery for scientific data processing. It creates workflows where large language model agents freely set up and configure development environments and evaluation harnesses, develop and improve data processing algorithms with designed exploration-exploitation balancing mechanisms, log history and findings in a structured database, and run holdout testing to ensure algorithm generalizability. CVEvolve offers a zero-code interface and does not require users to provide structured data and evaluation scripts.

Cherukara, MatthewJoseph [Argonne National Laborat↗

Structural and Stratigraphic Controls on Methane Hydrate occurrence and distribution: Gulf of Mexico, Walker Ridge 313 and Green Canyon 955: Final Report

The goal of this project was to determine structural and stratigraphic controls on hydrate occurrence and distribution in Green Canyon (GC) 955 and Walker Ridge (WR) 313 blocks using seismic and well data. Gas hydrate was discovered in these blocks in coarse- and fine-grained sediments during the 2009 Joint Industrial project (JIP) Leg 11 drilling expedition. Although the immediate interest of the exploration community is exclusively hydrate which is present in coarse–grained sediments, factors that control hydrate and free gas distribution in the two blocks and whether coarse and fine-grained hydrate-bearing units are related in any manner, formed the core of this research. The project spanned from 10/01/2012 to 07/31/2016. In the project, in both the leased blocks, the interval spanning the gas hydrate stability zone (GHSZ) was characterized using a joint analysis of sparse Ocean Bottom Seismic (OBS) and dense, surface–towed multichannel seismic (MCS) data. The project team had the luxury of calibrating their results with two well logs. Advance processing methods such as depth migration and full-waveform inversion (FWI) were used for seismic data analysis. Hydrate quantification was achieved through interpretation of the FWI velocity field using appropriate rock physics models at both blocks. The seismic modeling/inversion methodology (common to both GC955 and WR313 blocks) was as follows. First, the MCS data were depth migrated using a P-wave velocity (VP) model constructed using inversion of reflection arrival times of a few (four in both cases) key horizons carefully picked in the OBS data to farthest possible offsets. Then, the resolution of the traveltime VP model was improved to wavelength scale by inverting OBS gathers up to the highest frequency possible (21.75 Hz for GC955 and 17.5 for WR313) using FWI. Finally, the hydrate saturation (or the volume fraction) was estimated at the well location assuming one of the other hydrate morphology (filling the primary or the secondary porosity) was extrapolated out from the wells using the FWI VP as a guide. General outcomes were as follows. First and foremost, an imaging methodology using sparse seismic data, which is easily replicable at other sites with similar datasets, has been demonstrated. The end product of this methodology at both the leased blocks is quantitative estimates of hydrate distribution. Second, at both locations there is strong evidence that the base of the GHSZ, which does not appear as a clear Bottom Simulating Reflection (BSR), manifests in the VP perturbations created by FWI, suggesting that FWI is sensitive to subtle compositional changes in shallow sediments and establishes it as a valuable tool for investigations of hydrate-bearing basins. Third, through joint interpretation of the depth migrated image and the FWI VP model, how structure and stratigraphy jointly determine hydrate and free gas distribution in both blocks could be clearly visualized. The joint interpretation also suggests that the coarse and fine grained hydrate-bearing sediments at both leased are connected. Site specific results, in addition to general results, are as follows. At GC955 the overlying fine-grained hydrate-bearing unit could have been sourced from the underlying hydrate coarse-grained channel-levee complex through a chimney feature. The channel-levee system at GC955 is compartmentalized by faults, of which only a few may be impermeable. Although compartmentalized, the channel-levee system in the GC955 as a whole might be in communication except selected zones. At WR313 the overlying fine-grained fracture-filled hydrate unit appears to be sourced from below the GHSZ. The reason that only a particular fine-grained unit has hydrate, despite having lower porosity that the bounding units, could be the presence of secondary porosity (such as those formed from clay dewatering under compaction). In conclusion, the project was a pioneering effort in in joint analysis of OBS and MCS datasets for advancing the knowledge about a hydrate and free–gas system dynamics using advanced processing methods such as FWI and depth migration. Results obtained in this project can greatly advance the tools and techniques used for delineating specific hydrate prospects. Results obtained in this project can also be seamlessly incorporated into other DOE funded project on modeling the potential productivity and commercial viability of hydrate from sand-dominated reservoirs. The OBS and MCS data in this project were acquired in 2012 (after the JIP II drilling) by the USGS and therefore the results are a posteriori. Nonetheless, the seismic inversion workflow established through this project can be used to generate various what-if quantification scenarios even in absence of logs and serve as a valuable tool for guiding drilling operations. Results from this project can augment other DOE sponsored projects on determining the commercial viability of methane production from the Gulf of Mexico.

03 NATURAL GAS↗

Collecting and Processing Earth Science Data Metrics at NASA ESDIS

Since the launch of Terra satellite in 1999, the number of Earth Science remote sensing data products created and distributed by NASA's Earth Observing System (EOS) Data and Information System (EOSDIS) has increased from a few hundred to nearly ten thousand. NASA's Earth Science Data and Information System (ESDIS) Metrics System (EMS) collects metrics on data ingest, archive, and distribution by its Distributed Active Archive Centers (DAACs) and the Science Investigator-led Systems (SIPS), known as Data Providers. These metrics are critical in helping NASA management as well as data producers in resource planning and gaining a wide range of knowledge of data users and data usage.EMS receives flat files, or log files of data archive, ingest, and distribution either in their raw format, such as Apache web logs, or text files of log records formatted by the Data Providers. Tens of millions of records are processed each day to extract metrics on data products, user information, distribution protocols and services, and so on. The metrics are then made available to designated parties.This presentation provides an overview of the EMS processing workflow and improvement efforts made in recent years to handle ever-increasing number of data records and new metrics requirements, discusses several key steps including mapping log records to data products and identifying user communities along with geo-distribution, and demonstrates typical metrics capabilities produced by the EMS system. Challenges and potential approaches to improve the system are also discussed.

Pan, Jianfu↗

Event-Based Processing of Neutron Scattering Data

Many of the world's time-of-flight spallation neutrons sources are migrating to the recording of individual neutron events. This provides for new opportunities in data processing, the least of which is to filter the events based on correlating them with logs of sample environment and other ancillary equipment. This paper will describe techniques for processing neutron scattering data acquired in event mode that preserve event information all the way to a final spectrum, including any necessary corrections or normalizations. This results in smaller final errors, while significantly reducing processing time and memory requirements in typical experiments. Results with traditional histogramming techniques will be shown for comparison.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

AD – Elog Data Search Using Natural Language Processing Techniques

The goal of this project is to develop and evaluate a Machine Learning model using natural language processing techniques to categorize AD E-Log entries efficiently. AD E-Logs, which play a vital role in Fermilab's projects as a system to record and manage various data, often suffer from slow search processing and imprecise results. To address this issue, we preprocessed the data and employed the Doc2Vec model for training. The resulting model enables us to identify and retrieve the most relevant entries, thus enhancing user experience in accessing desired information.

Muse, Amiin↗

Geostatistical Simulation of Acoustic Log Data for Seismic Depth Conversion

Seismic reflection methods measure the time a seismic wave takes to travel through the ground, from the user defined source to a series of signal monitoring sensors known as geophones. The measured times need to be depth converted to allow for integration with other geological data. In order to convert from time to depth, an estimate of the rock volume velocity field must be made. The velocity field estimate can be made by assignment of velocity estimates to a geological model independent of the seismic processing. This article presents the results of using the acoustic geophysical log data extrapolated via sequential Gaussian simulation to derive the velocity field. The uncertainties associated with the velocity estimates were significant and provided the means to assess confidence limits for the actual depth determination. The technique is assessed by application to a major coal deposit, approximately 2.1 m thick and 210 m deep. Considering only the uncertainty associated with estimating the velocity field, half of the confidence interval values showed approximately 1 m of uncertainty in depth. The application of sequential Gaussian simulation to model the 3D distribution of acoustic velocity can be extended to other geophysical log parameters or derived estimates.

58 GEOSCIENCES↗

Visualization of hydraulic fracture using physics-informed clustering to process ultrasonic shear waves

Ultrasonic transmission is sensitive to the spatial variation in mechanical properties of materials due to the presence of cracks/fractures. Wave propagation through fractured media introduces changes in the frequency content, travel time and transmission coefficient of the wave. A workflow based on physics-informed unsupervised learning is developed to process the transmitted ultrasonic-shear waveforms to non-invasively visualize the geomechanical alterations due to hydraulic fracturing. Novelty of the work involves the assignment of both statistically consistent and physically consistent clusters to the measurements of shear waveforms acquired across the one axial and two frontal planes. Physically consistent/relevant information is incorporated by considering the travel time of the peak of spectral energy and transmission coefficient of the transmitted waveform. The proposed workflow generates maps of geomechanical alterations across the frontal and axial planes of the sample. The outputs of the workflow are in good agreement with independent techniques viz. acoustic emission and X-ray computed tomography. Finally, the proposed workflow can be adapted for improved fracture characterization in the subsurface when processing sonic-logging, cross-wellbore seismic or surface seismic waveform data.

42 ENGINEERING↗

Estimation of stochastic volatility with long memory for index prices of FTSE Bursa Malaysia KLCI

In recent years, modeling in long memory properties or fractionally integrated processes in stochastic volatility has been applied in the financial time series. A time series with structural breaks can generate a strong persistence in the autocorrelation function, which is an observed behaviour of a long memory process. This paper considers the structural break of data in order to determine true long memory time series data. Unlike usual short memory models for log volatility, the fractional Ornstein-Uhlenbeck process is neither a Markovian process nor can it be easily transformed into a Markovian process. This makes the likelihood evaluation and parameter estimation for the long memory stochastic volatility (LMSV) model challenging tasks. The drift and volatility parameters of the fractional Ornstein-Unlenbeck model are estimated separately using the least square estimator (lse) and quadratic generalized variations (qgv) method respectively. Finally, the empirical distribution of unobserved volatility is estimated using the particle filtering with sequential important sampling-resampling (SIR) method. The mean square error (MSE) between the estimated and empirical volatility indicates that the performance of the model towards the index prices of FTSE Bursa Malaysia KLCI is fairly well.

97 MATHEMATICS AND COMPUTING↗

Utah FORGE: 16B(78)-32 RFS DSS Strain Change Rate vs. Depth During 16A(78)-32 Stimulation

This dataset contains strain change rate versus depth data acquired using a Rayleigh frequency shift (RFS) distributed strain sensing (DSS) system during hydraulic stimulation of well 16A(78)-32 at the Utah FORGE site in April 2024. The data were collected from an optical fiber installed in the annulus of production well 16B(78)-32, approximately 300 feet from the injection well. The dataset includes tabulated strain data and an explanation of the methodology used to generate the frac log, which integrates strain change rate signals over selected time windows to identify fracture events.

15 GEOTHERMAL ENERGY↗

Structured Covariance Gaussian Networks for Orion Crew Module Aerodynamic Uncertainty Quantification

In this paper we propose a new approach for nonlinear regression and uncertainty quantification. The method is based on a pair of neural networks which parameterize mean and dense covariance functions of a multivariate Gaussian process, trained together to maximize the log-likelihood of observing the given data. The covariance matrix is made positive definite at every input by construction. We also propose a sampling approach that produces viable surrogate function realizations from the Gaussian process. We call the proposed model a Structured Covariance Gaussian Network (SCGN). We illustrate the use of SCGNs for learning an aerodynamic response surface with built-in uncertainty for the Orion crew module. We find that SCGN provides an efficient and systematic way to learn nonlinear functional relationships and dense covariances. We compare results to a baseline Gaussian process regressor and observe that the SCGN provides comparable uncertainty descriptions with improved scalability to dataset size. The sample functions generated by SCGN are fast to evaluate online and are therefore convenient for use in trajectory simulations. These results suggest that SCGN may be a viable computational method for aerodynamic uncertainty quantification.

machine learning↗

Structured Covariance Gaussian Networks for Orion Crew Module Aerodynamic Uncertainty Quantification

In this paper we propose a new approach for nonlinear regression and uncertainty quantification. The method is based on a pair of neural networks which parameterize mean and dense covariance functions of a multivariate Gaussian process, trained together to maximize the log-likelihood of observing the given data. The covariance matrix is made positive definite at every input by construction. We also propose a sampling approach that produces viable surrogate function realizations from the Gaussian process. We call the proposed model a Structured Covariance Gaussian Network (SCGN). We illustrate the use of SCGNs for learning an aerodynamic response surface with built-in uncertainty for the Orion crew module. We find that SCGN provides an efficient and systematic way to learn nonlinear functional relationships and dense covariances. We compare results to a baseline Gaussian process regressor and observe that the SCGN provides comparable uncertainty descriptions with improved scalability to dataset size. The sample functions generated by SCGN are fast to evaluate online and are therefore convenient for use in trajectory simulations. These results suggest that SCGN may be a viable computational method for aerodynamic uncertainty quantification.

machine learning↗

Utah FORGE: Drilling Data for Student Competition

Diagnostic drilling data (Pason log files) from Well 58-32 (previously labeled MU-ESW1), which was drilled near Milford Utah during Phase 2B of the FORGE Project to confirm geothermal reservoir characteristics met requirements for the final FORGE site. This dataset includes both raw, unprocessed drilling data recorded at 1Hz and a processed version downscaled to ~0.3m (1 ft) intervals. Diagnostic drilling data were collected to obtain useful information regarding the nature of the subsurface materials and performance of the drilling rig and drilling bits, including rate of penetration (ROP), weight on bit, temperature, pump pressure, etc.

15 GEOTHERMAL ENERGY↗

The message logging system for NOvA experiment

The message logging system provides the infrastructure for all of the distributed processes in the data acquisition (DAQ) to report status messages of various severities in a consistent manner to a central location, as well as providing the tools for displaying and archiving the messages. The message logging system has been developed over a decade, and has been run successfully on CDF and CMS experiments. The most recent work to the message logging system is to build it as a stand-alone package with the name MessageFacility which works for any generic framework or applications, with NO A as the first driving user. System designs and architectures, as well as the efforts of making it a generic library will be discussed. We also present new features that have been added.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

INSPIRE and SPIRES Log File Analysis

SPIRES, an aging high-energy physics publication data base, is in the process of being replaced by INSPIRE. In order to ease the transition from SPIRES to INSPIRE it is important to understand user behavior and the drivers for adoption. The goal of this project was to address some questions in regards to the presumed two-thirds of the users still using SPIRES. These questions are answered through analysis of the log files from both websites. A series of scripts were developed to collect and interpret the data contained in the log files. The common search patterns and usage comparisons are made between INSPIRE and SPIRES, and a method for detecting user frustration is presented. The analysis reveals a more even split than originally thought as well as the expected trend of user transition to INSPIRE.

99 GENERAL AND MISCELLANEOUS↗

Skylab Medical Data Center and Archives

The founding of the Skylab medical data center and archives as a central area to house medical data from space flights is described. Skylab program strip charts, various daily reports and summaries, experiment reports and logs, status report on Skylab data quality, raw data digital tapes, processed data microfilm, and other Skylab documents are housed in the data center. In addition, this memorandum describes how the data center acted as a central point for the coordination of preflight and postflight baseline data and how it served as coordinator for all data processing through computation and analysis. Also described is a catalog identifying Skylab medical experiments and all related data currently archived in the data center.

Spross, F. R.↗

Multichannel Networked Phasemeter Readout and Analysis

Netmeter software reads a data stream from up to 250 networked phasemeters, synchronizes the data, saves the reduced data to disk (after applying a low-pass filter), and provides a Web server interface for remote control. Unlike older phasemeter software that requires a special, real-time operating system, this program can run on any general-purpose computer. It needs about five percent of the CPU (central processing unit) to process 20 channels because it adds built-in data logging and network-based GUIs (graphical user interfaces) that are implemented in Scalable Vector Graphics (SVG). Netmeter runs on Linux and Windows. It displays the instantaneous displacements measured by several phasemeters at a user-selectable rate, up to 1 kHz. The program monitors the measure and reference channel frequencies. For ease of use, levels of status in Netmeter are color coded: green for normal operation, yellow for network errors, and red for optical misalignment problems. Netmeter includes user-selectable filters up to 4 k samples, and user-selectable averaging windows (after filtering). Before filtering, the program saves raw data to disk using a burst-write technique.

Edmonds, Karina↗

A semi–automatic analytical methodology for characterizing the energy consumption of MRI systems using load duration curves

Background and purpose: Magnetic resonance imaging (MRI) scanners are a major contributor to greenhouse gas emissions from the healthcare sector, and efforts to improve energy efficiency and reduce energy consumption rely on quantification of the characteristics of energy consumption. The purpose of this work was to develop a semi-automatic analytical methodology for the characterization of the energy consumption of MRI systems using only the load duration curve (LDC). LDCs are a fundamental tool used across various fields to analyze and understand the behavior of loads over time. Methods: An electric current transformer sensor and data logger were installed on two 3T MRI scanners from two vendors, termed M1 (outpatient scanner) and M2 (inpatient/emergency scanner). Data was collected for 1 month (7/11/2023 to 8/11/2023). Active power was calculated, assuming a balanced three-phase system, using the average current measured across all three phases, a 480 V reference voltage for both machines, and vendor-provided power factors. An LDC was constructed for each system by sorting the active power values in descending order and computing the cumulative time (in units of percentage) for each data point. The first derivative of the LDC was then computed (LDC’), smoothed by convolution with a window function (sLDC’), and used to detect transitions between different system modes including (in descending power levels): scan, prepared-to-scan, idle, low-power, and off. The final, segmented LDC was used to measure time (% total time), total energy (kWh), and mean power (kW) for each system mode on both scanners. The method was validated by comparing mean power values, computed using the segmented 1-month LDC, for each nonproductive system mode (i.e., prepared-to-scan, idle, lower-power, and off) against power levels measured after a deliberate system shutdown was performed for each scanner (1 day worth of data). Results: The validation revealed differences in mean power values <1.4% for all nonproductive modes and both scanners. In the scan system mode, the mean power values ranged from 29.8 to 37.2 kW and the total energy consumed for 1 month ranged from 11 106 to 14 466 kWh depending on the scanner. Over the course of 1 month, the portion of time the scanners were in nonproductive modes ranged from 76% to 80% across scanners and the nonproductive energy consumption ranged from 8010 to 6722 kWh depending on the scanner. The M1 (outpatient) scanner consumed 99.9 and 183.9 kWh/day in idle mode for weekdays and weekends, respectively, because the scanner spent 23% more time proportionally in idle mode on the weekends. Conclusions: A semi-automatic method for quantifying energy consumption characteristics of MRI scanners was introduced and validated. This method is relatively simple to implement as it requires only power data from the scanners and avoids the technical challenges associated with extracting and processing scanner log files. Finally, the methodology enables quantitative evaluation of the power, time, and energy characteristics of MRI scanners in scan and nonproductive system modes, providing baseline data and the capability of identifying potential opportunities for enhancing the energy efficiency of MRI scanners.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗