Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data processing and logging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

GUIDE: A Scalable Information Directory Service to Collect, Federate, and Analyze Logs for Operational Insights into a Leadership HPC Facility

In this paper, we describe the GUIDE framework to collect, federate, and analyze log data from the Oak Ridge Leadership Computing Facility's (OLCF), and how we use it derive insights into center operations. We collectsystem logs and extract monitoring data at every level of the various OLCF subsystems, and have developed a suite of pre-processing tools to make the raw data consumable. The cleansed logs are then ingested and federated into a central, scalable data warehouse, Splunk, that offers storage, indexing, querying, and visualization capabilities. We have further developed and deployed a set of analytics tools to analyze these multiple disparate log streams in concert, and derive operational insights. We describe our experience from developing and deploying the GUIDE infrastructure, and deriving valuable insights on the various subsystems, based on two years of operations in the production OLCF environment.

Vazhkudai, Sudharshan↗

Sources of machine-induced background in the ATLAS and CMS detectors at the CERN Large Hadron Collider

One source of experimental background in the CERN Large Hadron Collider (LHC) is particles entering the detectors from the machine. These particles are created in cascades, caused by upstream interactions of beam protons with residual gas molecules or collimators. We estimate the losses on the collimators with SixTrack and simulate the showers with FLUKA and MARS to obtain the flux and distribution of particles entering the ATLAS and CMS detectors. We consider some machine configurations used in the first LHC run, with focus on 3.5 TeV operation as in 2011. Results from FLUKA and MARS are compared and a very good agreement is found. An analysis of logged LHC data provides, for different processes, absolute beam loss rates, which are used together with further simulations of vacuum conditions to normalize the results to rates of particles entering the detectors. We assess the relative importance of background from elastic and inelastic beam-gas interactions, and the leakage out of the LHC collimation system, and show that beam-gas interactions are the dominating source of machine-induced background for the studied machine scenarios. Our results serve as a starting point for the experiments to perform further simulations in order to estimate the resulting signals in the detectors.

Circular colliders↗

2015 IC Report: w14_biosurveillance [Slides]

Our primary use of the institutional computing clusters has been for Wikipedia-based disease surveillance and forecasting work. We've expanded breadth: the number of diseases and locations that can be surveilled using internet data. We've expanded forecasting: surprisingly little work towards forecasting disease spread with quantified uncertainty. We've expanded big data processing techniques: the Wikipedia access logs are 5TB of compressed text; we're working on efficient ways to process and store time series. Our work received significant media coverage and was highlighted as LANL's best science story of 2014.

59 BASIC BIOLOGICAL SCIENCES↗

Scientific Objectives of the Gulf of Mexico Gas Hydrate JIP Leg II Drilling

The Gulf of Mexico Methane Hydrate Joint Industry Project (JIP) has been performing research on marine gas hydrates since 2001 and is sponsored by both the JIP members and the U.S. Department of Energy. In 2005, the JIP drilled the Atwater Valley and Keathley Canyon exploration blocks in the Gulf of Mexico to acquire downhole logs and recover cores in silt- and clay-dominated sediments interpreted to contain gas hydrate based on analysis of existing 3-D seismic data prior to drilling. The new 2007-2009 phase of logging and coring, which is described in this paper, will concentrate on gas hydrate-bearing sands in the Alaminos Canyon, Green Canyon, and Walker Ridge protraction areas. Locations were selected to target higher permeability, coarser-grained lithologies (e.g., sands) that have the potential for hosting high saturations of gas hydrate and to assist the U.S. Minerals Management Service with its assessment of gas hydrate resources in the Gulf of Mexico. This paper discusses the scientific objectives for drilling during the upcoming campaign and presents the results from analyzing existing seismic and well log data as part of the site selection process. Alaminos Canyon 818 has the most complete data set of the selected blocks, with both seismic data and comprehensive downhole log data consistent with the occurrence of gas hydrate-bearing sands. Preliminary analyses suggest that the Frio sandstone just above the base of the gas hydrate stability zone may have up to 80% of the available sediment pore space occupied by gas hydrate. The proposed sites in the Green Canyon and Walker Ridge areas are also interpreted to have gas hydrate-bearing sands near the base of the gas hydrate stability zone, but the choice of specific drill sites is not yet complete. The Green Canyon site coincides with a 4-way closure within a Pleistocene sand unit in an area of strong gas flux just south of the Sigsbee Escarpment. The Walker Ridge site is characterized by a sand-prone sedimentary section that rises stratigraphically across the base of the gas hydrate stability zone and that has seismic indicators of gas hydrate. Copyright 2008, Offshore Technology Conference

03 NATURAL GAS↗

Application of the informational reference system OZhUR to the automated processing of data from satellites of the Kosmos series

The structure and potential of the information reference system OZhUR designed for the automated data processing systems of scientific space vehicles (SV) is considered. The system OZhUR ensures control of the extraction phase of processing with respect to a concrete SV and the exchange of data between phases.The practical application of the system OZhUR is exemplified in the construction of a data processing system for satellites of the Cosmos series. As a result of automating the operations of exchange and control, the volume of manual preparation of data is significantly reduced, and there is no longer any need for individual logs which fix the status of data processing. The system Ozhur is included in the automated data processing system Nauka which is realized in language PL-1 in a binary one-address system one-state (BOS OS) electronic computer.

Pokras, V. M.↗

SU-G-BRB-04: Automated Output Factor Measurements Using Continuous Data Logging for Linac Commissioning

Purpose: Linac commissioning is a time consuming and labor intensive process, the streamline of which is highly desirable. In particular, manual measurement of output factors for a variety of field sizes and energy greatly hinders the commissioning efficiency. In this study, automated measurement of output factors was demonstrated as ‘one-click’ using data logging of an electrometer. Methods: Beams to be measured were created in the recording and verifying (R&V) system and configured for continuous delivery. An electrometer with an automatic data logging feature enabled continuous data collection for all fields without human intervention. The electrometer saved data into a spreadsheet every 0.5 seconds. A Matlab program was developed to analyze the excel data to monitor and check the data quality. Results: For each photon energy, output factors were measured for five configurations, including open field and four wedges. Each configuration includes 72 fields sizes, ranging from 4×4 to 20×30 cm{sup 2}. Using automation, it took 50 minutes to complete the measurement of 72 field sizes, in contrast to 80 minutes when using the manual approach. The automation avoided the necessity of redundant Linac status checks between fields as in the manual approach. In fact, the only limiting factor in such automation is Linac overheating. The data collection beams in the R&V system are reusable, and the simplified process is less error-prone. In addition, our Matlab program extracted the output factors faithfully from data logging, and the discrepancy between the automatic and manual measurement is within ±0.3%. For two separate automated measurements 30 days apart, consistency check shows a discrepancy within ±1% for 6MV photon with a 60 degree wedge. Conclusion: Automated output factor measurements can save time by 40% when compared with conventional manual approach. This work laid ground for further improvement for the automation of Linac commissioning.

43 PARTICLE ACCELERATORS↗

Assessment of Crew Time for Maintenance and Repairs Activities for Lunar Surface Missions

NASA is currently evaluating different methods to predict how much time crewmembers will spend conducting repair and maintenance activities on future space missions. As mission scope and spacecraft architectures change, it will be necessary to understand how crew repair and maintenance timelines are impacted by mission operations and technology changes. Past work has been done using historical ISS data to accurately predict crew habitation and operation timelines, resulting in the development of NASA’s Exploration Crew Time Model (ECTM). However, understanding crew maintenance and repair requirements has posed a unique challenge due to the complexity of available datasets, the probabilistic nature of sub-system failures, and the impacts of reliability growth on failure rates. This paper presents a methodology to collect and condition empirical repair and maintenance time data from available data sets, to extrapolate from that data to estimate projected maintenance and repair times for a lunar Surface Habitat, and to assess how uncertainty in repair time could impact utilization time on the lunar surface. NASA International Space Station (ISS) maintenance and crew time data are logged into two central databases, the Maintenance Data Collection (MDC) and the Operations Planning Timeline Integration System (OPTimIS) respectively. Separately, each of these two datasets capture only portions of the complete set of data required to generate an accurate assessment of crew time spent on maintenance activities at a sub-system level. MDC provides a detailed catalog of failure events and an overview of the failure’s required maintenance and OPTimIS provides a description of crew activities and crew time durations dedicated to maintenance. To create a more useful crew time estimate for maintenance timelines, the authors developed a methodology to capture relevant data from each set and combine and utilize that data by linking crew time requirements to specific components. The authors compare the failure logs in the MDC to crew activity logs pulled from OPTimIS and then process the data to estimate required repair times for each failure event. Data is also classified by the outcome of each repair event, whether the failed component was replaced or whether it was repaired in place. The entire maintenance activity dataset is then categorized based on the class of failed component to allow for a statistically significant sample size for each class and to provide accurate crew time estimates for any components lacking relevant data. This resultant component repair time data can be used in the future to generate Mean Time To Repair (MTTR) estimates and confidence intervals for each class of component based on a probabilistic distribution of documented maintenance events. These improved MTTR values can then be applied to candidate element sub-system architectures, along with component Mean Time Between Failure (MTBF) data to generate distributions for potential required system crew repair time estimates for a given mission. Repair time distributions can then be used to develop more accurate crew schedules and to assess potential available utilization time.

Crew Time↗

Assessment of Crew Time for Maintenance and Repair Activities for Lunar Surface Missions

NASA is currently evaluating different methods to predict how much time crewmembers will spend conducting repair and maintenance activities on future space missions. As mission scope and spacecraft architectures change, understanding how crew repair and maintenance timelines are impacted by mission operations and technology changes is vital for future mission planning. Past work has been done using historical International Space Station (ISS) data to accurately predict crew habitation and operation timelines, resulting in the development of NASA’s Exploration Crew Time Model (ECTM). However, understanding crew maintenance and repair requirements has posed a unique challenge due to the complexity of available datasets, the probabilistic nature of sub-system failures, and the impacts of reliability growth on failure rates. This paper presents a methodology to collect and condition empirical repair and maintenance time data from available datasets, to extrapolate from that data to estimate projected maintenance and repair times for a lunar Surface Habitat (SH), and to assess how uncertainty in repair time could impact utilization time on the lunar surface. NASA ISS maintenance and crew time data are logged into two central databases: the Maintenance Data Collection (MDC) and the Operations Planning Timeline Integration System (OPTimIS). Separately, each of these two datasets capture only portions of the complete set of data required to generate an accurate assessment of crew time spent on maintenance activities at a sub-system level. To create a more useful crew time estimate for maintenance timelines, the authors developed a methodology to capture relevant data from each set and combine and utilize that data by linking crew time requirements to specific components. The authors compare the failure logs in the MDC to crew activity logs pulled from OPTimIS and then process the data to estimate required repair time for each failure and repair event. The entire maintenance activity dataset is then categorized based on the class of failed component to ensure a significant sample size for each class and accurate crew time estimates for any components lacking relevant data. This resultant component repair time data can be used in the future to generate Mean Time to Repair (MTTR) estimates and confidence intervals for each class of component based on a probabilistic distribution of documented maintenance events. These improved MTTR values can then be applied to candidate element sub-system architectures, along with component Mean Time Between Failure (MTBF) data to generate distributions for potential required system crew repair time estimates for a given mission. The authors applied these modeling methods to a case study of a crewed mission to the planned SH and produced expected corrective maintenance crew time distributions. The results produced an expected corrective maintenance crew time at over 24 hours per mission, and a maintenance crew time distribution that reflects the importance of planning for sufficient maintenance requirements each mission. Repair time distributions can then be used to develop more accurate crew schedules and to assess potential available utilization time.

Crew Time↗

An experimental search for near-wall boundary conditions for large eddy simulation

Instantaneous wall shear stress and streamwise velocities have been measured simultaneously in a flat plate, turbulent boundary layer at moderate Reynolds number in an effort to provide experimental support for large eddy simulations. Data were obtained by using a buried-wire wall shear gage and a hot-wire rake positioned in the log region of the flow. All data processing was accomplished with digital data analysis techniques on a minicomputer. Fluctuations of the instantaneous U plus versus Y plus profiles about a mean law of the wall are shown to be significant and complex. Peak cross-correlation values between wall shear stress and the velocities are high and reflect the passage of a large structure inclined at a small angle to the wall. Estimates of this angle are consistent with those made by other investigators. Conditional sampling techniques were used to detect the passage of various sizes and types of flow disturbances (events) and to estimate their mean frequency of occurrence. Events characterized by large and sudden streamwise accelerations were found to be highly coherent throughout the log region and were strongly correlated with large fluctuations in wall shear-stress. Phase randomness between the near-wall quantities and the outer velocities was small. The results suggest that the flow events detected by conditional sampling applied to velocities in the log region may be related to the bursting process.

Robinson, S. K.↗

SU-E-T-144: Effective Analysis of VMAT QA Generated Trajectory Log Files for Medical Accelerator Predictive Maintenance

Purpose: To determine the effectiveness of SPC analysis for a model predictive maintenance process that uses accelerator generated parameter and performance data contained in trajectory log files. Methods: Each trajectory file is decoded and a total of 131 axes positions are recorded (collimator jaw position, gantry angle, each MLC, etc.). This raw data is processed and either axis positions are extracted at critical points during the delivery or positional change over time is used to determine axis velocity. The focus of our analysis is the accuracy, reproducibility and fidelity of each axis. A reference positional trace of the gantry and each MLC is used as a motion baseline for cross correlation (CC) analysis. A total of 494 parameters (482 MLC related) were analyzed using Individual and Moving Range (I/MR) charts. The chart limits were calculated using a hybrid technique that included the use of the standard 3σ limits and parameter/system specifications. Synthetic errors/changes were introduced to determine the initial effectiveness of I/MR charts in detecting relevant changes in operating parameters. The magnitude of the synthetic errors/changes was based on: TG-142 and published analysis of VMAT delivery accuracy. Results: All errors introduced were detected. Synthetic positional errors of 2mm for collimator jaw and MLC carriage exceeded the chart limits. Gantry speed and each MLC speed are analyzed at two different points in the delivery. Simulated Gantry speed error (0.2 deg/sec) and MLC speed error (0.1 cm/sec) exceeded the speed chart limits. Gantry position error of 0.2 deg was detected by the CC maximum value charts. The MLC position error of 0.1 cm was detected by the CC maximum value location charts for every MLC. Conclusion: SPC I/MR evaluation of trajectory log file parameters may be effective in providing an early warning of performance degradation or component failure for medical accelerator systems.

61 RADIATION PROTECTION AND DOSIMETRY↗

Utah FORGE: Well 16B(78)-32 Drilling Data

This drilling data for Utah FORGE well 16B(78)-32 include a well survey, core summary, mud and mud temperature logs, daily reports of the drilling process, and additional data from the Pason oil and gas company. Well 16B(78)-32 serves as the production well for reservoir creation, fluid circulation, and demonstration of heat extraction for the FORGE project. It has been drilled as a doublet approximately 300 feet parallel to and above the injection well 16A(78)-32. The proposed total depth was 10,658 feet, which was exceeded. Spudding began on April 26th, 2023. As of June 20th, 2023, the total depth measured 10,947 feet and the vertical depth measured 8,357 feet. Drilling included the trial use of insulated drill pipe (IDP) from Eavor Technologies, which was considered a success. IDP restricts counter-current heat transfer between drilling fluid inside the drill string and hotter returning fluid in the annulus, thereby ensuring the bottomhole assembly (BHA) remains submerged in cool fluid. Eavor rented 350 joints of IDP to FORGE which were run in two consecutive BHAs at the well. The results of this trial are included here.

15 GEOTHERMAL ENERGY↗

Windows Logging Service 3.0.058

WLS gathers all known relevant contextual data along with standard event log information, processes it into an easily consumable format for analysis by 3rd party tools, and forwards the logs to any compatible log server.

McCord, Jason↗

Towards a Comparative Assessment of Data-Driven Process Models in Health Information Technology

Process mining for conformance analysis focuses on comparing a reference process model against a data-driven process model that is generated via log files from information technology systems. While this approach is helpful when there is an existing process model in an organization, it leaves the question of what to do in the absence of a complete reference process model unanswered. In this paper, we present a comparative assessment approach that combines process mining, process mapping for dimensionality reduction, and statistical analysis. Our goal is to find similarities and dissimilarities in data-driven process models among U.S. Veterans Health Administration (VHA) facilities to assess process conformance among different healthcare facilities, which can help assess the standardization of care. We illustrate our approach by applying it to two clinical radiology order process models generated by two similar facilities. Our results demonstrate statistical similarities in the standardization of care among those two facilities.

Klasky, Hilda↗

A comparison of techniques for extracting emissivity information from thermal infrared data for geologic studies

This article evaluates three techniques developed to extract emissivity information from multispectral thermal infrared data. The techniques are the assumed Channel 6 emittance model, thermal log residuals, and alpha residuals. These techniques were applied to calibrated, atmospherically corrected thermal infrared multispectral scanner (TIMS) data acquired over Cuprite, Nevada in September 1990. Results indicate that the two new techniques (thermal log residuals and alpha residuals) provide two distinct advantages over the assumed Channel 6 emittance model. First, they permit emissivity information to be derived from all six TIMS channels. The assumed Channel 6 emittance model only permits emissivity values to be derived from five of the six TIMS channels. Second, both techniques are less susceptible to noise than the assumed Channel 6 emittance model. The disadvantage of both techniques is that laboratory data must be converted to thermal log residuals or alpha residuals to facilitate comparison with similarly processed image data. An additional advantage of the alpha residual technique is that the processed data are scene-independent unlike those obtained with the other techniques.

Hook, Simon J.↗

Utah FORGE: Phase 2C Seismic Observation and Ground Water Well Data and Well Locations

This submission contains the following data associated with Utah FORGE Phase 2C within the Roosevelt Hot Springs geothermal area: - An ArcGIS shapefile with well locations for wells 58-32, 78-32, 68-32, OH-3, OH-4, WOW-2, and WOW-3. Well 58-32 is the deep test well, wells 68-32 and 78-32 are seismic test wells, and the OH and WOW wells were used for ground water monitoring and temperature gradient logging. - Drilling reports, lithologic logs, daily drilling reports, cuttings logs, and drilling photos for seismic monitoring wells 78-32 and 68-32. - Raw and post-processing temperature logs for wells OH-3, OH-4, WOW-2, and WOW-4. The archive also includes a README.txt file, which contains an explanation of the data and how it was acquired, and a text file with coordinates for the logged wells.

15 GEOTHERMAL ENERGY↗

NREL Fleet Analysis Support Through Technology Integration Collaboration

This study leveraged the partnership between the United States Department of Energy's (DOE) Clean Cities Coalition Network and the Association for the Work Truck Industry (NTEA) to launch a vehicle and fleet analysis project that assisted fleets in identifying opportunities to save energy, improve efficiency, reduce costs, and meet environmental goals via short term data logging and analysis. The National Renewable Energy Laboratory (NREL) sought to establish a process that included initial data acquisition, provided data storage, and developed analytic methods to inform fleets of areas of opportunity based on approximately 30 days of in use vehicle performance data. However, long-term the project will require ongoing funding to fully develop and maintain the data sharing platform and to produce more complex analysis.

33 ADVANCED PROPULSION SYSTEMS↗

SHαDE: survey description and mass–kinematics scaling relations for dwarf galaxies

ABSTRACT The Study of H α from Dwarf Emissions (SHαDE) is a high spectral resolution (R = 13 500) H α integral field survey of 69 dwarf galaxies with stellar masses 106 < M⋆ < 109 M⊙. The survey used FLAMES on the ESO Very Large Telescope. SHαDE is designed to study the kinematics and stellar populations of dwarf galaxies using consistent methods applied to massive galaxies and at matching level of detail, connecting these mass ranges in an unbiased way. In this paper, we set out the science goals of SHαDE, describe the sample properties, outline the data reduction, and analysis processes. We investigate the log M⋆–log S0.5 mass–kinematics scaling relation, which has previously shown potential for combining galaxies of all morphologies in a single scaling relation. We extend the scaling relation from massive galaxies to dwarf galaxies, demonstrating this relation is linear down to a stellar mass of M⋆ ∼ 108.6 M⊙. Below this limit, the kinematics of galaxies inside one effective radius appears to be dominated by the internal velocity dispersion limit of the H α-emitting gas, giving a bend in the log M⋆–log S0.5 relation. Replacing stellar mass with total baryonic mass using gas mass estimate reduces the severity but does not remove the linearity limit of the scaling relation. An extrapolation to estimate the galaxies’ dark matter halo masses, yields a log Mh–log S0.5 scaling relation that is free of any bend, has reduced curvature over the whole mass range, and brings galaxies of all masses and morphologies on to the virial relation.

Barat, Dilyar↗