Splunk Analytics for Real-Time Systems Monitoring in HPC: LANL’s HPC Division’s Production Splunk Use Cases
Explore the source record for details and available documents.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
The overall goal is to improve the performance and economics of existing coal fired power plants by extending low load boiler operation to lower loads than is currently achievable. The objective of this program is to develop and validate sensor hardware and analytical algorithms to lower plant operating expenses (OPEX) for the currently operating pulverized coal utility boiler fleet. Coal fired utility boilers are increasingly under grid dispatch pressure. In some cases, the coal fired cost of generation is noncompetitive with respect to natural gas generation and subsidized renewable sources. To remain profitable and remain fully compliant with existing environmental regulations, the installed coal fired fleet must find technologies which allow it to move into a more flexible cyclic load dispatch model. Today the installed coal fired utility fleet must be cost of generation competitive, fully emissions compliant, and responsive to the variability inherent in renewable energy generation sources. In the Phase I of the project, GE Steam Power, Inc. (GE) performed modeling of different operating scenarios for low load operation using an existing full plant dynamic model developed for a 660MW steam power plant. Sensors and analytic algorithms to enable a stable and steady coal supply for low load pulverizer operation were identified and tested at the Pulverizer Development Facility (PDF) at GE’s Clean Energy Center in Bloomfield, Connecticut. Sensors and analytic algorithms to enable stable combustion for low load operation were identified and tested at the 15 MWth Industrial Scale Burner facility (ISBF) at GE’s Clean Energy Center. A concept was developed to test the sensors and control algorithms, down selected after testing, at a full-scale coal fired power plant. A budget estimate was then developed, and the concept was implemented at an existing utility power plant. The specific objectives of the experimental work were to: • Identify and select sensors and analytic algorithms for monitoring coal pulverizer operation at lower loads to provide stable operation and appropriate coal fineness at lower coal throughput; Identify and select sensors and analytic algorithms for a Boiler Flame Stability Monitor to better balance air and fuel at each burner. This enables a reduction in a coal boiler’s safe low load power level while maintaining stable flame characteristics; Develop a concept in Phase I for low load operation of a full-scale power plant and develop a budget estimate for testing and execute the test plan at an existing plant in Phase II; Validate the capability of the extended low load boiler system to extend the minimum load operating point in a safe and reliable manner on an existing full-scale utility boiler. At the completion of this experimental study, GE has developed a set of sensors and analytic algorithms, down selected after testing, that have the potential to enable safe low load operation of a utility boiler. GE has also identified a host site for testing these identified sensors and analytic algorithms. GE has generated a full set of deliverables that provide sufficient information to proceed with the next step of testing at a host site. This includes a potential host site and budget estimate for concept testing at host site. In the Phase II of the project, a series of field tests were completed to validate the extended low load boiler operation, which consisted of detailed engineering, installation, commissioning, and testing the additional sensors and analytics for the coal-fired combustion system on an existing full-scale utility boiler. The optimization work has been supported by the host plant and endorsed by their engineering and operation staff.
The Complexity-entropy causality plane (CECP) is a parsimonious representation space for time series. It has only two dimensions: normalized permutation entropy and Jensen-Shannon complexity of a time series. This two-dimensional representation allows for detection of slow or rapid drifts in the condition of mechanical components monitored through sensor measurements. The CECP representation can be used for both predictive analytics and visual monitoring of changes in component condition. This method requires minimal pre-processing of raw signals. Furthermore, it is insensitive to noise, stationarity, and trends. These desirable properties make CECP a good candidate for machine condition monitoring and fault diagnostics. In this work we study the effectiveness of CECP on three rotary component condition assessment applications. We use CECP representation of vibration signals to differentiate various machine component health conditions for rotary machine components, namely roller bearing and gears. The results confirm that the CECP representation is able to detect, with high accuracy, changes in underlying dynamics of machine component degradation states. From class separability perspective, the CECP representation is able to generate linearly separable classes for the classification of different fault states. This classification performance improves with increasing signal length. For signal length of 16,384 data points, the fault classification accuracy varies from 90% to 100% for bearing applications, and from 85% to 100% for gear applications. We observed that the optimum parameter for CECP representating depends on the application. For bearing applications we found that embedding dimension D = 4, 5, 6, and embedding delay τ = 1, 2, 3 are suitable for good fault classification. For gear applications we find that embedding dimension D = 4, 5, and embedding delay τ = 1, 5 are suitable for fault classification.
The purpose of environmental monitoring is to promote the early identification of, and response to, potential adverse environmental impacts associated with Lawrence Livermore National Laboratory (LLNL) operations. Environmental monitoring supports the Integrated Safety Management System (ISMS), International Organization for Standardization (ISO) 14001 Environmental Management Systems standard, and U. S. Department of Energy (DOE) Order 458.1, Radiation Protection of the Public and the Environment. Specifically, environmental monitoring enables LLNL to detect, characterize, and respond to releases from LLNL activities; assess impacts; estimate dispersal patterns in the environment; characterize the pathways of exposure to members of the public; characterize the exposures and doses to individuals and to the population; and to evaluate the potential impacts to the biota in the vicinity of LLNL. Environmental monitoring is also a major component of compliance demonstration for permits and other regulatory requirements. The Environmental Monitoring Plan (EMP) addresses the sample collection and analytical work supporting environmental monitoring to ensure the following: (1) A consistent system for collecting, assessing, and documenting environmental data of known and documented quality; (2) A validated and consistent approach for sampling and analysis of samples to ensure laboratory data meets program-specific needs and requirements within the framework of a performance-based approach for analytical laboratory work; and (3) An integrated sampling approach to avoid duplicative data collection. LLNL prepares the EMP because it provides an organizational framework for ensuring that environmental monitoring work, which is integral to the implementation of LLNL's Environmental Management System, is conducted appropriately. Furthermore, the Environmental Monitoring Plan helps LLNL ensure compliance with DOE Order 231.1 Change 2, Environment, Safety and Health Reporting, which require the publication of an annual report that characterizes the site's environmental management performance. To summarize, the general regulatory drivers for this environmental monitoring plan are ISO 14001, DOE Order 458.1, and DOE Order 231.1. The environmental monitoring addressed by this plan includes preoperational characterization and assessment, effluent and surveillance monitoring, and permit and regulatory compliance monitoring. Additional environmental monitoring is conducted at LLNL as part of compliance with the Comprehensive Environmental Response, Compensation, and Liability Act (CERCLA, also known as Superfund). LLNL coordinates its ground water surveillance monitoring program with the CERCLA monitoring program to gain sampling efficiencies.
The purpose of environmental monitoring is to promote the early identification of, and response to, potential adverse environmental impacts associated with Lawrence Livermore National Laboratory (LLNL) operations. Environmental monitoring supports the Integrated Safety Management System (ISMS), International Organization for Standardization (ISO) 14001 Environmental Management Systems standard, and U. S. Department of Energy (DOE) Order 450.1A, Environmental Protection Program. Specifically, in conformance with DOE Order 450.1A, Attachment 1, paragraph 1(b)(5), environmental monitoring enables LLNL to detect, characterize, and respond to releases from LLNL activities; assess impacts; estimate dispersal patterns in the environment; characterize the pathways of exposure to members of the public; characterize the exposures and doses to individuals and to the population; and to evaluate the potential impacts to the biota in the vicinity of LLNL. Environmental monitoring also serves to demonstrate compliance with permits and other regulatory requirements. The Environmental Monitoring Plan (EMP) addresses the sample collection and analytical work supporting environmental monitoring to ensure the following: (1) A consistent system for collecting, assessing, and documenting environmental data of known and documented quality. (2) A validated and consistent approach for sampling and analysis of samples to ensure laboratory data meets program-specific needs and requirements within the framework of a performance-based approach for analytical laboratory work. (3) An integrated sampling approach to avoid duplicative data collection. Until its cancellation in January 2003, DOE Order 5400.1 required the preparation of an environmental monitoring plan. Neither DOE Order 450.1A nor the ISO 14001 standard are as prescriptive as DOE Order 5400.1, in that neither expressly requires an EMP. However, LLNL continues to prepare the EMP because it provides an organizational framework for ensuring that this work, which is integral to the implementation of LLNL's Environmental Management System, is conducted appropriately. Furthermore, the Environmental Monitoring Plan helps LLNL ensure compliance with DOE Order 5400.5, Radiation Protection of the Public and the Environment, and DOE Order 231.1 Change 2, Environment, Safety and Health Reporting, which require the publication of an annual report that characterizes the site's environmental management performance. To summarize, the general regulatory drivers for this environmental monitoring plan are ISO 14001, DOE Order 450.1A, DOE Order 5400.5, and DOE Order 231.1. The environmental monitoring addressed by this plan includes preoperational characterization and assessment, effluent and surveillance monitoring, and permit and regulatory compliance monitoring. Additional environmental monitoring is conducted at LLNL as part of compliance with the Comprehensive Environmental Response, Compensation, and Liability Act (CERCLA, also known as Superfund). LLNL coordinates its ground water surveillance monitoring program with the CERCLA monitoring program to gain sampling efficiencies. (See LLNL [1992] and LLNL [2008] for information about LLNL's CERCLA activities).
A significant portion of the carbon sequestration research being performed in the United States involves the risk assessment of injecting large quantities of carbon dioxide into deep saline aquifers. Leakage of CO 2 has the potential to affect the quality of groundwater supplies in case contaminants migrate through underlying conduits. New remote sensing and near-surface monitoring technologies are needed to ensure that injection, abandoned, and monitoring wells are structurally sound, and that CO 2 remains within the geologic storage reservoir. In this paper, we propose underwater laser-induced breakdown spectroscopy (underwater LIBS) as an analytical method for monitoring naturally occurring elements that can act as tracers to detect a CO 2 leak from storage sites. Laboratory-scale experiments were conducted to measure Sr 2+ , Ca 2+ , K + , and Li + in bulk solutions to ascertain the analytical performance of underwater LIBS. We compared the effect of NaCl, Na 2 CO 3 , and Na 2 SO 4 on the analytes calibration curves to determine underwater LIBS’ ability to analyze samples of sodium compounds. In all cases, the calibration curves showed a good linearity within 2 orders of magnitude. The limit of detections (LODs) obtained for K + (30±1 ppb) and Li + (60±2 ppb) were in ppb range, while higher LODs were observed for Ca 2+ (0.94±0.14 ppm) and Sr 2+ (2.89±0.11 ppm). Evaluation of the calibration curves for the analytes in mixed solutions showed dependence of the lines’ intensity with the sodium compounds. The intensities increased respectively in the presence of dissolved NaCl and Na 2 SO 4 , whereas the intensities slightly decreased in the presence of Na 2 CO 3 . Lastly, the capabilities of underwater LIBS to detect certain elements in the ppb or in the low ppm range make it particularly appealing for in situ monitoring of a CO 2 leak.
Efficient and accurate wake models are required for wind plant performance modeling and the suite of engineering processes that support wind plant layout, control, and monitoring. Although many analytical and engineering wake models with low computational costs have been proposed, their ability to represent the power production of large wind plants in a wide range of atmospheric conditions is not completely understood. The following validation study reviews the underlying theory for analytical wake models, outlines quality control procedures for observational data, and compares model results with observational data from the Lillgrund Wind Plant. Lillgrund makes a valuable case study for wake modeling because of its regular arrangement and the relatively close spacing of constituent wind turbines, which lead to regular and significant wake interactions within the wind plant and the development of deep array flow conditions. Formulations for the velocity deficit, wake-added turbulence, and wake superposition methods are considered in a modular sense, yielding many possible configurations to represent wind turbine wakes, of which seven are examined in detail. Velocity deficit models that account for flow conditions in the near wake are better able to reproduce power production for wind turbines in the transitional region of the wind plant, where wind turbines experience as many as five wakes from upstream turbines. Finally, in the deep array, where power production reaches asymptotic values and wake statistics become quasi-periodic, wake superposition schemes become the largest driver in error reduction; using the linear or maximum wake superposition methods can reduce the relative root mean square error by as much as 40% in the deep array.
The goal of the Exascale Data Management Workflows project is to create tools to support techniques for in-situ data analysis and data management. Online data management co-running with simulations accelerates the scientific processes being carried out, provides rapid and timely scientific insights, and can help avoid unnecessary and scientifically invalid simulation computations, particularly when combined with or able to utilize data from experimental instrument and/or from past simulation runs. The University of Oregon team is contributing to the performance instrumentation and analysis aspect of this project. Our focus has been on efficient performance monitoring of data management at scale. The general approach of the MONA project is depicted in Figure 1 below. The figure shows performance monitoring applied to an I/O workflow associated with a scientific simulation, with online measurements captured from this workflow informing methods for workflow reconfiguration and dynamic adjustment. The goal is to maintain suitable levels of Quality of Service for workflow execution, by understanding the under lying causes of workflow performance and behavior. One outcome is workflow performance models able to characterize realistic workflows. Another outcome is performance ’mini-apps’ implementing such workflow behavior. Out of scope for this project are advanced methods for online workflow control.
The contemporary electrical grid is characterized by its complexity and abundance of data. A control-rich environment supported by information and communication technologies within an Advanced Distribution Management System (ADMS) presents a viable and cost-effective option for utility companies aiming to implement advanced real-time analytical schemes for monitoring and remotely controlling distribution feeders. Modular platform-based approaches to distribution operations require a structured framework for acquiring field device measurements, performing analytics, converting the setpoint to the correct protocol, and sending it on the appropriate communications network to the field devices. We present the development and deployment of an application service to integrate an open-source standardsbased platform with an ADMS test bed with field devices using the Distributed Network Protocol (DNP3) for data exchange. The step-by-step procedure for establishing the DNP3-Master service on an open-source distribution platform is outlined, comprehensively explaining the Master setup process. Moreover, sample use case results highlight the capabilities of the DNP3- Master service setup. Results demonstrate the scalability and configurability of the DNP3-Master service, making it adaptable for integration with other relevant applications, thus providing potential opportunities for real-world field trials and real-time assessments.
Powerpoint presentation for project update.
SRNL Analytical Development and R&D Engineering have developed an On-Line Monitoring Spectrophotometer to provide measurements of uranium and nitric acid at several locations in H Canyon Second Uranium Cycle. Instruments are installed at Tanks 15.4, 16.8, 17.4, 17.5, and 18.7. Two-sigma uncertainties for the instruments are 5.3% uranium (all tanks) and 11% nitric acid (Tanks 16.8 and 17.5). The spectrophotometers are of similar design to those recently installed in HB-Line for Pu monitoring, although some changes have been made to make them more suitable for uranium measurements. A full description of design, components, and operating procedures is given.
The objective of this project is to develop a robust event diagnostics (RED) platform by integrating state-of-the-art tensor analytics and machine learning into real-time grid monitoring. The proposed platform can effectively analyze and discover the information hiding within the provided PMU data for effective real-time grid monitoring. The proposed RED platform provides a set of robust diagnostics tools for grid operation and management, including 1) data quality assessment, 2) data completion, 3) event detection, and 4) robust event classification. All the functionalities of the RED platform can help the operator to make informed decisions and respond in a timely manner. The developed RED platform will serve as an innovative advisory tool to reliably identify key events and discover new insights about the events and grid characteristics in the PMU data, and contribute to the efficient, safe, reliable operation and design of the nation’s electric system.
Capital-intensive turbomachinery, such as gas turbines and combined cycle plants, are constantly being monitored for performance anomalies, faults, and physical degradation. Although these power-generating assets are equipped with hundreds of sensors, existing monitoring tools can only handle moderate-sized data. As a result, only a handful of aggregate metrics are used to monitor machine health. At the same time, developing advanced tools suitable for large datasets have been restricted by the lack of appropriate data. The objective of this proposal was to demonstrate a Big Data analytics framework for fault detection and diagnosis in gas turbine applications. We develop a predictive analytics framework methodology guided by these experimental data, industrial data from our collaborators, and physics-based models with engineering domain knowledge. Our analytics framework consists of four key components (1) a data curation process that addresses data storage, data quality assessments, and integrity checks, (2) a feature engineering component that utilizes statistical methods and transformation algorithms guided by physics-based models to extract high-fidelity fault features that can be leveraged for fault detection and classifying fault severities, (3) a Machine Learning-based fault detection and diagnostics algorithms for detecting operational and hardware faults in the combustion and the turbines section. We utilize two industry-class gas turbine component test rigs to generate first of its kind data for critical gas turbine faults with varying severity levels. Advanced gas turbine test facilities will be interrogated using state-of-the-art instrumentation techniques to build fault signatures and data trends for key combustor and turbine faults. Data generated from a combustor test rig (Georgia Tech) and a turbine test rig (Penn State) during both normal operation and with seeded faults serve as the basis for the Big Data sets. The test conditions in the two test facilities include common, critical events that occur in the operation. Utilizing the combustor test rig, we examine two common combustor faults: lean blowout and centerbody degradation. For the turbine section we develop analytic models for monitoring cooling faults in the gas turbine
Capital-intensive turbomachinery, such as gas turbines and combined cycle plants, are constantly being monitored for performance anomalies, faults, and physical degradation. Although these power-generating assets are equipped with hundreds of sensors, existing monitoring tools can only handle moderate-sized data. As a result, only a handful of aggregate metrics are used to monitor machine health. At the same time, developing advanced tools suitable for large datasets have been restricted by the lack of appropriate data. The objective of this proposal was to demonstrate a Big Data analytics framework for fault detection and diagnosis in gas turbine applications. We develop a predictive analytics framework methodology guided by these experimental data, industrial data from our collaborators, and physics-based models with engineering domain knowledge. Our analytics framework consists of four key components: (1) a data curation process that addresses data storage, data quality assessments, and integrity checks, (2) a feature engineering component that utilizes statistical methods and transformation algorithms guided by physics-based models to extract high-fidelity fault features that can be leveraged for fault detection and classifying fault severities, (3) a Machine Learning-based fault detection and diagnostics algorithms for detecting operational and hardware faults in the combustion and the turbines section. We utilize two industry-class gas turbine component test rigs to generate first of its kind data for critical gas turbine faults with varying severity levels. Advanced gas turbine test facilities will be interrogated using state-of-the-art instrumentation techniques to build fault signatures and data trends for key combustor and turbine faults. Data generated from a combustor test rig (Georgia Tech) and a turbine test rig (Penn State) during both normal operation and with seeded faults serve as the basis for the Big Data sets. The test conditions in the two test facilities include common, critical events that occur in the operation. Utilizing the combustor test rig, we examine two common combustor faults: lean blowout and centerbody degradation. For the turbine section we develop analytic models for monitoring cooling faults in the gas turbine.
Photoelectron spectroscopy has long been a powerful method in the toolbox of experimental physical chemistry and molecular physics. Recent improvements in coincidence methods, charged-particle imaging, and electron energy resolution have greatly expanded the variety of environments in which photoelectron spectroscopy can be applied, as well as the range of questions that can now be addressed. In this Perspectives Article, we focus on selected recent studies that highlight these advances and research areas. Furthermore, the topics include reactive intermediates and new thermochemical data, high-resolution comparisons of experiment and theory using methods based on pulsed-field ionisation (PFI), and the application of photoelectron spectroscopy as an analytical tool to monitor chemical reactions in complex environments, like model flames, catalytic or high-temperature reactors.
A fast and reliable analytical technique for monitoring the levels of the Next Generation Solvent (NGS) solvent suppressor, N,N’,N”-tris(3,7-dimethyloctyl)guanidine (TiDG), is required due to the susceptibility of this guanidine to degradation arising from the thermal and chemical conditions encountered in the Next Generation Caustic-Side Solvent Extraction (NG-CSSX) process currently in use at the Savannah River Site. This report documents the development of a GC-FID-based (Gas Chromatography–Flame Ionization Detection) technique for analyzing and quantifying TiDG and its primary degradation product, di-isodecylurea (di-iDU), as a means of near real-time surveillance of the NGS solvent. Upon experimental certification, the technique was subsequently utilized to measure the degradation of this suppressor component of the NGS solvent following a storage period of 19 months at both 25 °C and 35 °C. As currently described, this simple technique can be used to monitor the amounts of both TiDG and di-iDU in NGS solvent in less than 15 minutes time, thus offering near real-time guidance as to the levels of suppressor and its primary degradation product. This analytical information is essential for calculating the quantity of TiDG that must be routinely added to the solvent under conditions of continual suppressor degradation, in order to maintain stripping performance.
Explore the source record for details and available documents.
In thin film technology, analytical methods for monitoring the deposition of oxide and nitride coatings and the effects of corrosive, laser and ion-beam treatments have attracted considerable attention. For depth-profiling the concentrations of light isotopes, resonant nuclear reaction analysis is an excellent non-destructive ion-beam analytical tool. We report here on precision measurements of the 278 keV {sup 14}N(p,{gamma}) and the 151 keV {sup 18}O(p,{alpha}) resonances using the high-resolution proton beam of the Goettingen IONAS accelerator. The deduced resonance energies E{sub R} and total widths {gamma}(in the laboratory system) are E{sub R} = 277.60(27) keV and {gamma} = 1115(33) eV for the {sup 14}N(p,{gamma}) resonance, and E{sub R} = 150.97(26) keV and {gamma} = 178(35) eV for the {sup 18}O(p,{alpha}) resonance. These values are significantly more precise than the ones quoted in the literature.