Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “factorization machine”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Using Machine Learning to Analyze Factors Determining Cycle-to-Cycle Variation in a Spark-Ignited Gasoline Engine

In this work, we have applied a machine learning (ML) technique to provide insights into the causes of cycle-to-cycle variation (CCV) in a gasoline spark-ignited (SI) engine. The analysis was performed on a set of large eddy simulation (LES) calculations of a single cylinder of a four-cylinder port-fueled SI engine. The operating condition was stoichiometric, without significant knock, at a load of 16 bar brake mean effective pressure (BMEP), at an engine speed of 2500 revolutions per minute. A total of 123 cycles was simulated. Of these, 49 were run in sequence, while 74 were run in parallel. For the parallel approach, each cycle is initialized with its own synthetic turbulent field to generate CCV, as part of another work performed by us. In the current work, we used 3D information from all 123 cycles to compute flame topology and pre-ignition flow-field metrics. We then evaluated correlations between these metrics, and peak cylinder pressure (PCP) employing an ML technique called random forest. The computed metrics form the inputs to the random forest model, and PCP is the output. This model captures the effect of all inputs, as well as interactions between them owing to its decision-tree structure. The goal of this work is to demonstrate (as a first step) that ML models can implicitly learn complex relationships between pre-ignition flow-fields, flame shapes, and the eventual outcome of the cycle (whether a cycle will be a high or a low cycle).

42 ENGINEERING↗

Report for 2.2.1 Task 5: Develop and Document a State-Based Alarm System for a Nuclear Power Plant Control Room Using Machine Learning

Idaho National Laboratory (INL) has contracted IFE to support human factors research and the development of leading-edge technology to support control room operators as the U.S. fleet undergoes modernization and digitalization in legacy plants and control rooms. As the nuclear industry starts to shift to more digital controls and systems, these upgrades provide more information to the main control room in the form of digital signals and values. Also, an increase in the number of alarms points is provided by the vendors. New digital control rooms shift from main control boards to soft controls, and alarm panels to a single display. This change to a single display has created a problem of alarm waterfall, a situation in which the addition of new alarm points causes an overload of information to the operator during either a plant disturbance or other than normal full power operations. IFE’s goal is to find a workable solution to assist operators in both handling and understanding incoming alarms during emergency situations under these waterfall conditions.

99 GENERAL AND MISCELLANEOUS↗

Machine Learning to Identify Geologic Factors Associated with Production in Geothermal Fields: A Case-Study Using 3D Geologic Data from Brady Geothermal Field and NMFk

In this paper, we present an analysis using unsupervised machine learning (ML) to identify the key geologic factors that contribute to the geothermal production in Brady geothermal field. Brady is a hydrothermal system in northwestern Nevada that supports both electricity production and direct use of hydrothermal fluids. Transmissive fuid-fow pathways are relatively rare in the subsurface, but are critical components of hydrothermal systems like Brady and many other types of fuid-fow systems in fractured rock. Here, we analyze geologic data with ML methods to unravel the local geologic controls on these pathways. The ML method, non-negative matrix factorization with k-means clustering (NMFk), is applied to a library of 14 3D geologic characteristics hypothesized to control hydrothermal circulation in the Brady geothermal field. Our results indicate that macro-scale faults and a local step-over in the fault system preferentially occur along production wells when compared to injection wells and non-productive wells. We infer that these are the key geologic characteristics that control the through-going hydrothermal transmission pathways at Brady. Our results demonstrate: (1) the specific geologic controls on the Brady hydrothermal system and (2) the efficacy of pairing ML techniques with 3D geologic characterization to enhance the understanding of subsurface processes. This submission includes the published journal article detailing this work, the published 3D geologic map of the Brady Geothermal Area used as a basis to develop structural and geological variables that are hypothesized to control or effect permeability or connectivity, 3D well data, along which geologic data were sampled for PCA analyses, and associated metadata file. This work was done using the GeoThermalCloud framework, which is part of SmartTensors (both are linked below).

15 GEOTHERMAL ENERGY↗

Machine learning to identify geologic factors associated with production in geothermal fields: A casestudy using 3D geologic data, Brady geothermal field, Nevada

In this paper, we present an analysis using unsupervised machine learning (ML) to identify the key geologic factors that contribute to the geothermal production in the Brady geothermal field. Brady is a hydrothermal system in northwestern Nevada that supports both electricity production and direct use of hydrothermal fluids. Transmissive fluid flow pathways are relatively rare in the subsurface but are critical components of hydrothermal systems like Brady and many other types of fluid flow systems in fractured rock. The ML method, non-negative matrix factorization with k-means clustering (NMFk), is applied to a library of fourteen 3D geologic characteristics hypothesized to control hydrothermal circulation in the Brady geothermal field. Our results indicate the macro-scale faults and a local step-over in the fault system preferentially occur along with production wells when compared to injection wells and non-productive wells. We infer that these are the key geologic characteristics that control the through-going hydrothermal transmission pathways at Brady. Our results demonstrate 1) the specific geologic controls on the Brady hydrothermal system and 2) the efficacy of pairing ML techniques with 3D geologic characterization to enhance the understanding of subsurface processes.

15 GEOTHERMAL ENERGY↗

Machine learning to identify geologic factors associated with production in geothermal fields: a case-study using 3D geologic data, Brady geothermal field, Nevada

Abstract In this paper, we present an analysis using unsupervised machine learning (ML) to identify the key geologic factors that contribute to the geothermal production in Brady geothermal field. Brady is a hydrothermal system in northwestern Nevada that supports both electricity production and direct use of hydrothermal fluids. Transmissive fluid-flow pathways are relatively rare in the subsurface, but are critical components of hydrothermal systems like Brady and many other types of fluid-flow systems in fractured rock. Here, we analyze geologic data with ML methods to unravel the local geologic controls on these pathways. The ML method, non-negative matrix factorization with k -means clustering (NMF k ), is applied to a library of 14 3D geologic characteristics hypothesized to control hydrothermal circulation in the Brady geothermal field. Our results indicate that macro-scale faults and a local step-over in the fault system preferentially occur along production wells when compared to injection wells and non-productive wells. We infer that these are the key geologic characteristics that control the through-going hydrothermal transmission pathways at Brady. Our results demonstrate: (1) the specific geologic controls on the Brady hydrothermal system and (2) the efficacy of pairing ML techniques with 3D geologic characterization to enhance the understanding of subsurface processes.

58 GEOSCIENCES↗

Identifying Hydrometeorological Factors Influencing Reservoir Releases Using Machine Learning Methods

Simulation of reservoir releases plays a critical role in social-economic functioning and our nation's security. How-ever, it is challenging to predict the reservoir release accurately because of many influential factors from natural environments and engineering controls such as the reservoir inflow and storage. Moreover, climate change and hydrological intensification causing the extreme precipitation and temperature make the accurate prediction of reservoir releases even more challenging. Machine learning (ML) methods have shown some successful applications in simulating reservoir releases. However, previous studies mainly used inflow and storage data as inputs and only considered their short-term influences (e.g, previous one or two days). In this work, we use long short-term memory (LSTM) networks for reservoir release prediction based on four input variables including inflow, storage, precipitation, and temperature and consider their long-term influences. We apply the LSTM model to 30 reservoirs in Upper Colorado River Basin, United States. We analyze the prediction performance using six statistical metrics. More importantly, we investigate the influence of the input hydrometeorological factors, as well as their temporal effects on reservoir release decisions. Results indicate that inflow and storage are the most influential factors but the inclusion of precipitation and temperature can further improve the prediction of release especially in low flows. Additionally, the inflow and storage have a relatively long-term effect on the release. These findings can help optimize the water resources management in the reservoirs.

Fan, Ming↗

Graph coarsening: from scientific computing to machine learning

Abstract The general method of graph coarsening or graph reduction has been a remarkably useful and ubiquitous tool in scientific computing and it is now just starting to have a similar impact in machine learning. The goal of this paper is to take a broad look into coarsening techniques that have been successfully deployed in scientific computing and see how similar principles are finding their way in more recent applications related to machine learning. In scientific computing, coarsening plays a central role in algebraic multigrid methods as well as the related class of multilevel incomplete LU factorizations. In machine learning, graph coarsening goes under various names, e.g., graph downsampling or graph reduction. Its goal in most cases is to replace some original graph by one which has fewer nodes, but whose structure and characteristics are similar to those of the original graph. As will be seen, a common strategy in these methods is to rely on spectral properties to define the coarse graph.

Chen, Jie↗

SU-E-T-52: Beam Data Comparison for 20 Linear Accelerators in One Network

Purpose: To compare photon beam data for the 20 Varian linear accelerators (TrueBeam, iX, and EX models) in use at five centers in the same network with the intent to model with one set of beam data in Eclipsec. Methods: Varian linear accelerators, TrueBeam (3), 21 EX, iX, and Trilogy (14), and 6 EX (3), installed between 1999 and 2014 have their 6 MV and 15 MV x-ray beams reevaluated. Full commissioning, including output factors (St), percent depth doses (PDD), and off-axis profiles, was recently performed for a TrueBeam with a cc04 ion chamber in an IBA Blue phantom. Similarly, a subset of beam data for each of the other accelerators was measured recently as follows: for 3×3, 10×10, and 30×30 cm{sup 2} field sizes, flatness and penumbra (80–20%) were measured at dmax and 10 cm depths, PDD were measured at 10 and 20 cm depths, and St were measured at 5 cm depth. Measurement results for all machines were compared. Results: For 15 high-energy (6 and 15 MV) and 3 low-energy machines (6MV only): 1) PDD agreed within 1.4% at 10 and 20 cm depths; 2) penumbra agreed within 1.0 mm at dmax and 10 cm depths; 3) flatness was within 1.3% at dmax and 10 cm depths; and 4) with exception of the three low energy machines, output factors were within 1.1% and 0.5% for 3×3 and 30×30 cm{sup 2}, respectively. Measurement uncertainty, not quantified here, accounts for some of these differences. Conclusion: Measured beam data from 15 high-energy Varian linacs are consistent enough that they can be classified using one beam data set in Eclipse. Two additional high-energy machines are removed from this group until their data are further confirmed. Three low-energy machines will be in a separate class based upon differences in output factors (St)

07 ISOTOPE AND RADIATION SOURCES↗

Report for 2.2.1 Task 5: Develop and Document a State-Based Alarm System for a Nuclear Power Plant Control Room Using Machine Learning. Light Water Reactor Sustainability Program report

In legacy control rooms the operators might have 20 to 30 alarms to deal with on 12 control boards, during a reactor trip. The new digital alarm system in the upgraded control room will display between 150 and 200 alarm points on a single screen. This overload of information prevents the operators from identifying any abnormal alarms quickly without having to scroll through the alarm list looking for the abnormal alarms. One way to tackle this problem could be to attempt to create a state-based alarm system which would identify plant states and would identify which alarms are expected in those states and suppress them from the alarm screen so that any unexpected alarms would be displayed and easily identified to the operators. This can be done today but is very labor intensive in that an operator or training instructor would be required to run scenarios and log the alarms to be suppressed. The hope is that Machine Learning (ML) can provide an alternative solution with less manual effort required.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

HPC formulations of optimization algorithms for tensor completion

Tensor completion is a powerful tool used to estimate or recover missing values in multi-way data. It has seen great success in domains such as product recommendation and healthcare. Tensor completion is most often accomplished via low-rank sparse tensor factorization, a computationally expensive non-convex optimization problem which has only recently been studied in the context of parallel computing. In this work, we study three optimization algorithms that have been successfully applied to tensor completion: alternating least squares (ALS), stochastic gradient descent (SGD), and coordinate descent (CCD++). We explore opportunities for parallelism on shared- and distributed-memory systems and address challenges such as memory- and operation-efficiency, load balance, cache locality, and communication. Among our advancements are a communication-efficient CCD++ algorithm, an ALS algorithm rich in level-3 BLAS routines, and an SGD algorithm which combines stratification with asynchronous communication. Furthermore, we show that introducing randomization during ALS and CCD++ can accelerate convergence. We evaluate our parallel formulations on a variety of real datasets on a modern supercomputer and demonstrate speedups through 16384 cores. Further, these improvements reduce time-to-solution from hours to seconds on real-world datasets. We show that after our optimizations, ALS is advantageous on parallel systems of small-to-moderate scale, while both ALS and CCD++ provide the lowest time-to-solution on large-scale distributed systems.

97 MATHEMATICS AND COMPUTING↗

High Value Opportunities to Advance Automation in Electric Grid Control Rooms

Grid operators and electric utilities are increasingly driven to develop automated processes and introduce decision support tools to reduce cognitive demand on System Operations staff and aid in the operational decision-making process. However, System Operation staff are traditionally hesitant to implement and accept new solutions, automation processes, and tools within the control room. This paper explores high-value opportunities to advance automation in electric grid control rooms for the purpose of improving grid safety, reliability, and resiliency during normal and emergency operating conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Machine Learning in Infectious Disease for Risk Factor Identification and Hypothesis Generation: Proof of Concept Using Invasive Candidiasis

Machine learning (ML) models can handle large data sets without assuming underlying relationships and can be useful for evaluating disease characteristics, yet they are more commonly used for predicting individual disease risk than for identifying factors at the population level. We offer a proof of concept applying random forest (RF) algorithms to Candida-positive hospital encounters in an electronic health record database of patients in the United States. Candida-positive encounters were extracted from the Cerner HealthFacts database; invasive infections were laboratory-positive sterile site Candida infections. Features included demographics, admission source, care setting, physician specialty, diagnostic and procedure codes, and medications received before the first positive Candida culture. We used RF to assess risk factors for 3 outcomes: any invasive candidiasis (IC) vs non-IC, within-species IC vs non-IC (eg, invasive C. glabrata vs noninvasive C. glabrata), and between-species IC (eg, invasive C. glabrata vs all other IC). Fourteen of 169 (8%) variables were consistently identified as important features in the ML models. When evaluating within-species IC, for example, invasive C. glabrata vs non-invasive C. glabrata, we identified known features like central venous catheters, intensive care unit stay, and gastrointestinal operations. In contrast, important variables for invasive C. glabrata vs all other IC included renal disease and medications like diabetes therapeutics, cholesterol medications, and antiarrhythmics. Known and novel risk factors for IC were identified using ML, demonstrating the hypothesis-generating utility of this approach for infectious disease conditions about which less is known, specifically at the species level or for rarer diseases.

60 APPLIED LIFE SCIENCES↗