Defense of Supervised and Unsupervised Machine Learning Models
Explore the source record for details and available documents.
adversarial defense, tensor factorizations, tensor↗
SEARCH · Engineering Papers
Results for “factorization machine”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Artificial Intelligence/Machine Learning Technology in Power System Applications
The primary purpose of this report is to provide an overview of the advancement in artificial intelligence and machine learning (AI/ML) technologies and their applications in power systems. It offers a foundation for understanding the transformative role of AI/ML in power systems and aims to stimulate further research and development in this area. This report begins with a historical perspective of AI/ML technologies, then explores their advancement to today’s prominence. The document highlights key contributors to the success of AI/ML technologies, including increased computational power, greater data availability, innovative algorithms, and advanced tools. It further introduces various AI/ML techniques, including supervised, unsupervised and reinforcement learning, graph neural networks, and generative AI. It also emphasizes the critical importance of ensuring the safety, security, and trustworthiness of these AI/ML techniques within this sector. The report reviews the recent representative advancements in various power system applications enhanced by AI/ML techniques, underscoring key developments and their transformative impact as evidenced by numerous studies. It also explores both the opportunities and challenges associated with the application of AI/ML technologies to improve power system applications. While the report extensively covers AI/ML applications in power systems, focusing primarily on the technical and operational aspects, it may not thoroughly explore the sociopolitical, economic, and broader regulatory implications of AI/ML integration in power systems. AI/ML techniques hold significant potential for enhancing power system applications; however, they are not omnipotent. It is crucial to acknowledge their limitations and understand that they may not be able to address all challenges in the power system domain. Various factors must be considered that influence the implementation, adoption, and effectiveness of AI/ML solutions, including but not limited to safety, security, transparency, and trustworthiness. Additionally, the incorporation of advanced human–machine interfaces is essential, as it enables humans to validate the effectiveness of AI/ML solutions while remaining actively engaged, fostering trust in AI/ML deployment. Finally, the report summarizes AI/ML research activities supported by the Department of Energy (DOE) Office of Electricity (OE) through the Advanced Grid Modeling (AGM) program. The work aligns with the interests and mission of DOE-OE AGM, with the report serving as a resource for identifying existing progress and for pinpointing future applications within AI/ML that need further exploration and support.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Fast and flexible analysis of direct dark matter search data with machine learning
We present the results from combining machine learning with the profile likelihood fit procedure, using data from the Large Underground Xenon (LUX) dark matter experiment. This approach demonstrates reduction in computation time by a factor of 30 when compared with the previous approach, without loss of performance on real data. We establish its flexibility to capture non-linear correlations between variables (such as smearing in light and charge signals due to position variation) by achieving equal performance using pulse areas with and without position-corrections applied. Its efficiency and scalability furthermore enables searching for dark matter using additional variables without significant computational burden. We demonstrate this by including a light signal pulse shape variable alongside more traditional inputs such as light and charge signal strengths. Furthermore, this technique can be exploited by future dark matter experiments to make use of additional information, reduce computational resources needed for signal searches and simulations, and make inclusion of physical nuisance parameters in fits tractable.
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
Investigating explainable transfer learning for battery lifetime prediction under state transitions
Battery lifetime prediction at early cycles is crucial for researchers and manufacturers to examine product quality and promote technology development. Machine learning has been widely utilized to construct data-driven solutions for high-accuracy predictions. However, the internal mechanisms of batteries are sensitive to many factors, such as charging/discharging protocols, manufacturing/storage conditions, and usage patterns. These factors will induce state transitions, thereby decreasing the prediction accuracy of data-driven approaches. Transfer learning is a promising technique that overcomes this difficulty and achieves accurate predictions by jointly utilizing information from various sources. Hence, we develop two transfer learning methods, Bayesian Model Fusion and Weighted Orthogonal Matching Pursuit, to strategically combine prior knowledge with limited information from the target dataset to achieve superior prediction performance. From our results, our transfer learning methods reduce root-mean-squared error by 41% through adapting to the target domain. Furthermore, the transfer learning strategies identify the variations of impactful features across different sets of batteries and therefore disentangle the battery degradation mechanisms and the root cause of state transitions from the perspective of data mining. These findings suggest that the transfer learning strategies proposed in our work are capable of acquiring knowledge across multiple data sources for solving specialized issues.
25 ENERGY STORAGE↗
High density plasmas and new diagnostics: An overview (invited)
One of the limiting factors for the full understanding of Electron Cyclotron Resonance Ion Sources (ECRISs) fundamental mechanisms consists of few types of diagnostic tools so far available for such compact machines. Microwave-to-plasma coupling optimisation, new methods of density overboost provided by plasma wave generation, and magnetostatic field tailoring for generating a proper electron energy distribution function, suitable for optimal ion beams formation, require diagnostic tools spanning across the entire electromagnetic spectrum from microwave interferometry to X-ray spectroscopy; these methods are going to be implemented including high resolution and spatially resolved X-ray spectroscopy made by quasi-optical methods (pin-hole cameras). The ion confinement optimisation also requires a complete control of cold electrons displacement, which can be performed by optical emission spectroscopy. Several diagnostic tools have been recently developed at INFN-LNS, including “volume-integrated” X-ray spectroscopy in low energy domain (2-30 keV, by using silicon drift detectors) or high energy regime (>30 keV, by using high purity germanium detectors). For the direct detection of the spatially resolved spectral distribution of X-rays produced by the electronic motion, a “pin-hole camera” has been developed also taking profit from previous experiences in the ECRIS field. The paper will give an overview of INFN-LNS strategy in terms of new microwave-to-plasma coupling schemes and advanced diagnostics supporting the design of new ion sources and for optimizing the performances of the existing ones, with the goal of a microwave-absorption oriented design of future machines.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
Making Corgis Important for Honeycomb Classification: Adversarial Attacks on Concept-based Explainability Tools
Methods for model explainability have become increasingly critical for testing the fairness and soundness of deep learning. Concept-based interpretability techniques, which use a small set of human-interpretable concept exemplars in order to measure the influence of a concept on a model's internal representation of input, are an important thread in this line of research. In this work we show that these explainability methods can suffer the same vulnerability to adversarial attacks as the models they are meant to analyze. We demonstrate this phenomenon on two well-known concept-based interpretability methods: TCAV and faceted feature visualization. We show that by leveraging the geometry of the problem and carefully perturbing the examples of the concept that is being investigated, we can radically change the output of the interpretability method. The attacks that we propose can either induce positive interpretations (polka dots are an important concept for a model when classifying zebras) or negative interpretations (stripes are not an important factor in identifying images of a zebra). Our work highlights the fact that in safety-critical applications, there is need for security around not only the machine learning pipeline but also the model interpretation process.
Brown, Davis R.↗
Nuclear recoil detection with color centers in bulk lithium fluoride
We present initial results on the detection of nuclear recoils in lithium fluoride (LiF) through the fluorescence of color centers created by particle interactions in the crystal lattice. Using light-sheet fluorescence microscopy, we image nuclear recoil tracks from both fast and thermal neutron interactions deep within a cubic-centimeter-scale sample. Automated three-dimensional feature extraction based on machine-learning tools enables the identification and classification of individual events. We observe that the fluorescence response of LiF to gamma irradiation is strongly suppressed, by a factor of 30–50 compared to neutron exposure, demonstrating intrinsic insensitivity to electromagnetic backgrounds. The observed and simulated event characteristics are consistent, including their number, size, and topology. These results establish the feasibility of LiF as a scalable detection medium for rare nuclear-recoil events and constitute a first step toward 10–1000 g scale detectors with single-event sensitivity for applications in reactor-neutrino detection, neutron spectroscopy, and dark matter searches.
Aroujo, G R [University of Zurich]↗
Control and Calibration of GlueX Central Drift Chamber Using Gaussian Process Regression
The Gluonic Excitations (GlueX) experiment is designed to search for exotic hybrid mesons using photoproduction, and to study the hybrid meson spectrum predicted from Lattice Quantum Chromodynamics. For the first time, the GlueX Central Drift Chamber was controlled autonomously using machine learning (ML) to calibrate in real time while recording cosmic ray tracks. We demonstrate the ability of a Gaussian Process to predict the gain correction calibration factor used to determine a high voltage setting that will stabilize the CDC gain in response to changing environmental conditions; this is in contrast to the traditional, computationally expensive method of calibrating raw data after data collection is complete.
McSpadden, Helen↗
Tunable Topological Phonon for Next-generation Quantum Transduction
This project aims to understand the critical factors that determine transduction performance of topological phonons across an oxide perovskite/tungsten diselenide heterojunction. We will investigate mechanisms of their propagation and interfacial coupling using modeling and machine learning approaches. Methods include density functional theory, molecular dynamics, numerical transport simulations, and active learning for building up a training dataset for force field development.
75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
A study of appliance ownership and electricity consumption determinants in urban Ghanaian households
The residential sector in Ghana accounts for about 40% of aggregate electricity consumption out of which urban centers contribute 70%. The high weighted share of residential electricity use is attributed to high appliance ownership and use, and other household/building factors. The ability to determine how changes in the pattern of these factors influence electricity demand is critical if efforts to reduce consumption are to be effective. Here this study combines a residential electricity consumption survey (RECS) with electricity end-use monitoring of 60 households in Tema city Ghana, to yield the first ever comprehensive investigation of city-scale electricity consumption in urban Ghanaian homes. A multiple linear regression analysis is used to identify the most statistically significant indicators of appliance ownership and household electricity consumption. Results indicate that ownership of air conditioner, freezer, fan, refrigerator and television; and changes in socio-economic and building factors such as energy efficiency awareness and practice; income; household size and floor space show high statistical significance, and collectively explain 57% variance in households’ total electricity consumption. The presence of dependent children increases ownership of television, iron, washing machine and small kitchen appliances. This work provides a solid foundation for developing more tailored energy-saving policy interventions targeted at households.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
Strategy for Migration of Traditional to Hybrid Control Boards in a Nuclear Power Plant
This strategy document describes the NUREG-0711 based human factors engineering (HFE) phases and associated elements required to support design, verification and validation (V&V), and implementation of new digital control room elements in a legacy analog main control room (MCR). Information from previous planning and analysis work serves as the foundation for creating a human-machine interface (HMI) specification for distributed control systems (DCSs) to be implemented as part of nuclear power plant (NPP) modernization. This document reviews ways to take the HMSI specification and use it when migrating legacy displays or designing displays with new functionality. These displays undergo iterative usability testing during the design phase and then an integrated system validation (ISV) in the full-scope control room training simulator. Following successful demonstration of operator performance using the systems during the ISV, the new DCS is implemented at the plant, first in the training simulator and then in the MCR. This document concludes with a sample project plan, including a 15-month timeline from DCS design through implementation. Included is a discussion of how the U.S. Department of Energy’s Human System Simulation Laboratory (HSSL) can be used to support design and V&V activities. This report completes a Level 4 (M4) milestone under the U.S. Department of Energy’s (DOE’s) Light Water Reactor Sustainability (LWRS) Program.
21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
A Comparison of Infectious Disease Forecasting Methods across Locations, Diseases, and Time
Accurate infectious disease forecasting can inform efforts to prevent outbreaks and mitigate adverse impacts. This study compares the performance of statistical, machine learning (ML), and deep learning (DL) approaches in forecasting infectious disease incidences across different countries and time intervals. We forecasted three diverse diseases: campylobacteriosis, typhoid, and Q-fever, using a wide variety of features (n = 46) from public datasets, e.g., landscape, climate, and socioeconomic factors. We compared autoregressive statistical models to two tree-based ML models (extreme gradient boosted trees [XGB] and random forest [RF]) and two DL models (multi-layer perceptron and encoder–decoder model). The disease models were trained on data from seven different countries at the region-level between 2009–2017. Forecasting performance of all models was assessed using mean absolute error, root mean square error, and Poisson deviance across Australia, Israel, and the United States for the months of January through August of 2018. The overall model results were compared across diseases as well as various data splits, including country, regions with highest and lowest cases, and the forecasted months out (i.e., nowcasting, short-term, and long-term forecasting). Overall, the XGB models performed the best for all diseases and, in general, tree-based ML models performed the best when looking at data splits. There were a few instances where the statistical or DL models had minutely smaller error metrics for specific subsets of typhoid, which is a disease with very low case counts. Feature importance per disease was measured by using four tree-based ML models (i.e., XGB and RF with and without region name as a feature). The most important feature groups included previous case counts, region name, population counts and density, mortality causes of neonatal to under 5 years of age, sanitation factors, and elevation. This study demonstrates the power of ML approaches to incorporate a wide range of factors to forecast various diseases, regardless of location, more accurately than traditional statistical approaches.
59 BASIC BIOLOGICAL SCIENCES↗
SU-E-T-119: Dosimetric and Mechanical Characteristics of Elekta Infinity LINAC with Agility MLC
Purpose: Elekta Infinity is the one of the latest generation LINAC with unique features. Two Infinity LINACs are recently commissioned at our institution. The dosimetric and mechanical characteristics of the machines are presented. Methods: Both Infinity LINACs with Agility MLC (160 leaves with 0.5 cm leaf width) are configured with five electron energies (6, 9, 12, 15, and 18 MeV) and two photon energies (6 and 15 MV). One machine has additional photon energy (10 MV). The commissioning was performed by following the manufacturer's specifications and AAPM TG recommendations. Beam data of both electron and photon beams are measured with scanning ion chambers and linear diode array. Machines are adjusted to have the dosimetrically equivalent characteristics. Results: The commissioning of mechanical and imaging system meets the tolerances by TG recommendations. The PDD{sub 10} of various field sizes for 6 and 15 MV shows < 0.5% difference between two machines. For each electron beams, R{sub 80} matches with < 0.4 mm difference. The symmetry and flatness agree within 0.8% and 0.9% differences for photon beams, respectively. For electron beams, the differences of the symmetry and flatness are within 1.2% and 0.8%, respectively. The mean inline penumbras for 6, 10, and 15 MV are respectively 5.1±0.24, 5.6±0.07, and 5.9±0.10 mm for 10x10 cm at 10 cm depth. The crossline penumbras are larger than inline penumbras by 2.2, 1.4, and 1.0 mm, respectively. The MLC transmission factor with interleaf leakage is 0.5 % for all photon energies. Conclusion: The dosimetric and mechanical characteristics of two Infinity LINACs show good agreements between them. Although the Elekta Infinity has been used in many institutions, the detailed characteristics of the machine have not been reported. This study provides invaluable information to understand the Infinity LINAC and to compare the quality of commissioning data for other LINACs.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
Effects of random forest modeling decisions on biogeochemical time series predictions
Abstract Random forests (RF) are an increasingly popular machine learning approach used to model biogeochemical processes in the Earth system. While RF models are robust to many assumptions that complicate deterministic models, there are several important parameterization decisions for appropriate use and optimal model fit. We explored the role that parameter decisions, including training/testing data splitting strategies, variable selection, and hyperparameters play on RF goodness‐of‐fit by constructing models using 1296 unique parameter combinations to predict concentrations of nitrate, a key nutrient for biogeochemical cycling in aquatic ecosystems. Models were built on long‐term, publicly available water quality and meteorology time series collected by the National Estuarine Research Reserve monitoring network for two contrasting ecosystems representing freshwater and brackish estuaries. We found that accounting for temporal dependence when splitting data into training and testing subsets was key for avoiding over‐estimation of model predictive power. In addition, variable selection, the ratio of training to testing data, and to a lesser degree, variables per split and number of trees, were significant parameters for optimizing RF goodness‐of‐fit. We also explored how model parameter decisions influenced interpretation of the relative importance of predictors to the model, and model predictor‐dependent variable relationships, with results suggesting that both data structure and model parameterization influence these factors. Because much of the current RF literature is written for the computational and statistical science communities, the primary goal of this study is to provide guidelines for aquatic scientists new to machine learning to apply RF techniques appropriately to aquatic biogeochemical datasets.
54 ENVIRONMENTAL SCIENCES↗
Enhancing Fluid Flow Pressure and Saturation Prediction Accuracy and Reducing Uncertainty with Committee Machine – Illinois Basin Decatur Project (IBDP) as a Case Study
This is the conference paper accompanying an oral presentation at the 17th International Conference on Greenhouse Gas Control Technologies GHGT-17 held in Calgary, Canada, October 20-24, 2024. Carbon capture and storage (CCS) is a way to play a critical role in the global transition to a low-emission economy. Current progress is hampered by a number of factors, among which the lack of risk-informed design tools and decision support frameworks is seen as a major roadblock. Significant interest exists in using artificial intelligence to accelerate CCS site feasibility studies, as well as to facilitate the permit application process. Existing works commonly train a single deep learning model. This work investigates the feasibility of using a conventional ensemble learning (committee machine) technique to further improve prediction accuracy. Ensemble-based algorithms generally improve over individual base learners in terms of robustness and accuracy. Deep ensembles, however, are time-consuming to create and train. A pragmatic question is whether small-sized ensembles may lead to prediction improvement. Here we evaluated the efficacy of an ensemble learning technique using the latent spectral model (LSM), an efficient deep neural operator algorithm, as base learners. Preliminary results, obtained using the Illinois Basin-Decatur Project (IBDP) carbon sequestration data/model, show that small-sized ensembles can improve prediction over the base learners, achieving prediction accuracy of ~1.6 psi root mean square error (RMSE) on pressure (relative the average reservoir pressure of 3150 psi), and less than 1.3% for saturation.
Sun, Alexander↗
Machine learning framework for assessment of microbial factory performance
Metabolic models can estimate intrinsic product yields for microbial factories, but such frameworks struggle to predict cell performance (including product titer or rate) under suboptimal metabolism and complex bioprocess conditions. On the other hand, machine learning, complementary to metabolic modeling necessitates large amounts of data. Building such a database for metabolic engineering designs requires significant manpower and is prone to human errors and bias. We propose an approach to integrate data-driven methods with genome scale metabolic model for assessment of microbial bio-production (yield, titer and rate). Using engineered E. coli as an example, we manually extracted and curated a data set comprising about 1200 experimentally realized cell factories from ~100 papers. We furthermore augmented the key design features (e.g., genetic modifications and bioprocess variables) extracted from literature with additional features derived from running the genome-scale metabolic model iML1515 simulations with constraints that match the experimental data. Then, data augmentation and ensemble learning (e.g., support vector machines, gradient boosted trees, and neural networks in a stacked regressor model) are employed to alleviate the challenges of sparse, non-standardized, and incomplete data sets, while multiple correspondence analysis/principal component analysis are used to rank influential factors on bio-production. The hybrid framework demonstrates a reasonably high cross-validation accuracy for prediction of E.coli factory performance metrics under presumed bioprocess and pathway conditions (Pearson correlation coefficients between 0.8 and 0.93 on new data not seen by the model).
59 BASIC BIOLOGICAL SCIENCES↗
Human-Centered and Explainable Artificial Intelligence in Nuclear Operations
Nuclear power plants in the United States are critical to the nation’s energy security, accounting for 20% of all electricity produced for the power grid. As energy needs grow, 100 gigawatts of additional nuclear power will be necessary by 2050, more than double the current capacity. Realizing this target requires cutting-edge technology like artificial intelligence (AI) and machine learning (ML) that can bring about significant increases in the level of automation. Human-centered AI (HCAI) is a combination of human-centered design (human factors, human-in-the-loop, etc.) with AI/ML to help produce an efficient and reliable system with full consideration for human engagement. This paper provides a comprehensive and novel discussion of HCAI considerations in nuclear power, introducing unique applications for the existing fleet as well as new advanced reactor designs. We include real-life use cases of AI applications to work management processes at nuclear power sites and highlight lessons learned for HCAI.
Hall, Anna↗
Scalable Technologies Achieving Risk-Informed Condition-Based Predictive Maintenance Enhancing the Economic Performance of Operating Nuclear Power Plants
The primary objective of the research presented in this report is to develop scalable technologies that are deployable across plant assets and across the nuclear fleet to achieve risk-informed predictive maintenance (PdM) strategies at commercial nuclear power plants (NPPs). Over the years, the nuclear fleet has relied on labor-intensive and time-consuming preventive maintenance (PM) programs, driving up operation and maintenance (O&M) costs to achieve high capacity factors. A well-constructed risk-informed PdM approach for an identified plant asset has been developed in this research, taking advantage of advancements in data analytics, machine learning (ML), artificial intelligence (AI), physics-informed modeling, and visualization. These technologies would allow commercial NPPs to reliably transition from current labor-intensive PM programs to a technology driven PdM program, eliminating unnecessary O&M costs. The work presented in the report is being developed as part of a collaborative research effort between Idaho National Laboratory and Public Service Enterprise Group Nuclear, LLC. This report (1) reflects the results of work by LWRS Program researchers with PSEG, Nuclear LLC-owned Salem and Hope Creek Nuclear Power Plants; (2) presents utilization of circulating water system (CWS) heterogeneous data and fault modes from both the Salem and Hope Creek nuclear power plant sites to develop salient fault signatures associated with each fault mode; (3) describes the integration of component-level predictive models into a robust system-level model enabled by the federated-transfer learning; (4) describes the development of physics-informed model of circulating water pump and motor; (5) develops a scalable risk and economic model; and (6) outlines the development of a user-centric visualization application. The outcomes presented in this report lays the foundation and provides a much-needed technical basis to focus on explainability and trustworthiness of ML and AI-based technologies, as part of future research.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗