Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “machine learning, artificial intelligence”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48

Adversarial Artificial Intelligence: State of the Malpractice

Warfare systems are increasingly being supported by artificial intelligence (AI), and its influence is growing. As AI becomes a warfare enabler it has also become a target. For example, AI-enabled machine vision systems can be trivially deceived by specially formulated camouflage. Many approaches to making AI more resilient to protect against specific attacks fail to generalize. However, attacks often do generalize across models trained for the same task, regardless of architecture or training data. This paper will illustrate the state of the practice in offensive and defensive AI and clarify some myths about AI's triumphs and failures in the real world.

Artificial intelligence, AI, cybersecurity, milita↗

AI-Science for Performance Optimization and Diagnosis of Science Instrument Federations

Next generation of science workflows are expected to be executed over complex federations composed of supercomputers, science instruments, storage systems and networks, with new additions of the edge and cloud systems and services. The sheer complexity of these multi-domain federations makes it hard to manage them and optimize their performance, as small impedance mismatches (that can dynamically develop between systems) could drastically degrade the entire federation performance. Recent proliferation of Software Defined Everything (SDX) technologies combined with containerization frameworks provide custom instruments that can monitor and collect critical measurements at various levels to support diagnoses and performance optimization; but their data too enormous for human operators and analysts to process and generate decisions. Machine Learning (ML) methods that extract critical parameters, relationships and trends from the data offer general solutions. Artificial Intelligence (AI) and ML methods must be custom-developed for these problems based on solid, rigorous foundations, since black-box approaches are often ineffective and unsound.We propose to develop comprehensive AI-Science for the performance of science federations to (i) monitor and control storage, networks, experiments, and computing systems across multiple domains via softwarization layers, at speeds and scales orders of magnitude superior to current practice, (ii) optimally realize and orchestrate complex workflows with high performance by using dynamic state and performance estimation methods, and (iii) aggregate measurements across sites and time to develop infrastructure-level profiles, optimizations and diagnoses using AI-Science based on foundational principles from ML, game theory, and information fusion areas.

Rao, Nageswara↗

Cybersecurity Considerations for Emerging Energy Technologies

AI, cloud computing, post-quantum cryptography, zero-trust architectures, microgrids, and virtual power plants. What do these things have in common? They are all emerging technologies in the clean energy space that will be a critical part of grid modernization efforts. As we work towards clean energy and decarbonization targets, these technologies, developed to solve real-world problems, will help us reach goals and achieve new efficiencies as the paradigm of grid operation shifts. However, there are growing concerns about the cybersecurity risks associated with these trending topics as they are used in critical infrastructure applications. This talk will cover gaps, challenges, and opportunities for the secure implementation of grid modernization solutions and novel energy applications of state-of-the-art networking and communications. Proactive risk mitigation strategies, including the application of cyber-informed engineering, will be discussed. Practical applications of these techniques will help provide countermeasures to the impact of cyberattacks on critical infrastructure technologies in a new, digitized grid landscape.

14 SOLAR ENERGY↗

Digitalization mapping and assessment process supporting ION strategic transformation activities

The existing fleet of commercial nuclear power plants (NPPs) are an important asset in the nation’s portfolio of electrical generating resources. Their continued safe and reliable operation are critical to providing a large source of carbon-free electricity to power the nation’s economy. The United States Department of Energy’s (DOE) Light Water Reactor Sustainability (LWRS) Program develops the scientific bases, methods, and tools, for the continued safe and economical operation of the nation's commercial NPPs. The Plant Modernization Pathway within LWRS Program focuses on providing guidance to industry on the full-scale implementation of modernization solutions for NPPs that significantly reduce the technical and financial risks associated with modernization. This research is focused on helping the nuclear industry understand how to digitize and digitalize their NPPs so that they can design their modernization solutions to be scalable, sustainable, and integrated both laterally and horizontally within their organization. That is, this research creates a digital transformation in NPPs by reshaping cultural mindsets and by identifying business efficiencies. In partnership with industry, and using four previously established guiding principles for digitalization, this research supported NPP modernization through assessing readiness for digitalization as a means to achieve integrated operations for nuclear. Specifically, this research created an assessment to review an entire organization’s work processes to gather information about the digitalization health of the plant. The assessment tools were administered to plant employees, and the results were used to develop a digitalization plan. The survey assessment identified the optimal candidate processes that would most benefit from a digitalization initiative which were revealed through analytical frameworks. One analysis calculated mean digitalization health indicator scores for all endorsed activities which allowed the researchers to rank and color code the results for easy identification. Individual health indicator scores are also provided, should our industry partner wish to understand these findings according to their own organizational priorities, business considerations and desired end-state. The results were also analyzed from the perspective that organizations are comprised of different types of innovators (e.g., generators, optimizers, conceptualizers, and implementers), which differentially affects the organization’s ability to comprehend and adapt to change (i.e., opportunities to innovate). Understanding the relative composition of innovator types at an NPP allows them to gather insights into the strengths and weaknesses they have in innovating how work is performed. For the utility that partnered with this research team, the results showed that implementers make up the largest portion of respondents and conceptualizers the smallest portion. Knowing the proportion of innovator types gave this organization insights on how they can effectively implement their innovation solutions. Additionally, the results were analyzed from a technical, economic, and risk perspective to identify and quantify work reduction opportunities (WROs). Recognizing that not all cost-saving opportunities are the same, a Technical, Economic and Risk Assessment (TERA) was performed to evaluate WROs to identify areas of greatest potential and lowest risk. The key results from TERA included a digitalization opportunity score for each activity, and a calculation of potential cost savings. These two outputs formed the bases for calculating a priority index and rank for the activities/processes assessed. From the prioritization calculations, TERA can then help the utility 1) decide what digitalization priorities to invest money in implementing and then 2) calculates how much should be invested in the digitalization initiatives selected to achieve cost savings and/or an acceptable return on investment. Last, onsite interviews revealed several inefficiencies in the standard work processes that occur cross-departmentally that are due to the absence of digitized and digitalized processes. Examples of these include time spent scanning paper documents and then uploading the documents electronically, obtaining signatures, and searching for desired information. This represents a digital but not digitalized process. Over 15 opportunities to improve work processes were identified through this multi-method digitalization assessment. The various analytical assessments used (e.g., TERA, digitalization health indicator scores), as well as discussions with the utility partner, corroborated that all the opportunities identified had a strong potential to make work processes more efficient and to improve overall performance of the NPP.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Validation and parameterization of a novel physics-constrained neural dynamics model applied to turbulent fluid flow

We report, in fluid physics, data-driven models to enhance or accelerate time to solution are becoming increasingly popular for many application domains, such as alternatives to turbulence closures, system surrogates, or for new physics discovery. In the context of reduced order models of high-dimensional time-dependent fluid systems, machine learning methods grant the benefit of automated learning from data, but the burden of a model lies on its reduced-order representation of both the fluid state and physical dynamics. In this work, we build a physics-constrained, data-driven reduced order model for Navier–Stokes equations to approximate spatiotemporal fluid dynamics in the canonical case of isotropic turbulence in a triply periodic box. The model design choices mimic numerical and physical constraints by, for example, implicitly enforcing the incompressibility constraint and utilizing continuous neural ordinary differential equations for tracking the evolution of the governing differential equation. We demonstrate this technique on a three-dimensional, moderate Reynolds number turbulent fluid flow. In assessing the statistical quality and characteristics of the machine-learned model through rigorous diagnostic tests, we find that our model is capable of reconstructing the dynamics of the flow over large integral timescales, favoring accuracy at the larger length scales. More significantly, comprehensive diagnostics suggest that physically interpretable model parameters, corresponding to the representations of the fluid state and dynamics, have attributable and quantifiable impact on the quality of the model predictions and computational complexity.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A Digital Twin Framework Utilizing Machine Learning for Robust Predictive Maintenance: Enhancing Tire Health Monitoring

We introduce a novel digital twin (DT) framework for the predictive maintenance of long-term physical systems. Using monitoring tire health as an application, we show how the DT framework can be used to enhance automotive safety and efficiency, and how the technical challenges can be overcome using a three-step approach. First, to manage the data complexity over a long operation span, we employ data reduction techniques to concisely represent physical tires using historical performance and usage data. Relying on these data, for fast real-time prediction, we train a transformer-based model offline on our concise dataset to predict future tire health over time, represented as remaining casing potential (RCP). Based on our architecture, our model quantifies both epistemic and aleatoric uncertainties, providing reliable confidence intervals around predicted RCP. Second, to incorporate real-time data, we update the predictive model in the DT framework, ensuring its accuracy throughout its lifespan with the aid of hybrid modeling and the use of the discrepancy function. Third, to assist decision-making in predictive maintenance, we implement a tire state decision algorithm, which strategically determines the optimal timing for tire replacement based on RCP forecasted by our transformer model. This approach ensures that our DT accurately predicts system health, continually refines its digital representation, and supports predictive maintenance decisions. Furthermore, our framework effectively embodies a physical system, leveraging big data and machine learning (ML) for predictive maintenance, model updates, and decision-making.

advanced computing infrastructure↗

Constraining chaos: Enforcing dynamical invariants in the training of reservoir computers

Drawing on ergodic theory, we introduce a novel training method for machine learning based forecasting methods for chaotic dynamical systems. The training enforces dynamical invariants—such as the Lyapunov exponent spectrum and the fractal dimension—in the systems of interest, enabling longer and more stable forecasts when operating with limited data. The technique is demonstrated in detail using reservoir computing, a specific kind of recurrent neural network. Finally, results are given for the Lorenz 1996 chaotic dynamical system and a spectral quasi-geostrophic model of the atmosphere, both typical test cases for numerical weather prediction.

97 MATHEMATICS AND COMPUTING↗

Enhanced analysis of experimental x-ray spectra through deep learning

X-ray spectroscopic data from high-energy-density laser-produced plasmas has long required thorough, time-consuming analysis to extract meaningful source conditions. There are often confounding factors due to rapidly evolving states and finite spatial gradients (e.g., the existence of multi-temperature, multi-density, multi-ionization states, etc.) that make spectral measurements and analysis difficult. Here, in this paper, we demonstrate how deep learning can be applied to enhance x-ray spectral data analysis in both speed and intricacy. Neural networks (NNs) are trained on ensemble atomic physics simulations so that they can subsequently construct a model capable of extracting plasma parameters directly from experimental spectra. Through deep learning, the models can extract temperature distributions as opposed to single or dual temperature/density fits from standard trial-and-error atomic modeling at a significantly reduced computational cost compared to traditional trial-and-error methods. These NNs are envisioned to be deployed with high repetition rate x-ray spectrometers in order to provide detailed real-time analysis of experimental spectra.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Neural lumped parameter differential equations with application in friction-stir processing

Lumped parameter methods aim to simplify the evolution of spatially-extended or continuous physical systems to that of a “lumped” element representative of the physical scales of the modeled system. For systems where the definition of a lumped element or its associated physics may be unknown, modeling tasks may be restricted to full-fidelity physics simulations. Here, in this work, we consider data-driven modeling tasks with limited point-wise measurements of otherwise continuous systems. We build upon the notion of the Universal Differential Equation (UDE) to construct data-driven models for reducing dynamics to that of a lumped parameter and inferring its properties. The flexibility of UDEs allow for composing various known physical priors suitable for application-specific modeling tasks, including lumped parameter methods. The motivating example for this work is the plunge and dwell stages for friction-stir welding; specifically, (i) mapping power input into the tool to a point-measurement of temperature and (ii) using this learned mapping for process control.

97 MATHEMATICS AND COMPUTING↗

Machine Learning Approach for Spatiotemporal Multivariate Optimization of Environmental Monitoring Sensor Locations

Abstract Long-term environmental monitoring is critical for managing the soil and groundwater at contaminated sites. Recent improvements in state-of-the-art sensor technology, communication networks, and artificial intelligence have created opportunities to modernize this monitoring activity for automated, fast, robust, and predictive monitoring. In such modernization, it is required that sensor locations be optimized to capture the spatiotemporal dynamics of all monitoring variables as well as to make it cost-effective. The legacy monitoring datasets of the target area are important to perform this optimization. In this study, we have developed a machine-learning approach to optimize sensor locations for soil and groundwater monitoring based on ensemble supervised learning and majority voting. For spatial optimization, Gaussian process regression (GPR) is used for spatial interpolation, while the majority voting is applied to accommodate the multivariate temporal dimension. Results show that the algorithms significantly outperform the random selection of the sensor locations for predictive spatiotemporal interpolation. While the method has been applied to a four-dimensional dataset (with two-dimensional space, time, and multiple contaminants), we anticipate that it can be generalizable to higher-dimensional datasets for environmental monitoring sensor location optimization.

Siddiquee, Masudur R.↗

Key Learnings from Hydraulic Fracturing Test Site - 2 (HFTS-2), Delaware Basin

Hydraulic fractures (HF) play a dominant role in oil and gas production from unconventional reservoirs, fracture characteristics, geometry, and extent are generally not well known and are typically inferred from various monitoring methods or subsurface models. The Hydraulic Fracturing Test Site-2 (HFTS-2) is a field-based research experiment performed in the Wolfcamp formation of the Permian (Delaware) Basin. HFTS-2, a unique joint industry program (JIP) that brings together government, academia, and industry, focused on field data acquisition and interpretation. The project has built a comprehensive HF research dataset that includes microseismic (MS), 1,500 ft of core, diagnostic formation injection tests (DFIT), fluid characterization, advanced logs, geochemistry, downhole gauges, varying completions, and permanent fiber optic (FO) cable in vertical and horizontal wells. These data were integrated and used to characterize HF geometry/dimensions and resulting depletion profiles, gain insights for completion design, and achieve a better understanding of parent well depletion effects on child well performance. The analysis and integration of the comprehensive HFTS-2 diagnostics dataset provide insights for optimal well placement and completions and improves understanding about the effects of parent well depletion. Furthermore, this dataset can be used to blind test and develop subsurface workflows for unconventional resources. Key learnings from HFTS-2 and the new technologies tested can easily be transferred to other unconventional plays.

58 GEOSCIENCES↗

Dataset for Evaluation of Extreme Weather Impacts on Utility-Scale Photovoltaic Plant Performance in the United States

This dataset is a fusion of three data types (operations and maintenance tickets, weather data, and production data) that was used to support machine learning analysis and evaluation of drivers for low performance at photovoltaic (PV) sites during compound, extreme weather events. After being processed with machine learning, the data was used in the "Evaluation of Extreme Weather Impacts on Utility-scale Photovoltaic Plant Performance in the United States" manuscript. Additional details are captured in the associated manuscript.

AI↗

Similarity networks as a knowledge representation for space applications

Similarity networks are a powerful form of knowledge representation that are useful for many artificial intelligence applications. Similarity networks are used in applications ranging from information analysis and case based reasoning to machine learning and linking symbolic to neural processing. Strengths of similarity networks include simple construction, intuitive object storage, and flexible retrieval techniques that facilitate inferencing. Therefore, similarity networks provide great potential for space applications.

Bailey, David↗

Machine learning to classify animal species in camera trap images: Applications in ecology

Motion-activated cameras (“camera traps”) are increasingly used in ecological and management studies for remotely observing wildlife and are amongst the most powerful tools for wildlife research. However, studies involving camera traps result in millions of images that need to be analysed, typically by visually observing each image, in order to extract data that can be used in ecological analyses. We trained machine learning models using convolutional neural networks with the ResNet-18 architecture and 3,367,383 images to automatically classify wildlife species from camera trap images obtained from five states across the United States. We tested our model on an independent subset of images not seen during training from the United States and on an out-of-sample (or “out-of-distribution” in the machine learning literature) dataset of ungulate images from Canada. We also tested the ability of our model to distinguish empty images from those with animals in another out-of-sample dataset from Tanzania, containing a faunal community that was novel to the model. The trained model classified approximately 2,000 images per minute on a laptop computer with 16 gigabytes of RAM. The trained model achieved 98% accuracy at identifying species in the United States, the highest accuracy of such a model to date. Out-of-sample validation from Canada achieved 82% accuracy and correctly identified 94% of images containing an animal in the dataset from Tanzania. We provide an r package (Machine Learning for Wildlife Image Classification) that allows the users to (a) use the trained model presented here and (b) train their own model using classified images of wildlife from their studies. The use of machine learning to rapidly and accurately classify wildlife in camera trap images can facilitate non-invasive sampling designs in ecological studies by reducing the burden of manually analysing images. Our r package makes these methods accessible to ecologists.

54 ENVIRONMENTAL SCIENCES↗

DeepCare: Improving Patient Care using Deep Learning on Electronic Health Records

Coordinating patient care using electronic health records (EHR) data presents an exciting but formidable opportunity in data extraction, analysis and modeling. Traditional methods use a manual feature driven approach to model patients with age, family history and symptoms to predict disease outcomes. We propose a novel approach to model patients based on their streaming electronic health records data combined with information from medical knowledge bases, which has been gained over years of medical research. Using a combination of representation learning and long short term memory (LSTM) networks we plan to model patient evolution over time, leading to more accurate and individualized predictive models for patient’s diseases. Our approach will be transformative in providing critical decision support for patient care, enabling accurate understanding and evolution of diseases in patients.

60 APPLIED LIFE SCIENCES↗

Multilevel Cybersecurity for Photovoltaic Systems

The motivation behind this project is to protect critical infrastructure in electric power generation pertaining to solar photovoltaic (PV) systems. This growing renewable energy resource is becoming a more vital part of the nation’s energy portfolio, particularly since it has achieved grid-parity to existing generation methods in terms of cost. It is thus vital that steps be taken to ensure the cybersecurity of these assets. The project goal was to devise a multilevel cybersecurity solution to address PV security gaps at the inverter and system levels, and field test the solution under the supervision and review of a US-based solar inverter manufacturer and PV installer/operator. A two-level cyberattack defense approach was formulated whereby the first level, the solar inverter level, hardens individual devices and achieves a deeply cyber-secure inverter. The inverter level security involves a multi-layer defense-in-depth approach for securing the inverter while also providing data for the system level algorithms. The second level, the system level, addresses intrusion detection and restoration involving an ensemble of inverters and relevant systems.

14 SOLAR ENERGY↗