Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Active Learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49

Selecting Post-Processing Schemes for Accurate Detection of Small Objects in Low-Resolution Wide-Area Aerial Imagery

In low-resolution wide-area aerial imagery, object detection algorithms are categorized as feature extraction and machine learning approaches, where the former often requires a post-processing scheme to reduce false detections and the latter demands multi-stage learning followed by post-processing. In this paper, we present an approach on how to select post-processing schemes for aerial object detection. We evaluated combinations of each of ten vehicle detection algorithms with any of seven post-processing schemes, where the best three schemes for each algorithm were determined using average F-score metric. The performance improvement is quantified using basic information retrieval metrics as well as the classification of events, activities and relationships (CLEAR) metrics. We also implemented a two-stage learning algorithm using a hundred-layer densely connected convolutional neural network for small object detection and evaluated its degree of improvement when combined with the various post-processing schemes. The highest average F-scores after post-processing are 0.902, 0.704 and 0.891 for the Tucson, Phoenix and online VEDAI datasets, respectively. The combined results prove that our enhanced three-stage post-processing scheme achieves a mean average precision (mAP) of 63.9% for feature extraction methods and 82.8% for the machine learning approach.

54 ENVIRONMENTAL SCIENCES↗

Developing predictive models for µ opioid receptor binding using machine learning and deep learning techniques

Opioids exert their analgesic effect by binding to the µ opioid receptor (MOR), which initiates a downstream signaling pathway, eventually inhibiting pain transmission in the spinal cord. However, current opioids are addictive, often leading to overdose contributing to the opioid crisis in the United States. Therefore, understanding the structure-activity relationship between MOR and its ligands is essential for predicting MOR binding of chemicals, which could assist in the development of non-addictive or less-addictive opioid analgesics. This study aimed to develop machine learning and deep learning models for predicting MOR binding activity of chemicals. Chemicals with MOR binding activity data were first curated from public databases and the literature. Molecular descriptors of the curated chemicals were calculated using software Mold2. The chemicals were then split into training and external validation datasets. Random forest, k-nearest neighbors, support vector machine, multi-layer perceptron, and long short-term memory models were developed and evaluated using 5-fold cross-validations and external validations, resulting in Matthews correlation coefficients of 0.528–0.654 and 0.408, respectively. Furthermore, prediction confidence and applicability domain analyses highlighted their importance to the models’ applicability. Our results suggest that the developed models could be useful for identifying MOR binders, potentially aiding in the development of non-addictive or less-addictive drugs targeting MOR.

Research & Experimental Medicine↗

Furoxans (1,2,5-Oxadiazole-N-Oxides) as Novel NO Mimetic Neuroprotective and Procognitive Agents

Furoxans (1,2,5-oxadiazole-N-oxides) are thiol-bioactivated NO-mimetics that have not hitherto been studied in the CNS. Incorporation of varied substituents adjacent to the furoxan ring system led to modulation of reactivity toward bioactivation, studied by HPLC-MS/MS analysis of reaction products. Attenuated reactivity unmasked the cytoprotective actions of NO in contrast to the cytotoxic actions of higher NO fluxes reported previously for furoxans. Neuroprotection was observed in primary neuronal cell cultures following oxygen glucose deprivation (OGD). Neuroprotective activity was observed to correlate with thiol-dependent bioactivation to produce NO{sub 2}{sup -}, but not with depletion of free thiol itself. Neuroprotection was abrogated upon cotreatment with a sGC inhibitor, ODQ, thus supporting activation of the NO/sGC/CREB signaling cascade by furoxans. Long-term potentiation (LTP), essential for learning and memory, has been shown to be potentiated by NO signaling, therefore, a peptidomimetic furoxan was tested in hippocampal slices treated with oligomeric amyloid-{beta} peptide (A{beta}) and was shown to restore synaptic function. The novel observation of furoxan activity of potential therapeutic use in the CNS warrants further studies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Medial thalamic 18-FDG uptake following inescapable shock correlates with subsequent learned helpless behavior

The learned helplessness paradigm has been repeatedly shown to correlate with neurobiological aspects of depression in humans. In this model, rodents are exposed inescapable foot-shock in order to reveal susceptibility to escape deficit, defined as 'learned helplessness' (LH). Few methods are available to probe the neurobiological aspects underlying the differences in susceptibility in the living animal, thus far being limited to studies examining regional neurochemical changes with microdialysis. With the widespread implementation of small animal neuroimaging methods, including positron emission tomography (PET), it is now possible to explore the living brain on a systems level to define regional changes that may correlate with vulnerability to stress. In this study, 12 wild type Sprague-Dawley rats were exposed to 40 minutes of inescapable foot-shock followed by metabolic imaging using 2-deoxy-2[{sup 18}F]fluoro-D-glucose (18-FDG) 1 hour later. The escape test was performed on these rats 48 hours later (to accommodate radiotracer decay), where they were given the opportunity to press a lever to shut off the shock. A region of interest (ROI) analysis was used to investigate potential correlations (Pearson Regression Coefficients) between regional 18-FDG uptake following inescapable shock and subsequent learned helpless behavior (time to finish the test; number of successful lever presses within 20 seconds of shock onset). ROI analysis revealed a significant positive correlation between time to finish and 18-FDG uptake, and a negative correlation between lever presses and uptake, in the medial thalamic area (p=0.033, p=0.036). This ROI included the paraventricular thalamus, mediodorsal thalamus, and the habenula. In an effort to account for possible spillover artifact, the posterior thalamic area (including ventral medial and lateral portions) was also evaluated but did not reveal significant correlations (p=0.870, p=0.897). No other significant correlations were found in additional regions analyzed including the nucleus accumbens, caudate putamen, substantia nigra, and amygdala. These data suggest that medial thalamic 18-FDG uptake during inescapable shock may contribute to subsequent escape deficits, and are not confounded by shock effects per se, since all animals received the same treatment prior to scanning. We have previously explored 18-FDG differences following the escape test session which also showed hyperactivity in the medial thalamus of learned helpless animals compared to non-learned helpless, and included additional cortical-limbic changes. Given the neuroanatomical connections between the medial thalamus (and habenula) with the prefrontal cortex and monoaminergic brain stem, one possible speculation is that abnormal neuronal activity in these areas during stress may set in motion circuitry changes that correlate with learned helpless behavior.

18-FDG↗

Logical Activation Functions v.1.1

SAND2024-01501O Logical Activation Functions software is a PyTorch implementation from the paper, "Logical Activation Functions for Training Arbitrary Probabilistic Boolean Logic." The activation functions approximate logit-space marginalization of probabilistic truth tables from probabilistic interpretations of inputs. They also provide a general methodology to approximate logical relationships between abstract antecedents and consequents for machine learning architectures. They do not target any specific application or use-case. By training probabilistic truth tables, these activation functions can capture more expressive relationships in a neural network than typical elementwise activation functions. This code is only designed for a single compute node with a GPU and is limited to machine learning architectures than can fit within the memory of a single GPU. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Duersch, Jed↗

Detector Instrumentation, Energy Reconstruction and Data Analysis in the DUNE and NOvA Neutrino Experiments

Neutrino oscillations are so far the only experimental observation beyond the standard model since its development four decades ago. The remaining fundamental questions that can be answered by long-baseline neutrino oscillations are (1) the CP violation (whether neutrinos and antineutrinos behave the same way in oscillation), and (2) the mass hierarchy ($m_3>m_{1,2}$ or $m_{1,2}>m_3$), and (3) the octant of $\theta_{23}$ ($\theta_{23}>45^\circ, =45^\circ$ or $<45^\circ$). The PI's group at UCI focuses on long-baseline neutrino experiments DUNE and NOvA, key components of DOE's Intensity Frontier program. NOvA is the current major U.S.-based long-baseline neutrino experiment aiming to solve the mass hierarchy and $\theta_{23}$ octant. It is taking $\nu$ and $\bar{\nu}$ data from the NuMI beam at Fermilab. DUNE is the next-generation flagship neutrino experiment in the U.S. which is designed to decisively determine neutrino CP violation, mass hierarchy and $\theta_{23}$ octant. DUNE is Fermilab's first priority, and has been established as an international collaboration. During the period covered by the report, the PI's group has been exceptionally productive, with leading contributions to DUNE argon-purity monitoring detectors, NOvA/DUNE deep-learning reconstruction, and NOvA oscillation and near detector (ND) analyses. The group also is actively involved in DUNE/NOvA detector operation, data production, calibration, software upgrade and maintenance, and ProtoDUNE cold electronic QA/QC. Specifically, we have made accomplishments in the following four research projects: 1) Purity monitor R\&D and data analysis for DUNE, 2) Deep-learning-based energy reconstruction at NOvA and DUNE, 3) Oscillation analysis at NOvA, and 4) $\nu$-e elastic scattering analysis at NOvA.

47 OTHER INSTRUMENTATION↗

AttentionFire_v1.0: interpretable machine learning fire model for burned-area predictions over tropics

Abstract. African and South American (ASA) wildfires account for more than 70 % of global burned areas and have strong connection to local climate for sub-seasonal to seasonal wildfire dynamics. However, representation of the wildfire–climate relationship remains challenging due to spatiotemporally heterogenous responses of wildfires to climate variability and human influences. Here, we developed an interpretable machine learning (ML) fire model (AttentionFire_v1.0) to resolve the complex controls of climate and human activities on burned areas and to better predict burned areas over ASA regions. Our ML fire model substantially improved predictability of burned areas for both spatial and temporal dynamics compared with five commonly used machine learning models. More importantly, the model revealed strong time-lagged control from climate wetness on the burned areas. The model also predicted that, under a high-emission future climate scenario, the recently observed declines in burned area will reverse in South America in the near future due to climate changes. Our study provides a reliable and interpretable fire model and highlights the importance of lagged wildfire–climate relationships in historical and future predictions.

58 GEOSCIENCES↗

Identification of the Selective Sites for Electrochemical Reduction of CO to C 2+ Products on Copper Nanoparticles by Combining Reactive Force Fields, Density Functional Theory, and Machine Learning

Recent experiments have shown that CO reduction on oxide derived Cu nanoparticles (NP) are highly selective toward C 2+ products. However, understanding of the active sites on such NPs is limited, because the NPs have ~200 000 atoms with more than 10 000 surface sites, far too many for direct quantum mechanical calculations and experimental identifications. We show here how to overcome the computational limitation by combining multiple levels of theoretical computations with machine learning. This approach allows us to map the machine learned CO adsorption energies on the surface of the copper nanoparticle to construct the active site visualization (ASV). Furthermore, we identify the structural criteria for optimizing selective reduction by predicting the reaction energies of the potential determining step, $ΔE_{OCCOH}$, for the C 2+ product. Based on this structural criterion, we design a new periodic copper structure for CO reduction with a theoretical faradaic efficiency of 97%.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Review of heat transfer enhancement techniques for single phase flows

The thermal energy exchange between a flowing fluid and its confining channel is a ubiquitous process in modern society. To enhance the fluid-to-wall or wall-to-fluid heat transfer, several techniques have been developed to maximize the contact area between the fluid and the inner wall and/or disrupt the flow to enhance circulation or induce turbulence. Deployment of channels having features capable of enhancing heat transfer enables the reduction of heat exchanger size while maintaining performance. Reduction in equipment size is critical due to the ability to minimize the required volume of costly working fluids and to mitigate potential safety concerns associated with total system fluid volume. Here, a comprehensive review of single-phase heat transfer enhancement techniques is presented. The article provides a thorough comparison by analyzing the heat transfer rate, pressure drop, and other operational aspects. Single-phase heat transfer enhancement methods are divided into active and passive techniques. Active methods such as electrohydrodynamic (EHD), magnetohydrodynamics (MHD), or mechanical motion require external power to create enhancement. Passive methods such as dimples, fins, or tape inserts do not require external input and rely only on surface modification. Although active methods are more expensive and difficult to implement compared to passive techniques, it enables active control of heat transfer augmentation. Finally, this review develops and summarizes key learning data for design optimization enabled by additive manufacturing and machine learning algorithms, helping to inform these next-generation heat exchanger design methodologies for a plethora of modern applications such as electrification of vehicles, computing, and classical industries.

42 ENGINEERING↗

Advanced Data Science Model for Detecting Intelligent Malware

This study focused on developing a robust artificial intelligence (AI) model capable of detecting and characterizing advanced malware in Internet of Things (IoT) devices using network data. By analyzing network traffic with various machine learning (ML) models, our AI model can identify and characterize malicious activities to significantly improve malware detection accuracy and reliability as compared to traditional methods. The developed AI/ML model was trained using network data from IoT devices, leveraging classifiers such as Random Forest, Gradient Boosting, AdaBoost, and others to optimize detection performance. This project demonstrates a scalable framework for real-time malware detection and characterization in IoT networks, capable of identifying infected devices and facilitating the necessary steps to remove or isolate them, thereby preventing further infections. Although digital twin (DT) integration is not yet implemented in the current model, it represents a promising future enhancement. By creating a virtual replica of physical IoT devices, DT technology would allow for real-time monitoring and analysis without directly accessing operational technology, thus reducing the risk of compromising or reducing the performance of actual devices. This integration would further enhance the security of IoT ecosystems, combining AI technology to better flag and detect indications of malware-infected devices within a nuclear system environment.

42 ENGINEERING↗

A Fusion of Geothermal and InSAR Data with Machine Learning for Enhanced Deformation Forecasting at the Geysers

The Geysers geothermal field in California is experiencing land subsidence due to the seismic and geothermal activities taking place. This poses a risk not only to the underlying infrastructure but also to the groundwater level which would reduce the water availability for the local community. Because of this, it is crucial to monitor and assess the surface deformation occurring and adjust geothermal operations accordingly. In this study, we examine the correlation between the geothermal injection and production rates as well as the seismic activity in the area, and we show the high correlation between the injection rate and the number of earthquakes. This motivates the use of this data in a machine learning model that would predict future deformation maps. First, we build a model that uses interferometric synthetic aperture radar (InSAR) images that have been processed and turned into a deformation time series using LiCSBAS, an open-source InSAR time series package, and evaluate the performance against a linear baseline model. The model includes both convolutional neural network (CNN) layers as well as long short-term memory (LSTM) layers and is able to improve upon the baseline model based on a mean squared error metric. Then, after getting preprocessed, we incorporate the geothermal data by adding them as additional inputs to the model. This new model was able to outperform both the baseline and the previous version of the model that uses only InSAR data, motivating the use of machine learning models as well as geothermal data in assessing and predicting future deformation at The Geysers as part of hazard mitigation models which would then be used as fundamental tools for informed decision making when it comes to adjusting geothermal operations.

Yazbeck, Joe (ORCID:0000000302235260)↗

A Wrapper to Use a Machine-Learning-Based Algorithm for Earthquake Monitoring

Seismology is one of the main sciences used to monitor volcanic activity worldwide. Fast, efficient, and accurate seismicity detectors are crucial to assess the activity level of a volcano in near–real time and to issue timely warnings. Traditional real–time seismic processing software uses phase onset pickers followed by a phase association algorithm to declare an event and estimate its location. The pickers typically do not identify whether the detected phase is a P or S arrival, which can have a negative impact on hypocentral location quality and complicates phase association. We implemented the deep–neural–network–based method PhaseNet to identify in real time P and S seismic waves on data from one– and three–component seismometers. We tuned the Earthworm binder_ew associator module to use the phase identification from PhaseNet to detect and locate the events, which we archive in a SeisComP3 database. We assessed the performance of the algorithm by comparing the results with existing catalogs built to monitor seismic and volcanic activity in Mayotte and the Lesser Antilles region. Our algorithm, which we refer to as PhaseWorm, showed promising results in both contexts and clearly outperformed the previous automatic method implemented in Mayotte. As a result, this innovative real–time processing system is now operational for seismicity monitoring in Mayotte and Martinique.

58 GEOSCIENCES↗

Is the Distribution Grid Ready to Accept Large Scale Photovoltaic Deployment? - State of the Art, Progress and Future Prospects

The installed capacity of photovoltaic systems has recently increased at a much faster rate than the development of grid codes to effectively and efficiently manage high penetrations of PV within the distribution system. In a number of countries, PV penetrations in some regions are now raising growing concerns regarding integration. Management strategies vary considerably by country - some still have an approach that photovoltaic systems should behave as passive as possible while others demand an active participation in grid control. This variety of grid codes also causes challenges in learning from 'best practice'. This paper provides a review of current grid codes in some countries with high PV penetrations. In addition, the paper presents a number of country-specific case studies on different approaches for improved integration of photovoltaic systems in the distribution grid. In particular, we consider integration approaches using active and reactive power control that can reduce or defer expensive grid reinforcement while supporting higher PV penetrations.

14 SOLAR ENERGY↗

Materials characterization activities for %E2%80%9CTake Our Sons&Daughters to Work Day%E2%80%9D 2013.

We created interactive demonstration activities for Take Our Daughters&Sons to Work Day (TODSTWD) 2013 in order to promote general interest in chemistry and also generate awareness of the type of work our laboratories can perform. %E2%80%9CCurious about Mars Rover Curiosity?%E2%80%9D performed an elemental analysis on rocks brought to our lab using the same technique utilized on the planet Mars by the NASA robotic explorer Curiosity. %E2%80%9CFood is Chemistry?%E2%80%9D utilized a mass spectrometer to measure, in seconds, each participant's breath in order to identify the food item consumed for the activity. A total of over 130 children participated in these activities over a 3 hour block, and feedback was positive. This document reports the materials (including handouts), experimental procedures, and lessons learned so that future demonstrations can benefit from the baseline work performed. We also present example results used to prepare the Food activity and example results collected during the Curiosity demo.

Mowry, Curtis Dale↗

Importance of Upfront Preparatory Works for Vessel Internals Segmentation Projects - 16096

For more than thirty years, Westinghouse has been involved in reactor internals segmentation activities in the U.S. and Europe. Westinghouse completed in 2015 the segmentation of the reactor vessel and reactor vessel internals at the Jose Cabrera nuclear power plant in Spain and a similar project is on-going at Chooz A in France. Four more major reactor internals segmentation projects have been recently awarded in Sweden (Barsebaeck 1-2) and in Germany. (Philippsburg 1 and Neckarwestheim 1). For all reactor dismantling projects, it is essential that all activities are thoroughly planned and discussed upfront together with the customer. Detailed planning is crucial for achieving a successful project. One key activity in the preparation phase is the 'Segmentation and Packaging Plan' that documents the sequential steps required to segment, separate, and package each individual component, based on an activation analysis and component characterization study. Detailed procedures and specialized rigging equipment have to be developed to provide safeguards for preventing certain identified risks. The preparatory work can include some plant civil structure modifications for making the segmentation work easier and safer. Some original plant equipment is sometimes not suitable enough and need to be replaced. Before going to the site, testing and qualification are performed on full scale mock-ups in a specially designed pool for segmentation purposes. The mockup testing is an important step in order to verify the function of the equipment and minimize risk on site. This paper is describing the typical activities needed for preparing the reactor internals segmentation activities using under water mechanical cutting techniques. It will provide experiences and lessons learned that Westinghouse has collected from its recent projects and that will be applied for the new awarded projects. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Inferring low-dimensional microstructure representations using convolutional neural networks

We apply here recent advances in machine learning and computer vision to a central problem in materials informatics: the statistical representation of microstructural images. We use activations in a pretrained convolutional neural network to provide a high-dimensional characterization of a set of synthetic microstructural images. Next, we use manifold learning to obtain a low-dimensional embedding of this statistical characterization. We show that the low-dimensional embedding extracts the parameters used to generate the images. Finally, according to a variety of metrics, the convolutional neural network method yields dramatically better embeddings than the analogous method derived from two-point correlations alone.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Machine learning for the redox potential prediction of molecules in organic redox flow battery

Here, organic redox flow batteries (ORFB) are recognized as an innovative technology for the large-scale storage of renewable energy. The redox potential of organic redox-active molecules plays a vital role in their performance. Advanced screening techniques like high-throughput experiment and machine learning (ML) have significantly enhanced organic material performance and transformed the field of ORFB. However, the scarcity of experimental data poses a considerable challenge for ML model development in this domain. In our study, we developed lightweight graph-based Gaussian process regression (GPR) models with GPU-accelerated marginalized graph kernel and hybrid kernel to predict the redox potentials of organic redox-active molecules for ORFBs, specifically focusing on small datasets. To evaluate model accuracy, we created a new experimental database of organic redox-active molecules by the data from hundreds of published papers and assembled previous computational datasets. We also considered some key parameters, such as pH conditions and solvent type, to assess their impact on redox potential prediction. Our GPR model predicted redox potentials with high accuracy across all datasets using minimal training data. The study provides powerful tools for molecule screening and design and delivers valuable guidance on designing training datasets for costly experiments.

25 ENERGY STORAGE↗

Prediction of Specificity of α-Conotoxins to Subtypes of Human Nicotinic Acetylcholine Receptors with Semi-supervised Machine Learning

Conotoxins are a family of highly toxic neurotoxins composed of cysteine-rich peptides produced by marine cone snails. The most lethal cone snail species to humans is Conus geographus, with fatality rates of up to ∼65% from a single sting, which is caused mostly by the activity of α-conotoxins against human nicotinic acetylcholine receptors (nAChRs). While sequence-based machine learning (ML) classifiers have been trained to identify targets of conotoxins binding voltage-gated ion channels, no ML model has been built to predict the subtype-specific nAChR targets of α-conotoxins. Here, we trained an ML model in a semi-supervised manner to predict the specificity of α-conotoxin binding toward different human nAChR subtypes to overcome the challenge of limited data in subtype-specific nAChR targets of α-conotoxins and the issue that one α-conotoxin can bind multiple nAChR subtypes with high selectivity. We considered additional features of sequences of α-conotoxins in training our ML model, including the secondary structure propensities and electrostatic properties, which resulted in better prediction capability for the ML model. Notably, we identify that most α-conotoxins bind to α3β2, α1γδ, and α7 subtypes of human nAChRs. Our findings from this study provide a framework for predicting targets of various kinds of toxins.

59 BASIC BIOLOGICAL SCIENCES↗