Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Active learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,009 records · Page 56

A Fusion of Geothermal and InSAR Data with Machine Learning for Enhanced Deformation Forecasting at the Geysers

The Geysers geothermal field in California is experiencing land subsidence due to the seismic and geothermal activities taking place. This poses a risk not only to the underlying infrastructure but also to the groundwater level which would reduce the water availability for the local community. Because of this, it is crucial to monitor and assess the surface deformation occurring and adjust geothermal operations accordingly. In this study, we examine the correlation between the geothermal injection and production rates as well as the seismic activity in the area, and we show the high correlation between the injection rate and the number of earthquakes. This motivates the use of this data in a machine learning model that would predict future deformation maps. First, we build a model that uses interferometric synthetic aperture radar (InSAR) images that have been processed and turned into a deformation time series using LiCSBAS, an open-source InSAR time series package, and evaluate the performance against a linear baseline model. The model includes both convolutional neural network (CNN) layers as well as long short-term memory (LSTM) layers and is able to improve upon the baseline model based on a mean squared error metric. Then, after getting preprocessed, we incorporate the geothermal data by adding them as additional inputs to the model. This new model was able to outperform both the baseline and the previous version of the model that uses only InSAR data, motivating the use of machine learning models as well as geothermal data in assessing and predicting future deformation at The Geysers as part of hazard mitigation models which would then be used as fundamental tools for informed decision making when it comes to adjusting geothermal operations.

Yazbeck, Joe (ORCID:0000000302235260)↗

A Wrapper to Use a Machine-Learning-Based Algorithm for Earthquake Monitoring

Seismology is one of the main sciences used to monitor volcanic activity worldwide. Fast, efficient, and accurate seismicity detectors are crucial to assess the activity level of a volcano in near–real time and to issue timely warnings. Traditional real–time seismic processing software uses phase onset pickers followed by a phase association algorithm to declare an event and estimate its location. The pickers typically do not identify whether the detected phase is a P or S arrival, which can have a negative impact on hypocentral location quality and complicates phase association. We implemented the deep–neural–network–based method PhaseNet to identify in real time P and S seismic waves on data from one– and three–component seismometers. We tuned the Earthworm binder_ew associator module to use the phase identification from PhaseNet to detect and locate the events, which we archive in a SeisComP3 database. We assessed the performance of the algorithm by comparing the results with existing catalogs built to monitor seismic and volcanic activity in Mayotte and the Lesser Antilles region. Our algorithm, which we refer to as PhaseWorm, showed promising results in both contexts and clearly outperformed the previous automatic method implemented in Mayotte. As a result, this innovative real–time processing system is now operational for seismicity monitoring in Mayotte and Martinique.

58 GEOSCIENCES↗

Machine learning for the redox potential prediction of molecules in organic redox flow battery

Here, organic redox flow batteries (ORFB) are recognized as an innovative technology for the large-scale storage of renewable energy. The redox potential of organic redox-active molecules plays a vital role in their performance. Advanced screening techniques like high-throughput experiment and machine learning (ML) have significantly enhanced organic material performance and transformed the field of ORFB. However, the scarcity of experimental data poses a considerable challenge for ML model development in this domain. In our study, we developed lightweight graph-based Gaussian process regression (GPR) models with GPU-accelerated marginalized graph kernel and hybrid kernel to predict the redox potentials of organic redox-active molecules for ORFBs, specifically focusing on small datasets. To evaluate model accuracy, we created a new experimental database of organic redox-active molecules by the data from hundreds of published papers and assembled previous computational datasets. We also considered some key parameters, such as pH conditions and solvent type, to assess their impact on redox potential prediction. Our GPR model predicted redox potentials with high accuracy across all datasets using minimal training data. The study provides powerful tools for molecule screening and design and delivers valuable guidance on designing training datasets for costly experiments.

25 ENERGY STORAGE↗

Prediction of Specificity of α-Conotoxins to Subtypes of Human Nicotinic Acetylcholine Receptors with Semi-supervised Machine Learning

Conotoxins are a family of highly toxic neurotoxins composed of cysteine-rich peptides produced by marine cone snails. The most lethal cone snail species to humans is Conus geographus, with fatality rates of up to ∼65% from a single sting, which is caused mostly by the activity of α-conotoxins against human nicotinic acetylcholine receptors (nAChRs). While sequence-based machine learning (ML) classifiers have been trained to identify targets of conotoxins binding voltage-gated ion channels, no ML model has been built to predict the subtype-specific nAChR targets of α-conotoxins. Here, we trained an ML model in a semi-supervised manner to predict the specificity of α-conotoxin binding toward different human nAChR subtypes to overcome the challenge of limited data in subtype-specific nAChR targets of α-conotoxins and the issue that one α-conotoxin can bind multiple nAChR subtypes with high selectivity. We considered additional features of sequences of α-conotoxins in training our ML model, including the secondary structure propensities and electrostatic properties, which resulted in better prediction capability for the ML model. Notably, we identify that most α-conotoxins bind to α3β2, α1γδ, and α7 subtypes of human nAChRs. Our findings from this study provide a framework for predicting targets of various kinds of toxins.

59 BASIC BIOLOGICAL SCIENCES↗

Screening of bimetallic electrocatalysts for water purification with machine learning

Electrocatalysis provides a potential solution to NO 3 - pollution in wastewater by converting it to innocuous N 2 gas. However, materials with excellent catalytic activity are typically limited to expensive precious metals, hindering their commercial viability. Here, in response to this challenge, we have conducted the most extensive computational search to date for electrocatalysts that can facilitate NO 3 - reduction reaction, starting with 59 390 candidate bimetallic alloys from the Materials Project and Automatic-Flow databases. Using a joint machine learning- and computation-based screening strategy, we evaluated our candidates based on corrosion resistance, catalytic activity, N 2 selectivity, cost, and the ability to synthesize. We found that only 20 materials will satisfy all criteria in our screening strategy, all of which contain varying amounts of Cu. Our proposed list of candidates is consistent with previous materials investigated in the literature, with the exception of Cu–Co and Cu–Ag based compounds that merit further investigation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A Machine Learning Approach to Objective Identification of Dust in Satellite Imagery

Airborne dust has broad adverse effects on human activity, including aviation, human health, and agriculture. Remote sensing observations are used to detect dust and aerosols in the atmosphere using long established techniques. False color Red-Green-Blue (RGB) imagery using band differences sensitive to dust absorption (Dust RGB) is currently used operationally to assist forecasters and decision-makers in identifying dust at night, but there are still limitations, subjectivity, and nuances to image interpretation making night-time dust identification difficult even for experts. This study applies machine learning to the problem of night-time dust detection with a simple random forest (RF) model using Geostationary Operational Environmental Satellite-16 (GOES-16) Advanced Baseline Imager (ABI) infrared imagery, band differences sensitive to dust absorption, and Dust RGB color components as inputs to the model. The RF model achieves an Area-Under-Curve (AUC) of 0.97 with a standard deviation of 0.04 for dust cases. For images with dust present, the model correctly labels 85% of dust pixels and 99.96% of no-dust pixels for all dust images in the validation data set. The addition of a single null case to the training data set drastically reduces error in labeling no-dust pixels as dust from 45% to 14.5%. Application of the machine learning model to the April 13–14, 2019 dust event demonstrates the ability of the model to identify dust during night-time hours when visual dust detection is limited by the cooling ground surface characteristics.

dust↗

Lessons Learned from the Space Shuttle Engine Cutoff System (ECO) Anomalies

The Space Shuttle Orbiter's main engine cutoff (ECO) system first failed ground checkout in April, 2005 during a first tanking test prior to Return-to-Flight. Despite significant troubleshooting and investigative efforts that followed, the root cause could not be found and intermittent anomalies continued to plague the Program. By implementing hardware upgrades, enhancing monitoring capability, and relaxing the launch rules, the Shuttle fleet was allowed to continue flying in spite of these unexplained failures. Root cause was finally determined following the launch attempts of STS-122 in December, 2007 when the anomalies repeated, which allowed drag-on instrumentation to pinpoint the fault (the ET feedthrough connector). The suspect hardware was removed and provided additional evidence towards root cause determination. Corrective action was implemented and the system has performed successfully since then. This white paper presents the lessons learned from the entire experience, beginning with the anomalies since Return-to-Flight through discovery and correction of the problem. To put these lessons in better perspective for the reader, an overview of the ECO system is presented first. Next, a chronological account of the failures and associated investigation activities is discussed. Root cause and corrective action are summarized, followed by the lessons learned.

Martinez, Hugo E.↗

Experimentally Driven Automated Machine-Learned Interatomic Potential for a Refractory Oxide

Understanding the structure and properties of refractory oxides is critical for high temperature applications. In this work, a combined experimental and simulation approach uses an automated closed loop via an active learner, which is initialized by x-ray and neutron diffraction measurements, and sequentially improves a machine-learning model until the experimentally predetermined phase space is covered. Furthermore, a multiphase potential is generated for a canonical example of the archetypal refractory oxide, HfO 2 , by drawing a minimum number of training configurations from room temperature to the liquid state at similar to 2900 degrees C. The method significantly reduces model development time and human effort.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

AEcroscopy: A Software–Hardware Framework Empowering Microscopy Toward Automated and Autonomous Experimentation

Microscopy has been pivotal in improving the understanding of structure-function relationships at the nanoscale and is by now ubiquitous in most characterization labs. However, traditional microscopy operations are still limited largely by a human-centric click-and-go paradigm utilizing vendor-provided software, which limits the scope, utility, efficiency, effectiveness, and at times reproducibility of microscopy experiments. Here, in this work, a coupled software–hardware platform is developed that consists of a software package termed AEcroscopy (short for Automated Experiments in Microscopy), along with a field-programmable-gate-array device with LabView-built customized acquisition scripts, which overcome these limitations and provide the necessary abstractions toward full automation of microscopy platforms. The platform works across multiple vendor devices on scanning probe microscopes and electron microscopes. It enables customized scan trajectories, processing functions that can be triggered locally or remotely on processing servers, user-defined excitation waveforms, standardization of data models, and completely seamless operation through simple Python commands to enable a plethora of microscopy experiments to be performed in a reproducible, automated manner. This platform can be readily coupled with existing machine-learning libraries and simulations, to provide automated decision-making and active theory-experiment optimization to turn microscopes from characterization tools to instruments capable of autonomous model refinement and physics discovery.

47 OTHER INSTRUMENTATION↗

Analysis of the molecular determinants for furin cleavage of the spike protein S1/S2 site in defined strains of the prototype coronavirus murine hepatitis virus (MHV)

We analyzed the spike protein S1/S2 cleavage of selected strains of a prototype coronavirus, mouse hepatitis virus (MHV) by the cellular protease furin, in order to understand the structural requirements underlying the sequence selectivity of the scissile segment. The probability of cleavage of selected MHV strains was first evaluated from furin cleavage scores predicted by the ProP computer software, and then cleavage was measured experimentally with a fluorogenic peptide cleavage assay consisting of S1/S2 peptide mimics and purified furin. We found that in vitro cleavability varied across MHV strains in line with predicted results—but with the notable exception of MHV-A59, which was not cleaved despite a high score predicted for its sequence. Using the known X-Ray structure of furin in complex with a substrate-like inhibitor as an initial structural reference, we carried out molecular dynamics (MD) simulations to learn the modes of binding of the peptides in the furin active site, and the suitability of the complex for initiation of the enzymatic cleavage. We identified the 3D structural requirements of the furin active site configuration that enable bound peptides to undergo cleavage, and the way in which the various strains tested experimentally are fulfilling these requirements. We find that despite some flexibility in the organization of the peptide bound to the active site of the enzyme, the presence of a histidine at P2 of MHV-A59 fails to properly orient the sidechain of His194 of the furin catalytic triad and therefore produces a distortion that renders the peptide/complex structural configuration in the active site incompatible with requirements for cleavage initiation. The Ser/Thr in P1 of MHV-2 and MHV-S has a similar effect of distorting the conformation of the furin active site residues produced by the elimination of the canonical salt-bridge formed by arginine in P1 position. This work informs a study of coronavirus infection and pathogenesis with respect to the function of the viral spike protein, and suggests an important process of viral adaptation and evolution within the spike S1/S2 structural loop.

60 APPLIED LIFE SCIENCES↗

High-throughput solubility determination for data-driven materials design and discovery in redox flow battery research

Solubility is crucial for redox flow batteries because it affects their energy density. A data-driven approach based on artificial intelligence/machine learning models can accelerate the development of highly soluble redox-active materials, but the lack of relevant, large-quantity data makes accurate solubility prediction difficult. To overcome this deficiency, we developed a high-throughput experimentation process that combines a robotically controlled platform with high-throughput methodology to collect large-scale and high-quality solubility data. We demonstrate the potential utility and applicability of this high-throughput process by measuring the aqueous and non-aqueous solubilities of redox-active materials and studying the effect of additives on their solubilities for both aqueous and non-aqueous redox flow battery applications. A redox flow battery based on our optimized negative electrolyte formulation and a ferrocyanide-positive electrolyte offers highly stable performance over 18 days (>100 cycles) with consistent capacity and a 24% boost in energy density.

25 ENERGY STORAGE↗

Digital Rocks Portal (Digital Porous Media): Connecting data, simulation and community

Digital Rocks Portal (DRP, https://www.digitalrocksportal.org) organizes and preserves imaged datasets and experimental measurements of porous materials in subsurface, and beyond, with the mission to connect them to simulation and analysis, as well as educate the research community. We have over 150 projects represented in more than 200 publications, and an active community that reuses the data, most recently in multiple machine learning applications for automating image analysis as well as the prediction of transport. Such automation is crucial for performing formation evaluation tasks in near-real time. We present benchmark datasets that have played a role in recent machine learning prediction successes in the field. We further discuss the vision for further research advances, educational materials, as well as growth and sustainability plan of this digital rock physics community resource. In particular, we are in the process of expanding into a broader repository of engineered porous materials, specifically those for energy storage and the portal will transition to Digital Porous Media (DPM) in near future.

58 GEOSCIENCES↗

Automated nuclear cloud feature extraction from film

Chemical, biological, radiological, nuclear, and explosives incidents require rapid detection and characterization for appropriate response. For a nuclear detonation, visible-light cameras may be used to locate the cloud and characterize fallout deposition when coupled with numerical models. Films from the United States’ nuclear testing era compose the only sizeable collection of imagery depicting high-yield detonations. These films offer unique insights into characteristics of flows involving scales that are difficult to replicate experimentally, and they are a valuable source of data for the validation of models for nuclear fallout transport, either as part of emergency response or forensic activities. In this work, we implement modern computer vision and machine learning techniques to identify and track the cloud automatically and subsequently determine the time dependence of some of its features. We trained a ResNet-18 image classifier on hundreds of images to categorize nuclear cloud morphology. Each category or cloud regime is determined by early cloud evolution and is associated to constitutive properties of the flow, such as distribution of vorticity. Next, we identified keypoint features using the KAZE algorithm and tracked these keypoints in the images, allowing us to determine the dimensions and velocities of the cloud across film frames. These measurements converted to real-world units provide valuable experimental data that can be used in the development and validation of nuclear cloud models. We compared the results of this method against manual cloud rise measurements from two different films. In one, our automated method accelerated the feature extraction process without sacrificing measurement accuracy.

Khristy, Joel [ORNL] (ORCID:0000000209963060)↗

NuclPred v1

This tool takes a genome assembly as input and predicts per-site nucleosome occupancy as output. Trained on physical maps of nucleosome binding preferences across the fungal kingdom, NuclPred can be applied broadly across fungi (and other eukaryotes). This breadth, combined with its accuracy, means it could have both basic and applied biological implications, for example in understanding eukaryotic gene regulation and genetic engineering. Almost universally across eukaryotes, nucleosomes - each wrapping ~150 base pairs of DNA - serve to package DNA inside the nucleus, with major consequences on DNA access, gene activity and DNA integration. NuclPred was generated using a supervised deep learning approach combining convolutional and recurrent neural networks to take DNA features (nucleotides, GC content and structural information) as input, then use that information to predict the physical attractiveness DNA sequences might have for forming nucleosomes. With this information at hand, researchers can design more efficient CRISPR constructs, explore the interplay between DNA signatures and other regulators impact nucleosome locations, predict expression patterns, etc. This tool will be published as part of a manuscript currently under revision at iScience (draft attached).

Mondo, Stephen↗

Physical Sciences Vistas, Issue 1 2021 [Newsletter]

Issue 1 highlights of the Los Alamos Physical Sciences Vistas newsletter include: Finding and aiding success through the Lab's employee scholarship fund; Volunteer vignettes: helping others throughout Northern New Mexico; X-ray topography instrument reimagined for use at Oregon State University; Potentially activated metal recycle project triples its goal; Adaptive 3D machine-learning method for 3D coherent diffraction imaging; and, Sigma team aims for excellence in safety, quality, productivity.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Synthetic Data and Graph Generation for Modeling Adversarial Activity (Final Project Report)

The Data and Graph Generation for Modeling Adversary Activity (MAA) project developed a methodology along with scalable graph modeling and generation tools to produce realistic large-scale background activity graphs with embedded adversarial activity pathways. The technical report presents PNNL methodology, released datasets, lessons learned, and recommendations to develop graph analytic algorithms for structure-only and attributed knowledge graphs.

97 MATHEMATICS AND COMPUTING↗

Demonstration and Evaluation of the Human-Technology Integration Function Allocation Methodology

There is an imminent need for the existing nuclear power plants to reduce their operating and maintenance (O&M) costs to remain economically viable. Digital technology, including automation, provides a significant opportunity for the existing nuclear power plant fleet to transform the way in which work is accomplished, reducing O&M costs, and allowing the fleet to remain economically competitive. One notable opportunity to significantly reduce O&M costs pertains to modifications to the plant equipment and main control room (MCR). Existing instrumentation and control (I&C) technologies in the MCR are highly analog, costly to operate and maintain, and demand a high cognitive and physical workload from plant staff (i.e., operators). Digitalizing the MCR has a range of broad economic benefits, including improved plant performance and reduced manual work. Further, digital I&C systems can fundamentally change the way in which plant staff operate the plant; this is the concept of operation. Human-technology integration is important to ensure that impacts to the concept of operation are done in a way that account for capabilities of people and technology. Human-technology integration employs human factors engineering (HFE) methods and principles to maximize the benefits of digital technology, reducing human error, improving overall decision-making and usability. The U.S. Department of Energy Light Water Reactor Sustainability Program is applying human-technology integration research to ensure digital technologies are safe, reliable, and efficient. This paper documents the demonstration of the human-technology guidance developed by the Light Water Reactor Sustainability Program from a first-of-a-kind digital I&C upgrade, specifically addressing function analysis and allocation for a new digital I&C system that included changes in automation levels. The program’s specific approach is included in this work, following lessons learned. This document serves as a resource for industry to follow in applying human-technology integration and HFE to digital modifications, specific to function analysis and allocation. The lessons learned should be considered in the planning and execution of HFE activities that support such digital modifications.

99 GENERAL AND MISCELLANEOUS↗

Maritime Fuel Cell Generator Project: 2018 – 2023

This report summarizes activity in the Maritime Fuel Cell (MarFC) Generator Project from 2018 – 2023. FY 2018 saw the implementation of upgrades and repairs, making the unit more reliable and operator friendly. In FY2019 the team engaged the Scripps Institution of Oceanography (SIO) to use the MarFC to provide zero-emission shore power to the research vessel R/V Robert Gordon Sproul while in port at the Nimitz Marine Facility in San Diego, CA. In FY2020, the MarFC unit was shipped to San Diego, CA. A fueling contract with IGX was established to support MarFC operations at SIO, with renewable hydrogen provided by the California State University Los Angeles (CSULA) hydrogen station. The project team (Sandia, Cummins/Hydrogenics) provided training to SIO staff on the technical details of the MarFC, the safe use of hydrogen in general and the MarFC in particular. The first fueling of the unit at the SIO pier was successfully completed by IGX. The first powering of a vessel with fuel-cell shore power was conducted with the R/V Robert Gordon Sproul. While the mechanical systems (lights, AC, ventilation, hydraulics, pumps and cranes) were powered without incident, problems arose when powering the computer systems. Inspections carried out in FY2021 revealed the MarFC needed routine maintenance. Maintenance was performed and the unit was upgraded. The MarFC was turned on after the year pause, and initial test data on power levels and stability were collected. FY2022 was a year spent repairing, upgrading and testing the MarFC unit. Spikes in power and voltage were observed above 60 kW that could potentially extend below 60 kW with time. Such spikes could cause problems with the Sproul electrical systems. These age-related problems, the extended time for the Sproul spent in dry dock for scheduled upgrades, and the associated need to reschedule the vessel’s high-priority science missions made it no longer possible to deploy the unit at SIO. After due consideration, the decision was made by DOE, MARAD and the project team to cease the deployment, remove the MarFC from SIO, and not pursue further deployment activities. On December 2, 2022, the MarFC unit was removed from the Scripps Nimitz Marine Facility and shipped to Fridley, Michigan. The Cummins/Hydrogenics plan for the unit is to assess the condition of the MarFC subcomponents, and then use it as a training/learning system for technical employees new to hydrogen fuel-cell technology. After summarizing project activity from 2018 – 2023, this report provides a review of lessons learned. This report provides next steps in contemplating a follow-on project that would further advance the use of fuel-cell-based shore power in a marine setting. A comparison is made of the project results to the original objectives. This report ends with an accounting of presentations stemming from the project, and a list of references.

08 HYDROGEN↗