Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Active Learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58

Learning Behavior of Distribution System Discrete Control Devices for Cyber-Physical Security

Conventional cyber-security intrusion detection systems monitor network traffic for malicious activity and indications that an adversary has gained access to the system. The approach discussed here expands the idea of a traditional intrusion detection system within electrical power systems, specifically power distribution networks, by monitoring the physical behavior of the grid. This is achieved through the use of high-rate distribution Phasor Measurement Units (PMUs), alongside SCADA packets analysis, for the purpose of monitoring the behavior of discrete control devices. In this work we present a set of algorithms for passively learning the control logic of voltage regulators and switched capacitor banks. Upon detection of an abnormal operation, the operator is alerted and further action can be taken. Finally, the proposed learning algorithms are validated on both simulated data and on measured PMU data from a utility pilot deployment site.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Inverse Reinforcement Learning based Bayesian Goal Inference Method for Early Nuclear Proliferation Detection

Traditional methods for detection of nuclear proliferation indicators are usually applied after nuclear proliferation has already occurred. There is a need to advance these methods to perform early detection of nuclear proliferation indicators. In this project, we formulated an early detection problem as a sequential, decision-making, goal inference problem based on research publications of authors, to determine whether it is possible to infer whether an author will publish on a research activity before it has occurred. To develop and test our approach, we selected a civil nuclear activity for our case study. We constructed a state-action-state transition graph from publications of authors associated with the activity and the co-authors of their publications, using titles, abstracts, and author publication sequences. We then used inverse reinforcement learning to model the goal-directed behavior of authors in trajectories that terminate at selected goal states. Using a Bayesian formulation, we computed the probability that authors would reach each selected state from partially observed trajectories of their state transitions in their research topic space. The state with the highest probability was selected as the most probable goal state. Based on our results, we found that 60% of the times we can infer the correct goal state early; sometimes the inference is either delayed, or multiple states could be inferred as goal states. Overall, our results show that it is possible to perform early detection of research activities of authors in a nuclear technology area. Further research is necessary to establish a more accurate understanding of how topic modeling, topic space grid discretization, and the extent of overlap among trajectories of different goal states, affect the goal inference results. The methods developed in this work may be used to enhance data-driven methods for early detection of nuclear proliferation indicators.

97 MATHEMATICS AND COMPUTING↗

High throughput exploration of the oxidation landscape in high entropy alloys

We report high entropy alloys (HEAs) have gained interest for structural applications in extreme environments. With a potentially vast chemical and phase space, there are significant opportunities to discover superior performing alloys. Crucial for most high-temperature applications is understanding and mitigating the oxidation behavior of these chemically complex alloys. Most experimental and computational HEA studies have focused on a limited set of compositions and only a fraction these compositions have been characterized for oxidation. We present a high-throughput framework that utilizes density-functional theory (DFT) in concert with a combined machine-learning model and grand-canonical linear programming for assessing phase stability, phase-fraction, chemical activity and high-temperature survivability of arbitrary HEAs. This framework considers temperature dependent contributions to the Gibbs energy of the competing phases arising from short-range order and vibrational entropy. We demonstrate the effectiveness of the framework by assessing the thermodynamic stability, oxidation behavior, chemical activity, and phase decomposition of body-centered cubic Mo-W-Ta-Ti-Zr refractory HEAs. A total of 51 compositions were analyzed and ranked in order of their survivability based on the Pareto-front analysis. Oxidation was performed at 1373 K on fours samples in air showing the difference in oxidation behavior determined experimentally through scale thickness and their mass changes. The insights on oxidation behavior presented in this work will enable the fast assessment of technologically useful HEAs needed for future structural application in extreme conditions

36 MATERIALS SCIENCE↗

Applying Machine Learning to the Classification of DC-DC Converters. NA-22 Final Report

Tools are now available that enable measurement electromagnetic radiation (EMR) from active electronics in an item. This radiation may be intended WIFI or cellular network links, for example or unintended such as the switching noise generated by DC-to-DC converters. It would be extremely valuable to have the capability to discriminate between the low-voltage DC-to-DC converters or other digital noise prevalent in most modern electronics, versus the high-voltage DC-to-DC converters used in utility firesets. Previous work performed under a Sandia Laboratory Directed Research and Development (LDRD) project on Charge State Detection using a deep neural network has been continued in this effort. A state-of-the-art supervised machine learning algorithm has not only been extended to discriminate between low and high voltage converters but has been validated in determining a converters make and model.

42 ENGINEERING↗

CoolPINNs: A physics-informed neural network modeling of active cooling in vascular systems

Emerging technologies like hypersonic aircraft, space exploration vehicles, and batteries avail fluid circulation in embedded microvasculatures for efficient thermal regulation. Modeling is vital during the design and operational phases of these engineered systems. However, many challenges exist in developing a modeling framework. What is lacking is an accurate framework that (i) captures sharp jumps in the thermal flux across complex vasculature layouts, (ii) deals with oblique derivatives (involving tangential and normal components), (iii) handles nonlinearity because of radiative heat transfer, (iv) provides a high-speed forecast for real-time monitoring, and (v) facilitates robust inverse modeling. Here, this paper addresses these challenges by availing the power of physics-informed neural networks (PINNs). We develop a fast, reliable, and accurate Scientific Machine Learning (SciML) framework for vascular-based thermal regulation—called CoolPINNs: a PINNs-based modeling framework for active cooling. The proposed mesh-less framework elegantly overcomes all the mentioned challenges. The significance of the reported research is multi-fold. First, the framework is valuable for real-time monitoring of thermal regulatory systems because of rapid forecasting. Second, researchers can address complex thermoregulation designs since the approach is meshless. Finally, the framework facilitates systematic parameter identification and inverse modeling studies, perhaps the most significant utility of the current framework.

97 MATHEMATICS AND COMPUTING↗

Machine learning reveals sequence-function relationships in family 7 glycoside hydrolases

Family 7 glycoside hydrolases (GH7) are among the principal enzymes for cellulose degradation in nature and industrially. These important enzymes are often bimodular, including a catalytic domain and carbohydrate binding module (CBM) attached via a flexible linker, and exhibit an active site that binds cello-oligomers of up to ten glucosyl moieties. GH7 cellulases consist of two major subtypes: cellobiohydrolases (CBH) and endoglucanases (EG). Despite the critical importance of GH7 enzymes, there remain gaps in our understanding of how GH7 sequence and structure relate to function. Here, we employed machine learning to gain data-driven insights into relationships between sequence, structure, and function across the GH7 family. Machine-learning models, trained only on the number of residues in the active-site loops as features, were able discriminate GH7 CBHs and EGs with up to 99% accuracy, demonstrating that the lengths of loops A4, B2, B3, and B4 strongly correlate with functional subtype across the GH7 family. Classification rules were derived such that specific residues at 42 different sequence positions each predicted the functional subtype with accuracies surpassing 87%. A random forest model trained on residues at 19 positions in the catalytic domain predicted the presence of a CBM with 89.5% accuracy. Our ML results recapitulate, as top-performing features, a substantial number of the sequence positions determined by previous experimental studies to play vital roles in GH7 activity. We surmise that the yet-to-be-explored sequence positions among the top-performing features also contribute to GH7 functional variation and may be exploited to understand and manipulate function.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Identification of carbohydrate gene clusters obtained from in vitro fermentations as predictive biomarkers of prebiotic responses

Prebiotic fibers are non-digestible substrates that modulate the gut microbiome by promoting expansion of microbes having the genetic and physiological potential to utilize those molecules. Although several prebiotic substrates have been consistently shown to provide health benefits in human clinical trials, responder and non-responder phenotypes are often reported. These observations had led to interest in identifying, a priori, prebiotic responders and non-responders as a basis for personalized nutrition. In this study, we conducted in vitro fecal enrichments and applied shotgun metagenomics and machine learning tools to identify microbial gene signatures from adult subjects that could be used to predict prebiotic responders and non-responders. Using short chain fatty acids as a targeted response, we identified genetic features, consisting of carbohydrate active enzymes, transcription factors and sugar transporters, from metagenomic sequencing of in vitro fermentations for three prebiotic substrates: xylooligosacharides, fructooligosacharides, and inulin. A machine learning approach was then used to select substrate-specific gene signatures as predictive features. These features were found to be predictive for XOS responders with respect to SCFA production in an in vivo trial. Our results confirm the bifidogenic effect of commonly used prebiotic substrates along with inter-individual microbial responses towards these substrates. We successfully trained classifiers for the prediction of prebiotic responders towards XOS and inulin with robust accuracy (≥ AUC 0.9) and demonstrated its utility in a human feeding trial. Overall, the findings from this study highlight the practical implementation of pre-intervention targeted profiling of individual microbiomes to stratify responders and non-responders.

59 BASIC BIOLOGICAL SCIENCES↗

Importance of Engineered and Learned Molecular Representations in Predicting Organic Reactivity, Selectivity, and Chemical Properties

Machine-readable chemical structure representations are foundational in all attempts to harness machine learning for the prediction of reactivities, selectivities, and chemical properties directly from molecular structure. The featurization of discrete chemical structures into a continuous vector space is a critical phase undertaken before model selection, and the development of new ways to quantitatively encode molecules is an active area of research. Here, we highlight the application and suitability of different representations, from expert-guided “engineered” descriptors to automatically “learned” features, in different prediction tasks relevant to organic and organometallic chemistry, where differing amounts of training data are available. These tasks include statistical models of stereo- and enantioselectivity, thermochemistry, and kinetics developed using experimental and quantum chemical data. The use of expert-guided molecular descriptors provides an opportunity to incorporate chemical knowledge, domain expertise, and physical constraints into statistical modeling. In applications to stereoselective organic and organometallic catalysis, where data sets may be relatively small and 3D-geometries and conformations play an important role, mechanistically informed features can be used successfully to obtain predictive statistical models that are also chemically interpretable. We provide an overview of several recent applications of this approach to obtain quantitative models for reactivity and selectivity, where topological descriptors, quantum mechanical calculations of electronic and steric properties, along with conformational ensembles, all feature as essential ingredients of the molecular representations used. Alternatively, more flexible, general-purpose molecular representations such as attributed molecular graphs can be used with machine learning approaches to learn the complex relationship between a structure and prediction target. This approach has the potential to out-perform more traditional representation methods such as “hand-crafted” molecular descriptors, particularly as data set sizes grow. One area where this is particularly relevant is in the use of large sets of quantum mechanical data to train quantitative structure–property relationships. A general approach toward curating useful data sets and training highly accurate graph neural network models is discussed in the context of organic bond dissociation enthalpies, where this strategy outperforms regression using precomputed descriptors. Finally, we describe how graph neural network predictions can be incorporated into mechanistically informed statistical models of chemical reactivity and selectivity. Once trained, this approach avoids the expensive computational overhead associated with quantum mechanical calculations, while maintaining chemical interpretability. We illustrate examples for which fast predictions of bond dissociation enthalpy and of the identities of radicals formed through cleavage of a molecule’s weakest bond are used in simple physical models of site-selectivity and reactivity.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Can Accelerators Accelerate Learning?

The 'Young Talented' education program developed by the Brazilian State Funding Agency (FAPERJ)[1] makes it possible for high-schools students from public high schools to perform activities in scientific laboratories. In the Atomic and Molecular Physics Laboratory at Federal University of Rio de Janeiro (UFRJ), the students are confronted with modern research tools like the 1.7 MV ion accelerator. Being a user-friendly machine, the accelerator is easily manageable by the students, who can perform simple hands-on activities, stimulating interest in physics, and getting the students close to modern laboratory techniques.

43 PARTICLE ACCELERATORS↗

Machine Learning Approaches for Predicting Radiation Therapy Outcomes: A Clinician's Perspective

Radiation oncology has always been deeply rooted in modeling, from the early days of isoeffect curves to the contemporary Quantitative Analysis of Normal Tissue Effects in the Clinic (QUANTEC) initiative. In recent years, medical modeling for both prognostic and therapeutic purposes has exploded thanks to increasing availability of electronic data and genomics. One promising direction that medical modeling is moving toward is adopting the same machine learning methods used by companies such as Google and Facebook to combat disease. Broadly defined, machine learning is a branch of computer science that deals with making predictions from complex data through statistical models. These methods serve to uncover patterns in data and are actively used in areas such as speech recognition, handwriting recognition, face recognition, “spam” filtering (junk email), and targeted advertising. Although multiple radiation oncology research groups have shown the value of applied machine learning (ML), clinical adoption has been slow due to the high barrier to understanding these complex models by clinicians. Here, we present a review of the use of ML to predict radiation therapy outcomes from the clinician's point of view with the hope that it lowers the “barrier to entry” for those without formal training in ML. We begin by describing 7 principles that one should consider when evaluating (or creating) an ML model in radiation oncology. We next introduce 3 popular ML methods—logistic regression (LR), support vector machine (SVM), and artificial neural network (ANN)—and critique 3 seminal papers in the context of these principles. Although current studies are in exploratory stages, the overall methodology has progressively matured, and the field is ready for larger-scale further investigation.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Deep Kronecker neural networks: A general framework for neural networks with adaptive activation functions

Here we propose a new type of neural networks, Kronecker neural networks (KNNs), that form a general framework for neural networks with adaptive activation functions. KNNs employ the Kronecker product, which provides an efficient way of constructing a very wide network while keeping the number of parameters low. Our theoretical analysis reveals that under suitable conditions, KNNs induce a faster decay of the loss than that by the feed-forward networks. This is also empirically verified through a set of computational examples. Furthermore, under certain technical assumptions, we establish global convergence of gradient descent for KNNs. As a specific case, we propose the Rowdy activation function that is designed to get rid of any saturation region by injecting sinusoidal fluctuations, which include trainable parameters. The proposed Rowdy activation function can be employed in any neural network architecture like feed-forward neural networks, Recurrent neural networks, Convolutional neural networks etc. The effectiveness of KNNs with Rowdy activation is demonstrated through various computational experiments including function approximation using feed-forward neural networks, solution inference of partial differential equations using the physics-informed neural networks, and standard deep learning benchmark problems using convolutional and fully-connected neural networks.

97 MATHEMATICS AND COMPUTING↗

Electrochemical model of the polyaniline based organic memristive device

The electrochemical organic memristive device with polyaniline active layer is a stand-alone device designed and realized for reproduction of some synapse properties in the innovative electronic circuits, including the neuromorphic networks capable for learning. In this work, a new theoretical model of the polyaniline memristive is presented. The developed model of organic memristive functioning was based on the detailed consideration of possible electrochemical processes occuring in the active zone of this device. Results of the calculation have demonstrated not only the qualitative explanation of the characteristics observed in the experiment but also the quantitative similarities of the resultant current values. It is shown how the memristive could behave at zero potential difference relative to the reference electrode. This improved model can establish a basis for the design and prediction of properties of more complicated circuits and systems (including stochastic ones) based on the organic memristive devices.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Texturizing Wind Turbine Towers to Reduce Bat Mortality

There is still a great need for the development of mitigation strategies that are economically viable and can be used alone or in combination with other options (e.g., operational minimization, acoustic deterrents) to ensure that bat fatalities are effectively reduced at wind facilities across the U.S. Our goal was to develop a wind turbine tower coating that 1) bats show little or no interest in approaching, 2) can be applied to currently deployed wind turbine towers and to towers as they are constructed, 3) is economically feasible to produce and apply, and 4) ultimately contributes to a reduction in bat mortality at utility-scale wind facilities. Wind turbine tower monopoles are large, smooth surfaces and numerous studies have reported bats making close investigative approaches at turbine tower surfaces that are suggestive of drinking and foraging behavior. We therefore hypothesized that such activity could be contributing to bat-wind turbine fatalities by increasing the amount of time that bats spend in or around the rotor-swept zone. We further hypothesized that a texturizing the tower might minimized bat activity at the towers and therefore reduce fatality risk. To explore this, we designed a series of experiments to characterize how bats interact with smooth and texture-treated surfaces in a controlled environment. We conducted 64 behavioral trials in a flight facility from 10 June to 25 September 2015 and an additional 76 behavioral trials from 9 June to 30 August 2016. The first set of trials showed that while bats did make contact with smooth surfaces, they did not make contact with textured surfaces. We ascertained that bat activity occurred at 0 to 1 m distances from surfaces, suggesting that the bats (used in this study) may need to be this close to a surface to accurately discern its texture. From the results were developed a texture coating. For the second set of trials, we tested the texture coating. Bats showed a >40% reduction in activity within 1 m of the textured surfaces in comparison to the smooth surfaces. Following these controlled experiments, we conducted field tests at Wolf Ridge Wind, LLC. We applied the texture coating to the midsection of turbine monopoles. The texture coating was manually applied to 2 turbine towers, although we noted during the application there was variation in texture coating between turbines. We considered that this variation could potentially impact bat behavior. We then conducted bat activity surveys at both texture-treated towers and 2 nearby control towers, over 55 nights from 24 June to 22 September, 2017. All species of bats known to be present at the site were detected in the acoustic recordings at these turbine towers. We found no significant differences in overall numbers of bats observed and levels of acoustic activity at the smooth and texture-treated towers. When we analyzed the experimental pairs separately, however, we found that a greater proportion of the close range bat activity within Pair 1 occurred at the texture-treated tower and that much of this activity could be attributed to foraging behavior. In contrast at turbine Pair 2, we observed no difference in the proportion of close range bat activity between the smooth and texture-treated tower, with no clear differences in behavior at the two tower types. When we examined acoustic bat activity at the tower pairs separately, we found species-specific differences in activity that differed between the smooth and texture-treated towers within the pairs. For example, hoary bat acoustic activity was significantly higher at the texture-treated tower in Pair 1, but significantly lower at the texture-treated tower in Pair 2. Given the observational nature of the field test, our limited sample size (2 turbine pairs), variation in the texture-coating between the 2 turbine pairs, and different patterns of bat activity observed at the 2 turbine pairs, inferences from this one field test are limited at best. In conclusion, the results from the flight facility experiments were promising (i.e., we observed a significant decrease in bat activity at smooth compared to texture-treated surfaces); however, due to coating installation and application challenges prior to our field test, we were unable to collect sufficient information to understand how these coatings affect bat activity at operational wind turbine towers. Although the results from the field test are inconclusive, the lessons learned will be informative for future research into turbine surface materials that can modify the surface of the turbine tower and therefore alter how bats perceive wind towers. Thus, the outcomes of this research project may have a significant impact on wind energy operators, wind developers, and OEMs by contributing to future impact mitigation strategies. In future research we will test new ideas to improve the development, application, and evaluation of this mitigation technique.

17 WIND ENERGY↗

SOMAS: a platform for data-driven material discovery in redox flow battery development

Abstract Aqueous organic redox flow batteries offer an environmentally benign, tunable, and safe route to large-scale energy storage. The energy density is one of the key performance parameters of organic redox flow batteries, which critically depends on the solubility of the redox-active molecule in water. Prediction of aqueous solubility remains a challenge in chemistry. Recently, machine learning models have been developed for molecular properties prediction in chemistry and material science. The fidelity of a machine learning model critically depends on the diversity, accuracy, and abundancy of the training datasets. We build a comprehensive open access organic molecular database “Solubility of Organic Molecules in Aqueous Solution” (SOMAS) containing about 12,000 molecules that covers wider chemical and solubility regimes suitable for aqueous organic redox flow battery development efforts. In addition to experimental solubility, we also provide eight distinctive quantum descriptors including optimized geometry derived from high-throughput density functional theory calculations along with six molecular descriptors for each molecule. SOMAS builds a critical foundation for future efforts in artificial intelligence-based solubility prediction models.

25 ENERGY STORAGE↗

Catalyst carbonylation: a hidden, but essential, step in reaction initiation

The proliferation of increasingly useful reactions for hydrogen transfer in organic synthesis has included the introduction of many new homogeneous catalysts into the organic synthesis lexicon. Unlike the proliferation of palladium-based cross-coupling reactions in which the mechanism is generally conserved, we are learning that these emerging hydrogen transfer catalysts have a rich diversity of mechanisms for catalyst activation, speciation, C–H bond cleavage and formation, and ultimately deactivation. We find that an underappreciated commonality in the catalytic activation for some of these systems is the generation of a (carbonyl)metal group, which dominates the downstream speciation of the catalyst system. In this mini-review we highlight a few well-documented cases of this phenomenon as food for thought for those who are designing new catalytic systems to introduce into this dynamic and impactful area.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

NSUF 2016 Annual Report

The Nuclear Science User Facilities (NSUF) and its partner facilities represent a prototype laboratory that utilizes a distributed partnership, with each facility bringing exceptional capabilities to the relationship including reactors, beamlines, state-of-the-art instruments, hot cells, and equally important, expertise. These capabilities and people together create a nationwide infrastructure that allows the best ideas to be tested using the most advanced capabilities. Through the NSUF, researchers and their collaborators are building on current knowledge to better understand the complex behavior of materials and fuels in a nuclear reactor. The NSUF’s partnership program in 2016 included eight universities, one research and education consortium, three national laboratories, and one industry partner. The avenues opened through these partnerships facilitate cooperative research across the country, matching people with capabilities and students with mentors. The NSUF in 2016 included Idaho National Laboratory (INL) and the following institutions: • Argonne National Laboratory • Center for Advanced Energy Studies (a research and education consortium between Boise State University, INL, Idaho State University, University of Idaho, and University of Wyoming) • Illinois Institute of Technology • Massachusetts Institute of Technology • North Carolina State University • Oak Ridge National Laboratory • Pacific Northwest National Laboratory • Purdue University • University of California, Berkeley • University of Michigan • University of Nevada, Las Vegas • University of Wisconsin • Westinghouse Materials Center of Excellence. This report contains details on new capabilities brought into the NSUF in 2016, the evidence of the increasing research facilitated by the NSUF, and new tools and activities to propel nuclear research and development forward to meet energy reliability and security needs. Learn about the NSUF Nuclear Fuels and Materials Library and the Nuclear Energy Infrastructure Database, and how the robust NSUF website continues to evolve to support new tools. Read about how the NSUF supports Department of Energy (DOE) missions through efforts like the 2016 NSUF Ion Beam Options Workshop, which led to a prioritiza-tion of ion beam facilities according to their ability to support Department of Energy Office of Nuclear Energy (DOE-NE) missions.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Nuclear Fundamentals Orientation Module 1: Export Control Overview [Slides]

Presentation topics for the Export Control Overview are: LANL Export Control Team; Export Regulations and Responsibilities; Explaining Export Control; Weapons Program Activities Related to Export Control; Foreign Nationals and Export Control; Publications & Unlimited Release; and, Lessons Learned.

99 GENERAL AND MISCELLANEOUS↗