Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Machine Learning Algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

Harnessing autocatalytic reactions in polymerization and depolymerization

Abstract Autocatalysis and its relevance to various polymeric systems are discussed by taking inspiration from biology. A number of research directions related to synthesis, characterization, and multi-scale modeling are discussed in order to harness autocatalytic reactions in a useful manner for different applications ranging from chemical upcycling of polymers (depolymerization and reconstruction after depolymerization), self-generating micelles and vesicles, and polymer membranes. Overall, a concerted effort involving in situ experiments, multi-scale modeling, and machine learning algorithms is proposed to understand the mechanisms of physical and chemical autocatalysis. It is argued that a control of the autocatalytic behavior in polymeric systems can revolutionize areas such as kinetic control of the self-assembly of polymeric materials, synthesis of self-healing and self-immolative polymers, as next generation of materials for a sustainable circular economy. Graphic Abstract

36 MATERIALS SCIENCE↗

High-Fidelity Building Emulator

This dataset provides high-fidelity time series data for an emulated commercial office building sited in the Chicago, IL area during a Typical Meteorological Year (TMY). This dataset consists of air-side HVAC measurements and control inputs, and it includes normal operations as well as various implemented faults (with associated ground truth measurements) implemented on selected days. This data could be used to quantify and compare the impacts of different faults, and it could also be used as training or validation data for machine learning algorithms (e.g., reduced-order modelling, fault detection and diagnosis).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Alternate Null Hypothesis Correlation: A New Approach to Automatic Seismic Event Detection

This paper describes a new method of seismic signal detection that improves upon the conventional waveform correlation method. Recent studies suggested that a significant limiting factor in the application of waveform correlation to regional and global scale monitoring is the false alarm rate. The false alarms do not originate from detections on noise but rather from seismic arrivals with unrelated source locations. This article presents results from an approach to waveform correlation that exploits techniques from signal processing and machine learning to improve the accuracy of detecting seismic arrivals. We modify the detection model for waveform correlation such that transient signals from noncollocated seismicity are considered when designing the detectors. The new approach uses waveform templates from known catalog events to train a supervised machine learning algorithm that derives a new set of detectors to represent the unique characteristics of the template waveforms; these new detectors maximize the likelihood of detecting only the desired events, thereby minimizing false alarms. We train a waveform correlation template library for a single three-component seismic monitoring station. We then review results from applying the new detectors, known as alternate null hypothesis correlation (ANCorr) templates, to a test set of seismic waveforms. Finally, we compare ANCorr results with those from application of the conventional waveform correlation matched filter technique.

58 GEOSCIENCES↗

Learning crystal field parameters using convolutional neural networks

We present a deep machine learning algorithm to extract crystal field (CF) Stevens parameters from thermodynamic data of rare-earth magnetic materials. The algorithm employs a two-dimensional convolutional neural network (CNN) that is trained on magnetization, magnetic susceptibility and specific heat data that is calculated theoretically within the single-ion approximation and further processed using a standard wavelet transformation. We apply the method to crystal fields of cubic, hexagonal and tetragonal symmetry and for both integer and half-integer total angular momentum values J J of the ground state multiplet. We evaluate its performance on both theoretically generated synthetic and previously published experimental data on CeAgSb _2 2 , PrAgSb _2 2 and PrMg _2 2 Cu _9 9 , and find that it can reliably and accurately extract the CF parameters for all site symmetries and values of J J considered. This demonstrates that CNNs provide an unbiased approach to extracting CF parameters that avoids tedious multi-parameter fitting procedures.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

The Dark Machines Anomaly Score Challenge: Benchmark Data and Model Independent Event Classification for the Large Hadron Collider

We describe the outcome of a data challenge conducted as part of the Dark Machines (https://www.darkmachines.org) initiative and the Les Houches 2019 workshop on Physics at TeV colliders. The challenged aims to detect signals of new physics at the Large Hadron Collider (LHC) using unsupervised machine learning algorithms. First, we propose how an anomaly score could be implemented to define model-independent signal regions in LHC searches. We define and describe a large benchmark dataset, consisting of >1 billion simulated LHC events corresponding to 10\, fb^{-1} 10 f b − 1 of proton-proton collisions at a center-of-mass energy of 13 TeV. We then review a wide range of anomaly detection and density estimation algorithms, developed in the context of the data challenge, and we measure their performance in a set of realistic analysis environments. We draw a number of useful conclusions that will aid the development of unsupervised new physics searches during the third run of the LHC, and provide our benchmark dataset for future studies at https://www.phenoMLdata.org. Code to reproduce the analysis is provided at https://github.com/bostdiek/DarkMachines-UnsupervisedChallenge.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

PANTHER: Trajectory Analysis

We want to organize a body of trajectories in order to identify, search for, classify and predict behavior among objects such as aircraft and ships. Existing comparison functions such as the Fréchet distance are computationally expensive and yield counterintuitive results in some cases. We propose an approach using feature vectors whose components represent succinctly the salient information in trajectories. These features incorporate basic information such as total distance traveled and distance between start/stop points as well as geometric features related to the properties of the convex hull, trajectory curvature and general distance geometry. Additionally, these features can generally be mapped easily to behaviors of interest to humans that are searching large databases. Most of these geometric features are invariant under rigid transformation. We demonstrate the use of different subsets of these features to identify trajectories similar to an exemplar, cluster a database of several hundred thousand trajectories, predict destination and apply unsupervised machine learning algorithms.

42 ENGINEERING↗

Optimizing the Performance of Radionuclide Identification Software in the Hunt for Nuclear Security Threats

The Radionuclide Analysis Kit (RNAK), my team’s most recent nuclide identification software, is entering the testing phase. A question arises: will removing rare nuclides from the software’s library improve its overall performance? An affirmative response indicates fundamental errors in the software’s framework, while a negative response confirms the effectiveness of the software’s key machine learning algorithms. After thorough testing, I found that the performance of RNAK cannot be improved with the library choice effect, thus verifying the effectiveness of RNAK’s algorithms—multiple linear regression, Bayesian network using the Viterbi algorithm, and branch and bound search.

97 MATHEMATICS AND COMPUTING↗

Artificial Diversity and Defense Security (ADDSec) Final Report

Critical infrastructure systems continue to foster predictable communication patterns and static configurations over extended periods of time. The static nature of these systems eases the process of gathering reconnaissance information that can be used to design, develop, and launch attacks by adversaries. In this research effort, the early phases of an attack vector will be disrupted by randomizing application port numbers, IP addresses, and communication paths dynamically through the use of overlay networks within Industrial Control Systems (ICS). These protective measures convert static systems into "moving targets," adding an additional layer of defense. Additionally, we have developed a framework that automatically detects and defends against threats within these systems using an ensemble of machine learning algorithms that classify and categorize abnormal behavior. Our proof-of-concept has been demonstrated within a representative ICS environment. Performance metrics of our proof-of-concept have been captured with latency impacts of less than a millisecond, on average.

97 MATHEMATICS AND COMPUTING↗

Non-Traditional Supercomputing

The High-Performance Computing of today is much different than the supercomputing resources a few decades ago. The supercomputers of the past were huge complexes of hundreds of interconnected computers that had large teams of specialists to keep them running. Today, while supercomputers like Summit (the world's most powerful supercomputer as of June 2018, installed at Oak Ridge National Laboratory) are still in high demand for extremely fast computational power (over 200,000 trillion calculations per second, or 200 petaflops), researchers at Sandia now have access to non-traditional computing resources in the way of very powerful graphics processing units (GPUs). These GPU systems have enabled an entirely new avenue of exploration for Sandia, allowing researchers to further tackle problems in energy, advanced materials, artificial intelligence, and nuclear weapons. Many teams at Sandia utilize these GPU clusters to build models through the use of machine learning. These models are faster representations of their code-driven counterparts and can often be leveraged from the exascale computing resources of traditionally larger systems with huge boosts in performance. We highlight two resources for these smaller systems: the team that builds the hardware, and the team that researches and builds the machine learning algorithms.

97 MATHEMATICS AND COMPUTING↗

Safeguards Technology Development Program Annual Report of FY 2018

In this project, Brookhaven National Laboratory (BNL) and Sandia National Laboratories (SNL) are jointly developing deep machine learning algorithms to improve the review process of surveillance data by identifying objects of interest in image-review software. The technique being developed in this project can be used to reduce the burden on International Atomic energy Agency (IAEA) safeguards inspectors during surveillance review.

36 MATERIALS SCIENCE↗

Final Technical Report

This report highlights of the last 3 years research. Discovery that one-layer (1L) epitaxial graphene plus one carbon interfacial buffer layer (BfL) , both grown by sublimation on SiC(0001), present a stiffness upon indentation similar/larger than bulk diamond and resist to perforation by a diamond indenter. Discovery of an sp 2 - sp 3 phase transformation upon indentation at room temperature of 1L+BfL epitaxial graphene on SiC, the new ultra-hard, ultra-stiff and insulating sp 3 phase was named Diamene . Demonstration of Å-Indentation (ÅI) measurements to measure the stiffness (up to 1 TPa) of ultra-thin (down to 1 atomic layer) films on substrates. First measurement by ÅI of the stiffness of Q-Carbon nano-filaments. Discovery of an oscillatory behavior in friction forces and work function values for even and odd number of layers in polycrystalline MoS 2 films, associated to the oscillatory piezoelectricity of the grains . Demonstration that monolayer MoS 2 can efficiently screen the vdW interaction of the underlying substrate with external systems. Identification of SiC buried terraces and graphene number of layers in a continuous film of epitaxial graphene on SiC by machine learning algorithms. New understanding of defects formation in monolayer MoS 2 . Demonstration of a new method based on thermal scanning probe lithography (t-SPL) for patterning electrodes on 2D materials overcoming EBL limitations . Demonstration of t-SPL for patterning nanoscale magnetic quantum waveguides . New understanding of how charged nanoparticles electrostatically assemble in 1D .

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Machine Learning for Solar Technology Portfolio Management

Technology readiness level (TRL) labeling and forecasting today is done entirely manually. A computationally-assisted model of a TRL-like classification for estimation and tracking could enable a research and development (R&D) portfolio manager to more accurately estimate the relative level of development for technologies in that portfolio. This report describes the work to understand readiness level systems, train a machine learning algorithm to recognize textual indicators of particular readiness levels within written material from carefully chosen case studies in renewable technology development, and apply that algorithm to predict the readiness levels of other technology development cases. We account for the results of each step of the work conducted, including the predictive accuracy of the trained model: 54% correct, within a +/-1 readiness level error threshold and a root mean squared error of 1.88. Great potential remains to improve and apply this model for management of individual projects and across portfolios.

14 SOLAR ENERGY↗

Machine Learning for Solar Technology Portfolio Management

Technology readiness level (TRL) labeling and forecasting today is done entirely manually. A computationally-assisted model of a TRL-like classification for estimation and tracking could enable a research and development (R&D) portfolio manager to more accurately estimate the relative level of development for technologies in that portfolio. This report describes the work to understand readiness level systems, train a machine learning algorithm to recognize textual indicators of particular readiness levels within written material from carefully chosen case studies in renewable technology development, and apply that algorithm to predict the readiness levels of other technology development cases. We account for the results of each step of the work conducted, including the predictive accuracy of the trained model: 54% correct, within a +/-1 readiness level error threshold and a root mean squared error of 1.88. Great potential remains to improve and apply this model for management of individual projects and across portfolios.

14 SOLAR ENERGY↗

Understanding the Effects of Tapering on Gaussian Process Regression

Gaussian process regression is a computationally expensive machine learning algorithm that requires the solution of a system of linear equations with a dense covariance matrix. We propose a modification that uses tapering to introduce sparsity into the covariance matrix followed by matrix reordering schemes to reduce the bandwidth of the sparse matrix. We also apply iterative refinement to our approximate solution in order to recover some of the accuracy lost to tapering. Our numerical tests showed that this modification works best with datasets that have many small values in the covariance matrix. This restricts the usefulness of the modification, so other techniques to reduce computational time may be worth considering in the future.

97 MATHEMATICS AND COMPUTING↗

An Innovative HIV “Mosaic” Vaccine Design Based on Machine Learning

Approximately 37 million people worldwide have the human immunodeficiency virus (HIV). Because of HIV’s incredible diversity — each infected person carries a unique set of viruses — an effective vaccine against HIV needs to stimulate an immune response that can recognize its many variants. Using a machine-learning algorithm and the NIH funded Los Alamos National Laboratory database of hundreds of thousands of HIV sequences gathered from around the globe, Los Alamos scientists were able to design small sets of sequences that in combination provide optimal coverage of HIV’s diversity. The mosaic vaccine is the world’s first computationally-designed vaccine. Through a decade of testing it has continued to show promise, and so currently is being tested in two human efficacy trials to evaluate whether the investigational vaccine regimen can reduce the incidence of HIV infection among 2,600 women in sub-Saharan Africa, and 3,800 men who have sex with men and transgender people in the Americas.

59 BASIC BIOLOGICAL SCIENCES↗

Group Structure Machine Learning Proposal

Nuclear data is the linchpin underwriting several fundamental capabilities and mission needs at LANL. New techniques such as machine learning can be brought to bear to solve old problems such as multigroup cross-section accuracy. In neutron transport, generating multigroup cross sections is a complex and arcane task, but a crucial one, as accurate solutions require appropriate cross sections. There are two key challenges when generating multigroup cross sections: (1) choosing an accurate weight function, and (2) choosing appropriate energy boundaries. Often, energy boundaries are chosen using “expert judgment” that is not documented and is difficult to replicate. The long-standing Los Alamos 30-group structure has been in use since at least 1969 and is still in use today. Simplistic attempts over the years since to improve on the 30-group structure have been met with limited success. Machine learning algorithms would enable the selection of appropriate, problem-dependent group boundaries without an inordinate investment of scientist time. We will develop workflows and tools to enable these improved group boundary choices, which will reduce uncertainty and increase predictive capability of neutron-transport applications at LANL.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Cognition at the Point of Sensing

Over the last 15 years, compressive sensing techniques have been developed which have the potential to greatly reduce the amount of data collected by systems while preserving the amount of information obtained. A cost of this efficiency is that a computationally-intensive optimization routine must be used to put the sensed data into a form that a person can interpret. At the same time, machine learning techniques have experienced tremendous growth as well. Machines have demonstrated the ability learn how to effectively perform tasks such as detection and classification at speeds much faster than humanly possible. Our goal in this project was to study the feasibility of using compressive sensing systems "at the edge." That is, how can compressive sensing sensors be deployed such that information is created at the remote sensor rather than sending raw data to a central processing location? Studies were performed to analyze whether machine learning could be done on the compressively sensed data in its raw form. If a machine is performing the task, is it possible to do so without putting the data into a human interpretable form? We show that this is possible for some systems, in particular a compressive sensing snapshot imaging spectrometer. Machine learning tasks were demonstrated to be more effective and more robust to noise when the machine learning algorithm worked on data in its raw form. This system is shown to outperform a traditional spectrometer. Techniques for reducing the complexity of the reconstruction routine were also analyzed. Techniques for such as data regularization, deep neural networks, and matrix completion were studied and shown to have benefits over traditional reconstruction techniques. In this project we showed that compressive sensing sensors are indeed feasible at the edge. As always, sensors and algorithms must be carefully tuned to work in the constrained environment. In this project we developed tools and techniques to enable those analyses.

47 OTHER INSTRUMENTATION↗

Applying Machine Learning to the Classification of DC-DC Converters. NA-22 Final Report

Tools are now available that enable measurement electromagnetic radiation (EMR) from active electronics in an item. This radiation may be intended WIFI or cellular network links, for example or unintended such as the switching noise generated by DC-to-DC converters. It would be extremely valuable to have the capability to discriminate between the low-voltage DC-to-DC converters or other digital noise prevalent in most modern electronics, versus the high-voltage DC-to-DC converters used in utility firesets. Previous work performed under a Sandia Laboratory Directed Research and Development (LDRD) project on Charge State Detection using a deep neural network has been continued in this effort. A state-of-the-art supervised machine learning algorithm has not only been extended to discriminate between low and high voltage converters but has been validated in determining a converters make and model.

42 ENGINEERING↗