Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “learned priors”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Luna: What Did We Learn and What Should We Expect?

This presentation presents a look at the space program's background prior to lunar exploration and highlights the Apollo program and lessons learned from lunar exploration. The possibilities of exposures and difficulties attributed to lunar dust are described, including obscured vision, clogged equipment, coated surfaces, and inhalation, among others. A lunar dust simulant is proposed to support preliminary studies. Lunar dust is constantly activated by meteorite lunar dust, UV radiation and elements of solar wind - this active dust could produce reactive species. Methods of deactivation must be determined before new lunar missions, but first we must understand how to reactivate dust on Earth. Activation methods tested and described here include crushing/grinding or UV activation. Grinding time has a direct effect on amount of hydroxyl radicals produced upon addition of ground quartz to a solution. An increase in hydroxyl production was also seen for a lunar simulant with increased grinding.

Wallace, William T.↗

Algorithms for Learning Preferences for Sets of Objects

A method is being developed that provides for an artificial-intelligence system to learn a user's preferences for sets of objects and to thereafter automatically select subsets of objects according to those preferences. The method was originally intended to enable automated selection, from among large sets of images acquired by instruments aboard spacecraft, of image subsets considered to be scientifically valuable enough to justify use of limited communication resources for transmission to Earth. The method is also applicable to other sets of objects: examples of sets of objects considered in the development of the method include food menus, radio-station music playlists, and assortments of colored blocks for creating mosaics. The method does not require the user to perform the often-difficult task of quantitatively specifying preferences; instead, the user provides examples of preferred sets of objects. This method goes beyond related prior artificial-intelligence methods for learning which individual items are preferred by the user: this method supports a concept of setbased preferences, which include not only preferences for individual items but also preferences regarding types and degrees of diversity of items in a set. Consideration of diversity in this method involves recognition that members of a set may interact with each other in the sense that when considered together, they may be regarded as being complementary, redundant, or incompatible to various degrees. The effects of such interactions are loosely summarized in the term portfolio effect. The learning method relies on a preference representation language, denoted DD-PREF, to express set-based preferences. In DD-PREF, a preference is represented by a tuple that includes quality (depth) functions to estimate how desired a specific value is, weights for each feature preference, the desired diversity of feature values, and the relative importance of diversity versus depth. The system applies statistical concepts to estimate quantitative measures of the user s preferences from training examples (preferred subsets) specified by the user. Once preferences have been learned, the system uses those preferences to select preferred subsets from new sets. The method was found to be viable when tested in computational experiments on menus, music playlists, and rover images. Contemplated future development efforts include further tests on more diverse sets and development of a sub-method for (a) estimating the parameter that represents the relative importance of diversity versus depth, and (b) incorporating background knowledge about the nature of quality functions, which are special functions that specify depth preferences for features.

Wagstaff, Kiri L.↗

Phase Identification in Synchrotron X-ray Diffraction Patterns of Ti–6Al–4V Using Computer Vision and Deep Learning

X-ray diffraction patterns contain information about the atomistic structure and microstructure (defect population) of materials, extracting detailed information from diffraction patterns is complex, demanding and relies on prior knowledge. Here, we hypothesize that deep-learning techniques can help to perform an effective and accurate analysis with high throughput rates. To demonstrate this concept, we applied a novel deep learning framework to determine the evolution of the β-phase volume fraction in a Ti–6Al–4V alloy during heat-treatment from video sequences of 2D diffraction patterns recorded in transmission and with highly monochromatic radiation in a synchrotron beamline. In particular, we studied the impact of network design on prediction reliability and computational performance. Networks of different architectures were trained using 3008 experimental 2D patterns. A well-tuned model was found to reproduce the phase fractions of another experimental data set, consisting of 1100 diffraction patterns, with a mean-square error as small as 2.6 x 10 -4 . The average prediction error of β-phase volume fraction was within 1.6 x 10 -2 (in each diffraction pattern) of the values obtained by conventional methods. Our work demonstrates that convolutional neural networks can evaluate high energy X-ray diffraction patterns with a remarkable level of reliability. Furthermore, it demonstrates the significance of network design on the reliability of predictions and computational performance. The most complex models do not necessarily result in highest accuracy and may even fail to learn from the data.

36 MATERIALS SCIENCE↗

Bayesian Active Learning for Scanning Probe Microscopy: From Gaussian Processes to Hypothesis Learning

Recent progress in machine learning methods and the emerging availability of programmable interfaces for scanning probe microscopes (SPMs) have propelled automated and autonomous microscopies to the forefront of attention of the scientific community. However, enabling automated microscopy requires the development of task-specific machine learning methods, understanding the interplay between physics discovery and machine learning, and fully defined discovery workflows. This, in turn, requires balancing the physical intuition and prior knowledge of the domain scientist with rewards that define experimental goals and machine learning algorithms that can translate these to specific experimental protocols. Here, we discuss the basic principles of Bayesian active learning and illustrate its applications for SPM. We progress from the Gaussian process as a simple data-driven method and Bayesian inference for physical models as an extension of physics-based functional fits to more complex deep kernel learning methods, structured Gaussian processes, and hypothesis learning. These frameworks allow for the use of prior data, the discovery of specific functionalities as encoded in spectral data, and exploration of physical laws manifesting during the experiment. Here, the discussed framework can be universally applied to all techniques combining imaging and spectroscopy, SPM methods, nanoindentation, electron microscopy and spectroscopy, and chemical imaging methods and can be particularly impactful for destructive or irreversible measurements.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Network Anomaly Detection Using Federated Learning

The internet is turning out to be an integral part of every-one's lives as more and more devices are being connected to serve societal needs. Our work is motivated by two ma-jor observations. Firstly, one drawback of connecting to the network is the threat of network attacks that can compromise users' private information, leading to data loss and adversely affecting productivity. There are several traditional security mechanisms to defend against these attacks, such as firewalls, virtual private networks (VPNs), demilitarized zones (DMZs), and vulnerability scanners. One way to prevent these attacks is early detection and prevention. However, these kinds of architecture do not scale very well because of their centralized nature. Secondly, we observe from heuristics and data set distributions that the majority of the requests made to a server are innocuous. Therefore, almost all server request data sets are highly imbalanced, weighted highly towards the harmless requests.

Marfo, William↗

Sustainability, Scalability, and Resiliency of the Town of Innisfil Mobility-on-Demand Experiment: Preliminary Results, Analyses, and Lessons Learned

In 2017, the town of Innisfil, Ontario, launched Innisfil Transit in partnership with Uber, a transportation network company, to provide a subsidized on-demand public mobility service as an alternative to investing in a new fixed-route bus service. The performance of Innisfil Transit is documented in a 2021 Ryerson University report by Sweet, Mitra, and Benaroya, which shows greater cost effectiveness of the mobility provided over the proposed bus alternative. This paper expands on those findings by assessing Innisfil Transit with respect to sustainability, scalability, and resiliency. First, we quantify the energy and emissions of this program relative to traditional transit and driving alone across varying powertrains. We then characterize a conservative first-order estimate of the percentage of US communities that fall within a similar spatial-demographic tier as Innisfil. Replicability also hinges on service cost and performance in comparison to average values for low-density transit in the US. Lastly, most transit agencies experienced a significant drop in demand (as much as 90%) with slowly rebounding ridership since the onset of the COVID-19 pandemic. The resiliency of the Innisfil program to the pressures induced by the pandemic is examined in comparison to other transit operations. The lessons learned across these three dimensions complement prior work to better understand the efficiency and sustainability of on-demand public mobility service for low-density communities like Innisfil.

ADVANCED PROPULSION SYSTEMS↗

Improving qubit readout with hidden Markov models

We demonstrate the application of pattern recognition algorithms via hidden Markov models (HMM) for qubit readout. This scheme provides a state-path trajectory approach capable of detecting qubit-state transitions and makes for a robust classification scheme with higher starting-state assignment fidelity than when compared to a multivariate Gaussian or a support vector machine scheme. Therefore, the method also eliminates the qubit-dependent readout time optimization requirement in current schemes. Using a HMM state discriminator we estimate fidelities reaching the ideal limit. Unsupervised learning gives access to transition matrix, priors, and IQ distributions, providing a toolbox for studying qubit-state dynamics during strong projective readout.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Incorporation of Physics Phenomenology into an Adaptive Algorithm Framework (Final Report)

We attempt to incorporate prior physics knowledge into a machine learning architecture at an applied application level (empirical) as opposed to the level of fundamental physics (first principles). The purpose of this work is to allow for the application of methods of physics-informed machine learning to a broad range of national security problems, while enhancing the trust in machine-learned models by decreasing the “black box” nature of such methods.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Mars Exobiology: The Principles Behind The Plan For Exploration

The search for evidence of life on Mars is a highly interdisciplinary enterprise which extends beyond the traditional life sciences. Mars conceivably had a pervasive ancient biosphere which may have persisted even to the present, but only in subsurface environments. Understanding the history of Mars' global environment, including its inventory of volatile elements, is a crucial part of the search strategy. Those deposits (minerals, sediments, etc.) which could have and retained a record of earlier biological activity must be identified and examined. While the importance of. seeking another biosphere has not diminished during the years since the Viking mission, the strategy for Mars exploration certainly has been modified by later discoveries. The Viking mission itself demonstrated that the present day surface environment of Mars is hostile to life as we know it. Thus, to search effectively for life on Mars, be it extant or extinct, we now must greatly improve our understanding of Mars the planet. Such an understanding will help us broaden our search beyond the Viking lander sites, both back in time to earlier epochs and elsewhere to other sites and beneath the surface. Exobiology involves much more than simply a search for extant life beyond Earth. It addresses the prospect of long-extinct biospheres and also the chemistry, organic and otherwise, which either led to life or which occurred on rocky planets that remained lifeless. Even a Mars without a biosphere would reveal much about life. How better to understand the origin and impact of a biosphere than to compare Earth with another similar but lifeless planet? Still, several relatively recent discoveries offer encouragement that a Martian biosphere indeed might have existed. The ancient Martian surface was extensively sculptured by volcanism and the activity of liquid water. Such observations invoke impressions of an ancient martian atmosphere and environment that resembled ancient Earth more than present-day Mars. Since Viking, we have learned that our own biosphere began prior to 3.5 billion years ago, during an early period when our solar system apparently was sustaining clement conditions on at least two of its planets. Also, we have found that microorganisms can survive, even flourish, in environments more extreme in temperature and water availability than had been previously recognized. The common ancestor of life on Earth probably was adapted to elevated temperatures, raising the possibility that hydrothermal systems played a central role in sustaining our early biosphere. If a biosphere ever arose on Mars, at least some of its constituents probably dwelled in the subsurface. Even today, conditions on Mars and Earth become more similar with increasing depth beneath their surfaces. For example, under the martian permafrost, the geothermal gradient very likely maintains liquid water in environments which resemble aquifers on Earth. Indigenous bacteria have recently been recovered from deep aquifers on Earth. Liquid groundwater very likely persisted throughout Mars' history. Thus, martian biota, if they ever existed, indeed might have survived in subsurface environments.

DesMarais, D. J.↗

Utilizing the US Lab Nadir Research Window for Remote Sensing Operations with The Window Observational Research Facility (WORF)

The Window Observational Research Facility (WORF) is an ISPR-based rack facility designed to take advantage of the high optical quality US Lab Nadir research window. The WORF is based on the ISS Expedite the Processing of Experiments to Space Station (EXPRESS) rack mechanical structure and electronic systems. The WORF has a unique payload volume located at the center of the rack that provides access to the window. The interior dimensions of the payload volume are 34-in. (86.36 cm) wide by 33-in. (83.82 cm) high by 23-in. (58.42 cm) deep. This facility supports the deployment of payloads such as 9 in. aerial photography cameras and 12 in. diameter optical equipment. The WORF coupled with the optical quality of the United States Lab window support the deployment of various payload disciplines. The WORF provides payloads with power, data command and control, air cooling, water cooling, and video processing. The WORF's payload mounting surfaces and interfaces include the interior payload mounting shelf and the interior and exterior aircraft-like seat tracks. The payload mounting shelf is limited to a maximum mass of 136 kg (299 pounds). The WORF can accommodate large payloads such as the commonly used Leica-Heerbrug RC-30 aerial photography camera (whose dimensions are 53.3 cm (21-in.) wide by 50.8 cm (20-in.) deep by 76.2 cm (30-in.) long). The performance characteristics of the WORF allow it to support an array of payload disciplines. The WORF provides a maximum of 3 Kw at 28 Vdc and has a maximum data rate of 10 Mbps. The WORF's unique payload volume is designed to be light-tight, down to 2.8 x 10(exp -11) Watts/cm2/steradian, and have low-reflective surfaces. This specially designed WORF interior supports payload investigations that observe low-light-level phenomenon such as aurora. Although the WORF rack does not employ any active rack isolation (i.e., vibration dampening) technology, the rack provides a very stable environment for payload operations (on the order of X microradians). The facility's software is capable of being updated during its period of deployment. The WORF project also includes a Suitcase Simulator to allow for a payload developer to verify data interfaces at his development site, a trainer rack for astronauts to learn how to operate the WORF prior to flight, and the use of the EXPRESS Functional Checkout Units to allow for payload checkout at the KSC prior to launch.

Turner, Richard↗

Sustainability, Scalability and Resiliency of the Town of Innisfil Mobility-on-Demand Experiment: Preliminary Results, Analyses, and Lessons Learned: Preprint

In 2017, the Town of Innisfil, Ontario launched Innisfil Transit in partnership with Uber, a transportation network company, to provide a subsidized on-demand public mobility service as an alternative to investing in a new fixed-route bus service. The performance of Innisfil Transit is documented in a 2021 Ryerson University report which shows greater cost effectiveness of the mobility provided over the proposed bus alternative (Sweet, Mitra, and Benaroya 2021). This paper expands on those findings by assessing Innisfil Transit with respect to sustainability, scalability, and resiliency. First, we quantify the energy and emissions of this program relative to traditional transit and driving alone across varying powertrains. We then characterize a conservative first-order estimate of the percentage of US communities that fall within a similar spatial-demographic tier as Innisfil. Replicability also hinges on service cost and performance in comparison to average values for low-density transit in the US. Lastly, most transit agencies experienced a significant drop in demand (as much as 90%) with slowly rebounding ridership since the onset of the COVID-19 pandemic. The resiliency of the Innisfil program to the pressures induced by the pandemic is examined in comparison to other transit operations. The lessons learned across these three dimensions complement prior work to better understand the efficiency and sustainability of on-demand public mobility service for low-density communities like Innisfil.

ADVANCED PROPULSION SYSTEMS↗

Experimental verification of integrability in a Danilov-Nagaitsev lattice using machine learning

In non-linear optics, achieving integrability can enhance the dynamic aperture in storage rings. We analyze turn-by-turn phase-space data from our Danilov-Nagaitsev lattice implementation at Fermilab's Integrable Optics Test Accelerator using machine learning. AI Poincaré estimates conserved quantities from experimental data without prior knowledge of the invariant structure, showing qualitative agreement with theoretical predictions. Additionally, one of the two learned invariants exhibits comparable or better conservation compared to known theoretical expressions.

43 PARTICLE ACCELERATORS↗

Data-driven Mapping of the Mouse Connectome: The utility of transfer learning to improve the performance of deep learning models performing axon segmentation on light-sheet microscopy images

Light sheet microscopy has made possible the high temporal and spatial 3D imaging of both fixed and live biological tissue, with samples as large as the entire mouse brain. However, segmentation and quantification of that data remains a time-consuming manual process. Machine learning methods promise the possibility of automating this process. This study seeks to advance the performance of prior models through the application of refinements such as transfer learning.

59 BASIC BIOLOGICAL SCIENCES↗

Application of machine learning approaches in the analysis of mass absorption cross-section of black carbon aerosols: Aerosol composition dependencies and sensitivity analyses

Physics-based models typically require an in-depth understanding of a phenomenon and assumptions of the underlying process(es), which are often hard to obtain in practice, whereas data-driven machine learning models learn the structure and patterns in the training data without any prior theoretical assumptions and then use inference to develop useful predictions. A novel machine learning-based algorithm has been previously developed for the prediction of black carbon mass absorption cross-section (MAC BC ) and applied to a variety of different atmospheric environments. In contrast to light scattering theories which require assumptions about the underlying physics, this algorithm uses time-series data of aerosol properties to estimate the temporally-varying MAC BC at 870 nm. Here, we analyze our algorithm and discuss the influence of aerosol optical properties (such as Ångström exponents and single scattering albedo) and chemical composition on the model outputs and the associated accuracy. Additionally, we conduct sensitivity analyses on our models to understand how the predictions change in response to different sets of input variables. Our support vector machine (SVM) for regression model is the least sensitive to variations in the input variables, although all models tend to exhibit a degradation to their accuracy when scattering Ångström exponents are less than one.

54 ENVIRONMENTAL SCIENCES↗

Method of Real-Time Principal-Component Analysis

Dominant-element-based gradient descent and dynamic initial learning rate (DOGEDYN) is a method of sequential principal-component analysis (PCA) that is well suited for such applications as data compression and extraction of features from sets of data. In comparison with a prior method of gradient-descent-based sequential PCA, this method offers a greater rate of learning convergence. Like the prior method, DOGEDYN can be implemented in software. However, the main advantage of DOGEDYN over the prior method lies in the facts that it requires less computation and can be implemented in simpler hardware. It should be possible to implement DOGEDYN in compact, low-power, very-large-scale integrated (VLSI) circuitry that could process data in real time.

Duong, Tuan↗

Bio-Inspired Neural Model for Learning Dynamic Models

A neural-network mathematical model that, relative to prior such models, places greater emphasis on some of the temporal aspects of real neural physical processes, has been proposed as a basis for massively parallel, distributed algorithms that learn dynamic models of possibly complex external processes by means of learning rules that are local in space and time. The algorithms could be made to perform such functions as recognition and prediction of words in speech and of objects depicted in video images. The approach embodied in this model is said to be "hardware-friendly" in the following sense: The algorithms would be amenable to execution by special-purpose computers implemented as very-large-scale integrated (VLSI) circuits that would operate at relatively high speeds and low power demands.

Duong, Tuan↗

Anisotropic physics-regularized interpretable machine learning of microstructure evolution

Anisotropic Physics-Regularized Interpretable Machine Learning Microstructure Evolution (APRIMME) is a general-purpose machine learning solution for grain growth simulations. In prior work, PRIMME employed a deep neural network to predict site-specific migration as a function of its neighboring sites to model normal, isotropic, grain growth behavior. This work aims to extend this method by incorporating grain boundary misorientation-based grain growth behavior. APRIMME is trained on anisotropic simulations created using the Monte Carlo-Potts (MCP) model. Furthermore, the results of this work are compared statistically using grain radius, number of sides per grain, mean neighborhood misorientations, and the standard deviation of triple junction dihedral angles, and are found to match in most cases. The exceptions are small and seem to be related to two causes: (1) the deterministic model of APRIMME is learning from the stochastic simulations of MCP, which seems to accentuate triple junction behaviors; and, (2) a bias against very small grains is made evident in a quicker decrease in grains than expected at the beginning of an APRIMME simulation. APRIMME is also evaluated for its general ability to capture anisotropic grain growth behavior by first investigating different test case initial conditions, including a circle grain, three grain, and hexagonal grain microstructures.

36 MATERIALS SCIENCE↗

Incorporating Physical Priors into Weakly Supervised Anomaly Detection

We propose a new machine-learning-based anomaly detection strategy for comparing data with a background-only reference (a form of weak supervision). The sensitivity of previous strategies degrades significantly when the signal is too rare or there are many unhelpful features. Our prior-assisted weak supervision (PAWS) method incorporates information from a class of signal models to significantly enhance the search sensitivity of weakly supervised approaches. As long as the true signal is in the prespecified class, PAWS matches the sensitivity of a dedicated, fully supervised method without specifying the exact parameters ahead of time. On the benchmark LHC Olympics anomaly detection dataset, our mix of semisupervised and weakly supervised learning is able to extend the sensitivity over previous methods by a factor of 10 in cross section. Furthermore, if we add irrelevant (noise) dimensions to the inputs, classical methods degrade by another factor of 10 in cross section while PAWS remains insensitive to noise. This new approach could be applied in a number of scenarios and pushes the frontier of sensitivity between completely model-agnostic approaches and fully model-specific searches.

artificial neural networks↗