Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Association Learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Deep Learning Advances Arctic River Water Temperature Predictions

The accelerated warming in the Arctic poses serious risks to freshwater ecosystems by altering streamflow and river thermal regimes. However, limited research on Arctic River water temperatures exists due to data scarcity and the absence of robust methodologies, which often focus on large, major river basins. To address this, we leveraged the newly released, extensive AKTEMP data set and advanced machine learning techniques to develop a Long Short-Term Memory (LSTM) model. By incorporating ERA5-Land reanalysis data and integrating physical understanding into data-driven processes, our model advanced river water temperature predictions in ungauged, snow- and permafrost-affected basins in Alaska. Our model outperformed existing approaches in high-latitude regions, achieving a median Nash-Sutcliffe Efficiency of 0.95 and root mean squared error of 1.0°C. The LSTM model learned air temperature, soil temperature, solar radiation, and thermal radiation—factors associated with energy balance—were the most important drivers of river temperature dynamics. Soil moisture and snow water equivalent were highlighted as critical factors representing key processes such as thawing, melting, and groundwater contributions. Glaciers and permafrost were also identified as important covariates, particularly in seasonal river water temperature predictions. Our LSTM model successfully captured the complex relationships between hydrometeorological factors and river water temperatures across varying timescales and hydrological conditions. This scalable and transferable approach can be potentially applied across the Arctic, offering valuable insights for future conservation and management efforts.

54 ENVIRONMENTAL SCIENCES↗

Learning Assumptions for Compositional Verification

Compositional verification is a promising approach to addressing the state explosion problem associated with model checking. One compositional technique advocates proving properties of a system by checking properties of its components in an assume-guarantee style. However, the application of this technique is difficult because it involves non-trivial human input. This paper presents a novel framework for performing assume-guarantee reasoning in an incremental and fully automated fashion. To check a component against a property, our approach generates assumptions that the environment needs to satisfy for the property to hold. These assumptions are then discharged on the rest of the system. Assumptions are computed by a learning algorithm. They are initially approximate, but become gradually more precise by means of counterexamples obtained by model checking the component and its environment, alternately. This iterative process may at any stage conclude that the property is either true or false in the system. We have implemented our approach in the LTSA tool and applied it to the analysis of a NASA system.

Cobleigh, Jamieson M.↗

Characterizing Defect Dynamics in Silicon Carbide Using Symmetry-Adapted Collective Variables and Machine Learning Interatomic Potentials

Silicon carbide (SiC) divacancies are attractive candidates for spin-defect qubits possessing long coherence times and optical addressability. The high activation barriers associated with SiC defect formation and motion pose challenges for their study by first-principles molecular dynamics. In this work, we develop and deploy machine learning interatomic potentials (MLIPs) to accelerate defect dynamics simulations while retaining ab initio accuracy. We employ an active learning strategy comprising symmetry-adapted collective variable discovery and enhanced sampling to compile configurationally diverse training data, calculation of energies and forces using density functional theory (DFT), and training of an E(3)-equivariant MLIP based on the Allegro model. Here, the trained MLIP reproduces DFT-level accuracy in defect transition activation free energy barriers, enables the efficient and stable simulation of multidefect 216-atom supercells, and permits an analysis of the temperature dependence of defect thermodynamic stability and formation/annihilation kinetics to propose an optimal annealing temperature to maximally stabilize VV divacancies.

Computer simulations↗

Coincident learning for unsupervised anomaly detection of scientific instruments

Abstract Anomaly detection is an important task for complex scientific experiments and other complex systems (e.g. industrial facilities, manufacturing), where failures in a sub-system can lead to lost data, poor performance, or even damage to components. While scientific facilities generate a wealth of data, labeled anomalies may be rare (or even nonexistent), and expensive to acquire. Unsupervised approaches are therefore common and typically search for anomalies either by distance or density of examples in the input feature space (or some associated low-dimensional representation). This paper presents a novel approach called coincident learning for anomaly detection (CoAD), which is specifically designed for multi-modal tasks and identifies anomalies based on coincident behavior across two different slices of the feature space. We define an unsupervised metric, F ^ β , out of analogy to the supervised classification F β statistic. CoAD uses F ^ β to train an anomaly detection algorithm on unlabeled data , based on the expectation that anomalous behavior in one feature slice is coincident with anomalous behavior in the other. The method is illustrated using a synthetic outlier data set and a MNIST-based image data set, and is compared to prior state-of-the-art on two real-world tasks: a metal milling data set and our motivating task of identifying RF station anomalies in a particle accelerator.

43 PARTICLE ACCELERATORS↗

Nanoscale elemental and morphological imaging of nitrogen-fixing cyanobacteria

Nitrogen-fixing cyanobacteria bind atmospheric nitrogen and carbon dioxide using sunlight. This experimental study focused on a laboratory-based model system, Anabaena sp., in nitrogen-depleted culture. When combined nitrogen is scarce, the filamentous prokaryotes reconcile photosynthesis and nitrogen fixation by cellular differentiation into heterocysts. To better understand the influence of micronutrients on cellular function, 2D and 3D synchrotron X-ray fluorescence mappings were acquired from whole biological cells in their frozen-hydrated state at the Bionanoprobe, Advanced Photon Source. To study elemental homeostasis within these chain-like organisms, biologically relevant elements were mapped using X-ray fluorescence spectroscopy and energy-dispersive X-ray microanalysis. Higher levels of cytosolic K + , Ca 2+ , and Fe 2+ were measured in the heterocyst than in adjacent vegetative cells, supporting the notion of elevated micronutrient demand. P-rich clusters, identified as polyphosphate bodies involved in nutrient storage, metal detoxification, and osmotic regulation, were consistently co-localized with K + and occasionally sequestered Mg 2+ , Ca 2+ , Fe 2+ , and Mn 2+ ions. Machine-learning-based k-mean clustering revealed that P/K clusters were associated with either Fe or Ca, with Fe and Ca clusters also occurring individually. In accordance with XRF nanotomography, distinct P/K-containing clusters close to the cellular envelope were surrounded by larger Ca-rich clusters. The transition metal Fe, which is a part of nitrogenase enzyme, was detected as irregularly shaped clusters. The elemental composition and cellular morphology of diazotrophic Anabaena sp. was visualized by multimodal imaging using atomic force microscopy, scanning electron microscopy, and fluorescence microscopy. This paper discusses the first experimental results obtained with a combined in-line optical and X-ray fluorescence microscope at the Bionanoprobe.

Anabaena sp↗

Efficacy of using a dynamic length representation vs. a fixed-length for neuroarchitecture search

Deep learning neuroarchitecture and hyperparameter search are important in finding the best configuration that maximizes learned model accuracy. However, the number of types of layers, their associated hyperparameters, and the myriad of ways to connect layers poses a significant computational challenge in discovering ideal model configurations. Here, we assess two different approaches for neuroarchitecture search for a LeNet style neural network, one that uses a fixed-length approach where there is a preset number of possible layers that can be toggled on or off via mutation, and a variable-length approach where layers can be freely added or removed via special mutation operators. We found that the variable-length implementation trained better models while discovering unusual layer configurations worth further exploration.

Coletti, Mark↗

Salience Assignment for Multiple-Instance Data and Its Application to Crop Yield Prediction

An algorithm was developed to generate crop yield predictions from orbital remote sensing observations, by analyzing thousands of pixels per county and the associated historical crop yield data for those counties. The algorithm determines which pixels contain which crop. Since each known yield value is associated with thousands of individual pixels, this is a multiple instance learning problem. Because individual crop growth is related to the resulting yield, this relationship has been leveraged to identify pixels that are individually related to corn, wheat, cotton, and soybean yield. Those that have the strongest relationship to a given crop s yield values are most likely to contain fields with that crop. Remote sensing time series data (a new observation every 8 days) was examined for each pixel, which contains information for that pixel s growth curve, peak greenness, and other relevant features. An alternating-projection (AP) technique was used to first estimate the "salience" of each pixel, with respect to the given target (crop yield), and then those estimates were used to build a regression model that relates input data (remote sensing observations) to the target. This is achieved by constructing an exemplar for each crop in each county that is a weighted average of all the pixels within the county; the pixels are weighted according to the salience values. The new regression model estimate then informs the next estimate of the salience values. By iterating between these two steps, the algorithm converges to a stable estimate of both the salience of each pixel and the regression model. The salience values indicate which pixels are most relevant to each crop under consideration.

Wagstaff, Kiri L.↗

Chimeric Mouse Models for Space Radiation Risk Investigations

Assessment of human health risks associated with space radiation exposure is based largely on the knowledge learned from studies in which animals, mostly rodents, are exposed to high-LET radiation on the ground. It has been recognized that translation of animal results to meaningful implications for human disease can be challenging, particularly for certain risk categories such as the high-LET radiation effects in the central nervous system (CNS). Considering limitations in utilizing non-human primates and clinical studies in humans, chimeric animals can potentially bridge the knowledge gap between rodents and humans. In a chimeric animal, a specific organ or a cell type is replaced with respective human cells that are functional. A number of chimeric mouse models have been developed in the medical research community to study human diseases, and some of the models can potentially be used for NASA applications. For instance, mice engrafted with human hepatocytes, which have been used in studies of genotoxicity from carcinogen exposures, can be used for quantification of space radiation damage. A chimeric brain model, which was shown to perform superiorly in memory and cognitive tests, can also be a candidate for studying the CNS effects of radiation. It has also been reported that mice engrafted with human hematopoietic progenitor cells were exposed to X-rays and high-LET Si ions to investigate the radiation effects in the immune system. In a pilot study, we use PXB mice whose livers contain >90% human cells. These mice are exposed to gamma rays for investigations of DNA damage and transcriptomics changes in the humanized livers. Results obtained from PXB mice will be compared non-engrafted control animals from the same background strain that are exposed to identical conditions. The aim of the study is to determine whether chimeric mouse models are suitable for investigations of space radiation risks.

Honglu Wu↗

Chimeric Mouse Models for Space Radiation Risk Investigations

Assessment of human health risks associated with space radiation exposure is based largely on the knowledge learned from studies in which animals, mostly rodents, are exposed to high-LET radiation on the ground. It has been recognized that translation of animal results to meaningful implications for human disease can be challenging, particularly for certain risk categories such as the high-LET radiation effects in the central nervous system (CNS). Considering limitations in utilizing non-human primates and clinical studies in humans, chimeric animals can potentially bridge the knowledge gap between rodents and humans. In a chimeric animal, a specific organ or a cell type is replaced with respective human cells that are functional. A number of chimeric mouse models have been developed in the medical research community to study human diseases, and some of the models can potentially be used for NASA applications. For instance, mice engrafted with human hepatocytes, which have been used in studies of genotoxicity from carcinogen exposures, can be used for quantification of space radiation damage. A chimeric brain model, which was shown to perform superiorly in memory and cognitive tests, can also be a candidate for studying the CNS effects of radiation. It has also been reported that mice engrafted with human hematopoietic progenitor cells were exposed to X-rays and high-LET Si ions to investigate the radiation effects in the immune system. In a pilot study, we use PXB mice whose livers contain >90% human cells. These mice are exposed to gamma rays for investigations of DNA damage and transcriptomics changes in the humanized livers. Results obtained from PXB mice will be compared non-engrafted control animals from the same background strain that are exposed to identical conditions. The aim of the study is to determine whether chimeric mouse models are suitable for investigations of space radiation risks.

Honglu Wu↗

Chimeric Mouse Models for Space Radiation Risk Investigations

Assessment of human health risks associated with space radiation exposure is based largely on the knowledge learned from studies in which animals, mostly rodents, are exposed to high-LET radiation on the ground. It has been recognized that translation of animal results to meaningful implications for human disease can be challenging, particularly for certain risk categories such as the high-LET radiation effects in the central nervous system (CNS). Considering limitations in utilizing non-human primates and clinical studies in humans, chimeric animals can potentially bridge the knowledge gap between rodents and humans. In a chimeric animal, a specific organ or a cell type is replaced with respective human cells that are functional. A number of chimeric mouse models have been developed in the medical research community to study human diseases, and some of the models can potentially be used for NASA applications. Here we investigate use of mice engrafted with human hepatocytes, which have been used in studies of genotoxicity from carcinogen exposures, for assessment of space radiation damage. In a pilot study, we use PXB mice whose livers contain >90% human cells and have been found to function nearly identically to human liver tissues. These mice were exposed to gamma rays for investigations of DNA damage, transcriptomics, and histopathological changes in the humanized livers. Results obtained from PXB mice were compared non-engrafted control animals from the same background strain that are exposed to identical conditions. Preliminary data from histopathological analysis suggest chimeric mouse models are suitable for investigations of space radiation risks, as the humanized liver tissue exhibited changes induced by radiation and was markedly distinct from the liver tissue from the control animals (Fox Chase SCID mice).

Radiation effects↗

Comparison of Radiation-induced Damage Between Livers from Control and Chimeric Mice

Assessment of human health risks associated with space radiation exposure is based largely on the knowledge learned from studies in which animals, mostly rodents, are exposed to high-LET radiation on the ground. It has been recognized that translation of animal results to meaningful implications for human disease can be challenging, particularly for certain risk categories such as the high-LET radiation effects in the central nervous system (CNS). Considering limitations in utilizing non-human primates and clinical studies in humans, chimeric animals can potentially bridge the knowledge gap between rodents and humans. In a chimeric animal, a specific organ or a cell type is replaced with respective human cells that are functional. In this pilot study, we use PXB mice whose livers contain >90% human cells. These mice are exposed to gamma rays for investigations of DNA damage and transcriptomics changes in the humanized livers. Results obtained from PXB mice were compared non-engrafted control animals from the same background strain that are exposed to identical conditions. Staining of the liver tissues with H&E indicated that the human liver tissue in chimeric mice responds differently than the mouse liver tissue to gamma radiation on the cellular level, as evidenced by differences in inflammation and cellular damage seen on histopathology. The gene expression data collected from the liver samples will also be presented, which potentially offers an explanation for the differential responses.

Honglu Wu↗

Chimeric Mouse Models for Space Radiation Risk Investigations

Assessment of human health risks associated with space radiation exposure is based largely on the knowledge learned from studies in which animals, mostly rodents, are exposed to high-LET radiation on the ground. It has been recognized that translation of animal results to meaningful implications for human disease can be challenging, particularly for certain risk categories such as the high-LET radiation effects in the central nervous system (CNS). Considering limitations in utilizing non-human primates and clinical studies in humans, chimeric animals can potentially bridge the knowledge gap between rodents and humans. In a chimeric animal, a specific organ or a cell type is replaced with respective human cells that are functional. A number of chimeric mouse models have been developed in the medical research community to study human diseases, and some of the models can potentially be used for NASA applications. Here we investigate use of mice engrafted with human hepatocytes, which have been used in studies of genotoxicity from carcinogen exposures, for assessment of space radiation damage. In a pilot study, we use PXB mice whose livers contain >90% human cells and have been found to function nearly identically to human liver tissues. These mice were exposed to gamma rays for investigations of DNA damage, transcriptomics, and histopathological changes in the humanized livers. Results obtained from PXB mice were compared non-engrafted control animals from the same background strain that are exposed to identical conditions. Preliminary data from histopathological analysis suggest chimeric mouse models are suitable for investigations of space radiation risks, as the humanized liver tissue exhibited changes induced by radiation and was markedly distinct from the liver tissue from the control animals (Fox Chase SCID mice).

Radiation effects↗

Synopsis of NREL's Automated Mobility District (AMD) Research Program and Associated Publications

An automated mobility district (AMD) envisions a system of integrated mobility options that serves major activity centers such as campuses, central business districts, and large medical facilities. The National Renewable Energy Laboratory (NREL) has been investigating the implementation prospects for fully automated passenger transport systems that are deployed to operate within dense urban settings. This document provides a synopsis of findings revealed over the last three phases of work, which have yielded insights into the creation and management of AMDs anticipated to use automated vehicle (AV) technology over the next decade. Phase I and Phase II tracked the deployment and lessons learned from 10 early-stage demonstrations of automated shuttle deployments, and their associated insights into the challenges for automated driving systems to achieve safe operations within district-scale deployments. Phase III began in-depth investigations of critical subsystem components, as automation, electrification, and on-demand service continue to converge within initial AMD operations. These directed studies focus on elements of electrification, curbfront/station management, the role of infrastructure sensing, and overall integration of AMD safety management in central, simultaneous coordination of multiple AMD fleets. Future research in AMDs includes systems engineering methodology (more frequently referred to as "digital twins") for planning, design, testing, and ongoing operation of AMDs; location (or co-location) of management functions; and human supervision and passenger communications for safety and security in unattended vehicles. The synopsis references the foundational research products (papers and presentations) that have been published through conference proceedings, journal articles, and NREL reports.

33 ADVANCED PROPULSION SYSTEMS↗

Use of Machine Learning to Reduce Uncertainties in Particle Number Concentration and Aerosol Indirect Radiative Forcing Predicted by Climate Models

The radiative forcing of anthropogenic aerosols associated with aerosol–cloud interactions (RF(sub aci)) remains the largest source of uncertainty in climate prediction. The calculation of particle number concentration (PNC), one of the critical parameters affecting RF(sub aci), is generally simplified in climate models. Here we employ outputs from long-term (30-years) simulations of a global size-resolved (sectional) aerosol microphysics model and a machine-learning tool to develop a Random Forest Regression Model (RFRM) for PNC. We have implemented the PNC RFRM in GISS-ModelE2.1 with a mass-based One-Moment Aerosol module, which is one of CMIP6 models. Compared to the default setting, the GISS-ModelE2.1 simulation based on RFRM reduces the changes of cloud droplet number concentration associated with anthropogenic emissions, and decreases the RF(sub aci) from −1.46 W⋅m(exp −2) to −1.11 W⋅m(exp −2). This work highlights a promising approach based on machine learning to reduce uncertainties of climate models in predicting PNC and RF(sub aci) without compromising their computing efficiency.

Radiative forcing↗

Reactive behavior, learning, and anticipation

Reactive systems always act, thinking only long enough to 'look up' the action to execute. Traditional planning systems think a lot, and act only after generating fairly precise plans. Each represents an endpoint on a spectrum. It is argued that primitive forms of reasoning, like anticipation, play an important role in reducing the cost of learning and that the decision to act or think should be based on the uncertainty associated with the utility of executing an action in a particular situation. An architecture for an adaptable reactive system is presented and it is shown how it can be augmented with a simple anticipation mechanism that can substantially reduce the cost and time of learning.

Whitehead, Steven D.↗

Scalable edge clustering of dynamic graphs via weighted line graphs

Timestamped relational datasets consisting of records (or connections) between pairs of entities are ubiquitous in network science. For applications like peer-to-peer communication, email, various social network interactions, and computer network security, it is useful to organize these records into groups based on how and when they are occurring. Weighted line graphs offer a natural way to model how records are related in such datasets but for large real-world graph topologies, building and utilizing the line graph is prohibitively expensive. Here, we present the framework to cluster the edges of a dynamic graph via the associated line graph that contains two major contributions. The first is a method to work with the line graph implicitly and the second is a distributed scale implementation of an agglomerative hierarchical graph clustering algorithm. We outline a novel hierarchical dynamic graph edge clustering approach that efficiently breaks massive relational datasets into small sets of edges containing events at various timescales. This is in stark contrast to traditional graph clustering algorithms that prioritize highly connected (clique-like) community structures. Our approach relies on constructing a sufficient subgraph of a weighted line graph and applying a hierarchical agglomerative clustering. This approach is related to scalable techniques from spatial clustering, nonlinear-dimension reduction, topological data analysis, and draws particular inspiration from HDBSCAN. As an edge clustering, this method yields an overlapping node clustering. Our algorithm is parallelizable and we demonstrate efficient clustering of a billion-scale, real-world dynamic graph into small edge sets that correlate in topology and time. The entire clustering process for a graph with tens of billions of edges takes just a few minutes of run time on 256 nodes of a distributed compute environment. We argue how the output of the edge clustering is useful for a multitude of data visualization and powerful machine learning tasks, both involving the original massive dynamic graph data and metadata associated with the nodes and edges. Finally, we describe how this approach can be extended to dynamic hypergraphs and dynamic graphs/hypergraphs with unstructured data living on vertices and edges.

Data Analysis↗

Machine Learning Based AFP Inspection: A Tool for Characterization and Integration

Automated Fiber Placement (AFP) has become a standard manufacturing technique in the creation of large scale composite structures due to its high production rates. However, the associated rapid layup that accompanies AFP manufacturing has a tendency to induce defects. We forward an inspection system that utilizes machine learning (ML) algorithms to locate and characterize defects from profilometry scans coupled with a data storage system and a user interface (UI) that allows for informed manufacturing. A Keyence LJ-7080 blue light profilometer is used for fast 2D height profiling. After scans are collected, they are process by ML algorithms, displayed to an operator through the UI, and stored in a database. The overall goal of the inspection system is to add an additional tool for AFP manufacturing. Traditional AFP inspection is done manually adding to manufacturing time and being subject to inspector errors or fatigue. For large parts, the inspection process can be cumbersome. The proposed inspection system has the capability of accelerating this process while still keeping a human inspector integrated and in control. This allows for the rapid capability of the automated inspection software and the robustness of a human checking for defects that the system either missed or misclassified.

Sacco, Christopher↗

Rapid detection of rare events from in situ X-ray diffraction data using machine learning

High-energy X-ray diffraction methods can non-destructively map the 3D microstructure and associated attributes of metallic polycrystalline engineering materials in their bulk form. These methods are often combined with external stimuli such as thermo-mechanical loading to take snapshots of the evolving microstructure and attributes over time. However, the extreme data volumes and the high costs of traditional data acquisition and reduction approaches pose a barrier to quickly extracting actionable insights and improving the temporal resolution of these snapshots. This article presents a fully automated technique capable of rapidly detecting the onset of plasticity in high-energy X-ray microscopy data. The technique is computationally faster by at least 50 times than the traditional approaches and works for data sets that are up to nine times sparser than a full data set. This new technique leverages self-supervised image representation learning and clustering to transform massive data sets into compact, semantic-rich representations of visually salient characteristics ( e.g. peak shapes). These characteristics can rapidly indicate anomalous events, such as changes in diffraction peak shapes. It is anticipated that this technique will provide just-in-time actionable information to drive smarter experiments that effectively deploy multi-modal X-ray diffraction methods spanning many decades of length scales.

Zheng, Weijian↗