Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data representations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,081 records · Page 60

Visual Analytics of Multivariate Networks With Representation Learning and Composite Variable Construction

Multivariate networks are commonly found in real-world data-driven applications. Uncovering and understanding the relations of interest in multivariate networks is not a trivial task. This article presents a visual analytics workflow for studying multivariate networks to extract associations between different structural and semantic characteristics of the networks (e.g., what are the combinations of attributes largely relating to the density of a social network?). The workflow consists of a neural-network-based learning phase to classify the data based on the chosen input and output attributes, a dimensionality reduction and optimization phase to produce a simplified set of results for examination, and finally an interpreting phase conducted by the user through an interactive visualization interface. A key part of our design is a composite variable construction step that remodels nonlinear features obtained by neural networks into linear features that are intuitive to interpret. We demonstrate the capabilities of this workflow with multiple case studies on networks derived from social media usage and also evaluate the workflow with qualitative feedback from experts.

97 MATHEMATICS AND COMPUTING↗

Treatment of Tilted Sonar Data for Salt Cavern Analysis

Structural modeling and visualization of salt caverns requires three-dimensional representations. These representations are typically produced from sonar surveys conducted by companies that then produce a report of depths, distances, and volumes. There are multiple formats that are vendor dependent, and, as technology improves, there have been changes from only horizontal surveys to inclined shots for ceilings and floors to mid-cavern inclined shots. For geomechanical modeling, leaching predictions, and cavern stability visualizations, Sandia has previously written in-house software, called SONAR8, that created a consistent geometry format from the processed sonar reports. However, the increase in the need for mid-cavern inclined surveys led to the discovery of certain limitations in that code. This report describes methods used to process the multiple different formats to handle inclined shots in a consistent and accurate manner in our modeling efforts. A set of file formats and a database schema that was developed for this work is also documented in the appendices.

02 PETROLEUM↗

Coherent microscopy at resolution beyond diffraction limit using post-experimental data extrapolation

Conventional microscopic records represent intensity distributions whereby local sample information is mapped onto local information at the detector. In coherent microscopy, the superposition principle of waves holds; field amplitudes are added, not intensities. This non-local representation is spread out in space and interference information combined with wave continuity allows extrapolation beyond the actual detected data. Established resolution criteria are thus circumvented and hidden object details can retrospectively be recovered from just a fraction of an interference pattern.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Skewering the silos: using Brick to enable portable analytics, modeling and controls in buildings

Nearly all large commercial buildings have heating, ventilation and air conditioning (HVAC) systems, lighting systems, safety and other systems controlled by a computer—a dedicated server with a building energy management system (BMS). However, these BMSs are proprietary with each building’s assets (that is, fans, valves, pumps, and their setpoints) named and coded uniquely by the BMS vendor or engineer; building analytics and control algorithms are written specific to the assets and the building. Thus, any control updates or analytics to improve building performance—especially critical to reduce greenhouse emissions or improve load flexibility—are labor intensive and costly. The Brick schema was developed so the same analysis or control algorithms can work on a variety of buildings if each is digitally represented in a Brick data model. The goal of this project was to further the development of Brick to extend it beyond an academic project with demonstrated success in a small field study, to a practical choice for industrial and commercial stakeholders seeking to realize value from building data. To do this, we executed four objectives: (1) expand the Brick schema including its modeling capabilities and vocabulary, (2) develop tools for integrating Brick with existing digital technologies and representations in buildings, (3) develop an open-source analytics platform to facilitate use of Brick in delivering data value, and (4) demonstrate Brick-driven analytics and controls in real settings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Convoluted filtering for process cycle modeling

Principles of materials science and engineering, physics, mathematics, and information science are used to extract knowledge and insights from the process-structure–property-performance relationships hidden in materials data. The process-structure modeling can be accelerated without loss of interpretability, with artificial intelligence tools that mimic the salient features of the process and process-structure relations. In this work, a novel convoluted model-filtering technique was exploited to build and successfully train the Convoluted Filter (CoFi) artifacts for Fe-based alloy heat treatment cycles. The artifacts were pre-trained to filter out deep models that change the surrogate microstructure state after the heat treatment at ambient conditions. Direct representation of the thermal cycle features within knowledge Graph facilitated development of meaningful data models for microstructure evolution, which reduce overfitting to limited datasets.

36 MATERIALS SCIENCE↗

Precision Gas Sampling (PGS) Validation2011-2014 Final Campaign Report

In this field campaign, we used eddy covariance towers to quantify carbon, water, and energy fluxes from a pasture and a wheat field that were converted to switchgrass. The U.S. Department of Energy is investing in switchgrass as a cellulosic bioenergy crop, but there is little data available that could be used to develop or test land surface model representations of the crop. This campaign was a collaboration between Lawrence Berkeley National Laboratory and the U.S. Department of Agriculture Agricultural Research Service. Unfortunately, in 2011, Oklahoma had one of the most severe droughts on record, and the crop in one of the switchgrass fields experienced almost complete die-off. The crop was replanted, but subsequent drought conditions prevented its establishment. Then, in April 2012, a large tornado demolished the instruments at our site in Woodward, Oklahoma. These two events meant that we have some interesting data on land response to extreme weather; however, we were not able to collect continuous data for annual sums as originally intended. We did observe that, because of the drought, the net ecosystem exchange of CO 2 was much lower in 2011 than in 2010. Concomitantly, sensible heat fluxes increased and latent heat fluxes decreased. These conditions would have large consequences for land surface forcing of convection. Data from all years were submitted to the Atmospheric Radiation Measurement Climate Research Facility Data Archive, and the sites were registered in AmeriFlux.

09 BIOMASS FUELS↗

Efficient Clustering of Software Vulnerabilities using Self Organizing Map (SOM)

The common vulnerabilities and exposures (CVE) database was created with a mission to ``identify, define, and catalog publicly disclosed cybersecurity vulnerabilities''. This rich body of information can be used to enable rapid and efficient response to secure and defend cyber operations and protect critical cyber infrastructure. The main goal of this paper is to develop a visual analytics tool to enable deep analysis of CVEs using unsupervised clustering techniques. We enhance our analysis by first mapping CVEs to hierarchical-classes in Common Weakness Enumeration (CWE) using information in the National Vulnerability Database (NVD). Both the mapping and the numerical representation of CVEs are enabled by V2W-BERT, which uses natural language processing of the extensive information in NVD to generate a large tabular database of 137,226 CVE entries from 1999 to 2020, where each CVE is represented by a vector of 768 numerical features. The vectorized data is processed by Self-Organizing Maps (SOM), which is an unsupervised machine learning technique for dimensionality reduction, visual representation and clustering. Using a Torus map of 6417 units, we achieve ~10-fold data compression of ~140k CVEs using SOM. The trained map is further clustered using standard K-means clustering into 138 clusters of CVEs. We conducted a brief investigation of the rich mapping of CVEs to best-matching-units to K-means clusters, as well as CVEs to CWEs. For example, this novel mapping provided insight into the role of CWE-59 and CWE-264 in several CVEs that is otherwise hard to explore in the original data. We conclude that our this novel approach will not only enable deep analysis of the complex relationships between CVEs and CWEs, but also a mechanism to quickly respond to and design mitigation actions for rapidly evolving vulnerabilities that have not been mapped to existing CWEs.

Panchal, Khyati↗

Improving and testing machine learning methods for benchmarking soil carbon dynamics representation of land surface models

Representation of soil organic carbon (SOC) dynamics in Earth system models (ESMs) is a key source of uncertainty in predicting carbon climate feedbacks. The magnitude of this uncertainty can be reduced by accurate representation of environmental controllers of SOC stocks in ESMs. In this study, we used data of environmental factors, field SOC observations, ESM projections and machine learning approaches to identify dominant environmental controllers of SOC stocks and derive functional relationships between environmental factors and SOC stocks. Our derived functional relationships predicted SOC stocks with similar accuracy as the machine learning approach. We used the derived relationships to benchmark the coupled model intercomparison project phase six ESM representation of SOC stocks. We found divergent environmental control representation in ESMs in comparison to field observations. Representation of SOC in ESMs can be improved by including additional environmental factors and representing their functional relationships with SOC consistent with observations.

54 ENVIRONMENTAL SCIENCES↗

CMIP7 data request: Earth system priorities and opportunities

This paper presents a comprehensive overview of the Coupled Model Intercomparison Project Phase 7 (CMIP7) request for data pertaining to Earth systems science, and provides justification for the resources needed to produce this data. Topics within the CMIP7 Earth System (CMIP7-ES) theme centre around tracking of flows of energy, carbon, water and other fluxes across domains, and constraining feedbacks between these cycles and the climate system. These topics are summarized in this paper as scientific “opportunities” describing specific model intercomparison experiments and use cases for next-generation Earth System Model (ESM) output. These opportunities were submitted by modelling groups and scientific consortia following an extended public consultation process. Contained within each opportunity are requests for groups of Climate & Forecasting (CF) variables, which are bundled into variable groups representing all data required to address the opportunities' needs. Novel opportunities in CMIP7 compared with previous phases will include running `emissions-driven' simulations that integrate carbon emissions and removal scenarios with updated representations of the global carbon cycle, expanded variable groups needed to model marine trophic interactions and biogeochemistry, and data needed to understand the risk of global tipping points, among others. The production of these variables will close key gaps and uncertainties identified during previous rounds of CMIP, and support the 7th Intergovernmental Panel on Climate Change Assessment Report (AR7). We argue that CMIP7-ES data will be broadly used by scientific, policy, governmental, industry, and other communities that rely on climate model projections for research and decision making. As an author group we also reflect on the evolution of the CMIP7-ES data request as a part of a deliberative process in support of the global CMIP program.

54 ENVIRONMENTAL SCIENCES↗

Leveraging Environmental Monitoring Results from Department of Energy Sites for Research on the Food-Energy-Water Nexus

The Annual Site Environmental Report (ASER) from a U.S. Department of Energy (DOE) Site summarizes environmental data; environmental management performance; compliance with applicable DOE, federal, state, and local regulations; and restoration and surveillance monitoring programs. The Savannah River Site (SRS) produces ASERs that include results of monitoring mercury levels in fish samples obtained in the vicinity of SRS. Mercury is a toxic trace metal and the methylated organic form is a neurotoxin that bioaccumulates in the food web, endangering humans and other organisms. In United States, power plants are the largest source of mercury emissions. Research Objective: To determine the patterns of mercury levels in fish samples reported in the SRS environmental monitoring reports. We developed box plot visualizations to make sense of the data as well as identify fish species, dates and location with outlier mercury content. The integration and visual representation of multi-year datasets can support decision making processes on environmental compliance and environmental sustainability conducted at U.S. DOE Sites. We are constructing datasets from textual, image and multivariable data sources in the multi-year ASERs of the U.S. DOE Savannah River Site (SRS https://www.srs.gov/general/pubs/ERsum/index.html). The Fish Surveillance for mercury presents a case study for the intersection of food, energy and water systems. The dataset of 864 records (2008 and 2009) of mercury levels includes water location of fish, fish species, collection date and mercury content of fish sample. The patterns of mercury levels in the fish species as well as locations provide knowledge for further investigations. A research area for future studies is the composition of microbial communities in fish guts of varying levels of mercury.

54 ENVIRONMENTAL SCIENCES↗

Uncertainty quantification for large-scale ocean circulation predictions.

Uncertainty quantificatio in climate models is challenged by the sparsity of the available climate data due to the high computational cost of the model runs. Another feature that prevents classical uncertainty analyses from being easily applicable is the bifurcative behavior in the climate data with respect to certain parameters. A typical example is the Meridional Overturning Circulation in the Atlantic Ocean. The maximum overturning stream function exhibits discontinuity across a curve in the space of two uncertain parameters, namely climate sensitivity and CO{sub 2} forcing. We develop a methodology that performs uncertainty quantificatio in the presence of limited data that have discontinuous character. Our approach is two-fold. First we detect the discontinuity location with a Bayesian inference, thus obtaining a probabilistic representation of the discontinuity curve location in presence of arbitrarily distributed input parameter values. Furthermore, we developed a spectral approach that relies on Polynomial Chaos (PC) expansions on each sides of the discontinuity curve leading to an averaged-PC representation of the forward model that allows efficient uncertainty quantification and propagation. The methodology is tested on synthetic examples of discontinuous data with adjustable sharpness and structure.

54 ENVIRONMENTAL SCIENCES↗

Internal conversion and intersystem crossing dynamics based on coupled potential energy surfaces with full geometry-dependent spin–orbit and derivative couplings. Nonadiabatic photodissociation dynamics of NH 3 (A) leading to the NH(X 3 Σ – , a 1 Δ) + H 2 channel

Here we simulate the photodissociation of NH 3 originating from its first excited singlet state S 1 into the NH 2 + H (radical) and NH + H 2 (molecular) channels. The states considered are the ground singlet state S 0 , the first excited singlet state S 1 and the lowest-lying triplet state T 1 , which permit for the first time a uniform treatment of the internal conversion and intersystem crossing. The simulations are based on a diabatic potential energy matrix (DPEM) of S 0 , S 1 coupled by a conical intersection seam, as well as a potential energy surface (PES) for T 1 coupled by spin-orbit coupling (SOC) to the two singlet states. The DPEM and PES are fitted to ab initio electronic structure data (ESD) including energies, energy gradients, and derivative couplings. The DPEM also defines an adiabatic to diabatic state (AtD) transformation, which is used to transform the singular adiabatic SOC into a smooth function of the nuclear coordinates in the diabatic representation, allowing the diabatic SOC to be fit to an analytical functional form. ESD and SOC data obtained from these surfaces can serve as input for either quantum or semi-classical characterization of the nonadiabatic dynamics. Using the SHARC suite of programs, nonadiabatic simulations based on over 40 000 semi-classical trajectories assess the convergence of our results. The production of NH + H 2 is not direct, but is only achieved through a quasi-statistical dissociation mechanism after internal conversion to the ground electronic state. This leads to a much lower yield comparing with the main NH 2 + H channel. The NH(X 3 Σ_) radical produced through the intersystem crossing from S 0 to T 1 is rare (~0.2%) compared to NH(a 1 Δ) due to the process being spin forbidden.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Assimilation of Multiscale Data into Multifidelity Biogeochemical Models (Final Report)

Quantitative predictions of subsurface processes rely on computational models that capture, with different degrees of fidelity, complex interactions between hydrologic and biogeochemical processes. Molecular- and pore-scale models provide a high-fidelity representation of these processes but are impractical at the field scale. Reduced complexity (e.g., field-scale or data-driven) models sacrifice some degree of fidelity in favor of computational efficiency. Uncertainty and assimilation of data into model predictions, pose a question of model selection: Given a significant difference in computational cost, can a lower-fidelity model be preferable to its higher-fidelity counterpart? Since a predictive model must be computable in reasonable time it has to operate at the field scale, with molecular- and pore-scale data (obtained either from simulations or measurements) determining both the model's structure and parameters. Availability of such multi-resolution data raises a question hitherto undressed in hydrogeology: Can a coarse model dynamically ``learn'' its own structure (e.g., adjust the reaction pathways in its transport module) as more fine-scale data become available during simulations? Our results in multifidelity simulations, data assimilation, and machine learning led us to hypothesize that the answer to these questions is ``yes''. The overarching goal of this project was to confirm this hypothesis by developing scalable, computationally efficient tools for assimilation of data into multiscale models, in which fine-scale data and simulations dynamically inform and autonomously modify coarse-scale models. Our research led to nine manuscripts, three of which have been published and the other six are currently under review.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Tensor Basis Gaussian Process Models of Hyperelastic Materials

In this study, we develop Gaussian process regression (GPR) models of isotropic hyperelastic material behavior. First, we consider the direct approach of modeling the components of the Cauchy stress tensor as a function of the components of the Finger stretch tensor in a Gaussian process. We then consider an improvement on this approach that embeds rotational invariance of the stress-stretch constitutive relation in the GPR representation. This approach requires fewer training examples and achieves higher accuracy while maintaining invariance to rotations exactly. Finally, we consider an approach that recovers the strain-energy density function and derives the stress tensor from this potential. Although the error of this model for predicting the stress tensor is higher, the strain-energy density is recovered with high accuracy from limited training data. The approaches presented here are examples of physics-informed machine learning. They go beyond purely data-driven approaches by embedding the physical system constraints directly into the Gaussian process representation of materials models.

36 MATERIALS SCIENCE↗

ARCH: Large-scale knowledge graph via aggregated narrative codified health records analysis

Objective: Electronic health record (EHR) systems contain a wealth of clinical data stored as both codified data and free-text narrative notes (NLP). The complexity of EHR presents challenges in feature representation, information extraction, and uncertainty quantification. Here, to address these challenges, we proposed an efficient Aggregated naRrative Codified Health (ARCH) records analysis to generate a large-scale knowledge graph (KG) for a comprehensive set of EHR codified and narrative features. Methods: Using data from 12.5 million Veterans Affairs patients, ARCH first derives embedding vectors and generates similarities along with associated p-values to measure the strength of relatedness between clinical features with statistical certainty quantification. Next, ARCH performs a sparse embedding regression to remove indirect linkage between features to build a sparse KG. Finally, ARCH was validated on various clinical tasks, including detecting known relationships between entity pairs, predicting drug side effects, disease phenotyping, as well as sub-typing Alzheimer’s disease patients. Results: ARCH produces high-quality clinical embeddings and KG for over 60,000 codified and narrative EHR concepts. The KG and embeddings are visualized in the R-shiny powered web-API.3 ARCH achieved high accuracy in detecting EHR concept relationships, with AUCs of 0.926 (codified) and 0.861 (NLP) for similar EHR concepts, and 0.810 (codified) and 0.843 (NLP) for related pairs. It detected drug side effects with a 0.723 AUC, which improved to 0.826 after fine-tuning. Using both codified and NLP features, the detection power increased significantly. Compared to other methods, ARCH has superior accuracy and enhances weakly supervised phenotyping algorithms’ performance. Notably, it successfully categorized Alzheimer’s patients into two subgroups with varying mortality rates. Conclusion: The proposed ARCH algorithm generates large-scale high-quality semantic representations and knowledge graph for both codified and NLP EHR features, useful for a wide range of predictive modeling tasks.

Electronic health records↗

Lidar Mapping and Surveillance of Nuclear Infrastructure

Wear is unavoidable, whether it occurs in a nuclear facility or abridge on the highway its detection is crucial to preventing the failure of a system. While tools capable of detecting localized damage exist, industry lacks methods to evaluate the health of larger infrastructure. Routine inspection of nuclear facilities must be undertaken to ensure the safety of personnel and proper containment of nuclear materials. Most systems in a nuclear facility are designated as radioactive and confined spaces. To constantly monitor such systems in person would be hazardous but with a remote inspection tool it can be done in a safer and easier way. Lidar: Operates by emitting a laser pulse and looking for the reflected light. Allows user to gain 3D information of the environment. Project Objective: To develop an inspection tool for evaluating the health of large scale infrastructure using Lidar and machine learning. Autonomous Platform + Lidar + Data Fusion + Big Data. Use SLAM to build a 2D map of the environment. Point cloud created by transforming the points between reference frames. Point cloud to Surface: Inherent representation of surface geometry; Difficult to process with conventional techniques. Point cloud to Image: Easily processed by conventional machine learning algorithms. The quantity of data generated will necessitate a big data framework to manage the data for processing. Additional Sensors: Detecting the temperature (a) chemical makeup (b) and radiation emission (c) of a surface could assist in detecting problems. Human inspection can detect irregularities in both physical objects and their point-cloud representations. This is a good indication that mapping nuclear sites using Lidar will provide qualitative insight into the health of the facility. If deep learning can be used to automatically identify problem areas then the completed tool could become an invaluable asset.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Multi-Agent Graph-Attention Deep Reinforcement Learning for Post-Contingency Grid Emergency Voltage Control

Grid emergency voltage control (GEVC) is paramount in electric power systems to improve voltage stability and prevent cascading outages and blackouts in case of contingencies. While most deep reinforcement learning (DRL)-based paradigms perform single agents in a static environment, real-world agents for GEVC are expected to cooperate in a dynamically shifting grid. Moreover, due to high uncertainties from combinatory natures of various contingencies and load consumption, along with the complexity of dynamic grid operation, the data efficiency and control performance of the existing DRL-based methods are challenged. To address these limitations, we propose a multi-agent graph-attention (GATT)-based DRL algorithm for GEVC in multi-area power systems. Here, we develop graph convolutional network (GCN)-based agents for feature representation of the graph-structured voltages to improve the decision accuracy in a data-efficient manner. Furthermore, a cutting-edge attention mechanism concentrates on effective information sharing among multiple agents, synergizing different-sized subnetworks in the grid for cooperative learning. We address several key challenges in the existing DRL-based GEVC approaches, including low scalability and poor stability against high uncertainties. Test results in the IEEE benchmark system verify the advantages of the proposed method over several recent multi-agent DRL-based algorithms.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Masked Particle Modeling on Sets: Towards Self-Supervised High Energy Physics Foundation Models

Abstract We propose masked particle modeling (MPM) as a self-supervised method for learning generic, transferable, and reusable representations on unordered sets of inputs for use in high energy physics (HEP) scientific data. This work provides a novel scheme to perform masked modeling based pre-training to learn permutation invariant functions on sets. More generally, this work provides a step towards building large foundation models for HEP that can be generically pre-trained with self-supervised learning and later fine-tuned for a variety of down-stream tasks. In MPM, particles in a set are masked and the training objective is to recover their identity, as defined by a discretized token representation of a pre-trained vector quantized variational autoencoder. We study the efficacy of the method in samples of high energy jets at collider physics experiments, including studies on the impact of discretization, permutation invariance, and ordering. We also study the fine-tuning capability of the model, showing that it can be adapted to tasks such as supervised and weakly supervised jet classification, and that the model can transfer efficiently with small fine-tuning data sets to new classes and new data domains.

Heinrich, Lukas (ORCID:0000000240487584)↗