Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “generalization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,621 records · Page 90

Tolerating Correlated Failures for Generalized Cartesian Distributions via Bipartite Matching

Faults are expected to play an increasingly important role in how algorithms and applications are designed to run on future extreme-scale systems. A key ingredient of any approach to fault tolerance is effective support for fault tolerant data storage. A typical application execution consists of phases in which certain data structures are modified while others are read-only. Often, read-only data structures constitute a large fraction of total memory consumed. Fault tolerance for read-only data can be ensured through the use of checksums or parities, without resorting to expensive in-memory duplication or checkpointing to secondary storage. In this paper, we present a graph-matching approach to compute and store parity data for read-only matrices that are compatible with fault tolerant linear algebra (FTLA). Typical approaches only support blocked data distributions with each process holding one block with the parity located on additional processes. The matrices are assumed to be blocked by a cartesian grid with each block assigned to a process. We consider a generalized distribution in which each process can be assigned arbitrary blocks. We also account for the fact that multiple processes might be part of the same failure unit, say an SMP node. The flexibility enabled by our novel application of graph matching extends fault tolerance support to data distributions beyond those supported by prior work. We evaluate the matching implementations and cost to compute the parity and recover lost data, demonstrating the low overhead incurred by our approach.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

New-Sum: A Novel Online ABFT Scheme For General Iterative Methods

Emerging high-performance computing platforms, with large component counts and lower power margins, are anticipated to be more susceptible to soft errors in both logic circuits and memory subsystems. We present an online algorithm-based fault tolerance (ABFT) approach to efficiently detect and recover soft errors for general iterative methods. We design a novel checksum-based encoding scheme for matrix-vector multiplication that is resilient to both arithmetic and memory errors. Our design decouples the checksum updating process from the actual computation, and allows adaptive checksum overhead control. Building on this new encoding mechanism, we propose two online ABFT designs that can effectively recover from errors when combined with a checkpoint/rollback scheme.

Instantaneous Footprint↗

IRNet: A General Purpose Deep Risidual Regression Framework for Materials Discovery

Materials discovery is crucial for making scientific advances in many domains. Collections of data from experiments and first-principle computations have spurred interest in applying machine learning methods to create predictive models capable of mapping from composition and crystal structures to materials properties. Generally, these are regression problems with the input being a 1D vector composed of numerical attributes representing the material composition and/or crystal structure. While neural networks consisting of fully connected layers have been applied to such problems, their performance often suffers from the vanishing gradient problem when network depth is increased. Hence, predictive modeling for such tasks has been mainly limited to traditional machine learning techniques such as Random Forest. In this paper, we study and propose design principles for building deep regression networks composed of fully connected layers with numerical vectors as input. We introduce a novel deep regression network with individual residual learning, IRNet, that places shortcut connections after each layer so that each layer learns the residual mapping between its output and input. We use the problem of learning properties of inorganic materials from numerical attributes derived from material composition and/or crystal structure to compare IRNet’s performance against that of other machine learning techniques. Using multiple datasets from the Open Quantum Materials Database (OQMD) and Materials Project for training and evaluation, we show that IRNet provides significantly better prediction performance than the state-of-the-art machine learning approaches currently used by domain scientists. We also show that IRNet’s use of individual residual learning leads to better convergence during the training phase than when shortcut connections are between multi-layer stacks while maintaining the same number of parameters.

deep learning↗

General-Purpose Unsupervised Cyber Anomaly Detection via Non-Negative Tensor Factorization

Distinguishing malicious anomalous activities from unusual but benign activities is a fundamental challenge for cyber defenders. Prior studies have shown that statistical user behavior analysis yields accurate detections by learning behavior profiles from observed user activity. These unsupervised models are able to generalize to unseen types of attacks by detecting deviations from normal behavior, without knowledge of specific attack signatures. However, approaches proposed to date based on probabilistic matrix factorization are limited by the information conveyed in a two-dimensional space. Non-negative tensor factorization, on the other hand, is a powerful unsupervised machine learning method that naturally models multi-dimensional data, capturing complex and multi-faceted details of behavior profiles. Herein, our new unsupervised statistical anomaly detection methodology matches or surpasses state-of-the-art supervised learning baselines across several challenging and diverse cyber application areas, including detection of compromised user credentials, botnets, spam e-mails, and fraudulent credit card transactions.

97 MATHEMATICS AND COMPUTING↗

Power Grid Behavioral Patterns and Risks of Generalization in Applied Machine Learning

Recent years have seen a rich literature of data-driven approaches designed for power grid applications. However, insufficient consideration of domain knowledge can impose a high risk to the practicality of the methods. Specifically, ignoring the grid-specific spatiotemporal patterns (in load, generation, and topology, etc.) can lead to outputting infeasible, unrealizable, or completely meaningless predictions on new inputs. To address this concern, this paper investigates real-world operational data to provide insights into power grid behavioral patterns, including the time-varying topology, load, and generation, as well as the spatial differences (in peak hours, diverse styles) between individual loads and generations. Then based on these observations, we evaluate the generalization risks in some existing ML works caused by ignoring these grid-specific patterns in model design and training.

Li, Shimiao↗

Robust Containment Queries over Collections of Trimmed NURBS Surfaces via Generalized Winding Numbers

Here, we propose a containment query that is robust to the watertightness of regions bound by trimmed NURBS surfaces, as this property is difficult to guarantee for in-the-wild CAD models. Containment is determined through the generalized winding number (GWN), a mathematical construction that is indifferent to the arrangement of surfaces in the shape. Applying contemporary techniques for the 3D GWN to trimmed NURBS surfaces requires some form of geometric discretization, introducing computational inefficiency to the algorithm and even risking containment misclassifications near the surface. In contrast, our proposed method leverages properties of the 3D solid angle to solve the relevant surface integral using a boundary formulation with rapidly converging adaptive quadrature. Batches of queries are further accelerated by memoizing (i.e., caching and reusing) quadrature node positions and tangents as they are evaluated. We demonstrate that our GWN method is robust to complex trimming geometry in a CAD model, and is accurate up to arbitrary precision at arbitrary distances from the surface. The derived containment query is therefore robust to model non-watertightness while respecting all curved features of the input shape.

97 MATHEMATICS AND COMPUTING↗

Generalized Symmetries in Condensed Matter

Recent advances in our understanding of symmetry in quantum many-body systems offer the possibility of a generalized Landau paradigm that encompasses all equilibrium phases of matter. This is a brief and elementary review of some of these developments.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

General Nonlinear Ferroelectric Model v. Beta

The purpose of this software is to function as a generalized ferroelectric material model. The material model is designed to work with existing finite element packages by providing updated information on material properties that are nonlinear and dependent on loading history. The two major nonlinear phenomena this model captures are domain-switching and phase transformation. The software itself does not contain potentially sensitive material information and instead provides a framework for different physical phenomena observed within ferroelectric materials. The model is calibrated to a specific ferroelectric material through input parameters provided by the user.

Dong, Wen↗

rlmolecule: A library for general-purpose material and molecular optimization using AlphaZero-style reinforcement learning

This library includes in-progress code for the optimization of materials and molecules using reinforcement learning. This project seeks to develop a generalized machine learning approach for optimizing targeted, and often complex, functional properties over the space of possible material structures, allowing faster identification of promising candidates. Electronic and transport properties of materials are determined by their molecular structure (for molecules) or their crystal structure (for in-organic crystalline materials). The atomic composition, bonding, and 3-D-spatial arrangement in these systems therefore represent a vast, discontinuous search space for optimal candidates. This library implements AlphaZero style reinforcement learning applied to two worked examples: the optimization of stable organic radicals for redox flow batteries, and the determination of stable electrolyte species for solid state batteries. The current code contains proof-of-concept results run on the Eagle HPC system, while the completed package will be a flexible tool for material optimization across of number of energy-relevant fields, which leverages cloud compute resources for the majority of the computational heavy lifting.

Biagioni, David↗

Location Generalizer

This software produces general location descriptions from time-series location data collected from mobile devices that record global positioning system (GPS) coordinates over time. The purpose of this software is to convert detailed location history data, which is considered personally identifiable information (PII), into non-traceable, anonymized, generic information that is useful to researchers but does not contain PII. The software is specifically designed for use with trigger-based data that describe the parked locations and dwell times of automobiles.

Smart, John↗

Generalized Nuclear Data - WPEC Subgroup 43

This repository describes the goals and governance of WPEC Subgroup 43 (SG43). This subgroup is tasked with creating infrastructure for the Generalized Nuclear Data (GND) format.

Conlin, Jeremy↗

The Generalized Spallation Model

The Generalized Spallation Model (GSM) event generator is an advanced, robust, and scalable Fortran code developed from an extended and improved version of the earlier event generator codes CEM03.03 and LAQGSM03.03. The GSM implements its algorithms within the context of cascade exciton, particle equilibration, particle evaporation, and particle disintegration models sampled via Monte-Carlo techniques. Coalescence of particles is also considered. The GSM assumes the incident particles has sufficient energy to satisfy the assumptions utilized in the GSM. The GSM calculates reactions induced by hadrons and nuclei incident on nuclear targets at incident energies ranging from ~20 MeV up to several TeV per nucleon. Usage of GSM is recommended however for particles with incident energies exceeding ~100 MeV to ensure model-assumptions are satisfied. The GSM additionally provides its clients with sub-model libraries to allow them to model desired physics within their own physical models.

Juneau, Chase↗

GEECS (Generalized Equipment and Experiment Control System)

GEECS (Generalized Equipment and Experiment Control System) monitors and controls equipment distributed across a network, performs experiments by scanning input variables, and collects and stores various types of data synchronously from devices. Examples of devices include cameras, motors and pressure gauges. GEEKS is based upon LabView graphical object oriented programming (GOOP), allowing for a modular and scalable framework. Data is published for subscription of an arbitrary number of variables over TCP. A secondary framework allows easy development of graphical user interfaces for a combined control of any available devices on the control system without the need of programming knowledge. This allows for rapid integration of GEECS into a wide variety of systems. A database interface provides for devise and process configuration while allowing the user to save large quantities of data to local or network drives.

Gonsalves, Anthony↗

General Entity Model

General Entity Model (GEM) is an extensible, upper-level ontology. An ontology is simply a collection of concepts and their relationships and properties and can be used as a schema or data model to describe some domain. As an upper-level ontology, GEM is intended to be used as a foundation for building domain-specific ontologies (such as energy, manufacturing, etc).

Browning, JerenM↗

General Line Ampacity State Solver

INL’s General Line Ampacity State Solver (GLASS) is a high performance software platform that enables advanced grid system operations and planning efforts to be computed in real time. It enables the combination of advanced sensors and sensor networks, communication and data transfer channels, secure and reliable data management, and real-time processing through a flexible system architecture, with the ability to support and integrate with any utility enterprise system. GLASS is designed to help resolve the problems associated with thermally limited transmission and distribution networks, namely bare overhead power transmission lines. GLASS enables the methodology of Concurrent Cooling (Dynamic Line Rating) by reducing the need of using a cost-prohibited number of weather stations (reduce the number of weather stations per mile of overhead power line) to achieve the resolution necessary for individual electric transmission line span capacity calculations. GLASS achieves this by coupling real-time grid operations data and infrastructure architecture information with real-time field deployed weather station measurements and pre-computed Computational Fluid Dynamics (CFD)-based wind modeling interpolation parameters (look-up tables). GLASS uses mathematical models based on the IEEE 738 standard and builds off of the provided iterative solution using modern software paradigms and programming styles to provide a more robust and modular software system. GLASS also interfaces in real-time with utility companies using known transmission line spans and structures. GLASS provides real-time ampacity calculations based on recent weather station data as well as transmission line specifications. GLASS also allows the user to interact graphically with internal databases, which include information such as transmission line conductor types and thermal rating limits, weather station names and locations, specific transmission line span and structure locations, as well as recent ampacity calculations.

Gentle, Jake↗

Generalized Aerosol/Chemistry Interface (GIANT): A Community Effort to Advance Collaborative Science across Weather and Climate Models

Atmospheric aerosol and chemistry modules are key elements in Earth system models (ESMs), as they predict air pollutant concentrations and properties that can impact human health, weather, and climate. The current uncertainty in climate projections is partly due to the inaccurate representation of aerosol direct and indirect forcing. Aerosol/chemistry parameterizations used within ESMs and other atmospheric models span large structural and parameter uncertainties that are difficult to assess independently of their host models. Moreover, there is a strong need for a standardized interface between aerosol/chemistry modules and the host model to facilitate portability of aerosol/chemistry parameterizations from one model to another, allowing not only a comparison between different parameterizations within the same modeling framework, but also quantifying the impact of different model frameworks on aerosol/chemistry predictions. To address this need, we have initiated a new community effort to coordinate the construction of a Generalized Aerosol/Chemistry Interface (GIANT) for use across weather and climate models. We aim to organize a series of community workshops and hackathons to design and build GIANT, which will serve as the interface between a range of aerosol/chemistry modules and the physics and dynamics components of atmospheric host models. GIANT will leverage ongoing efforts at the U.S. modeling centers focused on building next-generation ESMs and the international AeroCom initiative to implement this common aerosol/chemistry interface. GIANT will create transformative opportunities for scientists and students to conduct innovative research to better characterize structural and parametric uncertainties in aerosol/chemistry modules, and to develop a common set of aerosol/chemistry parameterizations.

54 ENVIRONMENTAL SCIENCES↗

Polynomial Chaos–Based Bayesian Inference of K -Profile Parameterization in a General Circulation Model of the Tropical Pacific

The authors present a polynomial chaos (PC)–based Bayesian inference method for quantifying the uncertainties of the K-profile parameterization (KPP) within the MIT general circulation model (MITgcm) of the tropical Pacific. The inference of the uncertain parameters is based on a Markov chain Monte Carlo (MCMC) scheme that utilizes a newly formulated test statistic taking into account the different components representing the structures of turbulent mixing on both daily and seasonal time scales in addition to the data quality, and filters for the effects of parameter perturbations over those as a result of changes in the wind. To avoid the prohibitive computational cost of integrating the MITgcm model at each MCMC iteration, a surrogate model for the test statistic using the PC method is built. Because of the noise in the model predictions, a basis-pursuit-denoising (BPDN) compressed sensing approach is employed to determine the PC coefficients of a representative surrogate model. The PC surrogate is then used to evaluate the test statistic in the MCMC step for sampling the posterior of the uncertain parameters. Results of the posteriors indicate good agreement with the default values for two parameters of the KPP model, namely the critical bulk and gradient Richardson numbers; while the posteriors of the remaining parameters were barely informative.

54 ENVIRONMENTAL SCIENCES↗