Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Algorithms and data structure”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,459 records · Page 81

Machine learning interatomic potential for silicon-nitride (Si 3 N 4 ) by active learning

Silicon nitride (Si 3 N 4 ) is an extensively used material in the automotive, aerospace, and semiconductor industries. However, its widespread use is in contrast to the scarce availability of reliable interatomic potentials that can be employed to study various aspects of this material on an atomistic scale, particularly its amorphous phase. In this work, we developed a machine learning interatomic potential, using an efficient active learning technique, combined with the Gaussian approximation potential (GAP) method. Our strategy is based on using an inexpensive empirical potential to generate an initial dataset of atomic configurations, for which energies and forces were recalculated with density functional theory (DFT); thereafter, a GAP was trained on these data and an iterative re-training algorithm was used to improve it by learning on-the-fly. When compared to DFT, our potential yielded a mean absolute error of 8 meV/atom in energy calculations for a variety of liquid and amorphous structures and a speed-up of molecular dynamics simulations by 3–4 orders of magnitude, while achieving a first-rate agreement with experimental results. Our potential is publicly available in an open-access repository.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

What does fault tolerant Deep Learning need from MPI?

Deep Learning (DL) algorithms have become the {\em de facto} Machine Learning (ML) algorithm for large scale data analysis. DL algorithms are computationally expensive -- even distributed DL implementations which use MPI require days of training (model learning) time on commonly studied datasets. Long running DL applications become susceptible to faults -- requiring development of a fault tolerant system infrastructure, in addition to fault tolerant DL algorithms. This raises an important question: {\em What is needed from MPI for designing fault tolerant DL implementations?} In this paper, we address this problem for permanent faults. We motivate the need for a fault tolerant MPI specification by an in-depth consideration of recent innovations in DL algorithms and their properties, which drive the need for specific fault tolerance features. We present an in-depth discussion on the suitability of different parallelism types (model, data and hybrid); a need (or lack thereof) for check-pointing of any critical data structures; and most importantly, consideration for several fault tolerance proposals (user-level fault mitigation (ULFM), Reinit) in MPI and their applicability to fault tolerant DL implementations. We leverage a distributed memory implementation of Caffe, currently available under the Machine Learning Toolkit for Extreme Scale (MaTEx). We implement our approaches by extending MaTEx-Caffe for using ULFM-based implementation. Our evaluation using the ImageNet dataset and AlexNet neural network topology demonstrates the effectiveness of the proposed fault tolerant DL implementation using OpenMPI based ULFM.

Amatya, Vinay C.↗

Analysis and compensation of an aircraft simulator control loading system with compliant linkage

A hydraulic control loading system for aircraft simulation was analyzed to find the causes of undesirable low frequency oscillations and loading effects in the output. The hypothesis of mechanical compliance in the control linkage was substantiated by comparing the behavior of a mathematical model of the system with previously obtained experimental data. A compensation scheme based on the minimum integral of the squared difference between desired and actual output was shown to be effective in reducing the undesirable output effects. The structure of the proposed compensation was computed by use of a dynamic programing algorithm and a linear state space model of the fixed elements in the system.

Johnson, P. R.↗

Preliminary data processing system for telemetry data from Interkosmos-8 type satellites

The preliminary data processing system (PDPS), a set of algorithms, programs, equipment, data storage and memory devices, and all devices controlling the processing, is described using the Intercosmos-8 satellite as an example. Each stage of the system is considered along with its content and sequence. The essential elements of the data processing structure are described and the concepts underlying the selection of these elements are discussed.

Vilchinskaya, A. S.↗

Geologic applications of thermal-inertia mapping from satellite

In the Powder River Basin, Wyo., narrow geologic units having thermal inertias which contrast with their surroundings can be discriminated in optimal images. A few subtle thermal inertia anomalies coincide with areas of helium leakage believed to be associated with deep oil and gas concentrations. The most important results involved delineation of tectonic framework elements some of which were not previously recognized. Thermal and thermal inertia images also permit mapping of geomorphic textural domains. A thermal lineament appears to reveal a basement discontinuity which involves the Homestake Mine in the Black Hill, a zone of Tertiary igneous activity and facies control in oil producing horizons. Applications of these data to the Cabeza Prieta, Ariz., area illustrate their potential for igneous rock type discrimination. Extension to Yellowstone National Park resulted in the detection of additional structural information but surface hydrothermal features could not be distinguished with any confidence. A thermal inertia mapping algorithm, a fast and accurate image registration technique, and an efficient topographic slope and elevation correction method were developed.

Offield, T. W.↗

Interaction of a cumulus cloud ensemble with the large-scale environment. IV - The discrete model

The Arakawa-Schubert (1974) parameterization is applied to a prognostic model of large-scale atmospheric circulations and used to analyze data in a general circulation model (GCM). The vertical structure of the large-scale model and the solution for the cloud subensemble thermodynamical properties are examined to choose cloud levels and representative regions. A mass flux distribution equation is adapted to formulate algorithms for calculating the large-scale forcing and the mass flux kernel, using either direct solution or linear programming. Finally, the feedback of the cumulus ensemble on the large-scale environment for a given subensemble mass flux is calculated. All cloud subensemble properties were determined from the conservation of mass, moist static energy, and total water.

Lord, S. J.↗

Fidelity of Satellite Soundings

Two pattern recognition procedures to provide improvements to first guess fields for satellite temperature retrievals were developed. The first technique where a radiometer measurement is used to select one or more historical radiosonde temperature profiles as analog estimates of ambient thermal structure. Radiosondes are the vertical scales of the analogs. The vertical resolving power of the satellite radiometer is relevant only to a decision process. The analog selection process is much more effective if implemented in an orthogonalized space of measurement information. The second procedure partitions a priori dependent data into shape coherent pattern libraries using structure information inherent in the data itself. It is shown that the pattern recognition techniques are able to reduce first guess profile errors by nearly 50%. The impact of pattern recognition on temperature retrieval error is assessed by regression and physical iterative retrieval algorithms. The influence of improved first guess fields is markedly different on these two types of algorithm. Pattern recognition was a strong positive impact on the physical iterative method.

Thompson, O.↗

Evolution and advanced technology

The NASREM architecture with its standard interfaces permits development and evolution of the Flight Telerobotic Servicer to greater autonomy. Technologies in control strategies for an arm with seven DOF, including a safety system containing skin sensors for obstacle avoidance, are being developed. Planning and robotic execution software includes symbolic task planning, world model data bases, and path planning algorithms. Research over the last five years has led to the development of laser scanning and ranging systems, which use coherent semiconductor laser diodes for short range sensing. The possibility of using a robot to autonomously assemble space structures is being investigated. A control framework compatible with NASREM is being developed that allows direct global control of the manipulator. Researchers are developing systems that permit an operator to quickly reconfigure the telerobot to do new tasks safely.

Ollendorf, Stanford↗

Model correlation and damage location for large space truss structures: Secant method development and evaluation

On-orbit testing of a large space structure will be required to complete the certification of any mathematical model for the structure dynamic response. The process of establishing a mathematical model that matches measured structure response is referred to as model correlation. Most model correlation approaches have an identification technique to determine structural characteristics from the measurements of the structure response. This problem is approached with one particular class of identification techniques - matrix adjustment methods - which use measured data to produce an optimal update of the structure property matrix, often the stiffness matrix. New methods were developed for identification to handle problems of the size and complexity expected for large space structures. Further development and refinement of these secant-method identification algorithms were undertaken. Also, evaluation of these techniques is an approach for model correlation and damage location was initiated.

Smith, Suzanne Weaver↗

Optimum Design of Aerospace Structural Components Using Neural Networks

The application of artificial neural networks to capture structural design expertise is demonstrated. The principal advantage of a trained neural network is that it requires a trivial computational effort to produce an acceptable new design. For the class of problems addressed, the development of a conventional expert system would be extremely difficult. In the present effort, a structural optimization code with multiple nonlinear programming algorithms and an artificial neural network code NETS were used. A set of optimum designs for a ring and two aircraft wings for static and dynamic constraints were generated using the optimization codes. The optimum design data were processed to obtain input and output pairs, which were used to develop a trained artificial neural network using the code NETS. Optimum designs for new design conditions were predicted using the trained network. Neural net prediction of optimum designs was found to be satisfactory for the majority of the output design parameters. However, results from the present study indicate that caution must be exercised to ensure that all design variables are within selected error bounds.

Berke, L.↗

Implementation of a generalized coherent elastic scattering formulation for thermal neutron scattering analysis - 14487

The scattering interactions of thermal neutrons in matter are classified into inelastic and elastic components. In crystalline materials, coherent elastic scattering represents a dominant form of interaction. Traditionally, the treatment of this interaction in standard computer codes (e.g., the LEAPR module of the NJOY code system) was performed within the cubic approximation and restricted the analyst to a few materials that were hardwired into the code. In general, these restrictions can hinder the production of ENDF style thermal neutron scattering libraries for new materials outside the current portfolio of treated materials. In this work, a general formulation based on the exact theory of coherent elastic scattering was developed. This formulation is capable of processing the crystalline structure of any material. The cubic approximation is relaxed by accounting for the partial forces from asymmetric crystal structures in the calculation. The atom sites approximation is relaxed by utilizing a site-wise Debye-Waller factor. Specifically, the Debye-Waller factor is no longer regarded as a uniform constant across the crystal but treated as a matrix tensor that uses the integral of the partial phonon density of states. Therefore, the calculation of the coherent elastic scattering cross section is executed by applying the matrix-form of the Debye-Waller factor on each reciprocal space point and summing them up. Furthermore, the developed algorithm supports compounds with any number of elements and of any ratio to each other. This general formulation was successfully implemented and contributed to the production of ENDF style thermal neutron scattering libraries for silicon dioxide (α-SiO{sub 2}) and silicon carbide (3C-SiC). The needed input for the analysis was generated using density functional theory (DFT) atomistic simulations and dynamical matrix calculations for both materials. (authors)

42 ENGINEERING↗

Phenix - a comprehensive python-based system for macromolecular structure solution

Macromolecular X-ray crystallography is routinely applied to understand biological processes at a molecular level. However, significant time and effort are still required to solve and complete many of these structures because of the need for manual interpretation of complex numerical data using many software packages, and the repeated use of interactive three-dimensional graphics. Phenix has been developed to provide a comprehensive system for crystallographic structure solution with an emphasis on automation of all procedures. This has relied on the development of algorithms that minimize or eliminate subjective input, the development of algorithms that automate procedures that are traditionally performed by hand, and finally the development of a framework that allows a tight integration between the algorithms.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Multi-reference approach to the calculation of photoelectron spectra including spin-orbit coupling

X-ray photoelectron spectra provide a wealth of information on the electronic structure. The extraction of molecular details requires adequate theoretical methods, which in case of transition metal complexes has to account for effects due to the multi-configurational and spin-mixed nature of the many-electron wave function. Here, the restricted active space self-consistent field method including spin-orbit coupling is used to cope with this challenge and to calculate valence- and core-level photoelectron spectra. The intensities are estimated within the frameworks of the Dyson orbital formalism and the sudden approximation. Thereby, we utilize an efficient computational algorithm that is based on a biorthonormal basis transformation. The approach is applied to the valence photoionization of the gas phase water molecule and to the core ionization spectrum of the [Fe(H{sub 2}O){sub 6}]{sup 2+} complex. The results show good agreement with the experimental data obtained in this work, whereas the sudden approximation demonstrates distinct deviations from experiments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

HipGISAXS : a high-performance computing code for simulating grazing-incidence X-ray scattering data

This article describes the development of a flexible grazing-incidence small-angle X-ray scattering (GISAXS) simulation code in the framework of the distorted wave Born approximation that effectively utilizes the parallel processing power provided by graphics processors and multicore processors. The code, entitled High-Performance GISAXS , computes the GISAXS image for any given superposition of user-defined custom shapes or morphologies in a material and for various grazing-incidence angles and sample orientations. These capabilities permit treatment of a wide range of possible sample structures, including multilayered polymer films and nanoparticles on top of or embedded in a substrate or polymer film layers. In cases where the material displays regions of significant refractive index contrast, an algorithm has been implemented to perform a slicing of the sample and compute the averaged refractive index profile to be used as the reference geometry of the unperturbed system. A number of case studies are presented, which demonstrate good agreement with the experimental data for a variety of polymer and hybrid polymer/nanoparticle composite materials. The parallelized simulation code is well suited for addressing the analysis efforts required by the increasing amounts of GISAXS data being produced by high-speed detectors and ultrafast light sources.

Chemistry↗

Distinguishing isotropic and anisotropic signals for X-ray total scattering using machine learning

Understanding structure–property relationships is essential for advancing technologies based on thin films. X-ray pair distribution function (PDF) analysis can access relevant atomic structure details spanning local-, mid- and long-range structure. While X-ray PDF has been adapted for thin films on amorphous substrates, measurements on single-crystal substrates are necessary to accurately determine structure origins for some thin film materials, especially those for which the substrate changes the accessible structure and properties. However, when measuring films on single-crystal substrates, high-intensity anisotropic Bragg spots saturate 2D detector images, overshadowing the thin films' isotropic scattering signal. This renders previous data processing methods for films on amorphous substrates unsuitable for films on single-crystal substrates. To address this measurement need, we developed IsoDAT2D, an innovative data processing approach using unsupervised machine learning algorithms. The program combines dimensionality reduction and clustering algorithms to separate thin film and single-crystal substrate X-ray scattering signals. We use SimDAT2D , a program we developed to generate simulated thin film data, to validate IsoDAT2D . Here we also use IsoDAT2D to isolate X-ray total scattering signal from a thin film on a single-crystal substrate. The resulting PDF data are compared with similar data processed using previous methods, especially substrate subtraction for single-crystal and amorphous substrates. PDF data from IsoDAT2D -identified X-ray total scattering data are significantly better than from single-crystal substrate subtraction, but not as reliable as PDF data from amorphous substrate subtraction. With IsoDAT2D , there are new opportunities to expand PDF to a wider variety of thin films, including those on single-crystal substrates, with which new structure–property relationships can be elucidated to enable fundamental understanding and technological advances.

36 MATERIALS SCIENCE↗

Development of neural network force fields for corrosion studies

To fully understand the chemistry and physics of corrosion, novel methods of simulation must be developed. One approach is designing machine learning (ML) algorithms integrated with density functional theory to develop adaptive force fields to gain insight into corrosion behavior namely at the surface of metal oxides. Current methods of modeling corrosion are slow due to the computational cost of resolving both reaction mechanics and mass transport processes. Machine learning methods can be implemented to obtain structure-activity relationships at both the molecular and bulk scale while still retaining the accuracy of density functional theory (DFT) and significantly decreasing the time needed for simulations of complex chemical processes in the various environments of corrosion. Multiscale models are needed for corrosion studies to fully understand its processes not only at the atomic length scale (chemical bonding, energies, and forces), but also at the nano and meso length scales (solid-state physics and material science processes). Current methods of study include DFT, molecular dynamics, and Monte Carlo. The limitation of DFT is that only a small number of atoms or molecules can be simulated at that level of theory. Density functional theory is used to study the electronic structure of atoms and molecules, and calculate the force component of each atom. However, these calculations are limited to about 1000 atoms. Custom periodic boundary conditions (PBC) can be used to describe the various environments and defects that affect the atomic forces to produce a large data set from which a training set can be derived. Machine learning can be utilized to overcome the barrier of modeling macroscopic and multi-scale processes from ab initio calculations through the development of adaptive force fields. Local environments determine the atomic forces of a given system, therefore adaptive force fields must be created to produce reliable quantum mechanical calculations. This can be achieved by developing a learning algorithm that uses the mapped atomic forces or fingerprint as an input to produce energies and magnetic moments as output. A systematic approach was used to begin to build a data set in order to accurately describe the atomic forces in various environments. In Figure 4 below, a simple PBC cell of Fe{sub 2}O{sub 3} was first optimized. A surface optimization was performed next, followed by a hydroxylated surface optimization. Once this calculation has converged, the adsorption of halide species to the hydroxylated surface will be investigated. TensorFlow is an open source platform for machine learning developed by Google. Using a high level application program interface (API) such as Keras allows for building and training ML models easily in a number of different environments and languages. For this project, a neural network was developed within Anaconda in Python. Future Work: Further development of reference data set; Refining neural network and learning algorithm; Fingerprinting atomic environment to enable mapping of atomic force components; Choosing appropriate training set from reference data; Learning from training set and enabling non-linear mapping of training set fingerprints and the atomic forces; Estimation of uncertainty to identify ranges of outside applicability; Testing and analysis of molecular dynamic simulations.

36 MATERIALS SCIENCE↗

Energy-efficient mapping of large-scale workflows under deadline constraints in big data computing systems

Large-scale workflows for big data analytics have become a main consumer of energy in data centers where moldable parallel computing models such as MapReduce are widely applied to meet high computational demands with time-varying computing resources. The granularity of task partitioning in each moldable job of such big data workflows has a significant impact on energy efficiency, which remains largely unexplored. In this paper, we analyze the properties of moldable jobs and formulate a workflow mapping problem to minimize the dynamic energy consumption of a given workflow request under a deadline constraint in big data systems. Since this problem is strongly NP-hard, we design a fully polynomial-time approximation scheme (FPTAS) for a special case with a pipeline-structured workflow on a homogeneous cluster and a heuristic for the generalized problem with an arbitrary workflow on a heterogeneous cluster. The performance superiority of the proposed solution in terms of dynamic energy saving and deadline missing rate is illustrated by extensive simulation results in comparison with existing algorithms, and further validated by real-life workflow implementation and experimental results in Hadoop/YARN systems.

97 MATHEMATICS AND COMPUTING↗

An analysis of mesoscale VAS retrievals using statistical structure functions

Mesoscale sounding data from a truth rawinsonde network and a VAS from March 6-7, 1982 are statistically studied. The parameters of temperature, geopotential height, and mixing ratio at 850, 700, 500, 300, and 200 mb levels, and thickness and precipitable water are examined. The VAS retrieval gradients derived from a physical algorithm and from a regression technique are analyzed; the analysis reveals that both techniques have similar error characteristics and capabilities for calculating gradients of mesoscale temperature and geopotential height. Ground-truth rawinsonde data and VAS retrievals are compared; it is observed that VAS data describes weaker gradients than rawinsonde data.

Fuelberg, H. E.↗