Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Algorithms and data structure”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

Survey of Current State of the Art Entity-Relation Extraction Tools

In the area of information extraction from text data, there exists a number of tools with the capability of extracting entities, topics, and their relationships with one another from both structured and unstructured text sources. Such information has endless uses in a number of domains, however, the solutions to getting this information are still in early stages and has room for improvement. The topic has been explored from a research perspective by academic institutions, as well as formal tool creation from corporations but has not made much advancement since the early 2000's. Overall, entity extraction, and the related topic of entity linking, is common among these tools, though with varying degrees of accuracy, while relationship extraction is more difficult to find and seems limited to same sentence analysis. In this report, we take a look at the top state of the art tools currently available and identify their capabilities, strengths, and weaknesses. We explore the common algorithms in the successful approaches to entity extraction and their ability to efficiently handle both structured and unstructured text data. Finally, we highlight some of the common issues among these tools and summarize the current ability to extract relationship information.

97 MATHEMATICS AND COMPUTING↗

Thunderstorm Cloud-Type Classification from Space-Based Lightning Imagers

The organization and structure of thunderstorms determines the extent and severity of their hazards to the general public and their consequences for the Earth system. Distinguishing vigorous convective regions that produce heavy rain and hail from adjacent regions of stratiform clouds or overhanging anvil clouds that produce light to no rainfall is valuable in operations and physical research. Cloud-type algorithms that partition convection from stratiform regions have been developed for space-based radar, passive microwave, and now Geostationary Operational Environmental Satellites (GOES) Advanced Baseline Imager (ABI) multispectral products. However, there are limitations for each of these products including temporal availability, spatial coverage, and the degree to which they based on cloud microphysics. We report we have developed a cloud-type algorithm for GOES Geostationary Lightning Mapper (GLM) observations that identifies convective/nonconvective regions in thunderstorms based on signatures of interactions with nonconvective charge structures in the lightning flash data. The GLM sensor permits a rapid (20 s) update cycle over the combined GOES-16–GOES-17 domain across all hours of the day. Storm regions that do not produce lightning will not be classified by our algorithm, however. The GLM cloud-type product is intended to provide situational awareness of electrified nonconvective clouds and to complement other cloud-type retrievals by providing a contemporary assessment tied to lightning physics. We propose that a future combined ABI–GLM cloud-type algorithm would be a valuable product that could draw from the strengths of each instrument and approach.

54 ENVIRONMENTAL SCIENCES↗

Signal to Noise Studies on Thermographic Data with Fabricated Defects for Defense Structures

There is a growing international interest in thermal inspection systems for asset life assessment and management of defense platforms. The efficacy of flash thermography is generally enhanced by applying image processing algorithms to the observations of raw temperature. Improving the defect signal to noise ratio (SNR) is of primary interest to reduce false calls and allow for easier interpretation of a thermal inspection image. Several factors affecting defect SNR were studied such as data compression and reconstruction using principal component analysis and time window processing.

Zalameda, Joseph N.↗

An Intelligent Distributed Ledger Construction Algorithm for IoT

Blockchain is the next generation of secure data management that creates near-immutable decentralized storage. Secure cryptography created a niche for blockchain to provide alternatives to well-known security compromises. However, design bottlenecks with traditional blockchain data structures scale poorly with increased network usage and are extremely computation-intensive. This made the technology difficult to combine with limited devices, like those in Internet of Things networks. In protocols like IOTA, replacement of blockchain's linked-list queue processing with a lightweight dynamic ledger showed remarkable throughput performance increase. However, current stochastic algorithms for ledger construction suffer distinct trade-offs between efficiency and security. This work proposed a machine-learning approach with a multi-arm bandit that resolved these issues and was designed for auditing on limited devices. This algorithm was tested in a reinforcement-learning environment simulating the IOTA ledger's construction with a decision tree. This study showed through regret analysis and experimentation that this approach was secure against impulse manipulation attacks while remaining energy-efficient. Although the IOTA protocol was a pioneer for lightweight distributed ledgers, it is expected that future blockchain protocols will adopt techniques similar to those presented in this work.

multi-arm bandit↗

Application of concurrent processing to structural dynamic response computations

Described are the experiences gained from solving for the dynamic response of two simple structures on an experimental Multiple Instruction Multiple Data (MIMD) computer called the finite element machine. Introduced are MIMD computing concepts, describing how the concurrent algorithmic techniques implemented and giving results for the two example problems. The results show computational speedups of up to 7.83 using eight of the finite element machine processors and indicate that significant computational speedups are possible for large order structural computations.

Ransom, J.↗

Unsupervised discovery of extreme weather events using universal representations of emergent organization

Spontaneous self-organization is ubiquitous in systems far from thermodynamic equilibrium. While organized structures that emerge dominate transport properties, universal representations that identify and describe these key objects remain elusive. Here, we introduce a theoretically grounded framework for describing emergent organization that, via data-driven algorithms, is constructive in practice. Its building blocks are spacetime lightcones that embody how information propagates across a system through local interactions. We show that predictive equivalence classes of lightcones—local causal states—capture organized behaviors in complex spatiotemporal systems. Employing an unsupervised physics-informed machine learning algorithm and a high-performance computing implementation, we demonstrate automatically discovering organized structures in two real-world domain science problems. We show that local causal states identify vortices and track their power-law decay behavior in two-dimensional fluid turbulence. We then show how to detect and track familiar extreme weather events—hurricanes and atmospheric rivers—and discover other novel structures associated with precipitation extremes in high-resolution climate data at the grid-cell level.

Rupe, Adam [Pacific Northwest National Laboratory ↗

The Cooperative Huntsville Meteorological Experiment (COHMEX)

The Satellite Precipitation and Cloud Experiment, the Microburst and Severe Thunderstorm, and the FAA Lincoln Laboratories Operational Weather Studies of the COHMEX are described. The precipitation and cloud experiment focuses on the prestorm period in order to observe the physical processes leading to the formation of small convective systems. Aircraft, remote sensing and rewinsonde data are utilized to determine various storm/environment characteristics. Doppler velocity and reflectivity of microburst clouds are studied to evaluate the three-dimensional structure of microbursts from thunderstorms. The weather studies are designed to develop and test automatic algorithms for wind shear detection using Doppler weather radars. The application of satellite systems to data collection for these experiments is discussed.

Dodge, J.↗

Vertical Structure in Phytoplankton Growth and Productivity Inferred From Biogeochemical-Argo Floats and the Carbon-Based Productivity Model

Estimates of marine net primary production (NPP) commonly rely on limited in situ 14C incubations or satellite-based algorithms mainly constrained to the surface ocean. Here we combine data from biogeochemical Argo floats with a carbon-based productivity model (CbPM) to compute vertically-resolved estimates of NPP. Inferred NPP profiles derived by informing the CbPM with float-based, depth-resolved, bio-optical data are able to qualitatively reproduce the vertical structure in NPP inferred from in situ 14C incubations at various ocean regions. At station ALOHA, float-based estimates agree within uncertainty with productivity observations at depth, but underestimate surface NPP. We test the ability of the CbPM to infer the depth-resolved structure in NPP from bio-optical properties in the mixed layer, in similar fashion as how remote sensing algorithms of ocean productivity operate. In Southern Ocean waters, the depth-reconstructing implementation of the CbPM overestimates phytoplankton division rates and Chl:C below the mixed layer, resulting in artificially high subsurface NPP when compared with the fully float-informed implementation of the model. The CbPM subsurface extrapolation of phytoplankton Chl, Chl:C division rates, and NPP improves by accounting for deep nutrient (iron) stress impacts on photoacclimation in the Southern Ocean. This improvement is also observed in vertically- integrated NPP, where the mean bias between model implementations in depth-integrated productivity south of 30◦S is reduced by 62 % when account for deep iron limitation. Our results demonstrate that profiling data from biogeochemical Argo floats can serve to inform regional adjustments that lead to the improvement of marine productivity algorithms.

NPP↗

nbodykit: An Open-source, Massively Parallel Toolkit for Large-scale Structure

We present nbodykit, an open-source, massively parallel Python toolkit for analyzing large-scale structure (LSS) data. Using Python bindings of the Message Passing Interface, we provide parallel implementations of many commonly used algorithms in LSS. nbodykit is both an interactive and scalable piece of scientific software, performing well in a supercomputing environment while still taking advantage of the interactive tools provided by the Python ecosystem. Existing functionality includes estimators of the power spectrum, two- and three-point correlation functions, a friends-of-friends grouping algorithm, mock catalog creation via the halo occupation distribution technique, and approximate N-body simulations via the FastPM scheme. The package also provides a set of distributed data containers, insulated from the algorithms themselves, that enables nbodykit to provide a unified treatment of both simulation and observational data sets. nbodykit can be easily deployed in a high-performance computing environment, overcoming some of the traditional difficulties of using Python on supercomputers. We provide performance benchmarks illustrating the scalability of the software. The modular, component-based approach of nbodykit allows researchers to easily build complex applications using its tools. The package is extensively documented at http://nbodykit.readthedocs.io, which also includes an interactive set of example recipes for new users to explore. As open-source software, we hope nbodykit provides a common framework for the community to use and develop in confronting the analysis challenges of future LSS surveys.

79 ASTRONOMY AND ASTROPHYSICS↗

On-the-fly machine-learning for high-throughput experiments: search for rare-earth-free permanent magnets

Advanced materials characterization techniques with ever-growing data acquisition speed and storage capabilities represent a challenge in modern materials science, and new procedures to quickly assess and analyze the data are needed. Machine learning approaches are effective in reducing the complexity of data and rapidly homing in on the underlying trend in multi-dimensional data. Here, we show that by employing an algorithm called the mean shift theory to a large amount of diffraction data in high-throughput experimentation, one can streamline the process of delineating the structural evolution across compositional variations mapped on combinatorial libraries with minimal computational cost. Data collected at a synchrotron beamline are analyzed on the fly, and by integrating experimental data with the inorganic crystal structure database (ICSD), we can substantially enhance the accuracy in classifying the structural phases across ternary phase spaces. We have used this approach to identify a novel magnetic phase with enhanced magnetic anisotropy which is a candidate for rare-earth free permanent magnet.

Kusne, AG↗

An analysis of gamma ray burst time histories

Gamma ray burst time histories, ranging in durations from milliseconds to thousands of seconds, are as varied as the number of bursts. They show a wide array of structures from those that are very smooth to those that contain a seemingly uncountable number of spikes riding on top of other spikes. These profiles have tantalized researchers for years - they obviously hold important information on the nature of GRB's, but to date no one has been successful in analyzing them. For the past year the author has been working on algorithms to analyze these data. Two approaches have been followed in this investigation. The first is an attempt to quantify the amount of structure, or spikiness, in a profile. The second involves applying the latest theorems on chaos and fractals with the aim of extracting useful information from what seems to be a random collection of shot noise.

Lestrade, John Patrick↗

On the Impact of Widening Vector Registers on Sequence Alignment

Vector extensions, such as SSE, have been part of the x86 since the 1990s, with applications in graphics, signal processing, and scientific applications. Although many algorithms and applications can naturally benefit from automatic vectorization techniques, there are still many that are difficult to vectorize due to their dependence on irregular data structures, dense branch operations, or data dependencies. Sequence alignment, one of the most widely used operations in bioinformatics workflows, has a computational footprint that features complex data dependencies. In this paper, we demonstrate that the trend of widening vector registers adversely affects the state-of-the-art sequence alignment algorithm based on striped data layouts. We present a practically efficient SIMD implementation of a parallel scan based sequence alignment algorithm that can better exploit wider SIMD units. We conduct comprehensive workload and use case analyses to characterize the relative behavior of the striped and scan approaches and identify the best choice of algorithm based on input length and SIMD width.

Needleman-Wunsch↗

Analysis techniques for blob properties from gas puff imaging data

Filamentary structures, also known as blobs, are a prominent feature of turbulence and transport at the edge of magnetically confined plasmas. They cause cross-field particle and energy transport and are, therefore, of interest in tokamak physics and, more generally, nuclear fusion research. Several experimental techniques have been developed to study their properties. Among these, measurements are routinely performed with stationary probes, passive imaging, and, in more recent years, Gas Puff Imaging (GPI). In this work, we present different analysis techniques developed and used on 2D data from the suite of GPI diagnostics in the Tokamak à Configuration Variable, featuring different temporal and spatial resolutions. Although specifically developed to be used on GPI data, these techniques can be employed to analyze 2D turbulence data presenting intermittent, coherent structures. We focus on size, velocity, and appearance frequency evaluation with, among other methods, conditional averaging sampling, individual structure tracking, and a recently developed machine learning algorithm. We describe in detail the implementation of these techniques, compare them against each other, and comment on the scenarios to which these techniques are best applied and on the requirements that the data must fulfill in order to yield meaningful results.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Characterization of tissue magnetic susceptibility-induced distortions for MRIgRT

Purpose: MR image geometric integrity is one of the building blocks of MRI-guided radiotherapy. In particular, tissue magnetic susceptibility-induced effects are patient-dependent and their behavior is difficult to assess and predict. In this study, the authors investigated in detail the characteristics of susceptibility ({chi}) distortions in the context of MRIgRT, including the case of two common MR-linac system configurations. Methods: The magnetic field distortions were numerically simulated for several imaging parameters and anatomical sites, i.e., brain, lung, pelvis (with air pockets), and prostate. The simulation process consisted of (a) segmentation of patient CT data into susceptibility relevant anatomical volumes (i.e., soft-tissue, bone and air/lung), (b) conversion of CT data into susceptibility masks by assigning bulk {chi} values to the structures defined at (a), (c) numerical computations of the local magnetic fields by using a finite difference algorithm, and (d) generation of the geometric distortion maps from the magnetic field distributions. For each patient anatomy, the distortions were quantified at the interfaces of anatomical structures with significantly different {chi} values. The analysis was performed for two specific orientations of the external main magnetic field (B{sub 0}) characteristic to the MR-linac systems, specifically along the z-axis for a bore MR scanner and in the (x,y)-plane for a biplanner magnet. The magnetic field local perturbations were reported in ppm. The metrics used to quantify the geometric distortions were the maximum, mean, and range of distortions. The numerical simulation algorithm was validated using phantom data measurements. Results: Susceptibility-induced distortions were determined for both quadratic and patient specific geometries. The numerical simulations showed a good agreement with the experimental data. The measurements were acquired at 1.5 and 3 T and with an encoding gradient varying between 3 and 20 mT/m by using an annular phantom mimicking the water-air and water-oil {chi} interfaces. For quadratic geometries, the magnitude of field distortion increased rapidly with the size of the inhomogeneity up to about 10 mm and then tended to plateau. This trend became more evident for materials with a larger {Delta}{chi} relative to water. The simulations showed only a slight increase in the maximum distortion values when the B{sub 0} orientation was varied with regard to the shape of the {chi} inhomogeneity. In the case of patient anatomy, the largest distortion values arose at the air-soft-tissue interface. Considering the two MR-linac system configurations and comparing the field distortion values corresponding to all organ structures, the distortions tended to be larger for the biplanar magnet. The authors provide a reference table with ppm values which can be used to easily evaluate the geometric distortions for patient data as a function of B{sub 0} and the strength of the encoding gradient. Conclusions: The susceptibility distortions were quantified as a function of multiple parameters such as the {chi} inhomogeneity size and shape, the magnitude of B{sub 0} and the readout gradient, and the orientation of B{sub 0} with respect to the sample geometry. The analysis was performed for several anatomical sites and corresponding to two B{sub 0} orientations as featured by MR-linac systems.

60 APPLIED LIFE SCIENCES↗

Producing Science-Ready Radar Datasets for the Retrieval of Forest Structure Parameters from Backscatter: Correcting for Terrain Topography and Changes in Vegetation Reflectivity

Radar backscatter data contain both geometric and radiometric distortions due to underlying topography and the radar viewing geometry. Our objective is to develop a radiometric correction algorithm specific to the UAVSAR system configuration that would improve retrieval of forest structure parameters. UAVSAR is an airborne Lband radar capable of repeat?pass interferometry producing images with a spatial resolution of 5m. It is characterized by an electronically steerable antenna to compensate for aircraft attitude. Thus, the computation of viewing angles (i.e. look, incidence and projection) must include aircraft attitude angles (i.e. yaw, pitch and roll) in addition to the antenna steering angle. In this presentation, we address two components of radiometric correction: area projection and vegetation reflectivity. The first correction is applied by normalization of the radar backscatter by the local ground area illuminated by the radar beam. The second is a correction due to changes in vegetation reflectivity with viewing geometry.

polarimetry↗

Numerical Experimentation with Maximum Likelihood Identification in Static Distributed Systems

Many important issues in the control of large space structures are intimately related to the fundamental problem of parameter identification. One might also ask how well this identification process can be carried out in the presence of noisy data since no sensor system is perfect. With these considerations in mind the algorithms herein are designed to treat both the case of uncertainties in the modeling and uncertainties in the data. The analytical aspects of maximum likelihood identification are considered in some detail in another paper. The questions relevant to the implementation of these schemes are dealt with, particularly as they apply to models of large space structures. The emphasis is on the influence of the infinite dimensional character of the problem on finite dimensional implementations of the algorithms. Those areas of current and future analysis are highlighted which indicate the interplay between error analysis and possible truncations of the state and parameter spaces.

Scheid, R. E., Jr.↗

Analysis of Air Traffic Track Data with the AutoBayes Synthesis System

The Next Generation Air Traffic System (NGATS) is aiming to provide substantial computer support for the air traffic controllers. Algorithms for the accurate prediction of aircraft movements are of central importance for such software systems but trajectory prediction has to work reliably in the presence of unknown parameters and uncertainties. We are using the AutoBayes program synthesis system to generate customized data analysis algorithms that process large sets of aircraft radar track data in order to estimate parameters and uncertainties. In this paper, we present, how the tasks of finding structure in track data, estimation of important parameters in climb trajectories, and the detection of continuous descent approaches can be accomplished with compact task-specific AutoBayes specifications. We present an overview of the AutoBayes architecture and describe, how its schema-based approach generates customized analysis algorithms, documented C/C++ code, and detailed mathematical derivations. Results of experiments with actual air traffic control data are discussed.

Schumann, Johann Martin Philip↗