Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Algorithms and data structure”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45

Dynamic Transmission Line Switching Amid Wildfire-Prone Weather Under Decision-Dependent Uncertainty

During dry and windy seasons, environmental conditions significantly increase the risk of wildfires, exposing power grids to disruptions caused by transmission line failures. Wildfire propagation exacerbates grid vulnerability, potentially leading to prolonged power outages. To address this challenge, we propose a multistage optimization model that dynamically adjusts transmission grid topology in response to wildfire propagation, aiming to develop an optimal response policy. By accounting for decision-dependent uncertainty, where line survival probabilities depend on usage, we employ distributionally robust optimization to model uncertainty in line survival distributions. We adapt the stochastic nested decomposition algorithm and derive a deterministic upper bound for its finite convergence. To enhance computational efficiency, we exploit the Lagrangian dual problem structure for a faster generation of Lagrangian cuts. Using realistic data from the California transmission grid, we demonstrate the superior performance of dynamic response policies against two-stage alternatives through a comprehensive case study. In addition, after solving the multistage formulation, we construct easy-to-implement policies that significantly reduce computational burden while maintaining good performance in real-time deployment. History: Accepted by Russell Bent, Area Editor for Network Optimization: Algorithms and Applications. Funding: This work was supported by the U.S. Department of Energy, Office of Electricity [Grant DE-AC02-05CH11231]. The work of R. Jiang was supported in part by the U.S. National Science Foundation, Division of Electrical, Communications and Cyber Systems [Grant ECCS-1845980] and the U.S. Air Force Office of Scientific Research [Grant FA9550-23-1-0323]. Supplemental Material: The software that supports the findings of this study is available within the paper and its Supplemental Information ( https://pubsonline.informs.org/doi/suppl/10.1287/ijoc.2025.1210 ) as well as from the IJOC GitHub software repository ( https://github.com/INFORMSJoC/2025.1210 ). The complete IJOC Software and Data Repository is available at https://informsjoc.github.io/ .

Estrada-Garcia, Juan-Alberto↗

COE Task Order 4. Final Report: Automated Threat Recognition

Lawrence Livermore National Laboratory (LLNL) was tasked by the Department of Homeland Security (DHS) Science and Technology Directorate (S&T) with developing an automated target recognition algorithm for finding objects of interest in checked baggage at airports. The project used x-ray computed tomography (CT) data collected on a medical scanner of various simulated checked bags. Target objects of interest include clay, rubber, and saline in various concentrations. The final results are 93.9% probability of detection (P D ) with 11.9% probability of false alarm (PFA) on all targets and 100% detection for pseudo target sheets. This result is achieved by using a three-stage algorithm made up of segmentation, post-processing, and feature extraction and object classification. The segmentation proved to be the most important stage and it involves merging two distinct segmentation results followed by a set of algorithms for cleaning up the merged segmentations. The first segmentation algorithm operates on planar 10x10 voxel slabs (two- dimensional segments) in the three spatial planes. The segmenter calculates a probability that each slab in the image is a part of a target, determines if the probability was above a threshold, and then merges all connected slabs together. The second segmentation algorithm is an ensemble segmenter, which generates a set of possible segmentations through random permutations and computes an average behavior. The distinct properties of these segmenters results in a merged segmentation with superior results than either segmenter alone. The merged segmentation is “cleaned up” using post processing techniques to achieve the final labeled images. The final classification stage made use of a random forest classifier algorithm to discriminate targets from non-targets based on a set of features of the segmented objects partially from the voxel slabs and partially from the individual voxels. Features include standard statistics such as mean, median, and standard deviations of the density, features capturing some aspects of texture, and some features about the surrounding bag structure. In addition to the detection and false alarm results above, we show how the algorithms can be trained to “overfit” to the limited data set provided and achieve near perfect results (P D =100% and P FA =0%). This over-training is not recommended for long-term operation, but instead is meant to demonstrate how test design is an important factor in aviation security. Possible improvements to the algorithm and the testing methodology (including blind testing) are also presented.

42 ENGINEERING↗

Fast Multipole Methods for Three-Dimensional N-body Problems

We are developing computational tools for the simulations of three-dimensional flows past bodies undergoing arbitrary motions. High resolution viscous vortex methods have been developed that allow for extended simulations of two-dimensional configurations such as vortex generators. Our objective is to extend this methodology to three dimensions and develop a robust computational scheme for the simulation of such flows. A fundamental issue in the use of vortex methods is the ability of employing efficiently large numbers of computational elements to resolve the large range of scales that exist in complex flows. The traditional cost of the method scales as Omicron (N(sup 2)) as the N computational elements/particles induce velocities at each other, making the method unacceptable for simulations involving more than a few tens of thousands of particles. In the last decade fast methods have been developed that have operation counts of Omicron (N log N) or Omicron (N) (referred to as BH and GR respectively) depending on the details of the algorithm. These methods are based on the observation that the effect of a cluster of particles at a certain distance may be approximated by a finite series expansion. In order to exploit this observation we need to decompose the element population spatially into clusters of particles and build a hierarchy of clusters (a tree data structure) - smaller neighboring clusters combine to form a cluster of the next size up in the hierarchy and so on. This hierarchy of clusters allows one to determine efficiently when the approximation is valid. This algorithm is an N-body solver that appears in many fields of engineering and science. Some examples of its diverse use are in astrophysics, molecular dynamics, micro-magnetics, boundary element simulations of electromagnetic problems, and computer animation. More recently these N-body solvers have been implemented and applied in simulations involving vortex methods. Koumoutsakos and Leonard (1995) implemented the GR scheme in two dimensions for vector computer architectures allowing for simulations of bluff body flows using millions of particles. Winckelmans presented three-dimensional, viscous simulations of interacting vortex rings, using vortons and an implementation of a BH scheme for parallel computer architectures. Bhatt presented a vortex filament method to perform inviscid vortex ring interactions, with an alternative implementation of a BH scheme for a Connection Machine parallel computer architecture.

Koumoutsakos, P.↗

Quant-CT: Segmenting and Quantifying Computed Tomography

Quant-CT is currently a plugin to ImageJ, designed as a Java-class that provides control mechanism for the user to choose volumes of interest within porous material, followed by the selection of image subsamples for automated tuning of parameters for filters and classifiers, and finally measurement of material geometry, porosity, and visualization. Denoising is mandatory before any image interpretation, and we implemented a new 3D java code that performs bilateral filtering of data. Segmentation of the dense material is essential before any quantifications about geological sample structure, and we invented new schemes to deal with over segmentation when using statistical region merging algorithm to pull out grains that compose imaged material. It make uses of ImageJ API and other standard and thirty-party APIs. Quant-CT conception started in 2011 under Scidac-e sponsor, and details of the first prototype were documented in publications below. While it is used right now for microtomography images, it can potentially be used by anybody with 3D image data obtained by experiment or produced by simulation.

Daniela Ushizima, Wes Bethel↗

Arctic Sea ice studies with passive microwave satellite observations

The objectives of this research are: (1) to improve sea ice concentration determinations from passive microwave space observations; (2) to study the role of Arctic polynyas in the production of sea ice and the associated salinization of Arctic shelf water; and (3) to study large scale sea ice variability in the polar oceans. The strategy is to analyze existing data sets and data acquired from both the DMSP SSM/I and recently completed aircraft underflights. Special attention will be given the high resolution 85.5 GHz SSM/I channels for application to thin ice algorithms and processes studies. Analysis of aircraft and satellite data sets is expected to provide a basis for determining the potential of the SSM/I high frequency channels for improving sea ice algorithms and for investigating oceanic processes. Improved sea ice algorithms will aid the study of Arctic coastal polynyas which in turn will provide a better understanding of the role of these polynyas in maintaining the Arctic watermass structure. Analysis of satellite and archived meteorological data sets will provide improved estimates of annual, seasonal and shorter-term sea ice variability.

Cavalieri, D. J.↗

Improving best-phase image quality in cardiac CT by motion correction with MAM optimization

Purpose: Research in image reconstruction for cardiac CT aims at using motion correction algorithms to improve the image quality of the coronary arteries. The key to those algorithms is motion estimation, which is currently based on 3-D/3-D registration to align the structures of interest in images acquired in multiple heart phases. The need for an extended scan data range covering several heart phases is critical in terms of radiation dose to the patient and limits the clinical potential of the method. Furthermore, literature reports only slight quality improvements of the motion corrected images when compared to the most quiet phase (best-phase) that was actually used for motion estimation. In this paper a motion estimation algorithm is proposed which does not require an extended scan range but works with a short scan data interval, and which markedly improves the best-phase image quality. Methods: Motion estimation is based on the definition of motion artifact metrics (MAM) to quantify motion artifacts in a 3-D reconstructed image volume. The authors use two different MAMs, entropy, and positivity. By adjusting the motion field parameters, the MAM of the resulting motion-compensated reconstruction is optimized using a gradient descent procedure. In this way motion artifacts are minimized. For a fast and practical implementation, only analytical methods are used for motion estimation and compensation. Both the MAM-optimization and a 3-D/3-D registration-based motion estimation algorithm were investigated by means of a computer-simulated vessel with a cardiac motion profile. Image quality was evaluated using normalized cross-correlation (NCC) with the ground truth template and root-mean-square deviation (RMSD). Four coronary CT angiography patient cases were reconstructed to evaluate the clinical performance of the proposed method. Results: For the MAM-approach, the best-phase image quality could be improved for all investigated heart phases, with a maximum improvement of the NCC value by 100% and of the RMSD value by 81%. The corresponding maximum improvements for the registration-based approach were 20% and 40%. In phases with very rapid motion the registration-based algorithm obtained better image quality, while the image quality of the MAM algorithm was superior in phases with less motion. The image quality improvement of the MAM optimization was visually confirmed for the different clinical cases. Conclusions: The proposed method allows a software-based best-phase image quality improvement in coronary CT angiography. A short scan data interval at the target heart phase is sufficient, no additional scan data in other cardiac phases are required. The algorithm is therefore directly applicable to any standard cardiac CT acquisition protocol.

60 APPLIED LIFE SCIENCES↗

Improved interpretation of satellite altimeter data using genetic algorithms

Genetic algorithms (GA) are optimization techniques that are based on the mechanics of evolution and natural selection. They take advantage of the power of cumulative selection, in which successive incremental improvements in a solution structure become the basis for continued development. A GA is an iterative procedure that maintains a 'population' of 'organisms' (candidate solutions). Through successive 'generations' (iterations) the population as a whole improves in simulation of Darwin's 'survival of the fittest'. GA's have been shown to be successful where noise significantly reduces the ability of other search techniques to work effectively. Satellite altimetry provides useful information about oceanographic phenomena. It provides rapid global coverage of the oceans and is not as severely hampered by cloud cover as infrared imagery. Despite these and other benefits, several factors lead to significant difficulty in interpretation. The GA approach to the improved interpretation of satellite data involves the representation of the ocean surface model as a string of parameters or coefficients from the model. The GA searches in parallel, a population of such representations (organisms) to obtain the individual that is best suited to 'survive', that is, the fittest as measured with respect to some 'fitness' function. The fittest organism is the one that best represents the ocean surface model with respect to the altimeter data.

Messa, Kenneth↗

Characterization and classification of vegetation canopy structure and distribution within the Great Smoky Mountains National Park using LiDAR

Vegetation canopy structure is a critically important habit characteristic for many threatened and endangered birds and other animal species, and it is key information needed by forest and wildlife managers for monitoring and managing forest resources, conservation planning and fostering biodiversity. Advances in Light Detection and Ranging (LiDAR) technologies have enabled remote sensing-based studies of vegetation canopies by capturing three-dimensional structures, yielding information not available in two-dimensional images of the landscape pro- vided by traditional multi-spectral remote sensing platforms. However, the large volume data sets produced by airborne LiDAR instruments pose a significant computational challenge, requiring algorithms to identify and analyze patterns of interest buried within LiDAR point clouds in a computationally efficient manner, utilizing state-of-art computing infrastructure. We developed and applied a computationally efficient approach to analyze a large volume of LiDAR data and to characterize and map the vegetation canopy structures for 139,859 hectares (540 sq. miles) in the Great Smoky Mountains National Park. This study helps improve our understanding of the distribution of vegetation and animal habitats in this extremely diverse ecosystem.

Clustering↗

Unsupervised data mining in nanoscale x-ray spectro-microscopic study of NdFeB magnet

Novel developments in X-ray based spectro-microscopic characterization techniques have increased the rate of acquisition of spatially resolved spectroscopic data by several orders of magnitude over what was possible a few years ago. This accelerated data acquisition, with high spatial resolution at nanoscale and sensitivity to subtle differences in chemistry and atomic structure, provides a unique opportunity to investigate hierarchically complex and structurally heterogeneous systems found in functional devices and materials systems. However, handling and analyzing the large volume data generated poses significant challenges. Here we apply an unsupervised data-mining algorithm known as DBSCAN to study a rare-earth element based permanent magnet material, Nd 2 Fe 14 B. We are able to reduce a large spectro-microscopic dataset of over 300,000 spectra to 3, preserving much of the underlying information. Scientists can easily and quickly analyze in detail three characteristic spectra. Our approach can rapidly provide a concise representation of a large and complex dataset to materials scientists and chemists. For instance, it shows that the surface of common Nd 2 Fe 14 B magnet is chemically and structurally very different from the bulk, suggesting a possible surface alteration effect possibly due to the corrosion, which could affect the material’s overall properties.

36 MATERIALS SCIENCE↗

The SDSS-IV extended baryon oscillation spectroscopic survey: Luminous red galaxy target selection

Here, we describe the algorithm used to select the luminous red galaxy (LRG) sample for the extended Baryon Oscillation Spectroscopic Survey (eBOSS) of the Sloan Digital Sky Survey IV (SDSS-IV) using photometric data from both the SDSS and the Wide-field Infrared Survey Explorer. LRG targets are required to meet a set of color selection criteria and have z-band and i-band MODEL magnitudes z < 19.95 and 19.9 < i < 21.8, respectively. Our algorithm selects roughly 50 LRG targets per square degree, the great majority of which lie in the redshift range 0.6 < z < 1.0 (median redshift 0.71). We also demonstrate that our methods are highly effective at eliminating stellar contamination and lower-redshift galaxies. We perform a number of tests using spectroscopic data from SDSS-III/BOSS ancillary programs to determine the redshift reliability of our target selection and its ability to meet the science requirements of eBOSS. The SDSS spectra are of high enough signal-to-noise ratio that at least ~89% of the target sample yields secure redshift measurements. Finally, we present tests of the uniformity and homogeneity of the sample, demonstrating that it should be clean enough for studies of the large-scale structure of the universe at higher redshifts than SDSS-III/BOSS LRGs reached.

79 ASTRONOMY AND ASTROPHYSICS↗

RADIOISOTOPE IDENTIFICATION OF SHIELDED AND MASKED SNM RDD MATERIALS

Sonar and speech techniques have been investigated to improve functionality and enable handheld and other man-portable, mobile, and portal systems to positively detect and identify illicit nuclear materials, with minimal data and with minimal false positives and false negatives. RadSonar isotope detection and identification is an algorithm development project funded by NA-22 and employing the resources of Savannah River National Laboratory and three University Laboratories (JHU-APL, UT-ARL, and UW-APL). Algorithms have been developed that improve the probability of detection and decrease the number of false positives and negatives. Two algorithms have been developed and tested. The first algorithm uses support vector machine (SVM) classifiers to determine the most prevalent nuclide(s) in a spectrum. It then uses a constrained weighted least squares fit to estimate and remove the contribution of these nuclide(s) to the spectrum, iterating classification and fitting until there is nothing of significance left. If any Special Nuclear Materials (SNMs) were detected in this process, a second tier of more stringent classifiers are used to make the final SNM alert decision. The second algorithm is looking at identifying existing feature sets that would be relevant in the radioisotope identification context. The underlying philosophy here is to identify parallels between the physics and/or the structures present in the data for the two applications (speech analysis and gamma spectroscopy). The expectation is that similar approaches may work in both cases. The mel-frequency cepstral representation of spectra is widely used in speech, particularly for two reasons: approximation of the response of the human ear, and simplicity of channel effect separation (in this context, a 'channel' is a method of signal transport that affects the signal, examples being vocal tract shape, room echoes, and microphone response). Measured and simulated gamma-ray spectra from a hand-held Radioisotope Identification Device were used to evaluate the algorithms. This paper will present and discuss results of the Test and Evaluation performed on two algorithms produced from the project.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

An Automated, High-Throughput Method for Interpreting the Tandem Mass Spectra of Glycosaminoglycans

The biological interactions between glycosaminoglycans (GAGs) and other biomolecules are heavily influenced by structural features of the glycan. The structure of GAGs can be assigned using tandem mass spectrometry (MS{sup 2}), but analysis of these data, to date, requires manually interpretation, a slow process that presents a bottleneck to the broader deployment of this approach to solving biologically relevant problems. Automated interpretation remains a challenge, as GAG biosynthesis is not template-driven, and therefore, one cannot predict structures from genomic data, as is done with proteins. The lack of a structure database, a consequence of the non-template biosynthesis, requires a de novo approach to interpretation of the mass spectral data. We propose a model for rapid, high-throughput GAG analysis by using an approach in which candidate structures are scored for the likelihood that they would produce the features observed in the mass spectrum. To make this approach tractable, a genetic algorithm is used to greatly reduce the search-space of isomeric structures that are considered. The time required for analysis is significantly reduced compared to an approach in which every possible isomer is considered and scored. The model is coded in a software package using the MATLAB environment. This approach was tested on tandem mass spectrometry data for long-chain, moderately sulfated chondroitin sulfate oligomers that were derived from the proteoglycan bikunin. The bikunin data was previously interpreted manually. Our approach examines glycosidic fragments to localize SO{sub 3} modifications to specific residues and yields the same structures reported in literature, only much more quickly. .

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Aerosol and Cloud Experiments in Eastern North Atlantic (ACE-ENA) Science Plan

With their extensive coverage, low clouds greatly impact global climate. Presently, low clouds are poorly represented in global climate models (GCMs), and the response of low clouds to changes in atmospheric greenhouse gases and aerosols remains the major source of uncertainty in climate simulations. The poor representations of low clouds in GCMs are in part due to inadequate observations of their microphysical and macrophysical structures, radiative effects, and the associated aerosol distribution and budget in regions where the aerosol impact is the greatest. The Eastern North Atlantic (ENA) is a region of persistent but diverse subtropical marine boundary-layer (MBL) clouds, whose albedo and precipitation are highly susceptible to perturbations in aerosol properties. Boundary-layer aerosol in the ENA region is influenced by a variety of sources, leading to strong variations in cloud condensation nuclei (CCN) concentration and aerosol optical properties. Recently a permanent ENA site was established by the U.S. Department of Energy (DOE)’s Atmospheric Radiation Measurement (ARM) Climate Research Facility on Graciosa Island in the Azores, providing invaluable information on MBL aerosol and low clouds. At the same time, the vertical structures and horizontal variabilities of aerosol, trace gases, cloud, drizzle, and atmospheric thermodynamics are critically needed for understanding and quantifying the budget of MBL aerosol, the radiative properties, precipitation efficiency, and lifecycle of MBL clouds, and the cloud response to aerosol perturbations. Much of this data can be obtained only through aircraft-based measurements. In addition, the interconnected aerosol and cloud processes are best investigated by a study involving simultaneous in situ aerosol, cloud, and thermodynamics measurements. Furthermore, in situ measurements are also necessary for validating and improving ground-based retrieval algorithms at the ENA site. This project is motivated by the need for comprehensive in situ characterizations of boundary-layer structure, and associated vertical distributions and horizontal variabilities of low clouds and aerosol over the Azores. ARM Aerial Facility (AAF) Gulfstream-1 (G-1) aircraft will be deployed at the ENA site during two intensive operational periods (IOPs) of early summer (June to July) of 2017 and winter (January to February) of 2018, respectively. Deployments during both seasons allow for examination of key aerosol and cloud processes under a variety of representative meteorological and cloud conditions. The science themes for the deployments include: 1) Budget of MBL CCN and its seasonal variation; 2) Effects of aerosol on cloud and precipitation; 3) Cloud microphysical and macrophysical structures, and entrainment mixing; 4) Advancing retrievals of turbulence, cloud, and drizzle; and 5) Model evaluation and processes studies. A key advantage of the deployments is the strong synergy between the measurements onboard the G-1 and the routine measurements at the ENA site, including state-of-the-art profiling and scanning radars. The 3D cloud structures provided by the scanning radars will put the detailed in situ measurements into mesoscale and cloud lifecycle contexts. On the other hand, high quality in situ measurements will enable validation and improvements of ground-based retrieval algorithms at the ENA site, leading to high-quality and statistically robust data sets from the routine measurements. The deployments, combined with the routine measurements at the ENA site, will have a long lasting impact on the research and modeling of low clouds and aerosols in the remote marine environment.

54 ENVIRONMENTAL SCIENCES↗

Effect of substrate orientation on CdS homoepitaxy by molecular dynamics

CdS homoepitaxy growth was performed by molecular dynamics using different substrate orientations and structures in order to analyze the CdS crystallinity. As anticipated from thermodynamics of homoepitaxy, highly crystalline films with only point defects were obtained on substrates with rectangular surface geometries, including View the MathML source[112¯] zinc blende (ZB), [101¯0] wurtzite (WZ), [112¯0] WZ, [110][110] ZB, [010][010] ZB, and View the MathML source[1101110] ZB. In contrast, films grown on substrates with hexagonal surface geometries, corresponding to the [0001][0001] WZ and [111][111] ZB growth directions, showed structures with a large number of defects including; anti-sites, vacancies, stacking faults, twinning, and polytypism. WZ and ZB transitions and grain boundaries are identified using a lattice identification algorithm and represented graphically in a structural map. A dislocation analysis was performed to detect, identify, and quantify linear defects within the atomistic data. Systematic simulations using different temperatures, deposition rates, and substrate polarities were perform to analyze the trends of dislocation densities on [0001][0001] WZ direction and showed persistent polytypism. As a result, the polytypism observed in the films grown on the substrates with hexagonal surface geometry is attributed to the similar formation energies of the WZ and ZB phases.

36 MATERIALS SCIENCE↗

4D Imaging of ZnO-Coated Nanoporous Al 2 O 3 Aerogels by Chemically Sensitive Ptychographic Tomography: Implications for Designer Catalysts

The 3D chemical structure (4D spectromicroscopy) of nanoporous Al 2 O 3 aerogels coated with ZnO by atomic layer deposition (ALD) was studied by multienergy scanning transmission X-ray microscopy. These materials are representative of a class of designer catalysts in which the nanoporous support is prepared separately from the active catalyst material, which is subsequently introduced by ALD, thereby allowing independent optimization of the morphology, chemistry, and spatial distribution of the support and catalyst. The samples studied were prepared by Ga ion and Xe plasma focused ion beam (FIB) milling as well as drop casting from water suspension. Zn L and Al K edge spectra of six samples with three different ZnO loadings were measured to investigate how loading and different sample preparation methods affect the 3D distribution of the ZnO and Al 2 O 3 . Scanning transmission X-ray microscopy (STXM) and ptychographic imaging at two energies each at the Zn L 3 and Al K edge were measured. The ptychography data were analyzed by using the SHARP reconstruction code to generate quantitative 2D chemical maps of the Al 2 O 3 and the ZnO. The STXM and ptychography maps were then measured at a sequence of tilt angles, covering up to 160° of rotation. The 3D structure of the ZnO and Al 2 O 3 was derived from the tilt series data by tomographic reconstruction using a compressed sensing algorithm. A twodimensional spatial resolution (half-period) of 6 nm, measured by Fourier ring correlation, and a 3D spatial resolution (half-period) of 9 nm, measured by Fourier shell correlation, were achieved when using the COSMIC beamline at the Advanced Light Source (ALS). The results show that for all of the ZnO loadings studied there is nonuniform coverage of the ZnO on the Al 2 O 3 aerogel framework. In addition, we found that both FIB methods create sample artifacts, although the distortion was less with Xe plasma than Ga ion FIB.

36 MATERIALS SCIENCE↗

SIPMaP: A Tool for Modeling Irregular Parallel Computations in the Super Instruction Architecture

Performance modeling is becoming an increasingly important part of the parallel application development process, particularly for expensive computations that will be run on very high-end systems where resources are scarce. We describe a performance modeling tool SIPMaP (Super Instruction Processor Modeling and Prediction) developed for the Super-Instruction Architecture (SIA). The SIA is designed for applications where the dominant data structures are large multi-dimensional arrays and it comprises a DSL, the Super-Instruction Assembly Language (SIAL) that supports expressing algorithms in terms of blocks (tiles), and its runtime system Super Instruction Processor (SIP) that manages distribution and disk storage of the arrays. SIPMaP generates performance models from the SIAL source code. In comparison with many applications where useful performance models have been developed and reported, these programs are irregular and have other difficult to model characteristics such as extensive overlapping of communication and computation.

Computer Science↗

How Analysts Cognitively “Connect the Dots”

As analysts attempt to make sense of a collection of documents, such as intelligence analysis reports, they may wish to “connect the dots” between pieces of information that may initially seem unrelated. This process of synthesizing information between information requires users to make connections between pairs of documents, creating a conceptual story. We conducted a user study to analyze the process by which users connect pairs of documents and how they spatially arrange information. Users created conceptual stories that connected the dots using organizational strategies that ranged in complexity. We propose taxonomies for cognitive connections and physical structures used when trying to “connect the dots” between two documents. We compared the user-created stories with a data-mining algorithm that constructs chains of documents using co-occurrence metrics. Using the insight gained into the storytelling process, we offer design considerations for the existing data mining algorithm and corresponding tools to combine the power of data mining and the complex cognitive processing of analysts.

data mining↗

Distributed Hierarchical Contour Trees

Contour trees are a significant tool for data analysis as they capture both local and global variation. However, their utility has been limited by scalability, in particular for distributed computation and storage. We report a distributed data structure for storing the contour tree of a data set distributed on a cluster, based on a fan-in hierarchy, and an algorithm for computing it based on the boundary tree that represents only the superarcs of a contour tree that involve contours that cross boundaries between blocks. This allows us to limit the communication cost for contour tree computation to the complexity of the block boundaries rather than of the entire data set.

Carr, Hamish A↗