Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Human Error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

CRCNS US-France Research Proposal: Collaborative Research: Encoding reward expectation in Drosophilia

The fruit fly Drosophila melanogaster has been a valuable model for investigating the genetic and neural bases that underlie learning and memory. Early and most current studies use basic behavior conditioning protocols to study learning in controlled laboratory settings. More recently, the ability to transgenically manipulate many of the brain neurons in the fruit fly with exquisite specificity, and the recent knowledge of the synaptic ‘connectome’ of the fruit fly brain, makes these animals almost unique as a comprehensive model for studies of learning, memory and motivated behavior. In fact, the connectome has revealed many types of new connections that had until now been overlooked. Within this context, the thesis of this proposal is that studies of learning and memory will be greatly enhanced by using more sophisticated means for evaluating memory representations, such as have been developed in vertebrates, and combining those studies with information from the connectome guided by computational modelling. We propose to push beyond the boundaries of existing conditioning protocols for fruit flies to investigate more complex memory representations. In particular, we will investigate the function of reinforcement pathways in relation to the absence of expected reinforcement. More specifically, we propose a series of experiments designed to investigate the memory representations in fruit flies when an expected consequence of a Conditioned Stimulus (CS) fails to occur. Although studies have evaluated how this failure can establish extinction memory for the CS, our studies will go beyond studying extinction. Specifically, we predict that in Drosophila when a CS is associated with a failed expectation of an appetitive food reinforcement it will acquire aversive value, and vice versa for a failed expectation of an aversive reinforcer. We combine these studies with manipulations of reinforcement pathways in the CNS inspired from the connectome, iteratively knitted in with established computational models. Intellectual Merit: The concept of reinforcement expectation and incentive contrast have been influential in the development of studies of associative learning in mammals. These questions are particularly challenging to answer in vertebrates because they require exquisite cellular, temporal, and genetic specificity of experimental manipulations. The recent development of work with identified neurons and their connectomes makes the larval and adult fly brains ripe as models for pushing our understanding of neural bases for these higher- order conditioning phenomena. Broader Impacts: Public health: These analyses and the conceptual framework of prediction error processing underlying them have a profound impact on our understanding of reinforcement-related behavior in humans, including monetary rewards and the mnemonic consequences of traumatic experiences, and for pathologies of the dopamine reinforcement system. Educational: This project will provide interdisciplinary training for postdoctoral researchers, Ph.D. and undergraduate students. The PIs will act as co-supervisors or mentors of students working in the different labs via face-to-face and internet-based technologies. We will also work with ASU’s award-winning Ask- A-Biologist program. This is an online science program designed to enrich the learning experiences of students of all ages and to provide classroom material for use by K-12 teachers. We will develop an extension of a game developed under a prior NSF award, and the new game will include modules to teach K-12 students about how insects learn. We will also integrate into the AAB site a program developed by a collaborator (B Gerber) at the Leibniz Institut für Neurobiologie, Magdeburg, and now in use in schools in Germany, to teach K-12 students how to train animals using the fruit fly larval learning paradigm. Underrepresented groups: All PIs will work with their university offices of Academic Diversity and Equal Opportunity for reaching underrepresented students.

59 BASIC BIOLOGICAL SCIENCES↗

Automated Symbolic Upscaling: 2. Model Generation for Extended Applicability Regimes

Abstract In this second part of the two paper series, we detail an algorithmic procedure for systematically implementing the generalized closure form strategy presented in Part 1. This strategy extends the applicability of homogenized models with respect to classical homogenization theory, as demonstrated in Part 1 where upscaled models are rigorously derived in moderately reactive physical regimes. After encoding the algorithm into Symbolica, an automated upscaling framework, we upscale two reactive mass transport problems and numerically validate the resulting nonlinear homogenized models by showing the absolute error estimates predicted by homogenization theory are satisfied. In both problems, nontrivial closure forms and closure problems are automatically formulated using the encoded strategy with no human interaction, nor prior knowledge regarding the closure required for the systems. We hope these demonstrations spark further interest in automated analytical frameworks for multiscale modeling, as such capabilities are invaluable for generating rigorous multiscale models of complex phenomena in porous media.

Pietrzyk, Kyle↗

Regional Medium-Term Hourly Electricity Demand Forecasting Based on LSTM

This paper aims to forecast high-resolution (hourly) aggregated load for a certain region in the medium term (a few days to over a year). One region is defined as some places with similar climate characteristics because the climate influences people's daily lifestyles and hence the electric usage. We decom- pose the electric usage records into two parts: base load and seasonal load. Considering both temperature and time factors, different deep learning methods are adopted to characterize them. The first goal of our approach is to predict the peak load which is critical for power system planning. Furthermore, our proposed forecast method can provide the depiction of the hourly load profile to provide customized load curves for high- level real-time applications. The proposed method is tested on real-world historical data collected by CAISO, BPA, and PACW. The experimental results show that trained by three years of data, our method could reduce the prediction error for one-year lead hourly load below 5% MAPE, and predict the occurrence of the peak load for next year in CAISO with an error within three days. Furthermore, as a byproduct, an interesting observation on the impact of COVID-19 on human life was made and discussed based on these case studies.

deep learning↗

Regional Medium-Term Hourly Electricity Demand Forecasting Based on LSTM

This paper aims to forecast high-resolution (hourly) aggregated load for a certain region in the medium term (a few days to over a year). One region is defined as some places with similar climate characteristics because the climate influences people's daily lifestyles and hence the electric usage. We decompose the electric usage records into two parts: base load and seasonal load. Considering both temperature and time factors, different deep-learning methods are adopted to characterize them. The first goal of our approach is to predict the peak load which is critical for power system planning. Furthermore, our proposed forecast method can provide the depiction of the hourly load profile to provide customized load curves for high-level real-time applications. The proposed method is tested on real-world historical data collected by CAISO, BPA, and PACW. The experimental results show that trained by three years of data, our method could reduce the prediction error for a one-year lead hourly load below $5\%$ MAPE, and predict the occurrence of the peak load for next year in CAISO with an error within three days. Furthermore, as a byproduct, an interesting observation on the impact of COVID-19 on human life was made and discussed based on these case studies.

deep learning↗

Regional Medium-Term Hourly Electricity Demand Forecasting Based on LSTM: Preprint

This paper aims to forecast high-resolution (hourly) aggregated load for a certain region in the medium term (a few days to over a year). One region is defined as some places with similar climate characteristics because the climate influences people's daily lifestyles and hence the electric usage. We decompose the electric usage records into two parts: base load and seasonal load. Considering both temperature and time factors, different deep-learning methods are adopted to characterize them. The first goal of our approach is to predict the peak load which is critical for power system planning. Furthermore, our proposed forecast method can provide the depiction of the hourly load profile to provide customized load curves for high-level real-time applications. The proposed method is tested on real-world historical data collected by CAISO, BPA, and PACW. The experimental results show that trained by three years of data, our method could reduce the prediction error for a one-year lead hourly load below 5% MAPE, and predict the occurrence of the peak load for next year in CAISO with an error within three days. Furthermore, as a byproduct, an interesting observation on the impact of COVID-19 on human life was made and discussed based on these case studies.

deep learning↗

Enhanced Spatial Mapping of Histone Proteoforms in Human Kidney Through MALDI-MSI by High-Field UHMR-Orbitrap Detection

Core histones including H2A, H2B, H3, and H4 are key modulators of cellular repair, transcription, and replication within eukaryotic cells, playing vital roles within the pathogenesis of disease and cellular responses to environmental stimuli. Traditional mass spectrometry (MS) based bottom-up and top-down proteomics allows for the comprehensive identification of proteins and of post-translational modification (PTM) harboring proteoforms. However, these methodologies have difficulties preserving near cellular spatial distributions because they typically require laser capture microdissection (LCM) and advanced sample preparation techniques. Herein, we coupled matrix-assisted laser desorption/ionization (MALDI) source with a Thermo Scientific Q-Exactive HF Orbitrap MS upgraded with ultra-high mass range (UHMR) boards for the first demonstration of complementary high-resolution accurate mass measurements of proteoforms directly from tissue using this benchtop mass spectrometer. The platform achieved isotopic resolution throughout the detected mass range, providing confident assignments of proteoforms with low ppm mass error and a vastly improved duty cycle over other Fourier transform mass analyzers. Proteoform mapping of core histones was demonstrated on sections of human kidney at near-cellular spatial resolution, with several key distributions of histone and other proteoforms noted within both healthy biopsy and a section from a renal cell carcinoma (RCC) containing nephrectomy. Further, the use of MALDI-MS imaging (MSI) for proteoform mapping demonstrates several steps towards high-throughput accurate identification of proteoforms and provides a new tool for mapping biomolecule distributions throughout tissue sections in extended mass ranges.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Collagen Turnover in Relation to Risk Factors and Hemodynamics in Human Intracranial Aneurysms

Determinants for molecular and structural instability, that is, impending growth or rupture, of intracranial aneurysms (IAs) remain uncertain. To elucidate this, we endeavored to estimate the actual turnover rates of the main molecular constituent in human IA (collagen) on the basis of radiocarbon ( 14 C) birth dating in relation to IA hemodynamics. Collagen turnover rates in excised human IA samples were calculated using mathematical modeling of 14 C birth dating data of collagen in relation to risk factors and histological markers for collagen maturity/turnover in selected IA. Hemodynamics were simulated using image-based computational fluid dynamics. Correlation, logistic regression, and receiver operating characteristic analyses were performed. Collagen turnover rates were estimated in 46 IA (43 patients); computational fluid dynamics could be performed in 20 IA (20 patients). The mean collagen turnover rate (γ) constituted 126% (±1% error) per year. For patients with arterial hypertension, γ was greater than 2600% annually, whereas γ was distinctly lower with 32% (±1% error) per year for patients without risk factors, such as smoking and hypertension. There was a distinct association between histological presence of rather immature collagen in human IA and the presence of modifiable risk factors. Spatial-temporal averaged wall shear stress predicted rapid collagen turnover (odds ratio, 1.6 [95% CI, 1.0–2.7]). Receiver operating characteristic analysis demonstrated a good test accuracy (area under the curve, 0.798 [95% CI, 0.598–0.998]) for average wall shear stress with a threshold ≥4.9 Pa for rapid collagen turnover. Our data indicate that turnover rates and stability of collagen in human IA are strongly associated with the presence of modifiable risk factors and aneurysmal hemodynamics. Finally, these findings underline the importance of strict risk factor modification in patients with unruptured IA. Future should include more detailed risk factor data to establish a more causal understanding of hemodynamics and the rupture risk of individual IA.

60 APPLIED LIFE SCIENCES↗

Fast HARDI Uncertainty Quantification and Visualization with Spherical Sampling

In this paper, we study uncertainty quantification and visualization of orientation distribution functions (ODF), which corresponds to the diffusion profile of high angular resolution diffusion imaging (HARDI) data. The shape inclusion probability (SIP) function is the state‐of‐the‐art method for capturing the uncertainty of ODF ensembles. The current method of computing the SIP function with a volumetric basis exhibits high computational and memory costs, which can be a bottleneck to integrating uncertainty into HARDI visualization techniques and tools. We propose a novel spherical sampling framework for faster computation of the SIP function with lower memory usage and increased accuracy. In particular, we propose direct extraction of SIP isosurfaces, which represent confidence intervals indicating spatial uncertainty of HARDI glyphs, by performing spherical sampling of ODFs. Our spherical sampling approach requires much less sampling than the state‐of‐the‐art volume sampling method, thus providing significantly enhanced performance, scalability, and the ability to perform implicit ray tracing. Our experiments demonstrate that the SIP isosurfaces extracted with our spherical sampling approach can achieve up to 8164× speedup, 37282× memory reduction, and 50.2% less SIP isosurface error compared to the classical volume sampling approach. We demonstrate the efficacy of our methods through experiments on synthetic and human‐brain HARDI datasets.

97 MATHEMATICS AND COMPUTING↗

Explainable Neural Architecture Search (XNAS)

Code for the paper Learning Interpretable Models Through Multi-Objective Neural Architecture Search by Zachariah Carmichael, Tim Moon, and Sam Ade Jacobs. Monumental advances in deep learning have led to unprecedented achievements across a multitude of domains. While the performance of deep neural networks is indubitable, the architectural design and interpretability of such models are nontrivial. Research has been introduced to automate the design of neural network architectures through neural architecture search (NAS). Recent progress has made these methods more pragmatic by exploiting distributed computation and novel optimization algorithms. However, there is little work in optimizing architectures for interpretability. To this end, we propose a multiobjective distributed NAS framework that optimizes for both task performance and introspection. We leverage the non-dominated sorting genetic algorithm (NSGA-II) and explainable AI (XAI) techniques to reward architectures that can be better comprehended by humans. The framework is evaluated on several image classification datasets. We demonstrate that jointly optimizing for introspection ability and task error leads to more disentangled architectures that perform within tolerable error.

Carmichael, ZachariahJ↗

Characterization of two affinity matured Anti-Yersinia pestis F1 human antibodies with medical countermeasure potential

Yersinia pestis , the causative agent of plague and a biological threat agent, presents an urgent need for novel medical countermeasures due to documented cases of naturally acquired antibiotic resistance and potential person-to-person spread during a pneumonic infection. Immunotherapy has been proposed as a way to circumvent current and future antibiotic resistance. Here, we describe the development and characterization of two affinity matured human antibodies (αF1Ig AM2 and αF1Ig AM8) that promote survival of mice after exposure to aerosolized Y . pestis . We share details of the error prone PCR and yeast display technology-based affinity maturation process that we used. The resultant matured antibodies have nanomolar affinity for Y . pestis F1 antigen, are produced in high yield, and are resilient to 37°C stress for up to 6 months. Importantly, in vitro assays using a murine macrophage cell line demonstrated that αF1Ig AM2 and αF1Ig AM8 are opsonic. Even more importantly, in vivo studies using pneumonic plague mouse models showed that 100% of the mice receiving 500 μg of IgGs αF1Ig AM2 and αF1Ig AM8 survived lethal challenge with aerosolized Y . pestis CO92. Combined, these results provide evidence of the quality and robustness of αF1Ig AM2 and αF1Ig AM8 and support their development as potential medical countermeasures against plague.

59 BASIC BIOLOGICAL SCIENCES↗

Toward the validation of crowdsourced experiments for lightness perception

Crowdsource platforms have been used to study a range of perceptual stimuli such as the graphical perception of scatterplots and various aspects of human color perception. Given the lack of control over a crowdsourced participant’s experimental setup, there are valid concerns on the use of crowdsourcing for color studies as the perception of the stimuli is highly dependent on the stimulus presentation. Here, we propose that the error due to a crowdsourced experimental design can be effectively averaged out because the crowdsourced experiment can be accommodated by the Thurstonian model as the convolution of two normal distributions, one that is perceptual in nature and one that captures the error due to variability in stimulus presentation. Based on this, we provide a mathematical estimate for the sample size needed to produce a crowdsourced experiment with the same power as the corresponding in-person study. We tested this claim by replicating a large-scale, crowdsourced study of human lightness perception with a diverse sample with a highly controlled, in-person study with a sample taken from psychology undergraduates. Our claim was supported by the replication of the results from the latter. These findings suggest that, with sufficient sample size, color vision studies may be completed online, giving access to a larger and more representative sample. With this framework at hand, experimentalists have the validation that choosing either many online participants or few in person participants will not sacrifice the impact of their results.

97 MATHEMATICS AND COMPUTING↗

Structural basis of DNA synthesis opposite 8-oxoguanine by human PrimPol primase-polymerase

PrimPol is a human DNA polymerase-primase that localizes to mitochondria and nucleus and bypasses the major oxidative lesion 7,8-dihydro-8-oxoguanine (oxoG) via translesion synthesis, in mostly error-free manner. We present structures of PrimPol insertion complexes with a DNA template-primer and correct dCTP or erroneous dATP opposite the lesion, as well as extension complexes with C or A as a 3'–terminal primer base. We show that during the insertion of C and extension from it, the active site is unperturbed, reflecting the readiness of PrimPol to accommodate oxoG(anti). The misinsertion of A opposite oxoG(syn) also does not alter the active site, and is likely less favorable due to lower thermodynamic stability of the oxoG(syn)•A base-pair. During the extension step, oxoG(syn) induces an opening of its base-pair with A or misalignment of the 3'-A primer terminus. Together, the structures show how PrimPol accurately synthesizes DNA opposite oxidatively damaged DNA in human cells.

59 BASIC BIOLOGICAL SCIENCES↗

Evaluating Retention Index Score Assumptions to Refine GC–MS Metabolite Identification

As metabolomics grows into a high-throughput and high demand research field, current metrics for the identification of small molecules in gas chromatography–mass spectrometry (GC–MS) still require manual verification. Though steps have been taken to improve scoring metrics by combining spectral similarity (SS) and retention index (RI), the problem persists. A large body of literature has analyzed and refined SS scores, but few studies have explicitly studied improvements to RI scores. Here, in this study, we examined whether uninvestigated assumptions of the RI score are valid and propose ways to improve them. Query RIs were matched to library RI with a generous window of ±35 to avoid unintentional removal of valid compound identifications. Each match was manually verified as a true positive (TP), true negative, or unknown. Metabolites with at least 30 TP identifications were included in downstream analyses, resulting in a total of 87 metabolites from samples of varying complexity and type (e.g., amino acid mixtures, human urine, fungal species, and so on.). Our results showed that the RI score assumptions of normality, consistent variance across metabolites, and a mean error centered at 0 are often violated. We demonstrated through a cross-validation analysis that modifying these underlying assumptions according to empirical metabolite-specific distributions improved the TP and negative rankings. Further, we statistically determined the minimum number of samples required to estimate distributional parameters for scoring metrics. Overall, this work proposes a robust statistical pipeline to reduce the time bottleneck of metabolite identification by improving RI scores and thus minimize the effort to complete manual verification.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Biotic Interactions Are More Important than Propagule Pressure in Microbial Community Invasions

ABSTRACT Microbial probiotics are intended to improve functions in diverse ecosystems, yet probiotics often fail to establish in a preexisting microbiome. This is a species invasion problem. The relative importance of the two major factors controlling establishment in this context—propagule pressure (inoculation dose and frequency) and biotic interactions (composition of introduced and resident communities)—is unknown. We tested the effect of these factors in driving microbial composition and functioning following 12 microbial community invasions (e.g., introductions of many microbial invaders) in microcosms. Ecosystem functioning over a 30-day postinvasion period was assessed by measuring activity (respiration) and environment modification (dissolved organic carbon abundance). To test the dependence on environmental context, experiments were performed in two resource environments. In both environments, biotic interactions were more important than propagule pressure in driving microbial composition and community function, but the magnitude of effect varied by environment. Successful invaders comprised approximately 8% of the total number of operational taxonomic units (OTUs). Bacteria were better invaders than fungi, with average relative abundances of 7.4% ± 6.8% and 1.5% ± 1.4% of OTUs, respectively. Common bacterial invaders were associated with stress response traits. The most resilient bacterial and fungal families, in other words, those least impacted by invasions, were linked to antimicrobial resistance or production traits. Illuminating the principles that determine community composition and functioning following microbial invasions is key to efficient community engineering. IMPORTANCE With increasing frequency, humans are introducing new microbes into preexisting microbiomes to alter functioning. Example applications include modification of microflora in human guts for better health and those of soil for food security and/or climate management. Probiotic applications are often approached as trial-and-error endeavors and have mixed outcomes. We propose that increased success in microbiome engineering may be achieved with a better understanding of microbial invasions. We conducted a microbial community invasion experiment to test the relative importance of propagule pressure and biotic interactions in driving microbial community composition and ecosystem functioning in microcosms. We found that biotic interactions were more important than propagule pressure in determining the impact of microbial invasions. Furthermore, the principles for community engineering vary among organismal groups (bacteria versus fungi).

59 BASIC BIOLOGICAL SCIENCES↗

Fast and accurate metagenotyping of the human gut microbiome with GT-Pro

Single nucleotide polymorphisms (SNPs) in metagenomics are used to quantify population structure, track strains and identify genetic determinants of microbial phenotypes. However, existing alignment-based approaches for metagenomic SNP detection require high-performance computing and enough read coverage to distinguish SNPs from sequencing errors. To address these issues, we developed the GenoTyper for Prokaryotes (GT-Pro), a suite of methods to catalog SNPs from genomes and use unique k-mers to rapidly genotype these SNPs from metagenomes. Compared to methods that use read alignment, GT-Pro is more accurate and two orders of magnitude faster. Here, using high-quality genomes, we constructed a catalog of 104 million SNPs in 909 human gut species and used unique k-mers targeting this catalog to characterize the global population structure of gut microbes from 7,459 samples. GT-Pro enables fast and memory-efficient metagenotyping of millions of SNPs on a personal computer.

59 BASIC BIOLOGICAL SCIENCES↗

Combining computational modeling and experimental library screening to affinity-mature VEEV-neutralizing antibody F5

Engineered monoclonal antibodies have proven to be highly effective therapeutics in recent viral outbreaks. However, despite technical advancements, an ability to rapidly adapt or increase antibody affinity and by extension, therapeutic efficacy, has yet to be fully realized. We endeavored to stand-up such a pipeline using molecular modeling combined with experimental library screening to increase the affinity of F5, a monoclonal antibody with potent neutralizing activity against Venezuelan Equine Encephalitis Virus (VEEV), to recombinant VEEV (IAB) E1E2 antigen. We modeled the F5/E1E2 binding interface and generated predictions for mutations to improve binding using a Rosetta-based approach and dTERMen, an informatics approach. The modeling was complicated by the fact that a high-resolution structure of F5 is not available and the H3 loop of F5 exceeds the length for which current modeling approaches can determine a unique structure. A subset of the predicted mutations from both methods were incorporated into a phage display library of scFvs. This library and a library generated by error-prone PCR were screened for binding affinity to the recombinant antigen. Results from the screens identified favorable mutations which were incorporated into 12 human-IgG1 variants. The best variant, containing eight mutations, improved KD from 0.63 nM (parental) to 0.01 nM. While this did not improve neutralization or therapeutic potency of F5 against IAB, it did increase cross-reactivity to other closely related VEEV epizootic and enzootic strains, demonstrating the potential of this method to rapidly adapt existing therapeutics to emerging viral strains.

affinity-maturation↗

A ranking methodology for the coupling of pressurized water nuclear reactors and molten salt thermal energy storage

Thermal energy storage (TES) systems are a proposed solution to electricity market demand fluctuations and can be coupled to nuclear power plants to enable load following. Here, this work focuses on developing a methodology for evaluating potential designs for integrating a TES system into an existing pressurized water nuclear power plant. The proposed ranking methodology allows a group of experts to postulate and weigh designs based on ranking criteria derived from literature. The methodology developed in this study can aid in the final selection of a TES design for an existing nuclear power plant. The same process could be used to analyze other TES and nuclear reactor designs. The determined optimum design from this methodology was to place the TES system after the steam generator and to utilize the steam generated from the nuclear power plant to heat a molten salt TES unit. Another conclusion of this research was that human bias is prevalent during design selection, and actions such as standardized ranking criteria and large groups of experts should be used to minimize this error.

25 ENERGY STORAGE↗

Deep-Learning-Based Segmentation of Keyhole in In-Situ X-ray Imaging of Laser Powder Bed Fusion

In laser powder bed fusion processes, keyholes are the gaseous cavities formed where laser interacts with metal, and their morphologies play an important role in defect formation and the final product quality. The in-situ X-ray imaging technique can monitor the keyhole dynamics from the side and capture keyhole shapes in the X-ray image stream. Keyhole shapes in X-ray images are then often labeled by humans for analysis, which increasingly involves attempting to correlate keyhole shapes with defects using machine learning. However, such labeling is tedious, time-consuming, error-prone, and cannot be scaled to large data sets. To use keyhole shapes more readily as the input to machine learning methods, an automatic tool to identify keyhole regions is desirable. In this paper, a deep-learning-based computer vision tool that can automatically segment keyhole shapes out of X-ray images is presented. The pipeline contains a filtering method and an implementation of the BASNet deep learning model to semantically segment the keyhole morphologies out of X-ray images. The presented tool shows promising average accuracy of 91.24% for keyhole area, and 92.81% for boundary shape, for a range of test dataset conditions in Al6061 (and one AliSi10Mg) alloys, with 300 training images/labels and 100 testing images for each trial. Prospective users may apply the presently trained tool or a retrained version following the approach used here to automatically label keyhole shapes in large image sets.

36 MATERIALS SCIENCE↗