Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “visualization techniques”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Leveraging Prior Concept Learning Improves Generalization From Few Examples in Computational Models of Human Object Recognition

Humans quickly and accurately learn new visual concepts from sparse data, sometimes just a single example. The impressive performance of artificial neural networks which hierarchically pool afferents across scales and positions suggests that the hierarchical organization of the human visual system is critical to its accuracy. These approaches, however, require magnitudes of order more examples than human learners. We used a benchmark deep learning model to show that the hierarchy can also be leveraged to vastly improve the speed of learning. We specifically show how previously learned but broadly tuned conceptual representations can be used to learn visual concepts from as few as two positive examples; reusing visual representations from earlier in the visual hierarchy, as in prior approaches, requires significantly more examples to perform comparably. These results suggest techniques for learning even more efficiently and provide a biologically plausible way to learn new visual concepts from few examples.

Rule, Joshua S.↗

Experimental Modal Analysis Using Phase Quantities from Phase-Based Motion Processing and Motion Magnification

Phase-based motion processing and the associated Motion Magnification that it enables has become popular not only for the striking videos that it can produce of traditionally stiff structures visualized with very large deflections, but also for its ability to pull information out of the noise floor of images so that they can be processed with more traditional optical techniques such as digital image correlation or feature tracking. While the majority of papers in the literature have utilized the Phase-based Image Processing approach as a pre-processor for more quantitative analyses, the technique itself can be used directly to extract modal parameters from an image, noting that the extracted phases are proportional to displacements in the image. Therefore, once phases are extracted, they can be fit using traditional experimental modal analysis techniques. This produces a mode “shape” where the degrees of freedom are phases instead of physical motions. These phases can be scaled to produce on-image visualizations of the mode shapes, rather than operational shapes produced by bandpass filtering. Modal filtering techniques can also be used to visualize motions from an environment on an image using the modal phases as a basis for the expansion.

47 OTHER INSTRUMENTATION↗

Top-down proteomics

Proteoforms arising from posttranslational modifications, genetic polymorphisms, and RNA splice variants, play a pivotal role as the key drivers in biology. Thus, a comprehensive understanding of proteoforms is essential for unraveling the intricacies of biological systems and bridging the gap between genotype and phenotype. By analyzing whole proteins without digestion, top-down proteomics (TDP) provides a holistic view of the proteome and presents a next-generation approach for deciphering protein function, uncovering disease mechanisms, and advancing precision medicine. This Primer embarks on a journey into the world of TDP by encapsulating its historical context, underlying principles, recent advances, and an outlook on the future of TDP. The experimental section navigates instrumentation, sample preparation, intact protein separation, tandem mass spectrometry techniques, and data collection. Results decipher raw data, visualize intact protein spectra, unravel data analysis, and explain proteoform identification, characterization, and quantitation, as well as statistical analysis. Various applications of TDP spanning the human proteoform project, biomedical, biopharmaceutical, and clinical applications are described. These are complemented by discussions on measurement reproducibility, limitations, and a forward-looking perspective outlining uncharted waters where the field can advance, and potential exciting future applications of TDP.

Roberts, David S.↗

Ray-tracing image simulations of transparent objects with complex shape and inhomogeneous refractive index

Optical images of transparent three-dimensional objects can be different from a replica of the object’s cross section in the image plane, due to refraction at the surface or in the body of the object. Simulations of the object’s image are thus needed for the visualization and validation of physical models. We report ray tracing image simulations that achieved high physical fidelity, reproducing optical behaviors and image features not rendered in previous studies. We replicated brightfield microscopy images of drops with complex shapes, and images of pressure and shock waves traveling inside them. For high physical fidelity, the simulations must replicate the spatial and angular distribution of illumination rays, and both the experiment and the simulation must be designed for accurate optical modeling. The simulations are highly sensitive to the properties of the drops and can be used to diagnose and refine fluid dynamics models. The simulated images can also be optimized to extract multiple 3D properties from experimental images. Compared to specialized single-shot 3D imaging methods, this approach has the advantage that it preserves the experimental simplicity, the high resolution, and the visual interpretability characteristic to basic optical imaging. The techniques introduced here are directly applicable to optical microscopy, so they can be used in other fields, such as microfluidics and biology, to expand the type and the accuracy of three-dimensional information that can be extracted from basic optical images.

Cavitation↗

A Vision–based Robust $\mathcal{H}$ ∞ Gain Scheduling Longitudinal and Lateral Following Controller for Autonomous Vehicles on Urban Curved Roads

Implementing advanced driver assistance systems (ADAS) in congested and intricate urban traffic scenarios poses significant challenges. To address the frequent stop–and–go motions exhibited by autonomous vehicles (AVs) navigating urban roads with changes in curvature, we propose a vision–based robust $\mathcal{H}$ ∞ adaptive cruise control system (ACC) for longitudinal control, plus a lane keeping assist system (LKAS) for lateral control. For the vision-based ACC, a weighted probability objective function for the vehicle following behavior is formulated. We incorporate $\mathcal{H}$ ∞ performance and gain scheduling techniques to mitigate the impact of uncertainty in visual sensor measurements. Furthermore, the optimal time headway is scheduled based on the velocity to ensure traffic flow efficiency and safety during the vehicle following process. For the LKAS, we introduce a road curvature estimation method that integrates lane and vehicle dynamics information to obtain the lateral and heading offsets. Next, the design criterion of the observer–based robust gain scheduling lateral motion controller is established by linear matrix inequality (LMI). Here, a series of experiments conducted within a camera–in–loop platform validate the proposed method.

33 ADVANCED PROPULSION SYSTEMS↗

Seeing is believing: visualization of antiferromagnetic domains

Abstract Understanding and utilizing novel antiferromagnetic (AFM) materials has been recently one of the central issues in condensed matter physics, as well as in materials science and engineering. The relevant contemporary topics include multiferroicity, topological magnetism and AFM spintronics. The ability to image magnetic domains in AFM materials is of key importance for the success of these exciting fields. While imaging techniques of magnetic domains on the surfaces of ferro-(ferri)magnetic materials with, for example, magneto-optical Kerr microscopy and magnetic force microscopy have been available for a number of decades, AFM domain imaging is a relatively new development. We review various experimental techniques utilizing scanning, optical, and synchrotron X-ray probes to visualize AFM domains and domain walls, and to unveil their physical properties. We also discuss the existing challenges and opportunities in these techniques, especially with further increase of spatial and temporal resolution.

36 MATERIALS SCIENCE↗

Smartphone application for visualizing building air leakage

Annually, unwanted air leakage through building envelopes accounts for 4 quads of energy consumption in the United States, which translates to about 10% of total building energy consumption. Locating and sealing leakage sites is crucial fordecreasing building energy consumption. Smartphones are ubiquitous and contain sophisticated cameras and highperformance processors that could be employed to visualize air leakage using the background-oriented schlieren imaging technique, making leak detection cheaper and easier. This technique requires a textured and high-contrast background such as a brick or concrete masonry unit wall, a building air leak that has a temperature difference compared with the ambient air, and an imaging system. This work focuses on using smartphones as the imaging system to visualize air leakages. The paper discusses application development and the results of testing to determine leakage visualization performance as a function of leak temperature. The results show that leaks with a temperature difference greater than 16°C compared with the ambient air temperature were visualized using existing smartphones.

Boudreaux, Philip [ORNL] (ORCID:0000000229564665)↗

Resonant acoustic monitoring of damage in plug‐screw feeders

Abstract Plug‐screw feeders are critical in many industrial processes for compressing slurry materials via a rotating plug‐screw feeder. Over time, increasing plug‐screw feeder wear will eventually lead to catastrophic mechanical failure. Early detection of the wear state can prevent unplanned catastrophic failures resulting in operational shut‐downs, costly repairs, and most importantly the health and safety of workers. We present a theoretical basis for a noninvasive, in operando acoustic resonant technique to monitor the wear state of plug‐screw feeders. The technique is based on tracking the resonant acoustic modes of the plug‐screw feeder, which are sensitive to the plug‐screw feeder geometry, material, and operating conditions. We implemented a multivariate polynomial model to estimate the plug‐screw feeder wear state using multiple acoustic resonances by simulating the acoustic resonant modes for two categories of wear (tip and thread damage) that are common in plug‐screw feeders. Fitting multiple resonances to the polynomial model, we demonstrate accurate estimation of the total mass loss, as well as characterization of the type of damage (i.e., tip vs. thread). Current approaches for monitoring plug‐screw feeder wear rely on shutting down the operation and visually inspecting the plug‐screw feeder. The presented acoustic technique offers a noninvasive, in operando measurement approach that mitigates unplanned catastrophic failures. The acoustic resonance technique presented in the paper has a broad range of industrial applications including the Pharmaceutical, Mining, Integrated Biorefineries (IBR), and Additive Manufacturing industries, to name a few.

36 MATERIALS SCIENCE↗

2022 Prentice Award Lecture: Advancing Retinal Imaging and Visual Function in Patient Management and Disease Mechanisms

Patient-based research plays a key role in probing basic visual mechanisms. Less-well recognized is the role of patient-based retinal imaging and visual function studies in elucidating disease mechanisms, which are accelerated by advances in imaging and function techniques and are most powerful when combined with the results from histology and animal models. A patient's visual complaints can be one key to patient management, but human data are also key to understanding disease mechanisms. Unfortunately, pathological changes can be difficult to detect. Before advanced retinal imaging, the measurement of visual function indicated the presence of pathological changes that were undetectable with existing clinical examination. Over the past few decades, advances in retinal imaging have increasingly revealed the unseen. This has led to great strides in the management of many diseases, particularly diabetic retinopathy and macular edema, and age-related macular degeneration. It is likely widely accepted that patient-based research, as in clinical trials, led to such positive outcomes. Both visual function measures and advanced retinal imaging have clearly demonstrated differences among retinal diseases. Contrary to initial thinking, sight-threatening damage in diabetes occurs to the outer retina and not only to the inner retina. This has been clearly indicated in patient results but has only gradually entered the clinical classifications and understanding of disease etiology. There is strikingly different pathophysiology for age-related macular degeneration compared with photoreceptor and retinal pigment epithelial genetic defects, yet research models and even some treatments confuse these. It is important to recognize the role that patient-based research plays in probing basic visual mechanisms and elucidating disease mechanisms, combining these findings with the concepts from histology and animal models. Thus, this article combines sample instrumentation from my laboratory and progress in the fields of retinal imaging and visual function.

60 APPLIED LIFE SCIENCES↗

Structuring Nutrient Yields throughout Mississippi/Atchafalaya River Basin Using Machine Learning Approaches

To minimize the eutrophication pressure along the Gulf of Mexico or reduce the size of the hypoxic zone in the Gulf of Mexico, it is important to understand the underlying temporal and spatial variations and correlations in excess nutrient loads, which are strongly associated with the formation of hypoxia. This study’s objective was to reveal and visualize structures in high-dimensional datasets of nutrient yield distributions throughout the Mississippi/Atchafalaya River Basin (MARB). For this purpose, the annual mean nutrient concentrations were collected from thirty-three US Geological Survey (USGS) water stations scattered in the upper and lower MARB from 1996 to 2020. Eight surface water quality indicators were selected to make comparisons among water stations along the MARB over the past two decades. Principal component analysis (PCA) was used to comprehensively evaluate the nutrient yields across thirty-three USGS monitoring stations and identify the major contributing nutrient loads. The results showed that all samples could be analyzed using two main components, which accounted for 81.6% of the total variance. The PCA results showed that yields of orthophosphate (OP), silica (SI), nitrate–nitrites (NO 3 -NO 2 ), and total suspended sediment (TSS) are major contributors to nutrient yields. It also showed that land-planted crops, density of population, domestic and industrial discharges, and precipitation are fundamental causes of excess nutrient loads in MARB. These factors are of great significance for the excess nutrient load management and pollution control of the Mississippi River. It was found that the average nutrient yields were stable within the sub-MARB area, but the large nitrogen yields in the upper MARB and the large phosphorus yields in the lower MARB were of great concern. t-distributed stochastic neighbor embedding (t-SNE) revealed interesting nonlinear and local structures in nutrient yield distributions. Clustering analysis (CA) showed the detailed development of similarities in the nutrient yield distribution. Moreover, PCA, t-SNE, and CA showed consistent clustering results. This study demonstrated that the integration of dimension reduction techniques, PCA, and t-SNE with CA techniques in machine learning are effective tools for the visualization of the structures of the correlations in high-dimensional datasets of nutrient yields and provide a comprehensive understanding of the correlations in the distributions of nutrient loads across the MARB.

54 ENVIRONMENTAL SCIENCES↗

Quantifying uncertainty in Pareto estimates of global lake area

Abstract Size is a critical factor determining the rate and occurrence of specific lake processes such as carbon sequestration and greenhouse gas emissions and emerging evidence suggests that small lakes in particular have particularly large CO 2 flux rates. Because we do not have a complete census of all lakes, upscaling estimates of such processes to small lakes at broad spatial scales requires the use of lake size‐abundance distributions rather than empirical measurements of area. Existing lake census efforts are incomplete such that as lakes become smaller, they are more likely to be omitted either because they are too small to be resolved from remote sensing products or because of limited ground surveying effort (i.e., “censoring” of small lakes relative to large lakes). The present study explores one potential shortcoming of prior approaches estimating global lake area using lake size‐abundance distributions. Namely, that these prior approaches rely on frequentist curve fitting techniques combined with an ad‐hoc cutoff determination strategy (visual inspection to determine a likely censoring point). This yields an over‐exact lake area estimate that is typically reported with no uncertainty bounds. I show how these shortcomings can be addressed with a Bayesian model that produces larger estimates of lake area uncertainty relative to the typical approach. When used as part of a sensitivity analysis, such an approach has the potential to enable more robust intercomparisons among studies of aquatic processes upscaling.

54 ENVIRONMENTAL SCIENCES↗

Solvation Environment and Interface Dynamics of Li 2 B 12 H 12 and Li 2 B 12 F 12 Electrolytes Uncovered by Theory and Operando Optical and FTIR Spectroelectrochemistry

In this work, we evaluated two closo-borate salts (Li 2 B 12 H 12 and Li 2 B 12 F 12 ) in propylene carbonate from theoretical and experimental perspectives to understand how the coordination environment influences their spectroscopic and electrochemical properties. The coordination environments of the closo-borate salts were modeled via density functional theory (DFT) and molecular dynamics (MD). Vibrational spectra calculated from the predicted coordination environments are in agreement with experimentally measured steady-state FTIR data. This theoretical investigation also suggested that Li 2 B 12 F 12 would possess a higher ionic conductivity than Li 2 B 12 H 12 , which was corroborated experimentally. Additionally, an electrochemical cell was designed and fabricated that enabled operando optical and FTIR spectroelectrochemical (OP-IR-SEC) measurements. This allowed for the simultaneous measurement of the relative changes of species at a lithium electrode-liquid electrolyte interface and the visualization of lithium plating at the electrode surface. This technique could provide new chemical insights and potentially link optical changes at the electrode–electrolyte interface to specific chemical species in similar electrochemical systems. The Li 2 B 12 F 12 electrolyte was found to have a higher thermal stability, which may find utility in applications for batteries that are subject to high-temperature conditions.

36 MATERIALS SCIENCE↗

Visualizing broken symmetry and topological defects in a quantum Hall ferromagnet

The interaction between electrons in graphene under high magnetic fields drives the formation of a rich set of quantum Hall ferromagnetic (QHFM) phases with broken spin or valley symmetry. Visualizing atomic-scale electronic wave functions with scanning tunneling spectroscopy (STS), we resolved microscopic signatures of valley ordering in QHFM phases and spectral features of fractional quantum Hall phases of graphene. At charge neutrality, we observed a field-tuned continuous quantum phase transition from a valley-polarized state to an intervalley coherent state, with a Kekulé distortion of its electronic density. Mapping the valley texture extracted from STS measurements of the Kekulé phase, we could visualize valley skyrmion excitations localized near charged defects. Our techniques can be applied to examine valley-ordered phases and their topological excitations in a wide range of materials.

valley symmetry↗

Effective Defect Detection Using Instance Segmentation for NDI

Ultrasonic testing is a common Non-Destructive Inspection (NDI) method used in aerospace manufacturing. However, the complexity and size of the ultrasonic scans make it challenging to identify defects through visual inspection or machine learning models. Using computer vision techniques to identify defects from ultrasonic scans is an evolving research area. In this study, we used instance segmentation to identify the presence of defects in the ultrasonic scan images of composite panels that are representative of real components manufactured in aerospace. We used two models based on Mask- RCNN (Detectron 2) and YOLO 11 respectively. Additionally, we implemented a simple statistical pre-processing technique that reduces the burden of requiring custom-tailored pre-processing techniques. Our study demonstrates the feasibility and effectiveness of using instance segmentation in the NDI pipeline by significantly reducing data pre-processing time, inspection time, and overall costs.

computer vision techniques↗

Meeting Global Health Needs via Infectious Disease Forecasting: Development of a Reliable Data-Driven Framework

Infectious diseases (IDs) have a significant detrimental impact on global health. Timely and accurate ID forecasting can result in more informed implementation of control measures and prevention policies. To meet the operational decision-making needs of real-world circumstances, we aimed to build a standardized, reliable, and trustworthy ID forecasting pipeline and visualization dashboard that is generalizable across a wide range of modeling techniques, IDs, and global locations. We forecasted 6 diverse, zoonotic diseases (brucellosis, campylobacteriosis, Middle East respiratory syndrome, Q fever, tick-borne encephalitis, and tularemia) across 4 continents and 8 countries. We included a wide range of statistical, machine learning, and deep learning models (n=9) and trained them on a multitude of features (average n=2326) within the One Health landscape, including demography, landscape, climate, and socioeconomic factors. The pipeline and dashboard were created in consideration of crucial operational metrics—prediction accuracy, computational efficiency, spatiotemporal generalizability, uncertainty quantification, and interpretability—which are essential to strategic data-driven decisions. While no single best model was suitable for all disease, region, and country combinations, our ensemble technique selects the best-performing model for each given scenario to achieve the closest prediction. For new or emerging diseases in a region, the ensemble model can predict how the disease may behave in the new region using a pretrained model from a similar region with a history of that disease. The data visualization dashboard provides a clean interface of important analytical metrics, such as ID temporal patterns, forecasts, prediction uncertainties, and model feature importance across all geographic locations and disease combinations. As the need for real-time, operational ID forecasting capabilities increases, this standardized and automated platform for data collection, analysis, and reporting is a major step forward in enabling evidence-based public health decisions and policies for the prevention and mitigation of future ID outbreaks.

60 APPLIED LIFE SCIENCES↗

Electrochemical Imaging of Interfaces in Energy Storage via Scanning Probe Methods: Techniques, Applications, and Prospects

Developing a deeper understanding of dynamic chemical, electronic, and morphological changes at interfaces is key to solving practical issues in electrochemical energy storage systems (EESSs). To unravel this complexity, an assortment of tools with distinct capabilities and spatiotemporal resolutions have been used to creatively visualize interfacial processes as they occur. This review highlights how electrochemical scanning probe techniques (ESPTs) such as electrochemical atomic force microscopy, scanning electrochemical microscopy, scanning ion conductance microscopy, and scanning electrochemical cell microscopy are uniquely positioned to address these challenges in EESSs. We describe the operating principles of ESPTs, focusing on the inspection of interfacial structure and chemical processes involved in Li-ion batteries and beyond. We discuss current examples, performance limitations, and complementary ESPTs. Finally, we discuss prospects for imaging improvements and deep learning for automation. We foresee that ESPTs will play an enabling role in advancing EESSs as we transition to renewable energies.

25 ENERGY STORAGE↗

Towards resolving protein structures at the atomic scale using atom probe tomography

In the field of Structural Biology, Atom Probe Tomography (APT) is in the nascent stages of development wherein coarse-grained visuals of proteins have been captured. The characterization of organic samples or biomolecules through the technique is currently limited to the detection of a few dominant signatures. The problem of indecipherable characterization can inherently be traced back to multiple forms of technique-specific responses to organic samples and consequent triggers leading to organic-sample and sample-medium interactions. While it is possible for captured manifestations of protein reconstructions to seemingly appear intact from a basic visual purview, the parameter-protein associative responses throughout the structure as a direct consequence of the inherent workings of the technique (until harmonized with organic sample complexity and behavior) and field evaporation-based factors make non-aberrative atomic associations infeasible. The work focused on identifying and theorizing the (above stated and other) fundamental mechanisms that stronghold the study of intricate atomic to higher order associations in proteins through APT. Attempts at structure elucidation of the cryogenic sample under study, through indirect associations (and methods) based on other imaging techniques, further revealed the distinct and highly distortive nature at the atomic scale deterring structural tunability and thus characterization of APT based cryogenic samples under analysis. As a direct counter to the atomic scale characterization problem, by taking the experiment-specific uncertainties, and probable APT-centric organic sample-based variabilities into account, a basic result is extracted and presented. Through mass-spectrometric and computational analysis, specific individual amino acids (Sulfur-containing protein-bound amino acids) in proteins and aspects of protein structure (probable backbone fragments, partial sequence - partial backbone portions) have been identified and characterized. Under analysis considerations, a few of the simplest known and easily inferable segments that favor structural deteriorations in the reconstructions are stated. Additionally, to overcome technique-specific deterrents to the characterization of biomolecules in cryogenic sample medium, the development of a protein-labeling strategy tailored to APT is suggested.

59 BASIC BIOLOGICAL SCIENCES↗

Quantification and visualization of uncertainties in reconstructed penumbral images of implosions at Omega

Penumbral imaging is a technique used in plasma diagnostics in which a radiation source shines through one or more large apertures onto a detector. To interpret a penumbral image, one must reconstruct it to recover the original source. The inferred source always has some error due to noise in the image and uncertainty in the instrument geometry. Interpreting the inferred source thus requires quantification of that inference’s uncertainty. Markov chain Monte Carlo algorithms have been used to quantify uncertainty for similar problems but have never been used for the inference of the shape of an image. Because of this, there are no commonly accepted ways of visualizing uncertainty in two-dimensional data. This paper demonstrates the application of the Hamiltonian Monte Carlo algorithm to the reconstruction of penumbral images of fusion implosions and presents ways to visualize the uncertainty in the reconstructed source. This methodology enables more rigorous analysis of penumbral images than has been done in the past.

Instruments & Instrumentation↗