SEARCH · Engineering Papers

Results for “adaptive imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Root identification in minirhizotron imagery with multiple instance learning

In this study, multiple instance learning (MIL) algorithms to automatically perform root detection and segmentation in minirhizotron imagery using only image-level labels are proposed. Root and soil characteristics vary from location to location, and thus, supervised machine learning approaches that are trained with local data provide the best ability to identify and segment roots in minirhizotron imagery. However, labeling roots for training data (or otherwise) is an extremely tedious and time-consuming task. This paper aims to address this problem by labeling data at the image level (rather than the individual root or root pixel level) and train algorithms to perform individual root pixel level segmentation using MIL strategies. Three MIL methods (multiple instance adaptive cosine coherence estimator, multiple instance support vector machine, multiple instance learning with randomized trees) were applied to root detection and compared to non-MIL approaches. The results show that MIL methods improve root segmentation in challenging minirhizotron imagery and reduce the labeling burden. In our results, multiple instance support vector machine outperformed other methods. The multiple instance adaptive cosine coherence estimator algorithm was a close second with an added advantage that it learned an interpretable root signature which identified the traits used to distinguish roots from soil and did not require parameter selection.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2020

1D to 2D Transition in Tellurium Observed by 4D Electron Microscopy

A new microwave-enhanced synthesis method for the production of tellurium nanostructures is reported here—with control over products from the 1D regime (sub-5 nm diameter nanowires), to nanoribbons, to the 2D tellurene regime—along with a new methodology for local statistical quantification of the crystallographic parameters of these materials at the nanometer scale. Using a direct electron detector and image-corrected microscope, large and robust 4D scanning transmission electron microscopy datasets for accurate structural analysis are obtained. These datasets allow the adaptation of quantitative techniques originally developed for X-ray diffraction (XRD) refinement analyses to transmission electron microscopy, enabling the first demonstration of sub-picometer accuracy lattice parameter extraction while also obtaining both the size of the coherent crystallite domains and the nanostrain, which is observed to decrease as nanowires transition to tellurene. This new local analysis is commensurate with global powder XRD results, indicating the robustness of both the new synthesis approach and new structural analysis methodology for future scalable production of 2D tellurene and characterization of nanomaterials.

2D materials↗

DOE OSTI2020

Data-driven materials research enabled by natural language processing and information extraction

Given the emergence of data science and machine learning throughout all aspects of society, but particularly in the scientific domain, there is increased importance placed on obtaining data. Data in materials science are particularly heterogeneous, based on the significant range in materials classes that are explored and the variety of materials properties that are of interest. This leads to data that range many orders of magnitude, and these data may manifest as numerical text or image-based information, which requires quantitative interpretation. The ability to automatically consume and codify the scientific literature across domains - enabled by techniques adapted from the field of natural language processing - therefore has immense potential to unlock and generate the rich datasets necessary for data science and machine learning. This review focuses on the progress and practices of natural language processing and text mining of materials science literature and highlights opportunities for extracting additional information beyond text contained in figures and tables in articles. Here, we discuss and provide examples for several reasons for the pursuit of natural language processing for materials, including data compilation, hypothesis development, and understanding the trends within and across fields. Current and emerging natural language processing methods along with their applications to materials science are detailed. We, then, discuss natural language processing and data challenges within the materials science domain where future directions may prove valuable.

36 MATERIALS SCIENCE↗

DOE OSTI2022

Optimal band selection for target detection with a LWIR multispectral imager

Multispectral imaging can offer many benefits in cost, complexity, resolution, size, weight, and power, relative to hyperspectral imaging. When designing a multispectral system, spectral bandpasses can be selected using optimization algorithms configured to maximally separate target detection scores between target and background regions. A hyperspectral image (HSI) can serve as the source of data from which band groupings can be tested for optimality. The output of an adaptive cosine estimator target detection algorithm is used in an objective function. Three optimization algorithms are compared: particle swarm, dual annealing, and differential evolution. A global optimum is also found using a brute force approach on the Livermore Computing Syrah supercomputer. Three materials are investigated: calcite, gypsum, and limestone. This is done for 3-, 4-, and 5-band systems. The data originate from a longwave infrared HSI of a material display board. The optimization algorithms were run 30 times for every scenario. Performance statistics (maximum, minimum, mean, standard deviation, and median) based on the separation values are given. Additional characterization was performed using receiver operator characteristic (ROC) curves and the area under the ROC curve. While good performance was obtained for the three optimization algorithms, the dual annealing algorithm produced the highest and most consistent detection separation scores on average.

47 OTHER INSTRUMENTATION↗

DOE OSTI2021

Absorptive Weak Plume Detection on Gaussian and Non-Gaussian Background Clutter

For additive signals on Gaussian clutter, the optimal detector is a linear matched filter that is adapted to the known signal and the covariance of the background. This adaptive matched filter is widely used for gas-phase plume detection, even though the effect of the plume on the background is not strictly additive. Here, a derivation of the matched filter for a strictly absorptive plume produces, in the weak plume limit, a quadratic filter. This quadratic matched filter is extended in two ways: an elliptically-contoured multivariate t distribution is used to generalize the Gaussian background clutter, and a generalized likelihood ratio test detector is derived to extend applicability to stronger plumes. In addition to detectors whose purpose is to identify presence versus absence of a plume, expressions are also derived for estimating plume strength. The performance of these various detectors is evaluated by implanting simulated plume into background images that are either real hyperspectral images or simulated images based on different (Gaussian, multivariate t, and lognormal) clutter distributions.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2021

Adaptive hyperparameter updating for training restricted Boltzmann machines on quantum annealers

Restricted Boltzmann Machines (RBMs) have been proposed for developing neural networks for a variety of unsupervised machine learning applications such as image recognition, drug discovery, and materials design. The Boltzmann probability distribution is used as a model to identify network parameters by optimizing the likelihood of predicting an output given hidden states trained on available data. Training such networks often requires sampling over a large probability space that must be approximated during gradient based optimization. Quantum annealing has been proposed as a means to search this space more efficiently which has been experimentally investigated on D-Wave hardware. D-Wave implementation requires selection of an effective inverse temperature or hyperparameter (β) within the Boltzmann distribution which can strongly influence optimization. Here, we show how this parameter can be estimated as a hyperparameter applied to D-Wave hardware during neural network training by maximizing the likelihood or minimizing the Shannon entropy. We find both methods improve training RBMs based upon D-Wave hardware experimental validation on an image recognition problem. Neural network image reconstruction errors are evaluated using Bayesian uncertainty analysis which illustrate more than an order magnitude lower image reconstruction error using the maximum likelihood over manually optimizing the hyperparameter. The maximum likelihood method is also shown to out-perform minimizing the Shannon entropy for image reconstruction.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Adapting In Situ Accelerators for Sparsity With Granular Matrix Reordering

Neural network (NN) inference is an essential part of modern systems and is found at the heart of numerous applications ranging from image recognition to natural language processing. In situ NN accelerators can efficiently perform NN inference using resistive crossbars, which makes them a promising solution to the data movement challenges faced by conventional architectures. Although such accelerators demonstrate significant potential for dense NNs, they often do not benefit from sparse NNs, which contain relatively few non-zero weights. Processing sparse NNs on in situ accelerators results in wasted energy to charge the entire crossbar where most elements are zeros. To address this limitation, this paper proposes Granular Matrix Reordering (GMR): a preprocessing technique that enables an energy-efficient computation of sparse NNs on in situ accelerators. GMR reorders the rows and columns of sparse weight matrices to maximize the crossbars' utilization and minimize the total number of crossbars needed to be charged. The reordering process does not rely on sparsity patterns and incurs no accuracy loss. Finally, GMR achieves an average of 28% and up to 34% reduction in energy consumption over seven pruned NNs across four different pruning methods and network architectures.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Enabling reactive microscopy with MicroMator

Microscopy image analysis has recently made enormous progress both in terms of accuracy and speed thanks to machine learning methods and improved computational resources. This greatly facilitates the online adaptation of microscopy experimental plans using real-time information of the observed systems and their environments. Applications in which reactiveness is needed are multifarious. Here we report MicroMator, an open and flexible software for defining and driving reactive microscopy experiments. It provides a Python software environment and an extensible set of modules that greatly facilitate the definition of events with triggers and effects interacting with the experiment. We provide a pedagogic example performing dynamic adaptation of fluorescence illumination on bacteria, and demonstrate MicroMator’s potential via two challenging case studies in yeast to single-cell control and single-cell recombination, both requiring real-time tracking and light targeting at the single-cell level.

47 OTHER INSTRUMENTATION↗

DOE OSTI2025

MoRE-Brain: Routed Mixture of Experts for Interpretable and Generalizable Cross-Subject fMRI Visual Decoding

Decoding visual experiences from fMRI offers a powerful avenue to understand human perception and develop advanced brain-computer interfaces. However, current progress often prioritizes maximizing reconstruction fidelity while overlooking interpretability, an essential aspect for deriving neuroscientific insight. To address this gap, we propose MoRE-Brain, a neuro-inspired framework designed for high-fidelity, adaptable, and interpretable visual reconstruction. MoRE-Brain uniquely employs a hierarchical Mixture-of-Experts architecture where distinct experts process fMRI signals from functionally related voxel groups, mimicking specialized brain networks. The experts are first trained to encode fMRI into the frozen CLIP space. A finetuned diffusion model then synthesizes images, guided by expert outputs through a novel dual-stage routing mechanism that dynamically weighs expert contributions across the diffusion process. MoRE-Brain offers three main advancements: First, it introduces a novel Mixture-of-Experts architecture grounded in brain network principles for neuro-decoding. Second, it achieves efficient cross-subject generalization by sharing core expert networks while adapting only subject-specific routers. Third, it provides enhanced mechanistic insight, as the explicit routing reveals precisely how different modeled brain regions shape the semantic and spatial attributes of the reconstructed image. Extensive experiments validate MoRE-Brain’s high reconstruction fidelity, with bottleneck analyses further demonstrating its effective utilization of fMRI signals, distinguishing genuine neural decoding from over-reliance on generative priors. Consequently, MoRE-Brain marks a substantial advance towards more generalizable and interpretable fMRI-based visual decoding.

Wei, Yuxiang [Georgia Institute of Technology]↗

DOE OSTI2025

An on-chip phased array for non-classical light

Abstract Quantum science and technology can offer fundamental enhancements in sensing, communications and computing. The expansion from wired to wireless links is an exciting prospect for quantum technologies. For classical technologies, the advent of phased arrays enabled directional and adaptive wireless links by manipulating electromagnetic waves over free space. Here we demonstrate a phased array system on a chip that can receive, image and manipulate non-classical light over free space. We use an integrated photonic-electronic system with more than 1000 functional components on-chip to detect squeezed light. By integrating an array of 32 sub-wavelength engineered metamaterial antennas, we demonstrate a direct free-space-to-chip interface for reconfigurable quantum links. On the same chip, we implement a large-scale array of quantum-limited coherent receivers that can resolve non-classical signals simultaneously across 32 channels. With coherent readout and manipulation of these signals, we demonstrate 32-pixel imaging and spatially configurable reception of squeezed light over free space. Our work advances wireless quantum technologies that could enable practical applications in quantum communications and sensing.

Science & Technology - Other Topics↗

DOE OSTI2022

EdgeAI: Machine learning via direct attached accelerator for streaming data processing at high shot rate x-ray free-electron lasers

We present a case for low batch-size inference with the potential for adaptive training of a lean encoder model. We do so in the context of a paradigmatic example of machine learning as applied in data acquisition at high data velocity scientific user facilities such as the Linac Coherent Light Source-II x-ray Free-Electron Laser. We discuss how a low-latency inference model operating at the data acquisition edge can capitalize on the naturally stochastic nature of such sources. We simulate the method of attosecond angular streaking to produce representative results whereby simulated input data reproduce high-resolution ground truth probability distributions. By minimizing the mean-squared error between the decoded output of the latent representation and the ground truth distributions, we ensure that the encoding layers and resulting latent representation maintains full fidelity for any downstream task, be it classification or regression. We present throughput results for data-parallel inference of various batch sizes, some with throughput exceeding 100 k images per second. We also show in situ training below 10 s per epoch for the full encoder–decoder model as would be relevant for streaming and adaptive real-time data production at our nation’s scientific light sources.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Near-field infrared microscopy: A novel analytic mapping technique to nanocharacterize calcium silicate-based cement materials

Infrared imaging via scattering-type scanning near-field optical microscopy (s-SNOM) allows chemical mapping of organic and inorganic materials with nanoscale spatial resolution. However, its potential adaptation to the complex multiphase structure of Portland cement is yet to be explored. Here we demonstrate the successful implementation of s-SNOM to spatially resolve coexisting chemical phases in tricalcium silicate, Portland cement's main compound, with 20-nm resolution. We found that s-SNOM is sensitive to different anhydrous polymorphic phases, revealing nanoscale domains that are ‘invisible’ to other microscopic techniques. Furthermore, s-SNOM's ability to distinguish the unhydrated and hydrated phases signifies its great promise as an analytical tool to study the complex hydration process of cement. The key to s-SNOM's application was nano-modifying the surface roughness of the cement samples, allowing nanoscale infrared imaging without topographical artifacts. Our study opens a window for infrared spectral microscopy in cement and other porous inorganic materials.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Stimulated Raman Scattering Microscopy: Real-Time In-Situ Physical and Chemical Characterization of Reverse Osmosis Desalination Membrane Scaling

We introduce a stimulated Raman scattering (SRS) methodology designed for rapid, real-time, and in situ monitoring of RO membrane scaling adapted for bench-scale desalination flow cells. The methodology can provide new insights into membrane scaling dynamics by offering time-resolved reflection imaging of inorganic crystal growth, coupled with chemical identification from Raman spectral data. These capabilities allow for direct local measurement of the membrane surface area covered by different scalants as well as an approximation of the scalant volume using three-dimensional, integrated Raman intensity. The 2D and 3D SRS results obtained from CaSO 4 scaling experiments are compared to and are in reasonable agreement with those provided by confocal microscopy. The real-time physical and chemical characterization capabilities presented here could be extended to study combinations of inorganic, organic, and biological fouling. Overall, the SRS methodology represents an advancement in real-time sensing of membrane fouling that offers the potential for improved operation, lower cost, and more resilient RO membrane systems for sustainable water management.

42 ENGINEERING↗

DOE OSTI2026

Extended Accelerated Stress Testing of Lamination-Free Edge-Sealed Photovoltaic Minimodules

Lamination-free minimodules are constructed with silicon solar cells between glass sheets and an edge seal of polyisobutylene and silicone. These samples are stressed using a repeated sequential testing sequence including ultraviolet-containing simulated solar spectrum light exposure at elevated temperature, damp heat, humidity freeze, and thermal cycling adapted from the International Electrotechnical Commission (IEC) TS 63209-2:2022. The minimodule performance throughout the stressing is characterized by flash testing and electroluminescence imaging. Results are compared to conventional laminated minimodules using the same type of solar cells. The lamination-free minimodules experience up to 8% power loss compared to roughly 3% for the laminated versions. However, those losses, dominated by current and fill factor, are caused by glass soiling and busbar ribbon separation on the cells. When glass is replaced and the stressed cells are contacted with probes bypassing the delaminated ribbons, the initial performance is recovered, and overall losses of the lamination-free samples become negligible.

14 SOLAR ENERGY↗

DOE OSTI2026

Raw Lidar and Camera Data Synchronized with Precipitation and Present Weather Data

As part of the sensor characterization task of the SMART 2.0 project, this dataset includes raw data from three spinning lidars ([Ouster OS2-128](https://ouster.com/products/scanning-lidar/os2-sensor/), [Velodyne Puck (VLP-16)](https://velodynelidar.com/products/puck/), and [Velodyne Ultra Puck (VLP-32)](https://velodynelidar.com/products/ultra-puck/)), one camera ([Mako G-319](https://www.alliedvision.com/en/camera-selector/detail/mako/g-319/)), and one present weather sensor ([Vaisala FD-70](https://www.vaisala.com/en/products/weather-environmental-sensors/forward-scatter-fd70)). All data were synchronized, with the log start time indicated in the file name (HHMMSS). The data can be filtered by date, log time (HHMMSS), sensor, frame ID, and weather classification. These data were gathered statically at the Argonne Testbed for Multiscale Observational Science (ATMOS). Two target stop signs were placed in view of the sensors to contribute a target for comparing sensor data under different conditions. The weather data for each day are stored in netCDF “.nc” files. The lidar data contain the X, Y, Z, intensity, reflectivity, and ring from Ouster OS2-128 rev6, Velodyne VLP-16, and Velodyne VLP-32 lidars. ![raw lidar image](LiDAR_pointcloud_ATMOS.png)

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2021

Nanomechanical testing of freestanding polymer films: in situ tensile testing and Tg measurement

Abstract A method for small-scale testing and imaging of freestanding, microtomed polymer films using a push-to-pull device is presented. Central to this method was the development of a sample preparation technique which utilized solvents at cryogenic temperatures to transfer and deposit delicate thin films onto the microfabricated push-to-pull devices. The preparation of focused ion beam (FIB)-milled tensile specimens enabled quantitative in situ TEM tensile testing, but artifacts associated with ion and electron beam irradiation motivated the development of a FIB-free specimen preparation method. The FIB-free method was enabled by the design and fabrication of oversized strain-locking push-to-pull devices. An adaptation for push-to-pull devices to be compatible with an instrumented nanoindenter expanded the testing capabilities to include in situ heating. These innovations provided quantitative mechanical testing, postmortem TEM imaging, and the ability to measure the glass transition temperature, via dynamic mechanical analysis, of freestanding polymer films. Results for each of these mentioned characterization methods are presented and discussed in terms of polymer nanomechanics. Graphic Abstract

36 MATERIALS SCIENCE↗

DOE OSTI2025

Personalized and uncertainty-aware coronary hemodynamics simulations: From Bayesian estimation to improved multi-fidelity uncertainty quantification

Non-invasive simulations of coronary hemodynamics have improved clinical risk stratification and treatment outcomes for coronary artery disease, compared to relying on anatomical imaging alone. However, simulations typically use empirical approaches to distribute total coronary flow amongst the arteries in the coronary tree, which ignores patient variability, the presence of disease, and other clinical factors. Further, uncertainty in the clinical data often remains unaccounted for in the modeling pipeline. We present an end-to-end uncertainty-aware pipeline to (1) personalize coronary flow simulations by incorporating vessel-specific coronary flows as well as cardiac function; and (2) predict clinical and biomechanical quantities of interest with improved precision, while accounting for uncertainty in the clinical data. We assimilate patient-specific measurements of myocardial blood flow from clinical CT myocardial perfusion imaging to estimate branch-specific coronary artery flows. Simulated noise in the clinical data is used to estimate the joint posterior distributions of the model parameters using adaptive Markov Chain Monte Carlo sampling. Additionally, the posterior predictive distribution for the relevant quantities of interest is determined using a new approach combining multi-fidelity Monte Carlo estimation with non-linear, data-driven dimensionality reduction. This leads to improved correlations between high- and low-fidelity model outputs. Our framework accurately recapitulates clinically measured cardiac function as well as branch-specific coronary flows under measurement noise uncertainty. We observe substantial reductions in confidence intervals for estimated quantities of interest compared to single-fidelity Monte Carlo estimation and state-of-the-art multi-fidelity Monte Carlo methods. This holds especially true for quantities of interest that showed limited correlation between the low- and high-fidelity model predictions. In addition, the proposed multi-fidelity Monte Carlo estimators are significantly cheaper to compute than traditional estimators, under a specified confidence level or variance. The proposed pipeline for personalized and uncertainty-aware predictions of coronary hemodynamics is based on routine clinical measurements and recently developed techniques for CT myocardial perfusion imaging. The proposed pipeline offers significant improvements in precision and reduction in computational cost.

Bayesian parameter estimation↗

DOE OSTI2021

Rapid custom prototyping of soft poroelastic biosensor for simultaneous epicardial recording and imaging

Abstract The growing need for the implementation of stretchable biosensors in the body has driven rapid prototyping schemes through the direct ink writing of multidimensional functional architectures. Recent approaches employ biocompatible inks that are dispensable through an automated nozzle injection system. However, their application in medical practices remains challenged in reliable recording due to their viscoelastic nature that yields mechanical and electrical hysteresis under periodic large strains. Herein, we report sponge-like poroelastic silicone composites adaptable for high-precision direct writing of custom-designed stretchable biosensors, which are soft and insensitive to strains. Their unique structural properties yield a robust coupling to living tissues, enabling high-fidelity recording of spatiotemporal electrophysiological activity and real-time ultrasound imaging for visual feedback. In vivo evaluations of custom-fit biosensors in a murine acute myocardial infarction model demonstrate a potential clinical utility in the simultaneous intraoperative recording and imaging on the epicardium, which may guide definitive surgical treatments.

36 MATERIALS SCIENCE↗