Multi-image tie-point detection applied to multi-angle imagery from MISR
An automatic tie-point (TP) detection algorithm for multi-image triangulation and registration is described.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
An automatic tie-point (TP) detection algorithm for multi-image triangulation and registration is described.
Strain-engineering in atomically thin metal dichalcogenides is a useful method for realizing single-photon emitters (SPEs) for quantum technologies. Correlating SPE position with local strain topography is challenging due to localization inaccuracies from the diffraction limit. Currently, SPEs are assumed to be positioned at the highest strained location and are typically identified by randomly screening narrow-linewidth emitters, of which only a few are spectrally pure. In this work, hyperspectral quantum emitter localization microscopy is used to locate 33 SPEs in nanoparticle-strained WSe 2 monolayers with sub-diffraction-limit resolution (≈30 nm) and correlate their positions with the underlying strain field via image registration. In this system, spectrally pure emitters are not concentrated at the highest strain location due to spectral contamination; instead, isolable SPEs are distributed away from points of peak strain with an average displacement of 240 nm. These observations point toward a need for a change in the design rules for strain-engineered SPEs and constitute a key step toward realizing next-generation quantum optical architectures.
Abstract INTRODUCTION A key goal of the Alzheimer's Disease NeuroImaging Initiative (ADNI) positron emission tomography (PET) Core is to harmonize quantification of β‐amyloid (Aβ) and tau PET image data across multiple scanners and tracers. METHODS We developed an analysis pipeline (Berkeley PET Imaging Pipeline, B‐PIP) for ADNI Aβ and tau PET images and applied it to PET data from other multisite studies. Steps include image pre‐processing, refacing, magnetic resonance imaging (MRI)/PET co‐registration, visual quality control (QC), quantification of tracer uptake, and standardization of Aβ and tau standardized uptake value ratios (SUVrs) across tracers. RESULTS Measurements from 10,105 cross‐sectional and longitudinal Aβ and tau PET scans acquired in several studies between 2010 and 2024 can be processed, harmonized, and directly merged across tracers and cohorts. DISCUSSION The B‐PIP developed in ADNI is a scalable image harmonization approach used in several observational studies and clinical trials that facilitates rigorous Aβ and tau PET quantification and data sharing. Highlights Quantitative results from ADNI Aβ and tau PET data are generated using a rigorous, scalable image processing pipeline This pipeline has been applied to PET data from several other large, multisite studies and trials Quantitative outcomes are harmonizable across studies and are shared with the scientific community
The European Organization for Research and Treatment of Cancer (EORTC) Quality of Life Questionnaire Core 30 Physical Functioning subscale is a widely used patient-reported outcome measure that quantifies cancer patients' physical functioning. Strong floor/ceiling effects can affect a scale's sensitivity to change. The aim of this study was to characterize floor/ceiling effects of the physical functioning domain in patients with advanced/metastatic breast cancer enrolled in commercial clinical trials and a community-based trial. The clinical trial cohort comprised patients from 5 registrational trials submitted to the Food and Drug Administration for review (2010-2017). The community cohort comprised a subgroup of patients from the Alliance Patient Reported Outcomes to Enhance Cancer Treatment (PRO-TECT) trial. The distribution of patient responses to Physical Functioning items and the summed score were assessed at the baseline and 3-month follow-up for both cohorts. Descriptive statistics were used to determine floor/ceiling effects at the item and scale levels. The clinical trial cohort and the community cohort consisted of 2407 and 178 patients, respectively. Twenty-four percent or more of the respondents reported “not at all” for having trouble/needing help with each Physical Functioning item across both cohorts and measurement time points. Fourteen to twenty percent of the patients scored perfectly (100 of 100) on the Physical Functioning subscale summary measure (where higher scores indicated better physical functioning) across both cohorts and time points. Minor floor effects and notable ceiling effects were found at the item and scale levels of the Physical Functioning subscale, regardless of cohort, and this creates some uncertainty about its ability to detect changes in physical functioning among high-functioning patients. In conclusion, investigators may consider adding additional high-functioning items from the EORTC's item library to more accurately describe the impact of anticancer treatment on patients' physical functioning.
Aims To prospectively evaluate the incidence of myocardial injury after the administration of the fourth dose BNT162b2 mRNA vaccine (Pfizer‐BioNTech) against COVID‐19. Methods and results Health care workers who received the BNT162b2 vaccine during the fourth dose campaign had blood samples collected for high‐sensitivity cardiac troponin (hs‐cTn) during vaccine administration and 2–4 days afterward. Vaccine‐related myocardial injury was defined as hs‐cTn elevation above the 99th percentile upper reference limit and >50% increase from baseline measurement. Participants with evidence of myocardial injury underwent assessment for possible myocarditis. Of 324 participants, 192 (59.2%) were female and the mean age was 51.8 ± 15.0 years. Twenty‐one (6.5%) participants had prior COVID‐19 infection, the mean number of prior vaccine doses was 2.9 ± 0.4, and the median time from the last dose was 147 (142–157) days. Reported vaccine‐related adverse reactions included local pain at injection site in 57 (17.59%), fatigue in 39 (12.04%), myalgia in 32 (9.88%), sore throat in 21 (6.48%), headache in 18 (5.5%), fever ≥38°C in 16 (4.94%), chest pain in 12 (3.7%), palpitations in 7 (2.16%), and shortness of breath in one (0.3%) participant. Vaccine‐related myocardial injury was demonstrated in two (0.62%) participants, one had mild symptoms and one was asymptomatic; both had a normal electrocardiogram and echocardiography. Conclusion In a prospective investigation, an increase in serum troponin levels was documented among 0.62% of healthy health care workers receiving the fourth dose BNT162b2 vaccine. The two cases had mild or no symptoms and no clinical sequela. Clinical Trial Registration: ClinicalTrials.gov Identifier: NCT05308680.
Abstract For over a century, neuroscientists have been working toward parcellating the human cortex into distinct neurobiological regions. Modern technologies offer many parcellation methods for healthy cortices acquired through magnetic resonance imaging. However, these methods are suboptimal for personalized neurosurgical application given that pathology and resection distort the cerebrum. We sought to overcome this problem by developing a novel connectivity‐based parcellation approach that can be applied at the single‐subject level. Utilizing normative diffusion data, we first developed a machine‐learning (ML) classifier to learn the typical structural connectivity patterns of healthy subjects. Specifically, the Glasser HCP atlas was utilized as a prior to calculate the streamline connectivity between each voxel and each parcel of the atlas. Using the resultant feature vector, we determined the parcel identity of each voxel in neurosurgical patients ( n = 40) and thereby iteratively adjusted the prior. This approach enabled us to create patient‐specific maps independent of brain shape and pathological distortion. The supervised ML classifier re‐parcellated an average of 2.65% of cortical voxels across a healthy dataset ( n = 178) and an average of 5.5% in neurosurgical patients. Our patient dataset consisted of subjects with supratentorial infiltrating gliomas operated on by the senior author who then assessed the validity and practical utility of the re‐parcellated diffusion data. We demonstrate a rapid and effective ML parcellation approach to parcellation of the human cortex during anatomical distortion. Our approach overcomes limitations of indiscriminately applying atlas‐based registration from healthy subjects by employing a voxel‐wise connectivity approach based on individual data.
The 5th Aquatic Ecosystem MOdeling Network—Junior (AEMON-J) “Hacking Limnology” Workshop and 6th Virtual Summit: Incorporating Data Science and Open Science in the Aquatic Sciences (DSOS) convened 21–25 July 2025. As in previous years (Fig. 1; Meyer and Zwart 2020; Meyer et al. 2021b, 2021c, 2022, 2024), the virtual workshops and summit were free of charge, the content was formatted to allow for broad engagement from a globally distributed audience, and workshop materials and recordings were made available on the AEMON-J/DSOS archive (Meyer et al. 2021a). In contrast to previous years, which primarily focused on inland aquatic ecosystems, this year's workshops and summit showcased a notable plurality of ecosystem types, with workshops spanning marine, riverine, and lacustrine environments. The weeklong event brought together researchers and practitioners interested in the nexus of data science, open science, and the aquatic sciences, hosting between 47 and 65 attendees at a single time and a higher number of registrants (n = 389), who might opt to access the material asynchronously.
Abstract We present a machine learning workflow to discover signatures in acoustic measurements that can be utilized to create a low-dimensional model to accurately predict the location of keyhole pores formed during additive manufacturing processes. Acoustic measurements were sampled at 100 kHz during single-layer laser powder bed fusion (LPBF) experiments, and spatio-temporal registration of pore locations was obtained from post-build radiography. Power spectral density (PSD) estimates of the acoustic data were then decomposed using non-negative matrix factorization with custom $$\varvec{k}$$ k -means clustering (NMF $$\varvec{k}$$ k ) to learn the underlying spectral patterns associated with pore formation. NMF $$\varvec{k}$$ k returned a library of basis signals and matching coefficients to blindly construct a feature space based on the PSD estimates in an optimized fashion. Moreover, the NMF $$\varvec{k}$$ k decomposition led to the development of computationally inexpensive machine learning models which are capable of quickly and accurately identifying pore formation with classification accuracy of supervised and unsupervised label learning greater than 95% and 90%, respectively. The intrinsic data compression of NMF k , the relatively light computational cost of the machine learning workflow, and the high classification accuracy makes the proposed workflow an attractive candidate for edge computing toward in-situ keyhole pore prediction in LPBF.
The development of high-speed volumetric laser-induced fluorescence measurements of formaldehyde (CH 2 O-LIF) using a pulse-burst laser operated at a repetition rate of 100 kHz is presented here. A novel laser scanning system employing an acousto-optic deflector (AOD) enables quasi-4D CH 2 O-LIF imaging at a scan frequency of 10 kHz. The diagnostic capability of time-resolved volumetric imaging is demonstrated in a partially premixed DME/air lifted turbulent jet flame near the flame base. Simultaneous imaging of laser beam profiles is performed to account for the laser pulse energy fluctuation and laser sheet inhomogeneity. With the accurate registration of laser sheet positions, the volumetric reconstruction of CH 2 O-LIF signals is performed within a detection volume of 17.3 × 11.9 × 2.3 mm 3 with an average out-of-plane spatial resolution of 250μm. A surface detection algorithm with adaptive thresholding is used to determine the global maximum intensity gradient by calculating gradient percentiles. The flame topology characteristics are investigated by evaluating the 3D curvatures of CH 2 O surfaces. Curvatures calculated using 2D data systematically underestimate the full 3D curvature due to the lack of out-of-plane information. The inner surfaces near the turbulent fuel jet exhibit higher probabilities of large mean curvature than the outer surfaces. The saddle and cylindrical structures are dominant on both the inner and outer surfaces and the elliptic structures occur with lower probability. The results suggest that the damping of turbulent fluctuations by the temperature increase through the CH 2 O region reduces the curvature, but the local structure topology remains self-similar.
Systematic fault detection and control during laser powder bed fusion (L-PBF) has been a long-standing objective for system manufacturers and researchers in the additive manufacturing (AM) industry. This manuscript investigates a data fusion approach for detection of keyhole porosity formation during laser irradiation of Ti-6Al-4V substrates by concurrent recording of thermally induced optical emission measured using both off-axis and coaxial photodiode sensors, and acoustic emission. Subsurface defect formation was monitored via high-speed synchrotron X-ray imaging at 20,000 frames per second, enabling temporal registration of keyhole pore formation events to the monitoring signals at a resolution of 50 µs. We developed data fusion machine learning (ML) models for localized prediction of keyhole pore formation at various time scales ranging from 0.5 ms to 2 ms. The signal segments were featurized using two independent approaches: (1) power spectral density (PSD) and (2) highly comparative time series analysis (HCTSA) framework. The extracted features from different sensor modalities were fused together to construct a multimodal feature space and sequential feature selection was used to determine the most informative features for training the ML models. The predictive performance was evaluated for three classifying algorithms: Support Vector Machine (SVM), K-Nearest Neighbor (KNN), and Gaussian Naive Bayes (GNB). As a result, pore formation events were predicted with up to 0.95 F1-score, 1.0 recall and 0.94 accuracy. The most heavily weighted features indicate that model performance is chiefly governed by the acoustic monitoring signal, with a secondary contribution from the optical emission sensors.
A machine learning based image processing workflow is presented to enhance shale source rock microscopic images obtained using diverse imaging platforms. Images were acquired from a 30 μm diameter cylindrical Vaca Muerta shale sample using both nondestructive Transmission X-Ray Microscopy (TXM, alternately referred to as nano computed tomography) and destructive Focused Ion Beam-Scanning Electron Microscopy (FIB-SEM). Output cross-sectional images from each modality were aligned using a combination of manual and automated registration techniques to create a registered image dataset. We then apply this dataset for two image processing tasks: prediction of image cross sections with SEM-like resolution from nondestructive TXM data and repair of charged region artifacts (localized accumulation of electrons) within SEM images. The image processing algorithms for both tasks use deep learning models, specifically image-to-image Convolutional Neural Networks (CNNs) and conditional Generative Adversarial Networks (cGANs). In the image enhancement tasks, we are able to achieve significant qualitative and quantitative improvement in TXM images. Here, the best model reaches an average Peak Signal to Noise Ratio (PSNR) of 15.8 dB. Conditioning on TXM data is also shown to reduce artifacts from SEM charging, achieving an average PSNR of 25.8 dB. Furthermore, our results suggest that properly trained and validated networks are capable of significant enhancement of images obtained using nondestructive techniques, thereby improving interpretation of two- and three-dimensional images while preserving samples for future use.
Data sharing benefits the researcher, the scientific community, and the public by allowing the impact of data to be generalized beyond one project and by making science more transparent. However, many scientific communities have not developed protocols or standards for publishing, citing, and versioning datasets. One community that lags in data management is that of low-temperature geochemistry (LTG). This paper resulted from an initiative from 2018 through 2020 to convene LTG and data scientists in the U.S. to strategize future management of LTG data. Through webinars, a workshop, a preprint, a townhall, and a community survey, the group of U.S. scientists discussed the landscape of data management for LTG – the data-scape. Currently this data-scape includes a “street bazaar” of data repositories. This was deemed appropriate in the same way that LTG scientists publish articles in many journals. The variety of data repositories and journals reflect that LTG scientists target many different scientific questions, produce data with extremely different structures and volumes, and utilize copious and complex metadata. Nonetheless, the group agreed that publication of LTG science must be accompanied by sharing of data in publicly accessible repositories, and, for sample-based data, registration of samples with globally unique persistent identifiers. LTG scientists should use certified data repositories that are either highly structured databases designed for specialized types of data, or unstructured generalized data systems. Recognizing the need for tools to enable search and cross-referencing across the proliferating data repositories, the group proposed that the overall data informatics paradigm in LTG should shift from “build data repository, data will come” to “publish data online, cybertools will find”. Funding agencies could also provide portals for LTG scientists to register funded projects and datasets, and forge approaches that cross national boundaries. Finally, the needed transformation of the LTG data culture requires emphasis in student education on science and management of data.
The concrete microstructure was successfully reconstructed using the complementarity of X-ray and neutron computed tomography (CT). Neither tomogram alone was found to be suitable to properly describe the microstructure of concrete under this study. However, by merging the information revealed by the two modalities, and using image segmentation, noise reduction, and image registration techniques we reconstruct the concrete microstructure. Void, aggregate, and cement paste phases are successfully captured down to the images' spatial resolution, even though the aggregate consists of multiple minerals. The coarse-aggregate volume fraction of the reconstructed microstructure was similar to that of the mixing proportions. Furthermore, image-based finite element analysis is performed to demonstrate the effects of microstructure on stress concentration and strain localization.
Soil organic matter (OM) formation and persistence is strongly influenced by the spatial distribution of organic substrates and microscale soil heterogeneity by dictating OM accessibility to microorganisms. However, traditional size and/or density fractionation techniques disrupt aggregate architecture, eliminating spatial information needed to fully understand intra-aggregate OM distribution. To quantify three-dimensional OM spatial distribution and automate segmentation in X-ray microcomputed tomography (µCT) imaging without human annotation bias, we developed an iodine gas vapor (I2) based staining workflow that eliminates labor-intensive manual annotation while maintaining segmentation accuracy, using aggregates from four taxonomically diverse soils (Xerofluvent, Haploxeroll Sphagnofibrist, Palehumult) with an 8-fold range of soil organic carbon. Human annotation of 10 µCT slices by the experienced and inexperienced annotators resulted in variations up to 3% in the Dice similarity coefficient (DSC), reflecting a degree of inherent subjectivity of manual labeling. Such inconsistencies are expected to compound as the number of manually annotated slices increases. Dual-energy µCT imaging at 33.1 keV (below the iodine (I) K-edge) and 33.2 keV (above the I K-edge) was used to resolve aggregate microstructure following I2 staining. The automated image subtraction pipeline identified OM regions by the I Kedge induced brightness increases, achieving DSC values of 0.58–0.83 relative to an experienced annotator. Sensitivity analyses revealed that the reconstruction alpha value—optimized via the open-source tool TomocuPy—and the 3D registration slice count were the primary determinants of accuracy, providing a novel benchmark for dual-energy soil imaging. The pipeline without GPU acceleration achieved 9.6 to 43.2 times faster than manual annotation. Using GPU-accelerated image post-processing and affine transformation matrices, the pipeline successfully segmented OM elements for large-scale datasets (3232×3232 pixel, 2048 slices) within ~5200 s from raw file acquisition to segmented output. The high-throughput approach enables the quantification of OM spatial distribution across diverse and heterogeneous soil.
The integration of adaptive radiation therapy (ART), or modifying the treatment plan during the treatment course, is becoming more widely available in clinical practice. ART offers strong potential for minimizing treatment-related toxicity while escalating or de-escalating target doses based on the dose to organs at risk. Yet, ART workflows add complexity into the radiation therapy planning and delivery process that may introduce additional uncertainties. This work sought to review presently available ART workflows and technological considerations such as image quality, deformable image registration, and dose accumulation. Quality assurance considerations for ART components and minimum recommendations are described. Personnel and workflow efficiency recommendations are provided, as is a summary of currently available clinical evidence supporting the implementation of ART. Finally, to guide future clinical trial protocols, an example ART physician directive and a physics template following standard NRG Oncology protocol is provided.
We developed a new data-driven gated (DDG) positron emission tomography (PET)/computed tomography (CT) to improve the registration of CT and DDG PET.
This prospective study is, to our knowledge, the first report of daily adaptive radiation therapy (ART) for head and neck cancer (HNC) using a 1.5T magnetic resonance imaging-linear accelerator (MR-linac) with particular focus on safety and feasibility and dosimetric results of an online rigid registration-based adapt to position (ATP) workflow.
We estimate the effects of transportation network companies (TNCs) Uber and Lyft on vehicle ownership, fleet average fuel economy, and transit use in U.S. urban areas using a set of difference-in-difference propensity score-weighted regression models that exploit staggered market entry across the U.S. from 2011 to 2017. We find evidence that TNC entry into urban areas causes an average 0.7% increase in vehicle registrations with significant heterogeneity in these effects across urban areas: TNC entry produces larger vehicle ownership increases in urban areas with higher initial ownership (car-dependent cities) and in urban areas with lower population growth (where TNC-induced vehicle adoption outpaces population growth). We also find no statistically significant average effect of TNC entry on fuel economy or transit use but find evidence of heterogeneity in these effects across urban areas, including larger transit ridership reductions after TNC entry in areas with higher income and more childless households.