Engineering PapersSearch

SEARCH · Engineering Papers

Results for “SSL”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

Leveraging unlabeled SEM datasets with self-supervised learning for enhanced particle segmentation

Scanning Electron Microscopes (SEMs) are widely used in experimental science laboratories, often requiring cumbersome and repetitive user analysis. Automating SEM image analysis processes is highly desirable to address this challenge. In particle sample analysis, Machine Learning (ML) has emerged as the most effective approach for particle segmentation. However, the time-intensive process of manually annotating thousands of SEM images limits the applicability of supervised learning approaches. Self-Supervised Learning (SSL) offers a promising alternative by enabling knowledge extraction from raw, unlabeled data. This study presents a framework for evaluating SSL techniques in SEM image analysis, focusing on novel methods leveraging the ConvNeXtV2 architecture for particle detection. A dataset comprising 25,000 SEM images is curated to benchmark these proposed SSL methods. The results demonstrate that ConvNeXtV2 models, with varying parameter counts, consistently outperform other techniques in particle detection across different length scales, achieving up to a 34% reduction in relative error compared to established SSL methods. Furthermore, an ablation study explores the relationship between dataset size and SSL performance, providing actionable insights for practitioners regarding model selection and resource efficiency. This research advances the integration of SSL into autonomous analysis pipelines and supports its application in accelerating materials science discovery.

Rettenberger, Luca

Resimulation-based self-supervised learning for pretraining physics foundation models

Self-supervised learning (SSL) is at the core of training modern large machine learning models, providing a scheme for learning powerful representations that can be used in a variety of downstream tasks. However, SSL strategies must be adapted to the type of training data and downstream tasks required. We propose resimulation-based self-supervised representation learning (RS3L), a novel simulation-based SSL strategy that employs a method of resimulation to drive data augmentation for contrastive learning in the physical sciences, particularly, in fields that rely on stochastic simulators. By intervening in the middle of the simulation process and rerunning simulation components downstream of the intervention, we generate multiple realizations of an event, thus producing a set of augmentations covering all physics-driven variations available in the simulator. Using experiments from high-energy physics, we explore how this strategy may enable the development of a foundation model; we show how RS3L pretraining enables powerful performance in downstream tasks such as discrimination of a variety of objects and uncertainty mitigation. In addition to our results, we make the RS3L dataset publicly available for further studies on how to improve SSL strategies.

97 MATHEMATICS AND COMPUTING

Observation of the spiral spin liquid in a triangular-lattice material

The spiral spin liquid (SSL) is a highly degenerate state characterized by a continuous contour or surface in reciprocal space spanned by a spiral propagation vector. Although the SSL state has been predicted in a number of various theoretical models, very few materials are so far experimentally identified to host such a state. Via combined single-crystal wide-angle and small-angle neutron scattering, we report observation of the SSL in the quasi-two-dimensional delafossite-like AgCrSe 2 . We show that it is a very close realization of the ideal Heisenberg J 1 –J 2 –J 3 frustrated model on the triangular lattice. By supplementing our experimental results with microscopic spin-dynamics simulations, we demonstrate how such exotic magnetic states are driven by thermal fluctuations and exchange frustration.

36 MATERIALS SCIENCE

Observation of Unprecedented Fractional Magnetization Plateaus in a New Shastry-Sutherland Ising Compound

Geometrically frustrated magnetic systems, such as those based on the Shastry-Sutherland lattice (SSL), offer a rich playground for exploring unconventional magnetic states. The delicate balance between competing interactions in these systems leads to the emergence of novel phases. We present the characterization of Er 2 ⁢Be 2⁢ GeO 7 , an SSL compound with Er 3+ ions forming orthogonal dimers separated by nonmagnetic layers whose structure is invariant under the 𝑃⁢$\bar{4}21$⁢𝑚 space group. Neutron scattering reveals an antiferromagnetic dimer structure at zero field, typical of Ising spins on that lattice and consistent with the anisotropic magnetization observed. However, magnetization measurements exhibit fractional plateaus at 1/4 and 1/2 of saturation, in contrast to the expected 1/3 plateau of the SSL Ising model. By comparing the energy of candidate states with ground-state lower bounds we show that this behavior requires spatially anisotropic interactions, leading to an anisotropic Shastry-Sutherland Ising model symmetric under the 𝐶⁢𝑚⁢𝑚⁢2 space group. This anisotropy is consistent with the small orthorhombic distortion observed with single-crystal neutron diffraction. The other properties, including thermodynamics, which have been investigated theoretically using tensor networks, point to small residual interactions, potentially due to further couplings and quantum fluctuations. This study highlights Er 2 ⁢Be 2 ⁢GeO 7 as a promising platform for investigating exotic magnetic phenomena.

Yadav, Lalit [Duke University, Durham, NC (United

Advanced Semi-Supervised Learning with Uncertainty Estimation for Phase Identification in Distribution Systems

The integration of advanced metering infrastructure (AMI) into power distribution networks generates valuable data for tasks such as phase identification; however, the limited and unreliable availability of labeled data in the form of customer phase connectivity presents challenges. To address this issue, we propose a semi-supervised learning (SSL) framework that effectively leverages labeled and unlabeled data. Our approach incorporates self-training, label spreading, and Bayesian neural networks (BNNs) to enhance phase identification with AMI data. Our method uses an ensemble of multilayer perceptron classifiers in a self-training setup, iteratively adding high-confidence pseudo-labels to improve robustness. We also apply label spread to propagate labels based on data similarity, which enhances generalization across diverse distributions. In addition, we employ a BNNs with uncertainty estimation, boosting confidence in predictions and reducing phase identification errors. In our case study, we achieved approximately 98% +/- 0.08 accuracy with uncertainty using minimal and unreliable labeled data from a real U.S. utility, Duquesne Light Company. Our SSL approach, combined with uncertainty estimation, provides an efficient solution for phase identification in AMI data, ultimately improving the reliability of smart grid applications.

24 POWER TRANSMISSION AND DISTRIBUTION

Advanced Semi-Supervised Learning With Uncertainty Estimation for Phase Identification in Distribution Systems

The integration of advanced metering infrastructure (AMI) into power distribution networks generates valuable data for tasks such as phase identification; however, the limited and unreliable availability of labeled data in the form of customer phase connectivity presents challenges. To address this issue, we propose a semi-supervised learning (SSL) framework that effectively leverages labeled and unlabeled data. Our approach incorporates self-training, label spreading, and Bayesian neural networks (BNNs) to enhance phase identification with AMI data. Our method uses an ensemble of multilayer perceptron classifiers in a self-training setup, iteratively adding high-confidence pseudo-labels to improve robustness. We also apply label spread to propagate labels based on data similarity, which enhances generalization across diverse distributions. In addition, we employ a BNNs with uncertainty estimation, boosting confidence in predictions and reducing phase identification errors. In our case study, we achieved approximately 98% +/- 0.08 accuracy with uncertainty using minimal and unreliable labeled data from a real U.S. utility, Duquesne Light Company. Our SSL approach, combined with uncertainty estimation, provides an efficient solution for phase identification in AMI data, ultimately improving the reliability of smart grid applications.

24 POWER TRANSMISSION AND DISTRIBUTION

Particle trajectory representation learning with masked point modeling

Liquid argon time projection chambers (LArTPCs) offer millimeter-scale 3D images of particle trajectories, enabling precision studies of neutrino oscillation, detection of supernova and solar neutrinos, searches for exotic dark matter, and proton decay. Current approaches utilize supervised machine learning models, requiring extensive simulations of particle physics and detector response that can introduce bias. Self-supervised learning (SSL), a machine learning approach that learns useful representations of unlabeled data from the data itself, has significantly advanced how large datasets are utilized for representation learning; however, its potential for applications to sensory data in high precision particle physics experiments remains largely unexplored. We introduce the Point-based liquid argon masked autoencoder (PoLAr-MAE), a self-supervised framework that learns physically meaningful representations directly from unlabeled LArTPC images. PoLAr-MAE achieves remarkable data efficiency for a point-level segmentation task, outperforming fully supervised methods in low data regimes. Linear classifiers on model outputs demonstrate robust performance across multiple downstream tasks. Our results position sensor-level SSL as a practical foundation model strategy for LArTPCs.

Young, Samuel [Stanford Univ., CA (United States)]

Tunable broadband luminescence in lead-free hybrid copper halides

Metal halides are an important class of optoelectronic materials combining exceptional optical and electronic properties. An inherent advantage of metal halides is their solution synthesis and processability, which render them as low-cost and environmentally friendly materials for a range of applications from photovoltaics and photodetection to solid-state lighting (SSL). Here, in this study, we synthesized three previously unreported lead-free organic–inorganic hybrid copper halides: (OA) 4 CuX 5 (X = Br, I; OA + = C 8 H 17 NH 3+ , n-octylammonium cation) and (HA) 2 CuI 3 (HA + = C 6 H 13 NH 3 + , n-hexylammonium cation), all of which exhibit broadband emissions arising from self-trapped excitons (STEs). Among these compounds, (OA) 4 CuI 5 demonstrates tunable dual-band white-light emission with a high color rendering index value of 91 at room temperature. Temperature-dependent photoluminescence measurements and first-principles calculations reveal distinct behaviors between the two emission states in (OA) 4 CuI 5 . These findings highlight the potential of copper halide compounds for optoelectronic applications, particularly in the development of environmentally friendly solid-state lighting technologies.

36 MATERIALS SCIENCE

Constrained GAN-Generated X-Ray CT Data For Self-Supervised And Foundation-Model Segmentation Of Concrete Microstructures

Three-dimensional characterization of materials using X-ray computed tomography (XCT) is challenging due to the complexity of internal structures, noise, and variations in resolution. Traditional computer vision models often struggle to accurately segment these images, particularly in domain-specific applications like materials science. While supervised deep learning approaches have been developed to address the limitations of conventional algorithms, they typically require large amounts of labeled training data and often fail to generalize across different datasets. Self-supervised, few-and zero-shot learning methods have gained prominence in natural image processing and segmentation tasks, but their application to scientific imaging remains limited due to the unique structural complexity, noise, and textural artifacts present in materials science data. In this work, we investigate how domain adaptation, leveraging physics-based and GAN-generated synthetic data, impacts segmentation performance. We introduce a modified Contrastive Unpaired Translation (CUT) model designed to generate realistic labeled data, which can be used for training, pre-training, and fine-tuning segmentation models for real XCT microstructure data. We evaluate the performance of two segmentation approaches: a self-supervised network (SSL-ALPNet) and a foundation model (Segment Anything Model), assessing their improvements when pre-trained and/or fine-tuned on the synthesized data. Our results demonstrate that leveraging synthetic data significantly enhances segmentation performance, particularly in challenging materials science applications.

Ziabari, Amir [ORNL] (ORCID:000000034776457X)

Vision Foundation Models in Remote Sensing: A survey

Artificial intelligence (AI) technologies have profoundly transformed the field of remote sensing (RS), revolutionizing data collection, processing, and analysis. Traditionally reliant on manual interpretation and task-specific models, RS research has been significantly enhanced by the advent of foundation models (FMs)—large-scale pretrained AI models capable of performing a wide array of tasks with unprecedented accuracy and efficiency. This article provides a comprehensive survey of FMs in the RS domain. We categorize these models based on their architectures, pretraining datasets, and methodologies. Through detailed performance comparisons, we highlight emerging trends and the significant advancements achieved by those FMs. Additionally, we discuss technical challenges, practical implications, and future research directions, addressing the need for high-quality data, computational resources, and improved model generalization. Our research also finds that pretraining methods, particularly self-supervised learning (SSL) techniques like contrastive learning (CL) and masked autoencoders (MAEs), remarkably enhance the performance and robustness of FMs. This survey aims to serve as a resource for researchers and practitioners by providing a panorama of advances and promising pathways for the continued development and application of FMs in RS.

data models

Estimating Sparse Direct Effects in Multivariate Regression With the Spike-and-Slab LASSO

The multivariate regression interpretation of the Gaussian chain graph model simultaneously parametrizes (i) the direct effects of p predictors on q outcomes and (ii) the residual partial covariances between pairs of outcomes. We introduce a new method for fitting sparse versions of these models with spike-and-slab LASSO (SSL) priors. We develop an Expectation Conditional Maximization algorithm to obtain sparse estimates of the p × q matrix of direct effects and the q × q residual precision matrix. Our algorithm iteratively solves a sequence of penalized maximum likelihood problems with self-adaptive penalties that gradually filter out negligible regression coefficients and partial covariances. Because it adaptively penalizes individual model parameters, our method is seen to outperform fixed-penalty competitors on simulated data. We establish the posterior contraction rate for our model, buttressing our method’s excellent empirical performance with strong theoretical guarantees. Using our method, we estimated the direct effects of diet and residence type on the composition of the gut microbiome of elderly adults.

EM algorithm

Cadmium-Free QD Building Blocks for Human Centric Lighting

This project developed Cd-free quantum dot (QD) downconverters for efficacious human-centric lighting (HCL) light emitting diode (LED) devices. Solid state HCL devices address the lack of light in the cyan wavelength region (460-490 nm) in white LEDs by enhancing the melanopic daylight efficacy ratio (MDER) value. MDER is a metric that indicates the degree to which artificial lighting stimulates nonvisual biological processes in the retina responsible for regulating circadian rhythms compared with natural lighting. The peak sensitivity of melanopsin in the retina is at 479 nm, therefore artificial lighting which can fill the well-known “cyan gap” may improve human health. Due to the Restriction of Hazardous Substances (RoHS) regulations, cadmium-free core/shell/shell QDs are the primary targets for low toxicity, tunable downconverters. Cyan- and red-emitting core/shell/shell QDs were implemented in LED devices toward achieving a brightness of 210 lm/W at 4000 K, CRI 90, and MDER > 0.7. Synthetic development of Cd-free materials yielded cyan InP/ZnS QDs with a photoluminescence quantum yield (PLQY) of ~60% between 480-490 nm, and red InP/ZnSe/(ZnSeS)/ZnS QDs reaching ~80% PLQY at 620-630 nm. We successfully demonstrated that the inclusion of cyan QDs increased the MDER value to ≥0.7, but the brightness of the HCL LED devices was hindered due to low PLQY values. However, upon substitution of the Cd-free cyan QD with a low-Cd QD with >90% PLQY, brightness improved by 25% over the Cd-free device to 179 lm/W. Despite the technical obstacles remaining toward improving emission characteristics and stability of QDs under high flux, we have confirmed the promise of narrow, tunable QD emitters in SSL packages toward the goal of healthy, human-centric lighting.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI

VA EDH Advanced Software Pipeline Framework Report: Enhancing Automation and Scalability

The VA Environmental Determinants of Health (EDH) Advanced Software Pipeline Framework is designed to enhance the efficiency, scalability, and security of geospatial data processing workflows. This framework integrates modern data orchestration and containerization technologies, including Prefect for workflow automation, Docker for containerization, and PostgreSQL/PostGIS for geospatial data storage and analysis. It ensures standardized, reproducible, and automated data processing, supporting VA objectives related to substance use risk assessment and recovery research. The pipeline addresses key scalability and performance challenges through horizontal and vertical scaling, high-performance computing (HPC) integration, parallel processing, task caching, and dynamic resource allocation. These optimizations improve throughput and reduce latency, allowing the system to efficiently manage large and complex datasets. Additionally, security and compliance measures—such as data encryption (SSL), Role-Based Access Control (RBAC), and adherence to GDPR and HIPAA standards—safeguard sensitive information throughout data transmission and storage. A key implementation of this framework includes the automation of shelter list geolocation workflows, ensuring that up-to-date data is readily available for VA decision-making. Lessons learned from this project include the transition from in-memory processing to incremental storage writes, improving resource management and reliability. Future enhancements aim to expand automation, integrate AI-driven anomaly detection, and incorporate high-performance computing resources. This framework provides a scalable, secure, and adaptable solution for managing geospatial datasets, reinforcing the VA’s ability to support clinical and strategic initiatives through data-driven decision-making.

97 MATHEMATICS AND COMPUTING

Why Tunable? A Look at Schools Using Tunable Lighting

Between 2016-2019, Pacific Northwest National Laboratory (PNNL), documented two early pilot installations of tunable lighting in schools, supported by U.S. Department of Energy (DOE) Solid-State Lighting (SSL) program. These pilot installations were opportunities for the schools to become more familiar with the technology, save energy, and support teachers and students. Tunable lighting continues to be of interest, particularly in classrooms for students with disabilities. This case study looks at tunable lighting systems installed in classrooms at eight school districts across the U.S. since 2015, the earliest known installation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI

A Semi-Supervised Learning Method for the Identification of Bad Exposures in Large Imaging Surveys

As the data volume of astronomical imaging surveys rapidly increases, traditional methods for image anomaly detection, such as visual inspection by human experts, are becoming impractical. We introduce a machine-learning-based approach to detect poor-quality exposures in large imaging surveys, with a focus on the DECam Legacy Survey (DECaLS) in regions of low extinction (i.e., E ( B − V ) < 0.04 ). Our semi-supervised pipeline integrates a vision transformer (ViT), trained via self-supervised learning (SSL), with a k-Nearest Neighbor (kNN) classifier. We train and validate our pipeline using a small set of labeled exposures observed by surveys with the Dark Energy Camera (DECam). A clustering-space analysis of where our pipeline places images labeled in good and bad categories suggests that our approach can efficiently and accurately determine the quality of exposures. Applied to new imaging being reduced for DECaLS Data Release 11, our pipeline identifies 780 problematic exposures, which we subsequently verify through visual inspection. Being highly efficient and adaptable, our method offers a scalable solution for quality control in other large imaging surveys.

Luo, Yufeng (ORCID:0000000246230683)