Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Vision transformers”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Controlling Selectivity in Plasmonic Catalysis: Switching Reaction Pathway from Hydrogenation to Homocoupling Under Visible–Light Irradiation

Plasmonic catalysis enables the use of light to accelerate molecular transformations. Its application to the control reaction selectivity is highly attractive but remains challenging. Here, we have found that the plasmonic properties in AgPd nanoparticles allowed different reaction pathways for tunable product formation under visible-light irradiation. By employing the hydrogenation of phenylacetylene as a model transformation, we demonstrate that visible-light irradiation can be employed to steer the reaction pathway from hydrogenation to homocoupling. Our data showed that the decrease in the concentration of H species at the surface due to plasmon-enhanced H2 desorption led to the control in selectivity. Furthermore, these results provide important insights into the understanding of reaction selectivity with light, paving the way for the application of plasmonic catalysis to the synthesis of 1,3-diynes, and bringing the vision of light-driven transformations with target selectivity one step closer to reality.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Addressing Human and Organizational Factors in Nuclear Industry Modernization: An Operationally Focused Approach to Process and Methodology

Utility owners and operators of commercial nuclear power plants in the United States (U.S.) are and will be modernizing their nuclear power plants by performing a digital transformation involving design of an integrated set of systems that together enable a technology centric operating plant. The Plant Modernization Pathway of the U.S. Department of Energy Light Water Reactor Sustainability Program has a strategic action plan that lays the groundwork for a digital transformation of the nuclear industry. The model for this transformation is an advanced concept of operations, with an end point vision, “To achieve the maximum aggregate benefit enabled by this digital transformation.” To achieve this, the digital infrastructure for a nuclear plant must be designed as an integrated set of systems that together enable a technology centric operating model. The digital transformation process obviously needs to involve technology considerations and systems engineering, but it also needs to include human and organizational expertise. Thus, human and organizational factors, including sociotechnical systems methods and techniques (e.g., Cognitive Systems Engineering, Systems Theoretic Accident Modeling and Processes, human systems integration, and Macroergonomics) need to be considered for digital transformation projects in order to effectively integrate human and organizational expertise efforts into the new work system that results from nuclear power plant digital modernization. That is, the work system is the basic unit of sociotechnical systems analysis and contains three components: personnel, technical, and organization and management. These components should be jointly optimized with respect to the interdependence of systems performance criteria of effectiveness, efficiency and safety. Joint optimization can be achieved through the application of three human and organization functions: knowledge representation, knowledge elicitation, and cross-functional integration. This report provides a strategic framework for effective integration of human and organizational expertise within nuclear power plant digital modernization efforts.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Building Neutron Scattering Infrastructure in Louisiana for Advanced Materials (Final Report)

The main objective of the Louisiana Consortium for Neutron Scattering (LaCNS) is to build a major neutron scattering infrastructure capable of treating both soft and hard materials. The goal is to create a sustainable effort having the quality, breadth, and depth necessary to produce competitive proposals including collaborative and center type proposals. Our scientific aim is to understand the role of coupling in emergent complex materials and its impact on the structure/property relationship and to explore how to tune the key couplings to guide the design of materials with the desired properties. This naturally includes building a base of users of the Spallation Neutron Source (SNS) and the High Flux Isotope Reactor (HFIR) in Louisiana; to train highly talented graduate and post-doctoral students in synthesis, neutron scattering, and simulation and modeling techniques, thereby helping to produce the next generation of scientist who use neutron scattering techniques as a crucial part of their research. The goal of our hard matter program is to understand the interplay between spin, charge, orbital, and lattice degrees of freedom in carefully selected complex materials. We have made considerable progress on number of complex systems including the oxide Sr3(Ru1-xMnx)2O7 where short-range magnetic ordering with anisotropic spin texture is initiated at the metal-insulator transition that clearly indicates a strong spin-charge coupling. Another critical area is in quantum materials. For example, in the topological semimetal BaMnSb2, we found a 3D canted antiferromagnetic Weyl semimetal with a 2D electronic structure and a nontrivial Berry phase. In addition, in the hexagonal chiral Mn1/3NbS2 system, we found soliton/soliton and soliton/antisoliton domain walls where the application of small fields or small currents can be used to control nanoscopic magnetic domains where the control of domain walls is crucially important for information storage. In addition, chemical transformation investigations were performed on the VISION instrument at Spallation Neutron Source (SNS). The soft matter effort was focused on understanding the role of non-covalent interactions on the structure and dynamics of fluid-based soft matter. One key focus was on sequence-defined (SD) amphiphilic peptoid polymers that allow encoding of molecular interactions and thereby systematic investigations of how charge directs the solution self-assembly of amphiphilic polymers in water. Another important area was on the dynamics of lipids self-assembled into membranes for exploring the permeability and mechanical using both neutron spin echo (NSE) spectroscopy and quasielastic neutron scattering (QENS) to distinguished between viscoelasticity and permeability at the molecular scale. Overall, the LaCNS project was quite successful, generating 145 publications and 245 presentations. Our graduate and post-doctoral students were well trained resulting in positions in national laboratories (Oak Ridge National Laboratory (ORNL), Argonne National Laboratory and Los Alamos National Laboratory), major research universities, and industry. We also developed a uniaxial pressure cell along with ORNL for SNS. A critical goal of this project was to establish a foundation for competing nationally in federally funded research programs. To this end, we were quite successful in generating over twenty-two federally and non-federally funded grants including awards from NSF, DOE, and DOD, and two early career awards. Equally important, we were able to secure a key major piece of instrumentation via a large ARO grant for a state-of-the-art electron microscope.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Dynamic STEM-EELS for single-atom and defect measurement during electron beam transformations

This study introduces the integration of dynamic computer vision–enabled imaging with electron energy loss spectroscopy (EELS) in scanning transmission electron microscopy (STEM). This approach involves real-time discovery and analysis of atomic structures as they form, allowing us to observe the evolution of material properties at the atomic level, capturing transient states traditional techniques often miss. Rapid object detection and action system enhances the efficiency and accuracy of STEM-EELS by autonomously identifying and targeting only areas of interest. This machine learning (ML)–based approach differs from classical ML in that it must be executed on the fly, not using static data. We apply this technology to V-doped MoS 2 , uncovering insights into defect formation and evolution under electron beam exposure. This approach opens uncharted avenues for exploring and characterizing materials in dynamic states, offering a pathway to increase our understanding of dynamic phenomena in materials under thermal, chemical, and beam stimuli.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Catalyst-Vision (PEM Catalyst Layer Image Analysis Tool) [SWR-25-100]

Catalyst-Vision (PEM Catalyst Layer Image Analysis Tool) provides an advanced Python-based tool, primarily designed for use in a Jupyter/Colab notebook, for the quantitative morphological analysis of pre-segmented shapes. While developed for analyzing PEM catalyst layers from microscopy, its methodology is suitable for characterizing any grayscale object provided on a uniform white background. The tool uses a robust computer vision pipeline based on the Euclidean Distance Transform and skeletonization to accurately measure local thickness and tortuosity, providing a comprehensive characterization of an object's geometry and internal texture. If you find this code useful, please cite our preprint as: Chan, Ai-Lin and Hayden, Steven and Harvey, Steven P. and Smeaton, Michelle and Okrucky, Caleb and Watt, John and Ulična, Soňa and Spurgeon, Steven and Jungjohann, Katherine and Alia, Shaun, Mechanism-informed breakdown: understanding degradation by controlling voltage hold patterns in PEM water electrolyzers. Preprint (2025).

Spurgeon, Steven [National Laboratory of the Rocki↗
DOE OSTI2025

United States Muon Collider Community White Paper for the European Strategy for Particle Physics Update

This document is being submitted to the 2024-2026 European Strategy for Particle Physics Update (ESPPU) process on behalf of the US Muon Collider community, with its preparation coordinated by the interim US Muon Collider Coordination Group. The US Muon Collider Community comprises a few hundred American scientists. The purpose of the document is to inform ESPPU about the US plans for Muon Collider research and development (R&D), explain how these efforts align with the broader international R&D initiatives, and present the US community vision for the future realization of this transformative project.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Automated Assembly Progress Monitoring in Modular Construction Factories Using Computer Vision-Based Instance Segmentation

Modular construction has recently gained interest as a transformative construction method. In this method, a large portion of the construction is performed inside factories, where processes are fast-paced and interdependent; therefore, any deviation from the schedule can delay the production. Such deviations are frequent in modular factories due to the labor-intensive nature of the tasks. This propagation of delays can be mitigated by continuously monitoring each process; however, current manual monitoring methods are laborious, and recently proposed contact sensor-based methods are intrusive to the work. In addition, recent computer vision-based monitoring methods inside factories are limited to detection algorithms that fail to provide the pixel-level accuracy required for assembly progress monitoring in highly occluded factory scenes, and they require a large number of manual annotations. Therefore, this paper proposes a method to monitor the installation of subassemblies in modular construction factories using mask R-CNN instance segmentation and improves the data efficiency of the model using a copy-paste augmentation method. This method was validated on the CCTV videos captured from a modular construction factory in the US, resulting in a 9% mAP improvement in segmentation.

computer vision↗
DOE OSTI2026

Building an AI-native Research Ecosystem for Experimental Particle Physics: A Community Vision

Experimental particle physics seeks to understand the universe by probing its fundamental particles and forces and exploring how they govern the large-scale processes that shape cosmic evolution. This whitepaper presents a vision for how Artificial Intelligence (AI) can accelerate discovery in this field. We outline grand challenges that must be addressed to enable transformative breakthroughs and describe how current and planned experimental facilities can implement this vision to advance our understanding of the vast and complex physical world from the smallest to the largest scales. We show how facilities currently under construction, such as the HL-LHC, DUNE and soon EIC, can both benefit from and serve as proving grounds for this vision, while also enabling a longer-term goal for how future experiments -- like FCC-ee at CERN, IceCube-Gen2, a Muon Collider in the U.S., and smaller to mid-scale projects -- can be fully AI-native. We describe how a truly national-scale collaboration, jointly managed across large funding partners, and involving both DOE laboratories and universities, can make this happen.

Aarrestad, Thea Klaeboe [ETH, Zurich (main)]↗
DOE OSTI2024

Diffractive optical computing in free space

Abstract Structured optical materials create new computing paradigms using photons, with transformative impact on various fields, including machine learning, computer vision, imaging, telecommunications, and sensing. This Perspective sheds light on the potential of free-space optical systems based on engineered surfaces for advancing optical computing. Manipulating light in unprecedented ways, emerging structured surfaces enable all-optical implementation of various mathematical functions and machine learning tasks. Diffractive networks, in particular, bring deep-learning principles into the design and operation of free-space optical systems to create new functionalities. Metasurfaces consisting of deeply subwavelength units are achieving exotic optical responses that provide independent control over different properties of light and can bring major advances in computational throughput and data-transfer bandwidth of free-space optical processors. Unlike integrated photonics-based optoelectronic systems that demand preprocessed inputs, free-space optical processors have direct access to all the optical degrees of freedom that carry information about an input scene/object without needing digital recovery or preprocessing of information. To realize the full potential of free-space optical computing architectures, diffractive surfaces and metasurfaces need to advance symbiotically and co-evolve in their designs, 3D fabrication/integration, cascadability, and computing accuracy to serve the needs of next-generation machine vision, computational imaging, mathematical computing, and telecommunication technologies.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Barrierless nucleation in glassy precursors drives zeolite formation

Zeolites are crystalline, microporous silicates widely used in catalysis and separations, yet the molecular mechanisms of their formation remain unresolved. Experiments indicate that hydrothermal synthesis of silica zeolites from clear solution proceeds through amorphous nanoaggregates that gradually develop zeolite order in an apparently continuous amorphous to crystal transformation. Here, we combine molecular simulations with advanced algorithms that identify zeolite order and computer vision to elucidate the pathway from clear solution to zeolite nanocrystal. We show that at conditions of hydrothermal synthesis of silica zeolites, the transformation of precursor aggregate into zeolite is not limited by nucleation barriers but by the slow dynamics of reorganization in the glassy precursor matrix. The negligible nucleation barriers result in spinodal-like crystallization that leads to a gradual formation of a mosaic of small crystallites that explain the seemingly continuous character of zeolite crystallization and the catalytic activity of X-ray amorphous, protozeolites and embryonic zeolites. We find that zeolite-like porosity and short-range order emerge early within glassy precursors, well before crystallinity is detected in transmission electron microscopy (TEM) images or X-ray diffraction. The nanoaggregate’s temperature-size phase diagram reveals a convergence of the zeolite–amorphous equilibrium and maximum crystallization rate at ~3 nm diameter nanoparticle diameters and ~200 °C. This convergence signals the termination of the first-order amorphous-to-zeolite transition. Our results provide a unifying framework for understanding nucleation of silica zeolites from solution and suggest that barrierless nucleation may govern the formation of other nanoparticle systems, including minerals and oxides synthesized far below their bulk melting points.

36 MATERIALS SCIENCE↗
DOE OSTI2024

From Chaos to Clarity: Autonomous Materials Discovery for Extreme Environments [Slides]

The pursuit of advanced functional materials for energy applications demands an understanding of their behavior under the most challenging conditions. Extreme environments, characterized by intense radiation, high temperatures, and corrosive chemistries, push materials to their limits, often revealing unexpected behaviors and degradation pathways. Traditional materials research approaches, relying on trial-and-error experimentation, are often slow and resource-intensive, ill-suited to the complexities of extreme environments. This talk will explore the transformative potential of autonomous materials science in revolutionizing our understanding of materials synthesis and degradation in extreme environments. By integrating advanced microscopy techniques, artificial intelligence, and robotic experimentation, we can accelerate the discovery and design of resilient materials for a sustainable future. The presentation will highlight recent breakthroughs in autonomous microscopy, computer vision, and machine learning, showcasing their ability to unravel complex material transformations at the atomic scale. The talk will also delve into the challenges and opportunities associated with deploying autonomous systems to probe extreme environments, emphasizing the importance of robust algorithms, real-time data analysis, and adaptive experimentation. The ultimate goal is to empower scientists with unprecedented capabilities to explore, understand, and engineer materials that can withstand the harshest conditions, paving the way for innovations in energy, aerospace, and beyond.

14 SOLAR ENERGY↗
DOE OSTI2024

From Chaos to Clarity: Autonomous Materials Discovery for Extreme Environments

The pursuit of advanced functional materials for energy applications demands an understanding of their behavior under the most challenging conditions. Extreme environments, characterized by intense radiation, high temperatures, and corrosive chemistries, push materials to their limits, often revealing unexpected behaviors and degradation pathways. Traditional materials research approaches, relying on trial-and-error experimentation, are often slow and resource-intensive, ill-suited to the complexities of extreme environments. This talk will explore the transformative potential of autonomous materials science in revolutionizing our understanding of materials synthesis and degradation in extreme environments. By integrating advanced microscopy techniques, artificial intelligence, and robotic experimentation, we can accelerate the discovery and design of resilient materials for a sustainable future. The presentation will highlight recent breakthroughs in autonomous microscopy, computer vision, and machine learning, showcasing their ability to unravel complex material transformations at the atomic scale. The talk will also delve into the challenges and opportunities associated with deploying autonomous systems to probe extreme environments, emphasizing the importance of robust algorithms, real-time data analysis, and adaptive experimentation. Our ultimate goal is to empower scientists with unprecedented capabilities to explore, understand, and engineer materials that can withstand the harshest conditions, paving the way for innovations in energy, aerospace, and beyond.

artificial intelligence↗
DOE OSTI2023

The Synthescope: A Vision for Combining Synthesis with Atomic Fabrication

Here, the scanning transmission electron microscope, a workhorse instrument in materials characterization, is being transformed into an atomic-scale material-manipulation platform. With an eye on the trajectory of recent developments and the obstacles toward progress in this field, a vision for a path toward an expanded set of capabilities and applications is provided. The microscope is reconceptualized as an instrument for fabrication and synthesis with the capability to image and characterize atomic-scale structural formation as it occurs. Further development and refinement of this approach may have substantial impact on research in microelectronics, quantum information science, and catalysis, where precise control over atomic-scale structure and chemistry of a few “active sites” can have a dramatic impact on larger-scale functionality and where developing a better understanding of atomic-scale processes can help point the way to larger-scale synthesis approaches.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Interpreting and Accelerating Transformers for Jet Tagging

Attention-based transformers are ubiquitous in machine learning applications from natural language processing to computer vision. In high energy physics, one central application is to classify collimated particle showers in colliders based on the particle of origin, known as jet tagging. In this work, we study the interpretatbility and prospects for acceleration of Particle Transformer (ParT), a state-of-the-art model, leverages particle-level attention to improve jet-tagging performance. We analyzing ParT's attention maps and particle-pair correlations in the eta-phi plane, revealing intriguing features, such as a binary attention pattern that identifies critical substructure in jets. These insights enhance our understanding of the model's internal workings and learning process and hint at ways to improve its efficiency. Along these lines, we also explore low-rank attention, attention alternatives, and dynamic quantization to accelerate transformers for jet tagging. With quantization, we achieve a 50% reduction in model size and a 10% increase in inference speed without compromising accuracy. These combined efforts enhance both the performance and the interpretability of transformers in high-energy physics, opening avenues for more efficient and physics-driven model designs.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2026

Challenges and Vision for Standardization of Biopolymer Data Sets for Machine Learning

Machine learning (ML) is transforming materials research, yet potential for biopolymer discovery remains constrained by fragmented data and nonstandardized reporting. Biopolymers differ significantly from synthetic polymers, requiring specialized approaches to represent their biosynthetic origins, hierarchical structures, and application-specific metrics. In this Perspective, we identify three core challenges limiting biopolymer representation: information encoding, data quality, and data sharing. We describe the most pressing issues and propose commensurate approaches to address each key challenge. Recommendations include the design and adoption of biopolymer-specific fingerprinting and representation frameworks, development of hybrid human-large language model (LLM) data extraction strategies, and expanding Findable, Accessible, Interoperable, Reusable (FAIR)-compliant repositories. We propose a robust foundation to define interoperable, high-quality data sets that capture the full context of biopolymer materials. Standardized metadata, shared ontologies, and community-driven infrastructure would enable scalable, reproducible workflows and accelerate the ML-driven development of biopolymers.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Vision Foundation Models in Remote Sensing: A survey

Artificial intelligence (AI) technologies have profoundly transformed the field of remote sensing (RS), revolutionizing data collection, processing, and analysis. Traditionally reliant on manual interpretation and task-specific models, RS research has been significantly enhanced by the advent of foundation models (FMs)—large-scale pretrained AI models capable of performing a wide array of tasks with unprecedented accuracy and efficiency. This article provides a comprehensive survey of FMs in the RS domain. We categorize these models based on their architectures, pretraining datasets, and methodologies. Through detailed performance comparisons, we highlight emerging trends and the significant advancements achieved by those FMs. Additionally, we discuss technical challenges, practical implications, and future research directions, addressing the need for high-quality data, computational resources, and improved model generalization. Our research also finds that pretraining methods, particularly self-supervised learning (SSL) techniques like contrastive learning (CL) and masked autoencoders (MAEs), remarkably enhance the performance and robustness of FMs. This survey aims to serve as a resource for researchers and practitioners by providing a panorama of advances and promising pathways for the continued development and application of FMs in RS.

data models↗
DOE OSTI2026

Foundation models for atomistic simulation of chemistry and materials

Conventional computational methods for modeling chemical and materials systems are limited by system size and timescale, forcing a trade-off between quantum-mechanical accuracy and the sampling needed for realistic observables. Large language and vision foundation models — pre-trained on massive datasets using transformer architectures — have revolutionized many fields. It is thus interesting to ask whether a foundation model — subject to suitable data, parameter scaling and training — could enable learned simulations of chemistry and materials. Here, in this study, we review the field of machine-learned interatomic potentials (MLIPs) and posit that scaling up large and diverse chemical and materials datasets and highly expressive architectures using advanced training strategies should result in models that are: more efficient, transferable, robust to out-of-distribution scenarios, and easier to fine-tune to a variety of downstream physical observables than models trained from scratch on small datasets corresponding to specific, targeted atomistic simulation tasks. We provide specific criteria for creating such large-scale MLIP foundation models, coordinated strategies for their development, evaluation and deployment, and highlight potential emergent capabilities that could transform predictive simulations in chemistry and materials science and accelerate discovery across multiple technological domains.

Yuan, Eric C.-Y. [University of California, Berkel↗
DOE OSTI2020

Acid and heat stable enzymes for economical fuel production from biomass

CinderBio’s vision is to harness three billion years of biology to transform many industrial practices into sustainable processes with superior performance. Environments such as volcanic hot springs have evolved extremophilic microbes and enzymes that are naturally heat and acid stable. CinderBio was founded based on technologies developed at Lawrence Berkeley National Laboratory. Our core technologies are the molecular tools and know how to efficiently express extremophilic genes in an extremophilic host such that they retain their natural heat and acid stability. During this project, we tested our enzymes at the Advanced Biofuels and Bioproducts Process Development Unit (ABPDU), automated our fermentation and downstream processing, and built a comprehensive technoeconomic assessment (TEA) model for our manufacturing costs.

09 BIOMASS FUELS↗