Engineering PapersSearch

SEARCH · Engineering Papers

Results for “ViTs”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Vibration Isolation Technology (VIT) ATD Project

A fundamental advantage for performing material processing and fluid physics experiments in an orbital environment is the reduction in gravity driven phenomena. However, experience with manned spacecraft such as the Space Transportation System (STS) has demonstrated a dynamic acceleration environment far from being characterized as a 'microgravity' platform. Vibrations and transient disturbances from crew motions, thruster firings, rotating machinery etc. can have detrimental effects on many proposed microgravity science experiments. These same disturbances are also to be expected on the future space station. The Microgravity Science and Applications Division (MSAD) of the Office of Life and Microgravity Sciences and Applications (OLMSA), NASA Headquarters recognized the need for addressing this fundamental issue. As a result an Advanced Technology Development (ATD) project was initiated in the area of Vibration Isolation Technology (VIT) to develop methodologies for meeting future microgravity science needs. The objective of the Vibration Isolation Technology ATD project was to provide technology for the isolation of microgravity science experiments by developing methods to maintain a predictable, well defined, well characterized, and reproducible low-gravity environment, consistent with the needs of the microgravity science community. Included implicitly in this objective was the goal of advising the science community and hardware developers of the fundamental need to address the importance of maintaining, and how to maintain, a microgravity environment. This document will summarize the accomplishments of the VIT ATD which is now completed. There were three specific thrusts involved in the ATD effort. An analytical effort was performed at the Marshall Space Flight Center to define the sensitivity of selected experiments to residual and dynamic accelerations. This effort was redirected about half way through the ATD focusing specifically on the sensitivity of protein crystals to a realistic orbital environment. The other two thrusts of the ATD were performed at the Lewis Research Center. The first was to develop technology in the area of reactionless mechanisms and robotics to support the eventual development of robotics for servicing microgravity science experiments. This activity was completed in 1990. The second was to develop vibration isolation and damping technology providing protection for sensitive science experiments. In conjunction with the this activity, two workshops were held. The results of these were summarized and are included in this report.

Lubomski, Joseph F.

Reflectance and optical constants for Cer-Vit from 250 to 1050 A

The reflectance for a bowl-feed polished Cer-Vit sample was measured at nine wavelengths and five angles of incidence from 15 to 85 deg. Optical constants were derived by the reflectance-vs-angle-of-incidence method and compared to previously reported values for ultralow-expansion fused silica and several other glasses. Surface-roughness corrections of the reflectance data and optical constants are discussed.

Osantowski, J. F.

Throughput Estimation of Data Transport Networks From Digital Twin Measurements

Digital twins of networked infrastructures, known as Virtual Infrastructure Twins (VITs), are increasingly used for software development, pre-deployment testing, and design space exploration. While VITs avoid the costs and potential disruptions associated with experiments on operational networks, their throughput measurements are typically not sufficiently accurate for performance profiling of wide-area networks that they emulate. Here, machine learning (ML) methods are developed to transform these inaccurate VIT network throughput measurements to closely match in peak and overall profile of those from a physical testbed or production network. First, a micro kernel network reflecting a physical network is utilized to collect one-time measurements on a host to support this ML transformation. Then, a generic multi-modal ML method is developed to learn a map that transforms measurements from subsequent VITs on the same host to match past, current and follow-on testbed and cloud networks. ML generalization equations are derived to establish its correctness and probabilistically guarantee its generalization accuracy. Experimental results are presented for a variety of VIT hosts with target testbed and cloud networks; they include a case study of a four-site science ecosystem wherein inaccurate convex VIT measurement profiles are transformed into accurate concave profiles of target networks.

97 MATHEMATICS AND COMPUTING

Sequence length scaling in vision transformers for scientific images on frontier

Vision Transformers (ViTs) are pivotal for foundational models in scientific imagery, including Earth science applications, due to their capability to process large sequence lengths. While transformers for text have inspired scaling sequence lengths in ViTs, adapting these for ViTs introduces unique challenges. We develop distributed sequence parallelism for ViTs, enabling them to handle up to 1M tokens. Our approach, leveraging DeepSpeed-Ulysses and Long-Sequence-Segmentation with model sharding, is the first to apply sequence parallelism in ViT training, achieving a 94% batch scaling efficiency on 2,048 AMD-MI250X GPUs. Evaluating sequence parallelism in ViTs, particularly in models up to 10B parameters, highlighted substantial bottlenecks. We countered these with hybrid sequence, pipeline, and flash attention strategies, to scale beyond single GPU memory limits. Our method significantly enhances climate modeling accuracy by 20% in temperature predictions, marking the first training of a vision transformer model to convergence with a sequence length of 188K tokens, using full self-attention.

Tsaris, Aristeidis (aris) [ORNL] (ORCID:0000000277

Permeability Prediction Using Vision Transformers

Accurate permeability predictions remain pivotal for understanding fluid flow in porous media, influencing crucial operations across petroleum engineering, hydrogeology, and related fields. Traditional approaches, while robust, often grapple with the inherent heterogeneity of reservoir rocks. With the advent of deep learning, convolutional neural networks (CNNs) have emerged as potent tools in image-based permeability estimation, capitalizing on micro-CT scans and digital rock imagery. This paper introduces a novel paradigm, employing vision transformers (ViTs)—a recent advancement in computer vision—for this crucial task. ViTs, which segment images into fixed-sized patches and process them through transformer architectures, present a promising alternative to CNNs. We present a methodology for implementing ViTs for permeability prediction, its results on diverse rock samples, and a comparison against conventional CNNs. The prediction results suggest that, with adequate training data, ViTs can match or surpass the predictive accuracy of CNNs, especially in rocks exhibiting significant heterogeneity. This study underscores the potential of ViTs as an innovative tool in permeability prediction, paving the way for further research and integration into mainstream reservoir characterization workflows.

58 GEOSCIENCES

Design-to-Deployment Continuum Platform for Microscopes and Computing Ecosystems

Science ecosystems with networked computing systems and physical instruments are increasingly being deployed with a goal to achieve the productivity promised by AI-supported remote automation. In support of these efforts, the virtual infrastructure twins (VITs) have been successfully utilized to develop the orchestration codes for these ecosystems without requiring physical access to expensive instruments, such as electron microscopes. Currently, the utility of such a VIT is severely limited by the computing capacity and capability of the computing system used as its host. Furthermore, codes developed on the VIT typically need to be transferred and refactored for production use, particularly, on high-performance systems with accelerators. In response, we develop a design-to-deployment continuum platform wherein a VIT runs natively on the ecosystem's own computing system, and thereby facilitates the continual in-situ testing and transition of codes for production use. Here, we describe the development and testing of software for remote microscope steering and GPU-based image reconstruction using this platform on a multi-GPU computing system networked to Nion microscopes. We demonstrate a continual transition of steering and reconstruction codes developed under VIT platform to production ecosystem deployment.

Al-Najjar, Anees [Oak Ridge National Laboratory (O

Discovering Strong Gravitational Lenses in the Dark Energy Survey with Interactive Machine Learning and Crowd-sourced Inspection with Space Warps

We conduct a search for strong gravitational lenses in the Dark Energy Survey (DES) Year 6 imaging data. We implement a pre-trained Vision Transformer (ViT) for our machine learning (ML) architecture and adopt interactive machine learning to construct a training sample with multiple classes to address common types of false positives. Our ML model reduces ∼236 million DES cutout images to 22,564 targets of interest, including ∼85% of previously reported galaxy–galaxy lens candidates discovered in DES. These targets were visually inspected by citizen scientists, who ruled out ∼90% as false positives. Of the remaining 2618 candidates, 149 were expert-classified as “definite” lenses and 516 as “probable” lenses, for a total of 665 systems, with 147 of these candidates being newly identified. Additionally, we trained a second ViT to find double-source plane lens systems, finding at least one double-source system. Our main ViT excels at identifying galaxy–galaxy lenses, consistently assigning high scores to candidates with high expert assessments. The top 800 ViT-scored images include ∼100 of our “definite” lens candidates. This selection is an order of magnitude higher in purity than previous convolutional neural-network-based lens searches and demonstrates the feasibility of applying our methodology for discovering large samples of lenses in future surveys.

79 ASTRONOMY AND ASTROPHYSICS

AC Calorimetry and Thermophysical Properties of Bulk Glass-Forming Metallic Liquids

Thermo-physical properties of two bulk metallic glass forming alloys, Ti34Zr11Cu47Ni8 (VIT 101) and Zr57Nb5Ni12.6Al10CU15.4 (VIT 106), were investigated in the stable and undercooled melt. Our investigation focused on measurements of the specific heat in the stable and undercooled liquid using the method of AC modulation calorimetry. The VIT 106 exhibited a maximum undercooling of 140 K in free radiative cooling. Specific heat measurements could be performed in stable melt down to an undercooling of 80 K. Analysis of the specific heat data indicate an anomaly near the equilibrium liquidus temperature. This anomaly is also observed in y the temperature dependencies of the external relaxation time, the specific volume, and the surface tension; it is tentatively attributed to a phase separation in the liquid state. The VIT 101 specimen exhibited a small undercooling of about 50 K. Specific heat measurements were performed in the stable and undercooled melt. These various results will be combined with ground based work such as the measurement of T-T-T curves in the electrostatic levitator and low temperature viscosity and specific heat measurements for modeling the nucleation kinetics of these alloys.

Johnson, William L.

SHF: Symmetrical Hierarchical Forest with Pretrained Vision Transformer Encoder for High-Resolution Medical Segmentation

This paper presents a novel approach to addressing the long-sequence problem in high-resolution medical images for Vision Transformers (ViTs). Using smaller patches as tokens can enhance ViT performance, but quadratically increases computation and memory requirements. Therefore, the common practice for applying ViTs to high-resolution images is either to: (a) employ complex sub-quadratic attention schemes or (b) use large to medium-sized patches and rely on additional mechanisms within the model to capture the spatial hierarchy of details. We propose Symmetrical Hierarchical Forest (SHF), a lightweight approach that adaptively patches the input image to increase token information density and encode hierarchical spatial structures into the input embedding. We then apply a reverse depatching scheme to the output embeddings of the transformer encoder, eliminating the need for convolution-based decoders. Unlike previous methods that modify attention mechanisms or use a complex hierarchy of interacting models, SHF can be retrofitted to any ViT model to allow it to learn the hierarchical structure of details in high-resolution images without requiring architectural changes. Experimental results demonstrate significant gains in computational efficiency and performance: on the PAIP WSI dataset, we achieved a 3∼32×speedup or a 2.95%∼7.03% increase in accuracy (measured by Dice score) at a 64K2 resolution with the same computational budget, compared to state-of-the-art production models. On the 3D medical datasets BTCV and KiTS, training was 6×faster, with accuracy gains of 6.93% and 5.9%, respectively, compared to models without SHF.

Zhang, Enzhi [Hokkaido University, Japan]

Black-box optimization of CT acquisition and reconstruction parameters: a reinforcement learning approach

Protocol optimization is critical in Computed Tomography (CT) for achieving desired diagnostic image quality while minimizing radiation dose. Due to the inter-effect of influencing CT parameters, traditional optimization methods rely on the testing of exhaustive combinations of these parameters. This poses a notable limitation due to the impracticality of exhaustive parameter testing. This study introduces a novel methodology leveraging Virtual Imaging Trials (VITs) and reinforcement learning to more efficiently optimize CT protocols. Computational phantoms with liver lesions were imaged using a validated CT simulator and reconstructed with a novel CT reconstruction Toolkit. The optimization parameter space included tube voltage, tube current, reconstruction kernel, slice thickness, and pixel size. The optimization process was done using a Proximal Policy Optimization (PPO) agent which was trained to maximize the Detectability Index (d’) of the liver lesion for each reconstructed image. Results showed that our reinforcement learning approach found the absolute maximum d’ across the test cases while requiring 79.7% fewer steps compared to an exhaustive search, demonstrating both accuracy and computational efficiency, offering a efficient and robust framework for CT protocol optimization. The flexibility of the proposed technique allows for use of varying image quality metrics as the objective metric to maximize for. Our findings highlight the advantages of combining VIT and reinforcement learning for CT protocol management.

Fenwick, David [Duke University Medical Center]

ORBIT-2: Scaling Exascale Vision Foundation Models for Weather and Climate Downscaling

Sparse observations and coarse-resolution climate models limit effective regional decision-making, underscoring the need for robust downscaling. However, existing AI methods struggle with generalization across variables and geographies and are constrained by the quadratic complexity of Vision Transformer (ViT) self-attention. We introduce ORBIT-2, a scalable foundation model for global, hyper-resolution climate downscaling. ORBIT-2 incorporates two key innovations: (1) Residual Slim ViT (Reslim), a lightweight architecture with residual learning and Bayesian regularization for efficient, robust prediction; and (2) TILES, a tile-wise sequence scaling algorithm that reduces self-attention complexity from quadratic to linear, enabling long-sequence processing and massive parallelism. ORBIT-2 scales to 10 billion parameters across 65,536 GPUs, achieving up to 4.1 ExaFLOPS sustained throughput and 74–98% strong scaling efficiency. It supports downscaling to 0.9 km global resolution and processes sequences up to 4.2 billion tokens. On 7 km resolution benchmarks, ORBIT-2 achieves high accuracy with R2 scores in range of 0.98–0.99 against observation data.

Wang, Xiao [ORNL] (ORCID:0000000165451943)

Intercomparison of Deep Learning Model Architectures for Atmospheric River Prediction

With a rapid surge in the application of machine learning (ML) for a diverse range of tasks in climate science, the present study addresses a challenge for climate scientists when selecting the optimal ML or deep learning (DL) architecture for a given application. In particular, a DL intercomparison study was performed with a focus on forecasting the position of atmospheric rivers (ARs) on short-range time scales (up to 5-day lead times). AR predictions from multiple DL architectures, including various types of convolutional autoencoders and a vision transformer (ViT), were compared against ECMWF ERA5 reanalysis and hindcasts from a global climate model. DL models with similar trainable parameters were trained on ERA5 reanalysis data and AR positions derived from a thresholding algorithm to ensure a fair comparison among the DL models. Each model’s performance and accuracy in forecasting AR location and key input fields within a 5-day window were assessed using metrics of root-mean-square error, anomaly correlation, and mean intersection over union. The ViT architecture outperformed other autoencoder models in most of the metrics. Incorporating additional meteorological fields only yielded slight improvements in forecasting certain fields at longer lead times. The results also suggest that a smaller number of input time steps or smaller number of autoregressive steps can achieve better prediction skills, while also improving the overall computational efficiency. This research offers valuable insights into the strengths and weaknesses of different DL techniques for AR forecasting, hopefully guiding the development of improved models for forecasting this phenomenon.

54 ENVIRONMENTAL SCIENCES

Exploratory development of a glass ceramic automobile thermal reactor

This report summarizes the design, fabrication and test results obtained for glass-ceramic (CER-VIT) automotive thermal reactors. Several reactor designs were evaluated using both engine-dynamometer and vehicle road tests. A maximum reactor life of about 330 hours was achieved in engine-dynamometer tests with peak gas temperatures of about 1065 C (1950 F). Reactor failures were mechanically induced. No evidence of chemical degradation was observed. It was concluded that to be useful for longer times, the CER-VIT parts would require a mounting system that was an improvement over those tested in this program. A reactor employing such a system was designed and fabricated.

Gould, R. E.

Vibration isolation technology: An executive summary of systems development and demonstration

A program was organized to develop the enabling technologies needed for the use of Space Station Freedom as a viable microgravity experimental platform. One of these development programs was the Vibration Isolation Technology (VIT). This technology development program grew because of increased awareness that the acceleration disturbances present on the Space Transportation System (STS) orbiter can and are detrimental to many microgravity experiments proposed for STS, and in the future, Space Station Freedom (SSF). Overall technological organization are covered of the VIT program. Emphasis is given to the results from development and demonstration of enabling technologies to achieve the acceleration requirements perceived as those most likely needed for a variety of microgravity science experiments. In so doing, a brief summary of general theoretical approaches to controlling the acceleration environment of an isolated space based payload and the design and/or performance of two prototype six degree of freedom active magnetic isolation systems is presented.

Grodsinsky, Carlos M.

Selected OAST/OSSA space experiment activities in support of Space Station Freedom

The Space Experiments Division at NASA Lewis Research Center is developing technology and science space experiments for the Office of Aeronautics and Space Technology (OAST) and the Office of Space Sciences and Applications (OSSA). Selected precursor experiments and technology development activities supporting the Space Station Freedom (SSF) are presented. The Tank Pressure Control Experiment (TPCE) is an OAST-funded cryogenic fluid dynamics experiment, the objective of which is to determine the effectiveness of jet mixing as a means of equilibrating fluid temperatures and controlling tank pressures, thereby permitting the design of lighter cryogenic tanks. The information from experiments such as this will be utilized in the design and operation of on board cryogenic storage for programs such as SSF. The Thermal Energy Storage Flight Project (TES) is an OAST-funded thermal management experiment involving phase change materials for thermal energy storage. The objective of this project is to develop and fly in-space experiments to characterize void shape and location in phase change materials used in a thermal energy storage configuration representative of an advanced solar dynamic system design. The information from experiments such as this will be utilized in the design of future solar dynamic power systems. The Solar Array Module Plasma Interaction Experiment (SAMPIE) is an OAST-funded experiment to determine the environmental effects of the low earth orbit (LEO) space plasma environment on state-of-the-art solar cell modules biased to high potentials relative to the plasma. Future spacecraft designs and structures will push the operating limits of solar cell arrays and other high voltage systems. SAMPIE will provide key information necessary for optimum module design and construction. The Vibration Isolation Technology (VIT) Advanced Technology Development effort is funded by OSSA to provide technology necessary to maintain a stable microgravity environment for sensitive payloads on board spacecraft. The proof of concept will be demonstrated by laboratory tests and in low-gravity aircraft flights. VIT is expected to be utilized by many SSF microgravity science payloads. The Space Acceleration Measurement System (SAMS) is an OSSA-funded instrument to measure the microgravity acceleration environment for OSSA payloads on the shuttle and SSF.

Delombard, Richard

Vibration isolation technology - An executive summary of systems development and demonstration

A program was organized to develop the enabling technologies needed for the use of Space Station Freedom as a viable microgravity experimental platform. One of these development programs was the Vibration Isolation Technology (VIT). This technology development program grew because of increased awareness that the acceleration disturbances present on the Space Transportation System (STS) orbiter can and are detrimental to many microgravity experiments proposed for STS, and in the future, Space Station Freedom (SSF). Overall technological organization are covered of the VIT program. Emphasis is given to the results from development and demonstration of enabling technologies to achieve the acceleration requirements perceived as those most likely needed for a variety of microgravity science experiments. In so doing, a brief summary of general theoretical approaches to controlling the acceleration environment of an isolated space based payload and the design and/or performance of two prototype six degree of freedom active magnetic isolation systems is presented.

Grodsinsky, C. M.

Summer High School Apprenticeship Research Program (SHARP)

The summer of 1997 will not only be noted by NASA for the mission to Mars by the Pathfinder but also for the 179 brilliant apprentices that participated in the SHARP Program. Apprentice participation increased 17% over last year's total of 153 participants. As indicated by the End-of-the-Program Evaluations, 96% of the programs' participants rated the summer experience from very good to excellent. The SHARP Management Team began the year by meeting in Cocoa Beach, Florida for the annual SHARP Planning Conference. Participants strengthened their Education Division Computer Aided Tracking System (EDCATS) skills, toured the world-renowned Kennedy Space Center, and took a journey into space during the Alien Encounter Exercise. The participants returned to their Centers with the same goals and objectives in mind. The 1997 SHARP Program goals were: (1) Utilize NASA's mission, unique facilities and specialized workforce to provide exposure, education, and enrichment experiences to expand participants' career horizons and inspire excellence in formal education and lifelong learning. (2) Develop and implement innovative education reform initiatives which support NASA's Education Strategic Plan and national education goals. (3) Utilize established statistical indicators to measure the effectiveness of SHARP's program goals. (4) Explore new recruiting methods which target the student population for which SHARP was specifically designed. (5) Increase the number of participants in the program. All of the SHARP Coordinators reported that the goals and objectives for the overall program as well as their individual program goals were achieved. Some of the goals and objectives for the Centers were: (1) To increase the students' awareness of science, mathematics, engineering, and computer technology; (2) To provide students with the opportunity to broaden their career objectives; and (3) To expose students to a variety of enrichment activities. Most of the Center goals and objectives were consistent with the overall program goals. Modem Technology Systems, Inc., was able to meet the SHARP Apprentices, Coordinators and Mentors during their site visits to Stennis Space Center, Ames Research Center and Dryden Flight Research Center. All three Centers had very efficient programs and adhered to SHARP's general guidelines and procedures. MTSI was able to meet the apprentices from the other Centers via satellite in July during the SHARP Video-Teleconference(ViTS). The ViTS offered the apprentices and the NASA and SHARP Coordinators the opportunity to introduce themselves. The apprentices from each Center presented topical "Cutting Edge Projects". Some of the accomplishments for the 1997 SHARP Program year included: MTSI hiring apprentices from four of the nine NASA Centers, the full utilization of the EDCATS by apprentices and NASA/SHARP Coordinators, the distribution of the SHARP Apprentice College and Scholarship Directory, a reunion with former apprentices from Langley Research Center and the development of a SHARP Recruitment Poster. MTSI developed another exciting newsletter containing graphics and articles submitted by the apprentices and the SHARP Management Team.

Source record