Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Voxels”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Synthetic Data Generation for 3D Mesh Prediction and Spatial Reasoning During Multi-Agent Robotic Missions

In-space assembly operations require accurate reasoning over the pose, location, and structural organization of both the autonomous agents and assembly materials. In a full six-degree-of-freedom space, an accurate understanding of the full three-dimensional structure of the object of interest greatly enriches information for pose estimation and collision planning. Current methods of predicting pose estimation require a priori understanding of the shape of the object. Additionally, visual information in the space environment is impacted by variations in contrast and illumination. Using synthetic data allows us to rapidly generate large datasets with in varying environments and lighting conditions. This work details the generation of synthetic data used to explore the use of a region-based convolutional neural networks to detect objects of interest and predict a voxel-based three-dimensional mesh in order to understand their full three-dimensional shape. This mesh provides useful spatial information during in-space assembly operations without requiring either the complexity of maintaining models over the progress of building an object or observations from multiple angles. The generated meshes are then compared to that of ground truth in order to measure its performance.

James Ecker↗
NASA NTRS2017

Gaussian Mixture Models for Temporal Depth Fusion

Sensing the 3D environment of a moving robot is essential for collision avoidance. Most 3D sensors produce dense depth maps, which are subject to imperfections due to various environmental factors. Temporal fusion of depth maps is crucial to overcome those. Temporal fusion is traditionally done in 3D space with voxel data structures, but it can be approached by temporal fusion in image space, with potential benefits in reduced memory and computational cost for applications like reactive collision avoidance for micro air vehicles. In this paper, we present an efficient Gaussian Mixture Models based depth map fusion approach, introducing an online update scheme for dense representations. The environment is modeled from an ego-centric point of view, where each pixel is represented by a mixture of Gaussian inverse-depth models. Consecutive frames are related to each other by transformations obtained from visual odometry. This approach achieves better accuracy than alternative image space depth map fusion techniques at lower computational cost.

Matthies, Larry↗
NASA NTRSDate not supplied

Mineralogical, Elemental and Tomographic Reconnaissance Investigation for CLPS (“METRIC”)

METRIC comprises a suite of two instruments in a Lunar lander that perform X-ray diffraction (XRD) for mineral structure, X-ray fluorescence (XRF) for elemental composition, and X-ray Micro Computed Tomography (XCT) for 3D internal micromorphology. The instruments are accompanied by optical-near IR cameras to provide local geologic context. The Honeybee Robotics PlanetVac pneumatic sampling and transfer system [1],positioned on a lander footpad, will deliver sieved regolith to the X-ray instruments for analysis. The instrument suite is intended for delivery to the lunar surface on a Commercial Lunar Payload Services (CLPS) lander. The METRICXRD/F instrument draws on heritage from the Mars Science Laboratory CheMin instrument [2] and improves upon the design in multiple ways [3]. Like CheMin, Rietveld refinement and full-pattern fitting of METRIC XRD data can identify minerals at a detection limit of ~1 wt.%, quantify their abundances when present at >3 wt.%, and determine mineral composition (e.g., Fo#in olivine) from lattice parameters for minerals present at >5 wt.%[4,5]. An optimized XRF geometry provides for improved detection and quantification of major, minor and trace elements. The METRIC XCT instrument is a miniaturized X-ray Computed Tomography scanner[6]. Lunar regolith is delivered to a 3 mm diameter, 10 mm long graphite tube inside the instrument. The tube is rotated through 360°in 0.9deg.incrementsand a divergent point source X-ray beam is directed through the material. A Charge Coupled Device (CCD)records attenuation images whose brightness and contrast area function of average atomic number and density. Quantitative data, including particle and void sizes, 3D particle shape parameters, modal volumes and pore geometry can be derived from the resulting 3D reconstructions(voxel resolution: 30 μm). Crystal morphologies derived from METRIC XCT data complement the bulk mineralogy determined by the METRIC XRD/F and provide a measure of grain size distribution for the different phases. Taken together, the METRIC instrument suite determines crystal structure, elemental composition and morphology, three principal characteristics of geological materials that are highly useful in determining the origin and subsequent processing of lunar regolith.

Moon↗
NASA NTRSDate not supplied

Using X-Ray Computed Tomography to Catalog Rock Fragments in Apollo Drive Tube 73002

Overview: The Apollo missions collected 382 kg of rock, regolith, and core samples from six locations on the nearside of the Moon. Approximately 84% by mass of the Apollo collection remains in pristine condition within the curation facility at Johnson Space Center (i.e., never allocated, continuously stored in dry-N2 purged cabinets, exposure history restricted to Teflon, stainless steel, and Al-metal). Although most Apollo samples have been well characterized, there are several types of samples that have remained wholly or largely unstudied since their return, and/or that have been cu-rated under special conditions, e.g., frozen samples, samples stored in He-purged environment, and previously unopened drive tubes. NASA solicited proposals for the Apollo Next Generation Sample Analysis Pro-gram (ANGSA), and 9 teams were selected to study a subset of the unopened and frozen samples [1]. The first sample opened as part of the ANGSA pro-gram was drive tube 73002. This was originally a ~30 cm long, 4 cm diameter drive tube collected on a land-slide deposit near Lara Crater at the Apollo 17 landing site. It was part of a ~60 cm long double drive tube collected, and the bottom half of the tube (73001) was sealed under vacuum on the Moon [2]. Prior to opening sample 73002, the sample was imaged with a high resolution X-ray Computed Tomography (XCT) scan of the entire tube [3], which provided invaluable information during the dissection process [4]. In addition to the pre-dissection XCT scans, individual >4 mm particles were separated from the 73002 regolith during processing and scanned at high resolution by XCT. Here we pre-sent the initial lithologic classification of 134 individual >4 mm rock fragments separated from the 73002 core during the dissection process. Methodology: Drive tube 73002 was manually dissected in 0.5 cm depth intervals in three passes (Fig. 1) [4,5]. Each interval from pass 1 and 2 was sieved to <1 mm and >1 mm size fractions, and >1 mm particles were further manually subdivided into 1-2, 2-4, 4-10, and >10 mm size fractions. Pass 3 was not sieved, but >10 mm clasts were separated manually. Each 4-10 mm and >10 mm fragment was individually weighed, triply bagged in Teflon, and scanned by XCT. There are 60 rock fragments in Pass 1, 64 rock fragments in Pass 2 (from the 4-10 mm and >10 mm size fractions), and 8 rock fragments from Pass 3 (>10 mm size fraction). Each individually bagged rock fragment was scanned using the 180 kV nano-focus transmission source on the Nikon XTH 320 XCT system at NASA Johnson Space Center [6]. Scanning conditions varied considerably for individual particles, in large part be-cause of the large variation in size (0.008-19.623 g). All scans fell within the following range of scan conditions: 2.8-20.6 um voxel size; 90-155 kV voltage; 18-39 uA current; 1891-3141 projections; and 902-2000 slices. Results and Discussion: The 132 rock fragments from sample 73002 fall into the following general cat-gories: agglutinates (n = 6); basalts (13); impact melts (5); impact melt breccias (IMB; 42); regolith breccias (62); and soil breccias (4); see Figure 2 for representative examples of each lithology. Within most of these broad lithologic groups are recognizable subgroups. For example, a significant portion of regolith breccia fragments contain some agglutinate-like glass (n = 9) or are dilithologic (7) because they contain a single large clast (~50% or more by volume). Subgroups can be based on similarities to previously identified lunar lithologies, such as high-Ti basalts (9) and VLT basalts (4; Fig. 3), or based on commonly seen features within the fragments, such as poikilitic ilmenite IMB (10), ilmenite-lath IMB (12), or vesicular IMB (11) “groups”. Particles in the same “group” are not necessarily intended to be genetically related, but rather identify particles that are similar and that follow-up studies can classify in more detail [7]. Conclusion: Identification of lithologies based on XCT is a powerful tool, but a more absolute classification will sometimes require additional textural information from thin sections (e.g., glassy-matrix regolith vs. impact-melt vs. granulitic breccia) or quantitative mineral compositions (e.g., basalt vs. monomict breccia).

R A Zeigler↗
NASA NTRSDate not supplied

Firmware Architecture of the ARMADAS Bolting Robot

The Automated Reconfigurable Mission Adaptive Digital Assembly Systems (ARMADAS) project, under development at NASA Ames Research Center, has demonstrated on-ground autonomous robotic assembly of extensive digital structures, and it is now moving forward towards in-space demonstration. The ARMADAS system comprises of the operation software, the operation user interface (opsUI), and a swarm of robots. The robotic system consists of a multitude of collaborative agents specifically designed to transport, place and bolt the building blocks, called voxels (volumetric pixels). This paper focuses on the bolting robot, referred to as Mobile Metamaterial Internal Co-Integrator (MMIC-I). MMIC-I is a battery-powered crawling robot. It navigates the structure through extension, contraction and gripping. Two distinct controller boards operate the robot's two symmetric modules, referred to as module A and B. Board A is the master board: it coordinates motion planning and motion primitives execution, hosts the WiFi client, performs periodic self-assessment and system idle check and triggers faults if anomalies are detected. Board B periodically sends a heartbeat to board A, through a wired communication channel that uses the Serial protocol. Additionally, board A's WiFi client receives heartbeat packet requests or motion/bolting commands from a dedicated server board, and acknowledges reception sending back a response heartbeat packet containing information about the overall robot status, e. g. electrical current and voltage values, target and actual angles, operating mode, fault status. Whenever a motion command is sent, the motion planning section of the firmware determines the current robot configuration, using Inertial Measurement Unit readings and the motors Pulse Width Modulation values. Afterwards, it calculates the list of primitives needed to reach the target state, and controls their execution in the proper order. MMIC-I can receive and execute motion and bolting commands only when it is in operational mode. MMIC-I has three operating modes: standby, operational and safed. Standby mode is automatically entered upon startup. While in standby mode, all motors are powered off, and the only accepted commands are the ones relative to a change of mode and heartbeat packet request. Fault detection causes the robot to automatically enter safed or standby mode. Whenever the detected fault occurs within a motion and requires immediate intervention, e. g. an over-current situation, the robot enters safed mode. Safed mode powers off all motors except for the locomotion module, thus preventing the robot from collapsing. Conversely, when the detected fault doesn't require immediate intervention (low battery warning, for instance), the robot enters standby mode after completing the ongoing motion. This paper provides a detailed discussion of MMIC-I's firmware architecture. It accurately describes the implementation approach for each module: sensor data reading, motor control and actuation, WiFi server-client communication, intra-boards Serial communication, operating modes and autonomous fault detection, motion planning, coordination and execution, etc. Moreover, in support of the software description, this paper includes a thorough characterization of MMIC-I's hardware and avionics.

In-space assembly↗
NASA NTRSDate not supplied

Using XR for Improving Scientific Discovery With Numerical Weather Models

Earth science (ES) digital twins will help us understand the complex interactions and interrelationships that make up our Earth system and the impacts of earth science phenomena on it. Our work addresses two underdeveloped areas in current ES digital twin work: improving the understanding and interaction with ES model outputs by using Virtual and Mixed Reality (XR) tools and improving the non-intuitive mapping of continuous ES natural phenomena to gridded reference frames in current numerical models. Traditionally, scientists working on ES view and analyze the results of calculated or measured observables with static 1-dimensional (1D), 2D or 3D plots displayed on flat computer screens or paper. Using such limited mediums, it can be very difficult to identify, track and understand the evolution of key features due to poor viewing angles and the nature of flat computer screens. In addition, numerical models, such as the NASA Goddard Earth Observing System (GEOS) ES model, are almost exclusively formulated, visualized and analyzed in an Eulerian reference frame with fixed grid points in space and time. However, ES phenomena such as convective clouds, hurricanes and wildfire smoke plumes are visualized and analyzed in a Lagrangian reference frame: therefore it is often difficult and unnatural to understand these phenomena in relation to each other, visualized either in an Eulerian or Lagrangian context. In 3D visualizations, data generally takes one of three forms: gridded (e.g., voxelized) data, where space is divided into regions; point clouds, where data is represented as a set of points; and meshes, where objects are rendered as surfaces composed of small polygons (usually triangles). A gridded, Eulerian reference frame has been the default representation for the 2D visual analysis of atmospheric data in part because the numerical methods used to generate atmospheric model data in the first place use a gridded approach, with equations defining the relationships between the physical variables in each of a grid's cells across successive timesteps. In our work, we are particularly interested in data from GEOS. Another reason why gridded representations tend to be used for visualizing data from such models is because trajectories are difficult to interpret from representations on 2D surfaces, due to line-of-sight ambiguity. Instead of a fixed grid from GEOS, we embed a trajectory model to simulate particles' movement throughout a GEOS run. We then ingest these particle trajectories as animated point clouds with a NASA open source XR toolkit, the Mixed Reality Exploration Toolkit (MRET), and merge GEOS data with ES phenomena data onto one combined visualization that the user can intuitively interact with. Efficient rendering of arbitrarily large point clouds is an ongoing challenge being addressed by the computer science community, with the GPU-based optimizations and efficient GPU memory utilization a common theme of recent advances, especially for XR, where sustained high frame rate is mandatory to save the user from suffering due to simulation sickness. In this work, we describe and evaluate our progress in choosing and implementing appropriate methods for rendering arbitrarily large point clouds within MRET for XR. While tracking the XR headset enables the immersion of a user within a 3D scene of a data visualization, tracking of XR handheld controllers or user’s hands enables us to implement intuitive user interactions with the visualized datasets. Conventional tools require a user working with an ES visualization to conduct many interactions to commit their intended selections or manipulations with a visualized dataset; for example to specify a set of points in 3D space. Doing so in a 2D flat screen interface has traditionally required specifying a set of points in three distinct 2D coordinate systems (XY, XZ, and YZ), which is cumbersome. In other scientific domains, it has been shown that specifying or selecting a location or volume in XR using handheld controllers or tracked hands allows for greater speed and accuracy. We anticipate the same will hold true for atmospheric data, and we will share initial results of measuring the utility of such an interface. Notably, as the data being visualized is generated by GEOS as a prediction based on initial conditions, an intended application of our tool is to serve as part of an iterative feedback loop. Through XR, a scientist will review and manipulate a GEOS model run, modifying the conditions as needed to do subsequent runs of GEOS. Thereby, XR-based improvements to speed and accuracy of 3D tagging of points minimizes the effort required by both the scientist and the computer cluster conducting the necessary calculations.

Thomas Grubb↗
NASA NTRSDate not supplied

Multiscale Modeling of Reconstructed Tricalcium Silicate using NASA Multiscale Analysis Tool

To study microstructure characteristics of cementitious materials hydrated in space; previously, cement binder formations were processed under microgravity conditions and was further compared against ground-based experiments. For accurate estimation of process-structure-property linkage, particularly on samples hydrated in the microgravity environment, it is desired to have a high-fidelity volumetric representation of the microstructure. However, owing to small sample size and high porosity of the space-returned samples, conventional experimental characterization techniques are not viable. Hence, a deep learning-based reconstruction algorithm was employed to obtain high fidelity 3D volumes from sparse high resolution 2D Scanning Electron Microscopy (SEM) images, as inputs to micromechanics-based modeling. This machine learning-based reconstruction methodology validated against low-order statistical descriptors, captured the microstructural topology of both sample types (ground, 1g and microgravity, μg). Due to the lack of gravity, hydration products of the samples processed in space differed from those processed-on ground. Such AI-generated virtual samples were analyzed in a multiscale recursive micromechanics approach using the NASA Multiscale Analysis Tool (NASMAT). Here, we present a methodology to rapidly integrate and evaluate these AI-generated volumes in NASMAT. The synthesized microstructural volumes are directly employed as Representative Volume Elements (RVEs) to preserve the fidelity (1 pixel = 0.54 m). Invariably, analysis of such largescale problems (5123 voxels) requires huge amount of computational resources. By taking advantage of the NASMAT architecture, we also focused on systematic multiscale integration of these AI-reconstructed virtual volumes to reduce the computational demands. In this work, this methodology is demonstrated on the ground-based, 1g samples. The estimated stiffness value of 15.90 GPa is comparable to experimentally obtained modulus of hydrated tricalcium silicate sample. The workflow presented here paves the way for utilizing the NASMAT tool to perform multiscale analyses of other multi-phase material systems using either 3D virtual datasets synthesized using AI or obtained via micro-CT.

Machine Learning↗
NASA NTRSDate not supplied

Recent Developments to the Porous Microstructure Analysis (PuMA) Software

Introduction The Porous Microstructure Analysis (PuMA) software is an open source framework for image-based simulation, primarily used to determine effective properties based on material microstructure. PuMA was originally developed for the study of NASA thermal protection materials; however, many of the solvers in PuMA have applicability to a broad range of materials science applications. PuMA version 3.2 computes material surface area, pore diameters, effective thermal conductivity, continuum and rarefied tortuosity, and permeability. For anisotropic materials, PuMA can estimate material orientation and compute anisotropic thermal conductivity and elasticity. In this talk, a brief overview of the PuMA software and underlying methods will be presented, as well as some recent and ongoing developments, including the use of immersed boundary methods for image-based simulation and the development of a new weave segmentation tool, called TomoSAM. Cut-Cell method for heat and mass transfer For simulations on complex microstructures, traditional unstructured meshing techniques often prove to be difficult and time-intensive. Voxel-based solvers, which represent the surface as a staircase structure, are relatively simple to implement but can lose accuracy when feature resolution is poor. In this work, we present a novel 3D cut-cell method for solving the variable coefficient Poisson equation on complex microstructures, suitable for the determination of effective thermal conductivity or tortuosity of a material. The method uses a Marching Cubes/Marching Squares surface reconstruction to create cut-cells and determine geometric quantities. A flux-correction method is extended to 3D, with least squares gradient reconstruction, to solve for the boundary fluxes in the cut-cells. Verification cases show the solver achieves globally 2nd order accuracy on complex microstructures. TomoSAM TomoSAM, a module of the PuMA software, has been developed as a plugin for 3D Slicer, a software platform used for 3D image processing and visualization. It utilizes the Segment Anything Model (SAM), a deep learning model capable of identifying objects and generating image masks based on minimal user input. This feature enables efficient segmentation of complex 3D datasets, particularly of woven materials, from tomography or similar imaging methods, reducing the need for manual segmentation.

Tomography↗
NASA NTRSDate not supplied

Recent Developments to the Porous Microstructure Analysis (PuMA) Software

The Porous Microstructure Analysis (PuMA) software is an open source framework for image-based simulation, primarily used to determine effective properties based on material microstructure. PuMA was originally developed for the study of NASA thermal protection materials; however, many of the solvers in PuMA have applicability to a broad range of materials science applications. PuMA version 3.2 computes material surface area, pore diameters, effective thermal conductivity, continuum and rarefied tortuosity, and permeability. For anisotropic materials, PuMA can estimate material orientation and compute anisotropic thermal conductivity and elasticity. In this talk, a brief overview of the PuMA software and underlying methods will be presented, as well as some recent and ongoing developments, including the use of immersed boundary methods for image-based simulation and the development of a new weave segmentation tool, called TomoSAM. Cut-Cell method for heat and mass transfer For simulations on complex microstructures, traditional unstructured meshing techniques often prove to be difficult and time-intensive. Voxel-based solvers, which represent the surface as a staircase structure, are relatively simple to implement but can lose accuracy when feature resolution is poor. In this work, we present a novel 3D cut-cell method for solving the variable coefficient Poisson equation on complex microstructures, suitable for the determination of effective thermal conductivity or tortuosity of a material. The method uses a Marching Cubes/Marching Squares surface reconstruction to create cut-cells and determine geometric quantities. A flux-correction method is extended to 3D, with least squares gradient reconstruction, to solve for the boundary fluxes in the cut-cells. Verification cases show the solver achieves globally 2nd order accuracy on complex microstructures. TomoSAM TomoSAM, a module of the PuMA software, has been developed as a plugin for 3D Slicer, a software platform used for 3D image processing and visualization. It utilizes the Segment Anything Model (SAM), a deep learning model capable of identifying objects and generating image masks based on minimal user input. This feature enables efficient segmentation of complex 3D datasets, particularly of woven materials, from tomography or similar imaging methods, reducing the need for manual segmentation.

Tomography↗
DOE OSTI2020

Identification of uncommon objects in containers

A system for identifying in an image an object that is commonly found in a collection of images and for identifying a portion of an image that represents an object based on a consensus analysis of segmentations of the image. The system collects images of containers that contain objects for generating a collection of common objects within the containers. To process the images, the system generates a segmentation of each image. The image analysis system may also generate multiple segmentations for each image by introducing variations in the selection of voxels to be merged into a segment. The system then generates clusters of the segments based on similarity among the segments. Each cluster represents a common object found in the containers. Once the clustering is complete, the system may be used to identify common objects in images of new containers based on similarity between segments of images and the clusters.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Reconstruction of dynamic scenes based on differences between collected view and synthesized view

A system for generating a 4D representation of a scene in motion given a sinogram collected from the scene while in motion. The system generates, based on scene parameters, an initial 3D representation of the scene indicating linear attenuation coefficients (LACs) of voxels of the scene. The system generates, based on motion parameters, a 4D motion field indicating motion of the scene. The system generates, based on the initial 3D representation and the 4D motion field, a 4D representation of the scene that is a sequence of 3D representations having LACs. The system generates a synthesized sinogram of the scene from the generated 4D representation. The system adjusts the scene parameters and the motion parameters based on differences between the collected sinogram and the synthesized sinogram. The processing is repeated until the differences satisfy a termination criterion.

Kim, Hyojin↗
DOE OSTI2020

Autonomous Radiation Mapping and Quantification using an Unmanned Ground Vehicle. Part I - Environment Mapping

When characterizing facilities, advanced autonomous systems are safe, efficient, and cost-effective tools, which can safely deploy state-of-the-art instrumentation without exposing workers to radiation risks. One main focus of the research is the visual mapping of the environment.This paper presents a framework for the mapping aspect that utilizes lidar and SLAM technologies coupled with a monocular camera to create a point cloud of the environment. Upon completion, the present research work aims to provide an autonomous mobile robot the capability to localize itself and aid the user with visualizing the radiation data. Challenges: C++ node needs to properly synchronize image and point cloud data. 3D lidar has resolution of ± 3 cm. Proper camera calibration needed. Transforms need to be precise for proper alignment of image and point-cloud. Results: Voxelated point clouds. Accurate colors from calibrated cameras including details smaller than lidar resolution. Developed Robotics Operating System (ROS) package for ease of transfer to other robot platforms.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

Patch2Self2: Self-supervised Denoising on Coresets via Matrix Sketching

Diffusion MRI (dMRI) non-invasively maps brain white matter yet necessitates denoising due to low signal-to-noise ratios. Patch2Self (P2S) employing self-supervised techniques and regression on a Casorati matrix effectively denoises dMRI images and has become the new de-facto standard in this field. P2S however is resource intensive both in terms of running time and memory usage as it uses all voxels (n) from all-but-one held-in volumes (d-1) to learn a linear mapping Phi : \mathbb R ^ n x(d-1) \mapsto \mathbb R ^ n for denoising the held-out volume. The increasing size and dimensionality of higher resolution dMRI acquisitions can make P2S infeasible for large-scale analyses. This work exploits the redundancy imposed by P2S to alleviate its performance issues and inspect regions that influence the noise disproportionately. Specifically this study makes a three-fold contribution: (1) We present Patch2Self2 (P2S2) a method that uses matrix sketching to perform self-supervised denoising. By solving a sub-problem on a smaller sub-space so called coreset we show how P2S2 can yield a significant speedup in training time while using less memory. (2) We present a theoretical analysis of P2S2 focusing on determining the optimal sketch size through rank estimation a key step in achieving a balance between denoising accuracy and computational efficiency. (3) We show how the so-called statistical leverage scores can be used to interpret the denoising of dMRI data a process that was traditionally treated as a black-box. Experimental results on both simulated and real data affirm that P2S2 maintains denoising quality while significantly enhancing speed and memory efficiency achieved by training on a reduced data subset.

Fadnavis, Shreyas↗
DOE OSTI2025

MoRE-Brain: Routed Mixture of Experts for Interpretable and Generalizable Cross-Subject fMRI Visual Decoding

Decoding visual experiences from fMRI offers a powerful avenue to understand human perception and develop advanced brain-computer interfaces. However, current progress often prioritizes maximizing reconstruction fidelity while overlooking interpretability, an essential aspect for deriving neuroscientific insight. To address this gap, we propose MoRE-Brain, a neuro-inspired framework designed for high-fidelity, adaptable, and interpretable visual reconstruction. MoRE-Brain uniquely employs a hierarchical Mixture-of-Experts architecture where distinct experts process fMRI signals from functionally related voxel groups, mimicking specialized brain networks. The experts are first trained to encode fMRI into the frozen CLIP space. A finetuned diffusion model then synthesizes images, guided by expert outputs through a novel dual-stage routing mechanism that dynamically weighs expert contributions across the diffusion process. MoRE-Brain offers three main advancements: First, it introduces a novel Mixture-of-Experts architecture grounded in brain network principles for neuro-decoding. Second, it achieves efficient cross-subject generalization by sharing core expert networks while adapting only subject-specific routers. Third, it provides enhanced mechanistic insight, as the explicit routing reveals precisely how different modeled brain regions shape the semantic and spatial attributes of the reconstructed image. Extensive experiments validate MoRE-Brain’s high reconstruction fidelity, with bottleneck analyses further demonstrating its effective utilization of fMRI signals, distinguishing genuine neural decoding from over-reliance on generative priors. Consequently, MoRE-Brain marks a substantial advance towards more generalizable and interpretable fMRI-based visual decoding.

Wei, Yuxiang [Georgia Institute of Technology]↗
DOE OSTI2022

Virtual Volumes

SAND2022-14692 O Virtual Volumes is a CAD2VR plugin that gives users a powerful and intuitive way of exploring volumetric data in a three-dimensional (3D) virtual reality (VR) environment. It enables viewing of and interaction with volumetric and voxel data derived from sources such computed tomography (CT) scans. Current 2D software solutions for viewing CT scans and other volumetric data forces the user to look through "slices" of their data across anatomical planes. In Virtual Volumes, the user can intuitively interact, scale, crop, colorize, and threshold their data in a 3D VR environment. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Krukar, JohnA.↗
DOE OSTI2020

Bayes Inference Engine (BIE) Test Plan: TiltConeBeamFVT

The Bayes Inference Engine (BIE) is a general software tool intended to be used primarily in the analysis of radiographic data for density. An analysis is set up in the BIE by representing the problem as a collection of modules called glyphs. All glyphs to be used in creating the forward model of the experiment will be tested separately for a range of inputs. The testing of the adjoint code is performed in a separate document.

97 MATHEMATICS AND COMPUTING↗