SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
This package contains the code for the paper Combining Deep Learning with Physics Based Features in Explosion-Earthquake Discrimination published at Geophysical Research Letters. There are two Jupyter notebooks, one for building and training the two-branch model, and the other is visualizing the deep learning branch using GradCAM.
The Vistransformers Explained library is a collection of python notebooks that demonstrate the internal mechanics and uses of visual-transformer (ViT) machine learning models. The code implements, with mild modifications, ViT models that have been made publicly available through publication and GitHub code. The value added by this code is in-depth explanations of the mathematics behind the sub-modules of the ViT models, including original figures. Additionally, the library contains the code necessary to implement and train the ViT models. The library does not include example training data for the models; instead, it would rely on users generating their own datasets. The code is based on the PyTorch python library. It does not include any files other than python scripts, modules, or notebooks.
SAND2025-03438O HiTEM3d v1.0 is a user-friendly software designed to simulate how electromagnetic signals move through large geological environments, particularly around wellbores. It helps geophysicists and resource explorers understand subsurface conditions more effectively and affordably. By simplifying complex geological models, HiTEM3d allows users to visualize and analyze electromagnetic fields, making it easier to identify valuable resources like minerals or water. Its efficient processing capabilities ensure quick results, making it an essential tool for anyone involved in geophysical research or exploration. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.
Reno is a tool for creating, visualizing, and analyzing system dynamics models in Python. It additionally has the ability to convert models to PyMC, allowing Bayesian inference on models with variables that include prior probability distributions.
REACT is a website designed to simplify the analysis and decision-making process for retrofitting existing central plant heating and cooling systems with advanced heat pump technologies. The tool evaluates the technical and economic viability of replacing traditional boilers with various options including water-to-water or air-to-water heat pumps, which can provide efficient and lower-cost heating and cooling. It allows users to compare current central plant configurations with retrofit scenarios, assessing energy consumption, life-cycle costs, and environmental impact. Retrofitting traditional boiler and chiller systems with water-to-water or air-to-water heat pumps can significantly reduce energy consumption and lower lifecycle costs. The REACT provides: User-Friendly Tools: A user friendly web interface for quick, intuitive analysis accessible to non-experts. Advanced Modeling: A Python-powered engine for detailed parametric studies, optimization, and research applications. Comprehensive Analysis: Lifecycle cost evaluation, energy consumption modeling, and environmental impact assessment. Visual Insights: A variety of plots to visualize system performance and design trade-offs. The engine for the website (REACT) bases on several Python libraries, and the website will be hosted on an ETA server.
In the coming decades, our planet will witness unprecedented urban population growth in both established and emerging communities. The development and maintenance of urban infrastructures are highly energy-intensive. Urban areas are dictated by complex intersections among physical, engineered, and human dimensions that have significant implications for traffic congestion, emissions, and energy usage. In this chapter, we highlight recent research and development efforts at Oak Ridge National Laboratory (ORNL), the largest multipurpose science laboratory within the U.S. Department of Energy’s (DOE) national laboratory system, that characterizes the interactions between the human dynamics and critical infrastructures in conjunction with the integration of four distinct components: data, critical infrastructure models, and scalable computation and visualization, all within the context of physical and social systems. Discussions focus on four key topical themes: population and land use, sustainable mobility, the energy-water nexus, and urban resiliency, that are mutually aligned with DOE’s mission and ORNL’s signature science and technology capabilities. Using scalable computing, data visualization, and unique datasets from a variety of sources, the institute fosters innovative interdisciplinary research that integrates ORNL expertise in critical infrastructures including energy, water, transportation, and cyber, and their interactions with the human population.
With its extensive vehicle and energy use data, supply and demand modeling capabilities, ARIES platform, and visualization tools, NREL can help planners discern the best energy system designs to meet the business, sustainability, and operational goals of individual airports.
Ultrasonic testing is a common Non-Destructive Inspection (NDI) method used in aerospace manufacturing. However, the complexity and size of the ultrasonic scans make it challenging to identify defects through visual inspection or machine learning models. Using computer vision techniques to identify defects from ultrasonic scans is an evolving research area. In this study, we used instance segmentation to identify the presence of defects in the ultrasonic scan images of composite panels that are representative of real components manufactured in aerospace. We used two models based on Mask- RCNN (Detectron 2) and YOLO 11 respectively. Additionally, we implemented a simple statistical pre-processing technique that reduces the burden of requiring custom-tailored pre-processing techniques. Our study demonstrates the feasibility and effectiveness of using instance segmentation in the NDI pipeline by significantly reducing data pre-processing time, inspection time, and overall costs.
Radon daughter plate-out may pose a fundamental limitation to realizing large-scale superconducting quantum computers. Radon daughters plated-out on a superconducting qubit can decay, releasing energy into the substrate, producing phonons. Phonon-induced quasiparticles then generate bit-flip errors and reduce coherence times. We seek to increase plate-out on chips to enable future study of the impact of radon on coherence times. In this project, we utilize COMSOL Multiphysics simulations to visualize electric field configuration and model ion transport to finalize design of a device to increase radon plate-out on qubit chips.
This dataset is a model archive of the paper A bespoke model of Arctic river basins based on hillslope delineation (in prep), which introduces a watershed decomposition and parameterization method for large scale permafrost hydrology simulation. With this dataset, this study aims to address the research question: whether a computationally efficient hillslope-based modeling framework can reliably simulate discharge at Arctic river-basin scales. This dataset contains model input and output data for five modeling scenarios at a study site located in the Sagavanirktok River basin. The five modeling scenarios include three modeling cases under temperate conditions using full 3D, decomposed 3D, and decomposed 2D modeling strategies; and two modeling cases under actual Arctic conditions with permafrost using full 3D and decomposed 2D modeling strategies. Simulations were performed using the Advanced Terrestrial Simulator (ATS, v1.6 for three temperate scenarios and v1.5 for two Arctic scenarios), a physics-rich integrated surface–subsurface hydrologic model with cryo-hydrology features. For the three temperate models, simulations were conducted for the period of 10/01/1993 - 09/30/2002; and for the two Arctic models, simulations were conducted for the period of 01/01/1994 - 12/31/2002. To facilitate reproducibility of simulations, all datasets are organized hierarchically. The dataset contains: (1) Mesh files (.exo) for full 3D model, decomposed 3D models, and decomposed 2D models, located in huc/190604020802_gauge15906000/mesh/. Mesh files can be visualized through Paraview or read by Python. (2) Climate forcings (.h5) for full 3D model and decomposed 3D/2D models are located in huc/190604020802_gauge15906000/daymet_onePiece/, and huc/190604020802_gauge15906000/vp_pr_revised_daymet_1980_2006_with_wind/ separately. Accessible by Python. (3) Raw measured gage discharge (.csv) from USGS, located in huc/190604020802_gauge15906000/gaged_basin15906000_discharge_usgs/. Accessible by Python. (4) Delineated subdomain raster (.tif) and shape files (.shp), and the final parameterized results (.npy) for decomposed models, located in huc/190604020802_gauge15906000/data_preprocessed-meshing. Accessible by Python. (5) Temperate models are located in nonpermaf_huc190604020802_gauge15906000/, which includes three cases: decomposed 2D models (inside model_0*-hillslope_*), decomposed 3D models (inside model_1*-subcatchment_*), and full 3D model (inside model_2*-onepiece_*). Two step spin-up results (checkpoint_final.h5) are located in model_*1-*_spinup_steadystate and model_*2-*_spinup_cycle, separately, which are used to initialize real transient models. The input files (.xml) and output results (.dat) of the real transient models are located in model_*3-*_transient/. Especially, for two example hillslope models (ID=-11 and 11), additional h5py files are included in model_03-hillslope_transient/hillslope-11/, model_03-hillslope_transient/hillslope11, model_13-subcatchment_transient/subcatchment-11/, model_13-subcatchment_transient/subcatchment/11, respectively, which are used to plot the saturation figure (Figure 5) in the manuscript. Accessible by Python. (6) Arctic models are located in huc190604020802_gauge15906000/, which includes two cases: decomposed 2D models (inside model_04-hillslope_transient), and full 3D model (inside model_05-onepiece_transient_mannp1_ra). Three step spin-up results (checkpoint_final.h5) are located in model_01-column_freezeup/, model_02-column_spinup/, model_03-hillslope_spinup/, respectively, which are used to initialize real 2D transient hillslope models. The input files (.xml) and output results (.dat) of transient 2D hillslope models are located in model_04-hillslope_transient/. The input files (.xml) and output results (.dat) of the full 3D transient model is located in model_05-onepiece_transient_mannp1_ra/. The full 3D transient model is initialized by model_02-column_spinup/. Accessible by Python. (7) The MOSART routed discharge results (.csv) under Arctic conditions is located in huc190604020802_gauge15906000/MOSART/. Accessible by Python. (8) All Python codes (.py) used to parameterize full 3D model to decomposed 2D models are located in script/. These codes fit with watershed workflow (a watershed delineation tool) v1.4 under the branch gaob/v1.4 from https://github.com/gaobhub/watershed-workflow.git.
High-resolution transmission electron microscopy (HRTEM) is crucial for observing material’s structural and morphological evolution at Angstrom scales, but the electron beam can alter these processes. Devices such as CMOS-based direct-electron detectors operating in electron-counting mode can be utilized to substantially reduce the electron dosage. However, the resulting images often lead to a low signal-to-noise ratio, which requires frame integration that sacrifices temporal resolution. Several machine learning (ML) models have been recently developed to successfully denoise HRTEM images. Yet, these models are often computationally expensive, and their inference speeds on GPUs are outpaced by the imaging speed of advanced detectors, precluding in situ analysis. Furthermore, the performance of these denoising models on datasets with imaging conditions that deviate from the training datasets has not been evaluated. To mitigate these gaps, we propose a new self-supervised ML denoising pipeline specifically designed for time-series HRTEM images. This pipeline integrates a blind-spot convolution neural network with pre-processing and post-processing steps, including drift correction and low-pass filtering. Results demonstrate that our model outperforms various other ML and non-ML denoising methods in noise reduction and contrast enhancement, leading to improved visual clarity of atomic features. Additionally, the model is drastically faster than U-Net-based ML models and demonstrates excellent out-of-distribution generalization. The model’s computational inference speed is in the order of milliseconds per image, rendering it suitable for application in in-situ HRTEM experiments.
This article describes a new graphical user interface that uses the PENELOPE Monte Carlo code to calculate dose distributions in materials. It is named PUFFIn, for the Penelope User-Friendly Fast Interface and was developed as an educational and scoping analysis tool for non-experts in radiation modeling. PUFFIn enables the user to visualize and compare the dose distributions in objects (e.g., sterilized healthcare products) irradiated with cobalt-60 gamma-rays, electron beam (E-beam) or X-rays. From such comparisons, the user can determine the most efficient product and/or packaging designs for any given radiation field – whether for conceptual or existing products and packaging. PUFFIn is distributed in a complete, self-contained package of software, including the PENELOPE radiation transport code, a standard graphics package, and a set of simple exercises. The package is available to any user at no cost and requires a minimal amount of training compared to other similar software. PUFFIn's capabilities are described, as well as validation measurements performed at Texas A&M University E-beam facility and the Aerial E-beam Facility in France.
Domain-specific visualizations sometimes focus on narrow, albeit important, tasks for one group of users. This focus limits the utility of a visualization to other groups working with the same data. While tasks elicited from other groups can present a design pitfall if not disambiguated, they also present a design opportunity—namely, the development of visualizations that support multiple groups. This development choice presents a trade-off of broadening the scope but limiting support for the more narrow tasks of any one group, which in some cases can enhance the overall utility of the visualization. We investigate this scenario through a design study where we develop Guidepost, a notebook-embedded visualization of data that helps scientists assess compute wait times, machine learning researchers understand prediction accuracy, and system maintainers analyze usage trends. We adapt the use of personas for visualization design from existing literature in the HCI and design domains, applying them to categorize tasks based on their uniqueness across stakeholder personas. Under this model, tasks shared between all groups should be supported by interactive visualizations and tasks unique to each group can be deferred to scripting with notebook-embedded visualization design. We evaluate our visualization through real-world case studies and a task-focused evaluation with nine participants. We observe that together, Guidepost's visual encodings, interactions, and export capabilities support the tasks of our differing personas.
Infectious diseases (IDs) have a significant detrimental impact on global health. Timely and accurate ID forecasting can result in more informed implementation of control measures and prevention policies. To meet the operational decision-making needs of real-world circumstances, we aimed to build a standardized, reliable, and trustworthy ID forecasting pipeline and visualization dashboard that is generalizable across a wide range of modeling techniques, IDs, and global locations. We forecasted 6 diverse, zoonotic diseases (brucellosis, campylobacteriosis, Middle East respiratory syndrome, Q fever, tick-borne encephalitis, and tularemia) across 4 continents and 8 countries. We included a wide range of statistical, machine learning, and deep learning models (n=9) and trained them on a multitude of features (average n=2326) within the One Health landscape, including demography, landscape, climate, and socioeconomic factors. The pipeline and dashboard were created in consideration of crucial operational metrics—prediction accuracy, computational efficiency, spatiotemporal generalizability, uncertainty quantification, and interpretability—which are essential to strategic data-driven decisions. While no single best model was suitable for all disease, region, and country combinations, our ensemble technique selects the best-performing model for each given scenario to achieve the closest prediction. For new or emerging diseases in a region, the ensemble model can predict how the disease may behave in the new region using a pretrained model from a similar region with a history of that disease. The data visualization dashboard provides a clean interface of important analytical metrics, such as ID temporal patterns, forecasts, prediction uncertainties, and model feature importance across all geographic locations and disease combinations. As the need for real-time, operational ID forecasting capabilities increases, this standardized and automated platform for data collection, analysis, and reporting is a major step forward in enabling evidence-based public health decisions and policies for the prevention and mitigation of future ID outbreaks.
Predictive mathematical modeling is an essential part of systems biology and is interconnected with information management. Systems biology information is often stored in specialized formats to facilitate data storage and analysis. These formats are not designed for easy human readability and thus require specialized software to visualize and interpret results. Therefore, comprehending modeling and underlying networks and pathways is contingent on mastering systems biology tools, which is particularly challenging for users with no or little background in data science or system biology. To address this challenge, we investigated the usage of public Artificial Intelligence (AI) tools in exploring systems biology resources in mathematical modeling. We tested public AI’s understanding of mathematics in models, related systems biology data, and the complexity of model structures. Our approach can enhance the accessibility of systems biology for non-system biologists and help them understand systems biology without a deep learning curve.
Official code for the NeurIPS 2023 paper "Neural Image Compression: Generalization, Robustness, and Spectral Biases". This code can be used to: - Computing spectral distortion errors of images compressed with traditional codes or neural image compression models (as proposed in the aformentioned paper) - Visualize power spectral densities and fourier heatmaps (as proposed in the aformentioned paper) - Train and test a variety of neural image compression models
An open‐source modeling platform, called Anaerobic Digestion Model No. 1 Fast (ADM1F), is introduced to achieve fast and numerically stable simulations of anaerobic digestion processes. ADM1F is compatible with an iPython interface to facilitate model configuration, simulation, data analysis, and visualization. Faster simulations and more stable results are accomplished by implementing an advanced open‐source library of numerical methods called Portable Extensive Toolkit for Scientific Computation (PETSc) to solve the ADM1 system of equations. Leveraging PETSc, ADM1F can consistently complete a steady‐state simulation under 0.2 s, over 99% faster than a benchmark ADM1 model implemented with MATLAB while achieving agreement of model outputs within 1% of those obtained with the benchmark model. For dynamic simulations, however, ADM1F has a computational speed advantage only when the influent characteristics update more frequently than every 4 h. The ability of ADM1F to be useful as a tool to study anaerobic digestion systems is demonstrated through two example implementations of ADM1F: (1) a two‐phase co‐digestion scenario evaluating the impact of the organic loading rate and the substrate composition on reactor performance and stability, and (2) a conventional digester scenario assessing the effectiveness of recovery strategies after disruptions that led to instability. These examples demonstrate how the high simulation speed and the convenience of the iPython interface allow ADM1F to complete complex analyses within minutes, much faster than computational strategies currently reported in the literature.
Accurate modeling of gas hydrate reservoir productivity and geomechanical risks associated with subsurface dissociation of natural gas hydrates (NGH) requires the determination of model parameters through physical testing on natural hydrate-bearing sediments (HBS). This involves investigating the hydro-mechanical behavior of undisturbed hydrate samples from nature under in situ conditions using pressure core characterization and analysis, which provides a unique opportunity for research. By employing state-of-the-art micro computed tomography imagery on cryogenically preserved, hydrate-bearing sediment samples, we can determine hydrate saturation as well as permeability with and without the presence of hydrates in the sediment. Furthermore, utilizing a machine learning based image segmentation technique, it is possible to extract pore space and grain information. Subsections of the entire image volume were used to determine anisotropic permeabilities using a finite-difference method Stokes solver (FDMSS). Additionally, permeability measurements on whole pressure and temperature preserved hydrate-bearing core were analyzed by utilizing the National Energy Technology Laboratory’s (NETL) Pressure Core Characterization and X-ray CT Visualization Tool (PCXT) to manipulate, cut, and analyze pressure preserved sediment. Permeabilities were measured under a broad range of vertical stress states to simulate expected pressure changes during production scenarios, and the results show that permeabilities derived from images are in agreement with those from traditional core derived experiments. The collected stress-dependent permeability, permeability anisotropy, and corresponding gas hydrate saturations provide valuable input into numerical simulations of reservoir productivity. These properties have been proven to be key parameters determining a long-term reservoir response under depressurization.