SEARCH · Engineering Papers

Results for “data analysis, visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

All sources NASA NTRS DOE OSTI

DOE OSTI2025

MODE: A Web Application for Interactive Visualization and Exploration of Omics Data

Studies generating transcriptomics, proteomics, lipidomics, and metabolomics (colloquially referred to as “omics”) data allow researchers to find biomarkers or molecular targets, or understand complex biological structures and functions by identifying changes in biomolecule abundance and expression between experimental conditions. Omics data is multi-dimensional and oftentimes summarization techniques such as principal component analysis (PCA) are used to identify high-level patterns in data. Though useful, these summaries don’t allow exploration of detailed patterns in omics data that may have biological relevance. The use of interactive HTML displays with plots allows researchers to interact with omics data at a detailed level, but building these displays requires significant coding expertise. To overcome this barrier, the software MODE was built to empower users to build their own interactive HTML displays to support scientific discovery. These displays are easily shareable, do not depend on a specific operating system, and allow users to effortlessly sort and filter plots by categorical or numerical variables. MODE allows users to build and share these displays with several options for plot design and meta selection. In conclusion, the MODE web application and its capabilities are presented and then demonstrated on lipidomics data from a leaf wounding study.

lipidomics↗

DOE OSTI2025

Evaluating HPC Scheduling Strategies for Urgent Workloads

Scientific computing centers increasingly face workloads with diverse urgency requirements, driven by applications that demand rapid or even immediate execution. Appropriately configured scheduling policies can significantly improve both user satisfaction and overall cluster utilization. In this work, we present a systematic analysis of scheduler configurations under scenarios where a fraction of jobs have urgent computing needs. We evaluate multiple job scheduling simulators, develop a lightweight job-submission emulation framework, and create tools to analyze and visualize the resulting scheduling data. Our study identifies key trade-offs between responsiveness, fairness, and efficiency, and offers a set of practical scheduling configurations (particularly for Slurm) that can be tailored to HPC environments supporting mixed-urgency workloads.

Maheshwari, Ketan [ORNL] (ORCID:000000033800662X)↗

DOE OSTI2021

Quality Assurance and Quality Control (QA/QC) of Meteorological Time Series Data for Billy Barr, East River, Colorado USA

A comprehensive Quality Assurance (QA) and Quality Control (QC) statistical framework consists of three major phases: Phase 1—Preliminary raw data sets exploration, including time formatting and combining datasets of different lengths and different time intervals; Phase 2—QA of the datasets, including detecting and flagging of duplicates, outliers, and extreme values; and Phase 3—the development of time series of a desired frequency, imputation of missing values, visualization and a final statistical summary. The time series data collected at the Billy Barr meteorological station (East River Watershed, Colorado) were analyzed. The developed statistical framework is suitable for both real-time and post-data-collection QA/QC analysis of meteorological datasets.The files that are in this data package include one excel file, converted to CSV format (Billy_Barr_raw_qaqc.csv) that contains the raw meteorological data, i.e., input data used for the QA/QC analysis. The second CSV file (Billy_Barr_1hr.csv) is the QA/QC and flagged meteorological data, i.e., output data from the QA/QC analysis. The last file (QAQC_Billy_Barr_2021-03-22.R) is a script written in R that implements the QA/QC and flagging process. The purpose of the CSV data files included in this package is to provide input and output files implemented in the R script.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

The maximum extent of the filaments and sheets in the cosmic web: an analysis of the SDSS DR17

Filaments and sheets are striking visual patterns in cosmic web. The maximum extent of these large-scale structures are difficult to determine due to their structural variety and complexity. We construct a volume-limited sample of galaxies in a cubic region from the SDSS, divide it into smaller subcubes and shuffle them around. We quantify the average filamentarity and planarity in the 3D galaxy distribution as a function of the density threshold and compare them with those from the shuffled realizations of the original data. The analysis is repeated for different shuffling lengths by varying the size of the subcubes. The average filamentarity and planarity in the shuffled data show a significant reduction when the shuffling scales are smaller than the maximum size of the genuine filaments and sheets. We observe a statistically significant reduction in these statistical measures even at a shuffling scale of $\sim 130 \, {{\, \rm Mpc}}$, indicating that the filaments and sheets in three dimensions can extend up to this length scale. They may extend to somewhat larger length scales that are missed by our analysis due to the limited size of the SDSS data cube. We expect to determine these length scales by applying this method to deeper and larger surveys in future.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2024

Time-series metagenomics reveals changing protistan ecology of a temperate dimictic lake

Abstract Background Protists, single-celled eukaryotic organisms, are critical to food web ecology, contributing to primary productivity and connecting small bacteria and archaea to higher trophic levels. Lake Mendota is a large, eutrophic natural lake that is a Long-Term Ecological Research site and among the world’s best-studied freshwater systems. Metagenomic samples have been collected and shotgun sequenced from Lake Mendota for the last 20 years. Here, we analyze this comprehensive time series to infer changes to the structure and function of the protistan community and to hypothesize about their interactions with bacteria. Results Based on small subunit rRNA genes extracted from the metagenomes and metagenome-assembled genomes of microeukaryotes, we identify shifts in the eukaryotic phytoplankton community over time, which we predict to be a consequence of reduced zooplankton grazing pressures after the invasion of a invasive predator (the spiny water flea) to the lake. The metagenomic data also reveal the presence of the spiny water flea and the zebra mussel, a second invasive species to Lake Mendota, prior to their visual identification during routine monitoring. Furthermore, we use species co-occurrence and co-abundance analysis to connect the protistan community with bacterial taxa. Correlation analysis suggests that protists and bacteria may interact or respond similarly to environmental conditions. Cryptophytes declined in the second decade of the timeseries, while many alveolate groups (e.g., ciliates and dinoflagellates) and diatoms increased in abundance, changes that have implications for food web efficiency in Lake Mendota. Conclusions We demonstrate that metagenomic sequence-based community analysis can complement existing efforts to monitor protists in Lake Mendota based on microscopy-based count surveys. We observed patterns of seasonal abundance in microeukaryotes in Lake Mendota that corroborated expectations from other systems, including high abundance of cryptophytes in winter and diatoms in fall and spring, but with much higher resolution than previous surveys. Our study identified long-term changes in the abundance of eukaryotic microbes and provided context for the known establishment of an invasive species that catalyzes a trophic cascade involving protists. Our findings are important for decoding potential long-term consequences of human interventions, including invasive species introduction.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2020

Dynamic compressed sensing for real-time tomographic reconstruction

Electron tomography has achieved higher resolution and quality at reduced doses with recent advances in compressed sensing. Compressed sensing (CS) exploits the inherent sparse signal structure to efficiently reconstruct three-dimensional (3D) volumes at the nanoscale from undersampled measurements. However, the process bottlenecks 3D reconstruction with computation times that run from hours to days. Here we demonstrate a framework for dynamic compressed sensing that produces a 3D specimen structure that updates in real-time as new specimen projections are collected. Researchers can begin interpreting 3D specimens as data is collected to facilitate high-throughput and interactive analysis. Using scanning transmission electron microscopy (STEM), we show that dynamic compressed sensing accelerates the convergence speed by ~3-fold while also reducing its error by 27% for a Au/SrTiO 3 nanoparticle specimen. Before a tomography experiment is completed, the 3D tomogram has interpretable structure within ~33% of completion and fine details are visible as early as ~66%. Upon completion of an experiment, a high-fidelity 3D visualization is produced without further delay. Additionally, we report reconstruction parameters that tune data fidelity can be manipulated throughout the computation without re-running the entire process.

47 OTHER INSTRUMENTATION↗

DOE OSTI2024

Spatially Resolved Raman Spectroscopic Investigation of Uranyl Fluoride: A Case Study in the Importance of Instrument Optimization

Raman spectroscopy is an emerging technique for rapid and nondestructive analysis of nuclear materials for forensic and nonproliferation applications as it is a powerful tool for distinguishing multiple chemical forms of materials with similar stoichiometries. Recent developments in spectroscopic software have enabled rapid data collection with high-speed Raman spectroscopic mapping capabilities. However, some uranium-rich materials are susceptible to degradation in humid air and/or laser-induced phase transformations. To mitigate environmental or measurement-related sample degradation of potential samples of interest, we have taken a systematic approach to define optimized data collection parameters for high-throughput measurements of uranyl fluoride (UO 2 F 2 ), which is an important intermediate material in the nuclear fuel cycle. First, we systematically describe the influence of optical magnification (5× to 100×), laser power, and exposure time on obtained signal for identical particles of UO 2 F 2 and find that at low laser power and exposure times, comparable signal is obtained regardless of optical magnification. Second, we ensure sample integrity during data collection, and third, collect spectroscopic maps that employ optimized parameters to reduce the time required to obtain spatially resolved spectroscopic information. Reductions of 90% and 99% in measurement times are discussed as they relate to differences in resolving spectroscopic features of particles in identical mapping areas. Finally, during this work, we found that additional data processing options were needed and thus developed a customized Python script for importing, processing, analyzing, and visualizing Raman spectroscopic map data.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2025

Meeting Global Health Needs via Infectious Disease Forecasting: Development of a Reliable Data-Driven Framework

Infectious diseases (IDs) have a significant detrimental impact on global health. Timely and accurate ID forecasting can result in more informed implementation of control measures and prevention policies. To meet the operational decision-making needs of real-world circumstances, we aimed to build a standardized, reliable, and trustworthy ID forecasting pipeline and visualization dashboard that is generalizable across a wide range of modeling techniques, IDs, and global locations. We forecasted 6 diverse, zoonotic diseases (brucellosis, campylobacteriosis, Middle East respiratory syndrome, Q fever, tick-borne encephalitis, and tularemia) across 4 continents and 8 countries. We included a wide range of statistical, machine learning, and deep learning models (n=9) and trained them on a multitude of features (average n=2326) within the One Health landscape, including demography, landscape, climate, and socioeconomic factors. The pipeline and dashboard were created in consideration of crucial operational metrics—prediction accuracy, computational efficiency, spatiotemporal generalizability, uncertainty quantification, and interpretability—which are essential to strategic data-driven decisions. While no single best model was suitable for all disease, region, and country combinations, our ensemble technique selects the best-performing model for each given scenario to achieve the closest prediction. For new or emerging diseases in a region, the ensemble model can predict how the disease may behave in the new region using a pretrained model from a similar region with a history of that disease. The data visualization dashboard provides a clean interface of important analytical metrics, such as ID temporal patterns, forecasts, prediction uncertainties, and model feature importance across all geographic locations and disease combinations. As the need for real-time, operational ID forecasting capabilities increases, this standardized and automated platform for data collection, analysis, and reporting is a major step forward in enabling evidence-based public health decisions and policies for the prevention and mitigation of future ID outbreaks.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2022

Correlative image learning of chemo-mechanics in phase-transforming solids

We report constitutive laws underlie most physical processes in nature. However, learning such equations in heterogeneous solids (for example, due to phase separation) is challenging. One such relationship is between composition and eigenstrain, which governs the chemo-mechanical expansion in solids. Here we developed a generalizable, physically constrained image-learning framework to algorithmically learn the chemo-mechanical constitutive law at the nanoscale from correlative four-dimensional scanning transmission electron microscopy and X-ray spectro-ptychography images. We demonstrated this approach on Li X FePO 4 , a technologically relevant battery positive electrode material. We uncovered the functional form of the composition–eigenstrain relation in this two-phase binary solid across the entire composition range (0 ≤ X ≤ 1), including inside the thermodynamically unstable miscibility gap. The learned relation directly validates Vegard’s law of linear response at the nanoscale. Our physics-constrained data-driven approach directly visualizes the residual strain field (by removing the compositional and coherency strain), which is otherwise impossible to quantify. Heterogeneities in the residual strain arise from misfit dislocations and were independently verified by X-ray diffraction line profile analysis. Our work provides the means to simultaneously quantify chemical expansion, coherency strain and dislocations in battery electrodes, which has implications on rate capabilities and lifetime. Broadly, this work also highlights the potential of integrating correlative microscopy and image learning for extracting material properties and physics.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Floating Wind Array Ontology and Modeling Framework

While there are many tools for designing and modeling a single floating turbine, array level design and modeling has much more to consider. Designing floating wind arrays requires a coupled approach considering many variables, from bathymetry to installation and maintenance to failure and risk analysis. With all of these considerations, an array-level modeling tool is needed to quickly evaluate array designs. The Floating Array Model (FAModel) tool developed at the National Renewable Energy Laboratory was created to fill this gap in low-fidelity array modeling. FAModel is a python framework created to streamline holistic low-fidelity floating wind modeling for array-level analysis. FAModel integrates site data and models with a variety of open-source modeling tools developed by NREL, including FLORIS, RAFT, MoorPy, and anchor capacity models. The integration of these tools allows users to quickly and holistically design an array by considering forces, area analysis, visualization, annual energy production, failure modeling, and component costs.

17 WIND ENERGY↗

DOE OSTI2022

Unsupervised Machine Learning for Exploratory Data Analysis of Exoplanet Transmission Spectra

Abstract Transit spectroscopy is a powerful tool for decoding the chemical compositions of the atmospheres of extrasolar planets. In this paper, we focus on unsupervised techniques for analyzing spectral data from transiting exoplanets. After cleaning and validating the data, we demonstrate methods for: (i) initial exploratory data analysis, based on summary statistics (estimates of location and variability); (ii) exploring and quantifying the existing correlations in the data; (iii) preprocessing and linearly transforming the data to its principal components; (iv) dimensionality reduction and manifold learning; (v) clustering and anomaly detection; and (vi) visualization and interpretation of the data. To illustrate the proposed unsupervised methodology, we use a well-known public benchmark data set of synthetic transit spectra. We show that there is a high degree of correlation in the spectral data, which calls for appropriate low-dimensional representations. We explore a number of different techniques for such dimensionality reduction and identify several suitable options in terms of summary statistics, principal components, etc. We uncover interesting structures in the principal component basis, namely well-defined branches corresponding to different chemical regimes of the underlying atmospheres. We demonstrate that those branches can be successfully recovered with a K-means clustering algorithm in a fully unsupervised fashion. We advocate for lower-dimensional representations of the spectroscopic data in terms of the main principal components, in order to reveal the existing structure in the data and quickly characterize the chemical class of a planet.

Matchev, Konstantin T. (ORCID:0000000341829096)↗

DOE OSTI2023

Investigation of thermal hydraulic behavior of the High Temperature Test Facility's lower plenum via large eddy simulation

A high-fidelity computational fluid dynamics (CFD) analysis was performed using the Large Eddy Simulation (LES) model for the lower plenum of the High–Temperature Test Facility (HTTF), a ¼ scale test facility of the modular high temperature gas-cooled reactor (MHTGR) managed by Oregon State University. In most next–generation nuclear reactors, thermal stress due to thermal striping is one of the risks to be curiously considered. This is also true for HTGRs, especially since the exhaust helium gas temperature is high. In order to evaluate these risks and performance, organizations in the United States led by the OECD NEA are conducting a thermal hydraulic code benchmark for HTGR, and the test facility used for this benchmark is HTTF. HTTF can perform experiments in both normal and accident situations and provide high-quality experimental data. However, it is difficult to provide sufficient data for benchmarking through experiments, and there is a problem with the reliability of CFD analysis results based on Reynolds–averaged Navier–Stokes to analyze thermal hydraulic behavior without verification. To solve this problem, high-fidelity 3-D CFD analysis was performed using the LES model for HTTF. It was also verified that the LES model can properly simulate this jet mixing phenomenon via a unit cell test that provides experimental information. As a result of CFD analysis, the lower the dependency of the sub-grid scale model, the closer to the actual analysis result. In the case of unit cell test CFD analysis and HTTF CFD analysis, the volume-averaged sub-grid scale model dependency was calculated to be 13.0% and 9.16%, respectively. As a result of HTTF analysis, quantitative data of the fluid inside the HTTF lower plenum was provided in this paper. As a result of qualitative analysis, the temperature was highest at the center of the lower plenum, while the temperature fluctuation was highest near the edge of the lower plenum wall. The power spectral density of temperature was analyzed via fast Fourier transform (FFT) for specific points on the center and side of the lower plenum. FFT results did not reveal specific frequency-dominant temperature fluctuations in the center part. It was confirmed that the temperature power spectral density (PSD) at the top increased from the center to the wake. The vortex was visualized using the well-known scalar Q-criterion, and as a result, the closer to the outlet duct, the greater the influence of the mainstream, so that the inflow jet vortex was dissipated and mixed at the top of the lower plenum. Additionally, FFT analysis was performed on the support structure near the corner of the lower plenum with large temperature fluctuations, and as a result, it was confirmed that the temperature fluctuation of the flow did not have a significant effect near the corner wall. In addition, the vortices generated from the lower plenum to the outlet duct were identified in this paper. It is considered that the quantitative and qualitative results presented in this paper will serve as reference data for the benchmark.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Hydropower Resilience Database for Assessing Microgrid Formation Capability and Enhancing Power Grid Resilience

In the face of increasing frequency of extreme events, enhancing resilience and reliability of energy infrastructure demands innovative solutions. Hydropower, with its inherent generation flexibility and grid-forming capability, offers significant potential for enhancing power grid resilience through the establishment of microgrids. To enable informed decision-making and strategic planning, we present the Hydropower Resilience Database (HRD) that integrates data from various sources such as Oakridge National Laboratory (ORNL) HydroSource, National Inventory of Dams, and US Western Grid database. By integrating relevant information on hydropower plant characteristics, including dams, reservoirs, and connected electrical grid, this resource enables hydropower plant owners, utilities, and community stakeholders to identify and evaluate the feasibility of using hydropower resources in microgrids to support nearby communities and critical infrastructure in various challenging scenarios. Using HRD, a set of metrics are evaluated to quantify the capability of hydropower plants to support essential microgrid functions. An interactive tool is developed using ArcGIS, enabling the visualization and analysis using HRD. Our research contributes to strategic planning efforts for fortifying energy infrastructure, ensuring reliable power supply during disruptions, and advancing the development of robust and resilient energy systems in regions susceptible to grid vulnerabilities.

13 HYDRO ENERGY↗

DOE OSTI2023

Hydropower Resilience Database for Assessing Microgrid Formation Capability and Enhancing Power Grid Resilience

13 HYDRO ENERGY↗

DOE OSTI2024

Large-Scale Visualization of 3D Unstructured Groundwater Model Using Cave Automated Virtual Environment

The immersive three-dimensional (3D) virtual reality (VR) visualization of groundwater models allows us to deepen our understanding of aquifer systems and provide better solutions to present groundwater-related problems, such as groundwater recharge, water quality, and sustainability. Visualization assists in accurately developing groundwater models and revealing important subsurface features, including faulting, folding, and unconformity. However, assessing model accuracy poses challenges due to the complexity of geology and groundwater systems. This research demonstrates a workflow to visualize and analyze raw 3D unstructured groundwater model data using an immersive Cave Automated Virtual Environment (CAVE). To visualize the unstructured groundwater model data, the raw dataset is converted into interactive CAVE-compatible formats utilizing a set of tools: ParaView, Blender, and Unity. This enables researchers to immerse themselves in the data, identifying influential patterns and relationships. e resulting insights can inform the development of sophisticated machine-learning models for groundwater level prediction. The CAVE’s immersive capabilities allow intuitive exploration from various perspectives, providing a more holistic understanding of the factors affecting groundwater levels. These insights are crucial to improve predictive models. The CAVE results also facilitate collaborative analysis and have potential applications in training and education. is research demonstrates the value of immersive VR tools such as the CAVE for unraveling intricacies within high-dimensional scientific data to drive real-world forecasting and modeling applications.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Entropy-driven melting point depression in fcc HEAs

High Entropy Alloys (HEAs) are an increasingly dominant alloy design paradigm. The premise of entropic stabilization of single-phase alloys has motivated much of the research on HEAs. Chemical complexity may indeed help stabilize single alloy phases relative to other lower-entropy competing solid phases. Paradoxically, this complexity may de-stabilize these alloys against the liquid phase, potentially limiting the application space of HEAs at elevated temperatures. In this work, we carry out a comprehensive investigation of the phase stability in the fcc CoCrFeMnNiV-Al HEA space using a state of the art CALPHAD database. By using modern visualization techniques and statistical analysis we examine the trade-off between chemical complexity and stability against the liquid state and identify a potentially difficult to overcome barrier for development of high temperature alloys, at least within the conventional fcc HEA space. Here, limited experimental data seem to be consistent with this analysis.

36 MATERIALS SCIENCE↗

DOE OSTI2021

Detection of the Metabolic Response to Drought Stress Using Hyperspectral Reflectance

Drought is the most important limitation on crop yield. Understanding and detecting drought stress in crops is vital for improving water use efficiency through effective breeding and management. Leaf reflectance spectroscopy offers a rapid, non-destructive alternative to traditional techniques for measuring plant traits involved in a drought response. We measured drought stress in six glasshouse-grown agronomic species using physiological, biochemical and spectral data. In contrast to physiological traits, leaf metabolite concentrations revealed drought stress before it was visible to the naked eye. We used full-spectrum leaf reflectance data to predict metabolite concentrations using partial least-squares regression, with validation R2 values of 0.49 to 0.87. We show for the first time that spectroscopy may be used for the quantitative estimation of proline and abscisic acid, demonstrating the first use of hyperspectral data to detect a phytohormone. We used linear discriminant analysis and partial least squares discriminant analysis to differentiate between droughted and watered plants based on measured traits (accuracy: 71%) and raw spectral data (66%). Finally, we validated our glasshouse-developed models in an independent field trial. We demonstrate that spectroscopy can detect drought stress via underlying biochemical changes, before visual differences occur, representing a powerful advance for measuring limitations on yield.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Picometer-Precision Atomic Position Tracking through Electron Microscopy

The modern aberration-corrected scanning electron microscopes have successfully achieved direct visualization of atomic columns with sub-angstrom resolution. With this significant progress, advanced image quantification and analysis is still at its early stages. In this work, we present the complete pathway for the metrology of atomic resolution STEM images. This includes: 1) tips for acquiring high-quality STEM images; 2) denoising and drift-correction for enhancing measurement accuracy; 3) obtaining initial atom positions; 4) indexing the atoms based on unit cell vectors; 4) quantifying the atom column positions with either 2D-gaussian single peak fitting or 5) multi-peak fitting routines for slightly overlapping atomic columns; 6) quantification of lattice distortion/strain within the crystal structures or at the defects/interfaces where the lattice periodicity is disrupted, and 7) some common methods to visualize and present the analysis. Furthermore, a simple self-developed free MATLAB app (EASY-STEM) with a graphical user interface (GUI) will be introduced that can help with the analysis of STEM images without the need for writing dedicated analysis code or software. The advanced data analysis methods presented here can be applied for the local quantification of defect relaxations, local structural distortions, local phase transformations, and non-centrosymmetry in a wide range of materials.

47 OTHER INSTRUMENTATION↗