Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data visualization and analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

A High Performance Computational Framework for Dynamic Security Assessment under Uncertainty

Dynamic security assessment (DSA) is a critical function to evaluate power grids’ capability to survive the transition caused by a set of disturbances to an acceptable steady-state condition. Its computational burden is heavy. With the challenges brought by renewable energy and new smart grid technologies, DSA under uncertainty has to be considered to study the impact of forecast errors on DSA simulation, which further increases the computational burden. To address this challenge, this paper presents a high performance computational framework to support DSA simulation user uncertainty. The computational framework aims to provide a seamless workflow that links data from high performance computing, statistical analysis, to visualization so that a problem can be easily expressed in a way compatible with different functions. It also enables software compatibility such that application development can be more efficient. Case study results of the ESCA60 system and a western U.S. size system show the advantages and efficiency of the computational framework.

dynamic security assessment, high performance comp↗
DOE OSTI2014

MemAxes Visualization Software

Hardware advancements such as Intel's PEBS and AMD's IBS, as well as software developments such as the perf_event API in Linux have made available the acquisition of memory access samples with performance information. MemAxes is a visualization and analysis tool for memory access sample data. By mapping the samples to their associated code, variables, node topology, and application dataset, MemAxes provides intuitive views of the data.

Source record↗
DOE OSTI2017

Build and Execute Environment

At exascale, the challenge becomes to develop applications that run at scale and use exascale platforms reliably, efficiently, and flexibly. Workflows become much more complex because they must seamlessly integrate simulation and data analytics. They must include down-sampling, post-processing, feature extraction, and visualization. Power and data transfer limitations require these analysis tasks to be run in-situ or in-transit. We expect successful workflows will comprise multiple linked simulations along with tens of analysis routines. Users will have limited development time at scale and, therefore, must have rich tools to develop, debug, test, and deploy applications. At this scale, successful workflows will compose linked computations from an assortment of reliable, well-defined computation elements, ones that can come and go as required, based on the needs of the workflow over time. We propose a novel framework that utilizes both virtual machines (VMs) and software containers to create a workflow system that establishes a uniform build and execution environment (BEE) beyond the capabilities of current systems. In this environment, applications will run reliably and repeatably across heterogeneous hardware and software. Containers, both commercial (Docker and Rocket) and open-source (LXC and LXD), define a runtime that isolates all software dependencies from the machine operating system. Workflows may contain multiple containers that run different operating systems, different software, and even different versions of the same software. We will run containers in open-source virtual machines (KVM) and emulators (QEMU) so that workflows run on any machine entirely in user-space. On this platform of containers and virtual machines, we will deliver workflow software that provides services, including repeatable execution, provenance, checkpointing, and future proofing. We will capture provenance about how containers were launched and how they interact to annotate workflows for repeatable and partial re-execution. We will coordinate the physical snapshots of virtual machines with parallel programming constructs, such as barriers, to automate checkpoint and restart. We will also integrate with HPC-specific container runtimes to gain access to accelerators and other specialized hardware to preserve native performance. Containers will link development to continuous integration. When application developers check code in, it will automatically be tested on a suite of different software and hardware architectures.

Guan, Qiang↗
DOE OSTI2023

AEflow (Autoencoder fluid flow compression network) [SWR-22-29]

As the size of turbulent flow simulations continues to grow, in situ data compression is becoming increasingly important for visualization, analysis, and restart checkpointing. For these applications, single-pass compression techniques with low computational and communication overhead are crucial. In this paper we present a deep-learning approach to in situ compression using an autoencoder architecture that is customized for three-dimensional turbulent flows and is well suited for contemporary heterogeneous computing resources. The autoencoder is compared against a recently introduced randomized single-pass singular value decomposition (SVD) for three different canonical turbulent flows: decaying homogeneous isotropic turbulence, a Taylor-Green vortex, and turbulent channel flow. Our proposed fully convolutional autoencoder architecture compresses turbulent flow snapshots by a factor of 64 with a single pass, allows for arbitrarily sized input fields, is cheaper to compute than the randomized single-pass SVD for typical simulation sizes, performs well on unseen flow configurations, and has been made publicly available. The results reported here show that the autoencoder dramatically outperforms a randomized single-pass SVD with similar compression ratio and yields comparable performance to a higher-rank decomposition with an order of magnitude less compression in regard to preserving a number of important statistical quantities such as turbulent kinetic energy, enstrophy, and Reynolds stresses.

King, Ryan↗
DOE OSTI2022

Web application for machining parameter recommendation using visual analytics

The computer codes create a web application including multiple user interfaces, visualizations, interaction modules between the user, and visualizations. The visualizations will be interactive, allowing users to query the data directly, and they will be arranged in a dashboard. When selections are made in one visualization, filters will be applied to all other visualizations providing a coordinated system for asking questions about the data. The visualization can be utilized for manufacturing data management, analysis, and recommendation.

Chae, Junghoon↗
DOE OSTI2023

ML for microbiomes

The software provides machine learning analysis and visualization to detect patterns in microbiome data, including topic modeling, probabilistic graphical modeling, conventional machine learning methods, and deep learning. The software is written in python and R, it uses some python and R libraries as well as big open-source libraries like sklearn, networkX, pytorch (python), pgmpy (python), and bnlearn (R). It also has a script to use for MALLET and DTM (open-source packages for topic modeling, written in Java).

Kim, Anastasiia↗
DOE OSTI2024

Machine learning tools for epigenetics

The software provides machine learning analysis and visualization to detect patterns in epigenetic data, including conventional machine learning and statistical methods, and open-source packages like pyBigWig (https://github.com/deeptools/pyBigWig) for data processing. The software is written in python, it uses some python libraries.

Kim, Anastasiia↗
DOE OSTI2014

Exercise Prevents Weight Gain and Alters the Gut Microbiota in a Mouse Model of High Fat Diet-Induced Obesity

Diet-induced obesity (DIO) is a significant health concern which has been linked to structural and functional changes in the gut microbiota. Exercise (Ex) is effective in preventing obesity, but whether Ex alters the gut microbiota during development with high fat (HF) feeding is unknown. Determine the effects of voluntary Ex on the gastrointestinal microbiota in LF-fed mice and in HF-DIO. Male C57BL/6 littermates (5 weeks) were distributed equally into 4 groups: low fat (LF) sedentary (Sed) LF/Sed, LF/ Ex, HF/Sed and HF/Ex. Mice were individually housed and LF/Ex and HF/Ex cages were equipped with a wheel and odometer to record Ex. Fecal samples were collected at baseline, 6 weeks and 12 weeks and used for bacterial DNA isolation. DNA was subjected both to quantitative PCR using primers specific to the 16S rRNA encoding genes for Bacteroidetes and Firmicutes and to sequencing for lower taxonomic identification using the Illumina MiSeq platform. Data were analyzed using a one or two-way ANOVA or Pearson correlation. HF diet resulted in significantly greater body weight and adiposity as well as decreased glucose tolerance that were prevented by voluntary Ex (p<0.05). Visualization of Unifrac distance data with principal coordinates analysis indicated clustering by both diet and Ex at week 12. Sequencing demonstrated Ex-induced changes in the percentage of major bacterial phyla at 12 weeks. A correlation between total Ex distance and the ΔCt Bacteroidetes: ΔCt Firmicutes ratio from qPCR demonstrated a significant inverse correlation (r 2 = 0.35, p = 0.043). Conclusion: Ex induces a unique shift in the gut microbiota that is different from dietary effects. Microbiota changes may play a role in Ex prevention of HF-DIO.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

RETRO RX

RETRO Rx is an R&D 100 Gold Award-winning suite of tools that provides a new class of analytics in the space between traditional epidemiological models and unanalyzed spreadsheets of data. Unlike traditional models, these tools provide analysts, scientists, practitioners, and decision makers a way to easily and effectively do sophisticated analyses using a simple user interface. AIDO guides users at the early stages of a disease outbreak by comparing the current parameters to historic outbreaks. RED Alert constructs a broad historical picture of disease incidence (recent outbreak included) to detect disease reemergence at its earliest stages, locally and globally. RETRO Rx compiles data and presents analysis in a clear, concise visual format to support disease mitigation and prevention planning. Both are available currently as web-based apps. A prototype of the RED Alert mobile app with enhanced functionality is available for beta testing and AIDO mobile app development is planned.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1981

Manual versus digital Landsat analysis for delineating river flooding

It has been found that flood boundary information derived from Landsat images, acquired at different flood stages, could be used to develop an empirical model for estimating the extent of flooding on the basis of in situ measurements of river discharge. An investigation was undertaken to determine whether improved results might have been obtained through digital image analysis or by including other Landsat spectral bands. The study area encompasses a highly flood-prone reach of the Black River in Lewis County, NY. It was found that visual analysis of aerial photographs and a Landsat band 7 image gave similar results. Visual and digital analysis of Landsat band 7 data gave similar results, and digital analysis of Landsat band 7 data gave results which were at least as good as digital analysis of combinations of spectral bands.

Philipson, W. R.↗
NASA NTRS1984

The role of the Automated Plate Measuring (APM) machine in developing a program to discover QSOs automatically

The scanning of a direct plate with the automatic plate measuring machine which results in the automated selection and description of images is described. The selection of QSO candidates based on color-color diagrams constructed from the APM image data and the analysis of APM raster data for QSOs selected visually from objective prism plates are also discussed.

Turnshek, D.↗
NASA NTRS1986

Experimental study of effects of forebody geometry on high angle of attack static and dynamic stability and control

A series of low-speed wind tunnel tests on a generic airplane model with a cylindrical fuselage were made to investigate the effects of forebody shape and fitness ratio, and fuselage/wing proximity on static and dynamic lateral/directional stability. In addition, some preliminary testing to determine the effectiveness of deflectable forebody strakes for high angle of attack yaw control was conducted. During the stability investigation, 11 forebodies were tested including three different cross-sectional shapes with fineness ratios of 2, 3, and 4. In addition, the wing was tested at two longitudinal positions to provide a substantial variation in forebody/wing proximity. Conventional force tests were conducted to determine static stability characteristics, and single-degree-of-freedom free-to-roll tests were conducted to study the wing rock characteristics of the model with the various forebodies. Flow visualization data were obtained to aid in the analysis of the complex flow phenomena involved. The results show that the forebody cross-sectional shape and fineness ratio and forebody/wing proximity can strongly affect both static and dynamic (roll) stability at high angles of attack. These characteristics result from the impact of these factors on forebody vortex development, the behavior of the vortices in sideslip, and their interaction with the wing flow field. Preliminary results from the deflectable strake investigation indicated that forebody flow control using this concept can provide very large yaw control moments at stall and post-stall angles of attack.

Brandon, J. M.↗
NASA NTRS2012

NASA Tech Briefs, November 2012

The topics include: Visual System for Browsing, Analysis, and Retrieval of Data (ViSBARD); Time-Domain Terahertz Computed Axial Tomography NDE System; Adaptive Sampling of Time Series During Remote Exploration; A Tracking Sun Photometer Without Moving Parts; Surface Temperature Data Analysis; Modular, Autonomous Command and Data Handling Software with Built-In Simulation and Test; In-Situ Wire Damage Detection System; Amplifier Module for 260-GHz Band Using Quartz Waveguide Transitions; Wideband Agile Digital Microwave Radiometer; Buckyball Nucleation of HiPco Tubes; FACT, Mega-ROSA, SOLAROSA; An Integrated, Layered-Spinel Composite Cathode for Energy Storage Applications; Engineered Multifunctional Surfaces for Fluid Handling; Polyolefin-Based Aerogels; Adjusting Permittivity by Blending Varying Ratios of SWNTs; Gravity-Assist Mechanical Simulator for Outreach; Concept for Hydrogen-Impregnated Nanofiber/Photovoltaic Cargo Stowage System; DROP: Durable Reconnaissance and Observation Platform; Developing Physiologic Models for Emergency Medical Procedures Under Microgravity; Spectroscopic Chemical Analysis Methods and Apparatus; Low Average Sidelobe Slot Array Antennas for Radiometer Applications; Motion-Corrected 3D Sonic Anemometer for Tethersondes and Other Moving Platforms; Water Treatment Systems for Long Spaceflights; Microchip Non-Aqueous Capillary Electrophoresis (MicronNACE) Method to Analyze Long-Chain Primary Amines; Low-Cost Phased Array Antenna for Sounding Rockets, Missiles, and Expendable Launch Vehicles; Mars Science Laboratory Engineering Cameras; Seismic Imager Space Telescope; Estimating Sea Surface Salinity and Wind Using Combined Passive and Active L-Band Microwave Observations; A Posteriori Study of a DNS Database Describing Super critical Binary-Species Mixing; Scalable SCPPM Decoder; QuakeSim 2.0; HURON (HUman and Robotic Optimization Network) Multi-Agent Temporal Activity Planner/Scheduler; MPST Software: MoonKommand

Source record↗
DOE OSTI2014

MemAxes Visualization Software

Hardware advancements such as Intel's PEBS and AMD's IBS, as well as software developments such as the perf_event API in Linux have made available the acquisition of memory access samples with performance information. MemAxes is a visualization and analysis tool for memory access sample data. By mapping the samples to their associated code, variables, node topology, and application dataset, MemAxes provides intuitive views of the data.

Source record↗
DOE OSTI2017

Build and Execute Environment

At exascale, the challenge becomes to develop applications that run at scale and use exascale platforms reliably, efficiently, and flexibly. Workflows become much more complex because they must seamlessly integrate simulation and data analytics. They must include down-sampling, post-processing, feature extraction, and visualization. Power and data transfer limitations require these analysis tasks to be run in-situ or in-transit. We expect successful workflows will comprise multiple linked simulations along with tens of analysis routines. Users will have limited development time at scale and, therefore, must have rich tools to develop, debug, test, and deploy applications. At this scale, successful workflows will compose linked computations from an assortment of reliable, well-defined computation elements, ones that can come and go as required, based on the needs of the workflow over time. We propose a novel framework that utilizes both virtual machines (VMs) and software containers to create a workflow system that establishes a uniform build and execution environment (BEE) beyond the capabilities of current systems. In this environment, applications will run reliably and repeatably across heterogeneous hardware and software. Containers, both commercial (Docker and Rocket) and open-source (LXC and LXD), define a runtime that isolates all software dependencies from the machine operating system. Workflows may contain multiple containers that run different operating systems, different software, and even different versions of the same software. We will run containers in open-source virtual machines (KVM) and emulators (QEMU) so that workflows run on any machine entirely in user-space. On this platform of containers and virtual machines, we will deliver workflow software that provides services, including repeatable execution, provenance, checkpointing, and future proofing. We will capture provenance about how containers were launched and how they interact to annotate workflows for repeatable and partial re-execution. We will coordinate the physical snapshots of virtual machines with parallel programming constructs, such as barriers, to automate checkpoint and restart. We will also integrate with HPC-specific container runtimes to gain access to accelerators and other specialized hardware to preserve native performance. Containers will link development to continuous integration. When application developers check code in, it will automatically be tested on a suite of different software and hardware architectures.

Guan, Qiang↗
DOE OSTI2017

Design and implementation of HuREX analysis supporting interface - 171

Human error is recognized as one of the main causes to affect to the socio-technical system including nuclear power plant. Therefore, reducing human error through human reliability analysis (HRA) is a critical issue. Moreover, sufficient and reliable human performance data collection is a prerequisite for ensuring the safety of nuclear power plants. Korea Atomic Energy Research Institute developed the HuREX (Human Reliability data Extraction) framework to collect and analyze the responses of human operators from simulator training records of nuclear power plant. Thus, the development and computer software interfaces of the database are essential to efficiently support human reliability analysis. In this study, OPERA database was developed in accordance with the following process. First, the essential data required for the HRA analysis (e.g., plant data, procedures, system and equipment info, operating crews, results of simulator experiments, and so forth) was stored in the database. In addition, standardized procedures and related items were stored in the database to support HRA quantification. A data structure was developed to store crew responses conducted by operators to cope with an emergency situation during simulator experiments. In addition, various interfaces that escalate efficiency of the HuREX applications were developed. The HuREX analysis support interface was developed with HuREX Video Analyzer for observation of simulator collection data (e.g., audio-visual records, plant parameters, operator's action logs) and HuREX Data Analyzer for analysis of operator's conducted task. By using the OPERA database and HuREX analysis support interface developed through this research, maximizing the efficiency of human reliability analysis based on simulator training data. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS1976

Solar heating and cooling technical data and systems analysis

The accomplishments of a project to study solar heating and air conditioning are outlined. Presentation materials (data packages, slides, charts, and visual aids) were developed. Bibliographies and source materials on materials and coatings, solar water heaters, systems analysis computer models, solar collectors and solar projects were developed. Detailed MIRADS computer formats for primary data parameters were developed and updated. The following data were included: climatic, architectural, topography, heating and cooling equipment, thermal loads, and economics. Data sources in each of these areas were identified as well as solar radiation data stations and instruments.

Christensen, D. L.↗
DOE OSTI2026

Vulcan-Forge: Architecture and Design of a Multi-Modal Forensic Analysis Plugin for CALDERA

Forge and VULCAN together describe an open-architecture cybersecurity analysis ecosystem that unifies forensic artifact processing, detection engineering, and vulnerability intelligence within integrated platforms. Forge operates as a plugin for MITRE CALDERA, ingesting diverse evidence formats—including EVTX, PCAP/PCAPNG, CSV, JSON, YAML, XML, binaries, and archives—to construct a unified artifact graph enriched with severity scoring, TLP classification, and audit trails. It provides subsystems for artifact parsing, streaming structured-data visualization, NetworkMiner-based packet inspection, PE/.NET binary analysis, and LLM-assisted triage and rule generation, with outputs validated against CCCS-YARA and pySigma schemas. VULCAN complements this by serving as a cybersecurity analyst platform that integrates a Neo4j knowledge graph, Qdrant vector retrieval, SSVC-based triage, and a local LLM to deliver CVE intelligence and forensic analysis through a multi-source ingest pipeline drawing from NVD, CISA KEV, EPSS, MITRE ATT&CK, and CAPEC. Together, they bridge structured threat intelligence with automated forensic analysis and detection workflows.

97 MATHEMATICS AND COMPUTING↗