Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Visual Modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
NASA NTRS2015

Measuring and Modeling Shared Visual Attention

Multi-person teams are sometimes responsible for critical tasks, such as flying an airliner. Here we present a method using gaze tracking data to assess shared visual attention, a term we use to describe the situation where team members are attending to a common set of elements in the environment. Gaze data are quantized with respect to a set of N areas of interest (AOIs); these are then used to construct a time series of N dimensional vectors, with each vector component representing one of the AOIs, all set to 0 except for the component corresponding to the currently fixated AOI, which is set to 1. The resulting sequence of vectors can be averaged in time, with the result that each vector component represents the proportion of time that the corresponding AOI was fixated within the given time interval.We present two methods for comparing sequences of this sort, one based on computing the time varying correlation of the averaged vectors, and another based on a chi-square test testing the hypothesis that the observed gaze proportions are drawn from identical probability distributions.We have evaluated the method using synthetic data sets, in which the behavior was modeled as a series of activities, each of which was modeled as a first-order Markov process. By tabulating distributions for pairs of identical and disparate activities, we are able to perform a receiver operating characteristic (ROC) analysis, allowing us to choose appropriate criteria and estimate error rates. Using these criteria, we have applied the methods to data from airline crews, collected in a high-fidelity flight simulator (Gontar Hoermann, 2014). We conclude by considering the problem of automatic (blind) discovery of activities, using methods developed for text analysis.

Mulligan, Jeffrey B.↗
NASA NTRS2016

Measuring and Modeling Shared Visual Attention

Multi-person teams are sometimes responsible for critical tasks, such as flying an airliner. Here we present a method using gaze tracking data to assess shared visual attention, a term we use to describe the situation where team members are attending to a common set of elements in the environment. Gaze data are quantized with respect to a set of N areas of interest (AOIs); these are then used to construct a time series of N dimensional vectors, with each vector component representing one of the AOIs, all set to 0 except for the component corresponding to the currently fixated AOI, which is set to 1. The resulting sequence of vectors can be averaged in time, with the result that each vector component represents the proportion of time that the corresponding AOI was fixated within the given time interval. We present two methods for comparing sequences of this sort, one based on computing the time-varying correlation of the averaged vectors, and another based on a chi-square test testing the hypothesis that the observed gaze proportions are drawn from identical probability distributions.We have evaluated the method using synthetic data sets, in which the behavior was modeled as a series of activities, each of which was modeled as a first-order Markov process. By tabulating distributions for pairs of identical and disparate activities, we are able to perform a receiver operating characteristic (ROC) analysis, allowing us to choose appropriate criteria and estimate error rates.We have applied the methods to data from airline crews, collected in a high-fidelity flight simulator (Haslbeck, Gontar Schubert, 2014). We conclude by considering the problem of automatic (blind) discovery of activities, using methods developed for text analysis.

attention↗
NASA NTRS2016

Measuring and Modeling Shared Visual Attention

Multi-person teams are sometimes responsible for critical tasks, such as flying an airliner. Here we present a method using gaze tracking data to assess shared visual attention, a term we use to describe the situation where team members are attending to a common set of elements in the environment. Gaze data are quantized with respect to a set of N areas of interest (AOIs); these are then used to construct a time series of N dimensional vectors, with each vector component representing one of the AOIs, all set to 0 except for the component corresponding to the currently fixated AOI, which is set to 1. The resulting sequence of vectors can be averaged in time, with the result that each vector component represents the proportion of time that the corresponding AOI was fixated within the given time interval. We present two methods for comparing sequences of this sort, one based on computing the time-varying correlation of the averaged vectors, and another based on a chi-square test testing the hypothesis that the observed gaze proportions are drawn from identical probability distributions. We have evaluated the method using synthetic data sets, in which the behavior was modeled as a series of "activities," each of which was modeled as a first-order Markov process. By tabulating distributions for pairs of identical and disparate activities, we are able to perform a receiver operating characteristic (ROC) analysis, allowing us to choose appropriate criteria and estimate error rates. We have applied the methods to data from airline crews, collected in a high-fidelity flight simulator (Haslbeck, Gontar & Schubert, 2014). We conclude by considering the problem of automatic (blind) discovery of activities, using methods developed for text analysis.

attention↗
DOE OSTI2021

Instruction Roofline: An insightful visual performance model for GPUs

The Roofline performance model provides an intuitive approach to identify performance bottlenecks and guide performance optimization. However, the classic FLOP-centric approach is inappropriate for the emerging applications that perform more integer operations than floating point operations. In this article, we reintroduce our Instruction Roofline Model on NVIDIA GPUs and expand our evaluation of it. The Instruction Roofline incorporates instructions and memory transactions across all memory hierarchies together, and provides more performance insights than the FLOP-oriented Roofline Model, that is, instruction throughput, stride memory access patterns, bank conflicts, and thread predication. We use our Instruction Roofline methodology to analyze eight proxy applications: HPGMG from AMReX, Matrix Transpose benchmarks, ADEPT from MetaHipMer's sequence alignment phase, EXTENSION from MetaHipMer's local assembly phase, CUSP, cuSPARSE, cudaTensorCoreGemm, and cuBLAS. We demonstrate the ability of our methodology to understand various aspects of performance and performance bottlenecks on NVIDIA GPUs and motivate code optimizations.

Ding, N↗
DOE OSTI2024

Double Visual Defense Models

Explore the source record for details and available documents.

Bartoldson, Brian R [Lawrence Livermore National L↗
NASA NTRS1993

A visual detection model for DCT coefficient quantization

The discrete cosine transform (DCT) is widely used in image compression, and is part of the JPEG and MPEG compression standards. The degree of compression, and the amount of distortion in the decompressed image are determined by the quantization of the transform coefficients. The standards do not specify how the DCT coefficients should be quantized. Our approach is to set the quantization level for each coefficient so that the quantization error is at the threshold of visibility. Here we combine results from our previous work to form our current best detection model for DCT coefficient quantization noise. This model predicts sensitivity as a function of display parameters, enabling quantization matrices to be designed for display situations varying in luminance, veiling light, and spatial frequency related conditions (pixel size, viewing distance, and aspect ratio). It also allows arbitrary color space directions for the representation of color.

Ahumada, Albert J., Jr.↗
NASA NTRS2003

Modeling and Visualizing Uncertainty in Continuous Variables Predicted using Remotely Sensed Data

The use of remotely sensed images to map continuous biophysical variables, such as those related to terrestrial vegetation amount, sea surface temperature, and many other targets of NASA s Earth Observing System (EOS), includes variable, parametric, positional, spatial support and structural sources of uncertainty. A complete description of uncertainty will lead to a probability distribution at each location, allowing the exploration of the spatial dimension of uncertainty, that is, where the field is not well quantified. To achieve this purpose, convenient visualization tools are required. We have produced such a tool, called PDFVis, that facilitates the display of probability density functions (pdfs) on a per-grid-cell basis. The density estimate from Monte-Carlo generated realizations is interactively displayed as well as parametric and non-parametric summaries of the pdf field (such as mean, median, quartiles, standard deviation, number of modes, and locations of modes). Shaded surface renderings of pdfs along a transect can also be projected onto a plane. This tool will become more useful as richer descriptions of spatial uncertainty become available.

Dungan, Jennifer L.↗
NASA NTRS1992

A novel visual hardware behavioral language

Most hardware behavioral languages just use texts to describe the behavior of the desired hardware design. This is inconvenient for VLSI designers who enjoy using the schematic approach. The proposed visual hardware behavioral language has the ability to graphically express design information using visual parallel models (blocks), visual sequential models (processes) and visual data flow graphs (which consist of primitive operational icons, control icons, and Data and Synchro links). Thus, the proposed visual hardware behavioral language can not only specify hardware concurrent and sequential functionality, but can also visually expose parallelism, sequentiality, and disjointness (mutually exclusive operations) for the hardware designers. That would make the hardware designers capture the design ideas easily and explicitly using this visual hardware behavioral language.

Li, Xueqin↗
DOE OSTI2025

STREAM: A technology planning and capacity expansion model for the industrial sector

The Strategic Technology Roadmapping and Energy, Environmental, and Economic Analysis Model—STREAM—is an optimization-based modeling tool and analysis framework to assist with strategic planning and technology investments of the industrial sector. This open-source framework is written in Julia using the JuMP package, which enables users to model future “pathways” for incumbent and future production technologies, costs, fuels and energy carriers, and energy and non-energy environmental impacts from industries as they transform in pursuit of a robust and competitive manufacturing sector. The model starts with an initial stock of industrial production technologies and assets at a facility level and then determines pathways that minimize cost, subject to an array of possible constraints on demand, market shares, environmental flows, and other exogenously specified operational considerations such as capacity utilization rates or regional energy costs. Key features of the framework include flexibility to model a wide range of industries and industrial technologies/processes at varying levels of granularity, ability to perform parametric sensitivity analyses, and ability to visualize model results using visualization objects.

capacity expansion↗
NASA NTRS2017

Digital Human Modeling

The development of models to represent human characteristics and behaviors in human factors is broad and general. The term "model" can refer to any metaphor to represent any aspect of the human; it is generally used in research to mean a mathematical tool for the simulation (often in software, which makes the simulation digital) of some aspect of human performance and for the prediction of future outcomes. This section is restricted to the application of human models in physical design, e.g., in human factors engineering. This design effort is typically human interface design, and the digital models used are anthropometric. That is, they are visual models that are the physical shape of humans and that have the capabilities and constraints of humans of a selected population. They are distinct from the avatars used in the entertainment industry (movies, video games, and the like) in precisely that regard: as models, they are created through the application of data on humans, and they are used to predict human response; body stresses workspaces. DHM enable iterative evaluation of a large number of concepts and support rapid analysis, as compared with use of physical mockups. They can be used to evaluate feasibility of escape of a suited astronaut from a damaged vehicle, before launch or after an abort (England, et al., 2012). Throughout most of human spaceflight, little attention has been paid to worksite design for ground workers. As a result of repeated damage to the Space Shuttle which adversely affected flight safety, DHM analyses of ground assembly and maintenance have been developed over the last five years for the design of new flight systems (Stambolian, 2012, Dischinger and Dunn Jackson, 2014). The intent of these analyses is to assure the design supports the work of the ground crew personnel and thereby protect the launch vehicle. They help the analyst address basic human factors engineering questions: can a worker reach the task site from the work platform provided; can she or he see the task site; can she or he control tools, which, if dropped, might damage the system? Figure 7.3.1 provides an example of such analysis for a future NASA launch vehicle. [figure 7.3.1 here] In-space systems for operation by astronauts have long been targets for DHM analysis, given the focus on mission success and concerns for astronaut safety. Figure 7.3.2 illustrates the analysis of the design to support astronaut tasks for an International Space Station glovebox. [Figure 7.3.2 here] Use by

Dischinger, H. Charles, Jr.↗
DOE OSTI2024

Invertible Temper Modeling using Normalizing Flows and the Effects of Structure Preserving Loss

Advanced manufacturing research and development is typically small-scale, owing to costly experiments associated with these novel processes. Deep learning techniques could help accelerate this development cycle but frequently struggle in small-data regimes like the advanced manufacturing space. While prior work has applied deep learning to modeling visually plausible advanced manufacturing microstructures, little work has been done on data-driven modeling of how microstructures are affected by heat treatment, or assessing the degree to which synthetic microstructures are able to support existing workflows. We propose to address this gap by using invertible neural networks (normalizing flows) to model the effects of heat treatment, e.g., tempering. The model is developed using scanning electron microscope imagery from samples produced using shear-assisted processing and extrusion (ShAPE) manufacturing. This approach not only produces visually and topologically plausible samples, but also captures information related to a sample’s material properties or experimental process parameters. We also demonstrate that topological data analysis, used in prior work to characterize microstructures, can also be used to stabilize model training, preserve structure, and improve downstream results. We assess directions for future work and identify our approach as an important step towards end-to-end deep learning system for accelerating advanced manufacturing research and development.

Howland, Sylvia↗
DOE OSTI2023

Model simulations of Plum Island Ecosystems LTER low marsh site using ELM-PFLOTRAN

Model simulations using the E3SM Land Model (ELM) coupled to the PFLOTRAN reactive transport model via the Alquimia interface. The simulations were conducted for a tidal salt marsh at the Plum Island Ecosystems LTER near Rowley, Massachusetts, USA. Model simulations were forced using site-specific tidal cycles and salinity, and the simulations used a biogeochemical reaction network including aerobic decomposition, sulfate reduction, iron reduction, and methanogenesis. Model outputs include simulated carbon stocks, carbon dioxide and methane fluxes, and porewater concentrations of key solutes related to sulfur, iron, and carbon cycling. The model simulations included a saline simulation (with tidal sulfate inputs), a fresh simulation (with low salinity and low sulfate inputs), and a saline simulation with lower vegetation productivity to represent the effect of salinity on vegetation. These simulations were conducted to demonstrate that a new model framework incorporating subsurface redox and biogeochemical interactions into a land surface model could reproduce measured surface greenhouse gas fluxes and biogeochemical dynamics in tidal marsh ecosystems, and to test whether including redox interactions in a land surface model would allow the model to resolve contrasts in biogeochemical cycling and greenhouse gas production between saline and freshwater wetlands.The data package includes gzipped tar archives (which can be expanded using standard tar and gzip utilities) of model outputs from three model configurations: saline subsurface and reduced vegetation productivity related to salinity; saline subsurface with vegetation productivity not reduced; and freshwater. Also included are code for the modified E3SM model, Alquimia interface, and PFLOTRAN reactive transport simulator in gzipped tar format; plain text parameter and configuration files; python code files for visualizing model output and defining model configurations; and model output, tide and salinity forcing, and configuration files in netCDF format. See the README.md file in the data package for a detailed description of all files contained in the package. All files are in netCDF (.nc), gzipped tar archive (.tar.gz or .tgz), or text (all other files).Updated: May 13, 2024. Model output, E3SM code, PFLOTRAN input files, and python codes for visualizing results were updated to reflect changes made for the manuscript revision. The updated archive reflects the code and model output from the final accepted manuscript. Changes included updated reaction parameters reflecting improved parameterization and additional comparisons with field measurements. E3SM code changes included better support for multiple grid cells and improved flow and transport parameterization.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Visualizing an Exascale Data Center Digital Twin: Considerations, Challenges and Opportunities

Digital twins are an excellent tool to model, visualize, and simulate complex systems, to understand and optimize their operation. In this work, we present the technical challenges of real-time visualization of a digital twin of the Frontier supercomputer.We show the initial prototype and current state of the twin and highlight technical design challenges of visualizing such a large High Performance Computing (HPC) system. The goal is to understand the use of augmented reality as a primary way to extract information and collaborate on digital twins of complex systems. This leverages the spatio-temporal aspect of a 3D representation of a digital twin, with the ability to view historical and real-time telemetry, triggering simulations of a system state and viewing the results, which can be augmented via dashboards for details. Finally, we discuss considerations and opportunities for augmented reality of digital twins of large-scale, parallel computers.

Maiterth, Matthias↗
DOE OSTI2022

AOI.1 Application of Artificial Intelligence techniques enabling coal fired power plants the ability to achieve higher efficiency, improved availability, and increased reliability of their operations (Final Report)

During this effort, SparkCognition with support from the Electric Power Research Institute (EPRI) was tasked with applying artificial intelligence (AI) to improve the reliability, efficiency, and safety of operations at a coal-fired plant. By implementing AI techniques, like machine learning (ML), it is believed that operators can leverage existing data sources to gain more insights such as advanced warning of machine degradation. With enough lead time, a reliability engineer can take action to minimize, or even avoid, impact to production. To complete this work effort, SparkCognition developed and refined an ML-based model using sensor data for a Steam Turbine unit at a host site. The models were deployed in an online, web-based solution that allows users to visualize model outputs and supporting data. The final solution, based on SparkCognition’s proprietary software platform called SparkPredict®, was shared with EPRI who completed an online evaluation of results to determine the solution’s ability to detect actionable events.

20 FOSSIL-FUELED POWER PLANTS↗
DOE OSTI2024

Uncertainty Visualization Challenges in Decision Systems with Ensemble Data & Surrogate Models

Uncertainty visualization is a key component in translating important insights from ensemble simulation data into actionable decision-making by visually conveying various aspects of uncertainty within a system. With the recent advent of fast surrogate models trained on ensemble data, we can substitute computationally expensive simulations, which allows users to interact with more aspects of data spaces than ever before. However, the use of ensemble data with surrogate models in a decision-making tool brings up new challenges for uncertainty visualization, namely how to reconcile and communicate the new and different types of uncertainties brought in by surrogates and how to utilize these new data estimates in actionable ways. In this work, we examine these issues as they relate to high-dimensional data visualization, the integration of discrete datasets and the continuous representations of those datasets, and the unique difficulties associated with systems that allow users to iterate between input and output spaces. We assess the role of uncertainty visualization in facilitating intuitive and actionable interaction with ensemble data and surrogate models, and highlight key challenges in this new frontier of computational simulation.

ensemble data↗