Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analysis, visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

The Sloan Digital Sky Survey Quasar Catalog: Sixteenth Data Release

We present the final Sloan Digital Sky Survey IV (SDSS-IV) quasar catalog from Data Release 16 of the extended Baryon Oscillation Spectroscopic Survey (eBOSS). This catalog comprises the largest selection of spectroscopically confirmed quasars to date. The full catalog includes two subcatalogs (the current versions are DR16Q_v4 and DR16Q_Superset_v3 at https://data.sdss.org/sas/dr16/eboss/qso/DR16Q/): a "superset" of all SDSS-IV/eBOSS objects targeted as quasars containing 1,440,615 observations and a quasar-only catalog containing 750,414 quasars, including 225,082 new quasars appearing in an SDSS data release for the first time, as well as known quasars from SDSS-I/II/III. We present automated identification and redshift information for these quasars alongside data from visual inspections for 320,161 spectra. Here, the quasar-only catalog is estimated to be 99.8% complete with 0.3%-1.3% contamination. Automated and visual inspection redshifts are supplemented by redshifts derived via principal component analysis and emission lines. We include emission-line redshifts for Hα, Hβ, Mg II, C III], C IV, and Lyα. Identification and key characteristics generated by automated algorithms are presented for 99,856 broad absorption-line quasars and 35,686 damped Lyman alpha quasars. In addition to SDSS photometric data, we also present multiwavelength data for quasars from the Galaxy Evolution Explorer, UKIDSS, the Wide-field Infrared Survey Explorer, FIRST, ROSAT/2RXS, XMM-Newton, and Gaia. Calibrated digital optical spectra for these quasars can be obtained from the SDSS Science Archive Server.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

Observation and confirmation of nine strong-lensing systems in Dark Energy Survey Year 1 data

ABSTRACT We describe the observation and confirmation of nine new strong gravitational lenses discovered in Year 1 data from the Dark Energy Survey (DES). We created candidate lists based on (i) galaxy group and cluster samples, and (ii) photometrically selected galaxy samples. We selected 46 candidates through visual inspection and then used the Gemini Multi-Object Spectrograph(GMOS) at the Gemini South telescope to acquire a spectroscopic follow-up of 21 of these candidates. Through an analysis of these spectroscopic follow-up data, we confirmed nine new lensing systems and rejected two candidates, and the analysis was inconclusive on 10 candidates. For each of the confirmed systems, our report measured spectroscopic properties, estimated source image–lens separations, and estimated enclosed masses as well. The sources that we targeted have an i-band surface brightness range of $i_{\rm SB} \sim 22\!-\!24\, {\rm mag}\,{\rm arcsec}^{-2}$ and a spectroscopic redshift range of zspec ∼ 0.8−2.6. The lens galaxies have a photometric redshift range of zlens ∼ 0.3−0.7. The lensing systems range in source image–lens separation from 2 to 9 arcsec and in enclosed mass from 1012 to 1013 M⊙.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

A Geometry-Driven Longitudal Topic Model

A simple and scalable framework for longitudinal analysis of Twitter data is developed that combines latent topic models with computational geometric methods. Dimensionality reduction tools from computational geometry are applied to learn the intrinsic manifold on which the latent, temporal topics reside. Then shortest path distances on the manifold are used to link together these topics. The proposed framework permits visualization of the low-dimensional embedding which provides clear interpretation of the complex, high-dimensional trajectories that may exist among latent topics. Practical application of the proposed framework is demonstrated through its ability to capture and effectively visualize natural progression of latent COVID-19 related topics learned from Twitter data. Interpretability of the trajectories is achieved by comparing to real-world events. In addition, the framework permits study of spatial variation in Twitter behavior for learned topics. The analysis demonstrates that the proposed framework is able to capture granular-level impact of COVID-19 on public discussions. We end by arguing that Twitter data, when analyzed within the proposed framework, can serve as a valuable supplementary data stream for COVID-related studies.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

GSAS-II (GENERAL STRUCTURE AND ALAYSIS SYSTEM-II)

GSAS-II is a comprehensive data analysis and simulation software package for determining atomistic structures from single-crystal and powder diffraction data. X-ray, neutron and electron data may be used. Constant-wavelength, time-of-flight and pink-beam sources may be employed and analyses may combine different types of data. The package is oriented towards materials characterization problems, but protein crystallography, pair-distribution function analysis, small-angle scattering and reflectometry analysis are all included. GSAS-II provides tools for indexing and solving structures from powder diffraction data, in addition to structure, data and results visualization tools

TOBY, BRIANH↗
DOE OSTI2026

Model Assessment Wizard (MAW)

SAND2026-18710O The Model Assessment Wizard (MAW) is a tool for evaluating ontologies and provides users with a comprehensive workbench for analysis. MAW features sub-modules for visualization, alignment, Shapes Constraint Language (SHACL) and Web Ontology Language (OWL) constraints, and simplification. Users can upload data, identify missing information, visualize ontologies, and update constraints. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy's National Nuclear Security Administration under contract DE-NA0003525.

Murdock, Jaimie [Sandia National Lab. (SNL-CA), Li↗
DOE OSTI2020

The effect of lighting environment on task performance in buildings – A review

The effects of indoor environmental conditions on human health, satisfaction, and performance have been the focal point of research for decades. This paper reviews and summarizes the impact of lighting environment on task performance, specifically for the built environment audience. Existing studies included a variety of performance tests on cognitive performance and perception, visual acuity and reaction, memory, reasoning, and labor productivity. Illuminance, luminance ratio and correlated color temperature were found to affect performance in different ways, reflecting the impact of experimental techniques, conditions, performance evaluation methods used and data analysis methods. These were reviewed and categorized, with discussion on limitations related to sample size, modeling approach, carryover effects and other factors affecting individual differences in performance, with recommendations for future improvement. Although no universal conclusions can be made, in general, task performance seems to improve with higher illuminances, contrast ratios in the range of 7–11:1 (while always making sure that glare will not occur in the space) and higher correlated color temperature, while spectral tuning in the red or blue wavelengths has also shown positive effects. To obtain more generic evidence, future studies should be more consistent in terms of experimental procedures and overall light conditions, and also consider the effects of vertical illuminance, daylight provision/control, and outside views on task performance. Finally, studying performance with multi-factorial designs in a human-centered optimized manner (such as deploying variable lighting scenarios optimized for various tasks) can lead to deeper understanding of lighting effects on task performance, and ultimately to improved lighting design and operation in buildings overall.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Hardening DOE R&D Software Tools for Web-based Visualization SBIR Phase I Final Report

Ubiquitous web-based visualization is essential to delivering large-scale data visualization to various stakeholders, from the scientist to the board member. These stakeholders will not tolerate a stalled application or a pop-up window asking them to wait for the processing to complete. They require a responsive and interactive visualization environment with high-quality imagery suitable for detailed analysis and boardroom presentations. At Kitware, Inc., we have accomplished web visualization to this point, leveraging state-of-the-art tools like HTML5, CSS3, SVG, Canvas, and WebGL. Solutions that leverage a combination of these technologies are necessary to handle workloads that vary significantly in data size efficiently. However, it is not always practical to move large data to the web client for visualization. Kitware's ParaView as a Service combines client-side visualization using both distributed processing and remote rendering on big data impractical to move. Existing distributed processing and remote rendering solution's interactivity is below the expectations of web-based applications. Our project examined proposed solutions to the areas outlined above in ParaView as a Service. We have investigated concurrent pipelines, streaming images, progressive rendering, and optimization of algorithms and data movement to address these concerns. For the Phase I project, we completed the proposed work plan. As a result, the project produced three prototypes of essential importance for web visualization and the ParaView as a Service community. We created a simple desktop application for an interactive streamline placement prototype, a web-based interactive streamline placement prototype, and a web-based progressive rendering utilizing raytracing prototype. These prototypes relied on the hardening of emerging software toolkits funded by the Department of Energy (DOE) Advanced Scientific Computing Research (ASCR) program (such as ParaView, VTK-m, and Mochi). We blended these components into web-based visualization prototypes that meet the industry's expectations for interactivity and responsiveness. The Phase I project had four essential focus areas: 1. Develop prototype ParaView as a Service backend server using asynchronous, non-blocking design principles. 2. Develop a prototype web application that uses the ParaView as a Service backend server for remote data visualization. 3. Implement image streaming with encoding/compression and progressive rendering capabilities in the proposed platform. 4. Evaluate the prototype developed and summarize observations, including the challenges and pitfalls of our approach. After our successful completion of Phase I, we are strongly positioned to propose a successful Phase II project.

Geveci, Berk↗
DOE OSTI2021

Bridging cognitive gaps between user and model in interactive dimension reduction

Interactive machine learning (ML) systems are difficult to design because of the "Two Black Boxes" problem that exists at the interface between human and machine. Many algorithms that are used in interactive ML systems are black boxes that are presented to users, while the human cognition represents a second black box that can be difficult for the algorithm to interpret. These two black boxes create cognitive gaps between the user and the interactive ML model when a user interacts with the system. In this paper, we identify several cognitive gaps that exist in a previously-developed interactive visual analytics (VA) system, Andromeda. These cognitive gaps that we are addressing in Andromeda are representative of common problems in other VA systems. Our goal with this work is to open both black boxes and bridge these cognitive gaps by making improvements to the original Andromeda system, including designing new visual features to help people better understand how Andromeda processes and interacts with data and improving the underlying algorithm so that the Andromeda system can better understand the intent of the user during the data exploration process. We evaluate our designs through both qualitative and quantitative analysis (i.e., user study and simulation analysis), and the results confirm that the improved Andromeda system outperforms the original version significantly in a series of high-dimensional data understanding tasks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Spatially resolved phase transformation mapping in 410 stainless steel during additive manufacturing visualized via real-time infrared data

Here, in this study, we demonstrate that spatially resolved cooling curves derived from real-time infrared (IR) thermography during additive manufacturing (AM) can capture spatial variations in phase transformation temperatures through cooling curve analysis (CCA). Using this approach, we show that during laser hot-wire deposition of 410 stainless steel (410SS), the martensite start temperature (M s ) evolves dynamically throughout the build. The M s temperature is spatially nonuniform, ranging from 185 °C to 348 °C, with the lowest values toward the build center and higher values toward the upper region of the deposit. In the lower portion of the build, no M s inflection is detected via CCA, consistent with transformation occurring earlier during thermal cycling followed by tempering during subsequent thermal cycles. These trends in M s are corroborated by characterizing the microstructure by electron backscatter diffraction (EBSD). Traditionally, M s is assumed to be constant, and a single interpass temperature is applied during both deposition and residual stress modeling. Our results demonstrate that IR-derived cooling curves provide a route to spatially and temporally resolved transformation temperature tracking for dynamic interpass control and improved residual-stress modeling.

Additive manufacturing↗
DOE OSTI2022

Transient mixing behavior of a supercritical fluid injected into supercritical and subcritical environments

Transient, near-field mixing of a supercritical fluid injected into supercritical and subcritical environments is investigated experimentally. Fuel (propane) from a 100 μm diameter Bosch diesel injector is injected into a high-pressure test rig with a steady flow of heated, low-velocity nitrogen to control the ambient pressure and temperature. The fuel supply pressure is approximately 190 bar, allowing short injections lasting 3–4 ms to be performed in quick succession to acquire statistically significant datasets to represent the unsteady fuel–air mixing. Two test cases with the same ambient density and injector inlet pressure and temperature were chosen in an attempt to isolate effects of mixture phase behavior. Microscopic rainbow Schlieren deflectometry (RSD) is used for visualization and quantitative data acquisition. In the case of the supercritical ambient, the injector inlet and exit and ambient conditions are all supercritical. The RSD analysis reveals a mixing process similar to the single phase fluid mixing, though condensation is also observed locally, and can be explained by the adiabatic mixing theory presented in the paper. For the subcritical ambient case, the injector inlet is supercritical, but the injector exit and ambient conditions are both subcritical. The results show a rapid expansion in the near-field promoting mixing between propane and nitrogen. At downstream locations, significant condensation is also observed as predicted by the adiabatic mixing theory. As a result, the supercritical ambient case exhibited longer and narrower jet penetration compared to the subcritical ambient case.

02 PETROLEUM↗
DOE OSTI2023

Analysis of Pitting Corrosion on Wrought and Additively Manufactured 316L Stainless Steel in Atmospheric Environments

Additive manufacturing of metal components enables rapid fabrication of complex geometries. However, metal additive manufacturing also introduces new morphological and microstructural characteristics which might be detrimental to component performance. Here we report the pitting corrosion properties of wrought and additively manufactured 316L stainless steel after atmospheric exposure to coastal environments and laboratory-created environments. Qualitative visualization in combination with quantitative analysis of resulting pits provided an in-depth understanding of pitting differences between wrought and additively manufactured 316L stainless steel and between coastal and laboratory-based exposure. Optical and scanning electron microscopy were utilized for visualization, while white light interferometry measured pits across approximately 5mm x 5mm areas on each sample. Post-processing of the interferometry data enables quantification of pitting attack for each sample in terms of both pit depth and pit volume. The pitting analysis introduced herein offers a new technique to compare pitting attack between different manufacturing processes and materials.

36 MATERIALS SCIENCE↗
DOE OSTI2020

CYPminer: an automated cytochrome P450 identification, classification, and data analysis tool for genome data sets across kingdoms

Background: Cytochrome P450 monooxygenases (termed CYPs or P450s) are hemoproteins ubiquitously found across all kingdoms, playing a central role in intracellular metabolism, especially in metabolism of drugs and xenobiotics. The explosive growth of genome sequencing brings a new set of challenges and issues for researchers, such as a systematic investigation of CYPs across all kingdoms in terms of identification, classification, and pan-CYPome analyses. Such investigation requires an automated tool that can handle an enormous amount of sequencing data in a timely manner. Results: CYPminer was developed in the Python language to facilitate rapid, comprehensive analysis of CYPs from genomes of all kingdoms. CYPminer consists of two procedures i) to generate the Genome-CYP Matrix (GCM) that lists all occurrences of CYPs across the genomes, and ii) to perform analyses and visualization of the GCM, including pan-CYPomes (pan- and core-CYPome), CYP co-occurrence networks, CYP clouds, and genome clustering data. The performance of CYPminer was evaluated with three datasets from fungal and bacterial genome sequences. Conclusions: CYPminer completes CYP analyses for large-scale genomes from all kingdoms, which allows systematic genome annotation and comparative insights for CYPs. CYPminer also can be extended and adapted easily for broader usage.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Plant single-cell solutions for energy and the environment

Progress in sequencing, microfluidics, and analysis strategies has revolutionized the granularity at which multicellular organisms can be studied. In particular, single-cell transcriptomics has led to fundamental new insights into animal biology, such as the discovery of new cell types and cell type-specific disease processes. However, the application of single-cell approaches to plants, fungi, algae, or bacteria (environmental organisms) has been far more limited, largely due to the challenges posed by polysaccharide walls surrounding these species’ cells. In this perspective, we discuss opportunities afforded by single-cell technologies for energy and environmental science and grand challenges that must be tackled to apply these approaches to plants, fungi and algae. We highlight the need to develop better and more comprehensive single-cell technologies, analysis and visualization tools, and tissue preparation methods. We advocate for the creation of a centralized, open-access database to house plant single-cell data. Finally, we consider how such efforts should balance the need for deep characterization of select model species while still capturing the diversity in the plant kingdom. Investments into the development of methods, their application to relevant species, and the creation of resources to support data dissemination will enable groundbreaking insights to propel energy and environmental science forward.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

AEGIS (Air Emissions Grouped by Industrial Sectors) [SWR-24-49]

AEGIS is a robust framework designed to build and compile emissions inventories for various industrial sectors. It integrates multiple emissions databases provided by the USEPA – including GHGRP, NEI, and TRI – and leverages the STEWI and STEWICOMBO tools to retrieve, merge, and process data. The framework produces facility- and process-level inventories, identifies discrepancies (e.g., NAICS or FRS mismatches), and performs exploratory analysis including emission concentration calculations and visualization.

Atnoorkar, Swaroop↗
DOE OSTI2025

Exploring the Effects of Varying Pre-Chamber Geometry in a Heavy-Duty Natural Gas Optical Engine under Dilution Conditions

Pre-chamber combustion is an advanced ignition strategy that has been shown to enhance spark ignition (SI) combustion stability in natural gas (NG) engines by providing distributed ignition sites from turbulent jets and enhancing main-chamber turbulence. Pre-chamber combustion has been proven especially advantageous compared to SI in ultra-lean and dilute operating conditions. This work involves experimental investigation of the effects of varying passive pre-chamber nozzle configuration on pre-chamber and main chamber combustion under simulated exhaust gas recirculation (EGR) dilution (0 and 20%) conditions in a heavy-duty, single-cylinder, optically accessible NG engine at stoichiometric fuel-air ratio. Pre-chamber nozzle configurations include four pre-chambers with constant nozzle area to pre-chamber volume ratio (A/V) with different nozzle sizes and orientations and one configuration with larger nozzles. The optical engine is operated in a skip-fire sequence consisting of 18 motored cycles followed by two consecutive fired cycles to elucidate the effect of combustion residuals (internal EGR) on combustion evolution. Pressure-based diagnostics are used to monitor pre-chamber and subsequent main chamber combustion, and optical diagnostics include high-speed OH* chemiluminescence to visualize the development of pre-chamber jets and the resulting ignition of the main chamber charge. Heat release analysis of the in-cylinder pressure data indicates that a faster pre-chamber pressure rise does not always translate into faster main-chamber combustion. The pre-chamber with the smallest nozzle diameter produced the highest pre-chamber pressure rise and fastest combustion under non-diluted conditions. However, dilution delays the main chamber ignition for smaller nozzles despite a comparable rise in pre-chamber pressure compared to configurations with larger nozzles. This effect is more pronounced for cycles with in-cylinder combustion residuals in addition to external dilution. Additionally, it was observed that pre-chambers with swirling nozzles have a faster pressure rise in the pre-chamber and main chamber under dilute conditions. Optical diagnostics suggest that the main reason for the delay between the pre-chamber pressure rise and main-chamber combustion lies in jet quenching and delayed re-ignition, which can even lead to misfire if jets emitted from small nozzles combined with dilution fail to re-ignite.

Dhotre, Akash [University Of Minnesota-Twin Cities↗
DOE OSTI2024

Invertible Temper Modeling using Normalizing Flows and the Effects of Structure Preserving Loss

Advanced manufacturing research and development is typically small-scale, owing to costly experiments associated with these novel processes. Deep learning techniques could help accelerate this development cycle but frequently struggle in small-data regimes like the advanced manufacturing space. While prior work has applied deep learning to modeling visually plausible advanced manufacturing microstructures, little work has been done on data-driven modeling of how microstructures are affected by heat treatment, or assessing the degree to which synthetic microstructures are able to support existing workflows. We propose to address this gap by using invertible neural networks (normalizing flows) to model the effects of heat treatment, e.g., tempering. The model is developed using scanning electron microscope imagery from samples produced using shear-assisted processing and extrusion (ShAPE) manufacturing. This approach not only produces visually and topologically plausible samples, but also captures information related to a sample’s material properties or experimental process parameters. We also demonstrate that topological data analysis, used in prior work to characterize microstructures, can also be used to stabilize model training, preserve structure, and improve downstream results. We assess directions for future work and identify our approach as an important step towards end-to-end deep learning system for accelerating advanced manufacturing research and development.

Howland, Sylvia↗
DOE OSTI2021

Deep Dive Topic: Analysis

This section focuses on analysis of I/O behavior and the feedback resulting from that analysis. We define analysis of I/O behavior as interpreting and deriving meaning from I/O instrumentation data. We define feedback as the product of the analysis process. Feedback can be thought of as the link between analysis and the subsequent response to that analysis, such as I/O tuning or policy decisions (see Section 4.4).Analysis and feedback may be consumed by either human stakeholders or machine algorithms. If it is to be consumed by human stakeholders, then the analysis process will likely emphasize understandable language and visualization techniques. If it is to be consumed by machine algorithms, then it will likely emphasize the use of machine-parsable, consistent formats that are suitable for ingestion by policy engines and data-mining tools.

Snyder, Shane↗
DOE OSTI2025

Trust Your Gut: Comparing Human and Machine Inference from Noisy Visualizations

People commonly utilize visualizations not only to examine a given dataset, but also to draw generalizable conclusions about the underlying models or phenomena. Prior research has compared human visual inference to that of an optimal Bayesian agent, with deviations from rational analysis viewed as problematic. However, human reliance on non-normative heuristics may prove advantageous in certain circumstances. We investigate scenarios where human intuition might surpass idealized statistical rationality. In two experiments, we examine individuals’ accuracy in characterizing the parameters of known data-generating models from bivariate visualizations. Our findings indicate that, although participants generally exhibited lower accuracy compared to statistical models, they frequently outperformed Bayesian agents, particularly when faced with extreme samples. Participants appeared to rely on their internal models to filter out noisy visualizations, thus improving their resilience against spurious data. However, participants displayed overconfidence and struggled with uncertainty estimation. They also exhibited higher variance than statistical machines. Our findings suggest that analyst gut reactions to visualizations may provide an advantage, even when departing from rationality. These results carry implications for designing visual analytics tools, offering new perspectives on how to integrate statistical models and analyst intuition for improved inference and decision-making. The data and materials for this paper are available at https://osf.io/qmfv6

human-machine collaboration↗