Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analysis, visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,783 records · Page 99
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Elevation distributed micro-climatology data in a coastal glaciated watershed

Air temperature, ground temperature and relative humidity data were collected in a longitudinal transect of the Nooksack watershed at varying elevations from 500 to 1800 m above sea level. Data were collected by anchoring sensors from trees above winter snow levels and shaded from direct solar radiation. Paired sensors were also buried 3 cm under ground near each air temperature sensor to determine snow absence or presence. Select sites included relative humidity sensors to indicate whether precipitation was occurring. Data were collected every 3-4 h from December 2015 to Sept 2018 (with ongoing collection). Code for analysis of daily mean, minimum, maximum, and temperature change with elevation (lapse rates) are available on Github (https://doi.org/10.5281/zenodo.3239539). The sensor download and intermediate data products are available on HydroShare at (http://www.hydroshare.org/resource/222e832d3df24dea9bae9bbeb6f4219d) with publicly accessible visualization available from the Nooksack Observatory at data.cuahsi.org. Hydrologic models are generally structured with a single annual average lapse rate parameter which assumes a linear temperature gradient with elevation. The daily data (2016-2018) is used as part of ongoing studies on the non-linear dynamics and temporal variability of temperature with elevation to improve assessments of watershed function and salmon habitat.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

Sequenceserver: A Modern Graphical User Interface for Custom BLAST Databases

Comparing newly obtained and previously known nucleotide and amino-acid sequences underpins modern biological research. BLAST is a well-established tool for such comparisons but is challenging to use on new data sets. We combined a user-centric design philosophy with sustainable software development approaches to create Sequenceserver, a tool for running BLAST and visually inspecting BLAST results for biological interpretation. Sequenceserver uses simple algorithms to prevent potential analysis errors and provides flexible text-based and visual outputs to support researcher productivity. Our software can be rapidly installed for use by individuals or on shared servers.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Inferring the shape of data: a probabilistic framework for analysing experiments in the natural sciences

A critical step in data analysis for many different types of experiments is the identification of features with theoretically defined shapes in N -dimensional datasets; examples of this process include finding peaks in multi-dimensional molecular spectra or emitters in fluorescence microscopy images. Identifying such features involves determining if the overall shape of the data is consistent with an expected shape; however, it is generally unclear how to quantitatively make this determination. In practice, many analysis methods employ subjective, heuristic approaches, which complicates the validation of any ensuing results—especially as the amount and dimensionality of the data increase. Here, we present a probabilistic solution to this problem by using Bayes’ rule to calculate the probability that the data have any one of several potential shapes. This probabilistic approach may be used to objectively compare how well different theories describe a dataset, identify changes between datasets and detect features within data using a corollary method called Bayesian Inference-based Template Search; several proof-of-principle examples are provided. Altogether, this mathematical framework serves as an automated ‘engine’ capable of computationally executing analysis decisions currently made by visual inspection across the sciences.

Science & Technology - Other Topics↗
DOE OSTI2023

Compilation of a Solar Mirror Materials Database and an Analysis of Natural and Accelerated Mirror Exposure and Degradation

The National Renewable Energy Laboratory (NREL) has been conducting exposure experiments on solar reflectors for over four decades. Thousands of mirror samples from over one hundred suppliers have been exposed to and monitored in a range of relevant environments. These test conditions include outdoor test settings and several controlled laboratory environments. These samples have been rigorously individually characterized using a series of reflectance measurements, visual inspections, and in some cases, in-depth composition analysis to identify degradation modes, reflectance losses, and other mirror properties integral to understanding the solar reflector's life cycle. Here, this paper compiles the decades of measurement data into a concise statistical analysis. It includes exposure and degradation data for numerous reflector types, including secondary-surface reflector permutations of polymer and glass superstrates with silver and aluminum reflectors as well as front-surface reflectors. The results herein are intended to analyze environmental stressors and degradation trends among various historical and state-of-the-art solar reflectors. It may be used to support solar reflector design, effective testing methodology, and inform manufacturing decisions moving forward. Presented are the results of the compiled database and an initial analysis for degradation rate modeling using full-spectrum and wavelength-dependent approaches. The database is a growing resource hosted on a live, publicly accessible website. In conjunction with the analysis presented here, it provides a valuable resource to the solar reflector manufacturing and testing industry.

14 SOLAR ENERGY↗
NASA NTRS1995

Compression research on the REINAS Project

We present approaches to integrating data compression technology into a database system designed to support research of air, sea, and land phenomena of interest to meteorology, oceanography, and earth science. A key element of the Real-Time Environmental Information Network and Analysis System (REINAS) system is the real-time component: to provide data as soon as acquired. Compression approaches being considered for REINAS include compression of raw data on the way into the database, compression of data produced by scientific visualization on the way out of the database, compression of modeling results, and compression of database query results. These compression needs are being incorporated through client-server, API, utility, and application code development.

Rosen, Eric↗
NASA NTRS1995

Remote Visualization and Remote Collaboration On Computational Fluid Dynamics

A new technology has been developed for remote visualization that provides remote, 3D, high resolution, dynamic, interactive viewing of scientific data (such as fluid dynamics simulations or measurements). Based on this technology, some World Wide Web sites on the Internet are providing fluid dynamics data for educational or testing purposes. This technology is also being used for remote collaboration in joint university, industry, and NASA projects in computational fluid dynamics and wind tunnel testing. Previously, remote visualization of dynamic data was done using video format (transmitting pixel information) such as video conferencing or MPEG movies on the Internet. The concept for this new technology is to send the raw data (e.g., grids, vectors, and scalars) along with viewing scripts over the Internet and have the pixels generated by a visualization tool running on the viewer's local workstation. The visualization tool that is currently used is FAST (Flow Analysis Software Toolkit).

Watson, Val↗
NASA NTRS2015

Explore GPM IMERG and Other Global Precipitation Products with GES DISC GIOVANNI

New features and capabilities in the newly released GIOVANNI allow exploring GPM IMERG (Integrated Multi-satelliE Retrievals for GPM) Early, Late and Final Run global half-hourly and monthly precipitation products as well as other precipitation products distributed by the GES DISC such as TRMM Multi-Satellite Precipitation Analysis (TMPA), MERRA (Modern Era Retrospective-Analysis for Research and Applications), NLDAS (North American Land Data Assimilation Systems), GLDAS (Global Land Data Assimilation Systems), etc. GIOVANNI is a web-based tool developed by the GES DISC (Goddard Earth Sciences and Data Information Services Center) to visualize and analyze Earth science data without having to download data and software. The new interface in GIOVANNI allows searching and filtering precipitation products from different NASA missions and projects and expands the capabilities to inter-compare different precipitation products in one interface. Knowing differences in precipitation products is important to identify issues in retrieval algorithms, biases, uncertainties, etc. Due to different formats, data structures, units and so on, it is not easy to inter-compare precipitation products. Newly added features and capabilities (unit conversion, regridding, etc.) in GIOVANNI make inter-comparisons possible. In this presentation, we will describe these new features and capabilities along with examples.

Giovanni↗
NASA NTRSDate not supplied

Interactive Framework to Support Open Model-Data Validation Efforts at the CCMC

Validation of models using observation data has been a central activity at the Community Coordinated Modeling Center (CCMC) over more than a decade. The Comprehensive Assessment of Models and Events using Library Tools (CAMEL) framework is a database-driven implementation of the interactive analysis of model-data comparisons that simultaneously provides a view across a multitude of locations and time periods. CAMEL thus extends the single-location or single-trajectory timeseries data comparison capabilities provided by the CCMC online visualization that formed the backbone of initial validation efforts. We demonstrate CAMEL capabilities for an example application to study Neutral Density in the upper atmosphere among comparisons in the heliosphere, the Earth’s radiation belt, magnetosphere, and ionosphere-thermosphere-mesosphere domains.

Lutz Rastaetter↗
DOE OSTI2020

Characterizing Dislocation Defects in Dark Field X-ray Microscopy Images of Bulk Aluminum

Material defects play a large role in material response under shock loading, yet the process of how these defects initiate, propagate, and annihilate is not well understood. Using a newly developed diagnostic, dark field X-ray microscopy (DFXM), we can now visualize the behavior of dislocation defects in materials at the mesoscale under varying conditions. Using data from the European Synchrotron Radiation Facility, we apply a variety of image processing techniques to capture relevant features to locate and characterize size and orientation of dislocation defects in bulk aluminum DFXM images. Beyond simple visualization, this analysis drives statistical characterization of the defects and their dynamic response to further improve the relevant physics models.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2018

Application of multiplexed ion mobility spectrometry towards the identification of host protein signatures of treatment effect in pulmonary tuberculosis

Rationale: The monitoring of TB treatments in clinical practice and clinical trials relies on traditional sputum-based culture status indicators at specific time points. Accurate, predictive, blood-based protein markers would provide a simpler and more informative view of patient health and response to treatment. Objective: We utilized sensitive, high throughput multiplexed ion mobility-mass spectrometry (IM-MS) to characterize the serum proteome of TB patients at the start of and at 8 weeks of rifamycin-based treatment. We sought to identify treatment specific signatures within patients as well as correlate the proteome signatures to various clinical markers of treatment efficacy. Methods: Serum samples were collected from 289 subjects enrolled in CDC TB Trials Consortium Study 29 at time of enrollment and at the end of the intensive phase (after 40 doses of TB treatment). Serum proteins were immunoafinity-depleted of high abundant components, digested to peptides and analyzed for data acquisition utilizing a unique liquid chromatography IM-MS platform (LC-IM-MS). Linear mixed models were utilized to identify serum protein changes in the host response to antibiotic treatment as well as correlations with culture status end points. Results: A total of 10,137 peptides corresponding to 872 proteins were identified, quantified, and used for statistical analysis across the longitudinal patient cohort. In response to TB treatment, 244 proteins were sig- ni?cantly altered. Pathway/network comparisons helped visualize the interconnected proteins, identifying up regulated (lipid transport, coagulation cascade, endopeptidase activity) and down regulated (acute phase) processes and pathways in addition to other cross regulated networks (inflammation, cell adhesion, extracellular matrix). Detection of possible lung injury serum proteins such as HPSE, significantly downregulated upon treatment. Analyses of microbiologic data over time identified a core set of serum proteins (TTHY, AFAM, CRP, RET4, SAA1, PGRP2) which change in response to treatment and also strongly correlate with culture status. A similar set of proteins at baseline were found to be predictive of week 6 and 8 culture status. Conclusion: A comprehensive host serum protein dataset reflective of TB treatment effect is defined. A repeating set of serum proteins (TTHY, AFAM, CRP, RET4, SAA1, PGRP2, among others) were found to change significantly in response to treatment, to strongly correlate with culture status, and at baseline to be predictive of future culture conversion. If validated in cohorts with long term follow-up to capture failure and relapse of TB, these protein markers could be developed for monitoring of treatment in clinical trials and in patient care.

Kedia, Komal↗
NASA NTRS2016

Space Launch System Vibration Analysis Support

The ultimate goal for my efforts during this internship was to help prepare for the Space Launch System (SLS) integrated modal test (IMT) with Rodney Rocha. In 2018, the Structural Engineering Loads and Dynamics Team will have 10 days to perform the IMT on the SLS Integrated Launch Vehicle. After that 10 day period, we will have about two months to analyze the test data and determine whether the integrated vehicle modes/frequencies are adequate for launching the vehicle. Because of the time constraints, NASA must have newly developed post-test analysis methods proven well and with technical confidence before testing. NASA civil servants along with help from rotational interns are working with novel techniques developed and applied external to Johnson Space Center (JSC) to uncover issues in applying this technique to much larger scales than ever before. We intend to use modal decoupling methods to separate the entangled vibrations coming from the SLS and its support structure during the IMT. This new approach is still under development. The primary goal of my internship was to learn the basics of structural dynamics and physical vibrations. I was able to accomplish this by working on two experimental test set ups, the Simple Beam and TAURUS-T, and by doing some light analytical and post-processing work. Within the Simple Beam project, my role involves changing the data acquisition system, reconfiguration of the test set up, transducer calibration, data collection, data file recovery, and post-processing analysis. Within the TAURUS-T project, my duties included cataloging and removing the 30+ triaxial accelerometers, coordinating the removal of the structure from the current rolling cart to a sturdy billet for further testing, preparing the accelerometers for remounting, accurately calibrating, mounting, and mapping of all accelerometer channels, and some testing. Hammer and shaker tests will be performed to easily visualize mode shapes at low frequencies. Short analytical projects using MATLAB were also assigned to aid in research efforts. These included integration of acceleration data for comparison to measured displacement data. Laplace and Fourier transforms were also investigated to determine viability as a method of modal decoupling. In addition to these projects, I was also able contribute work that would benefit future interns and the division as a whole. I gave a short presentation and answered questions to aid in the recruitment of subsequent interns and co-ops for the division. I also assisted in revisions and additions to Intern/Co-Op Handbook to provide incoming employees with background information on the organization they are about to work for. I further developed tutorial on Pulse software, which was used for data acquisition for both experiments and will be helpful to interns and engineers that may be unfamiliar to the software. I gained a diverse range of experience throughout my internship. I was introduced to advanced dynamics and analytical techniques. This was through new experience with both hands on experimentation and analytical post processing methods. I was exposed to the benefits of interdepartmental collaboration and developed stronger skills in time management by coordinating two different tests at once. This internship provided an excellent opportunity to see how engineering theories applied to real life scenarios, and an introduction to how NASA/JSC solves technical problems.

Johnson, Katie↗
DOE OSTI2017

Deep Water Impact Ensemble Data Set

Asteroids of various sizes, speeds, and compositions are zipping around the solar system with potential future Earth engagements. Most of the earth is covered in ocean and impacts would likely occur in deep ocean water. The IEEE SciVis Contest 2018 is dedicated to the visualization and analysis of simulations designed to study asteroid impacts in deep ocean water.

"asteroid impact" meteor "in situ" visualization↗
DOE OSTI2022

Noodles: Cooking Up Collaborative Visualization

NOODLES is a new cross-domain collaborative visualization and analysis capability being developed at NREL. The NOODLES specification is a minimal protocol that can tie different software packages and platforms together. As an example, a simulation code that speaks this protocol could stream iso-surfaces to an immersive VR space and a web browser. Another example is a team (with some members across the country) classifying and discovering features in a statistical data plot, driven from a researcher's existing Python-based workflow. In this talk, we will discuss some background on the problems that this protocol intends to solve, basic principles of the specification, the current state of supporting libraries, and some demonstrations of the protocol in action.

3D↗
DOE OSTI2025

MODE: A Web Application for Interactive Visualization and Exploration of Omics Data

Studies generating transcriptomics, proteomics, lipidomics, and metabolomics (colloquially referred to as “omics”) data allow researchers to find biomarkers or molecular targets, or understand complex biological structures and functions by identifying changes in biomolecule abundance and expression between experimental conditions. Omics data is multi-dimensional and oftentimes summarization techniques such as principal component analysis (PCA) are used to identify high-level patterns in data. Though useful, these summaries don’t allow exploration of detailed patterns in omics data that may have biological relevance. The use of interactive HTML displays with plots allows researchers to interact with omics data at a detailed level, but building these displays requires significant coding expertise. To overcome this barrier, the software MODE was built to empower users to build their own interactive HTML displays to support scientific discovery. These displays are easily shareable, do not depend on a specific operating system, and allow users to effortlessly sort and filter plots by categorical or numerical variables. MODE allows users to build and share these displays with several options for plot design and meta selection. In conclusion, the MODE web application and its capabilities are presented and then demonstrated on lipidomics data from a leaf wounding study.

lipidomics↗
DOE OSTI2025

Evaluating HPC Scheduling Strategies for Urgent Workloads

Scientific computing centers increasingly face workloads with diverse urgency requirements, driven by applications that demand rapid or even immediate execution. Appropriately configured scheduling policies can significantly improve both user satisfaction and overall cluster utilization. In this work, we present a systematic analysis of scheduler configurations under scenarios where a fraction of jobs have urgent computing needs. We evaluate multiple job scheduling simulators, develop a lightweight job-submission emulation framework, and create tools to analyze and visualize the resulting scheduling data. Our study identifies key trade-offs between responsiveness, fairness, and efficiency, and offers a set of practical scheduling configurations (particularly for Slurm) that can be tailored to HPC environments supporting mixed-urgency workloads.

Maheshwari, Ketan [ORNL] (ORCID:000000033800662X)↗
DOE OSTI2021

Quality Assurance and Quality Control (QA/QC) of Meteorological Time Series Data for Billy Barr, East River, Colorado USA

A comprehensive Quality Assurance (QA) and Quality Control (QC) statistical framework consists of three major phases: Phase 1—Preliminary raw data sets exploration, including time formatting and combining datasets of different lengths and different time intervals; Phase 2—QA of the datasets, including detecting and flagging of duplicates, outliers, and extreme values; and Phase 3—the development of time series of a desired frequency, imputation of missing values, visualization and a final statistical summary. The time series data collected at the Billy Barr meteorological station (East River Watershed, Colorado) were analyzed. The developed statistical framework is suitable for both real-time and post-data-collection QA/QC analysis of meteorological datasets.The files that are in this data package include one excel file, converted to CSV format (Billy_Barr_raw_qaqc.csv) that contains the raw meteorological data, i.e., input data used for the QA/QC analysis. The second CSV file (Billy_Barr_1hr.csv) is the QA/QC and flagged meteorological data, i.e., output data from the QA/QC analysis. The last file (QAQC_Billy_Barr_2021-03-22.R) is a script written in R that implements the QA/QC and flagging process. The purpose of the CSV data files included in this package is to provide input and output files implemented in the R script.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1977

An image-processing system applied to earth-resource imagery

The Harwell Image Processing System (HIPS) has been adapted for processing earth-resource imagery in either film or tape format. Data from film are obtained using a computer-controlled flying-spot scanner. Local rapid interactive processing is based on a PDP 11/20 minicomputer which has suitable display facilities for immediate visual appraisal of results and also a fast data link to an IBM 370/168 computer complex. An extensive subroutine library is being assembled for data preprocessing and feature extraction. This chapter includes a discussion of the basic principles of image analysis, a description of the HIPS system, and finally, for illustrative purposes, a description of several simple software routines.

Carter, P.↗
NASA NTRS1989

Numerical study of a delta planform with multiple jets in ground effect

The flow past a 60-deg delta wing equipped with two thrust-reverser jets near the inboard trailing edge has been analyzed by numerical solution of the 3D thin-layer Navier-Stokes equations. An implicit, partially flux-split, approximately-factored Navier-Stokes solver coupled with a multiple grid embedding scheme has been adapted to this problem. Studies of the impact of numerical parameters (e.g., grid refinement and dissipation levels), and flow-field parameters such as the height of the delta wing above the ground plane and the jet size on the solution, were performed. Results of these numerical studies indicate some challenges in the accurate resolution of complex 3D free shear layers and jets. Nevertheless, flow features such as jet deformation and ground vortex formation observed in experimental flow visualizations are captured. Further, comparisons with experimental data confirm the ability to simulate the loss of wing-borne lift, commonly referred to 'suckdown, as the delta planform flies at slow speeds in close proximity to the ground. Detailed analysis of the numerical results has also given additional insight into the structure of the ground vortex and the mechanisms of lift loss.

Chawla, K.↗