Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Scientific Data Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

Scientific & Intelligence Exascale Visualization Analysis System

SIEVAS provides an immersive visualization framework for connecting multiple systems in real time for data science. SIEVAS provides the ability to connect multiple COTS and GOTS products in a seamless fashion for data fusion, data analysis, and viewing. It provides this capability by using a combination of micro services, real time messaging, and web service compliant back-end system.

Money, James H.↗

The parallelism motifs of genomic data analysis

Genomic datasets are growing dramatically as the cost of sequencing continues to decline and small sequencing devices become available. Enormous community databases store and share these data with the research community, but some of these genomic data analysis problems require large-scale computational platforms to meet both the memory and computational requirements. These applications differ from scientific simulations that dominate the workload on high-end parallel systems today and place different requirements on programming support, software libraries and parallel architectural design. For example, they involve irregular communication patterns such as asynchronous updates to shared data structures. We consider several problems in high-performance genomics analysis, including alignment, profiling, clustering and assembly for both single genomes and metagenomes. We identify some of the common computational patterns or ‘motifs’ that help inform parallelization strategies and compare our motifs to some of the established lists, arguing that at least two key patterns, sorting and hashing, are missing. This article is part of a discussion meeting issue ‘Numerical algorithms for high-performance computational science’.

59 BASIC BIOLOGICAL SCIENCES↗

Active Storage with Analytics Capabilities and I/O Runtime System for Petascale Systems

Computational scientists must understand results from experimental, observational and computational simulation generated data to gain insights and perform knowledge discovery. As systems approach the petascale range, problems that were unimaginable a few years ago are within reach. With the increasing volume and complexity of data produced by ultra-scale simulations and high-throughput experiments, understanding the science is largely hampered by the lack of comprehensive I/O, storage, acceleration of data manipulation, analysis, and mining tools. Scientists require techniques, tools and infrastructure to facilitate better understanding of their data, in particular the ability to effectively perform complex data analysis, statistical analysis and knowledge discovery. The goal of this work is to enable more effective analysis of scientific datasets through the integration of enhancements in the I/O stack, from active storage support at the file system layer to MPI-IO and high-level I/O library layers. We propose to provide software components to accelerate data analytics, mining, I/O, and knowledge discovery for large-scale scientific applications, thereby increasing productivity of both scientists and the systems. Our approaches include 1) design the interfaces in high-level I/O libraries, such as parallel netCDF, for applications to activate data mining operations at the lower I/O layers; 2) Enhance MPI-IO runtime systems to incorporate the functionality developed as a part of the runtime system design; 3) Develop parallel data mining programs as part of runtime library for server-side file system in PVFS file system; and 4) Prototype an active storage cluster, which will utilize multicore CPUs, GPUs, and FPGAs to carry out the data mining workload.

97 MATHEMATICS AND COMPUTING↗

The NASA AfriSAR Campaign: Airborne SAR and Lidar Measurements of Tropical Forest Structure and Biomass in Support of Current and Future Space Missions

In 2015 and 2016, the AfriSAR campaign was carried out as a collaborative effort among international space and National Park agencies (ESA, NASA, ONERA, DLR, ANPN and AGEOS) in support of the upcoming ESA BIOMASS, NASA-ISRO Synthetic Aperture Radar (NISAR) and NASA Global Ecosystem Dynamics Initiative (GEDI) missions. The NASA contribution to the campaign was conducted in 2016 with the NASA LVIS (Land Vegetation and Ice Sensor) Lidar, the NASA L-band UAVSAR (Uninhabited Aerial Vehicle Synthetic Aperture Radar). A central motivation for the AfriSAR deployment was the common AGBD estimation requirement for the three future spaceborne missions, the lack of sufficient airborne and ground calibration data covering the full range of ABGD in tropical forest systems, and the intercomparison and fusion of the technologies. During the campaign, over 7000 km2 of waveform Lidar data from LVIS and 30000 km2 of UAVSAR data were collected over 10 key sites and transects. In addition, field measurements of forest structure and biomass were collected in sixteen 1 hectare sized plots. The campaign produced gridded Lidar canopy structure products, gridded aboveground biomass and associated uncertainties, Lidar based vegetation canopy cover profile products, Polarimetric Interferometric SAR and Tomographic SAR products and field measurements. Our results showcase the types of data products and scientific results expected from the spaceborne Lidar and SAR missions; we also expect that the AfriSAR campaign data will facilitate further analysis and use of waveform Lidar and multiple baseline polarimetric SAR datasets for carbon cycle, biodiversity, water resources and more applications by the greater scientific community.

AfriSAR↗

Atomic and molecular data for space astronomy - Needs, analysis, and availability; 21st IAU General Assembly, Buenos Aires, Argentina, July 23-Aug. 1, 1991, Selected Papers

The present volume on atomic and molecular spectroscopic data for space astrophysics discusses scientific problems and laboratory data needs associated with the Hubble Space Telescope, atomic data needed for far ultraviolet astronomy with HUT and FUSE and for analysis of EUV and X-ray spectra, and data for observations of interstellar medium with the Hubble Space Telescope. Attention is also given to atomic and molecular data for analysis of IR spectra from ISO and SIRTF, atomic data from the opacity project, sources of atomic spectroscopic data for astrophysics, and summary of current molecular data bases.

Smith, Peter L.↗

HEALPix: A Framework for High-Resolution Discretization and Fast Analysis of Data Distributed on the Sphere

HEALPix the Hierarchical Equal Area isoLatitude Pixelization is a versatile structure for the pixelization of data on the sphere. An associated library of computational algorithms and visualization software supports fast scientific applications executable directly on discretized spherical maps generated from very large volumes of astronomical data. Originally developed to address the data processing and analysis needs of the present generation of cosmic microwave background experiments (e.g., BOOMERANG, WMAP), HEALPix can be expanded to meet many of the profound challenges that will arise in confrontation with the observational output of future missions and experiments, including, e.g., Planck, Herschel, SAFIR, and the Beyond Einstein inflation probe. In this paper we consider the requirements and implementation constraints on a framework that simultaneously enables an efficient discretization with associated hierarchical indexation and fast analysis/synthesis of functions defined on the sphere. We demonstrate how these are explicitly satisfied by HEALPix.

cosmic microwave background↗

Nimbus/TOMS Science Data Operations Support

Projected goals include the following: (1) Participate in and provide analysis of laboratory and in-flight calibration of LTV sensors used for space observations of backscattered LTV radiation; (2) Provide support to the TOMS Science Operations Center, including generating instrument command lists and analysis of TOMS health and safety data; (3) Develop and maintain software and algorithms designed to capture and process raw spacecraft and instrument data, convert the instrument output into measured radiance and irradiances, and produce scientifically valid products; (4) Process the TOMS data into Level 1, Level 2, and Level 3 data products; (5) Provide analysis of the science data products in support of NASA GSFC Code 916's research.

Source record↗

Nimbus/TOMS Science Data Operations Support

1. Participate in and provide analysis of laboratory and in-flight calibration of UV sensors used for space observations of backscattered UV radiation. 2. Provide support to the TOMS Science Operations Center, including generating instrument command lists and analysis of TOMS health and safety data. 3. Develop and maintain software and algorithms designed to capture and process raw spacecraft and instrument data, convert the instrument output into measured radiance and irradiances, and produce scientifically valid products. 4. Process the TOMS data into Level 1, Level 2, and Level 3 data products. 5. Provide analysis of the science data products in support of NASA GSFC Code 916's research.

Childs, Jeff↗

The CEOS Data Cube Portal: A User-Friendly, Open Source Software Solution for the Distribution, Exploration, Analysis, and Visualization of Analysis Ready Data

There is an urgent need to increase the capacity of developing countries to take part in the study and monitoring of their environments through remote sensing and space-based Earth observation technologies. The Open Data Cube (ODC) provides a mechanism for efficient storage and a powerful framework for processing and analyzing satellite data. While this is ideal for scientific research, the expansive feature space can also be daunting for end-users and decision-makers who simply require a solution which provides easy exploration, analysis, and visualization of Analysis Ready Data (ARD). Utilizing innovative web-design and a modular architecture, the Committee on Earth Observation Satellites (CEOS) has created a web-based user interface (UI) which harnesses the power of the ODC yet provides a simple and familiar user experience: the CEOS Data Cube (CDC). This paper presents an overview of the CDC architecture and the salient features of the UI. In order to provide adaptability, flexibility, scalability, and robustness, we leverage widely-adopted and well-supported technologies such as the Django web framework and the AWS Cloud platform. The fully-customizable source code of the UI is available at our public repository. Interested parties can download the source and build their own UIs. The UI empowers users by providing features that assist with streamlining data preparation, data processing, data visualization, and sub-setting ARD products in order to achieve a wide variety of Earth imaging objectives through an easy to use web interface.

User Interface↗

THEMIS: A Parameter Estimation Framework for the Event Horizon Telescope

The Event Horizon Telescope (EHT) provides the unprecedented ability to directly resolve the structure and dynamics of black hole emission regions on scales smaller than their horizons. This has the potential to critically probe the mechanisms by which black holes accrete and launch outflows, and the structure of supermassive black hole spacetimes. However, accessing this information is a formidable analysis challenge for two reasons. First, the EHT natively produces a variety of data types that encode information about the image structure in nontrivial ways; these are subject to a variety of systematic effects associated with very long baseline interferometry and are supplemented by a wide variety of auxiliary data on the primary EHT targets from decades of other observations. Second, models of the emission regions and their interaction with the black hole are complex, highly uncertain, and computationally expensive to construct. As a result, the scientific utilization of EHT observations requires a flexible, extensible, and powerful analysis framework. We present such a framework, Themis, which defines a set of interfaces between models, data, and sampling algorithms that facilitates future development. We describe the design and currently existing components of Themis, how Themis has been validated thus far, and present additional analyses made possible by Themis that illustrate its capabilities. Importantly, we demonstrate that Themis is able to reproduce prior EHT analyses, extend these, and do so in a computationally efficient manner that can efficiently exploit modern high-performance computing facilities. Themis has already been used extensively in the scientific analysis and interpretation of the first EHT observations of M87.

79 ASTRONOMY AND ASTROPHYSICS↗

CAD/CAM and scientific data management at Dassault

The history of CAD/CAM and scientific data management at Dassault are presented. Emphasis is put on the targets of the now commercially available software CATIA. The links with scientific computations such as aerodynamics and structural analysis are presented. Comments are made on the principles followed within the company. The consequences of the approximative nature of scientific data are examined. Consequence of the new history function is mainly its protection against copy or alteration. Future plans at Dassault for scientific data appear to be in opposite directions compared to some general tendencies.

Bohn, P.↗

Physics-Based Constraints in the Forward Modeling Analysis of Time-Correlated Image Data (Long Version)

The forward-model approach has been shown to produce accurate model reconstructions of scientific measurements for single-time image data. Here we extend the approach to a series of images that are correlated in time using the physics-based constraints that are often available with scientific imaging. The constraints are implemented through a representational bias in the model and, owing to the smooth nature of the physics evolution in the specified model, provide an effective temporal regularization. Unlike more general temporal regularization techniques, this restricts the space of solutions to those that are physically realizable. We explore the performance of this approach on a simple radiographic imaging problem of a simulated object evolving in time. We demonstrate that the constrained simultaneous analysis of the image sequence outperforms the independent forward modeling analysis over a range of degrees of freedom in the physics constraints, including when the physics model is under-constrained. Further, this approach outperforms the independent analysis over a large range of signal-to-noise ratios.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Structural Analysis Report for Sandia High Altitude Aerosol Research (SHAAR) Payloads

Sandia National Laboratories has interest in mounting enclosures to gather scientific data aboard NASA scientific balloons. This report documents the structural integrity of three separate payloads considered ‘piggybacks.’ To date, there are no design criteria for piggybacks, therefore each piggyback shall follow the same design requirements set by NASA per the Gondola Structural Design Requirements. This analysis report shall describe how each payload meets the design requirements laid out in the Gondola Design Requirements.

47 OTHER INSTRUMENTATION↗

ISABELA for effective in situ compression of scientific data: ISABELA FOR EFFECTIVE IN-SITU REDUCTION OF SPATIO-TEMPORAL DATA

Exploding dataset sizes from extreme-scale scientific simulations necessitates efficient data management and reduction schemes to mitigate I/O costs. With the discrepancy between I/O bandwidth and computational power, scientists are forced to capture data infrequently, thereby making data collection an inherently lossy process. Although data compression can be an effective solution, the random nature of real-valued scientific datasets renders lossless compression routines ineffective. These techniques also impose significant overhead during decompression, making them unsuitable for data analysis and visualization, which require repeated data access. To address this problem, we propose an effective method for In situ Sort-And-B-spline Error-bounded Lossy Abatement (ISABELA) of scientific data that is widely regarded as effectively incompressible. With ISABELA, we apply a pre-conditioner to seemingly random and noisy data along spatial resolution to achieve an accurate fitting model that guarantees a ≥0.99 correlation with the original data. We further take advantage of temporal patterns in scientific data to compress data b ≈ 85%, while introducing only a negligible overhead on simulations in terms of runtime. ISABELA significantly outperforms existing lossy compression methods, such as wavelet compression, in terms of data reduction and accuracy. We extend upon our previous paper by additionally building a communication-free, scalable parallel storage framework on top of ISABELA-compressed data that is ideally suited for extreme-scale analytical processing. The basis for our storage framework is an inherently local decompression method (it need not decode the entire data), which allows for random access decompression and low-overhead task division that can be exploited over heterogeneous architectures. Furthermore, analytical operations such as correlation and query processing run quickly and accurately over data in the compressed space. Copyright © 2012 John Wiley & Sons, Ltd.

Computer Science↗

Advancing electrochemical impedance analysis through innovations in the distribution of relaxation times method

Electrochemical impedance spectroscopy (EIS) is a key tool across various scientific disciplines, including energy sciences, chemistry, and biology, enabling the analysis of electrochemical systems. However, conventional methods for interpreting EIS data are often complex and model dependent. The distribution of relaxation times (DRT) offers a non-parametric approach that simplifies the interpretation process by providing a timescale interpretation of EIS data. This article provides a comprehensive review of current methods for DRT inversion. Additionally, a survey of practitioners highlights key challenges in the field. Here, the findings underscore the need for standardized DRT analysis and benchmarks, as well as the development of automated analysis tools. These advancements would improve the usability and interpretability of EIS data. Ultimately, implementing these improvements could not only propel the field forward but also expand the application of DRT in scientific research by making it accessible to a broader range of researchers, including those without specialized expertise in programming or statistics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

CORONAL MAGNETOGRAPHY OF A SIMULATED SOLAR ACTIVE REGION FROM MICROWAVE IMAGING SPECTROPOLARIMETRY

We have simulated the Expanded Owens Valley Solar Array (EOVSA) radio images generated at multiple frequencies from a model solar active region, embedded in a realistic solar disk model, and explored the resulting data cube for different spectral analysis schemes to evaluate the potential for realizing one of EOVSA’s most important scientific goals—coronal magnetography. In this paper, we focus on modeling the gyroresonance and free–free emission from an on-disk solar active region model with realistic complexities in electron density, temperature and magnetic field distribution. We compare the magnetic field parameters extrapolated from the image data cube along each line of sight after folding through the EOVSA instrumental profile with the original (unfolded) parameters used in the model. We find that even the most easily automated, image-based analysis approach (Level-0) provides reasonable quantitative results, although they are affected by systematic effects due to finite sampling in the Fourier (UV) plane. Finally, we note the potential for errors due to misidentified harmonics of the gyrofrequency, and discuss the prospects for applying a more sophisticated spectrally based analysis scheme (Level-1) to resolve the issue in cases where improved UV coverage and spatial resolution are available.

79 ASTRONOMY AND ASTROPHYSICS↗

UNESE Data Analysis - Disko Elm Gas Transport Characteristics (NA-22 Quarterly Report)

Two research papers describing gas transport studies in subsurface containment environments appropriate for underground nuclear explosions were revised and accepted for publication in the peer-reviewed journals, Nature – Scientific Reports and Journal of Geophysical Research. The Nature – Scientific Reports paper is a primary deliverable and describes the gas-transport experiment performed in P Tunnel (NNSS) and 1) subsequent analysis of field data as part of the UNESE program. The Journal of Geophysical Research paper describes an experiment, supported mainly by DARPA and led by researchers at Weston Geophysical and New Mexico Tech., with 2) analyses supported by this project to evaluate the ability of SF6 gas tracer to track xenon gas migration under conditions related to a previous UNESE experiment. Two new tasks consider 3) evaluation of detonation heating and multiphase flow on arrival of xenon at the surface and 4) the impact of surface or Langmuir adsorption of gases being transported through pores and along fractures.

58 GEOSCIENCES↗

Neutron and X-ray Detectors

The Basic Energy Sciences (BES) X-ray and neutron user facilities attract more than 12,000 researchers each year to perform cutting-edge science at these state-of-the-art sources. While impressive breakthroughs in X-ray and neutron sources give us the powerful illumination needed to peer into the nano- to mesoscale world, a stumbling block continues to be the distinct lag in detector development, which is slowing progress toward data collection and analysis. Urgently needed detector improvements would reveal chemical composition and bonding in 3-D and in real time, allow researchers to watch “movies” of essential life processes as they happen, and make much more efficient use of every X-ray and neutron produced by the source The immense scientific potential that will come from better detectors has triggered worldwide activity in this area. Europe in particular has made impressive strides, outpacing the United States on several fronts. Maintaining a vital U.S. leadership in this key research endeavor will require targeted investments in detector R&D and infrastructure. To clarify the gap between detector development and source advances, and to identify opportunities to maximize the scientific impact of BES user facilities, a workshop on Neutron and X-ray Detectors was held August 1-3, 2012, in Gaithersburg, Maryland. Participants from universities, national laboratories, and commercial organizations from the United States and around the globe participated in plenary sessions, breakout groups, and joint open-discussion summary sessions. Sources have become immensely more powerful and are now brighter (more particles focused onto the sample per second) and more precise (higher spatial, spectral, and temporal resolution). To fully utilize these source advances, detectors must become faster, more efficient, and more discriminating. In supporting the mission of today’s cutting-edge neutron and X-ray sources, the workshop identified six detector research challenges (and two computing hurdles that result from the corresponding increase in data volume) for the detector community to overcome in order to realize the full potential of BES neutron and X-ray facilities. Resolving these detector impediments will improve scientific productivity both by enabling new types of experiments, which will expand the scientific breadth at the X-ray and neutron facilities, and by potentially reducing the beam time required for a given experiment. These research priorities are summarized in the table below. Note that multiple, simultaneous detector improvements are often required to take full advantage of brighter sources. High-efficiency hard X-ray sensors: The fraction of incident particles that are actually detected defines detector efficiency. Silicon, the most common direct-detection X-ray sensor material, is (for typical sensor thicknesses) 100% efficient at 8 keV, 25%efficient at 20 keV, and only 3% efficient at 50 keV. Other materials are needed for hard X-rays. Replacement for 3He for neutron detectors: 3He has long been the neutron detection medium of choice because of its high cross section over a wide neutron energy range for the reaction 3He + n —> 3H + 1H + 0.764 MeV. 3He stockpiles are rapidly dwindling, and what is available can be had only at prohibitively high prices. Doped scintillators hold promise as ways to capture neutrons and convert them into light, although work is needed on brighter, more efficient scintillator solutions. Neutron detectors also require advances in speed and resolution. Fast-framing X-ray detectors: Today’s brighter X-ray sources make time-resolved studies possible. For example, hybrid X-ray pixel detectors, initially developed for particle physics, are becoming fairly mature X-ray detectors, with considerable development in Europe. To truly enable time-resolved studies, higher frame rates and dynamic range are required, and smaller pixel sizes are desirable. High-speed spectroscopic X-ray detectors: Improvements in the readout speed and energy resolution of X-ray detectors are essential to enable chemically sensitive microscopies. Advances would make it possible to take images with simultaneous spatial and chemical information. Very high-energy-resolution X-ray detectors: The energy resolution of semiconductor detectors, while suitable for a wide range of applications, is far less than what can be achieved with X-ray optics. A direct detector that could rival the energy resolution of optics could dramatically improve the efficiency of a multitude of experiments, as experiments are often repeated at a number of different energies. Very high-energy-resolution detectors could make these experiments parallel, rather than serial. Low-background, high-spatial-resolution neutron detectors: Low-background detectors would significantly improve experiments that probe excitations (phonons, spin excitations, rotation, and diffusion in polymers and molecular substances, etc.) in condensed matter. Improved spatial resolution would greatly benefit radiography, tomography, phase-contrast imaging, and holography. Improved acquisition and visualization tools: In the past, with the limited variety of slow detectors, it was straightforward to visualize data as it was being acquired (and adjust experimental conditions accordingly) to create a compact data set that the user could easily transport. As detector complexity and data rates explode, this becomes much more challenging. Three goals were identified as important for coping with the growing data volume from high-speed detectors: Facilitate better algorithm development. In particular, algorithms that can minimize the quantity of data stored. Improve community-driven mechanisms to reduce data protocols and enhance quantitative, interactive visualization tools. Develop and distribute community-developed, detector-specific simulation tools. Aim for parallelization to take advantage of high-performance analysis platforms. Improved analysis work flows: Standardize the format of metadata that accompanies detector data and describes the experimental setup and conditions. Develop a standardized user interface and software framework for analysis and data management. The diversity of detector improvements required is necessarily as broad as the range of scientific experimentation at BES facilities. This workshop identified a variety of avenues by which detector R&D can enable enhanced science at BES facilities. The Research Directions listed above will be addressed by focused R&D and detector engineering, both of which require specialized infrastructure and skills. While U.S. leadership in neutron and X-ray detectors lags behind other countries in several areas, significant talent exists across the complex. A forum of technical experts, facilities management, and BES could be a venue to provide further definition.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗