Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Scientific Data Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

ISAVS: Interactive Scalable Analysis and Visualization System

Modern science is inundated with ever increasing data sizes as computational capabilities and image acquisition techniques continue to improve. For example, simulations are tackling ever larger domains with higher fidelity, and high-throughput microscopy techniques generate larger data that are fundamental to gather biologically and medically relevant insights. As the image sizes exceed memory, and even sometimes local disk space, each step in a scientific workflow is impacted. Current software solutions enable data exploration with limited interactivity for visualization and analytic tasks. Furthermore analysis on HPC systems often require complex hand-written parallel implementations of algorithms that suffer from poor portability and maintainability. We present a software infrastructure that simplifies end-to-end visualization and analysis of massive data. First, a hierarchical streaming data access layer enables interactive exploration of remote data, with fast data fetching to test analytics on subsets of the data. Second, a library simplifies the process of developing new analytics algorithms, allowing users to rapidly prototype new approaches and deploy them in an HPC setting. Third, a scalable runtime system automates mapping analysis algorithms to whatever computational hardware is available, reducing the complexity of developing scaling algorithms. Here, we demonstrate the usability and performance of our system using a use case from neuroscience: filtering, registration, and visualization of tera-scale microscopy data. We evaluate the performance of our system using a leadership-class supercomputer, Shaheen II.

97 MATHEMATICS AND COMPUTING↗

Incorporating Parallel Computing into the Goddard Earth Observing System Data Assimilation System (GEOS DAS)

Atmospheric data assimilation is a method of combining actual observations with model forecasts to produce a more accurate description of the earth system than the observations or forecast alone can provide. The output of data assimilation, sometimes called the analysis, are regular, gridded datasets of observed and unobserved variables. Analysis plays a key role in numerical weather prediction and is becoming increasingly important for climate research. These applications, and the need for timely validation of scientific enhancements to the data assimilation system pose computational demands that are best met by distributed parallel software. The mission of the NASA Data Assimilation Office (DAO) is to provide datasets for climate research and to support NASA satellite and aircraft missions. The system used to create these datasets is the Goddard Earth Observing System Data Assimilation System (GEOS DAS). The core components of the the GEOS DAS are: the GEOS General Circulation Model (GCM), the Physical-space Statistical Analysis System (PSAS), the Observer, the on-line Quality Control (QC) system, the Coupler (which feeds analysis increments back to the GCM), and an I/O package for processing the large amounts of data the system produces (which will be described in another presentation in this session). The discussion will center on the following issues: the computational complexity for the whole GEOS DAS, assessment of the performance of the individual elements of GEOS DAS, and parallelization strategy for some of the components of the system.

Larson, Jay W.↗

The SunPy Project: An Interoperable Ecosystem for Solar Data Analysis

The SunPy Project is a community of scientists and software developers creating an ecosystem of Python packages for solar physics. The project includes the sunpy core package as well as a set of affiliated packages. The sunpy core package provides general purpose tools to access data from different providers, read image and time series data, and transform between commonly used coordinate systems. Affiliated packages perform more specialized tasks that do not fall within the more general scope of the sunpy core package. In this article, we give a high-level overview of the SunPy Project, how it is broader than the sunpy core package, and how the project curates and fosters the affiliated package system. We demonstrate how components of the SunPy ecosystem, including sunpy and several affiliated packages, work together to enable multi-instrument data analysis workflows. We also describe members of the SunPy Project and how the project interacts with the wider solar physics and scientific Python communities. Finally, we discuss the future direction and priorities of the SunPy Project.

Solar physics↗

Telescope Scientist on the Advanced X-ray Astrophysics Observatory

This period included many scientific observations made with the Chandra Observatory. The results, as is well known, are spectacular. Fortunately, the High Resolution Mirror Assembly (HRMA) performance continues to be essentially identical to that predicted from ground calibration data. The Telescope Scientist Team has improved the mirror model to provide a more accurate description to the Chandra observers and enable them to reduce the systematic errors and uncertainties in their data reduction. We also have made considerable progress in improving the scattering model. There also has been progress in the scientific program. At this time 58 distant clusters of galaxies have been observed. We are performing a systematic analysis of this rather large data set for the purpose of determining absolute distances utilizing the Sunyaev Zel'dovich effect. These observations also have been used to study the evolution of the cluster baryon mass function and the cosmological constraints which result from this evolution.

VanSpeybroeck, L.↗

On Performance Prediction of Big Data Transfer in High-performance Networks

Big data generated by large-scale scientific and industrial applications need to be transferred between different geographical locations for remote storage, processing, and analysis. High-speed dedicated connections provisioned in High-performance Networks (HPNs) are increasingly utilized to carry out such big data transfer. HPN management highly relies on an important capability of performance (mainly throughput) prediction to reserve sufficient bandwidth and meanwhile avoid over-provisioning that may result in unnecessary resource waste. This capability is critical to improving the resource (mainly bandwidth) utilization of dedicated connections and meeting various user requests for data transfer. Conventional methods conduct performance prediction by fitting prior observed transfer history with predefined loss functions, without considering unobservable latent factors such as competing loads on end hosts. Such latent factors also have a significant impact on the application-level data transfer performance, which may result in an inaccurate prediction model. In this paper, we first investigate the impact of latent factors and propose a clustering-based method to eliminate their negative impact on performance prediction. We then develop a robust machine learning-based performance predictor by: i) incorporating the proposed latent factor elimination method into data preprocessing, and ii) adopting a customized domain guided loss function. Extensive experimental results show that our predictor achieves significantly higher prediction accuracy than several other state-of-the-art methods.

Liu, Wuji↗

Analysis of Needlet Internal Linear Combination performance on B -mode data from sub-orbital experiments

The observation of primordial B modes in cosmic microwave background (CMB) polarisation data represents the main scientific goal of most of the future CMB experiments. This signal is predicted to be much lower than polarised Galactic emission (foregrounds) in any region of the sky, pointing to the need for effective component separation methods. Aims. Among all the techniques, the blind Needlet Internal Linear Combination (NILC) is of great relevance given our current limited knowledge of the B-mode foregrounds. In this work, we explore the possibility of employing NILC for the analysis of B modes reconstructed from partial-sky data, specifically addressing the complications that such an application yields such as E–B leakage, needlet filtering, and beam convolution. We consider two complementary simulated datasets of future experiments: the balloon-borne Short Wavelength Instrument for the Polarisation Explorer (SWIPE) of the Large Scale Polarisation Explorer, which targets the observation of both reionisation and recombination peaks of the primordial CMB B-mode angular power spectrum, and the ground-based Small Aperture Telescope of Simons Observatory, which, instead, is designed to observe only the recombination bump at ℓ ~ 80. We assessed the performance of the following two alternative techniques to correct for the CMB E–B leakage: the recycling technique and the Zhao-Baskaran method. We find that both techniques reduce the E–B leakage residuals at a negligible level given the sensitivity of the considered experiments, except for the recycling method in the SWIPE footprint at ℓ < 20. Thus, we implemented two extensions of the pipeline, the iterative B decomposition and the diffusive inpainting, which enabled us to recover the input CMB B-mode power for ℓ ≥ 5. For the considered experiments, we demonstrate that needlet filtering and beam convolution do not affect the CMB B-mode reconstruction. Finally, with an appropriate masking strategy, we find that NILC foregrounds subtraction allows one to achieve sensitivities on the tensor-to-scalar ratio in agreement with the targets of the considered CMB experiments.

79 ASTRONOMY AND ASTROPHYSICS↗

The agile alert system for gamma-ray transients

In recent years, a new generation of space missions has offered great opportunities for discovery in high-energy astrophysics. In this article we focus on the scientific operations of the Gamma-Ray Imaging Detector (GRID) on board the AGILE space mission. AGILE-GRID, sensitive in the energy range of 30 MeV-30 GeV, has detected many γ-ray transients of both galactic and extragalactic origin. This work presents the AGILE innovative approach to fast γ-ray transient detection, which is a challenging task and a crucial part of the AGILE scientific program. The goals are to describe (1) the AGILE Gamma-Ray Alert System, (2) a new algorithm for blind search identification of transients within a short processing time, (3) the AGILE procedure for γ-ray transient alert management, and (4) the likelihood of ratio tests that are necessary to evaluate the post-trial statistical significance of the results. Special algorithms and an optimized sequence of tasks are necessary to reach our goal. Data are automatically analyzed at every orbital downlink by an alert pipeline operating on different timescales. As proper flux thresholds are exceeded, alerts are automatically generated and sent as SMS messages to cellular telephones, via e-mail, and via push notifications from an application for smartphones and tablets. These alerts are crosschecked with the results of two pipelines, and a manual analysis is performed. Being a small scientific-class mission, AGILE is characterized by optimization of both scientific analysis and ground-segment resources. The system is capable of generating alerts within two to three hours of a data downlink, an unprecedented reaction time in γ-ray astrophysics.

79 ASTRONOMY AND ASTROPHYSICS↗

Projection-based multifidelity linear regression for data-scarce applications

Surrogate modeling for systems with high-dimensional quantities of interest remains challenging, particularly when training data are costly to acquire. This work develops multifidelity methods for multiple-input multiple-output linear regression targeting data-limited applications with high-dimensional outputs. Multifidelity methods integrate many inexpensive low-fidelity model evaluations with limited, costly high-fidelity evaluations. We introduce two projection-based multifidelity linear regression approaches with linear and nonlinear features that leverage principal component basis vectors for dimensionality reduction and combine multifidelity data through: (i) a direct data augmentation using low-fidelity data, and (ii) a data augmentation incorporating explicit linear corrections between low-fidelity and high-fidelity data. The data augmentation approaches combine high-fidelity and low-fidelity data into a unified training set and train the linear regression model through weighted least squares with fidelity-specific weights. We introduce a proximity-based weighting scheme with automatic weight selection strategy through cross-validation. Here, the proposed multifidelity linear regression methods are demonstrated on approximating the surface pressure field of a hypersonic vehicle in flight and the temperature field on an aircraft disc braking system. In an ultra low-data regime of no more than twelve high-fidelity samples, multifidelity linear regression achieves approximately 2% – 12% improvement in median accuracy and a higher R 2 score relative to single-fidelity methods at comparable computational cost.

data augmentation↗

International Neuroscience Initiatives through the Lens of High-Performance Computing

Neuroscience initiatives aim to develop new technologies and tools to measure and manipulate neuronal circuits. In this paper, to deal with the massive amounts of data generated by these tools, the authors envision the co-location of open data repositories in standardized formats together with high-performance computing hardware utilizing open source optimized analysis codes.

60 APPLIED LIFE SCIENCES↗

SULI Final Report

This project looks at alternative water sources, specifically in the field of desalination and selective ion removal through capacitive deionization (CDI). It project aims to both scale up the desalination capabilities of CDI cells as well as determine the selectivity of CDI for particular ions. My task is to design and build cells that have reproducible performance and characterize the materials for building these cells. The scientific methods I’ve learned through my work in CDI and the data mining and analysis tools I’ve become familiar with through CAES will be important catalysts in my future success in a graduate program. The purpose of this presentation is to give a standard of practice for my current method of building of capacitive deionization cells. Parts 1 and 2 will be discussed in which the electrodes are prepared, and the cell is built.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Alternate Fuel Vehicles in Tunnels

Many types of vehicles using fuels that differ from typical hydrocarbons such as gasoline and diesel are in use throughout the world. These include vehicles running on the combustion of natural gas and propane as well as electrical drive vehicles utilizing batteries or hydrogen as energy storage. These alternative fuels pose hazards that are different from traditional fuels and the safety of these vehicles are being questioned in areas such as tunnels and other enclosed spaces. Much scientific research and analysis has been conducted on tunnel and garage hazard scenarios; however, the data and conclusions might not seem to be immediately applicable to highway tunnel owners and authorities having jurisdiction over tunnels. This report provides a comprehensive, concise summary of the literature available characterizing the various hazards presented by all alternative fuel vehicles, including light-duty, medium- and heavy-duty, as well as buses. Research characterizing both worst-case and more plausible scenarios and risk-based analysis is also summarized Gaps in the research are identified in order to guide future research efforts to provide a complete analysis of the hazards and recommendations for the use of alternative fuel vehicles in tunnels.

33 ADVANCED PROPULSION SYSTEMS↗

Training and onboarding initiatives in high energy physics experiments

In this article we document the current analysis software training and onboarding activities in several High Energy Physics (HEP) experiments: ATLAS, CMS, LHCb, Belle II and DUNE. Fast and efficient onboarding of new collaboration members is increasingly important for HEP experiments. With rapidly increasing data volumes and larger collaborations the analyses and consequently, the related software, become ever more complex. This necessitates structured onboarding and training. Recognizing this, a meeting series was held by the HEP Software Foundation (HSF) in 2022 for experiments to showcase their initiatives. Here we document and analyze these in an attempt to determine a set of key considerations for future HEP experiments.

analysis software↗

The SpacePy space science package at 12 years

For over a decade, the SpacePy project has contributed open-source solutions for the production and analysis of heliophysics data and simulation results. Here we introduce SpacePy’s functionality for the scientific user and present relevant design principles. We examine recent advances and the future of SpacePy in the broader scientific Python ecosystem, concluding with some of the work that has used SpacePy.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Search for the Viking 2 landing site

The search for the landing site of Viking 2 is reviewed, emphasizing the characteristics of the various candidate sites and reasons for rejecting unsuitable sites. It is shown that the B3 site in Utopia Planitia was selected because the B latitude band (40 to 50 deg N) was of the highest scientific interest, the site appeared to be smoothed by uniform mantling, and the additional data analysis and acquisition required to land at any other site could have resulted in a landing delay and significant additional operational complexity. It is tentatively concluded that the Viking 2 lander rests in a deflation hollow.

Masursky, H.↗

The 2-8 GHz solar dynamic spectra and polarization measurement feasibility study

The preliminary system design of a Solar Microwave Spectrograph (SMS) is presented. This design resulted from a study to determine the feasibility of measuring solar polarization and dynamic spectra over the range of two to eight GHz, using broadband radio frequency instrumentation and rapid recording equipment in conjunction with radio telescopes. The scientific value of the proposed SMS instrument is discussed, with remarks concerning data reduction and analysis and a presentation of the engineering plan to implement the SMS system.

Haddock, F. T.↗

Magellan stereo images and Venusian geology

Areas of Venus imaged by Magellan radar with multiple viewing conditions provide unique data that will contribute to the solution of venusian geologic problems and provide a basis for quantitative comparison of venusian landforms with those on other planetary bodies. Three sets of images with different viewing conditions have been acquired: (1) left-looking with variable incidence angles (cycle 1 profile), (2) right-looking with nearly constant incidence angles (cycle 2 profile), and (3) left-looking with variable incidence angles that are almost always smaller than those in (1) (cycle 3 profiles). The unique data provided by paired images of the same scene with different incidence angles arises from image displacements caused by the relief of individual landforms at scales comparable to the ground-range and azimuth resolutions of the images. There are two aspects of the data: (1) Stereopsis achieved by simultaneous viewing of paired left-looking images of the same scene permits three-dimensional perception and interpretation of the morphologies of landforms at resolutions much finer than the altimetry footprints. (2) Measurements of differences of image displacements (parallax) on paired images with known imaging geometries provide quantitative estimates of the relief and shapes of landforms. The potential scientific contributions of the data can be grouped into two interrelated classes: (A) geologic mapping, analysis, and interpretation and (B) topical studies that involve topographic measurements. Stereopsis, without quantitative measurements, enhances geologic mapping, analysis, and interpretation of the rock units of Venus to a degree that cannot be overestimated. In geologic mapping, assemblages of landforms, assessments of backscatter and variations in backscatter, and fine-scale topography are used to define and characterize geologic map units that represent laterally continuous deposits or rock units. Stereopsis adds the important dimension of local relief for characterization of geologic units at a scale that is not possible with Magellan altimetry or products derived from the altimetry. Relative ages of the geologic units are determined using the well-known principles of superposition and intersection. Here, the perception of relief is invaluable because superposition relations among the geological units are more readily and clearly established. The recognition of folds, faults, and fault systems, regardless of their orientations, is facilitated with stereopsis so that sequences of deformation of the geologic units can be determined and structural analyses vastly improved. Shapes of landforms are readily perceived so that they can be properly interpreted. The end result of the mapping, analyses, and interpretations is a geologic history of Venus that includes the sequences of formation and deformation of various geologic units. Measurements of relief at the finest scale possible are necessary for numerous topical studies. Standard altimetry will provide the necessary information on the relief of most large landforms, but it tends to underestimate the relief of small landforms and distorts their shapes. Although special processing of the altimeter echoes improves the estimates of the relief and shapes of some landforms, there are uncertainties in the interpretations of the echoes. Examples of topical studies requiring measurements of relief are given.

Moore, H. J.↗

Geodynamics - Tracking satellites to monitor global change

The major goals and organizational structure of the International GPS Geodynamics Service (IGS), a new Navstar satellite tracking service, are described. IGS activities are aimed at providing the scientific community with data on GPS orbits accurate enough for performing regional and local GPS analysis and daily earth rotation information.

Beutler, Gerhard↗