Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Scientific Data Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

Optimizing Scientist Time through In Situ Visualization and Analysis

In situ processing produces reduced size persistent representations of a simulations state while the simulation is running. The need for in situ visualization and data analysis is often described in terms of supercomputer size and performance in relation to available storage size.

97 MATHEMATICS AND COMPUTING↗

VTK-m: Visualization for the Exascale Era and Beyond

A recent trend in modern high-performance computing is the increasing use of hybrid architectures, where the vast majority of performance comes from accelerators. Modern accelerators are based on Graphics Processing Units (GPU) that contain many low power cores that in their aggregate provides an extremely high computation rate. Current and future CPU processors are requiring more explicit parallelism as each successive version of the hardware packs in more cores, and technologies like hyperthreading and vector operations require even more parallel processing to leverage each core’s full potential. As an example, the Frontier supercomputer installed at Oak Ridge National Laboratories recently hit a record breaking 1.1 exaflops1 on the LINPACK HPC benchmark [Shoemaker 2022]. The system contains 37632 AMD MI250x GPUs which requires more than half a billion threads to keep the system fully utilized [Khizeran 2022].VTK-m is a toolkit of scientific visualization algorithms for these emerging processor architectures. VTK-m supports the fine-grained concurrency for data analysis and visualization algorithms required to drive extreme scale computing by providing abstract models for data and execution that can be applied to a variety of algorithms across many different processor architectures.

Bolstad, Mark↗

Report from the 2016 CrossConnects workshop: improving data mobility & management for bioinformatics

Due to significant declines in the price of genome sequencing technology, the bioinformatics sciences are experiencing a massive upswing in data generation resulting in an increasing need for data distribution and access. The sheer number of biological areas of study, many of which benefit from the scientific breakthroughs of one another, are adding to the increase of shared data usage. The need for effective data management, analysis, and access are becoming more critical. While there are commonalities facing both precision medicine and metagenomics, each area has its own unique challenges and needs. A workshop was held in April 2016 at Lawrence Berkeley National Laboratory that brought together scientists from both fields, along with experts in computing and networking. Presenters and attendees discussed current research and pressing data issues facing the bioinformatics field today and in the near future.

97 MATHEMATICS AND COMPUTING↗

Analyzing Multifaceted Scientific Data with Topological Analytics (Final Technical Report)

This final technical report describes the activities undertaken through Department of Energy, Office of Science, Advanced Scientific Computing Research Early Career award DE-SC-0019039, “Analyzing Multifaceted Scientific Data with Topological Analytics." This report summarizes contributions made toward the research of visualization, machine learning, and topological data analysis of complex simulation data.

97 MATHEMATICS AND COMPUTING↗

Statistical analysis of information from long-range spacecraft

Results are presented of analysis of statistical characteristics of information from spacecraft data compression systems, ignoring the nature of channel activity. Analysis of the distribution of the number of active channels and the channel activities was performed using data from scientific experiments conducted on the Zond-1 and Venera-4 spacecraft.

Khodarev, Y. K.↗

The Lockheed OSO-8 program. Analysis of data from the mapping X-ray heliometer experiment

The final report describes the extent of the analysis effort, and other activities associated with the preservation and documentation of the data set are described. The main scientific results, which are related to the behavior of individual solar activity regions in the energy band 1.5 - 15 keV, are summarized, and a complete bibliography of publications and presentations is given. Copies of key articles are also provided.

Acton, L. W.↗

Summary of progress at the Poker Flat Observatory in Alaska

A description of the status of the Poker Flat MST Radar as of early 1983 is included in the 1983 mesosphere-stratosphere-troposphere MST Workshop Proceedings. The Observatory continues to operate in a continuous data-taking mode, except for a three-week planned campaign experiment concurrent with the STATE rocket program during June 1983. Construction of the digital preprocessing system mentioned in the last status report is all but complete. This additional improvement should be operational by late summer. The possibility of steering the array also mentioned in the last status report is being investigated. A project is underway to electronically steer the one-quarter vertical section of the array. Steering will be in finite steps within about + or - 5 deg of vertical. Successful testing of this modification may lead to eventually steering the entire array in this manner. Data analysis of the data base (now more than four years in length) continues with well over one dozen extramural scientific groups participating.

Balsley, B. B.↗

SEAPAK user's guide, version 2.0. Volume 1: System description

The SEAPAK is a user interactive satellite data analysis package that was developed for the processing and interpretation of Nimbus-7/Coastal Zone Color Scanner (CZCS) and the NOAA Advanced Very High Resolution Radiometer (AVHRR) data. Significant revisions were made to version 1.0 of the guide, and the ancillary environmental data analysis module was expanded. The package continues to emphasize user friendliness and user interactive data analyses. Additionally, because the scientific goals of the ocean color research being conducted have shifted to large space and time scales, batch processing capabilities for both satellite and ancillary environmental data analyses were enhanced, thus allowing large quantities of data to be ingested and analyzed in background.

Mcclain, Charles R.↗

NICMOS status and plans

Near Infrared Camera and Multi-Object Spectrometer (NICMOS) has been in orbit for about 8 months. This is a report on its current status and future plans. Also included are some comments on particular aspects of data analysis concerning dark subtraction, shading, and removal of cosmic rays. At present NICMOS provides excellent images of high scientific content. Most of the observations utilize cameras 1 and 2 which are in excellent focus. Camera 3 is not yet within the range of the focus adjustment mechanism, but its current images are still quite excellent. In this paper we will present the status of various aspects of the NICMOS instrument.

Thompson, Rodger I.↗

Overview and Initial Results of SAND-E: Semi-Autonomous Navigation for Detrital Environments

Unmanned aerial systems (UAS) and automated terrain analysis for science and navigation are new technologies for planetary exploration. The Mars Helicopter will fly with the Mars2020 rover, the Dragonfly quadcopter will explore Titan, and Soil Properties and Object Classification (SPOC) software will be used for path planning and navigation on the Mars2020 rover. Using an Argo J5 rover instrumented with stereo cameras and Autonomous Soil Assessment System (ASAS) software, and an off the shelf quadcopter, SAND-E tested the use of automated terrain analysis and UAS data for science operations in a Mars-analog environment in Iceland during July of 2019. Scientifically, we sought to determine changes in the physical and chemical properties of sediments along a glacial-fluvial-aeolian transport pathway. Operationally, we tested rover mission-like scenarios that included UAS images and classified terrain images. Here, we present the initial results for both the operations and science elements of the study. Site Selection: A goal of SAND-E is examine sorting and alteration of sediments in fluvial and aeolian environments in both mineral-dominated and glass-dominated basaltic settings. During the first year of the project we focused on a mineral-dominated environment. Selection of the location was based on prior publications that indicated our selected region had a greater abundance of crystalline sediments than other areas fluvial-aeolian settings in Iceland. Other criteria included the presence of both fluvial and aeolian landforms along a transport pathway such that the sediments in transport could be linked to their source rocks. We chose the Skjaldbreidauhraun glacial outwash plain, which sits at the base of Thórisjökull glacier. The site is 30 km north of Thingvellir National Park and ~2 hours from Reykjavik. The outwash plain is fed by two small catchments that drain from the base of the glacier and cut through hyaloclastite and shield volcano bedrock. The drainage progresses from steep alluvial fans near the glacier into a low-sloping fluvial braidplain that becomes confined by the Skjaldbreidur shield volcano and creates a shallow canyon cut into lava bedrock. The fluvial system was a typical braided alluvial environment composed pebble- and cobble-bedded longitudinal bars and sandy channel beds. The river remained active and fluctuated in response to diurnal runoff cycles near the glacier before disappearing into the sandy substrate downstream. The high concentration of suspended sediment in the river was evident by the cloudy water and the silt and clay-sized sediments that draped the channel beds after abandonment and created playas in the lowest sloping areas of the catchment. The entire fluvial system was affected by the winds generated by frontal systems and katabatic flows descending the glacier. This resulted in the formation of aeolian lag deposits and a wind-deflation plain where the fluvial system was not active. Wind ripples and drifts formed in abandoned fluvial channels from aeolian reworking of the sand-sized fluvial sediments. The silt- and clay-sized sediments found in fluvial channels, bar tops, and playas generated dust plumes during high wind events. Our operation sought to capture the variability in this system by sampling from the range of fluvial and aeolian features 6.3 km (proximal), 11.3 km (medial), and 14.4 km (distal) along the river from its origin at the base of glacier.

Ewing, R. C.↗

Interoperability of Tools at the CCMC

The CCMC has a diverse set of tools in many languages that support utilization of simulation outputs accessible through CCMC interactive archives. Some model output post-processing and analysis tools are delivered to tCCMC by the community. One such model output post-processing/utilization tool developed by the CCMC is the open source Kamodo package. Kamodo is developed primarily in Python (with some C) and has already established strong interoperability with other Python libraries inside PyHC and out. While that interoperability is important, interoperability with other languages and tools is as important. Many models are written in Fortran or C, and their ability to pull in data from a Python tool or export directly to other analysis software in a different language will greatly increase scientific productivity. Interoperability within Python is important, but broader interoperability is just as important.

CCMC↗

Multiple multiresolution representation of functions and calculus for fast computation

We describe the mathematical representations, data structure and the implementation of the numerical calculus of functions in the software environment multiresolution analysis environment for scientific simulations, MADNESS. In MADNESS, each smooth function is represented using an adaptive pseudo-spectral expansion using the multiwavelet basis to a arbitrary but finite precision. This is an extension of the capabilities of most of the existing net, mesh and spectral based methods where the discretization is based on a single adaptive mesh, or expansions.

99 GENERAL AND MISCELLANEOUS↗

A Multiple Lines of Evidence Approach for Conceptual Site Models in Performance Assessments - 19070

Demonstration of the long-term performance of remediated radioactive waste sites relies on models that evaluate vadose zone and groundwater flow and contaminant transport for thousands of years. Model qualification, verification, and comparisons with data are essential elements to demonstrating the accuracy of long-term performance assessments (PAs). However, comparisons with data are generally limited due to incomplete characterization data and long-time scales. Since PAs support decision making to assure long-term protection of both human health and the environment, a conceptual site model (CSM) is needed to explain the hydrodynamic behavior and account for subsurface heterogeneities in sufficient detail to support confident decisions. In the case of the Waste Management Area (WMA) C PA, where the focus of the effort is on characterizing flow and transport through a thick vadose zone, site-specific data are sparse and larger-scale geologic descriptions are adopted with the risk of losing small scale features that may affect contaminant transport. Features such as horizontal bedding and sloping interfaces between contrasting material types, as well as vertically oriented features such as clastic dikes, may be difficult to delineate from sparse characterization data, but may affect the extent to which contaminants are transported. The PA conducted to identify long-term impacts associated with the closure of the single-shell tank (SST) farm at WMA C adopted an equivalent homogenous medium approach to represent the major stratigraphic units at the site. This approach explicitly represents major stratigraphic units but assigns hydraulic properties that implicitly account for the presence of small-scale heterogeneities and their impact on flow and contaminant transport to the groundwater. The objective of this study is to evaluate the available site-specific and analogue data that can be used to characterize heterogeneity and to assess its impact on fate and transport of contaminants that may lead to different conclusions when compared to the results of the equivalent homogeneous media approach. To this end, a multiple lines of evidence approach was used to construct alternative CSMs based on an evaluation of several types of data. These data include 1) general characteristics and features of the major stratigraphic units from historical descriptions; 2) borehole geologic logs; 3) particle size distribution measurements; 4) moisture content measurements; 5) spectral gamma data; and 6) concentrations of key constituents (i.e., Tc-99) in both the vadose zone and groundwater impacted by past releases. Based on an analysis of the available data, lines of evidence are evaluated for consistency and integrated in a consistent manner into scientifically defensible CSMs. Numerical models are then used to evaluate the impact that the explicit representation of heterogeneities has on contaminant transport. Together, the field data and the numerical modeling results indicate that heterogeneity caused by the small-scale features do not have a significant (i.e. greater than a factor of 2) impact on transport below WMA C relative to peak concentrations and arrival times for potential releases from waste tanks. The results of this study underscore the value of using multiple lines of evidence based on the quantity and quality of available data in developing alternative CSMs and evaluating their relative impact on key transport metrics such as arrival times and peak concentration. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

zPerf: A Statistical Gray-Box Approach to Performance Modeling and Extrapolation for Scientific Lossy Compression

With the scaling up of simulation-based scientific discovery on high-performance computing systems, the disparity between compute and I/O has increased, forcing domain scientists to save only a small amount of simulation data to persistent storage. This can result in the loss of essential physics fields that are needed for data analysis. While error-bounded lossy compression has made tremendous progress in bridging the gap between compute and I/O, the lack of understanding of compression performance remains a key hurdle to its wide adoption. Here, in this work, we present zPerf, a statistical gray-box performance modeling approach for scientific lossy compression. Our contributions are threefold: 1) We develop zPerf to estimate the performance of lossy compression techniques, based on in-depth understanding and statistical modeling for data features and core compression metrics; 2) We demonstrate the in-detailed implementation of zPerf using two case studies, where we derive the performance modeling for SZ and ZFP, two leading lossy compressors; 3) We evaluate the effectiveness of zPerf on real-world datasets across various domains. Based on the evaluation, we demonstrate the efficacy of the zPerf performance model; 4) We further discuss three case studies where zPerf is applied to extrapolate the compression ratio of SZ and ZFP with alternative encoding schemes as well as ZFP with an alternative transform scheme. Through the case studies, we demonstrate the potential of zPerf for exploring the design space of lossy compression, which has hardly been studied in the literature.

97 MATHEMATICS AND COMPUTING↗

Image registration for accurate electrode deformation analysis in operando microscopy of battery materials

Operando imaging techniques have become increasingly valuable in both battery research and manufacturing. However, the reliability of these methods can be compromised by instabilities in the imaging setup and operando cells, particularly when utilizing high-resolution imaging systems. The acquired imaging data often include features arising from both undesirable system vibrations and drift, as well as the scientifically relevant deformations occurring in the battery sample during cell operation. For meaningful analysis, it is crucial to distinguish and separately evaluate these two factors. To address these challenges, we employ a suite of advanced image-processing techniques. These include fast Fourier transform analysis in the frequency domain, power spectrum-based assessments for image quality, as well as rigid and non-rigid image-registration methods. These techniques allow us to identify and exclude blurred images, correct for displacements caused by motor vibrations and sample holder drift and, thus, prevent unwanted image artifacts from affecting subsequent analyses and interpretations. Additionally, we apply optical flow analysis to track the dynamic deformation of battery electrode materials during electrochemical cycling. This enables us to observe and quantify the evolving mechanical responses of the electrodes, offering deeper insights into battery degradation. Together, these methods ensure more accurate image analysis and enhance our understanding of the chemomechanical interplay in battery performance and longevity.

Sun, Tianxiao↗

From LIMS to OMPS-LP: Limb Ozone Observations for Future Reanalyses

High vertical resolution and accuracy of ozone data from satellite-borne limb sounders has made them an invaluable tool in scientific studies of the middle and upper atmosphere. However, it was not until recently that these measurements were successfully incorporated in atmospheric reanalyses: of the major multidecadal reanalyses only ECMWF's (European Centre for Medium-Range Weather Forecasts') ERA (ECMWF Re-Analysis)-Interim/ERA5 and NASA's MERRA-2 (Modern-Era Retrospective Analysis for Research and Applications-2) use limb ozone data. Validation and comparison studies have demonstrated that the addition of observations from the Microwave Limb Sounder (MLS) on EOS (Earth Observing System) Aura greatly improved the quality of ozone fields in MERRA-2 making these assimilated data sets useful for scientific research. In this presentation, we will show the results of test experiments assimilating retrieved ozone from the Limb Infrared Monitor of the Stratosphere (LIMS, 1978/1979) and Ozone Mapping Profiler Suite Limb Profiler (OMPS-LP, 2012 to present). Our approach builds on the established assimilation methodology used for MLS in MERRA-2 and, in the case of OMPS-LP, extends the excellent record of MLS ozone assimilation into the post-EOS era in Earth observations. We will show case studies, discuss comparisons of the new experiments with MERRA-2, strategies for bias correction and the potential for combined assimilation of multiple limb ozone data types in future reanalyses for studies of multidecadal stratospheric ozone changes including trends.

Wargan, K.↗

Data Sharing in Astrobiology: The Astrobiology Habitable Environments Database (AHED)

Astrobiology is a multidisciplinary area of scientific research focused on studying the origins of life on Earth and the conditions under which life might have emerged elsewhere in the universe. NASA uses the results of Astrobiology research to help define targets for future missions that are searching for life elsewhere in the universe. The understanding of complex questions in Astrobiology requires integration and analysis of data spanning a range of disciplines including biology, chemistry, geology, astronomy and planetary science. However, the lack of a centralized repository makes it difficult for Astrobiology teams to share data and benefit from resultant synergies. Moreover, in recent years, federal agencies are requiring that results of any federally funded scientific research must be available and useful for the public and the science community. The Astrobiology Habitable Environments Database (AHED), developed with a consolidated group of astrobiologists from different active research teams at NASA Ames Research Center, is designed to help to address these issues. AHED is a central, high-quality, long-term data repository for mineralogical, textural, morphological, inorganic and organic chemical, isotopic and other information pertinent to the advancement of the field of Astrobiology.

Define targets for futire missions↗