Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “scientific data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48

Scientific study of data analysis

We present a comparison between two numerical methods for the extrapolation of nonlinear force-free magnetic fields, the Iterative Method (IM) and the Progressive Extension Method (PEM). The advantages and disadvantages of these two methods are summarized and the accuracy and numerical instability are discussed. On the basis of this investigation, we claim that the two methods do resemble each other qualitatively.

Wu, S. T.↗

BOREAS AES Campbell Scientific Surface Meteorological Data

Canadian AES personnel collected data related to surface and atmospheric meteorological conditions over the BOREAS region. This data set contains 15-minute meteorological data from 14 automated meteorology stations located across the BOREAS region. Included in this data are parameters of date, time, mean sea level pressure, station pressure, temperature, dew point, wind speed, resultant wind speed, resultant wind direction, peak wind, precipitation, maximum temperature in the last hour, minimum temperature in the last hour, pressure tendency, liquid precipitation in the last hour, relative humidity, precipitation from a weighing gauge, and snow depth. Temporally, the data cover the period of August 1993 to December 1996. The data are provided in tabular ASCII files, and are classified as AFM-Staff data.

Atkinson, G. Barrie↗

Scientific Analysis of Data for the ISTP/SOLARMAX Programs

This Grant supplemented our work on data analysis from the Wind spacecraft which was one of the ISTRIA fleet of spacecraft. It was targeted at observations related to the time of solar maximum in 2000. The work we proposed to do under this grant included comparison of solar wind parameters obtained from different spacecraft in order to establish correlation lengths appropriate to the solar wind and also to compare parameters to explore solar cycle effects.

Lazarus, Alan J.↗

Understanding the Impact of Data Staging for Coupled Scientific Workflows

We report the rate of data generated by cutting-edge experimental science facilities and large-scale simulations enabled by current high-performance computing (HPC) systems has continued to grow at a far greater pace than the development of the network and storage capabilities on which these systems rely. To cope with this challenge, scientist are moving toward the creation of autonomous experiments and HPC simulations using machine learning. However, efficiently moving, storing, and processing large amounts of data away from the point of origin presents an incredible challenge. In-memory computing, in situ analysis, data staging, and data streaming are recognized viable alternatives to traditional file-based methods for transferring data between coupled workflows. However, the performance trade-offs and limitations for these methods are not fully understood when used in HPC applications. This article presents a comprehensive performance assessment of the current solutions for data staging when applied to applications that are not necessary I/O intensive which makes them not ideal candidates for these methods. Our study is based on experiments running at scale on Oak Ridge National Laboratory's Summit supercomputer using applications and simulations that cover typical computational motifs and patterns. We investigated the usability and cost/benefit trade-offs of staging algorithms for HPC applications under different scenarios and highlight opportunities for optimizing the dataflow between coupled simulation workflows.

97 MATHEMATICS AND COMPUTING↗

Data evaluation, analysis, and scientific study

Extensive work was performed in data analysis and modeling of solar active phenomena. The work consisted in the study of UV data from the Ultraviolet Spectrometer and Polarimeter (UVSP) instrument on board the Solar Maximum Mission satellite. These data were studied in conjunction with X-rays from the Hard X-ray Imaging Spectrometer (HXIS) instrument, and with H-alpha and magnetographic data from ground-based observatories. The processes we studied are the active phenomena which result from the interaction of the solar magnetic fields with the plasma in the outer regions of the solar atmosphere. These processes include some very dynamic processes such as the prominence eruptions and the 'microflares'. Our research aimed at characterizing the following: the observed phenomena, the possible physical models, and the relevance to the chromospheric and coronal heating.

Wu, S. T.↗

Recent scientific advances in the use of radar in scientific hydrology

The data needs in scientific hydrology involve measurements of system states and fluxes. The microwave region is particularly well suited for measuring the system states of soil moisture and snow and the major flux into the earth as rainfall. This paper discusses the unique data needs of hydrology and presents some recent examples from AIRSAR experiments.

Engman, Edwin T.↗

Smartfiles: An OO approach to data file interoperability

Data files for scientific and engineering codes typically consist of a series of raw data values whose descriptions are buried in the programs that interact with these files. In this situation, making even minor changes in the file structure or sharing files between programs (interoperability) can only be done after careful examination of the data file and the I/O statement of the programs interacting with this file. In short, scientific data files lack self-description, and other self-describing data techniques are not always appropriate or useful for scientific data files. By applying an object-oriented methodology to data files, we can add the intelligence required to improve data interoperability and provide an elegant mechanism for supporting complex, evolving, or multidisciplinary applications, while still supporting legacy codes. As a result, scientists and engineers should be able to share datasets with far greater ease, simplifying multidisciplinary applications and greatly facilitating remote collaboration between scientists.

Haines, Matthew↗

Accelerating scientific discoveries through data-driven innovations

Developing artificial intelligence (AI) and machine learning (ML) methods that can accelerate scientific discoveries and advance science has become one of the important research directions for the AI/ML research community. It has been gaining increasing attention from researchers in diverse scientific areas, including biomedical science, materials science, climate science, physics, chemistry, and many others. Data-driven AI/ML innovations to enable reliable predictions and optimal decision making for scientific discoveries face several critical challenges, among which are high system complexity, large search space, incomplete knowledge, and small data, all of which demand novel strategies to effectively address them. Meeting these challenges and thereby accelerating scientific discoveries and industrial innovations, calls for research that can take full advantage of the latest advances in AI/ML to integrate data-driven techniques with scientific knowledge and is able to execute them in modern high-performance computing (HPC) environments at scale. This Patterns special collection "Accelerating scientific discoveries through data-driven innovations" features articles that showcase the promising roles of AI/ML and data-driven modeling in accelerating scientific discoveries and may inspire the next wave of data-driven innovations in various scientific domains.

97 MATHEMATICS AND COMPUTING↗

Towards a Global MAP Data Base

Scientific and ecological needs call for the generation of a global data base of measured data from the Earth's atmosphere, similar but complementary to the data of the meteorological service. Right now there is a large gap between these needs and the available financial means. If this prevails, it might be prohibitive for the generation of such a data base. There must be a compromise between the needs and the means. Priorities must be set. Thus, discussions should be started on which data can be or should be stored. Newly generated data for storage in such a data base is recommended to be handled by the World Data Centers (WDCs). This brief report should help to stimulate discussions and ubsequent actions.

Hartmann, G. K.↗

Reduction and analysis of ATS-6 data

The scientific and technological results obtained by an energetic particle spectrometer are summarized. Data on energetic electrons trapped in the Earth's radiation belt near synchronous altitude and on solar particles penetrating to this altitude are discussed.

Paulikas, G. A.↗

Transforming Energy Through Computational Excellence: Advanced Scientific Visualization Reveals Energy Insights

The National Renewable Energy Laboratory's world-class researchers and analysts, along with the Insight Center (our state-of-the-art scientific visualization facility) make data immersion a reality, allowing users to step into and explore their data. With the rise of large, diverse, and distributed data sets, scientific visualization is now critical to the process of scientific discovery and to managing and analyzing data and extracting insights. NREL provides visualization capabilities and facilities that are supported by state-of-the-art equipment, leading-edge techniques, and expert staff.

data science↗

Data Placement Optimization for ATLAS in a Multi-Tiered Storage System within a Data Center

Scientific experiments and computations, especially in High Energy Physics, are generating and accumulating data at an unprecedented rate. Effectively managing this vast volume of data while ensuring efficient data analysis poses a significant challenge for data centers, which must integrate various storage technologies. This paper proposes addressing this challenge by designing and developing a precise data popularity prediction model utilizing state-of-theart AI/ML techniques. This model is crafted from the analysis of ATLAS data and access patterns. It enables us to migrate infrequently accessed data to more economical storage media, such as tape drives, while storing frequently accessed data on faster yet costlier storage media like HDD or SSD. This strategic approach ensures data is placed optimally into the appropriate storage classes, thereby maximizing storage capacity while minimizing data access latency for end-users. Furthermore, the paper includes a performance evaluation of the prediction model using various key metrics such as F1 score, accuracy, precision and recall. Finally, we present a prototype use case, leveraging real-world file access data to assess the model’s impact on performance.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A general scientific information system to support the study of climate-related data

The development and use of NASA's Pilot Climate Data System (PCDS) are discussed. The PCDS is used as a focal point for managing and providing access to a large collection of actively used data for the Earth, ocean and atmospheric sciences. The PCDS provides uniform data catalogs, inventories, and access methods for selected NASA and non-NASA data sets. Scientific users can preview the data sets using graphical and statistical methods. The system has evolved from its original purpose as a climate data base management system in response to a national climate program, into an extensive package of capabilities to support many types of data sets from both spaceborne and surface based measurements with flexible data selection and analysis functions.

Treinish, L. A.↗

Closing the Gap between FAIR Data Repositories and Hierarchical Data Formats

Many in the scientific community, particularly in publicly funded research, are pushing to adhere to more accessible data standards to maximize the findability, accessibility, interoperability, and reusability (FAIR) of scientific data, especially with the growing prevalence of machine learning augmented research. Online FAIR data repositories, such as the Open Science Framework (OSF), help facilitate the adoption of these standards by providing frameworks for storage, access, search, APIs, and other features that create organized hubs of scientific data. However, the wider acceptance of such repositories is hindered by the lack of support of hierarchical data formats, such as Technical Data Management Streaming (TDMS) and Hierarchical Data Format 5 (HDF5), that many researchers rely on to organize their datasets. Various tools and strategies should be used to allow hierarchical data formats, FAIR data repositories, and scientific organizations to work more seamlessly together. A pilot project at Los Alamos National Laboratory (LANL) addresses the disconnect between them by integrating the OSF FAIR data repository with hierarchical data renderers, extending support for additional file types in their framework. The multifaceted interactive renderer displays a tree of metadata alongside a table and plot of the data channels in the file. This allows users to quickly and efficiently load large and complex data files directly in the OSF webapp. Users who are browsing files can quickly and intuitively see the files in the way they or their colleagues structured the hierarchical form and immediately grasp their contents. This solution helps bridge the gap between hierarchical data storage techniques and FAIR data repositories, making both of them more viable options for scientific institutions like LANL which have been put off by the lack of integration between them.

97 MATHEMATICS AND COMPUTING↗

Dynamics Explorer 2: Continued FPI and NACS instrument data analysis and associated scientific activity at the University of Michigan

The grant entitled 'Dynamics Explorer 2 - continued FPI and NACS instrument data analysis and associated scientific activity at the University of Michigan' is a continuation of a grant that began with instrument development for the Dynamics Explorer 2 (DE 2) satellite. Over the years, many publications and presentations at scientific meetings have occurred under the aegis of this grant. This present report details the progress that has been made in the final three years of the grant. In these last 4 years of the grant 26 papers have been published or are in press and about 10 more are in preparation or have been submitted. A large number of presentations have been made in the same time span: 36 are listed in Appendix 2. Evidence of the high educational utility of this research is indicated by the list of Ph. D. and M. S. theses that have been completed in the last 3 years that have involved work connected with NAG5-465. The structure of this report is as follows: a brief synopsis of the aims of the grant NAG5-465 is given in the next section; then there is a summary of the scientific accomplishments that have occurred over the grant period; last, we make some brief concluding remarks. Reprints of articles that have recently appeared in refereed journals are appended to the end of this document.

Burns, Alan↗