Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Scientific Data Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

Use of computational modeling combined with advanced visualization to develop strategies for the design of crop ideotypes to address food security

Sustainable crop production is a contributing factor to current and future food security. Innovative technologies are needed to design strategies that will achieve higher crop yields on less land and with fewer resources. Computational modeling coupled with advanced scientific visualization enables researchers to explore and interact with complex agriculture, nutrition, and climate data to predict how crops will respond to untested environments. These virtual observations and predictions can direct the development of crop ideotypes designed to meet future yield and nutritional demands. This review surveys modeling strategies for the development of crop ideotypes and scientific visualization technologies that have led to discoveries in “big data” analysis. Combined modeling and visualization approaches have been used to realistically simulate crops and to guide selection that immediately enhances crop quantity and quality under challenging environmental conditions. Lastly, this survey of current and developing technologies indicates that integrative modeling and advanced scientific visualization may help overcome challenges in agriculture and nutrition data as large-scale and multidimensional data become available in these fields.

3D crop modeling↗

High speed infrared camera diagnostic for heat flux measurement in NSTX

A new high speed infrared camera has been successfully implemented and produced first set of heat flux measurements on the lower divertor tiles in the NSTX tokamak. High spatial and temporal resolutions, 6.4 mm and 1.6-6.3 kHz, respectively, enable us to investigate detailed structure of heat flux deposition pattern caused by transient events such as edge localized modes. A comparison of the data with a slow infrared camera viewing the same region of interest shows good agreement between the two independent measurements. Data analysis for various plasma conditions is in progress.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Parallelization of the Physical-Space Statistical Analysis System (PSAS)

Atmospheric data assimilation is a method of combining observations with model forecasts to produce a more accurate description of the atmosphere than the observations or forecast alone can provide. Data assimilation plays an increasingly important role in the study of climate and atmospheric chemistry. The NASA Data Assimilation Office (DAO) has developed the Goddard Earth Observing System Data Assimilation System (GEOS DAS) to create assimilated datasets. The core computational components of the GEOS DAS include the GEOS General Circulation Model (GCM) and the Physical-space Statistical Analysis System (PSAS). The need for timely validation of scientific enhancements to the data assimilation system poses computational demands that are best met by distributed parallel software. PSAS is implemented in Fortran 90 using object-based design principles. The analysis portions of the code solve two equations. The first of these is the "innovation" equation, which is solved on the unstructured observation grid using a preconditioned conjugate gradient (CG) method. The "analysis" equation is a transformation from the observation grid back to a structured grid, and is solved by a direct matrix-vector multiplication. Use of a factored-operator formulation reduces the computational complexity of both the CG solver and the matrix-vector multiplication, rendering the matrix-vector multiplications as a successive product of operators on a vector. Sparsity is introduced to these operators by partitioning the observations using an icosahedral decomposition scheme. PSAS builds a large (approx. 128MB) run-time database of parameters used in the calculation of these operators. Implementing a message passing parallel computing paradigm into an existing yet developing computational system as complex as PSAS is nontrivial. One of the technical challenges is balancing the requirements for computational reproducibility with the need for high performance. The problem of computational reproducibility is well known in the parallel computing community. It is a requirement that the parallel code perform calculations in a fashion that will yield identical results on different configurations of processing elements on the same platform. In some cases this problem can be solved by sacrificing performance. Meeting this requirement and still achieving high performance is very difficult. Topics to be discussed include: current PSAS design and parallelization strategy; reproducibility issues; load balance vs. database memory demands, possible solutions to these problems.

Larson, J. W.↗

Label-based Virtual Directories In dCache

Traditional filesystems organize data in directories. These directories are typically a collection of files whose grouping is based on a single criterion, e.g., the starting date of an experiment, experiment name, beamline ID, measurement device, or instrument. However, each file in a directory can belong to several logical groups, such as a special event type, experiment condition, or a part of a selected dataset. dCache is a storage system developed to store large amounts of scientific data, used by many HEP and Photon Science experiments. With recent developments in dCache, we have introduced a concept of file tagging, which dynamically groups files with the same label into virtual directories. The file labels can be added, removed, renamed, and deleted through the admin interface or via REST API. The files in virtual directories are exposed through all protocols supported by dCache. This contribution will describe the details of the implementation for file tagging in dCache and present our future development plans on automatic metadata extractions, a feature that will significantly simplify data management. Additionally, we are exploring the future use of virtual directories as a way to translate scientific data catalogs into filesystem views for direct data analysis.

Sahakyan, Marina [DESY]↗

Characterization and identification of HPC applications at leadership computing facility

High Performance Computing (HPC) is an important method for scientific discovery via large-scale simulation, data analysis, or artificial intelligence. Leadership-class supercomputers are expensive, but essential to run large HPC applications. The Petascale era of supercomputers began in 2008, with the first machines achieving performance in excess of one petaflops, and with the advent of new supercomputers in 2021 (e.g., Aurora, Frontier), the Exascale era will soon begin. However, the high theoretical computing capability (i.e., peak FLOPS) of a machine is not the only meaningful target when designing a supercomputer, as the resources demand of applications varies. A deep understanding of the characterization of applications that run on a leadership supercomputer is one of the most important ways for planning its design, development and operation. In order to improve our understanding of HPC applications, user demands and resource usage characteristics, we perform correlative analysis of various logs for different subsystems of a leadership supercomputer. This analysis reveals surprising, sometimes counter-intuitive patterns, which, in some cases, conflicts with existing assumptions, and have important implications for future system designs as well as supercomputer operations. For example, our analysis shows that while the applications spend significant time on MPI, most applications spend very little time on file I/O. Combined analysis of hardware event logs and task failure logs show that the probability of a hardware FATAL event causing task failure is low. Combined analysis of control system logs and file I/O logs reveals that pure POSIX I/O is used more widely than higher level parallel I/O. Based on holistic insights of the application gained through combined and co-analysis of multiple logs from different perspectives and general intuition, we engineer features to "fingerprint" HPC applications. We use t-SNE (a machine learning technique for dimensionality reduction) to validate the explainability of our features and finally train machine learning models to identify HPC applications or group those with similar characteristic. To the best of our knowledge, this is the first work that combines logs on file I/O, computing, and inter-node communication for insightful analysis of HPC applications in production.

Liu, Zhengchun↗

6th Annual Earth System Grid Federation Face to Face Conference Report

The Sixth Annual Face-to-Face (F2F) Conference of the Earth System Grid Federation (ESGF), a global consortium of international government agencies, institutions, and companies dedicated to the creation, management, analysis, and distribution of extreme-scale scientific data, was held December 5–9, 2016, in Washington, D.C.

54 ENVIRONMENTAL SCIENCES↗

Environmental Effects Assessment for Proposed Offshore Wind Farm off the Coast of Grays Harbor, Washington

Grays Harbor Wind LLC (GHW) is proposing to develop a floating offshore wind farm offshore of west Grays Harbor County, Washington (Grays Harbor). The proposed GHW Offshore Wind Project (Project) would entail construction, installation and operation of a 1,000-megawatt (MW) offshore wind farm consisting of approximately 75 floating units, each containing a floating foundation and wind turbine generator (WTG). The Project location is approximately 25 miles (21.7 nautical miles [nmi]) offshore west of Grays Harbor, at waters depths of 360 to 700 feet. The Pacific Northwest National Laboratory (PNNL) was contracted by Herrera Environmental Consultants, Inc. on behalf of GHW to carry out this preliminary scoping study to evaluate baseline conditions and potential effects on fish and marine mammals from development and operation of a floating offshore wind farm installed within a designated area off the coast of Washington1. Floating offshore wind units installed in an ocean environment as part of the Project would interact with marine wildlife. This Study report provides an initial data aggregation and analysis, using publicly available data, of the Project effects, both negative and positive, on the marine environment. The scope of this assessment is limited by the fact that the Project development is presently at the conceptual level. Data on marine organisms were aggregated and evaluated; however seabirds were evaluated by Herrera Environmental Consulting and, along with bats, were not included in the scope of this study. Significant additional work is necessary to characterize ocean, seafloor, and environmental conditions; select appropriate floating offshore wind technologies; identify construction methods and locations; and assess facility locations, including electrical interconnection. Data aggregation and analysis of seabirds and bats is also needed. Evaluation of the full range of potential environmental effects would be conducted following an award of a lease from the Bureau of Ocean Energy Management (BOEM) as part of the leasing, National Environmental Policy Act (NEPA)/State Environmental Policy Act (SEPA) environmental review and permitting processes. While this initial data aggregation and analysis uses best available public scientific information and current assumptions about the Project configuration, the effects discussed herein are based on the status of review to-date and may change as Project-specific details are developed.

17 WIND ENERGY↗

Bayesian Estimation of Thermonuclear Reaction Rates for Deuterium+Deuterium Reactions

The study of d+d reactions is of major interest since their reaction rates affect the predicted abundances of D, 3 He, and 7 Li. In particular, recent measurements of primordial D/H ratios call for reduced uncertainties in the theoretical abundances predicted by Big Bang nucleosynthesis (BBN). Different authors have studied reactions involved in BBN by incorporating new experimental data and a careful treatment of systematic and probabilistic uncertainties. To analyze the experimental data, Coc et al. used results of ab initio models for the theoretical calculation of the energy dependence of S -factors in conjunction with traditional statistical methods based on χ 2 minimization. Bayesian methods have now spread to many scientific fields and provide numerous advantages in data analysis. Astrophysical S -factors and reaction rates using Bayesian statistics were calculated by Iliadis et al. In this paper we present a similar analysis for two d+d reactions, d(d, n) 3 He and d(d, p) 3 H, that has been translated into a total decrease of the predicted D/H value by 0.16%.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Initial results from the EUV spectroheliometer on ATM

The Harvard College Observatory photoelectric spectroheliometer on the Apollo Telescope Mount operated correctly in orbit from May 29, 1973 to Feb. 7, 1974. During this period many thousands of spatial and spectral scans at extreme ultraviolet wavelengths were recorded during observations of a variety of solar features. The construction and modes of operation of the instrument are outlined and the principal scientific results from a preliminary analysis of the data are described.

Reeves, E. M.↗

Initial results from the EUV spectroheliometer on ATM

The Harvard College Observatory photoelectric spectroheliometer on the Apollo Telescope Mount operated correctly in orbit from May 29, 1973 to February 7, 1974. During this period, many thousands of spatial and spectral scans at extreme ultraviolet wavelengths were recorded during observations of a variety of solar features. The construction and modes of operation of the instrument are outlined, and the principal scientific results from a preliminary analysis of the data are described.

Reeves, E. M.↗

A guide to NASA's Pilot Land Data System (PLDS)

NASA's Pilot Land Data System (PLDS) is a distributed information management system designed to support NASA's land science community. The PLDS provides a wide range of services including management of information about scientific data, access to a library of scientific data, a data ordering capability, communications, connection to data analysis facilities, and electronic mail. The PLDS provides these services by offering the scientist the capability to search for and order data, and to communicate electronically with other scientists and computers. Three functions enable scientists to find what data are available and where they reside. The first two, Find data summaries and Read detailed descriptions give summary and detailed descriptions about data sets or groups of related data sets, science, projects, and institutions which archive land data. The third, gives information about specific pieces of data. This last function has two components, Search systemwide inventory and Search local inventory. The first component enables the user to find data elements (images, geological samples, transects, maps, etc.) that exist anywhere in the PLDS while the second has only information about data at the local site. The first enables the user to find pieces of data from several different data sets with the same temporal and spatial coverage and other elements common to most data sets, while the second allows the user to select a data set based on these descriptors and on those that are unique to a data set. The PLDS provides capabilities that enable electronic file transfers, intercomputer connection, and electronic mail. Both TCP/IP and DECnet protocols are supported via the NASA Science Internet (NIS). Access is also available through Telenet.

Source record↗

NASA/MSFC FY91 Global Scale Atmospheric Processes Research Program Review

The reports presented at the annual Marshall Research Review of Earth Science and Applications are compiled. The following subject areas are covered: understanding of atmospheric processes in a variety of spatial and temporal scales; measurements of geophysical parameters; measurements on a global scale from space; the Mission to Planet Earth Program (comprised of and Earth Observation System and the scientific strategy to analyze these data); and satellite data analysis and fundamental studies of atmospheric dynamics.

Leslie, Fred W.↗

The ISTP Program - An opportunity for collaboration in the investigation of solar-terrestrial relationships in the Americas

The ESA-NASA-ISAS International Solar Terrestrial Physics (ISTP) project has come to involve more than 2000 scientists worldwide; its investment of $2 billion by the U.S., the E.E.C., and Japan constitutes an excellent opportunity for participation of Latin American scientists in the analysis of geophysical observational data. The range of scientific problems addressed by ISTP are presently discussed with a view to the participation of Latin American researchers equipped with work stations of the requisite power.

Acuna, Mario H.↗

Intelligent assistance in scientific data preparation

Scientific data preparation is the process of extracting usable scientific data from raw instrument data. This task involves noise detection (and subsequent noise classification and flagging or removal), extracting data from compressed forms, and construction of derivative or aggregate data (e.g. spectral densities or running averages). A software system called PIPE provides intelligent assistance to users developing scientific data preparation plans using a programming language called Master Plumber. PIPE provides this assistance capability by using a process description to create a dependency model of the scientific data preparation plan. This dependency model can then be used to verify syntactic and semantic constraints on processing steps to perform limited plan validation. PIPE also provides capabilities for using this model to assist in debugging faulty data preparation plans. In this case, the process model is used to focus the developer's attention upon those processing steps and data elements that were used in computing the faulty output values. Finally, the dependency model of a plan can be used to perform plan optimization and run time estimation. These capabilities allow scientists to spend less time developing data preparation procedures and more time on scientific analysis tasks.

Chien, Steve↗

The role of small missions in planetary and lunar exploration

The Space Studies Board of the National Research Council charged its Committee on Planetary and Lunar Exploration (COMPLEX) to (1) examine the degree to which small missions, such as those fitting within the constraints of the Discovery program, can achieve priority objectives in the lunar and planetary sciences; (2) determine those characteristics, such as level of risk, flight rate, target mix, university involvement, technology development, management structure and procedures, and so on, that could allow a successful program; (3) assess issues, such as instrument selection, mission operations, data analysis, and data archiving, to ensure the greatest scientific return from a particular mission, given a rapid deployment schedule and a tightly constrained budget; and (4) review past programmatic attempts to establish small planetary science mission lines, including the Planetary Observers and Planetary Explorers, and consider the impact management practices have had on such programs. A series of small missions presents the planetary science community with the opportunity to expand the scope of its activities and to develop the potential and inventiveness of its members in ways not possible within the confines of large, traditional programs. COMPLEX also realized that a program of small planetary missions was, in and of itself, incapable of meeting all of the prime objectives contained in its report 'An Integrated Strategy for the Planetary Sciences: 1995-2010.' Recommendations are provided for the small planetary missions to fulfill their promise.

Source record↗

Cosmic Ray Astronomy

The cosmic ray division participation in the cooperative agreement was activated in the second year. The scientific goals will be analysis of cosmic ray data from the Japanese-American Cooperative Emulsion Experiments (JACEE). Measurements of primary cosmic rays in the JACEE emulsion chambers will be made to derive for each detected particle the deposited energy in the chamber and the primary charge (atomic number). The data will be corrected to the primary flux above the atmosphere, and the composition and energy spectra will be derived. The spectra of the individual elements will be interpreted in context with the supernova shock and other models of cosmic ray acceleration. Additional information is contained in the original extended abstract.

Wu, S. T.↗

APMS: An Integrated Set of Tools for Measuring Safety

This is a report of work in progress. In it, I summarize the status of the research and development of the Aviation Performance Measuring System (APMS) for managing, processing, and analyzing digital flight-recorded data. The objectives of the NASA-FAA APMS research project are to establish a sound scientific and technological basis for flight-data analysis, to define an open and flexible architecture for flight-data-analysis systems, and to articulate guidelines for a standardized database structure on which to continue to build future flight-data-analysis extensions. APMS will offer to the air transport community an open, voluntary standard for flight-data-analysis software, a standard that will help to ensure suitable functionality, and data interchangeability, among competing software programs. APMS will develop and document the methodologies, algorithms, and procedures for data management and analyses to enable users to easily interpret the implications regarding safety and efficiency of operations. APMS does not entail the implementation of a nationwide flight-data-collection system. It is intended to provide technical tools to ease the large-scale implementation of flight-data analyses at both the air-carrier and the national-airspace levels in support of their Flight Operations and Quality Assurance (FOQA) Programs and Advanced Qualifications Programs (AQP). APMS cannot meet its objectives unless it develops tools that go substantially beyond the capabilities of the current commercially available software and supporting analytic methods that are mainly designed to count special events. These existing capabilities, while of proven value, were created primarily with the needs of air crews in mind. APMS tools must serve the needs of the government and air carriers, as well as air crews, to fully support the FOQA and AQP programs. They must be able to derive knowledge not only through the analysis of single flights (special-event detection), but through statistical evaluation of the performance of large groups of flights. This paper describes the integrated suite of tools that will assist analysts in evaluating the operational performance and safety of the national air transport system, the air carrier, and the air crew.

Statler, Irving C.↗

APMS: An Integrated Suite of Tools for Measuring Performance and Safety

This is a report of work in progress. In it, I summarize the status of the research and development of the Aviation Performance Measuring System (APMS) for managing, processing, and analyzing digital flight-recorded data. The objectives of the NASA-FAA APMS research project are to establish a sound scientific and technological basis for flight-data analysis, to define an open and flexible architecture for flight-data-analysis systems, and to articulate guidelines for a standardized database structure on which to continue to build future flight-data-analysis extensions . APMS will offer to the air transport community an open, voluntary standard for flight-data-analysis software, a standard that will help to ensure suitable functionality, and data interchangeability, among competing software programs. APMS will develop and document the methodologies, algorithms, and procedures for data management and analyses to enable users to easily interpret the implications regarding safety and efficiency of operations. APMS does not entail the implementation of a nationwide flight-data-collection system. It is intended to provide technical tools to ease the large-scale implementation of flight-data analyses at both the air-carrier and the national-airspace levels in support of their Flight Operations and Quality Assurance (FOQA) Programs and Advanced Qualifications Programs (AQP). APMS cannot meet its objectives unless it develops tools that go substantially beyond the capabilities of the current commercially available software and supporting analytic methods that are mainly designed to count special events. These existing capabilities, while of proven value, were created primarily with the needs of air crews in mind. APMS tools must serve the needs of the government and air carriers, as well as air crews, to fully support the FOQA and AQP programs. They must be able to derive knowledge not only through the analysis of single flights (special-event detection), but through statistical evaluation of the performance of large groups of flights. This paper describes the integrated suite of tools that will assist analysts in evaluating the operational performance and safety of the national air transport system, the air carrier, and the air crew.

Statler, Irving C.↗