Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Scientific Data Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

The Solar-B Mission: First Light, Future Plans and Community Participation

The Solar-B spacecraft was launched from the Uchinoura Space Center into a circular, sun-synchronous, polar orbit by the Japanese Aerospace Exploration Agency in late September 2006. The spacecraft carries thee scientific instruments designed to follow the flow of magnetic energy from the photosphere to the corona to improve our understanding of both steady state and transient energy release. This goal will be achieved through coordinated observations of three highly advanced solar telescopes developed cooperatively by teams from Japan, the United States and the United Kingdom. The three telescopes are a 0.5m aperture, diffraction limited, solar optical telescope (SOT), an X-ray telescope (XRT) designed for full sun imaging with 1.0 arcsec pixels and an EUV imaging spectrometer (EIS) with an order of magnitude improvement in sensitivity over past instruments. The SOT focal plane contains three instruments, a spectropolarimeter for measuring vector magnetic fields, a broadband filter imager for recording images of the photosphere and chromosphere at the highest resolution the telescope is capable of, and a narrow band filter imager that will record Doppler grams and vector magnetograms. The XRT has broad temperature coverage and a spatial a resolution three times as high as Yohkoh. EIS covers a broad range of transition region and coronal temperatures in two spectral bands. Both XRT and EIS have 2 arcsec spatial resolution (1 arcsec pixels). Instrument first light occurred after five weeks on orbit to allow for out gassing and the opening of the telescopes doors. The initial observation sequences are designed to test the functionality of the different operating modes and for calibration. After this commissioning phase is complete a series of observations are planned to demonstrate the ability of the instruments to meet NASA's mission minimum success criteria. Data is downloaded every orbit to the Norwegian high latitude ground station at Svalbard. The data are transmitted to ISAS where they are reformatted into FITS files and archived as Level 0 data on the ISAS DARTS system. Once the initial observation period is complete, approximately six months after launch, the mission data will be open and freely available to researchers shortly after receipt at the DARTS data archive hosted in Japan and at NASA s Solar Data Analysis Center at the Goddard Space Flight Center. Scientific operations will be conducted from the ISAS facility in Sagamihara, Japan and the observatory will become available for performing joint operations with both ground and space based instruments and for conducting observing programs proposed by non-team members. This process will be described together with a status report from the initial operation of the observatory, showing examples of the first observations.

Davis, John M.↗

Towards Exascale Scientific Metadata Management

Advances in technology and computing hardware are enabling scientists from all areas of science to produce massive amounts of data using large-scale simulations or observational facilities. In this era of data deluge, effective coordination between the data production and the analysis phases hinges on the availability of metadata that describe the scientific datasets. Existing workflow engines have been capturing a limited form of metadata to provide provenance information about the identity and lineage of the data. However, much of the data produced by simulations, experiments, and analyses still need to be annotated manually in an ad hoc manner by domain scientists. Systematic and transparent acquisition of rich metadata becomes a crucial prerequisite to sustain and accelerate the pace of scientific innovation. Yet, ubiquitous and domain-agnostic metadata management infrastructure that can meet the demands of extreme-scale science is notable by its absence. To address this gap in scientific data management research and practice, we present our vision for an integrated approach that (1) automatically captures and manipulates information-rich metadata while the data is being produced or analyzed and (2) stores metadata within each dataset to permeate metadata-oblivious processes and to query metadata through established and standardized data access interfaces. We motivate the need for the proposed integrated approach using applications from plasma physics, climate modeling and neuroscience, and then discuss research challenges and possible solutions.

97 MATHEMATICS AND COMPUTING↗

Occam's razor and petascale visual data analysis

One of the central challenges facing visualization research is how to effectively enable knowledge discovery. An effective approach will likely combine application architectures that are capable of running on today's largest platforms to address the challenges posed by large data with visual data analysis techniques that help find, represent, and effectively convey scientifically interesting features and phenomena.

99 GENERAL AND MISCELLANEOUS↗

Science opportunities from the Topex/Poseidon mission

The U.S. National Aeronautics and Space Administration (NASA) and the French Centre National d'Etudes Spatiales (CNES) propose to conduct a Topex/Poseidon Mission for studying the global ocean circulation from space. The mission will use the techniques of satellite altimetry to make precise and accurate measurements of sea level for several years. The measurements will then be used by Principal Investigators (selected by NASA and CNES) and by the wider oceanographic community working closely with large international programs for observing the Earth, on studies leading to an improved understanding of global ocean dynamics and the interaction of the ocean with other processes influencing life on Earth. The major elements of the mission include a satellite carrrying an altimetric system for measuring the height of the satellite above the sea surface; a precision orbit determination system for referring the altimetric measurements to geodetic coordinates; a data analysis and distribution system for processing the satellite data, verifying their accuracy, and making them available to the scientific community; and a principal investigator program for scientific studies based on the satellite observations. This document describes the satellite, its sensors, its orbit, the data analysis system, and plans for verifying and distributing the data. It then discusses the expected accuracy of the satellite's measurements and their usefulness to oceanographic, geophysical, and other scientific studies. Finally, it outlines the relationship of the Topex/Poseidon mission to other large programs, including the World Climate Research Program, the U.S. Navy's Remote Ocean Sensing System satellite program and the European Space Agency's ERS-1 satellite program.

Stewart, R.↗

Chandra Interactive Analysis of Observations (CIAO)

The Chandra (formerly AXAF) telescope, launched on July 23, 1999, provides X-rays data with unprecedented spatial and spectral resolution. As part of the Chandra scientific support, the Chandra X-ray Observatory Center provides a new data analysis system, CIAO ("Chandra Interactive Analysis of Observations"). We will present the main components of the system: "First Look" analysis; SHERPA: a multi-dimensional, multi-mission modeling and fitting application; Chandra Imaging and Plotting System; Detect package-source detection algorithms; and DM package generic data manipulation tools, We will set up a demonstration of the portable version of the system and show examples of Chandra Data Analysis.

Dobrzycki, Adam↗

Managing Software Provenance to Enhance Reproducibility in Computational Research

Scientific processes rely on software as an important tool for data acquisition, analysis, and discovery. Over the years, sustainable software development practices have made progress in being considered as an integral component of research. However, management of computation-based scientific studies is often left to individual researchers who design their computational experiments based on personal preferences and the nature of the study. Here, we believe that the quality, efficiency, and reproducibility of computation-based scientific research can be improved by explicitly creating an execution environment that allows researchers to provide a clear record of traceability. This is particularly relevant to complex computational studies in high-performance computing (HPC) environments. In this article, we review the documentation required to maintain a comprehensive record of HPC computational experiments for reproducibility. We also provide an overview of tools and practices that we have developed to perform such studies around Flash-X, a multiphysics scientific software.

97 MATHEMATICS AND COMPUTING↗

Enabling Seamless Transitions from Experimental to Production HPC for Interactive Workflows

The evolving landscape of scientific computing requires seamless transitions from experimental to production HPC environments for interactive workflows. This paper presents a structured transition pathway developed at OLCF that bridges the gap between development testbeds and production systems. We address both technological and policy challenges, introducing frameworks for data streaming architectures, secure service interfaces, and adaptive resource scheduling for time-sensitive workloads and improved HPC interactivity. Our approach transforms traditional batch-oriented HPC into a more dynamic ecosystem capable of supporting modern scientific workflows that require near real-time data analysis, experimental steering, and cross-facility integration.

Etz, Brian [ORNL] (ORCID:0000000208554863)↗

Bridging Theory with Practice: An Exploratory Study of Visualization Use and Design for Climate Model Comparison

Evaluation methodologies in visualization have mostly focused on how well the tools and techniques cater to the analytical needs of the user. While this is important in determining the effectiveness of the tools and advancing the state-of-the-art in visualization research, a key area that has mostly been overlooked is how well established visualization theories and principles are instantiated in practice. This is especially relevant when domain experts, and not visualization researchers, design visualizations for analysis of their data or for broader dissemination of scientific knowledge. There is very little research on exploring the synergistic capabilities of cross-domain collaboration between domain experts and visualization researchers. To fill this gap, in this paper we describe the results of an exploratory study of climate data visualizations conducted in tight collaboration with a pool of climate scientists. The study analyzes a large set of static climate data visualizations for identifying their shortcomings in terms of visualization design. The outcome of the study is a classification scheme that categorizes the design problems in the form of a descriptive taxonomy. The taxonomy is a first attempt for systematically categorizing the types, causes, and consequences of design problems in visualizations created by domain experts. We demonstrate the use of the taxonomy for a number of purposes, such as, improving the existing climate data visualizations, reflecting on the impact of the problems for enabling domain experts in designing better visualizations, and also learning about the gaps and opportunities for future visualization research. We demonstrate the applicability of our taxonomy through a number of examples and discuss the lessons learnt and implications of our findings.

54 ENVIRONMENTAL SCIENCES↗

Efficient and Flexible Hierarchical Data Layouts for a Unified Encoding of Scalar Field Precision and Resolution

To address the problem of ever-growing scientific data sizes making data movement a major hindrance to analysis, we introduce a novel encoding for scalar fields: a unified tree of resolution and precision, specifically constructed so that valid cuts correspond to sensible approximations of the original field in the precision-resolution space. Furthermore, we introduce a highly flexible encoding of such trees that forms a parameterized family of data hierarchies. We discuss how different parameter choices lead to different trade-offs in practice, and show how specific choices result in known data representation schemes such as zfp[52], idx[58], and jpeg2000 [76]. Lastly, we provide system-level details and empirical evidence on how such hierarchies facilitate common approximate queries with minimal data movement and time, using real-world data sets ranging from a few gigabytes to nearly a terabyte in size. Experiments suggest that our new strategy of combining reductions in resolution and precision is competitive with state-of-the-art compression techniques with respect to data quality, while being significantly more flexible and orders of magnitude faster, and requiring significantly reduced resources.

97 MATHEMATICS AND COMPUTING↗

Charged particle and magnetic field research in space

Research completed and in progress is described, related publications and reports are listed, and abstracts of papers and talks on results of the research are given. The charged particle research centered on OGO-5 and OGO-6 electron spectrometer data, and theoretical radiation belt studies. Work on the ATS-1 magnetometer project included development of production data reduction programs, development of spectral analysis procedures, and scientific studies of ULF waves at synchronous orbit. The magnetic fields research also included work on the Mariner project and theoretical studies on the solar wind.

Source record↗

Research in space physics at the University of Iowa

The research is reported for current projects. Topics discussed include: study and analysis of data from Explorer 40, 43, and small scientific satellites; and the planned missions for Helios, UK-4, Pioneer R and H, and Hawkeye satellites. The progress in the theoretical studies of electron density of the solar corona, spectrophotometry, and interferometry are also reported.

Vanallen, J. A.↗

Social impact evaluation : Some implications of the specific decisional context approach for anticipatory project assessment with special reference to available alternatives and to techniques of evaluating the social impacts of the anticipated effects of such alternatives

The implications are explored of the specific decision context approach to anticipatory project assessment. More specifically, it is hypothesized that with respect to any given effect of a proposed project or action (mobility, job opportunities, air pollution, population distribution, etc.) such effect will likely differ in probability and/or magnitude from one decisional context to another; that the social desirability or undesirability of a given effect is a function (will differ with) each specific decisional context; that therefore the social impact of such effect will in all likelihood differ with each specific decisional context; and that the social significance of even the dame social impact of a given effect will vary from one decisional context to another when such social impact interacts with (competes with or reinforces) the social impacts of other effects. It also follows from this analysis that the respective roles of scientific method (demonstrable data) and adversarial system will not only differ with each specific decisional context but with each alternative course of action available to the decisional entity in each specific context.

Mayo, L. H.↗

Software agents for the dissemination of remote terrestrial sensing data

Remote terrestrial sensing (RTS) data is constantly being collected from a variety of space-based and earth-based sensors. The collected data, and especially 'value-added' analyses of the data, are finding growing application for commercial, government, and scientific purposes. The scale of this data collection and analysis is truly enormous; e.g., by 1995, the amount of data available in just one sector, NASA space science, will reach 5 petabytes. Moreover, the amount of data, and the value of analyzing the data, are expected to increase dramatically as new satellites and sensors become available (e.g., NASA's Earth Observing System satellites). Lockheed and other companies are beginning to provide data and analysis commercially. A critical issue for the exploitation of collected data is the dissemination of data and value-added analyses to a diverse and widely distributed customer base. Customers must be able to use their computational environment (eventually the National Information Infrastructure) to obtain timely and complete information, without having to know the details of where the relevant data resides and how it is accessed. Customers must be able to routinely use standard, widely available (and, therefore, low cost) analyses, while also being able to readily create on demand highly customized analyses to make crucial decisions. The diversity of user needs creates a difficult software problem: how can users easily state their needs, while the computational environment assumes the responsibility of finding (or creating) relevant information, and then delivering the results in a form that users understand? A software agent is a self-contained, active software module that contains an explicit representation of its operational knowledge. This explicit representation allows agents to examine their own capabilities in order to modify their goals to meet changing needs and to take advantage of dynamic opportunities. In addition, the explicit representation allows agents to advertize their capabilities and results to other agents, thereby allowing the collection of agents to reuse each others work.

Toomey, Christopher N.↗

The NASA L3 Study

The Astrophysics Implementation Plan calls for a minority role in L3, planned for launch in 2034. L3 The third large mission in ESAs Cosmic Visions 2015-2025 Programme NASA and ESA have been discussing a collaboration for 2 years Gravitational Observatory Advisory Team (GOAT) ESA study evaluating and recommend scientific performance tradeoffs, detection technologies, technology development activities, data analysis capabilities, schedule and cost US representatives: Guido Mueller, Mark Kasevich, Bill Klipstein, RTS Started in October 2014, concluding with a final report in late Marchor early April 2016. ESA solicited interest from ESA Member States in November 2015 NASA is continuing technology development support. ESA is restarting technology development activities.

The L3 Study organization and charter have been es↗

Web-Based Geographic Information System Tool for Accessing Hanford Site Environmental Data

Data volume, complexity, and access issues pose severe challenges for analysts, regulators and stakeholders attempting to efficiently use legacy data to support decision making at the U.S. Department of Energy’s (DOE) Hanford Site. DOE has partnered with the Pacific Northwest National Laboratory (PNNL) on the PHOENIX (PNNL-Hanford Online Environmental Information System) project, which seeks to address data access, transparency, and integration challenges at Hanford to provide effective decision support. PHOENIX is a family of spatially-enabled web applications providing quick access to decades of valuable scientific data and insight through intuitive query, visualization, and analysis tools. PHOENIX realizes broad, public accessibility by relying only on ubiquitous web-browsers, eliminating the need for specialized software. It accommodates a wide range of users with intuitive user interfaces that require little or no training to quickly obtain and visualize data. Currently, PHOENIX is actively hosting three applications focused on groundwater monitoring, groundwater clean-up performance reporting, and in-tank monitoring. PHOENIX-based applications are being used to streamline investigative and analytical processes at Hanford, saving time and money. But more importantly, by integrating previously isolated datasets and developing relevant visualization and analysis tools, PHOENIX applications are enabling DOE to discover new correlations hidden in legacy data, allowing them to more effectively address complex issues at Hanford.

decision support↗

AI for Science: Report on the Department of Energy (DOE) Town Halls on Artificial Intelligence (AI) for Science

The report documents the DOE Town Halls held during 2019 at Argonne National Laboratory, Oak Ridge National Laboratory, Lawrence Berkeley National Laboratory, and in Washington, DC. From July to October 2019, the Argonne, Oak Ridge, and Berkeley National Laboratories hosted a series of four town hall meetings attended by more than 1,000 U.S. scientists and engineers. The goal of the town hall series was to examine scientific opportunities in the areas of artificial intelligence (AI), Big Data, and high-performance computing (HPC) in the next decade, and to capture the big ideas, grand challenges, and next steps to realizing these opportunities. In this report and in the Department of Energy (DOE) laboratory community, we use the term “AI for Science” to broadly represent the next generation of methods and scientific opportunities in computing, including the development and application of AI methods (e.g., machine learning, deep learning, statistical methods, data analytics, automated control, and related areas) to build models from data and to use these models alone or in conjunction with simulation and scalable computing to advance scientific research. The AI for Science town hall discussions focused on capturing the transformational uses of AI that employ HPC and/or data analysis, leveraging data sets from HPC simulations or instruments and user facilities, and addressing scientific challenges unique to DOE user facilities and the agency’s wide-ranging fundamental and applied science enterprise.

36 MATERIALS SCIENCE↗

OPEN-Augmented Reality GUI for Bioenergy Crop Phenotyping and Precision Agriculture (Donald Danforth Plant Science Center Final Scientific Technical Report)

The project led by the Donald Danforth Plant Science Center, in collaboration with Arizona State University, George Washington University, and Saint Louis University, has made significant strides in advancing the phenotypic analysis of bioenergy crops through the development of an innovative AI processing pipeline. This initiative was primarily funded by ARPA-E, with additional cost-sharing provided by the participating institutions. The project successfully utilized a variety of sensors—3D scanners, thermal, RGB, and hyperspectral—to refine algorithms for data-driven trait signature identification and improve the classification and visualization of plant traits. The developed AI processing pipeline is capable of handling the complex, multidimensional data characteristic of dynamic agricultural environments. 1) Contributions to understanding: The research has advanced the field of plant phenomics by showcasing the synergistic use of various sensor data to enhance the precision of trait analysis in bioenergy crops. Through the integration of 3D scanners, thermal, RGB, and hyperspectral sensors, the project has developed robust data-driven trait signature algorithms and visualization techniques. These innovations have facilitated detailed monitoring and management of plant traits, providing vital insights into plant growth dynamics and stress responses. Further, the project has broadened our understanding of how machine learning can be effectively applied in multi-sensor environments to refine trait analysis. By leveraging diverse datasets, the research has not only improved the accuracy of phenotypic assessments but also established a versatile methodological framework that can be extended beyond agriculture to other fields requiring detailed phenotypic analysis. 2) Technical effectiveness and economic feasibility: The AI processing pipeline developed in this project demonstrated significant technical effectiveness, achieving high throughput analysis of extensive phenotypic data and meeting targeted accuracies. This system exemplified the capability of advanced machine learning technologies to efficiently manage and analyze large, complex datasets. Economically, the implementation of the project-developed pipelines may offer substantial cost savings across multiple sectors. It enhances data analysis processes and significantly reduces the need for manual data interpretation, thereby decreasing both the time and resources required. 3) Public benefit: The project has significantly broadened the scope of agricultural methodologies to enhance phenotypic analysis, with potential applications in various sectors beyond agriculture. Additionally, the initiative fostered an enriching educational and collaborative environment, significantly enhancing the technical skills of participants. It also made substantial contributions to the scientific community by providing open-access data sets and tools, encouraging ongoing research and development across various disciplines. Overall, the project not only met its scientific goals but also showcased the extensive utility of integrating advanced machine learning and sensor data analysis technologies. These advancements have proven instrumental in driving forward both theoretical research and practical applications, setting a strong foundation for future explorations and innovations in data-driven science.

60 APPLIED LIFE SCIENCES↗

An operations and command systems for the extreme ultraviolet explorer

About 40% of the budget of a scientific spacecraft mission is usually consumed by Mission Operations & Data Analysis (MO&DA) with MO driving these costs. In the current practice, MO is separated from spacecraft design and comes in focus relatively late in the mission life cycle. As a result, spacecraft may be designed that are very difficult to operate. NASA centers have extensive MO expertise but often lessons learned in one mission are not exploited for other parallel or future missions. A significant reduction of MO costs is essential to ensure a continuing and growing access to space for the scientific community. We are addressing some of these issues with a highly automated payload operations and command system for an existing mission, the Extreme Ultraviolet Explorer (EUVE). EUVE is currently operated jointly by the Goddard Space Flight Center (GSFC), responsible for spacecraft operations, and the Center for Extreme Ultraviolet Astrophysics (CEA) of the University of California, Berkeley, which controls the telescopes and scientific instruments aboard the satellite. The new automated system is being developed by a team including personnel from the NASA Ames Research Center (ARC), the Jet Propulsion Laboratory (JPL) and the Center for EUV Astrophysics (CEA). An important goal of the project is to provide AI-based technology that can be easily operated by nonspecialists in AI. Another important goal is the reusability of the techniques for other missions. Models of the EUVE spacecraft need to be built both for planning/scheduling and for monitoring. In both cases, our modeling tools allow the assembly of a spacecraft model from separate sub-models of the various spacecraft subsystems. These sub-models are reusable; therefore, building mission operations systems for another small satellite mission will require choosing pre-existing modules, reparametrizing them with respect to the actual satellite telemetry information, and reassembling them in a new model. We briefly describe the EUVE mission and indicate why it is particularly suitable for the task. Then we briefly outline our current work in mission planning/scheduling and spacecraft and instrument health monitoring.

Muscettola, Nicola↗