Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Scientific Data Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45

Analysis of small crack behavior for airframe applications

The small fatigue crack problem is critically reviewed from the perspective of airframe applications. Different types of small cracks-microstructural, mechanical, and chemical-are carefully defined and relevant mechanisms identified. Appropriate analysis techniques, including both rigorous scientific and practical engineering treatments, are briefly described. Important materials data issues are addressed, including increased scatter in small crack data and recommended small crack test methods. Key problems requiring further study are highlighted.

Mcclung, R. C.↗

Composite Infrared Spectrometer (CIRS) on Cassini

The Cassini spacecraft orbiting Saturn carries the composite infrared spectrometer (CIRS) designed to study thermal emission from Saturn and its rings and moons. CIRS, a Fourier transform spectrometer, is an indispensable part of the payload providing unique measurements and important synergies with the other instruments. It takes full advantage of Cassini's 13-year-long mission and surpasses the capabilities of previous spectrometers on Voyager 1 and 2. The instrument, consisting of two interferometers sharing a telescope and a scan mechanism, covers over a factor of 100 in wavelength in the mid and far infrared. It is used to study temperature, composition, structure, and dynamics of the atmospheres of Jupiter, Saturn, and Titan, the rings of Saturn, and surfaces of the icy moons. CIRS has returned a large volume of scientific results, the culmination of over 30 years of instrument development, operation, data calibration, and analysis. As Cassini and CIRS reach the end of their mission in 2017, we expect that archived spectra will be used by scientists for many years to come.

Jennings, Donald E.↗

Long-Term Ozone Variability and Trends from Reanalyses

Stratospheric ozone has a profound impact on radiation and chemistry over various spatial and temporal scales. The evolution of stratospheric ozone over the 21st century, however, is not well understood, especially in the lower stratosphere. Highly vertically resolved ozone data from satellite-borne limb sounders have proved to be invaluable for studying ozone in the middle and upper stratosphere but it was not until recently that these measurements were successfully incorporated in atmospheric reanalyses. Validation and comparison studies have demonstrated that the addition of observations from the Microwave Limb Sounder (MLS) on EOS (Earth Observing System) Aura greatly improved the quality of ozone fields in MERRA-2 (Modern-Era Retrospective analysis for Research and Applications, Version 2) making these assimilated data sets more useful for scientific research. In this presentation we demonstrate that multidecadal lower-stratospheric ozone variability and trends can be derived from NASA's MERRA-2 reanalysis ozone. In particular, the reanalysis ozone bias-corrected using a chemistry model simulation as a transfer function agrees very well with recently reprocessed long ozonesonde records. Ozone trends in the lower stratosphere will be discussed in the context of recent findings (Ball et al., 2018) and interpreted in connection with long-term circulation changes in the lower stratosphere. Next, we show that the use of ozone data retrieved from the next generation OMPS (Ozone Mapping Profiler Suite) instruments, including the OMPS Limb Profiler, can successfully extend the reanalyses into the future allowing comprehensive monitoring of global ozone and interpretation of its evolution during the critical period of expected ozone recovery and climate change from increasing concentration of greenhouse gases.

ozone↗

DataHub--Knowledge-Based Science Data Management for Exploratory Data Analysis

It is our belief that new modes of research and new tools will be required to handle the massive amount of diverse data that is to be stored, organized, accessed, distributed, visualized, and analyzed. The fundamental innovation required is the integration of three automation technologies, videlicet knowledge-based expert systems, science visualization and science data management. This integration is based on a concept caled the DataHub, which we describe here.

DataHub↗

The Zwicky Transient Facility: System Overview, Performance, and First Results

The Zwicky Transient Facility (ZTF) is a new optical time-domain survey that uses the Palomar 48 inch Schmidt telescope. A custom-built wide-field camera provides a 47 deg ^(2) field of view and 8 s readout time, yielding more than an order of magnitude improvement in survey speed relative to its predecessor survey, the Palomar Transient Factory. We describe the design and implementation of the camera and observing system. The ZTF data system at the Infrared Processing and Analysis Center provides near-real-time reduction to identify moving and varying objects. We outline the analysis pipelines, data products, and associated archive. Finally, we present on-sky performance analysis and first scientific results from commissioning and the early survey. ZTF’s public alert stream will serve as a useful precursor for that of the Large Synoptic Survey Telescope.

Eric C. Bellm↗

Automated Downlink Pipeline for Scientific Data Using TReK

ISS users generate scientific data files on orbit that require console operators to retrieve and deliver them for analysis. Automating the downlink process using TReK CFDP and DTN provides ground flight controllers and PD teams increased efficiency, reducing workload and resulting in cost savings without reduced services provided.

TReK↗

Efficient Aho-Corasick String Matching on Emerging Multicore Architectures

String matching algorithms are critical to several scientific fields. Beside text processing and databases, emerging applications such as DNA protein sequence analysis, data mining, information security software, antivirus, ma- chine learning, all exploit string matching algorithms [3]. All these applica- tions usually process large quantity of textual data, require high performance and/or predictable execution times. Among all the string matching algorithms, one of the most studied, especially for text processing and security applica- tions, is the Aho-Corasick algorithm. 1 2 Book title goes here Aho-Corasick is an exact, multi-pattern string matching algorithm which performs the search in a time linearly proportional to the length of the input text independently from pattern set size. However, depending on the imple- mentation, when the number of patterns increase, the memory occupation may raise drastically. In turn, this can lead to significant variability in the performance, due to the memory access times and the caching effects. This is a significant concern for many mission critical applications and modern high performance architectures. For example, security applications such as Network Intrusion Detection Systems (NIDS), must be able to scan network traffic against very large dictionaries in real time. Modern Ethernet links reach up to 10 Gbps, and malicious threats are already well over 1 million, and expo- nentially growing [28]. When performing the search, a NIDS should not slow down the network, or let network packets pass unchecked. Nevertheless, on the current state-of-the-art cache based processors, there may be a large per- formance variability when dealing with big dictionaries and inputs that have different frequencies of matching patterns. In particular, when few patterns are matched and they are all in the cache, the procedure is fast. Instead, when they are not in the cache, often because many patterns are matched and the caches are continuously thrashed, they should be retrieved from the system memory and the procedure is slowed down by the increased latency. Efficient implementations of string matching algorithms have been the fo- cus of several works, targeting Field Programmable Gate Arrays [4, 25, 15, 5], highly multi-threaded solutions like the Cray XMT [34], multicore proces- sors [19] or heterogeneous processors like the Cell Broadband Engine [35, 22]. Recently, several researchers have also started to investigate the use Graphic Processing Units (GPUs) for string matching algorithms in security applica- tions [20, 10, 32, 33]. Most of these approaches mainly focus on reaching high peak performance, or try to optimize the memory occupation, rather than looking at performance stability. However, hardware solutions supports only small dictionary sizes due to lack of memory and are difficult to customize, while platforms such as the Cell/B.E. are very complex to program.

Tumeo, Antonino↗

Deep vadose zone remediation: technical and policy challenges, opportunities, and progress in achieving cleanup endpoints

Current requirements for site remediation and closure are standards-based and are often overly conservative, costly, and in some cases, technically impractical. Use of risk-informed alternate endpoints provides a means to achieve remediation goals that are permitted by regulations and are protective of human health and the environment. Alternate endpoints enable the establishment of a path for cleanup that may include intermediate remedial milestones and transition points and/or regulatory alternatives to standards-based remediation. A framework is presented that is centered around developing and refining conceptual models in conjunction with assessing risks and potential endpoints as part of a system-based assessment that integrates site data with scientific understanding of processes that control the distribution and transport of contaminants in the subsurface and pathways to receptors. This system-based assessment and subsequent implementation of the remediation strategy with appropriate monitoring are targeted at providing a holistic approach to addressing risks to human health and the environment. This holistic approach also enables effective predictive analysis of contaminant behavior to provide defensible criteria and data for making long-term decisions. Developing and implementing an alternate endpoint-based approach for remediation and waste site closure presents a number of challenges and opportunities. Categories of these challenges include scientific and technical, regulatory, institutional, and budget and resource allocation issues. Opportunities exist for developing and implementing systems-based approaches with respect to supportive characterization, monitoring, predictive modeling, and remediation approaches. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A Zoom-in Analysis of I/O Logs to Detect Root Causes of I/O Performance Bottlenecks

Scientific applications frequently spend a large fraction of their execution time in reading and writing data on parallel file systems. Identifying these I/O performance bottlenecks and attributing root causes are critical steps toward devising optimization strategies. Several existing studies analyze I/O logs of a set of benchmarks or applications that were run with controlled behaviors. However, there is still a lack of general approach that systematically identifies I/O performance bottlenecks for applications running "in the wild" on production systems. In this study, we have developed an analysis approach of "zooming in" from platform-wide to application-wide to job-level I/O logs for identifying I/O bottlenecks in arbitrary scientific applications. We analyze the logs collected on a Cray XC40 system in production over a two-month period. This study results in several insights for application developers to use in optimizing I/O behavior.

Wang, Teng↗

An Adaptive Middleware Framework for Scientific Computing at Extreme Scales

Large computing systems including clusters, clouds, and grids, provide high-performance capabilities that can be utilized for many applications. But as the ubiquity of these systems increases and the scope of analysis being done on them grows, there is a growing need for applications that 1) do not require users to learn the details of high performance systems, and 2) are flexible and adaptive in their usage of these systems to accommodate the best time-to-solution for end users. We introduce a new adaptive interface design and a prototype implementation within the framework of an established middleware framework, MeDICi, for high performance computing systems and describe the applicability of this adaptive design to a real-life scientific workflow. This adaptive framework provides an access model for implementing a processing pipeline using high performance systems that are not local to the data source, making it possible for the compute capabilities at one site to be applied to analysis on data being generated at another site in an automated process. This adaptive design improves overall time-to-solution by moving the data analysis task to the most appropriate resource dynamically, reacting to failures and load fluctuations.

97 MATHEMATICS AND COMPUTING↗

A KBase Case Study on Genome-wide Transcriptomics and Plant Primary Metabolism in Sorghum

A better understanding of the genetic and metabolic mechanisms that confer stress resistance and tolerance in plants is key to engineering new crops through advanced breeding technologies. This requires a systems biology approach that builds on a genome-wide understanding of the regulation of gene expression, plant metabolism, physiology and growth. In this study, we examine the response to drought stress in Sorghum, as we leverage the tools for transcriptomics and plant metabolic modeling we have implemented at the U.S. Department of Energy Systems Biology Knowledgebase (KBase). KBase enables researchers worldwide to collaborate and advance research by allowing them to upload private or public data into the KBase Narrative Interface, empowering them to analyze this data using a rich, extensible array of computational and data-analytics tools, and allows them to securely share scientific workflows and conclusions. We demonstrate how to use the current RNA-seq tools in KBase, applicable to both plants and microbes, to assemble and quantify long transcripts and identify differentially expressed genes effectively. More specifically, we demonstrate the utility of the platform by identifying key genes that are differentially expressed during drought-stress in Sorghum bicolor, which is an important sustainable production crop plant. We then show how to use KBase tools to predict the membership of genes in metabolic pathways and examine expression data in the context of metabolic subsystems. We demonstrate the power of the platform by making the data analysis and interpretation available to the biologists in the reproducible, re-usable, point-and-click format of a KBase Narrative thus promoting FAIR (Findable, Accessible, Interoperable and Reusable) guiding principles for scientific data management and stewardship.

59 BASIC BIOLOGICAL SCIENCES↗

Data-driven Whitney forms for structure-preserving control volume analysis

Control volume analysis models physics via the exchange of generalized fluxes between subdomains. Here, we introduce a scientific machine learning framework adopting a partition of unity architecture to identify physically-relevant control volumes, with generalized fluxes between subdomains encoded via Whitney forms. The approach provides a differentiable parameterization of geometry which may be trained in an end-to-end fashion to extract reduced models from full field data while exactly preserving physics. The architecture admits a data-driven finite element exterior calculus allowing discovery of mixed finite element spaces with closed form quadrature rules. An equivalence between Whitney forms and graph networks reveals that the geometric problem of control volume learning is equivalent to an unsupervised graph discovery problem. The framework is developed for manifolds in arbitrary dimension, with examples provided for H(div) problems in $\mathbb{R}$ establishing convergence and structure preservation properties. Finally, we consider a lithium-ion battery problem where we discover a reduced finite element space encoding transport pathways from high-fidelity microstructure resolved simulations. The approach reduces the 5.89M finite element simulation to 136 elements while reproducing pressure to under 0.1% error and preserving conservation.

97 MATHEMATICS AND COMPUTING↗

Distinguishing Provenance Equivalence of Earth Science Data

Reproducibility of scientific research relies on accurate and precise citation of data and the provenance of that data. Earth science data are often the result of applying complex data transformation and analysis workflows to vast quantities of data. Provenance information of data processing is used for a variety of purposes, including understanding the process and auditing as well as reproducibility. Certain provenance information is essential for producing scientifically equivalent data. Capturing and representing that provenance information and assigning identifiers suitable for precisely distinguishing data granules and datasets is needed for accurate comparisons. This paper discusses scientific equivalence and essential provenance for scientific reproducibility. We use the example of an operational earth science data processing system to illustrate the application of the technique of cascading digital signatures or hash chains to precisely identify sets of granules and as provenance equivalence identifiers to distinguish data made in an an equivalent manner.

Tilmes, Curt↗

Toward Quantity-of-Interest Preserving Lossy Compression for Scientific Data

Today's scientific simulations and instruments are producing a large amount of data, leading to difficulties in storing, transmitting, and analyzing these data. While error-controlled lossy compressors are effective in significantly reducing data volumes and efficiently developing databases for multiple scientific applications, they mainly support error controls on raw data, which leaves a significant gap between the data and user's downstream analysis. This may cause unqualified uncertainties in the outcomes of the analysis, a.k.a quantities of interest (QoIs), which are the major concerns of users in adopting lossy compression in practice. In this paper, we propose rigorous mathematical theories to preserve four families of QoIs that are widely used in scientific analysis during lossy compression along with practical implementations. Specifically, we first develop the error control theory for univariate QoIs which are essential for computing physical properties such as kinetic energy, followed by multivariate QoIs that are more commonly used in real-world applications. The proposed method is integrated into a state-of-the-art compression framework in a modular fashion, which could easily adapt to new QoIs and new compression algorithms. Experiments on real-world datasets demonstrate that the proposed method provides faithful error control on important QoIs including kinetic energy, regional average, and isosurface without trials and errors, while offering compression ratios that are up to 4x of the compression ratios provided by state-of-the-art compressors.

Jiao, Pu↗

Collaborative Data Curation to Support the Multi-Mission Algorithm and Analysis Platform (MAAP)

Upcoming space-borne missions will offer unprecedented data about Earth but will also feature exponentially high data volumes. These high data volumes will change the way the scientific community works with data and will also create a unique need for improved data sharing and collaboration. NASA and ESA are working together to address these issues by collaboratively developing the Multi-Mission Algorithm and Analysis Platform (MAAP) to improve the understanding of global aboveground terrestrial carbon dynamics. The MAAP will support ESA’s BIOMASS mission, NASA’s GEDI mission and NASA/ISRO’s NISAR mission. The MAAP will be developed in two phases: a pilot phase and a full production phase. The pilot phase will demonstrate collaboration and basic capabilities. The pilot phase will focus on biomass relevant airborne and field campaign data. Two NASA teams are supporting the development of the MAAP. The MAAP engineering team is responsible for the development, maintenance and operations of the MAAP system while the MAAP data team ensures the ongoing quality of the data, metadata and other information provided in the MAAP. The MAAP data team also supports the ingest and archive of identified data to the MAAP platform. This poster describes the use case development process for the pilot MAAP and the data curated in support of those use cases. Additionally, this presentation will outline the pilot MAAP data ingest process and metadata curation effort along with efforts to ensure interoperability between ESA and NASA data and metadata.

Bugbee, Kaylin↗

The Living With a Star CDAW on the Solar and Geospace Connections of Solar Energetic Particles

The Living With a Star Program is sponsoring its first CDAW (Coordinated Data Analysis Workshop) to be held July 23-26, 2002 at a conference support location near the NASA Goddard Space Flight Center. This CDAW's topic is Solar Energetic Particle events. The topic was chosen due to the breadth of the impact of SEP's on the space environment and terrestrial climate. General goals of the LWS CDAW are a) Stimulate LWS Science on the near term, b) Facilitate cross-disciplinary interaction between the LWS scientific and space environment communities, c) Produce science products for all potential users, and d) Assist in the development of the LWS data system. The workshop will proceed similar to a previous CDAW held in 1999 on Interplanetary Type 11 Shocks. A list of target events has been compiled, which can be found at the workshop home page. The page lists all of the SEP events from 1996 January to 2001 December with energy > 10 MeV particle intensities exceeding 10 PFU. Preparation for the workshop consists of identifying relevant data from a wide variety of sources (solar, interplanetary, magnetospheric and climatary), accumulating the data (frequently this consists of both raw data, processed data and plots to ease perusal during the workshop) and gathering the software tools. Participants in the workshop are expected to complete their contributions of data or models prior to arriving at the workshop. Most of the CDAW consists of joint analysis of this data; only a few introductory talks are given at the beginning of the workshop, with the rest of the time being devoted to producing scientific results. Additional symposia may be scheduled at a later date, which will allow a venue for scientific talks on the CDAW results and associated science. The poster will list the scientific goals of the workshop, as well as a scientific discussion of the data which has been accumulated thus far.

Thompson, Barbara J.↗

The Proposed Mars Astrobiology Explorer - Cacher [MAX-C] Rover: First Step in a Potential Sample Return Campaign

Sample return from Mars has been advocated by numerous scientific advisory panels for over 30 years, most prominently beginning with the National Research Council s [1] strategy for the exploration of the inner solar system, and most recently by the Mars Exploration Program Analysis Group (MEPAG s) Next Decade Science Analysis Group [2]. Analysis of samples here on Earth would have enormous advantages over in situ analyses in producing the data quality needed to address many of the complex scientific questions the community has posed about Mars. Instead of a small, predetermined set of analytical techniques, state of the art preparative and instrumental resources of the entire scientific community could be applied to the samples. The analytical emphasis could shift as the meaning of each result becomes better appreciated. These arguments apply both to igneous rocks and to layered sedimentary materials, either of which could contain water and other volatile constituents. In 2009 MEPAG formed the Mid-Range Rover Science Analysis Group (MRR-SAG) to formulate a mission concept that would address two general objectives: (1) conduct high-priority in situ science and (2) make concrete steps towards the potential return of samples to Earth. This analysis resulted in a mission concept named the Mars Astrobiology Explorer-Cacher (MAX-C), which was envisioned for launch in the 2018 opportunity. After extensive discussion, this group concluded that by far the most definitive contribution to sample return by this mission would be to collect and cache, in an accessible location, a suite of compelling samples that could potentially be recovered and returned by a subsequent mission. This would have the effect of separating two of the essential functions of MSR, the acquisition of the sample collection and its delivery to martian orbit, into two missions.

Allen, Carlton C.↗

X ray observations of late-type stars using the ROSAT all-sky survey

The ROSAT mission made the first x ray survey of the entire sky using an imaging detector. Although ROSAT is a joint NASA/German project and involves direct American participation during its second phase of pointed observations, the all-sky survey remains the sole property of the German investigators. NASA grant represented the first use of ROSAT data analysis funds to support direct American participation in the ROSAT all-sky survey. The project involved a collaborative agreement between the Joint Institute for Laboratory Astrophysics (JILA) and the Max-Planck-Institut fur Extraterrestrische Physik (MPE) where JILA supplied MPE with a post-doctoral research associate with experience in the field of stellar (coronal) x ray emission to work within their ROSAT group. In return, members of the cool star research group at JILA were given the opportunity to collaborate on projects involving ROSAT all-sky survey data. Both sides have benefitted (and still benefit) from this arrangement since MPE suffers from a shortage of researchers who are interested in x ray emission from 'normal' stars and white dwarfs. MPE has also drawn upon experience in optical identification of x ray sources from the Einstein Extended Medium Sensitivity Survey in planning their own identification strategies for the ROSAT all-sky survey. The JILA cool stars group has benefitted since access to all-sky survey data has expanded the scope of their already extensive research programs involving multiwavelength observations of late-type stars. ROSAT was successfully launched on 1 June 1990 and conducted the bulk of the survey from 30 July 1990 to 25 January 1991. Data gaps in the survey have subsequently been made up. At the time of this writing (February 1992), the survey data have been processed once with the Standard Analysis Software System (SASS). A second processing will soon begin with improvements made to the SASS to correct errors and bugs found while carrying out scientific projects with data from the first processing. We outline the major research activities of Dr. Fleming over the past year (detailed accounts of his activities during the first two years of this grant can be found in the first-year and second-year status reports on this grant). Regarding the three specific projects which were proposed in the original proposal, two of them (White Dwarfs and Late M Dwarfs) are near completion. The results are described in two conference proceedings which are appended.

Linsky, Jeffrey L.↗