Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analysis software”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,081 records · Page 60

An overview of the Hadoop/MapReduce/HBase framework and its current applications in bioinformatics

Bioinformatics researchers are increasingly confronted with analysis of ultra large-scale data sets, a problem that will only increase at an alarming rate in coming years. Recent developments in open source software, that is, the Hadoop project and associated software, provide a foundation for scaling to petabyte scale data warehouses on Linux clusters, providing fault-tolerant parallelized analysis on such data using a programming style named MapReduce. An overview is given of the current usage within the bioinformatics community of Hadoop, a top-level Apache Software Foundation project, and of associated open source software projects. The concepts behind Hadoop and the associated HBase project are defined, and current bioinformatics software that employ Hadoop is described. The focus is on next-generation sequencing, as the leading application area to date.

43 PARTICLE ACCELERATORS↗

Engineering Complex Embedded Systems with State Analysis and the Mission Data System

It has become clear that spacecraft system complexity is reaching a threshold where customary methods of control are no longer affordable or sufficiently reliable. At the heart of this problem are the conventional approaches to systems and software engineering based on subsystem-level functional decomposition, which fail to scale in the tangled web of interactions typically encountered in complex spacecraft designs. Furthermore, there is a fundamental gap between the requirements on software specified by systems engineers and the implementation of these requirements by software engineers. Software engineers must perform the translation of requirements into software code, hoping to accurately capture the systems engineer's understanding of the system behavior, which is not always explicitly specified. This gap opens up the possibility for misinterpretation of the systems engineer s intent, potentially leading to software errors. This problem is addressed by a systems engineering methodology called State Analysis, which provides a process for capturing system and software requirements in the form of explicit models. This paper describes how requirements for complex aerospace systems can be developed using State Analysis and how these requirements inform the design of the system software, using representative spacecraft examples.

mission data systems↗

The software product assurance metrics study: JPL's software systems quality and productivity

The findings are reported of the Jet Propulsion Laboratory (JPL)/Software Product Assurance (SPA) Metrics Study, conducted as part of a larger JPL effort to improve software quality and productivity. Until recently, no comprehensive data had been assembled on how JPL manages and develops software-intensive systems. The first objective was to collect data on software development from as many projects and for as many years as possible. Results from five projects are discussed. These results reflect 15 years of JPL software development, representing over 100 data points (systems and subsystems), over a third of a billion dollars, over four million lines of code and 28,000 person months. Analysis of this data provides a benchmark for gauging the effectiveness of past, present and future software development work. In addition, the study is meant to encourage projects to record existing metrics data and to gather future data. The SPA long term goal is to integrate the collection of historical data and ongoing project data with future project estimations.

Bush, Marilyn W.↗

Supporting flight data analysis for Space Shuttle Orbiter Experiments at NASA Ames Research Center

The Space Shuttle Orbiter Experiments program in responsible for collecting flight data to extend the research and technology base for future aerospace vehicle design. The Infrared Imagery of Shuttle (IRIS), Catalytic Surface Effects, and Tile Gap Heating experiments sponsored by Ames Research Center are part of this program. The paper describes the software required to process the flight data which support these experiments. In addition, data analysis techniques, developed in support of the IRIS experiment, are discussed. Using the flight data base, the techniques have provided information useful in analyzing and correcting problems with the experiment, and in interpreting the IRIS image obtained during the entry of the third Shuttle mission.

Green, M. J.↗

Bayes Inference Engine (BIE) Test Plan: TiltConeBeamComboDMLinear

The Bayes Inference Engine (BIE) is a general software tool intended to be used primarily in the analysis of radiographic data for density. An analysis is set up in the BIE by representing the problem as a collection of modules called glyphs. All glyphs to be used in creating the forward model of the experiment will be tested separately for a range of inputs.

97 MATHEMATICS AND COMPUTING↗

Bayes Inference Engine (BIE) Test Plan: TiltConeBeamComboDMGeometric

The Bayes Inference Engine (BIE) is a general software tool intended to be used primarily in the analysis of radiographic data for density. An analysis is set up in the BIE by representing the problem as a collection of modules called glyphs. All glyphs to be used in creating the forward model of the experiment will be tested separately for a range of inputs.

97 MATHEMATICS AND COMPUTING↗

GOME wavelength calibration using solar and atmospheric spectra

Spectral information in the global ozone monitoring experiment (GOME) solar irradiance spectra and GOME earth radiance spectra are used in conjunction with the GOME solar reference spectrum to provide absolute vacuum internal wavelength calibration for GOME. Two methods for wavelength calibration of GOME data are investigated. The first employs chi-square minimization of a merit function involving wavelength and the GOME slit function. It is quite robust and requires little GOME data in the processing (calibration window regions from 15 to 40 pixels). The second employs cross correlation of GOME data and the solar reference spectrum in the Fourier transform domain, using a procedure in the image reduction and analysis facility (IRAF) software system developed for the determination of galaxy redshifts. It also requires small amounts of GOME data (calibration window regions with from 10 to 15 pixels). Both methods provide absolute wavelength calibration accurate to a small fraction of a GOME pixel across the entire GOME spectrum, and to 0.001 nm over much of the range.

Caspar, C.↗

Scalable Analysis Methods and In Situ Infrastructure for Extreme Scale Knowledge Discovery

High performance computers have for many years been on a trajectory that gives them extraordinary compute power with the addition of more and more compute cores. At the same time, other system parameters such as the amount of memory per core and bandwidth to storage have remained constant or have barely increased. This creates an imbalance in the computer, giving it the ability to compute a lot of data that it cannot reasonably save out due to time and storage constraints. While technologies have been invented to mitigate this problem (burst buffers, etc.), software has been adapting to employ in situ libraries which perform data analysis and visualization on simulation data while it is still resident in memory. This avoids the need to ever have to pay the costs of writing many terabytes of data files. Instead, in situ enables the creation of more concentrated data products such as statistics, plots, and data extracts, which are all far smaller than the full-sized volume data. With the increasing popularity of in situ, multiple in situ infrastructures have been created, each with its own mechanism for integrating with a simulation. To make it easier to instrument a simulation with multiple in situ infrastructures and include custom analysis algorithms, this project created the SENSEI framework.

97 MATHEMATICS AND COMPUTING↗

Silicon Carbide Temperature Monitor Processing Improvements. Status Report

Silicon carbide (SiC) temperature monitors are used as temperature sensors in Advanced Test Reactor (ATR) irradiations at the Idaho National Laboratory (INL). Although thermocouples are typically used to provide real-time temperature indication in instrumented lead tests, other indicators, such as melt wires, are also often included in such tests as an independent technique of detecting peak temperatures incurred during irradiation. In addition, less expensive static capsule tests, which have no leads attached for real-time data transmission, often rely on melt wires as a post-irradiation technique for peak temperature indication. Melt wires are limited in that they can only detect whether a single temperature is or is not exceeded. SiC monitors are advantageous because a single monitor can be used to detect for a range of temperatures that occurred during irradiation. As part of the process initiated to make SiC temperature monitors available at the ATR, post-irradiation evaluations of these monitors have been previously completed at the High Temperature Test Laboratory (HTTL). INL selected the resistance measurement approach for determining irradiation temperature from SiC temperature monitors because it is considered to be the most accurate measurement. The current process involves the repeated annealing of the SiC monitors at incrementally increasing temperature, with resistivity measurements made between annealing steps. The process is time consuming and requires the nearly constant attention of a trained staff member. In addition to the expensive and lengthy post analysis required, the current process adds many potential sources of error in the measurement, as the sensor must be repeatedly moved from furnace to test fixture. This time-consuming post irradiation analysis is a significant portion of the total cost of using these otherwise inexpensive sensors. An additional consideration of this research is that, if the SiC post processing can be automated, it could be performed in an MFC hot cell, further reducing the time and expense of lengthy decontaminations prior to processing. Sections of this report provide a general description of resistivity techniques currently used to infer peak irradiation temperature from silicon carbide temperature monitors along with some representative data, the proposed concepts to improve the process of analyzing irradiated SiC temperature monitors, the completed efforts to prove the proposed concepts, and future activities. The efforts detailed here succeeded in designing and developing a real-time automated SiC resistivity measurement system, and performed two initial test runs. Activities carried out include the assembly and integration of the system hardware; the design and development of a preliminary monitor fixture; the design of a technique to automate the data analysis and processing; the development of the communication, coordination, and user software; and the execution and troubleshooting of test run experiments using the box furnace. Although the automation system performed as required, the designed fixture did not succeed in establishing the needed electrical contacts with the SiC monitor.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

System for Photogrammetry, Imaging, Detection, and Ranging, Software Design

Kennedy Space Center (KSC) uses high level pan/tilt camera systems in order to capture data for image analysis. As of right now, we know that current camera systems need to be man-operated, range greatly in costs, and are supplied by third parties. This project, System for Photogrammetric Imaging, Detection, and Ranging, otherwise known as SPIDR, aims to provide high quality image analysis from data drawn from the pan/tilt camera system to upgrade KSC’s ability to take images, and improve space flight and tracking. What this abstract will do, is explain the software needed to carry out such important tasks.

R.S. Kim↗

Information Leakage Analysis using a Co-design-Based Fault Injection Technique on a RISC-V Microprocessor

The RISC-V instruction set architecture open licensing policy has spawned a hive of development activity, making a range of implementations publicly available. The environments in which RISC-V operates have expanded correspondingly, driving the need for a generalized approach to evaluating the reliability of RISC-V implementations under adverse operating conditions or after normal wear-out periods. Fault injection (FI) refers to the process of changing the state of registers or wires, either permanently or momentarily, and then observing execution behavior. The analysis provides insight into the development of countermeasures that protect against the leakage or corruption of sensitive information which might occur because of unexpected execution behavior. In this paper, we develop a hardware-software co-design architecture that enables fast, configurable fault emulation and utilize it for information leakage and data corruption analysis. Modern System-on-chip FPGAs enable building an evaluation platform where control elements run on a processor(s) (PS) simultaneously with the target design running in the programmable logic (PL). Software components of the FI system introduce faults and report execution behavior. A pair of RISC-V FI-instrumented implementations are created and configured to execute the Advanced Encryption Standard and Twister algorithms. Key and plaintext information leakage and degraded pseudo-random sequences are both observed in the output for a subset of the emulated faults.

42 ENGINEERING↗

Algorithm Optimally Orders Forward-Chaining Inference Rules

People typically develop knowledge bases in a somewhat ad hoc manner by incrementally adding rules with no specific organization. This often results in a very inefficient execution of those rules since they are so often order sensitive. This is relevant to tasks like Deep Space Network in that it allows the knowledge base to be incrementally developed and have it automatically ordered for efficiency. Although data flow analysis was first developed for use in compilers for producing optimal code sequences, its usefulness is now recognized in many software systems including knowledge-based systems. However, this approach for exhaustively computing data-flow information cannot directly be applied to inference systems because of the ubiquitous execution of the rules. An algorithm is presented that efficiently performs a complete producer/consumer analysis for each antecedent and consequence clause in a knowledge base to optimally order the rules to minimize inference cycles. An algorithm was developed that optimally orders a knowledge base composed of forwarding chaining inference rules such that independent inference cycle executions are minimized, thus, resulting in significantly faster execution. This algorithm was integrated into the JPL tool Spacecraft Health Inference Engine (SHINE) for verification and it resulted in a significant reduction in inference cycles for what was previously considered an ordered knowledge base. For a knowledge base that is completely unordered, then the improvement is much greater.

James, Mark↗

Analysis of Plant Pan-Genomes and Transcriptomes with GET_HOMOLOGUES-EST, a Clustering Solution for Sequences of the Same Species

The pan-genome of a species is defined as the union of all the genes and noncoding sequences found in all its individuals. However, constructing a pan-genome for plants with large genomes is daunting both in sequencing cost and the scale of the required computational analysis. A more affordable alternative is to focus on the genic repertoire by using transcriptomic data. Here, the software GET_HOMOLOGUES-EST was benchmarked with genomic and RNA-seq data of 19 Arabidopsis thaliana ecotypes and then applied to the analysis of transcripts from 16 Hordeum vulgare genotypes. The goal was to sample their pan-genomes and classify sequences as core, if detected in all accessions, or accessory, when absent in some of them. The resulting sequence clusters were used to simulate pan-genome growth, and to compile Average Nucleotide Identity matrices that summarize intra-species variation. Although transcripts were found to under-estimate pan-genome size by at least 10%, we concluded that clusters of expressed sequences can recapitulate phylogeny and reproduce two properties observed in A. thaliana gene models: accessory loci show lower expression and higher non-synonymous substitution rates than core genes. Finally, accessory sequences were observed to preferentially encode transposon components in both species, plus disease resistance genes in cultivated barleys, and a variety of protein domains from other families that appear frequently associated with presence/absence variation in the literature. These results demonstrate that pan-genome analyses are useful to explore germplasm diversity.

54 ENVIRONMENTAL SCIENCES↗

SAAF: SANS data Analysis using Analytical Functions

The recently completed Extended Q-Range Small Angle Scattering Diffractometer (EQ-SANS) has put the focus on its software needs with renewed urgency. In a series of efforts, we aim at providing a complete set of software solutions on the EQ-SANS instrument. These programs include initial data processing, data correction and reduction, analytical model fitting to the scattering data, Monte Carlo simulation for structure determination, and virtual instrument simulation for experiment planning. SAAF is one such program for analytical data modeling. It takes the reduced EQ-SANS data and allows users to fit the data to analytical models. These models are easy to write. They can either be user written, or from the pre-supplied model library.

Data Analysis↗

Evaluation of Bare Ground on Rangelands using Unmanned Aerial Vehicles

Attention is currently being given to methods that assess the ecological condition of rangelands throughout the United States. There are a number of different indicators that assess ecological condition of rangelands. Bare Ground is being considered by a number of agencies and resource specialists as a lead indicator that can be evaluated over a broad area. Traditional methods of measuring bare ground rely on field technicians collecting data along a line transect or from a plot. Unmanned aerial vehicles (UAVs) provide an alternative to collecting field data, can monitor a large area in a relative short period of time, and in many cases can enhance safety and time required to collect data. In this study, both fixed wing and helicopter UAVs were used to measure bare ground in a sagebrush steppe ecosystem. The data were collected with digital imagery and read using the image analysis software SamplePoint. The approach was tested over seven different plots and compared against traditional field methods to evaluate accuracy for assessing bare ground. The field plots were located on the Idaho National Laboratory (INL) site west of Idaho Falls, Idaho in locations where there is very little disturbance by humans and the area is grazed only by wildlife. The comparison of fixed-wing and helicopter UAV technology against field estimates shows good agreement for the measurement of bare ground. This study shows that if a high degree of detail and data accuracy is desired, then a helicopter UAV may be a good platform. If the data collection objective is to assess broad-scale landscape level changes, then the collection of imagery with a fixed-wing system is probably more appropriate.

54 ENVIRONMENTAL SCIENCES↗

Preliminary design of the redundant software experiment

The goal of the present experiment is to characterize the fault distributions of highly reliable software replicates, constructed using techniques and environments which are similar to those used in comtemporary industrial software facilities. The fault distributions and their effect on the reliability of fault tolerant configurations of the software will be determined through extensive life testing of the replicates against carefully constructed randomly generated test data. Each detected error will be carefully analyzed to provide insight in to their nature and cause. A direct objective is to develop techniques for reducing the intensity of coincident errors, thus increasing the reliability gain which can be achieved with fault tolerance. Data on the reliability gains realized, and the cost of the fault tolerant configurations can be used to design a companion experiment to determine the cost effectiveness of the fault tolerant strategy. Finally, the data and analysis produced by this experiment will be valuable to the software engineering community as a whole because it will provide a useful insight into the nature and cause of hard to find, subtle faults which escape standard software engineering validation techniques and thus persist far into the software life cycle.

Campbell, Roy↗