Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,531 records · Page 85

Thematic Mapper Image Production in the Engineering Checkout Phase

Thematic Mapper data processing during LANDSAT 4's first year was performed on an engineering evaluation basis. Fully corrected products were created for some 282 scenes during this period using software and systems based upon the intended full production systems to become operational following the evaluation period. The engineering systems included substantial software and procedures for assessing spacecraft, instrument and ground processing algorithmic behavior. The data systems are described in terms of performance objectives, processing organization and data flow, quality assurance measurements and achievement of goals. The a priori implementation of TM radiometric and geometric corrections is described. Changes to processing suggested by or implemented on the basis of on-orbit data analysis are discussed. Spacecraft, instrument and algorithmic performance are evaluated.

Fischel, D.↗

Gemini frontier fields: wide-field adaptive optics K{sub s}-band imaging of the galaxy clusters MACS J0416.1-2403 and ABELL 2744

We have observed two of the six Frontier Fields galaxy clusters, MACS J0416.1-2403 and Abell 2744, using the Gemini Multi-Conjugate Adaptive Optics System (GeMS) and the Gemini South Adaptive Optics Imager (GSAOI). With 0.″ 08–0.″ 10 FWHM our data are nearly diffraction-limited over a 100{sup ′′}×100{sup ′′} wide area. GeMS/GSAOI complements the Hubble Space Telescope (HST) redwards of 1.6 μm with twice the angular resolution. We reach a 5σ depth of K{sub s}∼25.6 mag (AB) for compact sources. In this paper, we describe the observations, data processing, and initial public data release. We provide fully calibrated, co-added images matching the native GSAOI pixel scale as well as the larger plate scales of the HST release, adding to the legacy value of the Frontier Fields. Our work demonstrates that even for fields at high galactic latitude where natural guide stars are rare, current multi-conjugated adaptive optics technology at 8 m telescopes has opened a new window on the distant universe. Observations of a third Frontier Field, Abell 370, are planned.

79 ASTRONOMY AND ASTROPHYSICS↗

16S and ITS Amplicon Sequencing Fastq files and metadata from PARCHED Panama Tropical Forest soils, 2019-2020,

Model projections predict tropical forests will experience longer periods of drought and more intense precipitation cycles under a changing climate. Such transitions have implications for structure-function relationships within microbial communities. We examine how chronic drying might reshape prokaryotic and fungal communities across four lowland forests in Panama with a wide variation in mean annual precipitation and soil fertility. Four sites were established across a 1000 mm span in mean annual precipitation (2335 to 3300 mm). We expected microbial communities at sites with lower MAP to be less sensitive to chronic drying than sites with higher MAP; while fungal communities to be more resistant to disturbance than prokaryotes. At each location, partial throughfall exclusion structures were established over 10 x 10 m plots to reduce direct precipitation input. Raw demultiplexed sequences (bacteria, archaea, fungal) from soil samples taken from PARCHED Panama Tropical Forest throughfall exclusion experiments. Files that contain 16S are sequences from prokaryotes, ITS indicates sequences from fungi. Compressed fastq files are contained in Field_PARCHED_ITS_fastq_2020.zip, Field_PARCHED_ITS_fastq_2019.zip, Field_PARCHED_16S_fastq_2020.zip, Field_PARCHED_16S_fastq_2019.zip.There are four sites across the isthmus of Panama, each with 4 control and 4 exclusion plots. Throughfall exclusion shelters were built to intercept 50% of throughfall precipitation that hits the soil. Samples were taken on May 2019 and Jan 2020 from 0-10 cm and 10-20 cm depth approximately 9 and 18 months after shelter installation. Metadata and sample IDs for fastq files for 2019 sampling are within Field_PARCHED_Metadata_2019_ITS.csv and Field_PARCHED_Metadata_2019_16S.csv. The metadata for both 16S and ITS fastq files for January 2020 is included in Field_PARCHED_Metadata_2020.csv. No data processing or QA/QC was done on the raw data. Data processing example provided in R notebook file.

54 ENVIRONMENTAL SCIENCES↗

Using NJOY to Create MCNP ACE Files and Visualize Nuclear Data

We provide lecture materials that describe the input requirements to create various MCNP ACE files (Fast, Thermal, Dosimetry, Photo-nuclear and Photo-atomic) with the NJOY Nuclear Data Processing code system. Input instructions to visualize nuclear data with NJOY are also provided.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Advanced space information systems

Onboard computers for pre-transmission data processing, automation of data acquisition centers, and real time data relay to control centers for advanced space information systems

REAL TIME↗

AMPS data management concepts

Five typical AMPS experiments were formulated to allow simulation studies to verify data management concepts. Design studies were conducted to analyze these experiments in terms of the applicable procedures, data processing and displaying functions. Design concepts for AMPS data management system are presented which permit both automatic repetitive measurement sequences and experimenter-controlled step-by-step procedures. Extensive use is made of a cathode ray tube display, the experimenters' alphanumeric keyboard, and the computer. The types of computer software required by the system and the possible choices of control and display procedures available to the experimenter are described for several examples. An electromagnetic wave transmission experiment illustrates the methods used to analyze data processing requirements.

Metzelaar, P. N.↗

The 1994 research and technology report at the Goddard Space Flight Center

The breadth of subject material in this 1994 edition of the Research and Technology Report illustrates the broad scope of activities at the Goddard Space Flight Center. The numerous entries dealing with data processing and visualization show the strong emphasis on data and its interpretation. Reports are presented in the following sections: data processing and visualization; space sciences - high energy astronomy, solar system, and new techniques; earth system science - atmospheres, oceans and ice, solid earth, and soils and vegetation; networks, planning, and information systems - mission scheduling and operations, spacecraft operation and status, software engineering, and infrastructure support; engineering and materials - spacecraft subsystems, launch vehicles, thermal control, new mechanisms, and testing and evaluation; and flight projects.

Soffen, Gerald↗

A High-Throughput, Adaptive FFT Architecture for FPGA-Based Space-Borne Data Processors

Historically, computationally-intensive data processing for space-borne instruments has heavily relied on ground-based computing resources. But with recent advances in functional densities of Field-Programmable Gate-Arrays (FPGAs), there has been an increasing desire to shift more processing on-board; therefore relaxing the downlink data bandwidth requirements. Fast Fourier Transforms (FFTs) are commonly used building blocks for data processing applications, with a growing need to increase the FFT block size. Many existing FFT architectures have mainly emphasized on low power consumption or resource usage; but as the block size of the FFT grows, the throughput is often compromised first. In addition to power and resource constraints, space-borne digital systems are also limited to a small set of space-qualified memory elements, which typically lag behind the commercially available counterparts in capacity and bandwidth. The bandwidth limitation of the external memory creates a bottleneck for a large, high-throughput FFT design with large block size. In this paper, we present the Multi-Pass Wide Kernel FFT (MPWK-FFT) architecture for a moderately large block size (32K) with considerations to power consumption and resource usage, as well as throughput. We will also show that the architecture can be easily adapted for different FFT block sizes with different throughput and power requirements. The result is completely contained within an FPGA without relying on external memories. Implementation results are summarized.

Nguyen, Kayla↗

Kepler: A Search for Terrestrial Planets. K2 Handbook

The Kepler spacecraft was repurposed for the K2 mission a year after the failure of the second of Kepler's four reaction wheels in 2013 May. The purpose of this document, the K2 Handbook (K2H), is to describe features of K2 operations, performance, data analysis, and archive products which are common to most K2 campaigns, but different in degree or kind from the corresponding features of the Kepler mission.The K2 Handbook is meant to be read with the following companion documents, which are all publicly available:1. Kepler Instrument Handbook (KSCI-19033) provides information about the design, performance and operational constraints of the instrument and an overview of the types of pixel data that are available.2. Kepler Data Processing Handbook (KSCI-19081) describes how pixels downloaded from the spacecraft are converted by the Kepler Data Processing Pipeline into the data products available at the MAST archive3. Kepler Archive Manual (KDMC-100008) describes the format and content of the data products and how to search for them.4. Kepler Data Characteristics Handbook (KSCI-19040) describes recurring non-astrophysical features of the Kepler data due to instrument signatures, spacecraft events or solar activity and explains how these characteristics are handled by the Kepler pipeline.5. The Ecliptic Plane Input Catalog describes the provenance of the positions and Kepler magnitudes used for target management and aperature photometry.6. K2 Data Release Notes (DRN) are on-line documents available on the K2 science website which describe the data inventory, instrumental signatures and events peculiar to individual observing campaigns.

K2↗

Exploring Beyond Earth's Atmosphere with Human-Machine Teams

NASA's highly successful Kepler Mission has revolutionized our understanding of the Galaxy. We now know that planets, even Earth-size planets in the habitable zone, are common. With the end of the Kepler Mission we now look to the future with the Transiting Exoplanet Survey Satellite (TESS) which will discover thousands of exoplanets in orbit around the brightest stars in the sky. In a two-year survey, TESS will perform an all-sky search of more than 200,000 stars for temporary drops in brightness caused by planetary transits. With Kepler and TESS, humanity is finally at the verge of studying the masses, sizes, densities, orbits, and atmospheres of a large cohort of small planets, including a sample of rocky worlds in the habitable zones of their host stars which may prove to host life. The massive data sets generated by Kepler and TESS must be meticulously combed for the weakest planetary signals every month. While a daunting and error-prone task for humans, this is an exciting opportunity for the breakthroughs recently seen in machine learning. Specifically, traditional methods for identifying planet transits require extensive data processing pipelines followed by extensive human vetting. This manual process risks loss of information due to the data processing and to inconsistency and biases due to individual human vetters. The latest advancements in machine learning will allow an objective classifier to minimize the losses of information and greatly lessen the burden on the human vetters, in addition to providing assessment of quality and score to each planet candidate, freeing the humans to concentrate on border cases and other more interesting investigations.

Smith, Jeffrey C.↗

Impacts of Carbon Capture on Life Cycle Inventory of Ammonia and Petroleum Products for Comparison to Thermoelectric Power Generation - LCAXVII

This work was presented at the American Center for Life Cycle Assessment (ACLCA) LCAXVII Conference in Portsmouth, NH on October 5, 2017. The objectives of this study are to create an updated baseline life cycle inventory for petroleum products considering the full suite of TRACI impacts that expands upon Cooney et al. and to understand the effect of implementing carbon capture on the environmental profile of refineries. This inventory adds toxic air emissions and releases to water and soil to NETL’s previous unit process data. The approach demonstrates how detailed national inventory data can be used to improve LCA unit process data. Facility-level variability is presented and the implications for uncertainty analysis and interpretation of results are discussed.

Young, Ben↗

On Certain New Methodology for Reducing Sensor and Readout Electronics Circuitry Noise in Digital Domain

NASA Hubble Space Telescope (HST) and upcoming cosmology science missions carry instruments with multiple focal planes populated with many large sensor detector arrays. These sensors are passively cooled to low temperatures for low-level light (L3) and near-infrared (NIR) signal detection, and the sensor readout electronics circuitry must perform at extremely low noise levels to enable new required science measurements. Because we are at the technological edge of enhanced performance for sensors and readout electronics circuitry, as determined by thermal noise level at given temperature in analog domain, we must find new ways of further compensating for the noise in the signal digital domain. To facilitate this new approach, state-of-the-art sensors are augmented at their array hardware boundaries by non-illuminated reference pixels, which can be used to reduce noise attributed to sensors. There are a few proposed methodologies of processing in the digital domain the information carried by reference pixels, as employed by the Hubble Space Telescope and the James Webb Space Telescope Projects. These methods involve using spatial and temporal statistical parameters derived from boundary reference pixel information to enhance the active (non-reference) pixel signals. To make a step beyond this heritage methodology, we apply the NASA-developed technology known as the Hilbert- Huang Transform Data Processing System (HHT-DPS) for reference pixel information processing and its utilization in reconfigurable hardware on-board a spaceflight instrument or post-processing on the ground. The methodology examines signal processing for a 2-D domain, in which high-variance components of the thermal noise are carried by both active and reference pixels, similar to that in processing of low-voltage differential signals and subtraction of a single analog reference pixel from all active pixels on the sensor. Heritage methods using the aforementioned statistical parameters in the digital domain (such as statistical averaging of the reference pixels themselves) zeroes out the high-variance components, and the counterpart components in the active pixels remain uncorrected. This paper describes how the new methodology was demonstrated through analysis of fast-varying noise components using the Hilbert-Huang Transform Data Processing System tool (HHT-DPS) developed at NASA and the high-level programming language MATLAB (Trademark of MathWorks Inc.), as well as alternative methods for correcting for the high-variance noise component, using an HgCdTe sensor data. The NASA Hubble Space Telescope data post-processing, as well as future deep-space cosmology projects on-board instrument data processing from all the sensor channels, would benefit from this effort.

Kizhner, Semion↗

High Accuracy Signal Validation Framework for Sensor Calibration Assessment in NPPs

Effective and efficient health management of sensing channels and instrumentation supports reliable and accurate process monitoring capacities in any industry. Current practice in the nuclear industry relies on periodic calibration assessment and correction activities. This time based maintenance technique consists of three steps: i) removal of sensor to a test environment, ii) testing and recalibration, and iii) reinstallation of sensor into its working environment. This procedure is highly labor intensive, adds to the outage cost and timeline, and contributes to worker radiation exposure and ALARA requirements. Furthermore, the human element contributes to error factors in all stages of the procedure. The effectiveness of this calibration procedure after sensors are returned to working environmental variables also raises concerns, and the practicability of this periodic approach is uncertain for future reactor designs with longer operating cycles between refueling outages. Studies indicate that periodic calibration assessment find only 10% of sensing instrumentations with calibration issues during a single outage (18- 24 months), meaning at least 90% of sensors are undergoing unnecessary maintenance actions. This provides an opportunity to maintain the current levels of safety and functional integrity with fewer, more targeted maintenance actions and lower economic burden. Performance-based maintenance planning shows much promise over current periodic maintenance approaches. Specifically, online monitoring (OLM) utilizes the continually collected process data to non-intrusively monitor the calibration status of process instrumentation and detect the onset of de-calibration, thereby minimizing the number of recalibration procedures required. Ultimately, this can lead to termination of time based recalibration at NPPs. OLM utilizes the process measurements made for process monitoring and control to evaluate the calibration status of the sensors and instrumentation making the measurements. OLM can detect and differentiate sensor faults and process anomalies, thus providing a valuable tool to suit the industry's and regulatory body's requirements. Though supported by more than a decade of research, OLM for sensor calibration assessment is yet to be implemented in the US fleet due to regulatory requirements and constraints. As shown in Figure 1, OLM utilizes process data to train statistical models that predict normal, error-free process behavior. Measured process values are compared with error-corrected predictions to ascertain the presence of faults. The reliability of OLM is dependent on the quality of its predictions, measured in part by the uncertainty in these predictions. This research develops a framework to accurately quantify the prediction uncertainty based on Bayesian inference techniques to provide the required confidence levels for OLM systems. The expected outcomes include signal validation by high-accuracy, high-confidence uncertainty quantification for variable sensor types and operating ranges. Furthermore, the framework will facilitate fault detection capacities and so-called virtual sensors, a capability to replace faulty sensor measurements with error-corrected values when a sensor fault is detected. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

A characterization of workflow management systems for extreme-scale applications

We present that the automation of the execution of computational tasks is at the heart of improving scientific productivity. Over the last years, scientific workflows have been established as an important abstraction that captures data processing and computation of large and complex scientific applications. By allowing scientists to model and express entire data processing steps and their dependencies, workflow management systems relieve scientists from the details of an application and manage its execution on a computational infrastructure. As the resource requirements of today’s computational and data science applications that process vast amounts of data keep increasing, there is a compelling case for a new generation of advances in high-performance computing, commonly termed as extreme-scale computing, which will bring forth multiple challenges for the design of workflow applications and management systems. This paper presents a novel characterization of workflow management systems using features commonly associated with extreme-scale computing applications. We classify 15 popular workflow management systems in terms of workflow execution models, heterogeneous computing environments, and data access methods. Finally, the paper also surveys workflow applications and identifies gaps for future research on the road to extreme-scale workflows and management systems.

97 MATHEMATICS AND COMPUTING↗

De-icing: recovery of diffraction intensities in the presence of ice rings

Macromolecular structures are routinely determined at cryotemperatures using samples flash-cooled in the presence of cryoprotectants. However, sometimes the best diffraction is obtained under conditions where ice formation is not completely ablated, with the result that characteristic ice rings are superimposed on the macromolecular diffraction. In data processing, the reflections that are most affected by the ice rings are usually excluded. Here, an alternative approach of subtracting the ice diffraction is tested. High completeness can be retained with little adverse effect upon the quality of the integrated data. This offers an alternate strategy when high levels of cryoprotectant lead to loss of crystal quality.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Accelerating Science Impact through Big Data Workflow Management and Supercomputing

The Large Hadron Collider (LHC), operating at the international CERN Laboratory in Geneva, Switzerland, is leading Big Data driven scientific explorations. ATLAS, one of the largest collaborations ever assembled in the the history of science, is at the forefront of research at the LHC. To address an unprecedented multi-petabyte data processing challenge, the ATLAS experiment is relying on a heterogeneous distributed computational infrastructure. To manage the workflow for all data processing on hundreds of data centers the PanDA (Production and Distributed Analysis)Workload Management System is used. An ambitious program to expand PanDA to all available computing resources, including opportunistic use of commercial and academic clouds and Leadership Computing Facilities (LCF), is realizing within BigPanDA and megaPanDA projects. These projects are now exploring how PanDA might be used for managing computing jobs that run on supercomputers including OLCF’s Titan and NRC-KI HPC2. The main idea is to reuse, as much as possible, existing components of the PanDA system that are already deployed on the LHC Grid for analysis of physics data. The next generation of PanDA will allow many data-intensive sciences employing a variety of computing platforms to benefit from ATLAS experience and proven tools in highly scalable processing.

97 MATHEMATICS AND COMPUTING↗

Subband/transform functions for image processing

Functions for image data processing written for use with the MATLAB(TM) software package are presented. These functions provide the capability to transform image data with block transformations (such as the Walsh Hadamard) and to produce spatial frequency subbands of the transformed data. Block transforms are equivalent to simple subband systems. The transform coefficients are reordered using a simple permutation to give subbands. The low frequency subband is a low resolution version of the original image, while the higher frequency subbands contain edge information. The transform functions can be cascaded to provide further decomposition into more subbands. If the cascade is applied to all four of the first stage subbands (in the case of a four band decomposition), then a uniform structure of sixteen bands is obtained. If the cascade is applied only to the low frequency subband, an octave structure of seven bands results. Functions for the inverse transforms are also given. These functions can be used for image data compression systems. The transforms do not in themselves produce data compression, but prepare the data for quantization and compression. Sample quantization functions for subbands are also given. A typical compression approach is to subband the image data, quantize it, then use statistical coding (e.g., run-length coding followed by Huffman coding) for compression. Contour plots of image data and subbanded data are shown.

Glover, Daniel↗

Kepler Data Validation II–Transit Model Fitting and Multiple-Planet Search

This paper discusses the transit model-fitting and multiple-planet search algorithms and performance of the Kepler Science Data Processing Pipeline, developed by the Kepler Science Operations Center (SOC). Threshold crossing events (TCEs), which are transit candidate events, are generated by the Transiting Planet Search (TPS) component of the pipeline and subsequently processed in the data validation (DV) component. The transit model is used in DV to fit TCEs to characterize planetary candidates and to derive parameters that are used in various diagnostic tests to classify them. After the signature associated with the TCE is removed from the light curve of the target star, the residual light curve goes through TPS again to search for additional TCEs. The iterative process of transit model fitting and multiple-planet search continues until no TCE is generated from the residual light curve or an upper limit is reached. The transit model-fitting and multiple-planet search performance of the final release (9.3, 2016January) of the pipeline is demonstrated with the results of the processing of four years (17 quarters) of flight data from the primary Kepler Mission. The transit model-fitting results are accessible from the NASA Exoplanet Archive. The final version of the SOC codebase is available through GitHub.

Threshold crossing events (TCEs↗