Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,693 records · Page 94

The Radio Fundamental Catalogue. I. Astrometry

We present the all-sky catalogue of absolute positions and estimates of correlated flux density of 21,942 compact radio sources determined from processing interferometric visibility data of virtually all VLBI observing sessions at 2 to 23~GHz from 72 programs suitable for absolute astrometry collected for 30 years. We used a novel technique of generation of a dataset of fused observables that allowed us to incorporate all available data in our analysis. The catalogue is the most complete and most precise to date. It forms the foundation and reference for positional astronomy, space geodesy, space navigation, population analysis of active galactic nuclei (AGNs), and provides calibrators for phase-referencing for differential astrometry and VLBI astrophysical observations. Its accuracy was evaluated through a detailed accounting systematic errors, rigorous decimation tests, comparison of different datasets, and comparison with other catalogues. The catalogue samples preferentially the AGNs with a strong contemporary parsec-scale synchrotron emission. Its milliarcsecond level positional accuracy allows association of these AGNs with detections in a wide range of the electromagnetic spectrum from low-frequency radio to gamma-rays and high energy neutrinos. We describe the innovative data processing and calibration technique in full detail, report the in depth analysis of random and systematic positional errors, and provide the list of associations with large surveys at different wavelengths.

Astronomy↗

HEP Software Foundation Community White Paper Working Group – Conditions Data

To produce the best physics results, high energy physics experiments require access to calibration and other non-event data during event data processing. These conditions data are typically stored in databases that provide versioning functionality, allowing physicists to make improvements while simultaneously guaranteeing the reproducibility of their results. With the increased complexity of modern experiments, and the evolution of computing models that demand large scale access to conditions data, the solutions for managing this access have evolved over time. In this white paper we give an overview of the conditions data access problem, present convergence on a common solution and present some considerations for the future.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Thermal scattering law for structure-dependent-Doppler broadening in FLASSH

Traditional Doppler broadening methods assume that target nuclei velocities follow a Maxwell-Boltzmann distribution which inherently assumes that the atoms are a free gas or that their velocities are independent of each other. This approximation is reasonable at high target temperatures and high neutron energies. However, nuclei are not independent: the lattice temperature and chemical binding will define the atomic motion. The thermal scattering law (i.e., TSL or S(α,β)) is a material property which describes the chemical binding and temperature response in terms of available momentum and energy states. In the thermal energy range, this TSL will define the thermal scattering cross sections. In the resonance region, the TSL offers a first-principles description of the probability distribution function for the velocity of the target nuclei. Using the TSL in Doppler broadening captures the structure of the material consistently from the thermal range into the resonance cross sections. In this work, both traditional free-gas and precise TSL Doppler broadening methods for resonance cross section evaluation have been implemented within the Full Law Analysis Scattering System Hub (FLASSH). This framework provides a generalized formulation for evaluating low-lying resonance data and streamlines nuclear data processing methods. TSL data generated using ab initio lattice dynamics (AILD) can be used to broaden cross section libraries in ENDF format for high-fidelity input into reactor physics calculations. These capabilities are demonstrated for the lowest absorption resonances of {sup 238}U in UO{sub 2}, UC and UN. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Production and Distribution of NASA MODIS Remote Sensing Products

The two Moderate Resolution Imaging Spectroradiometer (MODIS) instruments on-board NASA's Earth Observing System (EOS) Terra and Aqua satellites make key measurements for understanding the Earth's terrestrial ecosystems. Global time-series of terrestrial geophysical parameters have been produced from MODIS/Terra for over 7 years and for MODIS/Aqua for more than 4 1/2 years. These well calibrated instruments, a team of scientists and a large data production, archive and distribution systems have allowed for the development of a new suite of high quality product variables at spatial resolutions as fine as 250m in support of global change research and natural resource applications. This talk describes the MODIS Science team's products, with a focus on the terrestrial (land) products, the data processing approach and the process for monitoring and improving the product quality. The original MODIS science team was formed in 1989. The team's primary role is the development and implementation of the geophysical algorithms. In addition, the team provided feedback on the design and pre-launch testing of the instrument and helped guide the development of the data processing system. The key challenges the science team dealt with before launch were the development of algorithms for a new instrument and provide guidance of the large and complex multi-discipline processing system. Land, Ocean and Atmosphere discipline teams drove the processing system requirements, particularly in the area of the processing loads and volumes needed to daily produce geophysical maps of the Earth at resolutions as fine as 250 m. The processing system had to handle a large number of data products, large data volumes and processing loads, and complex processing requirements. Prior to MODIS, daily global maps from heritage instruments, such as Advanced Very High Resolution Radiometer (AVHRR), were not produced at resolutions finer than 5 km. The processing solution evolved into a combination of processing the lower level (Level 1) products and the higher level discipline specific Land and Atmosphere products in the MODIS Science Investigator Lead Processing System (SIPS), the MODIS Adaptive Processing System (MODAPS), and archive and distribution of the Land products to the user community by two of NASA s EOS Distributed Active Archive Centers (DAACs). Recently, a part of MODAPS, the Level 1 and Atmosphere Archive and Distribution System (LAADS), took over the role of archiving and distributing the Level 1 and Atmosphere products to the user community.

Wolfe, Robert↗

A novel tool for improving the data collection process during control room modernization human-system interface testing and evaluation activities - 271

The U.S. Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) Program is developing a scientific basis to extend the existing U.S. nuclear power plant (NPP) operating life beyond the current 60-year licensing period and to ensure NPP long-term reliability, productivity, safety, and security. Under the Advanced Instrumentation, Information, and Control (II and C) Systems Technologies pathway, the LWRS Program conducts targeted research and development to address long-term aging and obsolescence of existing instrumentation and control technologies, as well as to implement and test new digital II and C technology that enables broad innovation and business improvement in the NPP operating model. To this end, the role of human factors engineering (HFE) is important as part of ensuring that the control room modernization (CRM) activities account for the operator's cognitive and physiological characteristics. Part of the HFE process for CRM entails conducting tests and evaluations (T and Es) that will inform the design of new human-system interface (HSI) technologies. Qualitative data that captures operator feedback and important human-system interactions are an important part of T and E. However, the analyzing this qualitative data in order to provide actionable design recommendations can be time-consuming and error prone. This paper presents an early version of a tool, which uses a combination of natural language processing and supervised machine learning to support the analysis of qualitative data. The objectives of this tool is to improve the process of (1) sifting through freeform text for improved design issue identification, (2) maintaining consistency in theme coding conventions, and (3) readily providing actionable design guidance that can be traceable to state-of-the-art HFE guidelines such as NUREG-0700. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Memory node controller

A memory node controller for a node of a data processing network, the network including at least one computing device and at least one data resource, each data resource addressed by a physical address. The node is configured to couple the at least one computing device with the at least one data resource. Elements of the data processing network are addressed via a system address space. The memory node controller includes a first interface to the at least one data resource, a second interface to the at least one computing device, and a system to physical address translator cache configured to translate a system address in the system address space to a physical address in the physical address space of the at least one data resource.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Management and Analysis of Radiation Portal Monitor Data

Oak Ridge National Laboratory (ORNL) receives, archives, and analyzes data from radiation portal monitors (RPMs). Over time the amount of data submitted for analysis has grown significantly, and in fiscal year 2013, ORNL received 545 gigabytes of data representing more than 230,000 RPM operating days. This data comes from more than 900 RPMs. ORNL extracts this data into a relational database, which is accessed through a custom software solution called the Desktop Analysis and Reporting Tool (DART). DART is used by data analysts to complete a monthly lane-by-lane review of RPM status. Recently ORNL has begun to extend its data analysis based on program-wide data processing in addition to the lane-by-lane review. Program-wide data processing includes the use of classification algorithms designed to identify RPMs with specific known issues and clustering algorithms intended to identify as-yet-unknown issues or new methods and measures for use in future classification algorithms. This paper provides an overview of the architecture used in the management of this data, performance aspects of the system, and additional requirements and methods used in moving toward an increased program-wide analysis paradigm.

Rowe, Nathan C↗

NASA GeneLab RNA-seq consensus pipeline: Standardized processing of short-read RNA-seq data

With the development of transcriptomic technologies, we are able to quantify precise changes in gene expression profiles from astronauts and other organisms exposed to spaceflight. Members of NASA GeneLab and GeneLab-associated analysis working groups (AWGs) have developed a consensus pipeline for analyzing short-read RNA-sequencing data from spaceflight-associated experiments. The pipeline includes quality control, read trimming, mapping, and gene quantification steps, culminating in the detection of differentially expressed genes. This data analysis pipeline and the results of its execution using data submitted to GeneLab are now all publicly available through the GeneLab database. We present here the full details and rationale for the construction of this pipeline in order to promote transparency, reproducibility, and reusability of pipeline data; to provide a template for data processing of future spaceflight-relevant datasets; and to encourage cross-analysis of data from other databases with the data available in GeneLab.

59 BASIC BIOLOGICAL SCIENCES↗

Advanced Seismic Data Analysis Program (The Hot Pot Project), DOE Award: DE-EE0002839 (Phase 1 Report)

A five-line (23 mile) reflection- seismic survey was conducted at the Hot Pot geothermal prospect area in north-central Nevada under the USDOE (United States Department of Energy) Geothermal Technologies Program. The project objective was to utilize innovative seismic data processing, integrated with existing geological, geophysical and geochemical information, to identify high-potential drilling targets and to reduce drilling risk. Data acquisition and interpretation took place between October 2010 and April 2011. The first round of data processing resulted in large areas of relatively poor data, and obvious reflectors known from existing subsurface information either did not appear on the seismic profiles or appeared at the wrong depth. To resolve these issues, the velocity model was adjusted to include geologic input, and the lines were reprocessed. The resulting products were significantly improved, and additional detail was recovered within the high-velocity and in part acoustically isotropic basement. Features visible on the improved seismic images include interpreted low angle thrust faults within the Paleozoic Valmy Formation, which potentially are reactivated in the current stress field. Intermediate-depth wells are currently targeted to test these features. The seismic images also suggest the existence of Paleogene sedimentary and volcanic rocks which potentially may function as a near-surface reservoir, charged by deeper structures in Paleozoic rocks.

15 GEOTHERMAL ENERGY↗

Introduction to structure from motion and its applications in remote sensing

This talk discusses my experience at Los Alamos National Laboratories developing the Wide Area Persistent Surveillance (WAPS) system AngelFire and the problems with working with low resolution surface models. This experience provided a motivation to seek solutions to utilize the redundant WAPS imagery to build surface models of the urban environment. Structure from Motion (SfM) is a process that takes multiple view imagery and compute the 3D structure of a scene. We will walk through the basic algorithm and discuss areas for optimization. Military services and intelligence agencies face long-standing challenges with processing, exploiting, and disseminating ISR data. The problem is that too much data is being produced and not enough people to look at it and the problem is not going away. As a result of this data overload, we need to shift the way we think about data and find creative ways to use and present it so it can be easily digested by decision makers. SfM also provides a means for developing a data processing and organization architecture. Applications for various remote sensing applications will be discussed for motivation for why SfM and Multi-View Stereo rendering is an important area that needs to be continued to be developed.

47 OTHER INSTRUMENTATION↗

Remote terminal system evaluation

An Earth Resources Data Processing System was developed to evaluate the system for training, technology transfer, and data processing. In addition to the five sites included in this project two other sites were connected to the system under separate agreements. The experience of these two sites is discussed. The results of the remote terminal project are documented in seven reports: one from each of the five project sites, Purdue University, and an overview report summarizing the other six reports.

Phillips, T. L.↗

Remote sensing of Gulf Stream using GEOS-3 radar altimeter

Radar altimeter measurements from the GEOS-3 satellite to the ocean surface indicated the presence of expected geostrophic height differences across the the Gulf Stream. Dynamic sea surface heights were found by both editing and filtering the raw sea surface heights and then referencing these processed data to a 5 minute x 5 minute geoid. Any trend between the processed data and the geoid was removed by subtracting out a linear fit to the residuals in the open ocean. The mean current velocity of 107 + or - 29 cm/sec calculated from the dynamic heights for all orbits corresponded with velocities obtained from hydrographic methods. Also, dynamic topographic maps were produced for August, September, and October 1975. Results pointed out limitations in the accuracy of the geoid, height anomaly deteriorations due to filtering, and lack of dense time and space distribution of measurements.

Leitao, C. D.↗

A modeling analysis program for the JPL table mountain Io sodium cloud data

A detailed review of 110 of the 263 Region B/C images of the 1981 data set is undertaken and a preliminary assessment of 39 images of the 1976-79 data set is presented. The basic spatial characteristics of these images are discussed. Modeling analysis of these images after further data processing will provide useful information about Io and the planetary magnetosphere. Plans for data processing and modeling analysis are outlined. Results of very preliminary modeling activities are presented.

Smyth, W. H.↗

Multi-Tenant Isolation via Reconfigurable Networks

High performance computing environments are often used for a wide variety of workloads ranging from simulation, data transformation and analysis, and complex workflows to name just a few. These systems may process data at various security levels but in so doing are often enclaved at the highest security posture. This approach places significant restrictions on the users of the system even when processing data at a lower security level and exposes data at higher levels of confidentiality to a much broader population than otherwise necessary. The traditional approach of isolation, while effective in establishing security enclaves poses significant challenges for the use of shared infrastructure in HPC environments. This report details current state-of-the-art in reconfigurable network enclaving through Software Defined Networking (SDN) and Network Function Virtualization (NFV) and their applicability to secure enclaves in HPC environments. SDN and NFV methods are based on a solid foundation of system wide virtualization. The purpose of which is very straight forward, the system administrator can deploy networks that are more amenable to customer needs, and at the same time achieve increased scalability making it easier to increase overall capacity as needed without negatively affecting functionality. The network administration of both the server system and the virtual sub-systems is simplified allowing control of the infrastructure through well-defined APIs (Application Programming Interface). While SDN and NFV technologies offer significant promise in meeting these goals, they also provide the ability to address a significant component of the multi-tenant challenge in HPC environments, namely resource isolation. Traditional HPC systems are built upon scalable high-performance networking technologies designed to meet specific application requirements. Dynamic isolation of resources within these environments has remained difficult to achieve. SDN and NFV methodology provide us with relevant concepts and available open standards based APIs that isolate compute and storage resources within an otherwise common networking infrastructure. Additionally, the integration of the networking APIs within larger system frameworks such as OpenStack provide the tools necessary to establish isolated enclaves dynamically allowing the benefits of HPC while providing a controlled security structure surrounding these systems.

97 MATHEMATICS AND COMPUTING↗

Secure Enclaves: An Isolation-centric Approach for Creating Secure High Performance Computing Environments

High performance computing environments are often used for a wide variety of workloads ranging from simulation, data transformation and analysis, and complex workflows to name just a few. These systems may process data at various security levels but in so doing are often enclaved at the highest security posture. This approach places significant restrictions on the users of the system even when processing data at a lower security level and exposes data at higher levels of confidentiality to a much broader population than otherwise necessary. The traditional approach of isolation, while effective in establishing security enclaves poses significant challenges for the use of shared infrastructure in HPC environments. This report details current state-of-the-art in virtualization, reconfigurable network enclaving via Software Defined Networking (SDN), and storage architectures and bridging techniques for creating secure enclaves in HPC environments.

97 MATHEMATICS AND COMPUTING↗

A Comprehensive Plan for the Long-Term Calibration and Validation of Oceanic Biogeochemical Satellite Data

The primary objective of this planning document is to establish a long-term capability and validating oceanic biogeochemical satellite data. It is a pragmatic solution to a practical problem based primarily o the lessons learned from prior satellite missions. All of the plan's elements are seen to be interdependent, so a horizontal organizational scheme is anticipated wherein the overall leadership comes from the NASA Ocean Biology and Biogeochemistry (OBB) Program Manager and the entire enterprise is split into two components of equal sature: calibration and validation plus satellite data processing. The detailed elements of the activity are based on the basic tasks of the two main components plus the current objectives of the Carbon Cycle and Ecosystems Roadmap. The former is distinguished by an internal core set of responsibilities and the latter is facilitated through an external connecting-core ring of competed or contracted activities. The core elements for the calibration and validation component include a) publish protocols and performance metrics; b) verify uncertainty budgets; c) manage the development and evaluation of instrumentation; and d) coordinate international partnerships. The core elements for the satellite data processing component are e) process and reprocess multisensor data; f) acquire, distribute, and archive data products; and g) implement new data products. Both components have shared responsibilities for initializing and temporally monitoring satellite calibration. Connecting-core elements include (but are not restricted to) atmospheric correction and characterization, standards and traceability, instrument and analysis round robins, field campaigns and vicarious calibration sites, in situ database, bio-optical algorithm (and product) validation, satellite characterization and vicarious calibration, and image processing software. The plan also includes an accountability process, creating a Calibration and Validation Team (to help manage the activity), and a discussion of issues associated with the plan's scientific focus.

Hooker, Stanford B.↗

E4D_RT

Time-lapse ERT imaging for monitoring both natural and engineered subsurface processes has advanced rapidly over the past 15-20 years. However, imaging results generally required a significant amount of manual and computational effort, and therefore were not available while the process was occurring. Although the value of real-time imaging was recognized, several obstacles prevented it's implementation. E4D_RT addresses these obstacles by 1) providing specialized algorithms that negate the need for user intervention, thereby automating the time-lapse data processing steps, 2) linking field data collection systems with parallel supercomputing systems via wireless data transfer link, and 3) addressing the computational burdens by utilizing distributed memory supercomputing resources, thereby enabling rapid data processing and imaging results.

Source record↗

Large-scale Gulf Stream frontal study using GEOS 3 radar altimeter data

From data obtained by the GEOS 3 radar altimeter, sea surface heights are found by both editing and filtering the raw sea surface height measurements and then referencing these processed data to a 5 foot by 5 foot geoid. Any trend between the processed data and the geoid is removed by subtracting out a linear fit to the residuals in the open ocean. Data from individual passes are further processed by applying a minimum variance technique at the subsatellite crossing points to produce surface topography maps for the 6 months and an overall mean map which reveal important details about the Gulf Stream system. The differences between the monthly mean and the overall mean are calculated for each of the 6 months to show the temporal and spatial changes of the Gulf Stream front and spawned eddies. The standard deviation map is even more informative and shows preferred locations of Gulf Stream meanders.

Huang, N. E.↗