Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data virtualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31

The EGRET data products

We describe the Energetic Gamma Ray Experiment Telescope (EGRET) data products which we anticipate will suffice for virtually all guest and archival investigations. The production process, content, availability, format, and the associated software of each product is described. Supplied here is sufficient detail for each researcher to do analysis which is not supported by extant software.

Mattox, J. R.↗

The structure of the clouds distributed operating system

A novel system architecture, based on the object model, is the central structuring concept used in the Clouds distributed operating system. This architecture makes Clouds attractive over a wide class of machines and environments. Clouds is a native operating system, designed and implemented at Georgia Tech. and runs on a set of generated purpose computers connected via a local area network. The system architecture of Clouds is composed of a system-wide global set of persistent (long-lived) virtual address spaces, called objects that contain persistent data and code. The object concept is implemented at the operating system level, thus presenting a single level storage view to the user. Lightweight treads carry computational activity through the code stored in the objects. The persistent objects and threads gives rise to a programming environment composed of shared permanent memory, dispensing with the need for hardware-derived concepts such as the file systems and message systems. Though the hardware may be distributed and may have disks and networks, the Clouds provides the applications with a logically centralized system, based on a shared, structured, single level store. The current design of Clouds uses a minimalist philosophy with respect to both the kernel and the operating system. That is, the kernel and the operating system support a bare minimum of functionality. Clouds also adheres to the concept of separation of policy and mechanism. Most low-level operating system services are implemented above the kernel and most high level services are implemented at the user level. From the measured performance of using the kernel mechanisms, we are able to demonstrate that efficient implementations are feasible for the object model on commercially available hardware. Clouds provides a rich environment for conducting research in distributed systems. Some of the topics addressed in this paper include distributed programming environments, consistency of persistent data and fault-tolerance.

Dasgupta, Partha↗

AI applications to conceptual aircraft design

This paper presents in viewgraph form several applications of artificial intelligence (AI) to the conceptual design of aircraft, including: an access manager for automated data management, AI techniques applied to optimization, and virtual reality for scientific visualization of the design prototype.

Kathryn M. Chalfan↗

Compton Observatory EGRET All-Sky Survey

We describe the EGRET data products which we anticipate will suffice for virtually all guest and archival investigations. The production process, content, availability, format, and the associated software of each product is described. This paper also supplies sufficient detail for the archival researcher to do analysis which is not supported by extant software. Where published references don't exist, the EGRET team documentation is cited.

Source record↗

Enhanced Multi-Modal Access to Planetary Exploration

Tomorrow's Interplanetary Network (IPN) will evolve from JPL's Deep-Space Network (DSN) and provide key capabilities to future investigators, such as simplified acquisition of higher-quality science at remote sites and enriched access to these sites. These capabilities could also be used to foster public interest, e.g., by making it possible for students to explore these environments personally, eventually perhaps interacting with a virtual world whose models could be populated by data obtained continuously from the IPN. Our paper looks at JPL's approach to making this evolution happen, starting from improved communications. Evolving space protocols (e.g., today's CCSDS proximity and file-transfer protocols) will provide the underpinning of such communications in the next decades, just as today's rich web was enabled by progress in Internet Protocols starting from the early 1970's (ARPAnet research). A key architectural thrust of this effort is to deploy persistent infrastructure incrementally, using a layered service model, where later higher-layer capabilities (such as adaptive science planning) are enabled by earlier lower-layer services (such as automated routing of object-based messages). In practice, there is also a mind shift needed from an engineering culture raised on point-to-point single-function communications (command uplink, telemetry downlink), to one in which assets are only indirectly accessed, via well-defined interfaces. We are aiming to foster a 'community of access' both among space assets and the humans who control them. This enables appropriate (perhaps eventually optimized) sharing of services and resources to the greater benefit of all participants. We envision such usage to be as automated in the future as using a cell phone is today - with all the steps in creating the real-time link being automated.

interplanetary network (IPN)↗

The Impact of Ocean Observations in Seasonal Climate Prediction

The ocean provides the most significant memory for the climate system. Hence, a critical element in climate forecasting with coupled models is the initialization of the ocean with states from an ocean data assimilation system. Remotely-sensed ocean surface fields (e.g., sea surface topography, SST, winds) are now available for extensive periods and have been used to constrain ocean models to provide a record of climate variations. Since the ocean is virtually opaque to electromagnetic radiation, the assimilation of these satellite data is essential to extracting the maximum information content. More recently, the Argo drifters have provided unprecedented sampling of the subsurface temperature and salinity. Although the duration of this observation set has been too short to provide solid statistical evidence of its impact, there are indications that Argo improves the forecast skill of coupled systems. This presentation will address the impact these different observations have had on seasonal climate predictions with the GMAO's coupled model.

Rienecker, Michele↗

Mission Oriented Support and Theory (MOST) for MMS -- The Goddard Space Flight Center/University of California Los Angeles Interdisciplinary Science Program

The MOST IDS team was tasked with focusing on two general areas: The first was to participate with the Fast Plasma Investigation (FPI) team in the development of virtual detectors that model the instrument responses of the MMS FPI sensors. The virtual instruments can be 'flown through' both simulation data (from magnetohydrodynamic, hybrid, and kinetic simulations) and Cluster and THEMIS spacecraft data. The goal is to determine signatures of magnetic reconnection expected during the MMS mission. Such signatures can serve as triggers for selection of burst mode downloads. The chapter contributed by the FPI team covers that effort in detail and, therefore, most of that work has not been included here. The second area of emphasis, and the one detailed in this chapter, was to build on past and present knowledge of magnetic reconnection and its physical signatures. Below we describe intensive analyses of Cluster and THEMIS data together with theoretical models and simulations that delineate the plasma signatures that surround sites of reconnection, including the effects of turbulence as well as the detailed kinetic signatures that indicate proximity to reconnection sites. In particular, we point out that particles are energized in several regions, not only at the actual site of reconnection.

Goldstein, Melvyn L.↗

Systems and Methods for Data Visualization Using Three-Dimensional Displays

Data visualization systems and methods for generating 3D visualizations of a multidimensional data space are described. In one embodiment a 3D data visualization application directs a processing system to: load a set of multidimensional data points into a visualization table; create representations of a set of 3D objects corresponding to the set of data points; receive mappings of data dimensions to visualization attributes; determine the visualization attributes of the set of 3D objects based upon the selected mappings of data dimensions to 3D object attributes; update a visibility dimension in the visualization table for each of the plurality of 3D object to reflect the visibility of each 3D object based upon the selected mappings of data dimensions to visualization attributes; and interactively render 3D data visualizations of the 3D objects within the virtual space from viewpoints determined based upon received user input.

Djorgovski, Stanislav G.↗

Development of a test system for data links of the ATLAS Inner Tracker (ITk) upgrade silicon pixel detector

This contribution introduces a novel test system developed to evaluate the signal transmission quality in high-speed data links for the 2026 Inner Tracker (ITk) upgrade of the ATLAS experiment. Using an FPGA-based data acquisition (DAQ) framework, the setup can run simultaneous Bit Error Rate (BER) tests for up to 64 channels and generate virtual eye diagrams, for qualifying the ∼26k electrical links at the ATLAS ITk data rate of 1.28 Gb/s. The paper includes results from system calibration, yielding its contribution to the measured losses, and preliminary results from tests of prototype and pre-production assemblies of on-detector links of the three ATLAS ITk Pixel subsystems.

47 OTHER INSTRUMENTATION↗

Interplanetary Magnetic Field Power Spectrum Variations: A VHO Enabled Study

The newly reprocessed high time resolution (11/22 vectors/sec) Wind mission interplanetary magnetic field data and the solar wind key parameter search capability of the Virtual Heliospheric Observatory (VHO) affords an opportunity to study magnetic field power spectral density variations as a function of solar wind conditions. In the reprocessed Wind Magnetic Field Investigation (MFI) data, the spin tone and its harmonics are greatly reduced that allows the meaningful fitting of power spectra to the approx.2 Hz limit above which digitization noise becomes apparent. The power spectral density is computed and the spectral index is fitted for the MHD and ion inertial regime separately along with the break point between the two for various solar wind conditions . The time periods of fixed solar wind conditions are obtained from VHO searches that greatly simplify the process. The functional dependence of the ion inertial spectral index and break point on solar wind plasma and magnetic field conditions will be discussed

Szabo, A.↗

Interplanetary Magnetic Field Power Spectrum Variations: A VHO Enabled Study

The newly reprocessed high time resolution (11/22 vectors/sec) Wind mission interplanetary magnetic field data and the solar wind key parameter search capability of the Virtual Heliospheric Observatory (VHO) affords an opportunity to study magnetic field power spectral density variations as a function of solar wind conditions. In the reprocessed Wind Magnetic Field Investigation (MFI) data, the spin tone and its harmonics are greatly reduced that allows the meaningful fitting of power spectra to the ~2 Hz limit above which digitization noise becomes apparent. The power spectral density is computed and the spectral index is fitted for the MHD and ion inertial regime separately along with the break point between the two for various solar wind conditions. The time periods of fixed solar wind conditions are obtained from VHO searches that greatly simplify the process. The functional dependence of the ion inertial spectral index and break point on solar wind plasma and magnetic field conditions will be discussed

Szabo, A.↗

Controlling Infrastructure Costs: Right-Sizing the Mission Control Facility

Johnson Space Center's Mission Control Center is a space vehicle, space program agnostic facility. The current operational design is essentially identical to the original facility architecture that was developed and deployed in the mid-90's. In an effort to streamline the support costs of the mission critical facility, the Mission Operations Division (MOD) of Johnson Space Center (JSC) has sponsored an exploratory project to evaluate and inject current state-of-the-practice Information Technology (IT) tools, processes and technology into legacy operations. The general push in the IT industry has been trending towards a data-centric computer infrastructure for the past several years. Organizations facing challenges with facility operations costs are turning to creative solutions combining hardware consolidation, virtualization and remote access to meet and exceed performance, security, and availability requirements. The Operations Technology Facility (OTF) organization at the Johnson Space Center has been chartered to build and evaluate a parallel Mission Control infrastructure, replacing the existing, thick-client distributed computing model and network architecture with a data center model utilizing virtualization to provide the MCC Infrastructure as a Service. The OTF will design a replacement architecture for the Mission Control Facility, leveraging hardware consolidation through the use of blade servers, increasing utilization rates for compute platforms through virtualization while expanding connectivity options through the deployment of secure remote access. The architecture demonstrates the maturity of the technologies generally available in industry today and the ability to successfully abstract the tightly coupled relationship between thick-client software and legacy hardware into a hardware agnostic "Infrastructure as a Service" capability that can scale to meet future requirements of new space programs and spacecraft. This paper discusses the benefits and difficulties that a migration to cloud-based computing philosophies has uncovered when compared to the legacy Mission Control Center architecture. The team consists of system and software engineers with extensive experience with the MCC infrastructure and software currently used to support the International Space Station (ISS) and Space Shuttle program (SSP).

Martin, Keith↗

The Ground Truth Program: Simulations as Test Beds for Social Science Research Methods.

Social systems are uniquely complex and difficult to study, but understanding them is vital to solving the world’s problems. The Ground Truth program developed a new way of testing the research methods that attempt to understand and leverage the Human Domain and its associated complexities. The program developed simulations of social systems as virtual world test beds. Not only were these simulations able to produce data on future states of the system under various circumstances and scenarios, but their causal ground truth was also explicitly known. Research teams studied these virtual worlds, facilitating deep validation of causal inference, prediction, and prescription methods. The Ground Truth program model provides a way to test and validate research methods to an extent previously impossible, and to study the intricacies and interactions of different components of research.

97 MATHEMATICS AND COMPUTING↗

A hypermatrix formulation for subspace iteration

The computational efficiency of subspace iteration is addressed relative to the data structures adopted for the very large and generally sparse coefficient matrices. The frequent triangulations and matrix multiplications demand that access to the terms in the coefficient matrices be unbiased. Reliance on virtual memory (paging) operating systems with no special considerations for localized data access is not adequate. Specific data structures must be designed that accommodate the needs of the numerical algorithm yet eliminate unnecessary paging. An implementation of the subspace iteration method using hypermatrix data structures is presented. Use of hypermatrices is shown to provide unbiased and localized data access. The various modifications to the conventional formulation are described and an example problem illustrates the potential benefits of the hypermatrix formulation. Possibilities for adapting hypermatrix data structures to new supercomputer architectures are discussed.

Schmidt, Richard J.↗

Data system interprobability

Software was developed and tested which allows an end-user to build a book data object in an interactive fashion. The electronic book model was developed for the Library front-end of the DAVID (Distributed Access View Integrated Database) system. It is a complex data object which is capable of holding data of different types and formats. After the task, the plan was to assess the Book model and investigate the possibility of it serving as a knowledge base for a expert system front-end to the DAVID system. For the rest of the fellowship period, data system interoperability was examined. Specifically, a plan was prepared titled Implementations of the Land Analysis System (LAS) to Meet UNEP/GRID Requirements. This plan is aimed at reaching the goal of building one virtual global change information system which will link existing and future data systems allowing earth and space scientists to learn about, locate, access, and correlate data of interest regardless of its physical location. The plan proposed the construction of a master directory (MD) for the European data systems that is equivalent in structure to NASA's MD. The MD is to contain brief, high-level information about existing Earth and space science data sets sufficient for a user to know where data of interest reside and how to go about getting additional information. The plan also outlined the tasks that would be involved to electronically connect the MD system to the various discipline data systems (e.g., LAS) in order to achieve general interroperabilty, that is, the abilty to perform cross-systems searches and exchange of and access to distributed information.

Wakim, Nagi T.↗

QuarkNet High School Cosmic Ray Projects

QuarkNet High School teachers and students perform experiments with cosmic ray muons. Their data is available to all on the i2u2.org site; enable measurements of muon flux, speed, and lifetime. The pandemic restricted access to many detectors, so QuarkNet provided virtual resources allowing users to carry out simpler experiments with already uploaded data. Some QuarkNet high school groups have also carried out more complex projects, e.g. Solar Eclipse 2017, MUSE at Fermilab, storm tracking, and g-2, that required assembling entire physics collaborations.

79 ASTRONOMY AND ASTROPHYSICS↗

Progress toward Accelogic compression in ROOT

For the last 7 years, Accelogic pioneered and perfected a radically new theory of numerical computing codenamed “Compressive Computing”, which has an extremely profound impact on real-world computer science [1]. At the core of this new theory is the discovery of one of its fundamental theorems which states that, under very general conditions, the vast majority (typically between 70% and 80%) of the bits used in modern large-scale numerical computations are absolutely irrelevant for the accuracy of the end result. This theory of Compressive Computing provides mechanisms able to identify (with high intelligence and surgical accuracy) the number of bits (i.e., the precision) that can be used to represent numbers without affecting the substance of the end results, as they are computed and vary in real time. The bottom-line outcome will be to provide state-of-the-art compression algorithms --and accompanying software libraries-- able to surpass the performance of the compression engines currently available in the ROOT [7] framework. The resulting technology has the capability to enable substantial economic and operational gains (including speedup) for High Energy and Nuclear Physics data storage/analysis. In our initial studies, a factor of nearly x4 (3.9) compression was achieved with RHIC/STAR data where ROOT compression managed only x1.4 [6].As a collaboration of experimental scientists, private industry, and the ROOT Team, our aim is to capitalize on the substantial success delivered by the initial effort and produce a robust technology properly packaged as an open-source tool that could be used by virtually every experiment around the world as means for improving data management and accessibility.In this contribution, we will present our efforts integrating our concepts of “functionally lossless compression” within the ROOT framework implementation, with the purpose of producing a basic solution readily integrated into HENP applications. We will also present our progress applying this compression through realistic examples of analysis from both the STAR and CMS experiments.

Canal, Ph.↗