Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “network performance evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Determining Cloud Thermodynamic Phase from the Polarized Micro Pulse Lidar

A method to distinguish cloud thermodynamic phase from polarized Micro Pulse Lidar (MPL) measurements is described. The method employs a simple enumerative approach to classify cloud layers as either liquid water, ice water, or mixed-phase clouds based on the linear volume depolarization ratio and cloud top temperatures derived from Goddard Earth Observing System, version 5 (GEOS-5) assimilated data. Two years of cloud retrievals from the Micro Pulse Lidar Network (MPLNET) site in Greenbelt, MD are used to evaluate the performance of the algorithm. The fraction of supercooled liquid water in the mixed-phase temperature regime (-37 °C – 0 °C) calculated using MPLNET data is compared to similar calculations made using the spaceborne Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) instrument on board the Cloud‐Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) satellite, with reasonable consistency.

Jasper R Lewis↗

Enhancing End-to-End Performance of Information Services Over Ka-Band Global Satellite Networks

The Internet has been growing at a rapid rate as the key medium to provide information services such as e-mail, WWW and multimedia etc., however its global reach is limited. Ka-band communication satellite networks are being developed to increase the accessibility of information services via the Internet at global scale. There is need to assess satellite networks in their ability to provide these services and interconnect seamlessly with existing and proposed terrestrial telecommunication networks. In this paper the significant issues and requirements in providing end-to-end high performance for the delivery of information services over satellite networks based on various layers in the OSI reference model are identified. Key experiments have been performed to evaluate the performance of digital video and Internet over satellite-like testbeds. The results of the early developments in ATM and TCP protocols over satellite networks are summarized.

Bhasin, Kul B.↗

Performance Evaluation of the NASA/KSC Transmission System

NASA-KSC currently uses three bridged 100-Mbps FDDI segments as its backbone for data traffic. The FDDI Transmission System (FTXS) connects the KSC industrial area, KSC launch complex 39 area, and the Cape Canaveral Air Force Station. The report presents a performance modeling study of the FTXS and the proposed ATM Transmission System (ATXS). The focus of the study is on performance of MPEG video transmission on these networks. Commercial modeling tools - the CACI Predictor and Comnet tools - were used. In addition, custom software tools were developed to characterize conversation pairs in Sniffer trace (capture) files to use as input to these tools. A baseline study of both non-launch and launch day data traffic on the FTXS is presented. MPEG-1 and MPEG-2 video traffic was characterized and the shaping of it evaluated. It is shown that the characteristics of a video stream has a direct effect on its performance in a network. It is also shown that shaping of video streams is necessary to prevent overflow losses and resulting poor video quality. The developed models can be used to predict when the existing FTXS will 'run out of room' and for optimizing the parameters of ATM links used for transmission of MPEG video. Future work with these models can provide useful input and validation to set-top box projects within the Advanced Networks Development group in NASA-KSC Development Engineering.

Christensen, Kenneth J.↗

Reliability studies of integrated modular engine system designs

A study was performed to evaluate the reliability of Integrated Modular Engine (IME) concepts. Comparisons were made between networked IME systems and non-networked discrete systems using expander cycle configurations. Both redundant and non-redundant systems were analyzed. Binomial approximation and Markov analysis techniques were employed to evaluate total system reliability. In addition, Failure Modes and Effects Analyses (FMEA), Preliminary Hazard Analyses (PHA), and Fault Tree Analysis (FTA) were performed to allow detailed evaluation of the IME concept. A discussion of these system reliability concepts is also presented.

Hardy, Terry L.↗

Reliability studies of Integrated Modular Engine system designs

A study was performed to evaluate the reliability of Integrated Modular Engine (IME) concepts. Comparisons were made between networked IME systems and non-networked discrete systems using expander cycle configurations. Both redundant and non-redundant systems were analyzed. Binomial approximation and Markov analysis techniques were employed to evaluate total system reliability. In addition, Failure Modes and Effects Analyses (FMEA), Preliminary Hazard Analyses (PHA), and Fault Tree Analysis (FTA) were performed to allow detailed evaluation of the IME concept. A discussion of these system reliability concepts is also presented.

Hardy, Terry L.↗

QuantifyML: How good is my machine learning model?

This paper presents an approach, QuantifyML, which employs model counting to assess the learnability and robustness of machine learning models. Typically the efficacy of machine learning models is determined by computing their accuracy statistically on test data sets. However, this may be misleading, if the test data is not representative of the problem that is being studied. Further, two different models may have the same accuracy on a given data set, measured statistically, but may be very different in their behavior on unseen data. Also, models with high accuracy could have poor adversarial robustness. In QuantifyML, our goal is to precisely quantify the extent to which machine learning models have learned and generalized from the given data. In QuantifyML, a trained model is translated into a C program, which is fed to the CBMC model checking tool to produce a formula in Conjunctive Normal Form (CNF), which in turn is analyzed with state-of-the-art model counters to efficiently obtain precise counts w.r.t different outputs. QuantifyML enables i) evaluating the learnability of models by comparing the counts for the outputs to ground truth, expressed as logical predicates (if available), ii) comparing the performance of different models that may be built with different machine learning algorithms (e.g., decision-trees vs. neural networks), and iii) quantifying the robustness of trained models around given inputs. Our evaluation demonstrates these applications of QuantifyML on decision trees and neural networks trained to learn relational properties of graphs, for which we know the ground truth, and to perform image classification, for which we do not have the ground truth, but we can quantify local robustness.

Deep Neural Networks↗

A Study of an Optical Lunar Surface Communications Network with High Bandwidth Direct to Earth Link

Analyzed optical DTE (direct to earth) and lunar relay satellite link analyses, greater than 200 Mbps downlink to 1‐m Earth receiver and greater than 1 Mbps uplink achieved with mobile 5‐cm lunar transceiver, greater than 1Gbps downlink and greater than 10 Mpbs uplink achieved with 10‐cm stationary lunar transceiver, MITLL (MIT Lincoln Laboratory) 2013 LLCD (Lunar Laser Communications Demonstration) plans to demonstrate 622 Mbps downlink with 20 Mbps uplink between lunar orbiter and ground station; Identified top five technology challenges to deploying lunar optical network, Performed preliminary experiments on two of challenges: (i) lunar dust removal and (ii)DTN over optical carrier, Exploring opportunities to evaluate DTN (delay-tolerant networking) over optical link in a multi‐node network e.g. Desert RATS.

lunar surface system↗

(abstract) Satellite-Enhanced Personal Communications Experiments

As an initial step in exploring the opportunities afforded by the merger of satellite-based and land-based networks, Bellcore and JPL conducted several experiments utilizing NASA's Advanced Communications Technology Satellite (ACTS) and JPL's ACTS Mobile Terminal (AMT). Experimental goals fell into three categories: a) demonstrate personal communication applications, b) demonstrate interoperability among multiple wireless networks and the Public Switched Telecommunications Network (PSTN), and c) evaluate new protocol mechanisms for data communications using wireless links. We describe the performance of Point-of-Sale, e-mail, FAX, and call control applications, where the communication path passed through up to four networks: a wireless packet data network, the Satellite network, the PSTN, and a wireless cellular network. One important element of satellite-terrestrial interoperability is the efficiency of data communications protocols. Most protocols in use today (e.g., TCP/IP) have been optimized for wireline channels; their use over wireless networks presents significant new challenges. The characteristics of wireless channels -- increased error, longer packet delay, and limited bandwidth -- affect the design of the protocol. We describe experimental results for differing protocol mechanisms and parameters, such as acknowledgment schemes and packet sizes, that demonstrate the types of protocol needed for efficient use of wireless satellite-terrestrial networks.

personal↗

IBM PC/IX operating system evaluation plan

An evaluation plan for the IBM PC/IX Operating System designed for IBM PC/XT computers is discussed. The evaluation plan covers the areas of performance measurement and evaluation, software facilities available, man-machine interface considerations, networking, and the suitability of PC/IX as a development environment within the University of Southwestern Louisiana NASA PC Research and Development project. In order to compare and evaluate the PC/IX system, comparisons with other available UNIX-based systems are also included.

Dominick, Wayne D.↗

Modeling Atmospheric Brown Carbon in the GISS ModelE Earth System Model

Brown carbon (BrC) is an absorbing organic aerosol (OA), primarily emitted through biomass burning (BB), which exhibits light absorption unique to both black carbon (BC) and other organic aerosols. Despite many field and laboratory studies seeking to constrain BrC properties, the radiative forcing (RF) of BrC is still highly uncertain. To better understand its climate impact, we introduced BrC to the One-Moment Aerosol (OMA) module of the GISS ModelE Earth system model (ESM). We assessed ModelE sensitivity to primary BrC processed through a novel chemical aging scheme and to secondary BrC formed from biogenic volatile organic compounds (BVOCs). Initial results show that BrC typically contributes a top-of-the-atmosphere (TOA) radiative effect of 0.04 W m −2 . Sensitivity tests indicate that explicitly simulating BrC (separating it from other OAs), including secondary BrC, and simulating chemical bleaching of BrC contribute distinguishable radiative effects and should be accounted for in BrC schemes. This addition of prognostic BrC to ModelE allows greater physical and chemical complexity in OA representation with no apparent trade-off in model performance, as the evaluation of ModelE aerosol optical depth against Aerosol Robotic Network (AERONET) and Moderate Resolution Imaging Spectroradiometer (MODIS) retrieval data, with and without the BrC scheme, reveals similar skill in both cases. Thus, BrC should be explicitly simulated to allow more physically based chemical composition, which is crucial for more detailed OA studies like comparisons to in situ measurement campaigns. We include a summary of best practices for BrC representation within ModelE at the end of this paper.

brown carbon aerosols↗

Solar electric propulsion system evaluation

Solar electric propulsion system performance consisting of thrustors with thrust vector aligning actuators, switching network and flight type power conditioner

Costogue, E. N.↗

Astronomical Software Directory Service

With the support of NASA's Astrophysics Data Program (NRA 92-OSSA-15), we have developed the Astronomical Software Directory Service (ASDS): a distributed, searchable, WWW-based database of software packages and their related documentation. ASDS provides integrated access to 56 astronomical software packages, with more than 16,000 URLs indexed for full-text searching. Users are performing about 400 searches per month. A new aspect of our service is the inclusion of telescope and instrumentation manuals, which prompted us to change the name to the Astronomical Software and Documentation Service. ASDS was originally conceived to serve two purposes: to provide a useful Internet service in an area of expertise of the investigators (astronomical software), and as a research project to investigate various architectures for searching through a set of documents distributed across the Internet. Two of the co-investigators were then installing and maintaining astronomical software as their primary job responsibility. We felt that a service which incorporated our experience in this area would be more useful than a straightforward listing of software packages. The original concept was for a service based on the client/server model, which would function as a directory/referral service rather than as an archive. For performing the searches, we began our investigation with a decision to evaluate the Isite software from the Center for Networked Information Discovery and Retrieval (CNIDR). This software was intended as a replacement for Wide-Area Information Service (WAIS), a client/server technology for performing full-text searches through a set of documents. Isite had some additional features that we considered attractive, and we enjoyed the cooperation of the Isite developers, who were happy to have ASDS as a demonstration project. We ended up staying with the software throughout the project, making modifications to take advantage of new features as they came along, as well as influencing the software development. The Web interface to the search engine is provided by a gateway program written in C++ by a consultant to the project (A. Warnock).

Hanisch, Robert J.↗

RL-34 ring laser gyro laboratory evaluation for the Deep Space Network antenna application

The overall results of this laboratory evaluation are quite encouraging. The gyro data is in good agreement with the system's overall pointing performance, which is quite close to the technical objectives for the Deep Space Network (DSN) application. The system can be calibrated to the levels required for millidegree levels of pointing performance, and initialization performance is within the required 0.001 degree objective. The blind target acquisition performance is within a factor of two of the 0.0001 degree objective, limited only by a combination of the slow rate (0.5 deg/sec) and the existing production quantization logic (0.38 arc-sec/pulse). Logic circuitry exists to better this performance such that it will better the objective by 50 percent. Representative data with this circuitry has been provided for illustration. Target tracking performance is about twice the one millidegree objective, with several factors contributing. The first factor is the bias stability of the gyros, which is exceptional, but will limit performance to the 0.001 and 0.002 degree range for long tracking periods. The second contributing factor is the accelerometer contributions when the system is elevated. These degrade performance into the 0.003 to 0.004 degree range, which could be improved upon with some additional changes. Finally, we have provided a set of recommendations to improve performance closer to the technical objectives. These recommendations include gyro, electronics, and system configurational changes that form the basis for additional work to achieve the desired performance. In conclusion, we believe that the RL-34 ring laser gyro-based advanced navigation system demonstrated performance consistent with expectations and technical objectives, and it has the potential for even further enhancement for the DSN application.

Source record↗

A Validated Set of MIDAS V5 Task Network Model Scenarios to Evaluate Nextgen Closely Spaced Parallel Operations Concepts

The Closely Spaced Parallel Operations (CSPO) scenario is a complex, human performance model scenario that tested alternate operator roles and responsibilities to a series of off-nominal operations on approach and landing (see Gore, Hooey, Mahlstedt, Foyle, 2013). The model links together the procedures, equipment, crewstation, and external environment to produce predictions of operator performance in response to Next Generation system designs, like those expected in the National Airspaces NextGen concepts. The task analysis that is contained in the present report comes from the task analysis window in the MIDAS software. These tasks link definitions and states for equipment components, environmental features as well as operational contexts. The current task analysis culminated in 3300 tasks that included over 1000 Subject Matter Expert (SME)-vetted, re-usable procedural sets for three critical phases of flight; the Descent, Approach, and Land procedural sets (see Gore et al., 2011 for a description of the development of the tasks included in the model; Gore, Hooey, Mahlstedt, Foyle, 2013 for a description of the model, and its results; Hooey, Gore, Mahlstedt, Foyle, 2013 for a description of the guidelines that were generated from the models results; Gore, Hooey, Foyle, 2012 for a description of the models implementation and its settings). The rollout, after landing checks, taxi to gate and arrive at gate illustrated in Figure 1 were not used in the approach and divert scenarios exercised. The other networks in Figure 1 set up appropriate context settings for the flight deck.The current report presents the models task decomposition from the tophighest level and decomposes it to finer-grained levels. The first task that is completed by the model is to set all of the initial settings for the scenario runs included in the model (network 75 in Figure 1). This initialization process also resets the CAD graphic files contained with MIDAS, as well as the embedded operator models that comprise MIDAS. Following the initial settings, the model progresses to begin the first tasks required of the two flight deck operators, the Captain (CA) and the First Officer (FO). The task sets will initialize operator specific settings prior to loading all of the alerts, probes, and other events that occur in the scenario. As a note, the CA and FO were terms used in developing this model but the CA can also be thought of as the Pilot Flying (PF), while the FO can be considered the Pilot-Not-Flying (PNF)or Pilot Monitoring (PM). As such, the document refers to the operators as PFCA and PNFFO respectively.

task network model↗

Automatic transmission line monitor

Monitor improves complex network reliability in computer data links and command transmission lines. System evaluates circuit performance against preselected criteria, identifies and stores data indicating out-of-tolerance conditions, conducts closed loop testing, and provides for operation under command of digital computer that determines restoration priorities.

Parsons, W. E.↗

Evaluation plan for space station network interface units

Outlined here is a procedure for evaluating network interface units (NIUs) produced for the Space Station program. The procedures should be equally applicable to the data management system (DMS) testbed NIUs produced by Honeywell and IBM. The evaluation procedures are divided into four areas. Performance measurement tools are hardware and software that must be developed in order to evaluate NIU performance. Performance tests are a series of tests, each of which documents some specific characteristic of NIU and/or network performance. In general, these performance tests quantify the speed, capacity, latency, and reliability of message transmission under a wide variety of conditions. Functionality tests are a series of tests and code inspections that demonstrate the functionality of the particular subset of ISO protocols which have been implemented in a given NIU. Conformance tests are a series of tests which would expose whether or not selected features within the ISO protocols are present and interoperable.

Weaver, Alfred C.↗

Facility for the evaluation of space communications and related systems

NASA Lewis Research Center's Communications Projects Branch has developed a facility for the evaluation of space communications systems and related types of systems, called the Advanced Space Communications (ASC) Laboratory. The ASC Lab includes instrumentation, testbed hardware, and experiment control and monitor software for the evaluation of components, subsystems, systems, and networks. The ASC lab has capabilities to perform radiofrequency (RF), microwave, and millimeter-wave characterizations as well as measurements using low, medium, or high data rate digital signals. In addition to laboratory measurements, the ASC Lab also includes integrated satellite ground terminals allowing experimentation and measurements accessing operational satellites through real space links.

Kerczewski, Robert J.↗