Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “network performance evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Denoising Seismic Waveforms Using a Wavelet-Transform-Based Machine-Learning Method

Seismic waveform data recorded at stations can be thought of as a superposition of the signal from a source of interest and noise from other sources. Frequency‐based filtering methods for waveform denoising do not result in desired outcomes when the targeted signal and noise occupy similar frequency bands. Recently, denoising techniques based on deep‐learning convolutional neural networks (CNNs), in which a recorded waveform is decomposed into signal and noise components, have led to improved results. These CNN methods, which use short‐time Fourier transform representations of the time series, provide signal and noise masks for the input waveform. These masks are used to create denoised signal and designaled noise waveforms, respectively. However, advancements in the field of image denoising have shown the benefits of incorporating discrete wavelet transforms (DWTs) into CNN architectures to create multilevel wavelet CNN (MWCNN) models. The MWCNN model preserves the details of the input due to the good time–frequency localization of the DWT. In this report we use a data set of over 382,000 constructed seismograms recorded by the University of Utah Seismograph Stations network to compare the performance of CNN and MWCNN‐based denoising models. Evaluation of both models on constructed test data shows that the MWCNN model outperforms the CNN model in the ability to recover the ground‐truth signal component in terms of both waveform similarity and preservation of amplitude information. Model evaluation of real‐world data shows that both the CNN and MWCNN models outperform standard band‐pass filtering (BPF; average improvement in signal‐to‐noise ratio of 9.6 and 19.7 dB, respectively, with respect to BPF). Evaluation of continuous data suggests the MWCNN denoiser can improve both signal detection capabilities and phase arrival time estimates.

58 GEOSCIENCES↗

NAPAbench 2: A network synthesis algorithm for generating realistic protein-protein interaction (PPI) network families

Comparative network analysis provides effective computational means for gaining novel insights into the structural and functional compositions of biological networks. In recent years, various methods have been developed for biological network alignment, whose main goal is to identify important similarities and critical differences between networks in terms of their topology and composition. A major impediment to advancing network alignment techniques has been the lack of gold-standard benchmarks that can be used for accurate and comprehensive performance assessment of such algorithms. The original NAPAbench (network alignment performance assessment benchmark) was developed to address this problem, and it has been widely utilized by many researchers for the development, evaluation, and comparison of novel network alignment techniques. In this work, we introduce NAPAbench 2—a major update of the original NAPAbench that was introduced in 2012. NAPAbench 2 includes a completely redesigned network synthesis algorithm that can generate protein-protein interaction (PPI) network families whose characteristics closely match those of the latest real PPI networks. Furthermore, the network synthesis algorithm comes with an intuitive GUI that allows users to easily generate PPI network families with an arbitrary number of networks of any size, according to a flexible user-defined phylogeny. In addition, NAPAbench 2 provides updated benchmark datasets—created using the redesigned network synthesis algorithm—which can be used for comprehensive performance assessment of network alignment algorithms and their scalability.

42 ENGINEERING↗

ExaTN: Scalable GPU-Accelerated High-Performance Processing of General Tensor Networks at Exascale

We present ExaTN (Exascale Tensor Networks), a scalable GPU-accelerated C++ library which can express and process tensor networks on shared- as well as distributed-memory high-performance computing platforms, including those equipped with GPU accelerators. Specifically, ExaTN provides the ability to build, transform, and numerically evaluate tensor networks with arbitrary graph structures and complexity. It also provides algorithmic primitives for the optimization of tensor factors inside a given tensor network in order to find an extremum of a chosen tensor network functional, which is one of the key numerical procedures in quantum many-body theory and quantum-inspired machine learning. Numerical primitives exposed by ExaTN provide the foundation for composing rather complex tensor network algorithms. We enumerate multiple application domains which can benefit from the capabilities of our library, including condensed matter physics, quantum chemistry, quantum circuit simulations, as well as quantum and classical machine learning, for some of which we provide preliminary demonstrations and performance benchmarks just to emphasize a broad utility of our library.

97 MATHEMATICS AND COMPUTING↗

Reliability studies of integrated modular engine system designs

A study was performed to evaluate the reliability of Integrated Modular Engine (IME) concepts. Comparisons were made between networked IME systems and non-networked discrete systems using expander cycle configurations. Both redundant and non-redundant systems were analyzed. Binomial approximation and Markov analysis techniques were employed to evaluate total system reliability. In addition, Failure Modes and Effects Analyses (FMEA), Preliminary Hazard Analyses (PHA), and Fault Tree Analysis (FTA) were performed to allow detailed evaluation of the IME concept. A discussion of these system reliability concepts is also presented.

Hardy, Terry L.↗

Reliability studies of Integrated Modular Engine system designs

A study was performed to evaluate the reliability of Integrated Modular Engine (IME) concepts. Comparisons were made between networked IME systems and non-networked discrete systems using expander cycle configurations. Both redundant and non-redundant systems were analyzed. Binomial approximation and Markov analysis techniques were employed to evaluate total system reliability. In addition, Failure Modes and Effects Analyses (FMEA), Preliminary Hazard Analyses (PHA), and Fault Tree Analysis (FTA) were performed to allow detailed evaluation of the IME concept. A discussion of these system reliability concepts is also presented.

Hardy, Terry L.↗

QuantifyML: How good is my machine learning model?

This paper presents an approach, QuantifyML, which employs model counting to assess the learnability and robustness of machine learning models. Typically the efficacy of machine learning models is determined by computing their accuracy statistically on test data sets. However, this may be misleading, if the test data is not representative of the problem that is being studied. Further, two different models may have the same accuracy on a given data set, measured statistically, but may be very different in their behavior on unseen data. Also, models with high accuracy could have poor adversarial robustness. In QuantifyML, our goal is to precisely quantify the extent to which machine learning models have learned and generalized from the given data. In QuantifyML, a trained model is translated into a C program, which is fed to the CBMC model checking tool to produce a formula in Conjunctive Normal Form (CNF), which in turn is analyzed with state-of-the-art model counters to efficiently obtain precise counts w.r.t different outputs. QuantifyML enables i) evaluating the learnability of models by comparing the counts for the outputs to ground truth, expressed as logical predicates (if available), ii) comparing the performance of different models that may be built with different machine learning algorithms (e.g., decision-trees vs. neural networks), and iii) quantifying the robustness of trained models around given inputs. Our evaluation demonstrates these applications of QuantifyML on decision trees and neural networks trained to learn relational properties of graphs, for which we know the ground truth, and to perform image classification, for which we do not have the ground truth, but we can quantify local robustness.

Deep Neural Networks↗

Resiliency-based restoration optimization for dependent network systems against cascading failures

Due to the increasing importance of large-scale and complex network systems and the potential for massive cascading failures in these real-world systems, modeling of system resiliency and optimization of restoration strategies to mitigate system performance loss caused by diverse disruptions is of significant interest among researchers and practitioners. Although society has experienced many incidents that demonstrate the influence of cascading failures aggravated by dependencies inside network systems, existing resiliency-based restoration optimization research rarely if ever jointly considers the impact of system dependencies on cascading failures. In this paper, different restoration prioritization strategies are applied to network systems subject to cascading failures that take into account system dependencies. By conducting case studies on synthetic networks and the U.S. airport network system, the effects of restoration strategies are evaluated using a system resiliency metric and two system performance measurements. Furthermore, the influence of system dependency characteristics and the interplay between them and restoration strategies on system resiliency regarding cascading failures are also investigated. This work demonstrates the distinct effects of restoration prioritization actions against cascading failures to mitigate the performance loss in network systems with different properties. It also provides insights about restoration improvement by considering dependency impacts to effectively reduce the intensity and extent of cascading failures.

42 ENGINEERING↗

A Study of an Optical Lunar Surface Communications Network with High Bandwidth Direct to Earth Link

Analyzed optical DTE (direct to earth) and lunar relay satellite link analyses, greater than 200 Mbps downlink to 1‐m Earth receiver and greater than 1 Mbps uplink achieved with mobile 5‐cm lunar transceiver, greater than 1Gbps downlink and greater than 10 Mpbs uplink achieved with 10‐cm stationary lunar transceiver, MITLL (MIT Lincoln Laboratory) 2013 LLCD (Lunar Laser Communications Demonstration) plans to demonstrate 622 Mbps downlink with 20 Mbps uplink between lunar orbiter and ground station; Identified top five technology challenges to deploying lunar optical network, Performed preliminary experiments on two of challenges: (i) lunar dust removal and (ii)DTN over optical carrier, Exploring opportunities to evaluate DTN (delay-tolerant networking) over optical link in a multi‐node network e.g. Desert RATS.

lunar surface system↗

Parallel sorting algorithm classification: is manual instrumentation necessary?

Understanding parallel algorithms is crucial for accelerating scientific simulations on complex, distributed memory, high-performance computers. Modern algorithm classification approaches learn semantics directly from source code to differentiate between algorithms, however, accessing source code is not always possible. We can learn about parallel algorithms from observing their performance, as programs running the same algorithms and using the same hardware should exhibit similar performance characteristics. We present an approach to learn algorithm classes from parallel performance data directly in order to classify algorithms without access to the source code. We extend previous work to enable classifying parallel sorting algorithms using automatic instrumentation instead of requiring manual region annotations in the source code. In this work, we design and demonstrate a study for classification of parallel sorting algorithms using parallel performance data collected from automatic instrumentation, and evaluate the performance of our new methodology on classification. We leverage Caliper to collect the performance data, Thicket for our exploratory data analysis (EDA), and PyTorch and Scikit-learn to evaluate the effectiveness of random forests, support vector machines (SVMs), decision trees, neural networks, and logistic regressions on parallel performance data. Additionally, we study noise in parallel performance data, whether the removal of noise and pre-processing of the data is necessary to accurately classify parallel sorting algorithms, and determine the effectiveness of features created from performance data. In conclusion, we demonstrate classification accuracy for these five different models of up to 97.7% across four different parallel algorithm classes.

Algorithm Classification↗

Quantifying leaf symptoms of sorghum charcoal rot in images of field‐grown plants using deep neural networks

Abstract Charcoal rot of sorghum (CRS) is a significant disease affecting sorghum crops, with limited genetic resistance available. The causative agent, Macrophomina phaseolina (Tassi) Goid, is a highly destructive fungal pathogen that targets over 500 plant species globally, including essential staple crops. Utilizing field image data for precise detection and quantification of CRS could greatly assist in the prompt identification and management of affected fields and thereby reduce yield losses. The objective of this work was to implement various machine learning algorithms to evaluate their ability to accurately detect and quantify CRS in red‐green‐blue images of sorghum plants exhibiting symptoms of infection. EfficientNet‐B3 and a fully convolutional network emerged as the top‐performing models for image classification and segmentation tasks, respectively. Among the classification models evaluated, EfficientNet‐B3 demonstrated superior performance, achieving an accuracy of 86.97%, a recall rate of 0.71, and an F1 score of 0.73. Of the segmentation models tested, FCN proved to be the most effective, exhibiting a validation accuracy of 97.76%, a recall rate of 0.68, and an F1 score of 0.66. As the size of the image patches increased, both models’ validation scores increased linearly, and their inference time decreased exponentially. This trend could be attributed to larger patches containing more information, improving model performance, and fewer patches reducing the computational load, thus decreasing inference time. The models, in addition to being immediately useful for breeders and growers of sorghum, advance the domain of automated plant phenotyping and may serve as a foundation for drone‐based or other automated field phenotyping efforts. Additionally, the models presented herein can be accessed through a web‐based application where users can easily analyze their own images.

Gonzalez, Emmanuel M.↗

(abstract) Satellite-Enhanced Personal Communications Experiments

As an initial step in exploring the opportunities afforded by the merger of satellite-based and land-based networks, Bellcore and JPL conducted several experiments utilizing NASA's Advanced Communications Technology Satellite (ACTS) and JPL's ACTS Mobile Terminal (AMT). Experimental goals fell into three categories: a) demonstrate personal communication applications, b) demonstrate interoperability among multiple wireless networks and the Public Switched Telecommunications Network (PSTN), and c) evaluate new protocol mechanisms for data communications using wireless links. We describe the performance of Point-of-Sale, e-mail, FAX, and call control applications, where the communication path passed through up to four networks: a wireless packet data network, the Satellite network, the PSTN, and a wireless cellular network. One important element of satellite-terrestrial interoperability is the efficiency of data communications protocols. Most protocols in use today (e.g., TCP/IP) have been optimized for wireline channels; their use over wireless networks presents significant new challenges. The characteristics of wireless channels -- increased error, longer packet delay, and limited bandwidth -- affect the design of the protocol. We describe experimental results for differing protocol mechanisms and parameters, such as acknowledgment schemes and packet sizes, that demonstrate the types of protocol needed for efficient use of wireless satellite-terrestrial networks.

personal↗

Model Quality and Measurement Density Impact on Volt/Volt Ampere Reactive Optimization Performance

The operation of the utility grid is being reshaped by the continuous addition of distributed energy resources and advanced metering infrastructure, which challenge existing grid control strategies. Some utilities deploy advanced distribution management systems (ADMS) to assist with the consolidation of various applications and to augment situational awareness in response to the new power delivery dynamics. An ADMS is an integrated software platform that provides utilities with a way to enhance their reliability, control, and optimization with advanced applications, such as volt/VAR optimization (VVO). A VVO application could serve as a vehicle to deliver cost savings by providing the utility with a method to reduce rates by controlling the voltage and decreasing the energy usage in their service territory. Some utilities are reluctant to integrate an ADMS, because it is a significant investment that requires approval from the public regulatory commission and/or their customers. This paper evaluates the impact on VVO performance when using a lower-quality network model supplemented with additional measurements, which could provide an implementation for cost savings. The results show that a better model quality would provide the highest energy savings; however, some level of telemetry is necessary in all scenarios to prevent voltage exceedances.

24 POWER TRANSMISSION AND DISTRIBUTION↗

IBM PC/IX operating system evaluation plan

An evaluation plan for the IBM PC/IX Operating System designed for IBM PC/XT computers is discussed. The evaluation plan covers the areas of performance measurement and evaluation, software facilities available, man-machine interface considerations, networking, and the suitability of PC/IX as a development environment within the University of Southwestern Louisiana NASA PC Research and Development project. In order to compare and evaluate the PC/IX system, comparisons with other available UNIX-based systems are also included.

Dominick, Wayne D.↗

Modeling Atmospheric Brown Carbon in the GISS ModelE Earth System Model

Brown carbon (BrC) is an absorbing organic aerosol (OA), primarily emitted through biomass burning (BB), which exhibits light absorption unique to both black carbon (BC) and other organic aerosols. Despite many field and laboratory studies seeking to constrain BrC properties, the radiative forcing (RF) of BrC is still highly uncertain. To better understand its climate impact, we introduced BrC to the One-Moment Aerosol (OMA) module of the GISS ModelE Earth system model (ESM). We assessed ModelE sensitivity to primary BrC processed through a novel chemical aging scheme and to secondary BrC formed from biogenic volatile organic compounds (BVOCs). Initial results show that BrC typically contributes a top-of-the-atmosphere (TOA) radiative effect of 0.04 W m −2 . Sensitivity tests indicate that explicitly simulating BrC (separating it from other OAs), including secondary BrC, and simulating chemical bleaching of BrC contribute distinguishable radiative effects and should be accounted for in BrC schemes. This addition of prognostic BrC to ModelE allows greater physical and chemical complexity in OA representation with no apparent trade-off in model performance, as the evaluation of ModelE aerosol optical depth against Aerosol Robotic Network (AERONET) and Moderate Resolution Imaging Spectroradiometer (MODIS) retrieval data, with and without the BrC scheme, reveals similar skill in both cases. Thus, BrC should be explicitly simulated to allow more physically based chemical composition, which is crucial for more detailed OA studies like comparisons to in situ measurement campaigns. We include a summary of best practices for BrC representation within ModelE at the end of this paper.

brown carbon aerosols↗

Investigating the Vulnerabilities of the Direct Transfer Trip Scheme for Network Protector Units in the Secondary Networks of Electric Power Distribution Grids

Network protector units (NPUs) are crucial parts of the protection of secondary networks to effectively isolate faults occurring on the primary feeders. When a fault occurs on the primary feeder, there is a path of the fault current going through the service transformers that causes a negative flow of current on the NPU connected to the faulted feeder. Conventionally, NPUs rely on the direction of current with respect to the voltage to detect faults and make a correct trip decision. However, the conventional NPU logic does not allow the reverse power flow caused by distributed energy resources installed on secondary networks. The communication-assisted direct transfer trip logic for NPUs can be used to address this challenge. However, the communication-assisted scheme is exposed to some vulnerabilities arising from the disruption or corruption of the communicated data that can endanger the reliable operation of NPUs. This paper evaluates the impact of the malfunction of the communication system on the operation of communication-assisted NPU logic. To this end, the impact of packet modification and denial-of-service cyberattacks on the communication-assisted scheme are evaluated. The evaluation was performed using a hardware-in-the-loop (HIL) co-simulation testbed that includes both real-time power system and communication network digital simulators. This paper evaluates the impact of the cyberattacks for different fault scenarios and provides a list of recommendations to improve the reliability of communication-assisted NPU protection.

direct transfer trip↗

Solar electric propulsion system evaluation

Solar electric propulsion system performance consisting of thrustors with thrust vector aligning actuators, switching network and flight type power conditioner

Costogue, E. N.↗

Design of an Additively Manufactured Recuperator With 800 °C Inlet Temperature for sCO2 Power Cycle Application

Abstract Recuperators with design temperatures at and above 800 °C can further increase the thermal efficiency of supercritical CO2 power cycles by enabling higher turbine exhaust temperatures. Mar-M247 is a well-suited nickel-based superalloy for high temperature service due to its high creep strength that prevents excessive material thickness being required for pressure containment. Additive manufacturing using a high-speed laser-directed energy deposition (L-DED) process presents a promising solution, with build trials demonstrating the ability to produce nonconventional flow channels for enhanced heat transfer. A design process is presented that includes aerothermal and mechanical evaluation to maximize performance within the constraints of the manufacturing process. A 2-D heat transfer network and pressure drop code allows prediction of flow distribution and its effect on overall thermal performance. Established literature correlations, along with CFD simulation, inform the prediction of heat transfer coefficients and friction factors for the flowpaths and enhancement features in the heat exchanger core. Mechanical evaluation using finite element analysis (FEA) modeling with the intent of the ASME Boiler & Pressure Vessel Code (BPVC) Section VIII, Div. 2 assesses the operational safety of the design. The detailed design features annular finned passages that take advantage of helical flow paths to distribute the flow from separated headers to shared heat transfer surfaces. Performance predictions for the recuperator at a 50 kW scale provide insights into the feasibility of the additively manufactured (AM) process to produce recuperators on a commercial scale that extend existing operating envelopes.

Engineering↗