Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “network performance evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Learning Universal Authorship Representations

This code contains all the utilities required to reproduce the results of our EMNLP 2021 paper "Learning Universal Authorship Representations". It contains the utilities required for download the datasets, training our model, and performing all evaluations necessary for reproducing the results in the paper. Here's the abstract of our work: Determining whether two documents were composed by the same author, also known as authorship verification, has traditionally been tackled using statistical methods. Recently, authorship representations learned using neural networks have been found to outperform alternatives, particularly in large-scale settings involving hundreds of thousands of authors. But do such representations learned in a particular domain transfer to other domains? Or are these representations inherently entangled with domain-specific features? To study these questions, we conduct the first large-scale study of cross-domain transfer for authorship verification considering zero-shot transfers involving three disparate domains: Amazon reviews, fanfiction short stories, and Reddit comments. We find that although a surprising degree of transfer is possible between certain do- mains, it is not so successful between others. We examine properties of these domains that influence generalization and propose simple but effective methods to improve transfer.

Rivera Soto, RafaelA↗
DOE OSTI2022

Automatic Waveform Quality Control for Surface Waves Using Machine Learning

Surface-wave seismograms are widely used by researchers to study Earth’s interior and earthquakes. To extract information reliably and robustly from a suite of surface waveforms, the signals require quality control screening to reduce artifacts from signal complexity and noise. This process has usually been completed by human experts labeling each waveform visually, which is time consuming and tedious for large data sets. We explore automated approaches to improve the efficiency of waveform quality control processing by investigating logistic regression, support vector machines, K-nearest neighbors, random forests (RF), and artificial neural networks (ANN) algorithms. To speed up signal quality assessment, we trained these five machine learning (ML) methods using nearly 400,000 human-labeled waveforms. The ANN and RF models outperformed other algorithms and achieved a test accuracy of 92%. We evaluated these two best-performing models using seismic events from geographic regions not used for training. The results show that the two trained models agree with labels from human analysts but required only 0.4% of the time. Although the original (human) quality assignments assessed general waveform signal-to-noise, the ANN or RF labels can help facilitate detailed waveform analysis. Our investigations demonstrate the capability of the automated processing using these two ML models to reduce outliers in surface-wave-related measurements without human quality control screening.

58 GEOSCIENCES↗
DOE OSTI2020

Model Exploration of an Information-Based Healthcare Intervention Using Parallelization and Active Learning

This paper describes the application of a large-scale active learning method to characterize the parameter space of a computational agent-based model developed to investigate the impact of CommunityRx, a clinical information-based health intervention that provides patients with personalized information about local community resources to meet basic and self-care needs. Additionally, the diffusion of information about community resources and their use is modeled via networked interactions and their subsequent effect on agents' use of community resources across an urban population. A random forest model is iteratively fitted to model evaluations to characterize the model parameter space with respect to observed empirical data. We demonstrate the feasibility of using high-performance computing and active learning model exploration techniques to characterize large parameter spaces; by partitioning the parameter space into potentially viable and non-viable regions, we rule out regions of space where simulation output is implausible to observed empirical data. We argue that such methods are necessary to enable model exploration in complex computational models that incorporate increasingly available micro-level behavior data. We provide public access to the model and high-performance computing experimentation code.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2011

Evaluation of Long-Range Lightning Detection Networks Using TRMM/LIS Observations

Recent advances in long-range lightning detection technologies have improved our understanding of thunderstorm evolution in the data sparse oceanic regions. Although the expansion and improvement of long-range lightning datasets have increased their applicability, these applications (e.g., data assimilation, atmospheric chemistry, and aviation weather hazards) require knowledge of the network detection capabilities. Toward this end, the present study evaluates data from the World Wide Lightning Location Network (WWLLN) using observations from the Lightning Imaging Sensor (LIS) aboard the Tropical Rainfall Measurement Mission (TRMM) satellite. The study documents the WWLLN detection efficiency and location accuracy relative to LIS observations, describes the spatial variability in these performance metrics, and documents the characteristics of LIS flashes that are detected by WWLLN. Improved knowledge of the WWLLN detection capabilities will allow researchers, algorithm developers, and operational users to better prepare for the spatial and temporal coverage of the upcoming GOES-R Geostationary Lightning Mapper (GLM).

Rudlosky, Scott D.↗
DOE OSTI2022

FLISR in the Presence of DERs ADMS Test Bed Use Case

Fault location, isolation, and restoration (FLISR) is one of the distribution automation applications that utilities are most interested in. It operates groups of switches on distribution feeders to improve the reliability of power delivery after localizing outages. FLISR is an essential function for enabling a self-healing grid, and it directly affects grid reliability and resilience. The presence of DERs brings both new opportunities and challenges for FLISR applications. For instance, some DERs can work as backup generation sources and help energize local networks so more switching options can be achieved with the coordination of FLISR operations; however, the existence of DERs also brings new challenges. The bidirectional power flow resulting from DERs might require dynamic changes to protective devices' fault current settings, and thus the FLISR application will need to dynamically adjust its operations in coordination with the dynamic protection settings. Also, some FLISR applications make their service restoration decisions and close tie-switches based on predefined rules; however, the presence of DERs and their impact on altering net loads on the local feeder network are not considered. For this use case, the project team is using the FLISR application of the Survalent ADMS operating on a real-time simulation of a feeder from Central Georgia EMC, a cooperative electric utility. The performance of the FLISR application is being evaluated for different locations and combinations of DERs, including grid-forming battery energy storage systems.

ADMS↗
DOE OSTI2020

Impacts of Experimentally Obtained Harmonic Spectrums of Residential Appliances on Distribution Feeder

Owing to the increased use of power electronic based appliances and energy-efficient home equipment such as modern lighting loads, the percentage of nonlinear loads has increased in the distribution system, which can impact system performance, loss, and stability. Thus a comprehensive knowledge of their power quality and harmonic analysis is essential to improve the load models, voltage stability assessment, determination of possible interactions at harmonic frequencies, protection planning, and the effect of system impedance. This paper focuses on harmonic load flow analysis for multiple residential load types to determine the expected impacts on an modeled distribution secondary. For this study, the household appliances include lighting, power electronic, resistive, and motor loads with a nominal supply voltage of 120 V single-phase or 240 V split phase at a nominal frequency of 60 Hz. The harmonic spectrums, as obtained from the experimental evaluation of real loads, are used to inform the harmonic load flow for a detailed secondary network, including the distribution service transformer extracted from a real distribution feeder's model. Additionally, the impact of voltage harmonics on a three-phase test load is presented with experimental results. The harmonic data of the transformer terminal voltage, as obtained from the former load flow study, are scaled to generate the source voltage for the three-phase configuration of the grid simulator to make the test setup very similar to a typical secondary design in the U.S.

ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATION↗
NASA NTRS1989

DSN 70-meter antenna X- and S-band calibration. Part 2: System noise temperature measurements and telecommunications link evaluation

The X- and S-band system operating noise temperatures of the Deep Space Network (DSN) 70-m antennas are presented. Models of atmosphere and ground noise temperature contributions, as they affect the antenna calibrations, are given for future use in telecommunications link modeling. The measured 70-m antenna network gain/system noise temperature (G/T) performance is presented. Compared with the earlier 64-m antenna network, G/T improvements of from 1.8 dB to 2.5 dB, depending on elevation angle, were achieved. G/T comparisons are made with the DSN/Flight Project Design Handbook and the Voyager telecommunications design control table. Actual Voyager telecommunications link performance is compared with predictions made by TPAP (the Voyager telecommunications prediction and analysis program) and with measured performance of the individual 70-m antennas. A modification in the use of antenna gain, system noise temperature, and atmospheric attenuation in existing telecommunications design control tables is suggested.

Slobin, S. D.↗
DOE OSTI2020

Analysis of the performance of different culvert boundary conditions in 2D shallow flow models

Culverts allow roads to safely traverse small streams or drainage ditches, and their proper design is critical to ensure a safe and reliable transportation network. A correct modelization of these hydraulic structures becomes crucial in the assessment of flood footprints or discharge peak estimation in a risk evaluation plan. The question of how to include culverts comes up frequently when assembling a hydraulic model that requires the presence of as many singular elements as possible. In this work, three different culvert integrations with the surface domain are studied and compared in the context of a 2D shallow water (SW) model. All of them are based on the Federal Highway Administration (FHWA) formulation for the culvert discharge estimation but differ in complexity and in the interaction with the numerical model for surface flow, some of them as internal boundary conditions. Several steady and unsteady validation test cases are presented and the numerical results are compared with the predictions from HEC-RAS 1D and HY-8 software. Furthermore, the culvert area, shape and their sensitivity to the 2D computational mesh is also analyzed.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Performance Evaluation of Comparative Vacuum Monitoring and Piezoelectric Sensors for Structural Health Monitoring of Rotorcraft Components

The costs associated with the increasing maintenance and surveillance needs of aging structures are rising at an unexpected rate. Multi-site fatigue damage, hidden cracks in hard-to-reach locations, disbonded joints, erosion, impact, and corrosion are among the major flaws encountered in today’s extensive fleet of aging aircraft and space vehicles. Aircraft maintenance and repairs represent about a quarter of a commercial fleet’s operating costs. The application of Structural Health Monitoring (SHM) systems using distributed sensor networks can reduce these costs by facilitating rapid and global assessments of structural integrity. The use of in-situ sensors for real-time health monitoring can overcome inspection impediments stemming from accessibility limitations, complex geometries, and the location and depth of hidden damage. Reliable, structural health monitoring systems can automatically process data, assess structural condition, and signal the need for human intervention. The ease of monitoring an entire on-board network of distributed sensors means that structural health assessments can occur more often, allowing operators to be even more vigilant with respect to flaw onset. SHM systems also allow for condition-based maintenance practices to be substituted for the current time-based or cycle-based maintenance approach thus optimizing maintenance labor. The Federal Aviation Administration has conducted a series of SHM validation and certification programs intended to comprehensively support the evolution and adoption of SHM practices into routine aircraft maintenance practices. This report presents one of those programs involving a Sandia Labs-aviation industry effort to move SHM into routine use for aircraft maintenance. The Airworthiness Assurance NDI Validation Center (AANC) at Sandia Labs, in conjunction with Sikorsky, Structural Monitoring Systems Ltd., Anodyne Electronics Manufacturing Corp., Acellent Technologies Inc., and the Federal Aviation Administration (FAA) carried out a trial validation and certification program to evaluate Comparative Vacuum Monitoring (CVM) and Piezoelectric Transducers (PZT) as a structural health monitoring solution to specific rotorcraft applications. Validation tasks were designed to address the SHM equipment, the health monitoring task, the resolution required, the sensor interrogation procedures, the conditions under which the monitoring will occur, the potential inspector population, adoption of CVM and PZT systems into rotorcraft maintenance programs and the document revisions necessary to allow for their routine use as an alternate means of performing periodic structural inspections. This program addressed formal SHM technology validation and certification issues so that the full spectrum of concerns, including design, deployment, performance and certification were appropriately considered. Sandia Labs designed, implemented, and analyzed the results from a focused and statistically relevant experimental effort to quantify the reliability of a CVM system applied to Sikorsky S-92 fuselage frame application and a PZT system applied to an S-92 main gearbox mount beam application. The applications included both local and global damage detection assessments. All factors that affect SHM sensitivity were included in this program: flaw size, shape, orientation and location relative to the sensors, as well as operational and environmental variables. Statistical methods were applied to performance data to derive Probability of Detection (POD) values for SHM sensors in a manner that agrees with current nondestructive inspection (NDI) validation requirements and is acceptable to both the aviation industry and regulatory bodies. The validation work completed in this program demonstrated the ability of both CVM and PZT SHM systems to detect cracks in rotorcraft components. It proved the ability to use final system response parameters to provide a Green Light/Red Light (“GO” – “NO GO”) decision on the presence of damage. In additional to quantifying the performance of each SHM system for the trial applications on the S-92 platform, this study also identified specific methods that can be used to optimize damage detection, guidance on deployment scenarios that can affect performance and considerations that must be made to properly apply CVM and PZT sensors. These results support the main goal of safely integrating SHM sensors into rotorcraft maintenance programs. Additional benefits from deploying rotorcraft Health and Usage Monitoring Systems (HUMS) may be realized when structural assessment data, collected by an SHM system, is also used to detect structural damage to compliment the operational environment monitoring. The use of in-situ sensors for health monitoring of rotorcraft structures can be a viable option for both flaw detection and maintenance planning activities. This formal SHM validation will allow aircraft manufacturers and airlines to confidently make informed decisions about the proper utilization of CVM and PZT technology. It will also streamline future regulatory actions and formal certification measures needed to assure the safe application of SHM solutions.

42 ENGINEERING↗
DOE OSTI2022

A machine learning approach to water quality forecasts and sensor network expansion: Case study in the Wabash River Basin, United States

Abstract Midwestern cities require forecasts of surface nitrate loads to bring additional treatment processes online or activate alternative water supplies. Concurrently, networks of nitrate monitoring stations are being deployed in river basins, co‐locating water quality observations with established stream gauges. However, tools to evaluate the future value of expanded networks to improve water quality forecasts remains challenging. Here, we construct a synthetic data set of stream discharge and nitrate for the Wabash River Basin—one of the United States’ most nutrient polluted basins—using the established Agro‐IBIS and THMB models. Synthetic data enables rapid, unbiased and low‐cost assessment of potential sensor placements to support management objectives, such as near‐term forecasting. Using the synthetic data, we established baseline 1‐day forecasts for surface water nitrate at 12 cities in the basin using support vector machine regression (SVMR; RMSE 0.48–3.3 ppm). Next, we used the SVMRs to evaluate the improvement in forecast performance associated with deployment of additional nitrate sensors. We identified the optimal sensor placement to improve forecasts at each city, and the relative value of sensors at each candidate location. Finally, we assessed the co‐benefit realized by other cities when a sensor is deployed to optimize a forecast at one city, finding significant positive externalities in all cases. Ultimately, our study explores the potential for machine learning to make near‐term predictions and critically evaluate the improvement realized by expanding a monitoring network. While we use nitrate pollution in the Wabash River Basin as a case study, this approach could be readily applied to any problem where the future value of sensors and network design are being evaluated.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Energy Resilience for Mission Assurance, Agile Co-simulation for Cyber Energy System Security (ACCESS) Model Advancements for Resilience Analysis (Version 3, July 2023)

Agile Co-simulation for Cyber Energy System Security (ACCESS) is a co-simulation platform developed by Lawrence Livermore National Laboratory (LLNL). The primary high-level use-case for ACCESS is to study existing or new cyber-physical critical infrastructure systems, with a heavy emphasis on 1) systems that utilize communication networks, and 2) studies that seek to understand cyber-related system impacts. ACCESS is currently used for several energy system resilience projects at LLNL. In the Energy Resilience for Mission Assurance (ERMA) project, ACCESS is used in the Mod eling for Metric Calculation task (specifically, subtask 4.3, Communications and Cyber Modeling) to model and simulate the cyber and communication system aspects of Defense Critical Electric Infrastructure (DCEI) systems, with a focus on computing specific communication system metrics that can impact system resilience and mission performance. Simulated communication system per formance will be fed back to other ERMA system components so that mission performance can be evaluated holistically. This report describes several enhancements to the ACCESS platform that were implemented during the execution of the ERMA project in support of reslience analysis. This includes the addition of new models and subsystems, enhancements to existing models, and integration with external systems. The remainder of this report is structured as follows. In Section 2, a brief background description of the ACCESS platform is provided, including an outline of ACCESS components, example use cases, and a set of communication network resilience metrics that can be computed with ACCESS. Section 3 describes the ACCESS model enhancements for ERMA in detail. Finally, Section 4 briefly outlines future integration opportunities between ACCESS and project participant capabilities identified during the progression of the project.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Lithium Oxide Superionic Conductors Inspired by Garnet and NASICON Structures

Abstract The key component in lithium solid‐state batteries (SSBs) is the solid electrolyte composed of lithium superionic conductors (SICs). Lithium oxide SICs offer improved electrochemical and chemical stability compared with sulfides, and their recent advancements have largely been achieved using materials in the garnet‐ and NASICON (sodium superionic conductor)‐ structured families. In this work, using the ion‐conduction mechanisms in garnet and NASICON as inspiration, a common pattern of an “activated diffusion network” and three structural features that are beneficial for superionic conduction: a 3D percolation Li diffusion network, short distances between occupied Li sites, and the “homogeneity” of the transport path are identified. A high‐throughput computational screening is performed to search for new lithium oxide SICs that share these features. From this search, seven candidates are proposed exhibiting high room‐temperature ionic conductivity evaluated using ab initio molecular dynamics simulations. Their structural frameworks including spinel, oxy‐argyrodite, sodalite, and LiM(SeO 3 ) 2 present new opportunities for enriching the structural families of lithium oxide SICs.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Semi-supervised permutation invariant particle-level anomaly detection

The development of analysis methods to distinguish potential beyond the Standard Model phenomena in a model-agnostic way can significantly enhance the discovery reach in collider experiments. However, the typical machine learning (ML) algorithms employed for this task require fixed length and ordered inputs that break the natural permutation invariance in collision events. To address this, a semi-supervised anomaly detection tool is presented that takes a variable number of particle-level inputs and leverages a signal model to encode this information into a permutation invariant, event-level representation via supervised training with a Particle Flow Network (PFN). Data events are then encoded into this representation and given as input to an autoencoder for unsupervised ANomaly deTEction on particLe flOw latent sPacE (ANTELOPE), classifying anomalous events based on a low-level and permutation invariant input modeling. Performance of the ANTELOPE architecture is evaluated on simulated samples of hadronic processes in a high energy collider experiment, showing good capability to distinguish disparate models of new physics.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

HYPPO v1.0.0

HYPPO is a hyperparameter optimization (HPO) software that uses surrogate modeling and uncertainty quantification to provide reliable neural network architectures. Similar state-of-the-art HPO technologies do not use such features and mostly perform random searches to explore the parameter space, which can easily become computationally expensive. Using HYPPO, the user is able to reduce by an order of magnitude the number of evaluations necessary to identify the most optimal region in the hyperparameter space. Finally, using asynchronous nested parallelism, we are able to decrease by two orders of magnitude the amount of time required to complete the HPO process.

Dumont, Vincent↗
DOE OSTI2020

Corroborative Evaluation of the Real-World Energy Saving Potentials of InfoRich Eco-Autonomous Driving (iREAD) System

There has been an increasing interest in exploring the potential to reduce energy consumption of future connected and automated vehicles. People have extensively studied various eco-driving implementations that leverage preview information provided by on-board sensors and connectivity, as well as the control authority enabled by automation. Quantitative real-world evaluation of eco-driving benefits is a challenging task. The standard regulatory driving cycles used for measuring exhaust emissions and fuel economy are not truly representative of real-world driving, nor for capturing how connectivity and automation might influence driving trajectories. To adequately consider real-world driving behavior and potential “off-cycle” impacts, this paper presents four collaborative evaluation methods: large-scale simulation, in-depth simulation, vehicle-in-the-loop testing, and vehicle road testing. These four approaches, spanning simulation and testing aspects, evaluate real-world fuel economy benefits with different ranges and resolutions. The large-scale simulations leverage an extensive real-world driving database to assess overall eco-driving benefits across a range of road network and driving scenarios. The real-world driving data are further leveraged to generate representative driving routes for deeper evaluation. Based on the representative routes, in-depth simulation relying on high-fidelity models investigates how different traffic scenarios can impact the eco-driving performance. The vehicle-in-the-loop setup reinforces the in-depth simulations by conducting tests with an actual vehicle operated on a chassis dynamometer; the measured energy savings were indeed found to agree with the in-depth simulation savings estimates. Finally, limited but representative road testing with the fully integrated vehicle will be conducted to demonstrate the eco-driving capability and conclude the overall evaluation regimen.

ARPA-E↗
NASA NTRS1989

Interpenetrating polymer networks from acetylene terminated materials

As part of a program to develop high temperature/high performance structural resins for aerospace applications, the chemistry and properties of a novel class of interpenetrating polymer networks (IPNs) were investigated. These IPNs consist of a simple diacetylenic compound (aspartimide) blended with an acetylene terminated arylene ether oligomer. Various compositional blends were prepared and thermally cured to evaluate the effect of crosslink density on resin properties. The cured IPNs exhibited glass transition temperatures ranging from 197 to 254 C depending upon the composition and cure temperature. The solvent resistance, fracture toughness and coefficient of thermal expansion of the cured blends were related to the crosslink density. Isothermal aging of neat resin moldings, adhesive and composite specimens showed a postcure effect which resulted in improved elevated temperature properties. The chemistry, physical and mechanical properties of these materials will be discussed.

Connell, J. W.↗
NASA NTRS1992

An investigation of networking techniques for the ASRM facility

This report is based on the early design concepts for a communications network for the Advanced Solid Rocket Motor (ASRM) facility being built at Yellow Creek near Iuka, MS. The investigators have participated in the early design concepts and in the evaluation of the initial concepts. The continuing system design effort and any modification of the plan will require a careful evaluation of the required bandwidth of the network, the capabilities of the protocol, and the requirements of the controllers and computers on the network. The overall network, which is heterogeneous in protocol and bandwidth, is being modeled, analyzed, simulated, and tested to obtain some degree of confidence in its performance capabilities and in its performance under nominal and heavy loads. The results of the proposed work should have an impact on the design and operation of the ASRM facility.

Moorhead, Robert J., II↗
NASA NTRS2016

Analysis of Summer-Time Ozone and Precursor Species in the Southeast United States

Ozone (O3) is a greenhouse gas and toxic pollutant which plays a major role in air quality and atmospheric chemistry. The understanding and ability to model the horizontal and vertical structure of O3 mixing ratios is difficult due to the complex formation/destruction processes and transport pathways that cause large variability of O3. The Environmental Protection Agency has National Ambient Air Quality Standards for O3 set at 75 ppb with future standards proposed to be as low as 65 ppb. These lower values emphasize the need to better understand/simulate the transport processes, emission sources, and chemical processes controlling precursor species (e.g., NOx, VOCs, and CO) which influence O3 mixing ratios. The uncertainty of these controlling variables is particularly large in the southeast United States (US) which is a region impacted by multiple different emission sources of precursor species (anthropogenic and biogenic) and transport processes resulting in complex spatio-temporal O3 patterns. During this work we will evaluate O3 and precursor species in the southeast US applying models, ground-based and airborne in situ data, and lidar observations. In the summer of 2013, the UAH O3 Differential Absorption Lidar (DIAL) (part of the Tropospheric Ozone Lidar Network (TOLNet)) measured vertical O3 profiles from the surface up to approximately 12 km. During this period, the lidar observed numerous periods of dynamic temporal and vertical O3 structures. In order to determine the sources/processes impacting these O3 mixing ratios we will apply the CTM GEOS-Chem (v9-02) at a 0.25 deg x 0.3125 deg resolution. Using in situ ground-based (e.g., SEARCH Network, CASTNET), airborne (e.g., NOAA WP-3D - SENEX 2013, DC-8 - SEAC4RS), and TOLNet lidar data we will first evaluate the model to determine the capability of GEOS-Chem to simulate the spatio-temporal variability of O3 in the southeast US. Secondly, we will perform model sensitivity studies in order to quantify which emission sources (e.g., anthropogenic, biogenic, lighting, wildfire) and transport processes (e.g., stratospheric, long-range, local scale) are contributing to these TOLNet-observed dynamic O3 patterns. Results from the evaluation of the model and the study of sources/processes impacting observed O3 mixing ratios will be presented.

Optical Radar↗