Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “network performance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,693 records · Page 94

Spike-and-Slab Shrinkage Priors for Structurally Sparse Bayesian Neural Networks

Network complexity and computational efficiency have become increasingly significant aspects of deep learning. Sparse deep learning addresses these challenges by recovering a sparse representation of the underlying target function by reducing heavily overparameterized deep neural networks. Specifically, deep neural architectures compressed via structured sparsity (e.g., node sparsity) provide low-latency inference, higher data throughput, and reduced energy consumption. In this article, we explore two well-established shrinkage techniques, Lasso and Horseshoe, for model compression in Bayesian neural networks (BNNs). To this end, we propose structurally sparse BNNs, which systematically prune excessive nodes with the following: 1) spike-and-slab group Lasso (SS-GL) and 2) SS group Horseshoe (SS-GHS) priors, and develop computationally tractable variational inference, including continuous relaxation of Bernoulli variables. We establish the contraction rates of the variational posterior of our proposed models as a function of the network topology, layerwise node cardinalities, and bounds on the network weights. Furthermore, we empirically demonstrate the competitive performance of our models compared with the baseline models in prediction accuracy, model compression, and inference latency.

97 MATHEMATICS AND COMPUTING↗

A Comparative Study of Physics‐Informed and Data‐Driven Neural Networks for Compound Flood Simulation at River‐Ocean Interfaces: A Case Study of Hurricane Irene

Simulating compound flooding (CF) at the river-ocean interface within large-scale Earth System Models (ESMs) presents significant challenges due to complex interactions between river discharge, storm surge, and tides. This study assesses the comparative advantages of physics-informed and data-driven machine learning (ML) approaches for enhancing local ESM performance. We systematically compare data-driven neural network models (i.e., CNNs, U-Net, Long Short-Term Memory (LSTM), Gated Recurrent Unit), and physics-informed neural network (PINN) models, including vanilla PINN and a finite-difference-based PINN (FD-PINN). Specifically, FD-PINN is introduced to enhance computational efficiency, accelerating vanilla PINNs by ∼6.5 times while improving accuracy. To enhance data-driven model training, a new data-generation approach is developed to sample historical fluvial and coastal flood events, which ensures a robust data set for extreme event prediction. The models are evaluated using a realistic one-dimensional river domain extracted from an ESM's river mesh and the Hurricane Irene event as an independent test case. Results show that FD-PINN achieves accurate predictions with significantly reduced computational costs relative to vanilla PINNs. Among data-driven models, the best overall performance is achieved by a CNN-LSTM hybrid, which balances accuracy and efficiency. While a fully connected CNN (CNN-FC) provides the best accuracy, it incurs high computational cost. Architectures lacking strong temporal modeling tend to underperform on unseen events. These findings highlight the importance of sequence-aware designs for robust generalization. This study reveals the trade-offs between physics-informed and data-driven models and proposes an adaptive hybrid framework for integrating ML into ESMs to enhance local flood simulations.

Earth Systems Modeling↗

Application of neural networks to autonomous rendezvous and docking of space vehicles

NASA-Marshall has investigated the feasibility of numerous autonomous rendezvous and docking (ARD) candidate techniques. Neural networks have been studied as a viable basis for such systems' implementation, due to their intrinsic representation of such nonlinear functions as those for which analytical solutions are either difficult or nonexistent. Neural networks are also able to recognize and adapt to changes in their dynamic environment, thereby enhancing redundancy and fault tolerance. Outstanding performance has been obtained from ARD azimuth, elevation, and roll networks of this type.

Dabney, Richard W.↗

Trainability of Dissipative Perceptron-Based Quantum Neural Networks

Several architectures have been proposed for quantum neural networks (QNNs), with the goal of efficiently performing machine learning tasks on quantum data. Rigorous scaling results are urgently needed for specific QNN constructions to understand which, if any, will be trainable at a large scale. Here, we analyze the gradient scaling (and hence the trainability) for a recently proposed architecture that we call dissipative QNNs (DQNNs), where the input qubits of each layer are discarded at the layer’s output. We find that DQNNs can exhibit barren plateaus, i.e., gradients that vanish exponentially in the number of qubits. Moreover, we provide quantitative bounds on the scaling of the gradient for DQNNs under different conditions, such as different cost functions and circuit depths, and show that trainability is not always guaranteed. Here our work represents the first rigorous analysis of the scalability of a perceptron-based QNN.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Advanced control techniques for modern inertia based inverters

In this research three artificial intelligent (AI)-based techniques are proposed to regulate the voltage and frequency of a grid-connected inverter. The increase in the penetration of renewable energy sources (RESs) into the power grid has led to the increase in the penetration of fast-responding inertia-less power converters. The increase in the penetration of these power electronics converters changes the nature of the conventional grid, in which the existing kinetic inertia in the rotating parts of the enormous generators plays a vital role. The concept of virtual inertia control scheme is proposed to make the behavior of grid connected inverters more similar to the synchronous generators, by mimicking the mechanical behavior of a synchronous generator. Conventional control techniques lack to perform optimally in nonlinear, uncertain, inaccurate power grids. Besides, the decoupled control assumption in conventional VSGs makes them nonoptimal in resistive grids. The neural network predictive controller, the heuristic dynamic programming, and the dual heuristic dynamic programming techniques are presented in this research to overcome the draw backs of conventional VSGs. The nonlinear characteristics of neural networks, and the online training enable the proposed methods to perform as robust and optimal controllers. The simulation and the experimental laboratory prototype results are provided to demonstrate the effectiveness of the proposed techniques.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Data-Driven Prediction and Optimization of Energy Use for Transit Fleets of Electric and ICE Vehicles

Due to the high upfront cost of electric vehicles, many public transit agencies can afford only mixed fleets of internal combustion and electric vehicles. Optimizing the operation of such mixed fleets is challenging because it requires accurate trip-level predictions of electricity and fuel use as well as efficient algorithms for assigning vehicles to transit routes. We present a novel framework for the data-driven prediction of trip-level energy use for mixed-vehicle transit fleets and for the optimization of vehicle assignments, which we evaluate using data collected from the bus fleet of CARTA, the public transit agency of Chattanooga, TN. We first introduce a data collection, storage, and processing framework for system-level and high-frequency vehicle-level transit data, including domain-specific data cleansing methods. We train and evaluate machine learning models for energy prediction, demonstrating that deep neural networks attain the highest accuracy. Based on these predictions, we formulate the problem of minimizing energy use through assigning vehicles to fixed-route transit trips. We propose an optimal integer program as well as efficient heuristic and meta-heuristic algorithms, demonstrating the scalability and performance of these algorithms numerically using the transit network of CARTA.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

RL-34 ring laser gyro laboratory evaluation for the Deep Space Network antenna application

The overall results of this laboratory evaluation are quite encouraging. The gyro data is in good agreement with the system's overall pointing performance, which is quite close to the technical objectives for the Deep Space Network (DSN) application. The system can be calibrated to the levels required for millidegree levels of pointing performance, and initialization performance is within the required 0.001 degree objective. The blind target acquisition performance is within a factor of two of the 0.0001 degree objective, limited only by a combination of the slow rate (0.5 deg/sec) and the existing production quantization logic (0.38 arc-sec/pulse). Logic circuitry exists to better this performance such that it will better the objective by 50 percent. Representative data with this circuitry has been provided for illustration. Target tracking performance is about twice the one millidegree objective, with several factors contributing. The first factor is the bias stability of the gyros, which is exceptional, but will limit performance to the 0.001 and 0.002 degree range for long tracking periods. The second contributing factor is the accelerometer contributions when the system is elevated. These degrade performance into the 0.003 to 0.004 degree range, which could be improved upon with some additional changes. Finally, we have provided a set of recommendations to improve performance closer to the technical objectives. These recommendations include gyro, electronics, and system configurational changes that form the basis for additional work to achieve the desired performance. In conclusion, we believe that the RL-34 ring laser gyro-based advanced navigation system demonstrated performance consistent with expectations and technical objectives, and it has the potential for even further enhancement for the DSN application.

Source record↗

Differentiable hybrid neural network approach for enhancing reactor dynamics simulations

Reactor dynamics simulations provide essential insights into the time-dependent behavior of nuclear reactors under various operating conditions. However, high-fidelity simulations can be computationally intensive, requiring significant computational resources. Here, to address this challenge, this study employs a differentiable hybrid model that utilizes neural networks as a corrector to enhance the performance of a low-fidelity simulation, aligning its predictions with those of a high-fidelity simulation. Low-fidelity and high-fidelity simulations were obtained by adjusting the mesh size in the System Dynamics Analysis Tool. The differentiable hybrid model was trained in two approaches: time-step-wise and sequence-wise. It was then applied to simulate various transients in a molten salt reactor. Its performance was evaluated by comparing its responses to transients against those of the high-fidelity simulation. An additional approach was performed using a data-driven model to correct the low-fidelity simulation. In comparison, the differentiable hybrid model showed significant improvements in transient prediction, effectively addressing the limitations of the low-fidelity simulations. The results highlighted the robustness of the differentiable hybrid model in both training approaches. It delivered simulations that were at least 3.8 times faster than high-fidelity models. In the time-step-wise approach, it achieved at least a 39% improvement in accuracy. In the sequence-wise approach, it showed at least an 81% accuracy improvement over the full transient. This approach offers a promising path for improving computational efficiency without compromising accuracy in nuclear reactor simulations, making it suitable for real-time digital twin applications.

42 - ENGINEERING↗

Wilson Corners, Solid Waste Management Unit 001(SWMU 01) 2023 Annual Long-Term Monitoring Report

This report presents a summary of the long-term monitoring (LTM) activities that occurred in 2023 at Wilson Corners, Solid Waste Management Unit 001, at Kennedy Space Center (KSC), Florida. Annual LTM of groundwater is being conducted at the site. Based on results from groundwater sampling activities performed during the 2019 through 2020 LTM reporting period and the 2020 and 2021 DPT groundwater sampling, it was determined that the LTM sampling plan was no longer meeting the goal of LTM because delineation was not verified and the installation of an air sparge (AS) system to treat the area of the High Concentration Plume was recommended. The AS System was installed in late 2022 and early 2023. System start-up activities were initiated in April 2023. Following system startup, several site wells required retrofitting to equip wellheads for withstanding the air pressure released from air sparge wells during system operation. Some site wells also required repair or abandonment, and replacement. Survey of location and top-of-casing of newly installed monitoring wells was combined with scheduled AS system survey activities and was completed in January 2024. The activities presented in this report include the February and April 2023 LTM monitoring well installations; March and April 2023 LTM and performance monitoring well water level gauging and sampling; November 2023 LTM well retrofits and repairs; a summary of December 2023 LTM well abandonments and installations (complete site well abandonment activities will be presented under a separate cover); and January 2024 LTM well survey. During the March and April 2023 sampling events, the low-flow sampling method was used, and samples were analyzed for a select list of volatile organic compounds. In March 2023, groundwater flow for the site was generally to the west was generally consistent with historical observations at the site. The Low Concentration Plume (LCP) continues to extend both horizontally and vertically beyond the terminal depth of the current monitoring well network. Data, inclusive of the 2023 LTM and baseline performance monitoring sampling events, indicate that the LCP encompasses an estimated 19.5 acres, compared to the 2021 LCP footprint, inclusive of the 2020 and 2021 DPT sampling events of 20.7 acres. The vertical extent of VOCs was historically delineated by monitoring wells screened greater than 48 feet below land surface (bls). The results from the three vertical extent monitoring wells screened below 48 feet bls that were sampled during the 2023 LTM indicate that groundwater vinyl chloride concentrations in these three wells are greater than the GCTL. As presented in the 2021 Long-Term Monitoring Report (NASA 2022), the KSCRT agreed to delay deeper investigations in this area to prevent the creation of additional pathways for vertical migration. Based on groundwater sampling activities performed in 2023, recommendations are to perform the next annual LTM sampling event, scheduled for April 2024 and to conduct quarterly performance monitoring of the AS System. The current selection of monitoring wells in the recommended 2024 LTM plan will provide an adequate data set for monitoring groundwater plume behavior; however, the LTM monitoring well network will be evaluated and refined based on 2024 LTM and year one performance monitoring data.

King Linnea↗

Development of message passing-based graph convolutional networks for classifying cancer pathology reports

Abstract Background Applying graph convolutional networks (GCN) to the classification of free-form natural language texts leveraged by graph-of-words features (TextGCN) was studied and confirmed to be an effective means of describing complex natural language texts. However, the text classification models based on the TextGCN possess weaknesses in terms of memory consumption and model dissemination and distribution. In this paper, we present a fast message passing network (FastMPN), implementing a GCN with message passing architecture that provides versatility and flexibility by allowing trainable node embedding and edge weights, helping the GCN model find the better solution. We applied the FastMPN model to the task of clinical information extraction from cancer pathology reports, extracting the following six properties: main site, subsite, laterality, histology, behavior, and grade. Results We evaluated the clinical task performance of the FastMPN models in terms of micro- and macro-averaged F1 scores. A comparison was performed with the multi-task convolutional neural network (MT-CNN) model. Results show that the FastMPN model is equivalent to or better than the MT-CNN. Conclusions Our implementation revealed that our FastMPN model, which is based on the PyTorch platform, can train a large corpus (667,290 training samples) with 202,373 unique words in less than 3 minutes per epoch using one NVIDIA V100 hardware accelerator. Our experiments demonstrated that using this implementation, the clinical task performance scores of information extraction related to tumors from cancer pathology reports were highly competitive.

59 BASIC BIOLOGICAL SCIENCES↗

Development and Test of High Temperature Surface Acoustic Wave Gas Sensors

The demand for sensors in hostile environments, such as power plant environments, aerospace environments, oil and gas extraction, and high-temperature metallurgy environments, has risen over the past decades in a continuous attempt to increase process control, improve energy and process efficiency in production, reduce operational and maintenance costs, increase safety, and perform condition-based maintenance in equipment and structures operating in high-temperature harsh-environment conditions. The increased reliability, improved performance, and development of new sensors and networks with a multitude of components, especially wireless networks, are the target for operation in harsh environments. Gas sensors, in particular H2 sensors, operating above 200 C are required in the instrumentation, process control and general safety of a number of industries including coal, natural gas, and nuclear power generation facilities, the aerospace and automotive industries, metallurgical production and defense-related applications. The surface acoustic wave (SAW) platform is a particularly promising option for high-temperature, harsh-environment gas sensing applications since the platform exhibits advantages, such as battery-free and wireless operation, small size, possibility for scale production using well-developed technologies from the semiconductor industry, and low cost of installation and operation. In this work, one-port SAW resonators (SAWRs) operating along five different orientations on a commercially available langasite (LGS) wafer employing Pt-Al2O3 electrodes and reflectors were designed, fabricated, and used as high-temperature H2 sensors. Two of the selected orientations were predicted and confirmed to have temperature-compensated operation above 150 C. A gas sensor test setup was developed, capable of gas cycling between N2, O2 and N2/H2 mixtures under extended high-temperature periods (up to 650 C for over 20 hours). Thin film Pt-Al2O3 was used as the electrode material for the transducers and reflectors capable of high-temperature operation, and also as H2 sensing film. In addition, yttria-stabilized zirconia (YSZ) thin films with Pt decoration were tested as sensing films aimed to enhance the SAWR sensor response to H2. The SAW devices were monitored in excess of 1700 hours in real-time during gas cycling sequences up to 600 C, leading to the following findings: i) the Pt-Al2O3 electrodes performed better for H2 sensing than the Pt-decorated YSZ sensing film, showing as much as 50% higher frequency variation response in the 200 C to 400 C range; ii) different crystallographic orientations operating on the same LGS wafer experienced different responses to H2 exposures up to 500 C; iii) the surface oxidation state of the SAWR sensors was shown to have an important impact on subsequent H2 exposure responses. In addition, a sensor system employing two LGS SAWRs, aligned along two different orientations, has been developed to simultaneously determine H2 presence and temperature. Finally, wireless interrogation of a SAWR sensor was successful within the gas cycling test fixture, and successful wireless H2 detection was achieved above 400 C.

Ayes Moncada, Armando↗

Enhancing 2‐Pyrone Synthase Efficiency by High‐Throughput Mass‐Spectrometric Quantification and In Vitro/In Vivo Catalytic Performance Correlation

Abstract Engineering efficient biocatalysts is essential for metabolic engineering to produce valuable bioproducts from renewable resources. However, due to the complexity of cellular metabolic networks, it is challenging to translate success in vitro into high performance in cells. To meet such a challenge, an accurate and efficient quantification method is necessary to screen a large set of mutants from complex cell culture and a careful correlation between the catalysis parameters in vitro and performance in cells is required. In this study, we employed a mass‐spectrometry based high‐throughput quantitative method to screen new mutants of 2‐pyrone synthase (2PS) for triacetic acid lactone (TAL) biosynthesis through directed evolution in E. coli . From the process, we discovered two mutants with the highest improvement (46 fold) in titer and the fastest k cat (44 fold) over the wild type 2PS, respectively, among those reported in the literature. A careful examination of the correlation between intracellular substrate concentration, Michaelis‐Menten parameters and TAL titer for these two mutants reveals that a fast reaction rate under limiting intracellular substrate concentrations is important for in‐cell biocatalysis. Such properties can be tuned by protein engineering and synthetic biology to adopt these engineered proteins for the maximum activities in different intracellular environments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Image processing pipeline for AI-driven nanoparticle megalibrary characterization

Recent innovations have made it possible to produce megalibraries, millions of structurally and compositionally distinct nanoparticles on a chip. These megalibraries yield vast volumes of data that are impossible to analyze manually, necessitating the development of automated tools. In previous work, we created a binary classification machine learning model to select quality nanoparticle images for downstream analysis. In this work, we show that adding a custom image processing step before training can produce significantly higher-performing models in a fraction of the time and make them more robust to different image noise levels and microscope acquisition settings. The image processing pipeline proposed here effectively cleans raw nanoparticle images, enhances key features, and allows us to use much lower resolution images and simpler neural network model architectures. These features result in higher performance and significant cost savings. Experiments demonstrate superior performance relative to baseline, including an 18.2% improvement in recall and a 13.1% increase in accuracy. Given the high cost of downstream analysis, it is critical to minimize false positives, and our best-performing model reaches a precision of 95.9% and a weighted F-score of 95.1% on an unseen test set. Additionally, model training time is reduced from hours to less than a minute. We also show that, using this custom image processing pipeline, model performance is significantly improved at lower pixel resolutions compared to downsizing alone. We expect that adopting this pipeline for AI-driven automated nanoparticle characterization will allow researchers to rapidly and accurately analyze much greater volumes of data, thereby accelerating materials discovery.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Climatic clustering and longitudinal analysis with impacts on food, bioenergy, and pandemics

Predicted growth in world population will put unparalleled stress on the need for sustainable energy and global food production, as well as increase the likelihood of future pandemics. In this work, we identify high-resolution environmental zones in the context of a changing climate and predict longitudinal processes relevant to these challenges. We do this using exhaustive vector comparison methods that measure the climatic similarity between all locations on earth at high geospatial resolution relative to global-scale analyses. The results are captured as networks, in which edges between geolocations are defined if their historical climate similarities exceed a threshold. We apply Markov clustering and our novel Correlation of Correlations method to the resulting climatic networks, which provides unprecedented agglomerative and longitudinal views of climatic relationships across the globe. The methods performed here resulted in the fastest (9.37x10 18 operations/sec) and one of the largest (168.7x10 21 operations) scientific computations ever performed, with more than 100 quadrillion edges considered for a single climatic network. Our climatic analysis reveals areas of the world experiencing rapid environmental changes, which can have important implications for global carbon fluxes and zoonotic spillover events. Correlation and network analyses of this kind are widely applicable across computational and predictive biology domains, including systems biology, ecology, carbon cycles, biogeochemistry, and zoonosis research.

59 BASIC BIOLOGICAL SCIENCES↗

Ultra-Fast Non-Volatile Resistive Switching Devices with Over 512 Distinct and Stable Levels for Memory and Neuromorphic Computing

Low-current multilevel programmability with inherent non-volatility and high stability of resistance states is required for both multi-bit memory storage and deep learning accelerators but is difficult to achieve. Here, in a resistive switching system, this work realizes >512 (>9 bits) distinct non-volatile conductance levels with stable retention for each state with current levels down to the nanoampere range, highly promising for potential integration with small processing nodes with ultra-low power consumption requirements. This is achieved by demonstrating a new thin film design concept that encompasses three key features: an ultra-thin epitaxial oxygen ionic switching layer that provides a tunable energy barrier at the bottom electrode, an overcoat amorphous layer that acts as an ion migration barrier for stable state retention, and a partial conductive filament as a localized electronic transport channel to the epitaxial switching layer. A large dynamic resistance range of up to seven orders of magnitude is achieved with reset-free transitions among intermediate states, and programmability is demonstrated with ultra-fast (20 ns) pulses. Artificial neural network (ANN) simulations, based on the experimental performance and its non-idealities, demonstrate close-to-ideal inference accuracies for various Modified National Institute of Standards and Technology (MNIST) data sets.

36 MATERIALS SCIENCE↗

Comparison of TCeMA and TDMA for Inter-Satellite Communications using OPNET Simulation

A robust data link protocol, enabling unique physical and MAC layer technologies and sub-network level protocols, is needed in order to take advantage of the full potential of using both TDMA and CDMA in a satellite communication network. A novel MAC layer protocol, TDMA with CDMA-encoding multiple access (TCeMA) integrated with null-steered digital beam-forming spatial multiplexing, is investigated to support flexible spacecraft communications. Abstract models of the TCeMA and TDMA processes are developed in OPNFiT and a comparison of the performances of TCeMA and TDMA in a satellite network simulation are made. TCeMA provides the better connectivity and capacity with respect to TDMA for satellite communication traffic.

Hain, Regina Rosales↗

Structure-performance relationships in lignin-based transesterification vitrimers: The role of lignin structural features

Lignin has been hailed as an ideal renewable alternative for petrochemical-based prepolymers in material synthesis for a sustainable and circular economy, due to its abundant aromatic network and high carbon content. However, the properties and performance of lignin-derived macromolecules are strongly influenced by the lignin itself. While numerous studies have explored the impact of lignin content on the thermomechanical performance of lignin-based vitrimers, literature on how the inherent structural features of lignin affect these properties is scanty. In this study, hardwood organosolv lignin was fractionated in ethyl acetate, ethanol, and acetone to obtain lignin fractions with varying structural characteristics. These fractions were then modified through carboxylation and crosslinked with epoxidized soybean oil (ESO) at a hydroxyl to epoxy group ratio of 1:1 to produce lignin-based transesterification vitrimers (LVs). The thermal properties (i.e. glass transition temperature and thermal stability), tensile strength, storage modulus, and stress relaxation behavior of the LVs were studied and carefully related to the structural features of lignin. The results revealed a positive relationship between strong hydroxyl content in modified lignin and the tensile strength (5.10–9.71 MPa), storage modulus (1099.4 – 1372.8 MPa), crosslinking density, and stress relaxation of the LVs. Additionally, both the storage modulus and tensile strength exhibited a positive relationship with the ratio of rigid linkages in modified lignin, while lignin molecular weight was found to significantly impact the thermal properties of LVs (i.e Tg and thermal stability). This study not only highlights the valorization of lignin in vitrimer synthesis but also provide insights for designing lignin-based materials with tailored properties for specific applications.

Bio-based polymer↗