Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “layered networks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,279 records · Page 71

Objectively Identifying Transverse Cirrus Bands in Tropical Cyclones using a Convolutional Neural Network

Transverse cirrus bands (TCBs) are bands of upper-level clouds that are regularly seen in mesoscale and synoptic-scale weather systems. In tropical cyclones, their appearance has been subjectively linked to intensification and the diurnal cycle, but these hypothesized relationships have not been rigorously tested due to the difficulty of objectively identifying TCBs in satellite images. This presentation describes a machine learning technique that successfully identifies TCBs in imagery from the GOES-16 Advanced Baseline Imager. The technique uses a convolutional neural network (CNN) that assigns a probability of each pixel in the image being associated with a TCB. Using the CNN, a database of TCBs from 2018 to 2022 was developed for the Atlantic basin. Statistics using this database will be presented, including the relationship between TCBs and deep-layer vertical wind shear, intensity change, and the TC diurnal cycle.

John Mark Mayhall↗

Enhancing Unknown Waveform Detection by Learning Intra and Inter-domain Dependencies with Advanced Attention Fusion Mechanisms

Detection of unknown waveforms in mission-critical communications is a crucial area of interest for the Department of Energy (DoE). Traditional methods and recent deep learning-based approaches often assume that the training set includes all possible classes, which is impractical for detecting new waveforms. This limitation gives rise to the problem of open-set recognition (OSR), which involves correctly identifying known classes while detecting and rejecting unknown or unseen classes. To address this limitation, we propose a novel dual-domain complex-valued neural architecture that jointly processes time-domain and frequency-domain signal representations using transformer mechanisms. A transformer model is a deep learning architecture that uses self-attention mechanisms to process and learn relationships in sequential data. Our model employs a cosine similarity loss to extract domain-specific features and incorporates a transformer architecture in the latent space to weigh the importance of different features from the time and frequency domains. The transformer layer includes stacked self-attention and cross-attention modules to learn intra-domain and inter-domain dependencies, creating a more holistic signal representation. An attention-based fusion module intelligently combines the time and frequency-domain features using multi-head attention, enabling the network to learn the optimal feature for each domain in each input signal. Quantitative results demonstrate the impact of these architectural choices on overall performance, showing significant improvement after incorporating self and cross-attention modules and using complex attention fusion over simple weighted fusion. Our ongoing work will focus on addressing the limitations of threshold-based OSR methods by developing a novel generative framework that integrates a conditional diffusion probabilistic model (DPM). DPM is a generative framework that learns to synthesize complex data by reversing a gradual noising process using a neural network trained to denoise step-by-step. Our goal is to leverage the inherent strengths of DPMs for identifying unknown signals more robustly. One primary advantage of using a DPM is its ability to provide a more reliable anomaly score based on the model's reconstruction error, rather than relying solely on classifier confidence. Additionally, the iterative denoising process of DPMs makes this approach naturally resilient to low Signal-to-Noise Ratio (SNR) conditions, where traditional methods often fail. By implementing this generative framework, we aim to enhance the model's capability to accurately detect unknown waveforms and maintain performance in challenging environments.

99 - GENERAL AND MISCELLANEOUS↗

Disruption of Commercial Solar Inverter System by TLS Proxy Man-in-the-Middle Attack

Transport Layer Security (TLS) is a cryptographic protocol that encrypts communication data, providing end-to-end communication encryption and authentication. Currently, TLS is widely adopted for securing communication between servers and end devices, including solar inverter systems. Therefore, users/operators can securely access the solar inverters through a web user interface (WebUI) application programmable interface (API) on a PC or server over TLS-enabled Wi-Fi or Ethernet. However, the security of the TLS-based network becomes compromised if it is breached by a TLS proxy man-in-the-middle (MITM) exploit. This report explores potential vulnerabilities in a commercial solar inverter system that leverages a TLS proxy MITM and discusses the impacts through assume-breached penetration testing. Furthermore, the paper explores recommended mitigation methods against the TLS proxy MITM exploit in solar inverters.

97 MATHEMATICS AND COMPUTING↗

Peak Prediction Using Multi Layer Perceptron (MLP) for Edge Computing ASICs Targeting Scientific Applications

High data rate detectors play an integral part in scientific research and their development is actively pursued at High Energy Physics (HEP) facilities around the world. Edge Machine Learning (ML) offers the ability to reduce data rates by integrating ML algorithms into Application Specific Integrated Circuits (ASICs) on the front end electronics. In this work, we explore a set of neural network architectures for predicting the peak amplitudes in the detector's sensor response. We have designed and synthesized several MLP based neural networks comparing their inference accuracy, power consumption, and area targeting for minimal latency. The neural networks are synthesized in a commercial 65nm process. The effect of quantizing the network's weights and biases on hardware performance and area is reported. We also conduct design space exploration to compare between design alternatives

47 OTHER INSTRUMENTATION↗

Adaptive Data-Driven Model Predictive Control for Heat Pipe Microreactors

To establish a technical basis for self-regulating microreactors, a model predictive control (MPC) system is investigated to proactively respond to anomalies and disturbances in anticipation of potential deviations from operating setpoints. Due to the difficulty of developing a physics-based surrogate model that can accurately match plant data in various operating conditions, machine learning algorithms are used in MPC, which allow for learning from both simulation and operation data, thus efficiently describing the targeted transient with arbitrary accuracy. However, one of the biggest concerns in applying ML algorithms like artificial neural networks (ANNs) is that the predictive capabilities of ANN are limited by training data. If there are gaps between the training and target domain, the accuracy of an ANN can degrade significantly when it is used to predict unseen data. To improve the predictive capability of ANN and enable a confident use of data-driven MPCs outside the training data, this study proposes an adaptive data-driven MPC framework. The system will monitor the discrepancy between plant responses and surrogate predictions, fine-tune the ANN-based surrogate when a large discrepancy is detected, and continue MPC operation with updated surrogates. The framework is demonstrated on a point kinetic model for microreactors. The hyperparameters of the update strategy, including layers to update, error thresholds, learning rate discount, and number of data points used for fine-tuning, are optimized so the simulated microreactor is able to follow changes in setpoint with the smallest of deviations.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Adaptable Data Driven Model Predictive Control for Heat Pipe Microreactors

To establish a technical basis for self-regulating microreactors, a model predictive control (MPC) system is investigated to proactively respond to anomalies and disturbances in anticipation of potential deviations from operating setpoints. Due to the difficulty of developing a physics-based surrogate model that can accurately match plant data in various operating conditions, machine learning algorithms are used in MPC, which allow for learning from both simulation and operation data, thus efficiently describing the targeted transient with arbitrary accuracy. However, one of the biggest concerns in applying ML algorithms like artificial neural networks (ANNs) is that the predictive capabilities of ANN are limited by training data. If there are gaps between the training and target domain, the accuracy of an ANN can degrade significantly when it is used to predict unseen data. To improve the predictive capability of ANN and enable a confident use of data-driven MPCs outside the training data, this study proposes an adaptive data-driven MPC framework. The system will monitor the discrepancy between plant responses and surrogate predictions, fine-tune the ANN-based surrogate when a large discrepancy is detected, and continue MPC operation with updated surrogates. The framework is demonstrated on a point kinetic model for microreactors. The hyperparameters of the update strategy, including layers to update, error thresholds, learning rate discount, and number of data points used for fine-tuning, are optimized so the simulated microreactor is able to follow changes in setpoint with the smallest of deviations.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Compact Ferroelectric Programmable Majority Gate for Compute-in-Memory Applications

In this study, a compact and novel ferroelectric (FE) programmable majority gate is proposed and its novel application in Binary Neural Network (BNNs) is investigated. We demonstrate: i) by integrating N metal-ferroelectric-metal (MFM) capacitors on the gate of a transistor (1T-N-MFM structure), a nonvolatile and programmable majority (MAJ) gate that performs MAJ of AND between the gate input and polarization is realized; ii) validation the functionality of our 3-input MAJ of AND gate through comprehensive theoretical and experimental investigations; iii) a compact implementation of 3-input MAJ of XNOR gate that leverages only five of our 3-input MAJ of AND gates connected in parallel; iv) application of MAJ of XNOR gates to replace the XNOR gates and the first layer of the adder tree in the BNNs for up to 21x area saving on top of eliminating the energy-hungry memory accesses due to the compute-in-memory nature.

97 MATHEMATICS AND COMPUTING↗

Mode connectivity in the loss landscape of parameterized quantum circuits

Variational training of parameterized quantum circuits (PQCs) underpins many workflows employed on near-term noisy intermediate scale quantum (NISQ) devices. It is a hybrid quantum-classical approach that minimizes an associated cost function in order to train a parameterized ansatz. In this work we adapt the qualitative loss landscape characterization for neural networks introduced in Goodfellow et al. (2014); Li et al. (2017) and tests for connectivity used in Draxler et al. (2018) to study the loss landscape features in PQC training. We present results for PQCs trained on a simple regression task, using the bilayer circuit ansatz, which consists of alternating layers of parameterized rotation gates and entangling gates. Multiple circuits are trained with 3 different batch gradient optimizers: stochastic gradient descent, the quantum natural gradient, and Adam. We identify large features in the landscape that can lead to faster convergence in training workflows.

97 MATHEMATICS AND COMPUTING↗

Measurement of hybrid rocket solid fuel regression rate for a slab burner using deep learning

This study presents an imaging-based deep learning tool to measure the fuel regression rate in a 2D slab burner experiment for hybrid rocket fuels. The slab burner experiment is designed to verify mechanistic models of reacting boundary layer combustion in hybrid rockets by the measurement of fuel regression rates. A DSLR camera with a high intensity flash is used to capture images throughout the burn and the images are then used to find the fuel boundary to calculate the regression rate. A U-net convolutional neural network architecture is explored to segment the fuel from the experimental images. Here, a Monte-Carlo Dropout process is used to quantify the regression rate uncertainty produced from the network. The U-net computed regression rates are compared with values from other techniques from literature and show error less than 10%. An oxidizer flux dependency study is performed and shows the U-net predictions of regression rates are accurate and independent of the oxidizer flux, when the images in the training set are not over-saturated. Training with monochrome images is explored and is not successful at predicting the fuel regression rate from images with high noise. The network is superior at filtering out noise introduced by soot, pitting, and wax deposition on the chamber glass as well as the flame when compared to traditional image processing techniques, such as threshold binary conversion and spatial filtering. U-net consistently provides low error image segmentations to allow accurate computation of the regression rate of the fuel.

42 ENGINEERING↗

Climatology of the Vertical Profiles of Polarimetric Radar Variables and Retrieved Microphysical Parameters in Continental/Tropical MCSs and Landfalling Hurricanes

Most existing cloud models tend to overestimate the size of cloud ice particles and underestimate their concentration. This emphasizes the need to provide a reliable observational reference to optimize cloud model performance, particularly in areas of high concentration of ice at high altitudes. The dual-polarization radars give the community a unique opportunity to quantify cloud ice with a good accuracy using polarimetric radar retrievals. Here, in this study, we utilize the network of operational WSR-88D radars to build a climatology of the vertical profiles of radar variables, such as radar reflectivity Z, differential reflectivity Z DR , and specific differential phase K DP as well as the radar-retrieved vertical profiles of ice water content (IWC) above the melting layer and liquid water content below it, mean volume diameter D m , and total number concentration N t of ice and liquid particles. Such climatology was created for continental/marine mesoscale convective systems (MCSs) and tropical cyclones including hurricanes. The dataset includes 13 continental MCSs, 10 marine MCSs, and 11 tropical cyclones. Separate statistics of the “background” vertical profiles and the ones associated with high IWC aloft have been obtained in the course of this study. It is shown that continental MCSs exhibit larger size of ice in lower concentration aloft compared to the marine MCSs and especially tropical cyclones/hurricanes. A combination of high KDP and low Z aloft signifies lower D m , higher N t , and often substantial IWC.

54 ENVIRONMENTAL SCIENCES↗

Learning local equivariant representations for large-scale atomistic dynamics

Abstract A simultaneously accurate and computationally efficient parametrization of the potential energy surface of molecules and materials is a long-standing goal in the natural sciences. While atom-centered message passing neural networks (MPNNs) have shown remarkable accuracy, their information propagation has limited the accessible length-scales. Local methods, conversely, scale to large simulations but have suffered from inferior accuracy. This work introduces Allegro, a strictly local equivariant deep neural network interatomic potential architecture that simultaneously exhibits excellent accuracy and scalability. Allegro represents a many-body potential using iterated tensor products of learned equivariant representations without atom-centered message passing. Allegro obtains improvements over state-of-the-art methods on QM9 and revMD17. A single tensor product layer outperforms existing deep MPNNs and transformers on QM9. Furthermore, Allegro displays remarkable generalization to out-of-distribution data. Molecular simulations using Allegro recover structural and kinetic properties of an amorphous electrolyte in excellent agreement with ab-initio simulations. Finally, we demonstrate parallelization with a simulation of 100 million atoms.

74 ATOMIC AND MOLECULAR PHYSICS↗

Learning the structure of wind: A data-driven nonlocal turbulence model for the atmospheric boundary layer

In this work, we develop a novel data-driven approach to modeling the atmospheric boundary layer. This approach leads to a nonlocal, anisotropic synthetic turbulence model which we refer to as the deep rapid distortion (DRD) model. Our approach relies on an operator regression problem that characterizes the best fitting candidate in a general family of nonlocal covariance kernels parameterized in part by a neural network. This family of covariance kernels is expressed in Fourier space and is obtained from approximate solutions to the Navier–Stokes equations at very high Reynolds numbers. Each member of the family incorporates important physical properties such as mass conservation and a realistic energy cascade. The DRD model can be calibrated with noisy data from field experiments. After calibration, the model can be used to generate synthetic turbulent velocity fields. To this end, we provide a new numerical method based on domain decomposition which delivers scalable, memory-efficient turbulence generation with the DRD model as well as others. We demonstrate the robustness of our approach with both filtered and noisy data coming from the 1968 Air Force Cambridge Research Laboratory Kansas experiments. Using these data, we witness exceptional accuracy with the DRD model, especially when compared to the International Electrotechnical Commission standard.

17 WIND ENERGY↗

An Accuracy Assessment of the CALIOP/CALIPSO Version 2/Version 3 Daytime Aerosol Extinction Product Based on a Detailed Multi-Sensor, Multi-Platform Case Study

The Cloud Aerosol LIdar with Orthogonal Polarization (CALIOP), on board the CALIPSO platform, has measured profiles of total attenuated backscatter coefficient (level 1 products) since June 2006. CALIOP s level 2 products, such as the aerosol backscatter and extinction coefficient profiles, are retrieved using a complex succession of automated algorithms. The goal of this study is to help identify potential shortcomings in the CALIOP version 2 level 2 aerosol extinction product and to illustrate some of the motivation for the changes that have been introduced in the next version of CALIOP data (version 3, released in June 2010). To help illustrate the potential factors contributing to the uncertainty of the CALIOP aerosol extinction retrieval, we focus on a one-day, multi-instrument, multiplatform comparison study during the CALIPSO and Twilight Zone (CATZ) validation campaign on 4 August 2007. On that day, we observe a consistency in the Aerosol Optical Depth (AOD) values recorded by four different instruments (i.e. spaceborne MODerate Imaging Spectroradiometer, MODIS: 0.67 and POLarization and Directionality of Earth s Reflectances, POLDER: 0.58, airborne High Spectral Resolution Lidar, HSRL: 0.52 and ground-based AErosol RObotic NETwork, AERONET: 0.48 to 0.73) while CALIOP AOD is a factor of two lower (0.32 at 532 nm). This case study illustrates the following potential sources of uncertainty in the CALIOP AOD: (i) CALIOP s low signal-to-noise ratio (SNR) leading to the misclassification and/or lack of aerosol layer identification, especially close to the Earth s surface; (ii) the cloud contamination of CALIOP version 2 aerosol backscatter and extinction profiles; (iii) potentially erroneous assumptions of the aerosol extinction-to-backscatter ratio (Sa) used in CALIOP s extinction retrievals; and (iv) calibration coefficient biases in the CALIOP daytime attenuated backscatter coefficient profiles. The use of version 3 CALIOP extinction retrieval for our case study seems to partially fix factor (i) although the aerosol retrieved by CALIOP is still somewhat lower than the profile measured by HSRL; the cloud contamination (ii) appears to be corrected; no particular change is apparent in the observation-based CALIOP Sa value (iii). Our case study also showed very little difference in version 2 and version 3 CALIOP attenuated backscatter coefficient profiles, illustrating a minor change in the calibration scheme (iv).

Kacenelenbogen, M.↗

High-Thermal-Conductivity Fabrics

Heat management with common textiles such as nylon and spandex is hindered by the poor thermal conductivity from the skin surface to cooling surfaces. This innovation showed marked improvement in thermal conductivity of the individual fibers and tubing, as well as components assembled from them. The problem is centered on improving the heat removal of the liquid-cooled ventilation garments (LCVGs) used by astronauts. The current design uses an extensive network of water-cooling tubes that introduces bulkiness and discomfort, and increases fatigue. Range of motion and ease of movement are affected as well. The current technology is the same as developed during the Apollo program of the 1960s. Tubing material is hand-threaded through a spandex/nylon mesh layer, in a series of loops throughout the torso and limbs such that there is close, form-fitting contact with the user. Usually, there is a nylon liner layer to improve comfort. Circulating water is chilled by an external heat exchanger (sublimator). The purpose of this innovation is to produce new LCVG components with improved thermal conductivity. This was addressed using nanocomposite engineering incorporating high-thermalconductivity nanoscale fillers in the fabric and tubing components. Specifically, carbon nanotubes were added using normal processing methods such as thermoplastic melt mixing (compounding twin screw extruder) and downstream processing (fiber spinning, tubing extrusion). Fibers were produced as yarns and woven into fabric cloths. The application of isotropic nanofillers can be modeled using a modified Nielsen Model for conductive fillers in a matrix based on Einstein s viscosity model. This is a drop-in technology with no additional equipment needed. The loading is limited by the ability to maintain adequate dispersion. Undispersed materials will plug filtering screens in processing equipment. Generally, the viscosity increases were acceptable, and allowed the filled polymers to still be processed.The novel feature is that fabrics do not inherently possess good thermal conductivity. In fact, fabrics are used for thermal insulation, not heat removal. The technology represents the first material that is a wearable fabric, based on company textiles and materials that will significantly conduct heat.

Chibante, L. P. Felipe↗

Zwitterionic Photocurable Resin for High‐Resolution 3D Printing of Ultralow‐Fouling Microstructures

High‐resolution 3D printing technologies are enabling a new generation of microstructured materials for applications where biocompatibility is critical. However, most conventional 3D‐printable resins yield materials that exhibit trade‐offs between antifouling properties and mechanical robustness, limiting their applicability in living systems. In nature, zwitterionic surface groups form tightly bound hydration layers that act as effective barriers against protein and cell attachment. Inspired by this strategy, a zwitterionic acrylamide‐based photoresist—carboxybetaine di‐methacrylamide (CBDA)—is developed for projection‐based vat photopolymerization, enabling the fabrication of complex microarchitectures with exceptional antifouling properties. The bifunctional monomer allows the formation of dense, cross‐linked networks that resist swelling while maintaining a high density of zwitterionic groups. Printed structures exhibit strong resistance to protein and cell adhesion, as confirmed by porcine blood assays, alongside robust mechanical performance. As a demonstration, a tubular structure featuring a negative Poisson's ratio lattice is printed to showcase structural fidelity and versatility. This resin formulation offers a broadly applicable strategy for fabricating microscale devices and surfaces where antifouling performance and structural integrity are both essential—spanning biomedical interfaces, soft robotics, and beyond.

3D printing↗

Crust Composition and the Shallow Heat Source in KS 1731–260

The presence of a strong shallow heat source of unknown origin in accreting neutron star crusts has been inferred by analyzing x-ray observations of their cooling in quiescence. Here, we model the cooling of KS 1731–260 using realistic crust compositions and nuclear heating and cooling sources from detailed nuclear reaction network calculations. We find that the required strength of the shallow heat source in KS 1731–260 is reduced by more than a factor of 3 compared to previous analysis, a 5⁢𝜎 difference that alleviates the need for exotic solutions. Our analysis also suggests the existence of an impure nuclear pasta layer in the inner crust of KS 1731–260, though future observations will provide more stringent constraints. In addition, we obtain constraints on the dominant surface burning modes of KS 1731–260 over its history.

neutron star cooling↗

Vegetation classification map and covariates associated with NEON AOP survey, East River, CO 2018

This package includes geospatial data layers developed to investigate how environmental gradients—specifically topography and near-surface soil properties—drive the spatial arrangement of dominant plant communities in mountainous watersheds. The geospatial products, which support the analysis of these ecological relationships, are derived from airborne hyperspectral and LiDAR datasets acquired by the National Ecological Observatory Network (NEON) Airborne Observation Platform (AOP), in conjunction with an extensive ground field campaign conducted in summer 2018. This work is part of the DOE Watershed Function Science Focus Area (SFA) and features geospatial datasets developed based on observations and ground data collected at East River, Colorado, in collaboration with the National Ecological Observatory Network (NEON) Airborne Observation Platform (AOP) survey in June 2018. Classification Map: - Classification Map (PNG, GeoTIFF): Derived from hyperspectral and LiDAR airborne data using a machine learning approach. - Class Code Mapper (CSV): Associates pixel values with corresponding vegetation/non-vegetation classes. - Classification Reference Data (CSV): Reference data used in the machine learning procedure. LiDAR-Derived Products: - Topographical Metrics (GeoTIFFs): Elevation, slope, curvature, TWI, TPI, solar insolation, and canopy height model (CHM), smoothed with a 5x5 pixel window. Vegetation Indices: - GeoTIFFs of NDVI, NDNI, NDWI: Vegetation indices derived from hyperspectral data. Urban Masks: - Urban Mask (GeoTIFF): Applied to the mapping to convert bare soil classes to urban classes. Software Compatibility: GeoTIFFs: Can be visualized with GIS software or libraries that support GeoTIFF images. CSV Files: Can be opened with any software that handles comma-separated values. The FLMD file provides details and links to the source datasets used to derive the products. The manuscript (in the Method session) provides details on how each product was derived. This work was supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231. Update on 2026-03-25: Since the original dataset publication date of 02/28/2020, this package has a new classification map derived by an improved methodology. This update also includes additional ground data that improved the representation of some of the communities. See the methods for further details on what has changed between versions.

2018 NEON and 2025 CHESS Campaigns↗

A synoptic-scale overview of the TOGA COARE intensive observing period November 1992 to February 1993 based on analyses from US operational global data assimilation systems

The operational global analyses from the two major U.S. numerical weather prediction centers, the Navy's Fleet Numerical Oceanography Center and the National Meteorological Center, are used to describe the synoptic-scale features of the 1 Nov. 1992 to 28 Feb. 1993 TOGA COARE intensive observing period (IOP). TOGA COARE is an international field experiment in which a large number of research scientists from the Goddard Laboratory for Atmospheres (Code 910) and the Laboratory for Hydrospheres (Code 970) participated. Two high-amplitude intraseasonal (30-60 day) oscillations passed through the TOGA COARE observational network located in the equatorial western Pacific. Associated with the oscillations were two 6-10 day periods of persistent westerly surface winds at the equator or 'westerly wind bursts.' These events are depicted through time series and time-longitude cross sections of divergence/velocity potential, surface winds, precipitation, ocean mixed-layer depth, and sea surface temperature. The high and low frequency components of the flow in which the intraseasonal oscillations were embedded are shown using seasonal, monthly, and 5-day averages of the surface, 850 and 200 mb winds, precipitation, and sea-level pressure, and a time-longitude cross section of tropical cyclone activity. Independent verification of precipitation comes from near real-time satellite estimates, and a reference climatology is given based on 9 years of ECMWF analyses. Daily 00 UTC analyses of surface winds and sea-level pressure for the entire western Pacific and Indian Ocean are provided to trace the evolution of individual synoptic events.

Fiorino, M.↗