Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Network convergence”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Hutchinson Trace Estimation for high-dimensional and high-order Physics-Informed Neural Networks

Physics-Informed Neural Networks (PINNs) have proven effective in solving partial differential equations (PDEs), especially when some data are available by seamlessly blending data and physics. However, extending PINNs to high-dimensional and even high-order PDEs encounters significant challenges due to the computational cost associated with automatic differentiation in the residual loss function calculation. Herein, we address the limitations of PINNs in handling high-dimensional and high-order PDEs by introducing the Hutchinson Trace Estimation (HTE) method. Starting with the second-order high-dimensional PDEs, which are ubiquitous in scientific computing, HTE is applied to transform the calculation of the entire Hessian matrix into a Hessian vector product (HVP). This approach not only alleviates the computational bottleneck via Taylor-mode automatic differentiation but also significantly reduces memory consumption from the Hessian matrix to an HVP’s scalar output. We further showcase HTE’s convergence to the original PINN loss and its unbiased behavior under specific conditions. Comparisons with the Stochastic Dimension Gradient Descent (SDGD) highlight the distinct advantages of HTE, particularly in scenarios with significant variability and variance among dimensions. We further extend the application of HTE to higher-order and higher-dimensional PDEs, specifically addressing the biharmonic equation. By employing tensor-vector products (TVP), HTE efficiently computes the colossal tensor associated with the fourth-order high-dimensional biharmonic equation, saving memory and enabling rapid computation. The effectiveness of HTE is illustrated through experimental setups, demonstrating comparable convergence rates with SDGD under memory and speed constraints. Additionally, HTE proves valuable in accelerating the Gradient-Enhanced PINN (gPINN) version as well as the Biharmonic equation. Overall, HTE opens up a new capability in scientific machine learning for tackling high-order and high-dimensional PDEs.

Curse of dimensionality↗

A Novel Deep Reinforcement Learning Approach to Traffic Signal Control with Connected Vehicles

The advent of connected vehicle (CV) technology offers new possibilities for a revolution in future transportation systems. With the availability of real-time traffic data from CVs, it is possible to more effectively optimize traffic signals to reduce congestion, increase fuel efficiency, and enhance road safety. The success of CV-based signal control depends on an accurate and computationally efficient model that accounts for the stochastic and nonlinear nature of the traffic flow. Without the necessity of prior knowledge of the traffic system’s model architecture, reinforcement learning (RL) is a promising tool to acquire the control policy through observing the transition of the traffic states. In this paper, we propose a novel data-driven traffic signal control method that leverages the latest in deep learning and reinforcement learning techniques. By incorporating a compressed representation of the traffic states, the proposed method overcomes the limitations of the existing methods in defining the action space to include more practical and flexible signal phases. The simulation results demonstrate the convergence and robust performance of the proposed method against several existing benchmark methods in terms of average vehicle speeds, queue length, wait time, and traffic density.

42 ENGINEERING↗

Operationalizing “Wickedness” as Analytical and Creative Tools to Transform Aviation

As the world grows increasingly networked and complex, so do challenges faced by aviation and technology professionals (e.g., fighting wildfires and increasing access to healthcare). There is a need to develop new methods to tackle complex socio-technical problems relevant to aviation. The concept of “wicked” problems offers new methods and perspectives for framing complex challenges. In this paper, we present two modes of operationalizing “wickedness” used by NASA’s Convergent Aeronautics Solutions (CAS) Project to develop transformative innovations in aviation: as an analytical, evaluative tool and a creative, generative tool. Through project examples, we demonstrate that using wickedness as a creative tool during the design process enables rich problem exploration with diverse stakeholders and reflection on how a problem is formulated, while usage as an analytical tool can provide criteria for project selection if internal agreement on the definitions of such criteria is established. Operationalizing wickedness as a creative tool may also enable organizational development of a generative mindset to better adapt to our rapidly changing future.

Robyn C Richmond↗

Operationalizing “Wickedness” as Analytical and Creative Tools to Transform Aviation

As the world grows increasingly networked and complex, so do challenges faced by aviation and technology professionals (e.g., fighting wildfires and increasing access to healthcare). There is a need to develop new methods to tackle complex socio-technical problems relevant to aviation. The concept of “wicked” problems offers new methods and perspectives for framing complex challenges. In this paper, we present two modes of operationalizing “wickedness” used by NASA’s Convergent Aeronautics Solutions (CAS) Project to develop transformative innovations in aviation: as an analytical, evaluative tool and a creative, generative tool. Through project examples, we demonstrate that using wickedness as a creative tool during the design process enables rich problem exploration with diverse stakeholders and reflection on how a problem is formulated, while usage as an analytical tool can provide criteria for project selection if internal agreement on the definitions of such criteria is established. Operationalizing wickedness as a creative tool may also enable organizational development of a generative mindset to better adapt to our rapidly changing future.

Robyn Richmond↗

Efficient and choreographed quality-of- service management in dense 6G verticals with high-speed mobility requirements

Future 6G networks are envisioned to support very heterogeneous and extreme applications (known as verticals). Some examples are further-enhanced mobile broadband communications, where bitrates could go above one terabit per second, or extremely reliable and low-latency communications, whose end-to-end delay must be below one hundred microseconds. To achieve that ultra-high Quality-of-Service, 6G networks are commonly provided with redundant resources and intelligent management mechanisms to ensure that all devices get the expected performance. But this approach is not feasible or scalable for all verticals. Specifically, in 6G scenarios, mobile devices are expected to have speeds greater than 500 kilometers per hour, and device density will exceed ten million devices per square kilometer. In those verticals, resources cannot be redundant as, because of such a huge number of devices, Quality-of-Service requirements are pushing the effective performance of technologies at physical level. And, on the other hand, high-speed mobility prevents intelligent mechanisms to be useful, as devices move around and evolve faster than the usual convergence time of those intelligent solutions. New technologies are needed to fill this unexplored gap. Therefore, in this paper we propose a choreographed Quality-of-Service management solution, where 6G base stations predict the evolution of verticals at real-time, and run a lightweight distributed optimization algorithm in advance, so they can manage the resource consumption and ensure all devices get the required Quality-of-Service. Prediction mechanism includes mobility models (Markov, Bayesian, etc.) and models for time-variant communication channels. Besides, a traffic prediction solution is also considered to explore the achieved Quality-of-Service in advance. The optimization algorithm calculates an efficient resource distribution according to the predicted future vertical situation, so devices achieve the expected Quality-of-Service according to the proposed traffic models. An experimental validation based on simulation tools is also provided. Results show that the proposed approach reduces up to 12% of the network resource consumption for a given Quality-of-Service.

42 ENGINEERING↗

Tree tensor network hierarchical equations of motion based on time-dependent variational principle for efficient open quantum dynamics in structured thermal environments

In this work, we introduce an efficient method, TTN-HEOM, for exactly calculating the open quantum dynamics for driven quantum systems interacting with highly structured bosonic baths by combining the tree tensor network (TTN) decomposition scheme with the bexcitonic generalization of the numerically exact hierarchical equations of motion (HEOM). The method yields a series of quantum master equations for all core tensors in the TTN that efficiently and accurately capture the open quantum dynamics for non-Markovian environments to all orders in the system–bath interaction. These master equations are constructed based on the time-dependent Dirac–Frenkel variational principle, which isolates the optimal dynamics for the core tensors given the TTN ansatz. The dynamics converges to the HEOM when increasing the rank of the core tensors, a limit in which the TTN ansatz becomes exact. We introduce TENSO, tensor equations for non-Markovian structured open systems, as a general-purpose Python code to propagate the TTN-HEOM dynamics. We implement three general propagators for the coupled master equations: two fixed-rank methods that require a constant memory footprint during the dynamics and one adaptive-rank method with a variable memory footprint controlled by the target level of computational error. We exemplify the utility of these methods by simulating a two-level system coupled to a structured bath containing one Drude–Lorentz component and eight Brownian oscillators, which is beyond what can presently be computed using the standard HEOM. Our results show that the TTN-HEOM is capable of simulating both dephasing and relaxation dynamics of driven quantum systems interacting with structured baths, even those of chemical complexity, with an affordable computational cost.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Data analysis and model simulation of the initiation of convection on April 24, 1982

A combined modelling and data analysis is used to examine the initiation and development of a hail-producing mesoscale convective system which developed over the Texas panhandle near Amarillo, Texas, on April 24, 1982, and propagated east into Oklahoma. This event occurred during the NASA AVE-VAS IV experiment, as a dense upper air mesoscale network was collecting data at three-hour intervals. The results show that both synoptic and mesoscale processes separately and in concert help to force the convection. The destabilization of the atmosphere due to cold advection is important in removing any cap to deep convective development. The upper level moistening due to flow from the northwest also helps to increase the convective instability of the atmosphere. The mesoscale convergence due to cloud shading appears dominant over that of topography, but the latter cannot be ignored, especially in its sustained effect. The developing mesoscale circulation also appears to tap a surface supply of moisture feeding the convection.

Mcnider, R. T.↗

Flight Results of the NF-15B Intelligent Flight Control System (IFCS) Aircraft with Adaptation to a Longitudinally Destabilized Plant

Adaptive flight control systems have the potential to be resilient to extreme changes in airplane behavior. Extreme changes could be a result of a system failure or of damage to the airplane. The goal for the adaptive system is to provide an increase in survivability in the event that these extreme changes occur. A direct adaptive neural-network-based flight control system was developed for the National Aeronautics and Space Administration NF-15B Intelligent Flight Control System airplane. The adaptive element was incorporated into a dynamic inversion controller with explicit reference model-following. As a test the system was subjected to an abrupt change in plant stability simulating a destabilizing failure. Flight evaluations were performed with and without neural network adaptation. The results of these flight tests are presented. Comparison with simulation predictions and analysis of the performance of the adaptation system are discussed. The performance of the adaptation system is assessed in terms of its ability to stabilize the vehicle and reestablish good onboard reference model-following. Flight evaluation with the simulated destabilizing failure and adaptation engaged showed improvement in the vehicle stability margins. The convergent properties of this initial system warrant additional improvement since continued maneuvering caused continued adaptation change. Compared to the non-adaptive system the adaptive system provided better closed-loop behavior with improved matching of the onboard reference model. A detailed discussion of the flight results is presented.

Bosworth, John T.↗

Stochastic machine learning via sigma profiles to build a digital chemical space

This work establishes a different paradigm on digital molecular spaces and their efficient navigation by exploiting sigma profiles. To do so, the remarkable capability of Gaussian processes (GPs), a type of stochastic machine learning model, to correlate and predict physicochemical properties from sigma profiles is demonstrated, outperforming state-of-the-art neural networks previously published. The amount of chemical information encoded in sigma profiles eases the learning burden of machine learning models, permitting the training of GPs on small datasets which, due to their negligible computational cost and ease of implementation, are ideal models to be combined with optimization tools such as gradient search or Bayesian optimization (BO). Gradient search is used to efficiently navigate the sigma profile digital space, quickly converging to local extrema of target physicochemical properties. While this requires the availability of pretrained GP models on existing datasets, such limitations are eliminated with the implementation of BO, which can find global extrema with a limited number of iterations. A remarkable example of this is that of BO toward boiling temperature optimization. Holding no knowledge of chemistry except for the sigma profile and boiling temperature of carbon monoxide (the worst possible initial guess), BO finds the global maximum of the available boiling temperature dataset (over 1,000 molecules encompassing more than 40 families of organic and inorganic compounds) in just 15 iterations (i.e., 15 property measurements), cementing sigma profiles as a powerful digital chemical space for molecular optimization and discovery, particularly when little to no experimental data is initially available.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

QuGAN: A Quantum State Fidelity based Generative Adversarial Network

In the recent years, Generative Adversarial Networks (GANs) have been arguably one of the largest strides forward in Deep Learning. Many papers illustrate the use of GANs to accomplish extremely impressive goals, such as text-to-image or image augmentation. Specifically, GANs have seen this success in the computer vision domain. However, GANs are not without their own set of problems. GANs are computationally expensive, sometimes computationally prohibitive, and can suffer a multitude of convergence problems. As research on classical GANs continues to push the topic further, a branch of GANs, namely Quantum GANs, has seen research interest in the past years. In this work, we intend to push this research further with an illustration of a Quantum GAN architecture that provide stable convergence of the model and is extended onto real data sets. Furthermore, unlike many other Quantum GANs out there, our model's GAN architecture runs the discriminator and the generator primarily on Quantum hardware through the use of a Quantum-based similarity metric. When compared to the very few other Quantum GAN papers, our architecture leads to significantly better results in almost all aspects.

Stein, Samuel A.↗

A hillock and cloud model for faculae

A hillock model is used here to explain facular contrasts, allowing faculae to emit more energy than the surrounding unmagnetized photosphere. For downflows, horizontal motions converge near the photosphere and many fibril flux tubes are drawn together to form a large dark area, the sunspot. For upflows, the motions diverge near the photosphere and fibril flux tubes are dispersed over a larger area associated with faculae. The upflows transport material and energy, resulting in hotter than normal temperatures, which in turn cause the gas to expand compared with its surroundings. Buoyancy thus causes a 'network' of patchy hillocks, clouds, or geysers to form which allows the sun to reradiate the energy deficit associated with sunspots by locally increasing the effective surface area of the sun beyond that of a sphere. The consequences of this model for the physical form of the facular manifestation, the appearance of faculae from earth, and the 'energy balance' in active regions are addressed.

Schatten, Kenneth H.↗

Large-eddy simulation of non-vaporizing sprays using the spectral-element method

Predictive simulations of high-pressure sprays require accurate representation of the turbulent gaseous flow field generated by liquid jet. Typically, the accuracy that can be obtained with low-order numerical methods (e.g. finite volume, finite element) is limited by stability issues in fine grids and the order of convergence of the method. In this work, we resolve the turbulent flow field in an Eulerian manner using the high-order spectral element method, coupled with a Lagrangian parcels approach to model the atomizing liquid jet. Large eddy simulations of single-hole sprays under non-evaporative conditions were conducted and compared against experimental data from Margot et al. (2008) and Spray A data from the Engine Combustion Network. The sensitivity of liquid penetration and droplet sizes to different breakup model parameters was studied. The effect of different numerical parameters, such as polynomial order of the solution (grid resolution), on liquid penetration was also analyzed. The method achieved grid-independent results using p-refinement, achieving finer resolution (by a factor of x 1.7 - x 3.5) in the gas-phase solution than in state-of-the-art simulations using the finite-volume method. Here the results showed good agreement with experimental data, demonstrating the ability of the current method to accurately capture liquid penetration and the shape of the spray.

97 MATHEMATICS AND COMPUTING↗

Designing the Protocols for Programmable Ammonia Catalysis

Programmable catalysis can provide a more energy-efficient and cost-effective route to enhancing commercial ammonia production, a key process in the advancement of renewable energy technologies and the manufacture of fertilizers and basic chemicals. This work explores the computational discovery of optimal forcing protocols to drive such dynamic catalysis models. By employing matrix-free time-stepper methods, coupled with an optimization approach, that integrates Bayesian optimization with a Bayesian continuation strategy to efficiently discover the periodic steady states of such periodically forced systems, we enable the discovery of complex optimal catalyst strain waveforms, while ensuring robust solver convergence. We demonstrate the flexibility of our approach to discover optimized forcing protocols under varying physical constraints on strain modulation or other catalyst operating parameters. We show that these can have a temporal structure more complex than simple step functions. In order to detect undesirable catalytic loops that may correlate with overall reduced performance, we perform a study using graph-theoretical analysis to investigate the dynamics of catalytic kinetic networks formed.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Computationally efficient Bayesian estimation of graphical networks for omics data

Graphical networks are useful, widely-used modeling approaches to represent complex biological processes with biological measurements generated by platforms such as mass spectrometry. Bayesian analyses of graphical networks for omics data have several advantages over their frequentist counterparts, such as the inclusion of prior knowledge in the estimation of models. However, Bayesian approaches to date have only been feasible for data with a couple hundred biomolecules due to prohibitive computational time, but omics data often contains tens of thousands of biomolecules. Here, we present and illustrate a more computationally efficient approach named BPlane (Bayesian PseudoLikelihood-based Algorithm for Network Estimation) to extend Bayesian modeling capabilities for larger-sized datasets, such as most untargeted proteomics data. Via simulation, we demonstrate that BPlane produces substantial computational savings over a current state-of-the-art Bayesian algorithm while maintaining competitive edge detection accuracy. On a SARS-CoV2 proteomics data with 7000 proteins, the competing algorithm takes three times as long to complete the first iteration as BPlane takes to converge after over 100 iterations.

EM algorithm↗

A Novel Data-based Stochastic Distribution Control for Non-Gaussian Stochastic Systems

In this note, we present a novel data-based approach to investigate the non-Gaussian stochastic distribution control problem. As the motivation of this note, the existing methods have been summarised regarding to the drawbacks, for example, neural network weights training for unknown stochastic distribution and so on. To overcome these disadvantages, a new transformation for dynamic probability density function is given by kernel density estimation using interpolation. Based upon this transformation, a representative model has been developed while the stochastic distribution control problem has been transformed into an optimisation problem. Then, data-based direct optimisation and identification-based indirect optimisation have been proposed. In addition, the convergences of the presented algorithms are analysed and the effectiveness of these algorithms has been evaluated by numerical examples. In summary, the contributions of this note are as follows: 1) a new data-based probability density function transformation is given; 2) the optimisation algorithms are given based on the presented model; and 3) a new research framework is demonstrated as the potential extensions to the existing stochastic distribution control.

42 ENGINEERING↗

The extended amygdala and salt appetite

Both chemo- and mechanosensitive receptors are involved in detecting changes in the signals that reflect the status of body fluids and of blood pressure. These receptors are located in the systemic circulatory system and in the sensory circumventricular organs of the brain. Under conditions of body fluid deficit or of marked changes in fluid distribution, multiple inputs derived from these humoral and neural receptors converge on key areas of the brain where the information is integrated. The result of this central processing is the mobilization of homeostatic behaviors (thirst and salt appetite), hormone release, autonomic changes, and cardiovascular adjustments. This review discusses the current understanding of the nature and role of the central and systemic receptors involved in the facilitation and inhibition of thirst and salt appetite and on particular components of the central neural network that receive and process input derived from fluid- and cardiovascular-related sensory systems. Special attention is paid to the structures of the lamina terminalis, the area postrema, the lateral parabrachial nucleus, and their association with the central nucleus of the amygdala and the bed nucleus of the stria terminalis in controlling the behaviors that participate in maintaining body fluid and cardiovascular homeostasis.

NASA Discipline Regulatory Physiology↗

Proton switching molecular magnetoelectricity

Abstract The convergence of proton conduction and multiferroics is generating a compelling opportunity to achieve strong magnetoelectric coupling and magneto-ionics, offering a versatile platform to realize molecular magnetoelectrics. Here we describe machine learning coupled with additive manufacturing to accelerate the design strategy for hydrogen-bonded multiferroic macromolecules accompanied by strong proton dependence of magnetic properties. The proton switching magnetoelectricity occurs in three-dimensional molecular heterogeneous solids. It consists of a molecular magnet network as proton reservoir to modulate ferroelectric polarization, while molecular ferroelectrics charging proton transfer to reversibly manipulate magnetism. The magnetoelectric coupling induces a reversible 29% magnetization control at ferroelectric phase transition with a broad thermal hysteresis width of 160 K (192 K to 352 K), while a room-temperature reversible magnetic modulation is realized at a low electric field stimulus of 1 kV cm −1 . The findings of electrostatic proton transfer provide a pathway of proton mediated magnetization control in hierarchical molecular multiferroics.

36 MATERIALS SCIENCE↗

Deep learning of structural morphology imaged by scanning X-ray diffraction microscopy

Scanning X-ray nanodiffraction microscopy is a powerful technique for spatially resolving nanoscale structural morphologies by diffraction contrast. One of the critical challenges in experimental nanodiffraction data analysis is posed by the convergence angle of nanoscale focusing optics which creates simultaneous dependency of the far-field scattering data on three independent components of the local strain tensor-corresponding to dilation and two potential rigid body rotations of the unit cell. All three components are in principle resolvable through a spatially mapped sample tilt series; however, traditional data analysis is computationally expensive and prone to artifacts. In this study, we implement NanobeamNN, a convolutional neural network specifically tailored to the analysis of scanning probe X-ray microscopy data. NanobeamNN learns lattice strain and rotation angles from simulated diffraction of a focused X-ray nanobeam by an epitaxial thin film and can directly make reasonable predictions on experimental data without the need for additional fine-tuning. We demonstrate that this approach represents a significant advancement in computational speed over conventional methods, as well as a potential improvement in accuracy over the current standard.

Luo, Aileen [Cornell Univ., Ithaca, NY (United Sta↗