Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “representation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,513 records · Page 84

The Radiative Effect on Cloud Microphysics from the Arctic to the Tropics

Cloud representation is one of the largest uncertainties in the current weather and climate models. In this article, the observations and modeling of the radiative effect on (cloud) microphysics (REM) from the Arctic to the Tropics are overviewed, providing a new direction to meet the challenge of cloud representation. REM deals with the radiation-induced temperature difference between cloud particles and air. It leads to two common phenomena observed at the surface—dew and frost—and impacts clouds aloft significantly, which is noticed via the wide occurrence of horizontally oriented ice crystals (HOICs). However, REM has been overlooked by all of the operational weather and climate models. Based on the bin model of REM and the global distribution of radiative cooling/warming, the observations of REM from several platforms (e.g., aircrafts, field campaigns, and satellites) are coordinated in this article, yielding a global picture on REM. As a result, the picture is compatible with the global distribution of HOICs and other ice crystal characteristics obtained from various clouds on the globe, such as diamond dust (or clear-sky precipitation) in the Arctic, sub-visual cirrus clouds in the tropical tropopause layer, and other cirrus clouds from the low to high latitudes. In addition, ice crystals possess relatively strong REM compared to liquid drops because their aspect ratio is usually not one. The global picture on REM can be used by the weather and climate modelers to diagnose their cloud representation biases. It can also be used to improve the atmospheric ice retrieval algorithm from satellite observations.

cloud microphysics↗

Impact of Assimilating Adaptively Thinned AIRS Cloud-Cleared Radiances on the Analysis of Polar Lows and Mediterranean Sea Tropical-Like Cyclone in a Global Modeling and Data Assimilation Framework

Polar lows, and mesoscale convective cyclones bearing resemblance to tropical cyclones but originating outside of the tropics, are storms that are challenging to represent accurately in global analyses and models because of their small size, rapid growth at subsynoptic scales, occurrence in data poor oceanic regions, and difficulties in objectively validating them in analysis. Building on previous positive results obtained with respect to the representation of tropical cyclones (TCs) in a global model, a set of observing system experiments (OSEs) performed using the NASA Goddard Earth Observing System (GEOS, version 5) are investigated, focusing on three case studies—a polar low in the Sea of Okhotsk, a polar low in the Southern Ocean, and a Mediterranean Sea tropical-like cyclone that occurred during the boreal fall season of 2014. Experiments assimilating adaptively thinned cloud-cleared hyperspectral infrared radiances from the Atmospheric Infrared Sounder (AIRS) instrument on board the NASA Aqua satellite, with higher density in the vicinity of each storm and its pre-cyclogenesis environment, and lower density elsewhere, demonstrate a positive impact on the analyzed representation of each storm. The adaptive thinning experiments improve the storm intensity and structure, including vertical alignment, depth, symmetry, strength, and compactness of warm core compared to the reference experiments. The results suggest that jet-level processes associated with extremely strong horizontal velocity gradients as represented in the model analysis can be useful to locate dynamically active regions of the extratropical atmosphere where denser data coverage is likely to improve the analyzed representation of polar lows and other similar marine mesoscale convective cyclones.

global modeling↗

The Hazard Components of Representative Key Risks. The Physical Climate Perspective

The framework of Representative Key Risks (RKRs) has been adopted by the Intergovernmental Panel on Climate Change Working Group II (WGII) to categorize, assess and communicate a wide range of regional and sectoral key risks from climate change. These are risks expected to become severe due to the potentially detrimental convergence of changing climate conditions with the exposure and vulnerability of human and natural systems. Other papers in this special issue treat each of eight RKRs holistically by assessing their current status and future evolution as a result of this convergence. However, in these papers, such assessment cannot always be organized according to a systematic gradation of climatic changes. Often the big-picture evolution of risk has to be extrapolated from either qualitative effects of “low”, “medium” and “high” warming, or limited/focused analysis of the consequences of particular mitigation choices (e.g., benefits of limiting warming to 1.5 or 2C), together with consideration of the socio-economic context and possible adaptation choices. In this study we offer a representation – as systematic as possible given current literature and assessments – of the future evolution of the hazard components of RKRs. We identify the relevant hazards for each RKR, based upon the WGII authors’ assessment, and we report on their current state and expected future changes in magnitude, intensity and/or frequency, linking these changes to Global Warming Levels (GWLs) to the extent possible. We draw on the assessment of changes in climatic impact-drivers relevant to RKRs described in the 6th Assessment Report by Working Group I supplemented when needed by more recent literature. For some of these quantities - like regional trends in oceanic and atmospheric temperature and precipitation, some heat and precipitation extremes, permafrost thaw and Northern Hemisphere snow cover - a strong and quantitative relationship with increasing GWLs has been identified. For others - like frequency and intensity of tropical cyclones and extra-tropical storms, and fire weather - that link can only be described qualitatively. For some processes - like the behavior of ice sheets, or changes in circulation dynamics - large uncertainties about the effects of different GWLs remain, and for a few others - like ocean pH and air pollution - the composition of the scenario of anthropogenic emissions is most relevant, rather than the warming reached. In almost all cases, however, the basic message remains that every small increment in CO2 concentration in the atmosphere and associated warming will bring changes in climate phenomena that will contribute to increasing risk of impacts on human and natural systems, in the absence of compensating changes in these systems’ exposure and vulnerability, and in the absence of effective adaptation. Our picture of the evolution of RKR-relevant climatic impact-drivers complements and enriches the treatment of RKRs in the other papers in at least two ways: by filling in their often only cursory or limited representation of the physical climate aspects driving impacts, and by providing a fuller representation of their future potential evolution, an important component – if never the only one – of the future evolution of risk severity.

Representative Key Risks↗

Towards Effective Drought Monitoring in the Middle East and North Africa (Mena) Region: Implications From Assimilating Leaf Area Index and Soil Moisture Into the Noah-Mp Land Surface Model for Morocco

The Middle East and North Africa (MENA) region has experienced more frequent and severe drought events in recent decades, leading to increasingly pressing concerns over already strained food and water security. An effective drought monitoring and early warning system is thus critical to support risk mitigation and management by countries in the region. Here we investigate the potential for assimilation of leaf area index (LAI) and soil moisture observations to improve the representation of the overall hydrological and carbon cycles and drought by an advanced land surface model. The results reveal that assimilating soil moisture does not meaningfully improve model representation of the hydrological and biospheric processes for this region, but instead it degrades the simulation of the interannual variation in evapotranspiration (ET) and carbon fluxes, mainly due to model weaknesses in representing prognostic phenology. However, assimilating LAI leads to greater improvement, especially for transpiration and carbon fluxes, by constraining the timing of simulated vegetation growth response to evolving climate conditions. LAI assimilation also helps to correct for the erroneous interaction between the prognostic phenology and irrigation during summertime, effectively reducing a large positive bias in ET and carbon fluxes. Independently assimilating LAI or soil moisture alters the categorization of drought, with the differences being greater for more severe drought categories. We highlight the vegetation representation in response to changing land use and hydroclimate as one of the key processes to be captured for building a successful drought early warning system for the MENA region.

Wanshu Nie↗

Shedding Light on Microbial Dark Matter with A Universal Language of Life

The majority of microbial genomes have yet to be cultured, and most proteins predicted from microbial genomes or sequenced from the environment cannot be functionally annotated. As a result, current computational approaches to describe microbial systems rely on incomplete reference databases that cannot adequately capture the full functional diversity of the microbial tree of life, limiting our ability to model high-level features of biological sequences. The scientific community needs a means to capture the functionally and evolutionarily relevant features underlying biology, independent of our incomplete reference databases. Such a model can form the basis for transfer learning tasks, enabling downstream applications in environmental microbiology, medicine, and bioengineering. Here we present LookingGlass, a deep learning model capturing a “universal language of life”. LookingGlass encodes contextually-aware, functionally and evolutionarily relevant representations of short DNA reads, distinguishing reads of disparate function, homology, and environmental origin. We demonstrate the ability of LookingGlass to be fine-tuned to perform a range of diverse tasks: to identify novel oxidoreductases, to predict enzyme optimal temperature, and to recognize the reading frames of DNA sequence fragments. LookingGlass is the first contextually-aware, general purpose pre-trained “biological language” representation model for short-read DNA sequences. LookingGlass enables functionally relevant representations of otherwise unknown and unannotated sequences, shedding light on the microbial dark matter that dominates life on Earth.

A Hoarfrost↗

Understanding Model-Observation Discrepancies in Satellite Retrievals of Atmospheric Temperature Using GISS ModelE

We examine multiple factors in the representation of satellite-retrieved atmospheric temperature diagnostics in historical simulations of climate change during the satellite era (specifically 1979–2021) using GISS ModelE contributions to the Coupled Model Intercomparison Project (Phase 6) (CMIP6). The tropospheric and stratospheric trends in these diagnostics are affected by greenhouse gases (notably carbon dioxide and ozone), coupling with the ocean, volcanic aerosols, solar activity and compositional and dynamic feedbacks. We explore the impacts of internal variability, changing forcing specifications, composition interactivity, the quality of the stratospheric circulation, vertical resolution, and possible impacts of the mis-specification of volcanic aerosol optical depths. Overall temperature trends throughout the satellite period are well captured, but discrepancies at all levels exist and have multiple distinct causes. We find that stratospheric comparisons (using Stratospheric Sounding Unit (SSU) retrievals and successor instruments) are most affected by variations in the representation of ozone depletion and feedbacks, followed by the volcanic signals. Tropospheric skill (using the Microwave Sounding Unit (MSU) retrievals) is affected by the trends in ocean heat uptake and tropospheric aerosols, but also by the representation of stratospheric processes through the impact of the Brewer-Dobson circulation on the height of the tropical tropopause. We demonstrate that no single factor is the dominant cause of the discrepancies and that almost all observations lie within the broad envelope of structural uncertainty.

satellite retrievals of atmospheric temperature↗

Resolving the fine structure in the energy landscapes of repeat proteins

Ankyrin (ANK) repeat proteins are coded by tandem occurrences of patterns with around 33 amino acids. They often mediate protein–protein interactions in a diversity of biological systems. These proteins have an elongated non-globular shape and often display complex folding mechanisms. This work investigates the energy landscape of representative proteins of this class made up of 3, 4 and 6 ANK repeats using the energy-landscape visualisation method (ELViM). By combining biased and unbiased coarse-grained molecular dynamics AWSEM simulations that sample conformations along the folding trajectories with the ELViM structure-based phase space, one finds a three-dimensional representation of the globally funnelled energy surface. In this representation, it is possible to delineate distinct folding pathways. We show that ELViMs can project, in a natural way, the intricacies of the highly dimensional energy landscapes encoded by the highly symmetric ankyrin repeat proteins into useful low-dimensional representations. These projections can discriminate between multiplicities of specific parallel folding mechanisms that otherwise can be hidden in oversimplified depictions.

Murilo N. Sanches↗

Using XR for Improving Scientific Discovery With Numerical Weather Models

Earth science (ES) digital twins will help us understand the complex interactions and interrelationships that make up our Earth system and the impacts of earth science phenomena on it. Our work addresses two underdeveloped areas in current ES digital twin work: improving the understanding and interaction with ES model outputs by using Virtual and Mixed Reality (XR) tools and improving the non-intuitive mapping of continuous ES natural phenomena to gridded reference frames in current numerical models. Traditionally, scientists working on ES view and analyze the results of calculated or measured observables with static 1-dimensional (1D), 2D or 3D plots displayed on flat computer screens or paper. Using such limited mediums, it can be very difficult to identify, track and understand the evolution of key features due to poor viewing angles and the nature of flat computer screens. In addition, numerical models, such as the NASA Goddard Earth Observing System (GEOS) ES model, are almost exclusively formulated, visualized and analyzed in an Eulerian reference frame with fixed grid points in space and time. However, ES phenomena such as convective clouds, hurricanes and wildfire smoke plumes are visualized and analyzed in a Lagrangian reference frame: therefore it is often difficult and unnatural to understand these phenomena in relation to each other, visualized either in an Eulerian or Lagrangian context. In 3D visualizations, data generally takes one of three forms: gridded (e.g., voxelized) data, where space is divided into regions; point clouds, where data is represented as a set of points; and meshes, where objects are rendered as surfaces composed of small polygons (usually triangles). A gridded, Eulerian reference frame has been the default representation for the 2D visual analysis of atmospheric data in part because the numerical methods used to generate atmospheric model data in the first place use a gridded approach, with equations defining the relationships between the physical variables in each of a grid's cells across successive timesteps. In our work, we are particularly interested in data from GEOS. Another reason why gridded representations tend to be used for visualizing data from such models is because trajectories are difficult to interpret from representations on 2D surfaces, due to line-of-sight ambiguity. Instead of a fixed grid from GEOS, we embed a trajectory model to simulate particles' movement throughout a GEOS run. We then ingest these particle trajectories as animated point clouds with a NASA open source XR toolkit, the Mixed Reality Exploration Toolkit (MRET), and merge GEOS data with ES phenomena data onto one combined visualization that the user can intuitively interact with. Efficient rendering of arbitrarily large point clouds is an ongoing challenge being addressed by the computer science community, with the GPU-based optimizations and efficient GPU memory utilization a common theme of recent advances, especially for XR, where sustained high frame rate is mandatory to save the user from suffering due to simulation sickness. In this work, we describe and evaluate our progress in choosing and implementing appropriate methods for rendering arbitrarily large point clouds within MRET for XR. While tracking the XR headset enables the immersion of a user within a 3D scene of a data visualization, tracking of XR handheld controllers or user’s hands enables us to implement intuitive user interactions with the visualized datasets. Conventional tools require a user working with an ES visualization to conduct many interactions to commit their intended selections or manipulations with a visualized dataset; for example to specify a set of points in 3D space. Doing so in a 2D flat screen interface has traditionally required specifying a set of points in three distinct 2D coordinate systems (XY, XZ, and YZ), which is cumbersome. In other scientific domains, it has been shown that specifying or selecting a location or volume in XR using handheld controllers or tracked hands allows for greater speed and accuracy. We anticipate the same will hold true for atmospheric data, and we will share initial results of measuring the utility of such an interface. Notably, as the data being visualized is generated by GEOS as a prediction based on initial conditions, an intended application of our tool is to serve as part of an iterative feedback loop. Through XR, a scientist will review and manipulate a GEOS model run, modifying the conditions as needed to do subsequent runs of GEOS. Thereby, XR-based improvements to speed and accuracy of 3D tagging of points minimizes the effort required by both the scientist and the computer cluster conducting the necessary calculations.

Thomas Grubb↗

Constraining Global Coronal Models with Multiple Independent Observables

Global coronal models seek to produce an accurate physical representation of the Sun's atmosphere that can be used, for example, to drive space-weather models. Assessing their accuracy is a complex task, and there are multiple observational pathways to provide constraints and tune model parameters. Here, we combine several such independent constraints, defining a model-agnostic framework for standardized comparison. We require models to predict the distribution of coronal holes at the photosphere, and neutral line topology at the model's outer boundary. We compare these predictions to extreme-ultraviolet (EUV) observations of coronal hole locations, white-light Carrington maps of the streamer belt, and the magnetic sector structure measured in situ by Parker Solar Probe and 1 au spacecraft. We study these metrics for potential field source surface (PFSS) models as a function of source surface height and magnetogram choice, as well as comparing to the more physical Wang–Sheeley–Arge (WSA) and the Magnetohydrodynamic Algorithm outside a Sphere (MAS) models. We find that simultaneous optimization of PFSS models to all three metrics is not currently possible, implying a trade-off between the quality of representation of coronal holes and streamer belt topology. WSA and MAS results show the additional physics that they include address this by flattening the streamer belt while maintaining coronal hole sizes, with MAS also improving coronal hole representation relative to WSA. We conclude that this framework is highly useful for inter- and intra-model comparisons. Integral to the framework is the standardization of observables required of each model, evaluating different model aspects.

S. T. Badman↗

Quantum-Assisted Variational Segmentation for Image-to-Image Wildfire Detection Using Satellite Data

The quantum computing community has been searching for suitable applications to demonstrate the potential of near-term quantum devices. Quantum machine learning is a potential candidate, particularly using models that cannot be efficiently simulated with classical computers [1, 2]. This work focuses on a transition phase of quantum computers where the quantum machine learning model is still simulable classically but projected not to be simulable as the size of the model grows. Ultimately quantum computers may have advantages for high-dimensional real-world problems. Due to the limited number of qubits in current noisy intermediate-scale quantum (NISQ) devices, the direct application of quantum computers in high dimensional data is not feasible. To remedy this problem, an encoder-decoder architecture can be utilized. The encoder model would transform the high-dimensional data into a compact representation, to a level that small quantum computers can be used today (or in the near future), and the decoder would take the quantum processed outputs back to the high-dimensional space. Addressing the two challenges of quantum machine learning, this work investigates a hybrid supervised generative model with a quantum Ising Born machine embedded as the latent distribution. The model contains four main parts (Figure 1.a.): (1) a U-NET architecture responsible for learning segmentation flow, (2) a Prior network responsible for learning an encoded latent distribution of the input data, (3) a Born machine which represents the latent distribution, and (4) a Posterior network in charge of learning the joint encoded latent distribution of inputs and target data. The initial model, proposed by [3], is optimized by (1) maximizing the overlap of the prior and posterior latent distributions, and (2) minimizing the segmentation loss. The proposed model is designed to be investigated in a simulation environment applied to the real-world application of wildfire segmentation. Specifically, the model is designed to solve the patchy wildfire segmentations of Moderate Resolution Imaging Spectroradiometer (MODIS) by taking the MODIS observations and using Visible Infrared Imaging Radiometer Suite’s (VIIRS) consistent wildfire product as the target. The model solves patchy wildfire segmentations and provides insight into the epistemic errors sourced from model variation. The model utilizes the Born machine as a QUBO solver to represent the latent space as a Bernoulli distribution. The proposed configuration allows the variational segmentation model to leverage the true quantum probabilistic nature and derive a more expressive latent configuration, increasing the model performance in describing wildfire segmentations. The quantum probabilistic information of the Born machine is directly incorporated in the Kullback-Leibler divergence loss in the prior and posterior distributions, forcing the Bernoulli latent distribution to maximize the overlap of input and joint input-target distributions. The proposed model is then trained and compared with a baseline only consisting of direct Bernoulli latent distribution with no Born machine representing the latent space. The models are evaluated based on the segmentation metrics, such as precision, recall, intersect of union, with uncertainty boundaries accounting for the stochastic nature of the model. Our findings show that even in low latent-dimensional space (due to the limit in computational power of the classical quantum simulator), we are able to effectively capture the latent representation and hence the model performs better than the baseline. The findings are a projection for scaling the model into higher dimensional latent space with the Born machine surpassing the baseline performance. Figure 1. Sub-figure (a) demonstrates the architecture for the training phase. The model consists of a Prior and Posterior network that encode inputs and joint input-target data into compact representations, respectively. The Born machine represents the latent distribution, and the U-NET branch learns the segmentation patterns of the data. The stochasticity is introduced to the U-NET through its last layer to create meaningful but stochastic segmentations. Sub-figure (b) represents the inference phase where the model takes the stochastic behavior from the prior network and injects that into the U-NET. Each attempt of inference will generate different but similar segmentations from the same distribution of the wildfire event. REFERENCES [1] Coyle, B., Mills, D., Danos, V., & Kashefi, E. (2020). The Born supremacy: quantum advantage and training of an Ising Born machine. npj Quantum Information, 6(1), 1-11. [2] Liu, J. G., & Wang, L. (2018). Differentiable learning of quantum circuit born machines. Physical Review A, 98(6), 062324. [3] Kohl, S., Romera-Paredes, B., Meyer, C., De Fauw, J., Ledsam, J. R., Maier-Hein, K., ... & Ronneberger, O. (2018). A probabilistic u-net for segmentation of ambiguous images. Advances in neural information processing systems, 31.

quantum machine learning↗

Enhancing Long-Term Trend Simulation of OH Through the Synergy of Model Simulations and Aura Ozone Monitoring Instrument (OMI) NO 2 and HCHO Retrievals

During the last few years, tremendous progress has been made to develop an efficient parameterization module using agile machine learning techniques. The aim of this module is to provide dynamic response of the tropospheric hydroxyl radical (OH) to its major drivers, including trace gases, aerosols, clouds, and meteorology. This module, named ECCOH (pronounced “echo”) and implemented in NASA’s GEOS-5 global model, offers an unrealized opportunity to unravel the convoluted response of OH to its underlying drivers while approaching the accuracy of full-chemistry without incurring excessive computational costs, making it suitable for climate models. However, the accurate representation of OH in ECCOH poses challenges due to the lack of representation of some of its critical inputs such as the abundance of NO 2 and HCHO concentrations. As such, we leverage the well-characterized satellite observations of NO2 and HCHO columns from Aura OMI to enhance their representation in ECCOH using an optimal interpolation method for the time period of 2005 - present. We show how the inclusion of OMI information can affect the spatiotemporal variability and long-term trends of OH, CO, and CH 4 across the globe. Additionally, we underscore the necessity of obtaining high-fidelity information regarding tropospheric ozone from the southern hemisphere from space, a region currently lacking full verification in models, posing a challenge to get a reasonable amount of chemical sink for CH 4 .

OH↗

Towards an Aviation Large Language Model by Fine-tuning and Evaluating Transformers

In the aviation domain, there are many applications for machine learning and artificial intelligence tools that utilize natural language. For example, there is a desire to know the commonalities in written safety reports such as voluntary post incidents reports or aerial wildfire operations reports to better understand the risks present. Another use-case is the possibility of extracting airspace procedures and constraints currently written in documents such as Letters of Agreement. These applications can benefit from the use of state-of-the-art natural language processing techniques when adapted to the language/phraseology specific to the aviation domain. This paper evaluates the viability of adaptation of NLP tools to the aviation domain by fine-tuning transformer based models using aviation data sets. In 2018, a novel language model based on neural units (also called transformers) was created and became known as “Bidirectional Encoder Representations from Transformers” or BERT. This architecture combined with large amounts of English training data and innovative semi-supervised training tasks set the standard for what would later emerge as Large Language Models. The performance of these models was further improved by hyperparameter tuning and refinement of the semi-supervised training task and resulted in “Robustly Optimized BERT Pre-training Approach through hyperparameter tuning” or RoBERTa models. These pre-trained Large Language Models proved to be useful for a wide variety of natural language processing tasks such as text classification and question answering through a process called fine-tuning. The transformer architecture with pre-trained weights served as the basis with the last few layers replaced with layers fine-tuned to perform a new task e.g., a layer that provides a label for the entire input text. This process of fine-tuning can also be used to adapt the models to new domains; e.g., BioBERT started with the pre-trained BERT model and was completed by additional fine-tuning and training on biomedical documents. Transformer-based architectures can also be used to create rich representations of text called embeddings which can serve as the input to other machine learning models. This allows simpler algorithms such as logistic regression to use context-rich representations of the text while still remaining quick to train and evaluate. In the world of aviation, there is a growing demand for natural language processing and understanding but the domain presents unique challenges. Due to the technical content (and specialized language) of most aviation documents, fine-tuning pre-trained Large Language Models to specific tasks has not met the benchmark on natural language processing tasks set by simpler models trained from scratch on the data. To address this deficiency, this paper evaluates the improvements from fine-tuning a Large Language Model on a large set of aviation documents using the original semi-supervised training tasks before performing specific natural language tasks. In fine-tuning, a domain-specific dataset is used on the original training task but with the pre-trained Large Language Model instead of starting from a random initialization. This approach allows the model to be adapted to the specific domain language without discarding the information gained from training on general English data. This paper utilized two major dataset types to train and assess the RoBERTa fine-tuning performance. The first are 7,057 Letters of Agreement which are Federal Aviation Administration (FAA) documents that formalize airspace operations across the national airspace system. They contain many examples of ‘aviation English’ using domain specific terminology and phrasing which serves as a representative basis to perform the semi-supervised fine-tuning. The second type is the 494 document classification labels to be used for evaluation. This down-stream evaluation aims to show the performance of the fine-tuned model, better understand how much data is needed for an effective fine-tuning, and how fine-tuning can be adapted for different applications in-the domain. After semi-supervised training, evaluation begins by encoding the documents for classification using the fine-tuned RoBERTa model. Then a logistic regression classifier is trained to label the document type and compared against our ground truth labels. This currently leads to a 82.8% accuracy on 10-fold cross validation showing improvement over baseline RoBERTa which achieved 81.0%. We plan to measure the improvements on additional tasks and it is expected that these improvements will lead to more robust models that can tackle the natural language processing challenges present in aviation datasets.

ATM↗

Wildfire Segmentation From Remotely Sensed Data Using Quantum-Compatible Conditional Vector Quantized-Variational Autoencoders

Wildfires represent a critical environmental hazard with multifaceted implications for ecosystems, communities, and public health [1]. The escalating frequency and intensity of wildfires globally have intensified the urgency for robust segmentation methodologies to facilitate effective mitigation, response, and recovery strategies [2]. Accurate wildfire segmentation is pivotal for delineating fire boundaries, assessing progression patterns, and prioritizing resource allocation during emergency scenarios. Furthermore, precise segmentation enables stakeholders, including policymakers, environmental scientists, and emergency responders, to formulate evidence-based strategies, thereby minimizing socio-economic disruptions and ecological degradation. Consequently, advancing wildfire segmentation techniques through innovative technological interventions remains a paramount research imperative. Although foundational in wildfire segmentation, traditional deterministic models exhibit inherent limitations that compromise their efficacy in dynamic and uncertain environments. These models often operate on rigid algorithms prioritizing deterministic classifications, thereby overlooking the inherent complexities and uncertainties associated with wildfire behavior and satellite data variability. Such deterministic frameworks tend to produce oversimplified representations that fail to capture the intricate nuances of evolving fire dynamics, spatial heterogeneity, and environmental interactions [1]. Consequently, the deterministic approach’s propensity for uncertainty collapsing [1, 3] hampers the accuracy, reliability, and applicability of segmentation outcomes in real-world scenarios. Contrastingly, stochastic models offer a more nuanced and adaptable framework for wildfire segmentation. By integrating probabilistic elements into the modeling paradigm, stochastic approaches, particularly probabilistic approaches such as variational auto encoders (VAEs) [4], facilitate comprehensive uncertainty assessment, enabling researchers to quantify and incorporate uncertainties into segmentation outcomes effectively. This probabilistic nature empowers stochastic models to encapsulate variability, account for data inconsistencies, and adapt to evolving environmental conditions, enhancing segmentation accuracy, reliability, and robustness. Embracing stochastic methodologies thus catalyzes advancements in wildfire science by fostering a more holistic, adaptive, and resilient segmentation framework. Despite VAEs demonstrating significant promise in various applications, they come with inherent limitations that have garnered attention within the machine learning community. One of the primary drawbacks lies in their reliance on static priors, which essentially assume a fixed distribution for latent variables, thereby limiting the model’s flexibility to capture complex data structures effectively [5]. This static nature leads to suboptimal representations, especially when dealing with complex and high-dimensional data. Additionally, VAEs often struggle with generating sharp and realistic samples, a phenomenon commonly referred to as mode collapse [5, 7, 6]. Furthermore, the optimization process in VAEs, which involves balancing the reconstruction loss and the regularization term, can sometimes be challenging to fine-tune [7]. In recent efforts to address these shortcomings, alternative approaches like Vector Quantized Variational Auto encoders(VQ-VAEs) [7], address the challenges by incorporating discrete latent variables and leveraging techniques that enhance the quality and diversity of generated samples while maintaining efficient training dynamics. VQ-VAEs propose a dynamic prior distribution generation mechanism that diverges from the static priors commonly associated with traditional VAEs. This dynamic approach allows for more adaptive and context-aware latent variable representations, thereby potentially capturing complex data structures more effectively. Unlike autoregressive prior models such as PixelCNN, which, despite their ability to model dependencies across data dimensions, suffer from significant computational inefficiencies and lack flexibility in handling diverse datasets. In our work, we propose to use a generative quantum-compatible approach to help alleviate the shortcomings of autoregressive prior model in VQ-VAEs. Restricted Boltzmann Machines (RBMs) are a viable alternative prior model that can learn prior distributions in a faster and more flexible manner. In this research endeavor, we meticulously curate a state-of-the-art dataset leveraging satellite MODIS data in conjunction with VIIRS fire masks, derived from Fire Radiative Power (FRP), thereby encapsulating diverse wildfire scenarios and environmental contexts. We developed a conditional VQ-VAE architecture with the RBM prior model that is trained in a supervised manner for segmenting wildfire masks. This innovative approach synergistically harnesses deep learning capabilities, enabling the generation of segmentation maps characterized by heightened precision, granularity, and contextual relevance. Furthermore, replacing the autoregressive prior learning method proposed by the original VQ-VAE with a prior density approximation via quantum-compatible RBM facilitates expedited inference processes, augments flexibility in prior sampling, optimizes computational efficiency and establishes a groundbreaking benchmark in wildfire segmentation methodologies.

quantum machine learning↗

Automatic Detection and Classification of Aurora in THEMIS All‐Sky Images

We report a novel machine-learning algorithm for automatically detecting and classifying aurora in all–sky images (ASI) that is largely trained without requiring ground–truth labels. By including a small number of labeled images, we are able to automatically label all of the approximately 700 million images in the Time History of Events and Macroscale Interactions during Substorms (THEMIS) ASI data set from 2008 to 2022. We use a two–stage approach. In the first stage, we adapt the Simple framework for Contrastive Learning of Representations (SimCLR) algorithm to learn latent representations of THEMIS all–sky images. We then finetune a classifier network on the latent representations our model learns of the manually labeled Oslo aurora THEMIS (OATH) data set. We demonstrate that this two–stage approach achieves excellent classification results on data for which there is no current ML classification benchmark. The outcome of this work will facilitate efficient information retrieval for researchers interested in specific categories of aurora and will enable large scale statistical studies and machine learning analyses of THEMIS all–sky images that have not previously been possible. To demonstrate possible ways to utilize this database, we performed a statistical analysis of the occurrence rates of auroral labels with respect to solar wind parameters, interplanetary magnetic field vector, and geomagnetic indices. We further investigate the occurrence rates of auroral phenomena in the annotated data set and their geoeffectiveness by utilizing the co–located THEMIS ground magnetometer data set.

Jeremiah W Johnson↗

Experimental and Numerical Investigation of the NASA High Efficiency Centrifugal Compressor Vaned Stage Geometry and Aerodynamic Performance

Since its inception in the early 2010s, the NASA High Efficiency Centrifugal Compressor (HECC) has been enigmatic for the propulsion research community: experimental data and numerical simulations of the stage have generally not aligned in their quantifications of performance metrics. Typically, the fault for these disagreements is assigned to the numerical simulations as the simulations are models, and models are inherently incomplete representations of the experiment. This “incompleteness” may manifest in assumptions regarding roughness or heat transfer, simplifications of the flow path (i.e., neglecting bleed flows), or the oft-scapegoated turbulence model. In the case of HECC, recent work showed unexpected discrepancies between the intended impeller geometry defined in the design report (termed Design-Intent) and the manufactured impeller used in the experimental campaigns (termed As-Manufactured). That work used numerical simulations to establish that the geometric differences between the Design-Intent and As-Manufactured impellers were significant enough to result in drastically different performance predictions for the HECC vaneless diffuser configuration. The Design-Intent impeller simulations over predicted the performance relative to the experiment, whereas the As-Manufactured simulations better represented the experimental data, both in terms of one-dimensional performance metrics and spanwise flow profiles. This effort expands on that work by examining in detail the geometry and aerodynamic performance of the HECC vaned diffuser configuration. Further differences between the Design-Intent and As-Manufactured geometries have been discovered in the vaned diffuser and exit guide vanes, and these differences are documented herein. The summations of the geometric differences for all of the components were used to create two numerical models of HECC vaned diffuser configuration: the Design-Intent simulations which are generated from the original geometry definitions given in the design report and the As-Manufactured simulations which are the best available representation of the manufactured compressor hardware used in the experimental test campaigns. In congruence with the earlier vaneless diffuser work, the numerical predictions of the Design-Intent choked mass flow rate, total pressure ratio, and efficiency were notably greater than that of the As-Manufactured simulations. To increase confidence in the experimental dataset, measurements from a recent test campaign conducted in 2024 are used to validate the original experimental data acquired from 2012 to 2014 with good repeatability overall, especially considering the passage of time and differences in the data acquisition systems between the test campaigns. Both numerical simulations were then extensively evaluated against the experimental data. The As-Manufactured simulations provided better estimates of the stage performance than the Design-Intent cases in terms of most performance metrics. Nonetheless, more detailed results still show opportunities for improvement. Despite a more accurate representation of the physical hardware, characterization of the impeller work input remains a challenge even for rigorously developed numerical models.

vaned diffuser↗

Experimental and Numerical Investigation of the NASA High Efficiency Centrifugal Compressor Vaned Stage Geometry and Aerodynamic Performance

Since its inception in the early 2010s, the NASA High Efficiency Centrifugal Compressor (HECC) has been enigmatic for the propulsion research community: experimental data and numerical simulations of the stage have generally not aligned in their quantifications of performance metrics. Typically, the fault for these disagreements is assigned to the numerical simulations as the simulations are models, and models are inherently incomplete representations of the experiment. This “incompleteness” may manifest in assumptions regarding roughness or heat transfer, simplifications of the flow path (i.e., neglecting bleed flows), or the oft-scapegoated turbulence model. In the case of HECC, recent work showed unexpected discrepancies between the intended impeller geometry defined in the design report (termed Design-Intent) and the manufactured impeller used in the experimental campaigns (termed As-Manufactured). That work used numerical simulations to establish that the geometric differences between the Design-Intent and As-Manufactured impellers were significant enough to result in drastically different performance predictions for the HECC vaneless diffuser configuration. The Design-Intent impeller simulations over predicted the performance relative to the experiment, whereas the As-Manufactured simulations better represented the experimental data, both in terms of one-dimensional performance metrics and spanwise flow profiles. This effort expands on that work by examining in detail the geometry and aerodynamic performance of the HECC vaned diffuser configuration. Further differences between the Design-Intent and As-Manufactured geometries have been discovered in the vaned diffuser and exit guide vanes, and these differences are documented herein. The summations of the geometric differences for all of the components were used to create two numerical models of HECC vaned diffuser configuration: the Design-Intent simulations which are generated from the original geometry definitions given in the design report and the As-Manufactured simulations which are the best available representation of the manufactured compressor hardware used in the experimental test campaigns. In congruence with the earlier vaneless diffuser work, the numerical predictions of the Design-Intent choked mass flow rate, total pressure ratio, and efficiency were notably greater than that of the As-Manufactured simulations. To increase confidence in the experimental dataset, measurements from a recent test campaign conducted in 2024 are used to validate the original experimental data acquired from 2012 to 2014 with good repeatability overall, especially considering the passage of time and differences in the data acquisition systems between the test campaigns. Both numerical simulations were then extensively evaluated against the experimental data. The As-Manufactured simulations provided better estimates of the stage performance than the Design-Intent cases in terms of most performance metrics. Nonetheless, more detailed results still show opportunities for improvement. Despite a more accurate representation of the physical hardware, characterization of the impeller work input remains a challenge even for rigorously developed numerical models.

centrifugal compressor↗

Data-driven modeling and control of dynamical systems using Koopman and Perron-Frobenius operators

This dissertation studies the data-driven modeling and control problem of nonlinear systems by exploiting the linear operator theoretic framework involving Koopman and Perro-Frobenius operator. A systematic linear-operator based controller design procedure has been established, which can be used to solve a variety of nonlinear control problems, including feedback stabilization using control Lyapunov functions, optimal quadratic regulation using Koopman eigenfunctions and convex optimization formulation of optimal control problem using P-F and Koopman operator approximation. As the core of data-driven modeling, we first propose a new algorithm for the finite-dimensional approximation of the linear transfer Koopman and Perron-Frobenius operator from time-series data. We argue that the existing approach for the finite-dimensional approximation of these transfer operators such as Dynamic Mode Decomposition (DMD) and Extended Dynamic Mode Decomposition (EDMD) do not capture two important properties of these operators, namely positivity and Markov property. The algorithm we propose preserves these two properties. We call the proposed algorithm as naturally structured DMD (NSDMD) since it retains the inherent properties of these operators. Naturally structured DMD algorithm leads to a better approximation of the steady-state dynamics of the system regarding computing Koopman and Perron- Frobenius operator eigenfunctions and eigenvalues. However, preserving positivity property is critical for capturing the real transient dynamics of the system. This positivity property of the transfer operators and it's finite-dimensional approximation play an important role for controller and estimator design of nonlinear systems. To solve the feedback stabilization problem for nonlinear control systems, we tried to take advantage of the Koopman operator framework. The Koopman operator approach provides a linear representation for a nonlinear dynamical system and a bilinear representation for a nonlinear control system. The problem of feedback stabilization of a nonlinear control system is then transformed to the stabilization of a bilinear control system. We propose a control Lyapunov function (CLF)-based approach for the design of stabilizing feedback controllers for the bilinear system. The search for finding a CLF for the bilinear control system is formulated as a convex optimization problem. This leads to a schematic procedure for designing CLF-based stabilizing feedback controllers for the bilinear system and hence the original nonlinear system. Another advantage of the proposed controller design approach outlined in this dissertation is that it does not require explicit knowledge of system dynamics. In particular, the bilinear representation of a nonlinear control system in the Koopman eigenfunction space can be obtained from time-series data. Next, we study the optimal quadratic regulation problem for nonlinear systems. The linear operator theoretic framework involving the Koopman operator is used to lift the dynamics of nonlinear control system to an infinite-dimensional bilinear system. The optimal quadratic regulation problem for nonlinear system is formulated in terms of the finite-dimensional approximation of the bilinear system. A convex optimization-based approach is proposed for solving the quadratic regulator problem for bilinear system. We applied a variety of examples and compared the simulation results between our framework and conventional LQR control using linearized model. For more general optimal control problems, we provide a density-function based convex formulation for the optimal control problem of the nonlinear system. The convex formulation relies on the duality result in the stability theory of a dynamical system involving density function and Perron-Frobenius operator. The optimal control problem is formulated as an infinite-dimensional convex optimization program. The finite-dimensional approximation of the optimization problem relies on the recent advances made in the data-driven computation of the Koopman operator, which is dual to the Perron-Frobenius operator. Simulation results are presented to demonstrate the application of the developed framework.

Huang, Bowen↗

Variational Autoencoders for Learning Nonlinear Dynamics of Physical Systems

We develop data-driven methods for incorporating physical information for priors to learn parsimonious representations of nonlinear systems arising from parameterized PDEs and mechanics. Our approach is based on Variational Autoencoders (VAEs) for learning nonlinear state space models from observations. We develop ways to incorporate geometric and topological priors through general manifold latent space representations. We investigate the performance of our methods for learning low dimensional representations for the nonlinear Burgers equation and constrained mechanical systems.

97 MATHEMATICS AND COMPUTING↗