Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image representation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

Preconditioning of overcast-to-broken cloud transitions by riming in marine cold air outbreaks

Marine cold air outbreaks (CAOs) commonly form overcast cloud decks that transition into broken cloud fields downwind, dramatically altering the local radiation budget. In this study, we investigate the impact of frozen hydrometeors on these transitions. We focus on a CAO case in the NW Atlantic, the location of the multi-year flight campaign ACTIVATE (Aerosol Cloud meTeorology Interactions oVer the western ATlantic Experiment). We use MERRA-2 (Modern-Era Retrospective analysis for Research and Applications, version 2) reanalysis fields to drive large eddy simulations with mixed-phase two-moment microphysics in a Lagrangian framework. We find that transitions are triggered by substantial rain (rainwater paths >25 g m−2), and only simulations that allow for aerosol depletion result in sustained breakups, as observed. Using a range of diagnostic ice nucleating particle concentrations, Ninp, we find that increasing ice progressively accelerates transitions, thus abbreviating the overcast state. Ice particles affect the cloud-topped boundary layer evolution, primarily through riming-related processes prior to substantial rain, leading to (1) a reduction in cloud liquid water, (2) early consumption of cloud condensation nuclei, and (3) early and light precipitation cooling and moistening below cloud. We refer to these three effects collectively as “preconditioning by riming”. Greater boundary layer aerosol concentrations available as cloud condensation nuclei (CCN) delay the onset of substantial rain. However, cloud breakup and low CCN concentration final stages are found to be inevitable in this case, due, primarily, to liquid water path buildup. An ice-modulated cloud transition speed suggests the possibility of a negative cloud–climate feedback. To address prevailing uncertainties in the model representation of mixed-phase processes, the magnitude of ice formation and riming impacts and, thereby, the strength of an associated negative cloud–climate feedback process, requires further observational evaluation by targeting riming hot spots with in situ imaging probes that allow for both the characterization of ice particles and abundance of supercooled droplets.

Marine cold air outbreaks↗

Method and Apparatus for Virtual Interactive Medical Imaging by Multiple Remotely-Located Users

A virtual interactive imaging system allows the displaying of high-resolution, three-dimensional images of medical data to a user and allows the user to manipulate the images, including rotation of images in any of various axes. The system includes a mesh component that generates a mesh to represent a surface of an anatomical object, based on a set of data of the object, such as from a CT or MRI scan or the like. The mesh is generated so as to avoid tears, or holes, in the mesh, providing very high-quality representations of topographical features of the object, particularly at high- resolution. The system further includes a virtual surgical cutting tool that enables the user to simulate the removal of a piece or layer of a displayed object, such as a piece of skin or bone, view the interior of the object, manipulate the removed piece, and reattach the removed piece if desired. The system further includes a virtual collaborative clinic component, which allows the users of multiple, remotely-located computer systems to collaboratively and simultaneously view and manipulate the high-resolution, three-dimensional images of the object in real-time.

Ross, Muriel D.↗

Applied photo interpretation for airbrush cartography

New techniques of cartographic portrayal have been developed for the compilation of maps of lunar and planetary surfaces. Conventional photo interpretation methods utilizing size, shape, shadow, tone, pattern, and texture are applied to computer processed satellite television images. The variety of the image data allows the illustrator to interpret image details by inter-comparison and intra-comparison of photographs. Comparative judgements are affected by illumination, resolution, variations in surface coloration, and transmission or processing artifacts. The validity of the interpretation process is tested by making a representational drawing by an airbrush portrayal technique. Production controls insure the consistency of a map series. Photo interpretive cartographic portrayal skills are used to prepare two kinds of map series and are adaptable to map products of different kinds and purposes.

Inge, J. L.↗

Coastal Typologies: Methods for Improving Representation of Arctic Coastal Environments, Starting with Alaska's Northern Slope [Slides]

The objectives of the project included: Broaden QGIS (mapping) and Python (data analysis) skill set; Contribute to overall development of coastal typologies by conducting data mining and analysis; Expand scientific literacy; Narrow data sources to those most useful for project; Convert chosen data sets into image formats for analysis; and, Utilize python to analyze images.

58 GEOSCIENCES↗

A ModEx Framework for Watershed Subsurface Investigation With Limited Geophysical Data Using Machine Learning and Hydrologic Modeling

Abstract Subsurface heterogeneity influences watershed hydrology strongly but remains difficult to characterize at catchment scales with sparse and costly field data. Geophysical surveys such as electromagnetic induction (EMI) provide local spatial subsurface images yet scaling them to watershed scales and converting EMI‐derived resistivity into hydraulic properties remains a challenge. We present a Model–Experiment (ModEx) framework that integrates limited EMI data with machine learning (ML) and hydrologic modeling to improve process representation and guide field investigations. Sparse EMI surveys were scaled to the catchment scale using a Random Forest model, and the resulting resistivity fields were combined with nearby borehole constraints to parameterize a hydrologic model. The EMI‐informed hydrological simulations improved predictions of streamflow sustained by subsurface flow and shallow saturation patterns. By combining EMI data and ML with hydrologic modeling, the ModEx framework guides future subsurface surveys, providing a transferable and efficient strategy for data–model integration across diverse watersheds. Plain Language Summary Mapping the underground network of soil and rock that controls water is essential for predicting floods and droughts, but seeing underground is difficult and expensive. We cannot drill everywhere, so scientists use geophysical tools to scan broad areas. There are two key challenges: these geophysical scans are often sparse across the whole watershed, and the geophysical data is hard to translate into water‐related properties. We used artificial intelligence to solve these problems. We taught a computer to find patterns linking the limited geophysical data to the land surface properties. This allowed it to fill in the gaps and create a complete, useful subsurface map for the entire watershed. This new map improves hydrologic simulations, leading to more accurate predictions of water movement in the watershed. It also helps scientists build better models with less data and generates a priority map showing where to measure next, making future investigations more efficient. Key Points Limited EMI scaled with ML improves catchment‐scale subsurface parameterization for hydrologic models The framework integrates hydrologic modeling with limited geophysical data to support subsurface investigation design ModEx framework offers a transferable data–model integration strategy that quantifies and reduces uncertainty guiding watershed studies

Chen, Hang↗

An improved evaluation of surface finish with a three dimensional tester

The design and programming of an automated three dimensional surface finish tester is described. The device produces a three dimensional image of the microscopic texture of the examined surface. The surface finish tester presents the following advantages over conventional profilometry: (1) more complete exploration of surface texture by successive probe sweeps; (2) automation of measuring and calculating; (3) more accurate representation of the derived parameters; (4) analysis of the degree of homogeneity of the surface; (5) three dimensional graphic representation accurately depicting the state of the surface; (6) detection of local imperfections; and (7) detection of scoring that occurred during machining.

GRANDADAM↗

Vision Based Localization in Urban Environments

As part of DARPA's MARS2020 program, the Jet Propulsion Laboratory developed a vision-based system for localization in urban environments that requires neither GPS nor active sensors. System hardware consists of a pair of small FireWire cameras and a standard Pentium-based computer. The inputs to the software system consist of: 1) a crude grid-based map describing the positions of buildings, 2) an initial estimate of robot location and 3) the video streams produced by each camera. At each step during the traverse the system: captures new image data, finds image features hypothesized to lie on the outside of a building, computes the range to those features, determines an estimate of the robot's motion since the previous step and combines that data with the map to update a probabilistic representation of the robot's location. This probabilistic representation allows the system to simultaneously represent multiple possible locations, For our testing, we have derived the a priori map manually using non-orthorectified overhead imagery, although this process could be automated. The software system consists of two primary components. The first is the vision system which uses binocular stereo ranging together with a set of heuristics to identify features likely to be part of building exteriors and to compute an estimate of the robot's motion since the previous step. The resulting visual features and the associated range measurements are software component, a particle-filter based localization system. This system uses the map and the then fed to the second primary most recent results from the vision system to update the estimate of the robot's location. This report summarizes the design of both the hardware and software and will include the results of applying the system to the global localization of a robot over an approximately half-kilometer traverse across JPL'S Pasadena campus.

unmanned-ground vehicles↗

Computational and Experimental Study of Plume and Shock Interaction Effects on Sonic Boom in the NASA Ames 9x7 Supersonic Wind Tunnel

A wind tunnel test was performed in the NASA Ames 9x7 Supersonic Wind Tunnel focusing on the shock waves traveling through and interacting with an exhaust nozzle plume. This experimental study was conducted to develop and validate the CFD capability required to accurately include nozzle flow with impinging shock effects on near field and ground‐propagated sonic boom signatures. The model was made to be generic, and included a simple nozzle shape, two different aft decks, and a few generic horizontal tails. High pressure air was pumped through a nozzle at various nozzle pressure ratios (NPR) to represent the engine plume in flight. The three different aft body representations each created a different shock wave signature that passed through the plume. An aft deck configuration, where part of the aircraft shields the nozzle plume, was also tested. Retroreflective Background-Oriented Schlieren (RBOS) was used to obtain schlieren images of the flow field around the model and behind the model. This study compares wind tunnel data and numerical simulations conducted by the NASA Tetrahedral Unstructured Software System CFD code, USM3D.

Winski, Courtney S.↗

An improved method for precise automatic co-registration of moderate and high-resolution spacecraft imagery

Improvements to the automated co-registration and change detection software package, AFIDS (Automatic Fusion of Image Data System) has recently completed development for and validation by NGA/GIAT. The improvements involve the integration of the AFIDS ultra-fine gridding technique for horizontal displacement compensation with the recently evolved use of Rational Polynomial Functions/ Coefficients (RPFs/RPCs) for image raster pixel position to Latitude/Longitude indexing. Mapping and orthorectification (correction for elevation effects) of satellite imagery defies exact projective solutions because the data are not obtained from a single point (like a camera), but as a continuous process from the orbital path. Standard image processing techniques can apply approximate solutions, but advances in the state-of-the-art had to be made for precision change-detection and time-series applications where relief offsets become a controlling factor. The earlier AFIDS procedure required the availability of a camera model and knowledge of the satellite platform ephemeredes. The recent design advances connect the spacecraft sensor Rational Polynomial Function, a deductively developed model, with the AFIDS ultrafine grid, an inductively developed representation of the relationship raster pixel position to latitude /longitude. As a result, RPCs can be updated by AFIDS, a situation often necessary due to the accuracy limits of spacecraft navigation systems. An example of precision change detection will be presented from Quickbird.

co-registration↗

A biomass map of the Brazilian Amazon from multisource remote sensing

The Amazon Forest, the largest contiguous tropical forest in the world, stores a significant fraction of the carbon on land. Changes in climate and land use affect total carbon stocks, making it critical to continuously update and revise the best estimates for the region, particularly considering changes in forest dynamics. Forest inventory data cover only a tiny fraction of the Amazon region, and the coverage is not sufficient to ensure reliable data interpolation and validation. This paper presents a new forest above-ground biomass map for the Brazilian Amazon and the associated uncertainty both with a resolution of 250 meters and baseline for the satellite dataset the year of 2016 (i.e., the year of the satellite observation). A significant increase in data availability from forest inventories and remote sensing has enabled progress towards high-resolution biomass estimates. This work uses the largest airborne LiDAR database ever collected in the Amazon, mapping 360,000 km 2 through transects distributed in all vegetation categories in the region. The map uses airborne laser scanning (ALS) data calibrated by field forest inventories that are extrapolated to the region using a machine learning approach with inputs from Synthetic Aperture Radar (PALSAR), vegetation indices obtained from the Moderate-Resolution Imaging Spectroradiometer (MODIS) satellite, and precipitation information from the Tropical Rainfall Measuring Mission (TRMM). A total of 174 field inventories geolocated using a Differential Global Positioning System (DGPS) were used to validate the biomass estimations. The experimental design allowed for a comprehensive representation of several vegetation types, producing an above-ground biomass map varying from a maximum value of 518 Mg ha -1 , a mean of 174 Mg ha -1 , and a standard deviation of 102 Mg ha -1 . This unique dataset enabled a better representation of the regional distribution of the forest biomass and structure, providing further studies and critical information for decision-making concerning forest conservation, planning, carbon emissions estimate, and mechanisms for supporting carbon emissions reductions.

54 ENVIRONMENTAL SCIENCES↗

Materials characterization: Can artificial intelligence be used to address reproducibility challenges?

Material characterization techniques are widely used to characterize the physical and chemical properties of materials at the nanoscale and, thus, play central roles in material scientific discoveries. However, the large and complex datasets generated by these techniques often require significant human effort to interpret and extract meaningful physicochemical insights. Artificial intelligence (AI) techniques such as machine learning (ML) have the potential to improve the efficiency and accuracy of surface analysis by automating data analysis and interpretation. In this perspective paper, we review the current role of AI in surface analysis and discuss its future potential to accelerate discoveries in surface science, materials science, and interface science. We highlight several applications where AI has already been used to analyze surface analysis data, including the identification of crystal structures from XRD data, analysis of XPS spectra for surface composition, and the interpretation of TEM and SEM images for particle morphology and size. We also discuss the challenges and opportunities associated with the integration of AI into surface analysis workflows. These include the need for large and diverse datasets for training ML models, the importance of feature selection and representation, and the potential for ML to enable new insights and discoveries by identifying patterns and relationships in complex datasets. Most importantly, AI analyzed data must not just find the best mathematical description of the data, but it must find the most physical and chemically meaningful results. In addition, the need for reproducibility in scientific research has become increasingly important in recent years. The advancement of AI, including both conventional and the increasing popular deep learning, is showing promise in addressing those challenges by enabling the execution and verification of scientific progress. By training models on large experimental datasets and providing automated analysis and data interpretation, AI can help to ensure that scientific results are reproducible and reliable. Although integration of knowledge and AI models must be considered for the transparency and interpretability of models, the incorporation of AI into the data collection and processing workflow will significantly enhance the efficiency and accuracy of various surface analysis techniques and deepen our understanding at an accelerated pace.

Materials Science↗

802GHz integrated horn antennas imaging array

Pattern measurements at 802GHz of a single element in 256-element integrated horn imaging array are presented. The integrated-horn antenna consists of a dipole-antenna suspended on a 1-micron dielectric membrane inside a pyramidal cavity etched in silicon. The theoretical far-field patterns, calculated using reciprocity and Floquet-modes representation of the free-space field, agree well with the measured far-field patterns at 802GHz. The associated directivity for a 1.40 lambda horn aperture, calculated from the measured E and H-plane patterns is 12.3dB + or - 0.2dB. This work demonstrates that high-efficiency integrated-horn antennas are easily scalable to terahertz frequencies and could be used for radio-astronomical and plasma-diagnostic applications.

Ali-Ahmad, Walid Y.↗

Cutting out the Middleman: Calibrating and Validating a Dynamic Vegetation Model (ED2-PROSPECT5) Using Remotely Sensed Surface Reflectance

Canopy radiative transfer is the primary mechanism by which models relate vegetation composition and state to the surface energy balance, which is important to light- and temperature-sensitive plant processes as well as understanding land–atmosphere feedbacks. In addition, certain parameters (e.g., specific leaf area, SLA) that have an outsized influence on vegetation model behavior can be constrained by observations of shortwave reflectance, thus reducing model predictive uncertainty. Importantly, calibrating against radiative transfer outputs allows models to directly use remote sensing reflectance products without relying on highly derived products (such as MODIS leaf area index) whose assumptions may be incompatible with the target vegetation model and whose uncertainties are usually not well quantified. Here, we created the EDR model by coupling the two-stream representation of canopy radiative transfer in the Ecosystem Demography model version 2 (ED2) with a leaf radiative transfer model (PROSPECT-5) and a simple soil reflectance model to predict full-range, high-spectral-resolution surface reflectance that is dependent on the underlying ED2 model state. We then calibrated this model against estimates of hemispherical reflectance (corrected for directional effects) from the NASA Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) and survey data from 54 temperate forest plots in the northeastern United States. The calibration significantly reduced uncertainty in model parameters related to leaf biochemistry and morphology and canopy structure for five plant functional types. Using a single common set of parameters across all sites, the calibrated model was able to accurately reproduce surface reflectance for sites with highly varied forest composition and structure. However, the calibrated model's predictions of leaf area index (LAI) were less robust, capturing only 46 % of the variability in the observations. Comparing the ED2 radiative transfer model with another two-stream soil–leaf–canopy radiative transfer model commonly used in remote sensing studies (PRO4SAIL) illustrated structural errors in the ED2 representation of direct radiation backscatter that resulted in systematic underestimation of reflectance. In addition, we also highlight that, to directly compare with a two-stream radiative transfer model like EDR, we had to perform an additional processing step to convert the directional reflectance estimates of AVIRIS to hemispherical reflectance (also known as “albedo”). In future work, we recommend that vegetation models add the capability to predict directional reflectance, to allow them to more directly assimilate a wide range of airborne and satellite reflectance products. We ultimately conclude that despite these challenges, using dynamic vegetation models to predict surface reflectance is a promising avenue for model calibration and validation using remote sensing data.

Alexey N Shiklomanov↗

Machine learning assisted bayesian inference of mix and hot-spot conditions in NIF implosions

Experiments on the National Ignition Facility (NIF) have provided clear evidence of ablator material mixing into the Hot-Spot, leading to degraded performance. However, inferring the amount of mix and Hot-Spot conditions from typical experimental observations (e.g. x-ray spectra and images) is highly challenging. Here, we have developed an analysis method that utilizes machine learning assisted Bayesian inference to find the probability distributions of the Hot-Spot and mix conditions. This approach uses a neural network, trained on an idealized 2-dimensional representation of the Hot-Spot and mix distribution, and Bayesian inference to find the statistical distributions of Hot-Spot conditions that provide a match with observations. We have tested this method with synthetic data from simulations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Global field reconstruction from sparse sensors with Veronoi tessellation-assisted deep learning

Achieving accurate and robust global situational awareness of a complex time-evolving field from a limited number of sensors has been a longstanding challenge. This reconstruction problem is especially difficult when sensors are sparsely positioned in a seemingly random or unorganized manner, which is often encountered in a range of scientific and engineering problems. Moreover, these sensors can be in motion and can become online or offline over time. The key leverage in addressing this scientific issue is the wealth of data accumulated from the sensors. As a solution to this problem, we propose a data-driven spatial field recovery technique founded on a structured grid-based deep-learning approach for arbitrary positioned sensors of any numbers. It should be noted that the naïve use of machine learning becomes prohibitively expensive for global field reconstruction and is furthermore not adaptable to an arbitrary number of sensors. In the present work, we consider the use of Voronoi tessellation to obtain a structured-grid representation from sensor locations enabling the computationally tractable use of convolutional neural networks. One of the central features of the present method is its compatibility with deep-learning based super-resolution reconstruction techniques for structured sensor data that are established for image processing. The proposed reconstruction technique is demonstrated for unsteady wake flow, geophysical data, and three-dimensional turbulence. The current framework is able to handle an arbitrary number of moving sensors, and thereby overcomes a major limitation with existing reconstruction methods. The presented technique opens a new pathway towards the practical use of neural networks for real-time global field estimation.

Fukami, Kai↗

Experimental and Computational Analysis of a Rotating Detonation Combustor

Rotating detonation combustor (RDC) research has progressed along parallel experimental and computational paths with limited opportunities for validation. Validation is a crucial step to ensure RDC simulations provide an accurate representation of the physical phenomena, and thus, can be used with confidence for design optimization in different applications. In this study, data from a quasi-two-dimensional computational fluid dynamic simulation in an annular RDC are compared with experimental measurements including particle image velocimetry at 100 kHz. Results show good agreement between measured and simulated dynamic pressures, Chapman-Jouguet speeds, and static pressure distributions. Velocity measurements at the annulus exit show good temporal and quantitative agreement with simulations including spikes from the passing shock.

Detonation↗

Image-to-Image Wildfire Detection via Quantum-Compatible Variational Segmentation from Remotely-sensed Data

Over the last decade, the incidence of wildfires has surged, causing widespread destruction globally. To better comprehend and manage these incidents, remote sensing and aerial missions have been implemented in recent efforts. However, this has resulted in an exponential rise in the amount of remote sensing data utilization, leading to a need for intelligent automation of data extraction in wildfire studies. Machine learning provides an accurate automated approach for detecting these natural anomalies and facilitates decision-makers to take prompt actions. To make insightful decisions in wildfire management, it is imperative to move beyond simple detection and explore the potential of probabilistic generative machine learning for creating "what-if" scenarios for various wildfire conditions. Such models offer improved representation of the stochastic nature of wildfire events. However, the optimization of these models can be computationally expensive, especially when using classical computers. Quantum computers have recently emerged as a promising solution to reduce the computational cost of training such models and improve their performance. In this study, we aim to utilize quantum-compatible machine learning techniques to implement our probabilistic generative approach. To that end, we propose a supervised probabilistic variational model consisting of a U-NET-based image-to-image component along with encoder and decoder networks which work as a variational autoencoder (VAE) component. Additionally, we explore the type of latent distribution type in the VAE component and implement different means for modeling the prior distribution. We further investigate the quantum-compatible versions of the model compared to the classical counterpart and benchmark potential benefits of quantum compatibility over the classical model.

quantum machine learning↗

Event-to-Video Conversion for Overhead Object Detection

Collecting overhead imagery using an event camera is desirable due to the energy efficiency of the image sensor compared to standard cameras. However, event cameras complicate downstream image processing, especially for complex tasks such as object detection. In this paper, we investigate the viability of event streams for overhead object detection. We demonstrate that across a number of standard modeling approaches, there is a significant gap in performance between dense event representations and corresponding RGB frames. We establish that this gap is, in part, due to a lack of overlap between the event representations and the pre-training data that the object detectors were initially trained on through a number of experiments. Then, apply an off-the-shelf event-to-video conversion tool that converts event streams into gray-scale video to close this gap. We demonstrate that this approach results in a large performance increase, outperforming even event-specific object detection techniques on our overhead target task. These results suggest that better aligning event representations with existing large pre-trained models may result in greater short-term performance gains compared to end-to-end event-specific architectural improvements.

machine learning (ML), computer vision, Neuromorph↗