Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “masking algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Micropulse Lidar Cloud Mask Machine-Learning Value-Added Product Report

Cloud detection algorithms of various techniques have been developed and applied to atmospheric ground-based lidar data to identify cloud boundaries and produce clouds masks. While these algorithms are able to identify a wide variety of cloud types and conditions, it is often observed that the algorithms can still fail to accurately detect clouds that are readily discernible when inspecting the lidar imagery. Based on this observation, an alternative approach for cloud detection is to take advantage of machine-learning capabilities and the trained human eye as an interpreter of lidar images, and in turn, to train a neural network to recognize the desired features in the lidar data.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2021

Lunar Terrain Coverage Analysis Data Delivery Workflow

In this work, we are developing a lunar terrain database to enable fast rendering of sun illumination and earth visibility for a proposed coverage analysis tool. This development will advance lunar mission design and formulation for current and future communications architectures, and will aid in lunar surface mission planning and communications/navigation operations. Our effort can be described in three steps: (1) we parallelize a brute force algorithm, which computes elevation masks from laser altimetry data acquired by the Lunar Reconnaissance Orbiter’s (LRO) Lunar Orbiter Laser Altimeter (LOLA); (2) we investigate parallel I/O methods to store terrain mask information from step (1) into a parallel file system; and (3) we finally deliver data to the terrain coverage analysis tool.

Michels, Dominik↗
DOE OSTI2024

NREL GOES Reference Document

The purpose of this document is to create a single reference document representing abridged versions of the PATMOS-x Algorithm Theoretical Basis Documents (ATBDs) specifically relevant to GOES 16-18 processing. This document has been compiled from several documents: Cloud Mask ATBD, AWG Cloud Height Algorithm (ACHA) ATBD, Daytime Cloud Optical and Microphysical Properties (DCOMP) ATBD, and CLAVR-x User's Guide.

14 SOLAR ENERGY↗
NASA NTRS2016

Development of an Operational Land Water Mask for MODIS Collection 6, and Influence on Downstream Data Products

Data from the Moderate Resolution Imaging Spectro-radiometer (MODIS)on-board the Earth Observing System Terra and Aqua satellites are processed using a land water mask to determine when an algorithm no longer needs to be run or when an algorithm needs to follow a different pathway. Entering the fourth reprocessing (Collection 6 (C6)) the MODIS team replaced the 1 km water mask with a 500 m water mask for improved representation of the continental surfaces. The new water mask represents more small water bodies for an overall increase in water surface from 1 to 2 of the continental surface. While this is still a small fraction of the overall global surface area the increase is more dramatic in certain areas such as the Arctic and Boreal regions where there are dramatic increases in water surface area in the new mask. MODIS products generated by the on-going C6 reprocessing using the new land water mask show significant impact in areas with high concentrations of change in the land water mask. Here differences between the Collection 5 (C5) and C6 water masks and the impact of these differences on the MOD04 aerosol product and the MOD11 land surface temperature product are shown.

Carroll, M. L.↗
DOE OSTI2023

Deep learning for morphological identification of extended radio galaxies using weak labels

Abstract The present work discusses the use of a weakly-supervised deep learning algorithm that reduces the cost of labelling pixel-level masks for complex radio galaxies with multiple components. The algorithm is trained on weak class-level labels of radio galaxies to get class activation maps (CAMs). The CAMs are further refined using an inter-pixel relations network (IRNet) to get instance segmentation masks over radio galaxies and the positions of their infrared hosts. We use data from the Australian Square Kilometre Array Pathfinder (ASKAP) telescope, specifically the Evolutionary Map of the Universe (EMU) Pilot Survey, which covered a sky area of 270 square degrees with an RMS sensitivity of 25–35 $\mu$ Jy beam $^{-1}$ . We demonstrate that weakly-supervised deep learning algorithms can achieve high accuracy in predicting pixel-level information, including masks for the extended radio emission encapsulating all galaxy components and the positions of the infrared host galaxies. We evaluate the performance of our method using mean Average Precision (mAP) across multiple classes at a standard intersection over union (IoU) threshold of 0.5. We show that the model achieves a mAP $_{50}$ of 67.5% and 76.8% for radio masks and infrared host positions, respectively. The network architecture can be found at the following link: https://github.com/Nikhel1/Gal-CAM

Astronomy & Astrophysics↗
NASA NTRS1990

Locating A Planar Target From An Image

Report describes experiments to test two algorithms being considered for use in automatic control of robots and remote manipulators. One algorithm based on quadrangle-projection method, which involves use of four target points lying at corners of quadrangle. Other algorithm based on elastic-matching ("rubber-mask") approach, in which reference image warped to conform to actual image. Both algorithms determine position and orientation of target with accuracy sufficient for consistent and efficient acquisition by telerobot.

Cornils, Karin↗
NASA NTRS2010

Detecting Thin Cirrus in Multiangle Imaging Spectroradiometer Aerosol Retrievals

Thin cirrus clouds (optical depth (OD) < 03) are often undetected by standard cloud masking in satellite aerosol retrieval algorithms. However, the Mu]tiangle Imaging Spectroradiometer (MISR) aerosol retrieval has the potential to discriminate between the scattering phase functions of cirrus and aerosols, thus separating these components. Theoretical tests show that MISR is sensitive to cirrus OD within Max{0.05 1 20%l, similar to MISR's sensitivity to aerosol OD, and MISR can distinguish between small and large crystals, even at low latitudes, where the range of scattering angles observed by MISR is smallest. Including just two cirrus components in the aerosol retrieval algorithm would capture typical MISR sensitivity to the natural range of cinus properties; in situations where cirrus is present but the retrieval comparison space lacks these components, the retrieval tends to underestimate OD. Generally, MISR can also distinguish between cirrus and common aerosol types when the proper cirrus and aerosol optical models are included in the retrieval comparison space and total column OD is >-0.2. However, in some cases, especially at low latitudes, cirrus can be mistaken for some combinations of dust and large nonabsorbing spherical aerosols, raising a caution about retrievals in dusty marine regions when cirrus is present. Comparisons of MISR with lidar and Aerosol Robotic Network show good agreement in a majority of the cases, but situations where cirrus clouds have optical depths >0.15 and are horizontally inhomogeneous on spatial scales shorter than 50 km pose difficulties for cirrus retrieval using the MISR standard aerosol algorithm..

Pierce, Jeffrey R.↗
NASA NTRS2016

Shortwave Direct Radiative Effects of Above-Cloud Aerosols Over Global Oceans Derived From 8 Years of CALIOP and MODIS Observations

In this paper, we studied the frequency of occurrence and shortwave direct radiative effects (DREs) of above-cloud aerosols (ACAs) over global oceans using 8 years (2007-2014) of collocated CALIOP and MODIS observations. Similar to previous work, we found high ACA occurrence in four regions: southeastern (SE) Atlantic region, where ACAs are mostly light-absorbing aerosols, i.e., smoke and polluted dust according to CALIOP classification, originating from biomass burning over the African Savanna; tropical northeastern (TNE) Atlantic and the Arabian Sea, where ACAs are predominantly windblown dust from the Sahara and Arabian deserts, respectively; and the northwestern (NW) Pacific, where ACAs are mostly transported smoke and polluted dusts from Asia. From radiative transfer simulations based on CALIOP-MODIS observations and a set of the preselected aerosol optical models, we found the DREs of ACAs at the top of atmosphere (TOA) to be positive (i.e., warming) in the SE Atlantic and NW Pacific regions, but negative (i.e., cooling) in the TNE Atlantic Ocean and the Arabian Sea. The cancellation of positive and negative regional DREs results in a global ocean annual mean diurnally averaged cloudy-sky DRE of 0.015 W m(exp. -2) [range of -0.03 to 0.06 W m (exp. -2)] at TOA. The DREs at surface and within the atmosphere are -0.015 W m(exp. -2) [range of -0.09 to -0.21 W m(exp. -2)], and 0.17 W m(exp. -2) [range of 0.11 to 0.24 W m(exp. -2)], respectively. The regional and seasonal mean DREs are much stronger. For example, in the SE Atlantic region, the JJA (July-August) seasonal mean cloudy-sky DRE is about 0.7 W m(exp. -2) [range of 0.2 to 1.2 W m(exp. -2)] at TOA. All our DRE computations are publicly available. The uncertainty in our DRE computations is mainly caused by the uncertainties in the aerosol optical properties, in particular aerosol absorption, the uncertainties in the CALIOP operational aerosol optical thickness retrieval, and the ignorance of cloud and potential aerosol diurnal cycle. In situ and remotely sensed measurements of ACA from future field campaigns and satellite missions and improved lidar retrieval algorithm, in particular vertical feature masking, would help reduce the uncertainty.

direct radiative effects↗
NASA NTRS2014

TPSAS-NF1676L-19259-DND

In climate and Earth energy budget studies, understanding the presence and distribution of clouds is an essential first step. AVHRR measurements comprise the longest record of imager data from a common instrument for remote sensing of cloud and radiation properties. The NASA LaRC AVHRR cloud mask is a global cloud detection algorithm used as part of the Climate Data Record (CDR) project initiated by NOAA's National Climatic Data Center (NCDC). The objective of CDR program is to provide climate information derived from weather satellite data for more than 30 years. Recent improvements in the LaRC AVHRR cloud mask include detecting more daytime small cumulus and thin Cirrus in tropical oceans, especially over Sun Glint regions, better discrimination between polar clouds and snow ice surfaces including nighttime over Antarctica where 3.7 μm signals are noisy, and enhancement of nighttime ocean thin Cirrus and low clouds detection. Monthly averaged global and zonal cloud fractions from improved NOAA 18 AVHRR cloud mask compare well with CERES-MODIS Edition 4 (CM Ed4), MODIS team, and CALIPSO cloud mask. Spatially and temporally matched cloud detection statistics between NOAA 18 AVHRR and CALIPSO cloud mask will also be presented.

Qing Z Trepte↗
DOE OSTI2023

Adaptive language model training for molecular design

Abstract The vast size of chemical space necessitates computational approaches to automate and accelerate the design of molecular sequences to guide experimental efforts for drug discovery. Genetic algorithms provide a useful framework to incrementally generate molecules by applying mutations to known chemical structures. Recently, masked language models have been applied to automate the mutation process by leveraging large compound libraries to learn commonly occurring chemical sequences (i.e., using tokenization) and predict rearrangements (i.e., using mask prediction). Here, we consider how language models can be adapted to improve molecule generation for different optimization tasks. We use two different generation strategies for comparison, fixed and adaptive. The fixed strategy uses a pre-trained model to generate mutations; the adaptive strategy trains the language model on each new generation of molecules selected for target properties during optimization. Our results show that the adaptive strategy allows the language model to more closely fit the distribution of molecules in the population. Therefore, for enhanced fitness optimization, we suggest the use of the fixed strategy during an initial phase followed by the use of the adaptive strategy. We demonstrate the impact of adaptive training by searching for molecules that optimize both heuristic metrics, drug-likeness and synthesizability, as well as predicted protein binding affinity from a surrogate model. Our results show that the adaptive strategy provides a significant improvement in fitness optimization compared to the fixed pre-trained model, empowering the application of language models to molecular design tasks.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Automatic Code Generation for High-Performance Graph Algorithms

Graph problems are common across fields of scientific computing and social sciences. However, despite their importance, implementing graph algorithms effectively on modern computing systems is a challenging task that requires significant programming effort and generally results in customized implementations. Current computing and memory hierarchies are not architected for irregular computations resulting in challenges for graph algorithms to achieve high performance on those architectures. In this paper, we present GraphX, a novel compiler framework and DSL designed to simplify the development of efficient graph algorithms and achieve high performance on modern computing systems. GraphX consists of a DSL for efficient implementation of graph algorithms, various optimizations, such as support for sparse linear algebra and workspace transformations, optimized graph primitives, including semiring and masking, and a high-performance code generation engine. Using GraphX, users can implement graph algorithms using a semantically-rich language with graph-oriented operators. GraphX uses these semantics to automatically generate efficient code for target architectures, increasing performance and portability across architectures. The composable nature of GraphX makes it possible to extend the set of optimizations and architectures without modifying the source code. We demonstrate GraphX outperforms state-of-the-art graph libraries, such as LAGraph, up to $3.7 speedup in semiring operations, $2.19 speedup in an important sparse computational kernel, and $9.05 speedup in graph processing algorithms.

compiler, graph algorithms, semiring, masking, wor↗
NASA NTRS2024

Investigating the Spatial and Temporal Limitations for Remote Sensing of Wildfire Smoke Using Satellite and Airborne Imagers During FIREX_AQ

Starting from point sources, wildfire smoke is important in the global aerosol system. The ability to characterize smoke near-source is key to modeling smoke dispersion and predicting air quality. With hemispheric views and 10-min refresh, imagers in Geostationary (GEO) orbit have advantages monitoring smoke over once-per-day sensors in low-earth orbit (LEO). However, both can be inadequate in capturing the characteristics of smoke plumes close to their sources due to too-coarse spatial resolution (both detector and product resolution), too-sparse temporal resolution (from LEO sensors), and too-conservative masking. In addition to satellite observations, the Fire Influence on Regional to Global Environments and Air Quality experiment offered sub-orbital enhanced-MODIS Airborne Simulator (eMAS) imagery at 50 m pixel resolution—including multiple eMAS flight tracks over individual fires in short time periods. It provided opportunity to explore smoke plume characterization at various spatial and temporal scales and quantify the limitations of space sensors for describing smoke magnitude near source as well as its temporal evolution. Here we applied modified aerosol algorithm to different imagers, relaxing its masking to estimate smoke's aerosol optical depth (AOD) as close as possible to its source. We found that GEO sensors with nominal 1 km spatial resolution can match the much finer resolution eMAS retrieved mean plume AOD, as long as the retrieval spatial resolution is finer than the width of the plumes. However, the plume's maximum AOD may be drastically underestimated by satellite products.

remote sensing↗
DOE OSTI2024

Algorithms for Non-Negative Matrix Factorization on Noisy Data With Negative Values

Non-negative matrix factorization (NMF) is a dimensionality reduction technique that has shown promise for analyzing noisy data, especially astronomical data. For these datasets, the observed data may contain negative values due to noise even when the true underlying physical signal is strictly positive. Prior NMF work has not treated negative data in a statistically consistent manner, which becomes problematic for low signal-to-noise data with many negative values. In this paper we present two algorithms, Shift-NMF and Nearly-NMF, that can handle both the noisiness of the input data and also any introduced negativity. Both of these algorithms use the negative data space without clipping or masking and recover non-negative signals without any introduced positive offset that occurs when clipping or masking negative data. We demonstrate this numerically on both simple and more realistic examples, and prove that both algorithms have monotonically decreasing update rules.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS2004

Top-of-Atmosphere Direct Radiative Effect of Aerosols over Global Oceans from Merged CERES and MODIS Observations

The direct radiative effect of aerosols (DREA) is defined as the difference between radiative fluxes in the absence and presence of aerosols. In this study, the direct radiative effect of aerosols is estimated for 46 months (March, 2000 to December, 2003) of merged CERES and MODIS Terra global measurements over ocean. This analysis includes the contribution from clear regions in both clear and partly cloudy CERES footprints. MODIS-CERES narrow-to-broadband regressions are developed to convert clear-sky MODIS narrowband radiances to broadband SW radiances, and CERES clear-sky Angular Distribution Models (ADMs) are used to estimate the corresponding TOA radiative fluxes needed to determine the DREA. Clear-sky MODIS pixels are identified using two independent cloud masks: (i) the NOAA-NESDIS algorithm used for inferring aerosol properties from MODIS on the CERES Single Scanner Footprint TOA/Surface Fluxes and Clouds (SSF) product (NOAA-SSF); and (ii) the standard algorithm used by the MODIS aerosol group to produce the MODO4 product (MODO4). Over global oceans, direct radiative cooling by aerosols for clear scenes identified from MODO4 is estimated to be 5.5 W m-2, compared to 3.8 W m-2 for clear scenes from NOAA-SSF. Regionally, differences are largest in areas affected by dust aerosol, such as oceanic regions adjacent to the Saharan and Saudi Arabian deserts, and in northern Pacific Ocean regions influenced by dust transported from Asia. The net total-sky (clear and cloudy) DREA is negative (cooling) and is estimated to be -2.0 W m-2 from MOD04, and -1.6 W m-2 from NOAA-SSF. The DREA is shown to have pronounced seasonal cycles in the Northern Hemisphere and large year-to-year fluctuations near deserts. However, no systematic trend in deseasonalized anomalies of the DREA is observed over the 46-month time series considered.

Loeb, N. G.↗
NASA NTRS2013

Multi-sensor Cloud Retrieval Simulator and Remote Sensing from Model Parameters : Synthetic Sensor Radiance Formulation - Pt. 1

In this paper we describe a general procedure for calculating synthetic sensor radiances from variable output from a global atmospheric forecast model. In order to take proper account of the discrepancies between model resolution and sensor footprint, the algorithm takes explicit account of the model subgrid variability, in particular its description of the probability density function of total water (vapor and cloud condensate.) The simulated sensor radiances are then substituted into an operational remote sensing algorithm processing chain to produce a variety of remote sensing products that would normally be produced from actual sensor output. This output can then be used for a wide variety of purposes such as model parameter verification, remote sensing algorithm validation, testing of new retrieval methods and future sensor studies.We show a specific implementation using the GEOS-5 model, the MODIS instrument and the MODIS Adaptive Processing System (MODAPS) Data Collection 5.1 operational remote sensing cloud algorithm processing chain (including the cloud mask, cloud top properties and cloud optical and microphysical properties products). We focus on clouds because they are very important to model development and improvement.

Simulations↗
NASA NTRS2013

Equivalent Sensor Radiance Generation and Remote Sensing from Model Parameters: Equivalent Sensor Radiance Formulation - Part 1

In this paper we describe a general procedure for calculating equivalent sensor radiances from variables output from a global atmospheric forecast model. In order to take proper account of the discrepancies between model resolution and sensor footprint the algorithm takes explicit account of the model subgrid variability, in particular its description of the probably density function of total water (vapor and cloud condensate.) The equivalent sensor radiances are then substituted into an operational remote sensing algorithm processing chain to produce a variety of remote sensing products that would normally be produced from actual sensor output. This output can then be used for a wide variety of purposes such as model parameter verification, remote sensing algorithm validation, testing of new retrieval methods and future sensor studies. We show a specific implementation using the GEOS-5 model, the MODIS instrument and the MODIS Adaptive Processing System (MODAPS) Data Collection 5.1 operational remote sensing cloud algorithm processing chain (including the cloud mask, cloud top properties and cloud optical and microphysical properties products.) We focus on clouds and cloud/aerosol interactions, because they are very important to model development and improvement.

Simulations↗
NASA NTRS2016

Lenslet Array to Further Suppress Star Light for Direct Exoplanet Detection

Direct imaging plays a key role in the detection and characterization of exoplanets orbiting within its host star's habitable zone. Many innovative ideas for starlight suppression and wavefront control have been proposed and developed over the past decade. However, several technological challenges still lie ahead to achieve the required contrast, including controlling the observatory pointing performance, fabricating occulting masks with tight optical tolerances, developing wavefront control algorithms, controlling stray light, advancing single photon detecting detectors, and integrated system-level issues. This paper explores how a lenslet array and pinhole mask may be implemented to further suppress uncorrected starlight that leaks through the occulting mask. An external occulter, or star shade, is simulated to demonstrate this concept, although this approach can be implemented for internal coronagraphs as well. We describe how to use simple relay optics to control the scene near the inner working angle and the level of the suppression expected. Furthermore, if the lenslet array is the input to an integral field spectrograph, as planned for the WFIRST mission, the spectral content of the exoplanet atmospheres can be obtained to determine if the observed planet is habitable and ultimately, if it is inhabited.

Integral Field spectrograph↗
NASA NTRS2023

Passive Microwave Arctic Sea Ice Melt Onset Dates From the Advanced Horizontal Range Algorithm 1979 - 2022

The onset of the summer melt season is a key stage of the Arctic sea ice seasonal cycle and is an indicator of climate change. Surface melting of the bare or snow-covered sea ice is detected using passive microwave satellite observations. The data set presented here is a 44 year record of Arctic sea ice annual melt onset (MO) dates for 1979–2022 produced using an updated version of the Advanced Horizontal Range Algorithm (AHRA). This data product contains annual maps of the sea ice MO date and a set of descriptive statistics summarizing the data. This paper describes a new update of the AHRA methodology, now AHRA V5, including key changes to the algorithm starting date and sea ice mask methodology to improve estimates of early-season MO dates especially near the sea ice periphery. AHRA V5 data are suitable for monitoring trends in Arctic and regional sea ice MO dates and for process studies of atmosphere-sea ice interactions during the early spring and summer months.

Angela C. Bliss↗