Engineering PapersSearch

Engineering topics

Kuo, Kwo-Sen

Publications and source records attributed to Kuo, Kwo-Sen.

At least 19 records

The Combined Radar-Radiometer Algorithm — GPM Version 06X

The primary motivation behind the Version 6X (V06X) Combined Radar-Radiometer Algorithm (CORRA) is to utilize high-sensitivity mode (HS) Ka-band data that had been moved to locations in the outer part of the GPM Dual-Frequency Precipitation Radar (DPR) swath on May 21, 2018. Presented at the Precipitation Measurement Missions (PMM) meeting are statistics of CORRA precipitation estimates across both the inner and outer portions of the DPR swath for the purpose of identifying potential discontinuities caused by the new HS data. Although none are found, further investigation reveals possible biases caused by assumptions regarding radar pulse attenuation within the ground clutter of the DPR.

Olson, Bill

The OpenSSP Snow Particle and Scattering Property Database: Current Status and Future Plans

Understanding the connection between microphysical properties of falling snow and remote sensing observations requires detailed models of snow particles and the related electromagnetic scattering properties. To this end, we have created a database of synthetically-grown snow particles along with electromagnetic scattering properties calculated using advanced computational methods. We showcase the breadth of the catalog, current work, applications of the catalog, and future plans.

Adams, Ian S.

Quantifying the Relative Impact of Model Microphysics Parameterizations and Scattering Models in Simulating Synthetic Radar and Microwave Radiometer Observations

Output from numerical weather models is often used to simulate observations from remote sensing instruments, for purposes ranging from data assimilation, synthetic retrievals of geophysical quantities, and optimization of observing systems. However, when hydrometeors are present, the level of detail provided by the weather model is generally insufficient to fully constrain the input to the radiative transfer model (RTM), and further assumptions must be made by the RTM user in order to produce synthetic observations. Using a hierarchy of models including cloud-resolving, double-moment, bin microphysical, and ice-habit predicting models, along with scattering properties from the OpenSSP, Atmospheric Radiative Transfer Simulator (ARTS) databases, as well as relatively simple geometries (e.g., cylindrical plates and columns), we demonstrate the spread in synthetic observation output and the extent to which it is reduced when microphysics is more strongly constrained by the model. As an intermediate step, an error budget for the RTM simulations was derived and from that we developed and will describe best practices for observation simulation (e.g., optimal number of hydrometeor size bins, truncation of the particle size distribution, angular resolution of scattering phase function). Some statistical comparisons with observations will also be presented.

Munchak, S. Joseph

Active and Passive Radiative Transfer Simulations for GPM-Related Field Campaigns

Using a three-dimensional radiative transfer model combined with cloud-resolving model output, we simulate active and passive sensor observations of clouds and precipitaiton. This combination of tools allows us to diagnose the contributions of various hydrometeor types. Radar multiple scattering is most closely associated with the presence of graupel. At Wband, massive amounts multiple scattering in deep convection can decorrelate the reflectivity profile from the vertical structure, but for less intense events, multiple scattering could be a useful indicator of riming. For passive sensors, polarization differences at 166 GHz indicate the presence of horizontally aligned frozen particles with pronounced aspect ratios, while high concentrations of more isotropic aggregates and graupel dampen the polarization difference while also contributing to the lowest brightness temperature depressions. The insights into remote sensing measurements will facilitate the development of improved algorithms and advanced sensors.

Adams, Ian S.

Active and Passive Radiative Transfer Modeling of the Olympic Mountains Experiment

Sensor forward models are an important tool for interpreting remote sensing observations of geophysical phenomena. By implementing a three-dimensional framework, we can simulate and analyze observations from various sensors on disparate platforms. To demonstrate our model framework, we simulate observations from the Olympic Mountains Experiment (OLYMPEX). The use of cloud model simulations allows us to understand sensor response to cloud ice, falling snow, and other processes and features, and the application of model tools to observations allows us to quantify precipitation.MIIST 3D Forward ModelThe Multi-Instrument Inverse Solver Testbed(MIIST) uses the Atmospheric Radiative TransferSimulator (ARTS) for solving the vector radiativetransfer (RT) equation in up to three spatialdimensions within a spherical geometry• Gas absorptiono Line-by-line calculationso Fast transmittance tables• Hydrometeor scattering solverso Discrete ordinateo RT4 (Evans, 1D)o Radar Single Scattering (1D or 3D)o Monte Carlo (3D)Scattering TablesHigh-fidelity hydrometeor scatteringtables are necessary for accurateand consistent forward modeling ofmulti-frequency observations• Requires full Stokes matriceso And absorption vector• Randomly oriented particleso Discrete Dipole Approximationo Characteristic Basis Function Method(coming soon)• Horizontally-oriented plateso Invariant Imbedding T-matrix MethodCloud Resolving SimulationsCloud resolving simulations (e.g.,NU-WRF) supply output consistentwith ARTS needs• Atmospheric Informationo Temperatureo Pressure / heighto Water vapor• Hydrometeor Profileso ARTS architecture ripe for explicit binmicrophysics• Examples use Morrison 2M schemeThe Olympic Mountains Experiment (OLYMPEX)Validation for GPM of mid-latitudefrontal systems approaching nearcoastalmountains from the ocean• Large collection of ground-based andairborne sensorso Radarso Radiometerso In situ• Contemporaneous with RADEXo Two sets of radar at same frequenciesRadiometer Simulation (3 km NUWRF, 20151203, 15:00)2018.12.14 7Simulate 166 GHz polarizationdifference• Corresponds to the presence of aligned icecrystals• Look at trends for both simulations andobservations• Simulations can tolerate lower resolutiono Larger domainSimulations from Observations: OLYMPEXSimulate sensor response usinggeophysical retrievals as input• Single frequency radar retrievals• Multiple scattering enhancementapparent at W band• Spatially dependent phenomenonModeling Application: 1D Retrievals03 December 2015• DC-8 and ER-2 flightso Focus on APR-3 (DC-8)• Citationo Stacked microphysics legso Qualitative comparisonso Range of frozen habitso Presence of supercooledliquid cloudsResults• Retrievals match probeso Good qualitative match• Bands of increasedreflectivity correspond tolarge Dm and highaggregate fraction• Significant amounts ofsupercooled liquid water

Adams, Ian S.

Invariant Imbedded T-Matrix Method for Axial Symmetric Hydrometeors with Extreme Aspect Ratios

The single-scattering properties (SSPs) of hydrometeors are the fundamental quantities for physics-based precipitation retrievals. Thus, efficient computation of their electromagnetic scattering is of great value. Whereas the semi-analytical T-Matrix methods are likely the most efficient for nonspherical hydrometeors with axial symmetry, they are not suitable for arbitrarily shaped hydrometeors absent of any significant symmetry, for which volume integral methods such as those based on Discrete Dipole Approximation (DDA) are required. Currently the two leading T-matrix methods are the Extended Boundary Condition Method (EBCM) and the Invariant Imbedding T-matrix Method incorporating Lorentz-Mie Separation of Variables (IITM+SOV). EBCM is known to outperform IITM+SOV for hydrometeors with modest aspect ratios. However, in cases when aspect ratios become extreme, such as needle-like particles with large height to diameter values, EBCM fails to converge. Such hydrometeors with extreme aspect ratios are known to be present in solid precipitation and their SSPs are required to model the radiative responses accurately. In these cases, IITM+SOV is shown to converge. An efficient, parallelized C++ implementation for both EBCM and IITM+SOV has been developed to conduct a performance comparison between EBCM, IITM+SOV, and DDSCAT (a popular implementation of DDA). We present the comparison results and discuss details. Our intent is to release the combined ECBM IITM+SOV software to the community under an open source license.

Pelissier, Craig

Limiting Data Friction by Reducing Data Download Using Spatiotemporally Aligned Data Organization Through STARE

Current data processing practice limits the volume and variety of relevant geoscience data that can practically be applied to important problems. File archives in centralized data centers are the principal means by which Earth Science data are accessed. This approach, however, requires laborious search, retrieval, and eventual customization/adaptation for the data to be used. Such fractionation makes it even more difficult to share outcomes, i.e. research artifacts and data products, hampering reusability and repeatability, since end users generally have their own research agenda and preferences as well as scarce resources. Thus, while finding and downloading data files from central data centers are already costly for end users working in their own field, using data products from other disciplines rapidly becomes prohibitive. This curtails scientific productivity, limits avenues of study, and endangers quality and reproducibility. The Spatio-Temporal Adaptive Resolution Encoding (STARE) is a unifying scheme that facilitates the indexing, access, and fusion of diverse Earth Science data. STARE implements an innovative encoding of geo-spatiotemporal information, originally developed for aligning datasets with diverse spatiotemporal characteristics in an array database. The spatial component of STARE recursively quadfurcates a root polyhedron, producing a hierarchical scheme for addressing geographic locations and regions. The temporal component of STARE uses conventional date-time units as an indexing hierarchy. The additional encoding of spatial and temporal resolution information in STARE enables comparisons and conditional selections across diverse datasets. Moreover, spatiotemporal set-operations, e.g. union and intersection, are mapped to efficient integer operations with STARE. Applied to existing data models (point, grid, spacecraft swath) and corresponding granules, STARE indexes provide a streamlined description usable as geo-spatiotemporal metadata. When coupled with large scale, distributed hardware and software, STARE-based data access reduces pre-analysis data preparation costs by offering a convenient means to align different datasets spatiotemporally without specialized effort in parallel computing or distributed data management.

Kuo, Kwo-Sen

An Innovative Infrastructure with a Universal Geo-Spatiotemporal Data Representation Supporting Cost-Effective Integration of Diverse Earth Science Data

The SpatioTemporal Adaptive Resolution Encoding (STARE) is a unifying scheme encoding geospatial and temporal information for organizing data on scalable computing/storage resources, minimizing expensive data transfers. STARE provides a compact representation that turns set-logic functions into integer operations, e.g. conditional sub-setting, taking into account representative spatiotemporal resolutions of the data in the datasets. STARE geo-spatiotemporally aligns data placements of diverse data on massive parallel resources to maximize performance. Automating important scientific functions (e.g. regridding) and computational functions (e.g. data placement) allows scientists to focus on domain-specific questions instead of expending their efforts and expertise on data processing. With STARE-enabled automation, SciDB (Scientific Database) plus STARE provides a database interface, reducing costly data preparation, increasing the volume and variety of interoperable data, and easing result sharing. Using SciDB plus STARE as part of an integrated analysis infrastructure dramatically eases combining diametrically different datasets.

Rilee, Michael Lee

Active and Passive 3D Vector Radiative Transfer with Preferentially-Aligned Ice Particles

For the purposes of interpreting active (radar) and passive (radiometer) microwave and millimeter wave remote sensing data, we have constructed a consistent radiative transfer modeling framework to simulate the responses for arbitrary sensors with differing sensing geometries and hardware configurations. As part of this work, we have implemented a recent method for calculating the electromagnetic properties of individual ice crystals and snow flakes. These calculations will allow us to exploit polarized remote sensing observations to discriminate different particles types and elucidate dynamics of cloud and precipitating systems.

Adams, Ian S.

Polycrystal Snowfakes

Building on the previous success of a mono-crystal snowflake growth model, a team of NASA researchers has invented and implemented a poly-crystal variant of the model to simulate simultaneous crystalline growth along lattices of different orientations. Inferring snowfall intensity and amount using remote sensing relies on knowing the scattering properties of snowing particles. However, these scattering properties depend strongly on the geometric shapes of the snowing particles. Poly-crystal snow particles, such as bullet rosettes, appear frequently in nature. Simulating the growth of both mono-crystal and poly-crystal particles and obtaining accurate scattering properties are paramount for furthering accurate quantitative estimates of snowfalls.

Clune, Tom

MCRadar: A Monte Carlo Solver for Cloud and Precipitation Radar

Multiple scattering produces anomalous echoes in observed radar profiles that cannot be explained by other phenomena. These effects are most obvious for spaceborne platforms, at shorter wavelengths, and in convection, as multiple scattering is governed by antenna beam width, optical depth, and albe do; however, multiple scattering has been observed in a range of precipitating conditions. To account for the effects of multiple scattering, Monte Carlo integration is employed in a flexible framework to enable arbitrary radar configurations with finite Gaussian beams for three-dimensional atmospheric scenarios. The three-dimensional nature of the model, coupled with the finite antenna response, also allows for consideration of nonuniform beam filling effects that often coincide with multiple scattering. Examples of airborne and spaceborne radars at various wavelengths are used to illustrate the effects of multiple scattering and nonuniform beam filling. The MCRadar code is currently available in the development version of ARTS.

Adams, Ian Stuart

An Application Programming Interface for Synthetic Snowflake Particle Structure and Scattering Data

The work by Kuo and colleagues on growing synthetic snowflakes and calculating their single-scattering properties has demonstrated great potential to improve the retrievals of snowfall. To grant colleagues flexible and targeted access to their large collection of sizes and shapes at fifteen (15) microwave frequencies, we have developed a web-based Application Programming Interface (API) integrated with NASA Goddard's Precipitation Processing System (PPS) Group. It is our hope that the API will enable convenient programmatic utilization of the database. To help users better understand the API's capabilities, we have developed an interactive web interface called the OpenSSP API Query Builder, which implements an intuitive system of mechanisms for selecting shapes, sizes, and frequencies to generate queries, with which the API can then extract and return data from the database. The Query Builder also allows for the specification of normalized particle size distributions by setting pertinent parameters, with which the API can also return mean geometric and scattering properties for each size bin. Additionally, the Query Builder interface enables downloading of raw scattering and particle structure data packages. This presentation will describe some of the challenges and successes associated with developing such an API. Examples of its usage will be shown both through downloading output and pulling it into a spreadsheet, as well as querying the API programmatically and working with the output in code.

reflectivity properties of snowflakes

Benchmark Comparison of Cloud Analytics Methods Applied to Earth Observations

Cloud computing has the potential to bring high performance computing capabilities to the average science researcher. However, in order to take full advantage of cloud capabilities, the science data used in the analysis must often be reorganized. This typically involves sharding the data across multiple nodes to enable relatively fine-grained parallelism. This can be either via cloud-based file systems or cloud-enabled databases such as Cassandra, Rasdaman or SciDB. Since storing an extra copy of data leads to increased cost and data management complexity, NASA is interested in determining the benefits and costs of various cloud analytics methods for real Earth Observation cases. Accordingly, NASA's Earth Science Technology Office and Earth Science Data and Information Systems project have teamed with cloud analytics practitioners to run a benchmark comparison on cloud analytics methods using the same input data and analysis algorithms. We have particularly looked at analysis algorithms that work over long time series, because these are particularly intractable for many Earth Observation datasets which typically store data with one or just a few time steps per file. This post will present side-by-side cost and performance results for several common Earth observation analysis operations.

science data management

Implementing Connected Component Labeling as a User Defined Operator for SciDB

We have implemented a flexible User Defined Operator (UDO) for labeling connected components of a binary mask expressed as an array in SciDB, a parallel distributed database management system based on the array data model. This UDO is able to process very large multidimensional arrays by exploiting SciDB's memory management mechanism that efficiently manipulates arrays whose memory requirements far exceed available physical memory. The UDO takes as primary inputs a binary mask array and a binary stencil array that specifies the connectivity of a given cell to its neighbors. The UDO returns an array of the same shape as the input mask array with each foreground cell containing the label of the component it belongs to. By default, dimensions are treated as non-periodic, but the UDO also accepts optional input parameters to specify periodicity in any of the array dimensions. The UDO requires four stages to completely label connected components. In the first stage, labels are computed for each subarray or chunk of the mask array in parallel across SciDB instances using the weighted quick union (WQU) with half-path compression algorithm. In the second stage, labels around chunk boundaries from the first stage are stored in a temporary SciDB array that is then replicated across all SciDB instances. Equivalences are resolved by again applying the WQU algorithm to these boundary labels. In the third stage, relabeling is done for each chunk using the resolved equivalences. In the fourth stage, the resolved labels, which so far are "flattened" coordinates of the original binary mask array, are renamed with sequential integers for legibility. The UDO is demonstrated on a 3-D mask of O(1011) elements, with O(108) foreground cells and O(106) connected components. The operator completes in 19 minutes using 84 SciDB instances.

UDO