Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “robust regression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24

Probabilistic limit of detection for ricin identification using a shotgun proteomics assay

Robust and highly specific methods for the detection of the protein toxin ricin are of interest to the law enforcement community. In previous studies, methods based on liquid chromatography-tandem mass spectrometry shotgun proteomics have been proposed. The successful implementation of this approach relies on specific data evaluation criteria addressing (1) the quality of the mass spectrometric data, (2) the confidence of peptide identifications (peptide-spectrum matches), and (3) the number and sequence specificity of peptides detected. We present such data evaluation criteria, and use a novel approach to establish the limit of detection for this ricin assay. Specifically, we use logistic regression to determine the probability of detection for individual ricin peptides at different concentrations. We then apply basic rules from probability theory, combining these individual peptide probabilities into an overall assay limit of detection. This procedure yields an assay limit of detection for ricin at 42.5 ng on column or 21.25 ng/µL for a 2-µL injection. We also show that, in spite of the conventional wisdom that detergents are deleterious to mass spectrometric analyses, the presence of Tween-20 did not prevent detection of ricin peptides, and indeed assays performed in buffers that included Tween-20 gave better results than assays performed using other buffer formulations with or without detergent removal.

Heller, Natalie C.↗

ASP (Adaptive Splines for Prediction) [SWR-22-66]

This software package provides functionality to fit piecewise cubic splines to model the relationship between a univariate X (independent variable) and a univariate Y (dependent variable). The output is akin to linear regression but has higher "capacity" in that it can learn more complicated relationships despite leveraging only a single predictor. It thus can learn very reasonable relationships between X and Y with minimal effort. The canonical intended use case is for predicting electric demand (Y) from temperature (X). There can be complicated, non-linear relationships between these two variables, but these can be reasonably approximated by the sum of: 1) an "aggregate" relationship between daily average temperature and daily average demand, and 2) intra-day patterns represented as hourly offsets from the daily average load. The spline functionality is used for learning a robust "aggregate" relationship without the inconvenience of manual feature engineering while still ensuring robust results. The model fitting workhorse is R's built-in smooth.spline. This package provides a suite of options for controlling how smooth.spline fits a spline to the data. In particular, it is designed to return a model with a single critical point (i.e., a single location along the domain/support where the first derivative is zero). This is to ensure that predicted changes in electric demand are always positive as temperatures become more extreme. This helps to prevent overfitting, particularly when the input data has few observations or has significant uncertainty from other sources.

Murphy, Sinnott↗

Dynamical Downscaling of Earth System Model Data for Energy System Analysis

Assessing energy resources (e.g., solar, wind, and hydro) under future scenarios requires datasets with sufficient spatial and temporal detail to capture variability and extreme events. While global-scale Earth System Model (ESM) projections are widely used, their coarse resolution limits direct application to regional energy system analyses. Dynamical downscaling offers a robust approach to generate physically consistent, fine-scale datasets that better represent local atmospheric processes impacting energy resources. In this work, we present a two-stage approach for producing high-resolution historical and future projections over the contiguous United States (CONUS). First, we optimize the Weather Research and Forecasting (WRF) model configuration for energy-relevant variables - solar irradiance, wind speed, and precipitation - by conducting ERA5-driven simulations at 8-km and 28-km resolution. Multiple physics schemes and model configurations within the WRF are evaluated against observational datasets including the National Solar Radiation Database (NSRDB), the Parameter-elevation Regressions on Independent Slopes Model (PRISM), and the Stage IV multi-radar/multi-sensor precipitation product for the CONUS domain. Using the best-performing configuration, we dynamically downscale MPI-ESM1-2-HR simulations for 2000-2060 under SSP2-4.5 and SSP5-8.5 scenarios at 4-km spatial and hourly temporal resolution. This presentation will provide a comprehensive analysis of the results from multiple numerical experiments and high-resolution ESM projections. In addition, we will discuss potential applications of our high-resolution datasets within the energy sector and outline future research avenues dedicated to evaluating how extreme weather events influence system performance and resilience.

24 POWER TRANSMISSION AND DISTRIBUTION↗

MnEdgeNet for accurate decomposition of mixed oxidation states for Mn XAS and EELS L2,3 edges without reference and calibration

Accurate decomposition of the mixed Mn oxidation states is highly important for characterizing the electronic structures, charge transfer and redox centers for electronic, and electrocatalytic and energy storage materials that contain Mn. Electron energy loss spectroscopy (EELS) and soft X-ray absorption spectroscopy (XAS) measurements of the Mn L2,3 edges are widely used for this purpose. To date, although the measurements of the Mn L2,3 edges are straightforward given the sample is prepared properly, an accurate decomposition of the mix valence states of Mn remains non-trivial. For both EELS and XAS, 2+, 3+, and 4+ reference spectra need to be taken on the same instrument/beamline and preferably in the same experimental session because the instrumental resolution and the energy axis offset could vary from one session to another. To circumvent this hurdle, in this study, we adopted a deep learning approach and developed a calibration-free and reference-free method to decompose the oxidation state of Mn L2,3 edges for both EELS and XAS. A deep learning regression model is trained to accurately predict the composition of the mix valence state of Mn. To synthesize physics-informed and ground-truth labeled training datasets, we created a forward model that takes into account plural scattering, instrumentation broadening, noise, and energy axis offset. With that, we created a 1.2 million-spectrum database with 1-by-3 oxidation state composition ground truth vectors. The library includes a sufficient variety of data including both EELS and XAS spectra. By training on this large database, our convolutional neural network achieves 85% accuracy on the validation dataset. We tested the model and found it is robust against noise (down to PSNR of 10) and plural scattering (up to t/λ = 1). We further validated the model against spectral data that were not used in training. In particular, the model shows high accuracy and high sensitivity for the decomposition of Mn 3 O 4 , MnO, Mn 2 O 3 , and MnO 2 . The accurate decomposition of Mn 3 O 4 experimental data shows the model is quantitatively correct and can be deployed for real experimental data. Our model will not only be a valuable tool to researchers and material scientists but also can assist experienced electron microscopists and synchrotron scientists in the automated analysis of Mn L edge data.

25 ENERGY STORAGE↗

A Climate and History Case Study of 18th- and 19th-Century Multidecadal Droughts in East Africa Using a new Tree-Ring Drought Atlas

Historians and paleoclimatologists have both identified the decades spanning the late-18th and early-19th centuries in many East African regions as a period of prolonged and severe drought. A challenge that emerges from both the historical evidence and the paleolimnological data that have been primarily used to characterize this drought period, however, concerns the dating of events and the characterization of their spatial character; both oral traditions and lake-core proxies cannot typically offer hydroclimate estimates with seasonal or annual resolution, nor can they provide gridded reconstructions on the order of 1° latitude and longitude. The new East African Drought Atlas (EADA) incorporates far-field dendroclimatic records and several local East African tree-ring chronologies to provide estimates of the self-calibrating Palmer Drought Severity Index (scPDSI) on a 0.5° latitude-longitude grid. We present the Point-by-Point Regression technique that was used to create the EADA, the rationale for the employed input data network, and the calibration and validation skill of the derived hydroclimatic field reconstruction. We use the EADA to characterize the timing of two decadal-scale droughts, centered over the Uganda and Kenya regions, which occurred in the late 18th century and early in the 19th century and were separated by a shorter, but pronounced wet period. We characterize the spatial patterns of the associated events and the dynamical causes that that the patterns imply. The reconstructed droughts are also compared to historical and paleolimnological data to evaluate the robustness of the reconstruction and the degree of agreement across the different sources of information.

Droughts↗

A Climate and History Case Study of 18th- and 19th-Century Multidecadal Droughts in East Africa Using a new Tree-Ring Drought Atlas

Historians and paleoclimatologists have both identified the decades spanning the late-18th and early-19th centuries in many East African regions as a period of prolonged and severe drought. A challenge that emerges from both the historical evidence and the paleolimnological data that have been primarily used to characterize this drought period, however, concerns the dating of events and the characterization of their spatial character; both oral traditions and lake-core proxies cannot typically offer hydroclimate estimates with seasonal or annual resolution, nor can they provide gridded reconstructions on the order of 1° latitude and longitude. The new East African Drought Atlas (EADA) incorporates far-field dendroclimatic records and several local East African tree-ring chronologies to provide estimates of the self-calibrating Palmer Drought Severity Index (scPDSI) on a 0.5° latitude-longitude grid. We present the Point-by-Point Regression technique that was used to create the EADA, the rationale for the employed input data network, and the calibration and validation skill of the derived hydroclimatic field reconstruction. We use the EADA to characterize the timing of two decadal-scale droughts, centered over the Uganda and Kenya regions, which occurred in the late 18th century and early in the 19th century and were separated by a shorter, but pronounced wet period. We characterize the spatial patterns of the associated events and the dynamical causes that that the patterns imply. The reconstructed droughts are also compared to historical and paleolimnological data to evaluate the robustness of the reconstruction and the degree of agreement across the different sources of information.

Droughts↗

Aemulus ν: precision halo mass functions in wνCDM cosmologies

Precise and accurate predictions of the halo mass function for cluster mass scales in wνCDM cosmologies are crucial for extracting robust and unbiased cosmological information from upcoming galaxy cluster surveys. Here, we present a halo mass function emulator for cluster mass scales (≳ 1013 M ⊙/h) up to redshift z = 2 with comprehensive support for the parameter space of wνCDM cosmologies allowed by current data. Based on the Aemulus ν suite of simulations, the emulator marks a significant improvement in the precision of halo mass function predictions by incorporating both massive neutrinos and non-standard dark energy equation of state models. This allows for accurate modeling of the cosmology dependence in large-scale structure and galaxy cluster studies. We show that the emulator, designed using Gaussian Process Regression, has negligible theoretical uncertainties compared to dominant sources of error in future cluster abundance studies. Our emulator is publicly available (https://github.com/DelonShen/aemulusnu_hmf), providing the community with a crucial tool for upcoming cosmological surveys such as LSST and Euclid.

cluster counts↗

Open Science Approach to Analyze Climate-Crop Relationships in the US Leveraging GES DISC and Galaxy Workflows

Understanding the intricate relationship between climate variability and agricultural production is crucial for ensuring food security. This study investigates the impact of climate parameters, such as temperature, precipitation, and soil moisture, on major US crop yields. Adopting an open science approach, the study analyzes the impact of climate on agricultural production in the United States. The Galaxy workflow engine serves as the primary tool for integrating climate data from the Goddard Earth Sciences Data and Information Services Center (GES DISC), retrieved via the Giovanni system, with yield statistics from the United States Department of Agriculture’s National Agricultural Statistics Service (USDA NASS). Extensions for reading, preprocessing, and analyzing external data have been developed, enabling the creation of workflows within the Galaxy platform. The development of a reproducible workflow allows for the calculation of seasonal climate averages, which are then assessed for their correlation with crop yields. This methodology ensures the replicability of the research, promoting transparency and collaboration in the scientific community. Correlational and regression analyses have been applied to different sub-zones and crops. The findings from this research offer valuable insights into the relationship between climate parameters and crop yields. These insights contribute to a deeper understanding of climate-crop relationships, providing a solid foundation for informed decision-making in the agricultural sector. The high correlation values indicate a significant relationship between climate parameters and crop yields, underscoring the importance of considering climate factors in agricultural planning and policymaking. This research also exemplifies the power of open science in advancing our understanding of complex environmental and agricultural phenomena. By leveraging open data and services, it provides a robust and replicable framework for future studies in this critical field.

Open science↗

Impact of acetic acid exposure on metal contact degradation of different crystalline silicon solar cell technologies

Degradation due to acetic acid in photovoltaic (PV) modules has been a commonly observed phenomenon for both damp-heat exposure and outdoor operations. Acetic acid is a degradation byproduct of ethylene-vinyl acetate (EVA), a common module encapsulant. To address this issue, robust metallization pastes and cell technologies are being developed. However, it is important to assess how these technologies perform in an acetic acid environment and withstand degradation before they are implemented in the solar market. In this work, we investigate the impact of acetic acid exposure on four different cell groups: monofacial passivated emitter and rear contact (PERC) cells with advanced telluride-based front contact pastes, bifacial PERC cells with novel aluminum rear contact pastes, bifacial tunnel oxide passivated contacts (TOPCon) cells, and silicon heterojunction (SHJ) cells. These cells were exposed to acetic acid for different time increments. The recombination losses were characterized by Suns-VOC, and multi-variate regression analysis of intensity-dependent photoluminescence (PL) images with Griddler AI. Resistive losses were tracked with the transmission line method (TLM). Samples showing severe performance degradation were selected for further materials characterization to understand the root cause. Top-down and cross-sectional scanning electron microscopy (SEM), energy dispersive spectroscopy (EDS), and X-ray photoelectron spectroscopy (XPS) were performed to investigate the change in materials properties. Our study shows that the front contacts of the bifacial TOPCon cells and monofacial PERC cells were significantly affected by acetic acid exposure. Here, the SHJ cells were found to be the most stable.

14 SOLAR ENERGY↗

Three-dimensional segmentation of luminal and adventitial borders in serial intravascular ultrasound images

Intravascular ultrasound (IVUS) provides exact anatomy of arteries, allowing accurate quantitative analysis. Automated segmentation of IVUS images is a prerequisite for routine quantitative analyses. We present a new three-dimensional (3D) segmentation technique, called active surface segmentation, which detects luminal and adventitial borders in IVUS pullback examinations of coronary arteries. The technique was validated against expert tracings by computing correlation coefficients (range 0.83-0.97) and William's index values (range 0.37-0.66). The technique was statistically accurate, robust to image artifacts, and capable of segmenting a large number of images rapidly. Active surface segmentation enabled geometrically accurate 3D reconstruction and visualization of coronary arteries and volumetric measurements.

NASA Discipline Cardiopulmonary↗

Elimination of drift in a fiber-Bragg-grating-based multiplexed Michelson interferometer measurement system

Random phase drift in single-mode optical fiber interferometers used with measurement systems, which is resulted from various types of environmental disturbances, should be eliminated in order to obtain high measurement precision. We propose an optical fiber interferometric measurement system which has the function of self-eliminating the random phase drift and is stable and robust enough for real-time precision measurement. By employing the characteristics of fiber Bragg gratings, the system interleaves two fiber Michelson interferometers together that share the common-interferometric-optical path. The signal of one of the interferometers is used to stabilize the system while the signal of the other interferometer is used for measurement. An electronic feedback loop for the stabilizing action is designed. The bandwidth of the feedback loop is 5 kHz, sufficiently wide to eliminate random phase drift resulted from various environmental disturbances. The system is endowed with high stability and therefore suitable for real-time precision measurement. By means of an active phase tracking technique to measure displacement, the linear regression coefficient of the displacement measurement results is 0.9998.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Navigating Transition-Metal Chemical Space: Artificial Intelligence for First-Principles Design

Conspectus The variability of chemical bonding in open-shell transition-metal complexes not only motivates their study as functional materials and catalysts but also challenges conventional computational modeling tools. Here, tailoring ligand chemistry can alter preferred spin or oxidation states as well as electronic structure properties and reactivity, creating vast regions of chemical space to explore when designing new materials atom by atom. Although first-principles density functional theory (DFT) remains the workhorse of computational chemistry in mechanism deduction and property prediction, it is of limited use here. DFT is both far too computationally costly for widespread exploration of transition-metal chemical space and also prone to inaccuracies that limit its predictive performance for localized d electrons in transition-metal complexes. These challenges starkly contrast with the well-trodden regions of small-organic-molecule chemical space, where the analytical forms of molecular mechanics force fields and semiempirical theories have for decades accelerated the discovery of new molecules, accurate DFT functional performance has been demonstrated, and gold-standard methods from correlated wavefunction theory can predict experimental results to chemical accuracy. The combined promise of transition-metal chemical space exploration and lack of established tools has mandated a distinct approach. In this Account, we outline the path we charted in exploration of transition-metal chemical space starting from the first machine learning (ML) models (i.e., artificial neural network and kernel ridge regression) and representations for the prediction of open-shell transition-metal complex properties. The distinct importance of the immediate coordination environment of the metal center as well as the lack of low-level methods to accurately predict structural properties in this coordination environment first motivated and then benefited from these ML models and representations. Once developed, the recipe for prediction of geometric, spin state, and redox potential properties was straightforwardly extended to a diverse range of other properties, including in catalysis, computational “feasibility”, and the gas separation properties of periodic metal–organic frameworks. Interpretation of selected features most important for model prediction revealed new ways to encapsulate design rules and confirmed that models were robustly mapping essential structure–property relationships. Encountering the special challenge of ensuring that good model performance could generalize to new discovery targets motivated investigation of how to best carry out model uncertainty quantification. Distance-based approaches, whether in model latent space or in carefully engineered feature space, provided intuitive measures of the domain of applicability. With all of these pieces together, ML can be harnessed as an engine to tackle the large-scale exploration of transition-metal chemical space needed to satisfy multiple objectives using efficient global optimization methods. In practical terms, bringing these artificial intelligence tools to bear on the problems of transition-metal chemical space exploration has resulted in ML-model assessments of large, multimillion compound spaces in minutes and validated new design leads in weeks instead of decades.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

System Synthesis in Preliminary Aircraft Design using Statistical Methods

This paper documents an approach to conceptual and preliminary aircraft design in which system synthesis is achieved using statistical methods, specifically design of experiments (DOE) and response surface methodology (RSM). These methods are employed in order to more efficiently search the design space for optimum configurations. In particular, a methodology incorporating three uses of these techniques is presented. First, response surface equations are formed which represent aerodynamic analyses, in the form of regression polynomials, which are more sophisticated than generally available in early design stages. Next, a regression equation for an overall evaluation criterion is constructed for the purpose of constrained optimization at the system level. This optimization, though achieved in a innovative way, is still traditional in that it is a point design solution. The methodology put forward here remedies this by introducing uncertainty into the problem, resulting a solutions which are probabilistic in nature. DOE/RSM is used for the third time in this setting. The process is demonstrated through a detailed aero-propulsion optimization of a high speed civil transport. Fundamental goals of the methodology, then, are to introduce higher fidelity disciplinary analyses to the conceptual aircraft synthesis and provide a roadmap for transitioning from point solutions to probabalistic designs (and eventually robust ones).

DeLaurentis, Daniel↗

System Synthesis in Preliminary Aircraft Design Using Statistical Methods

This paper documents an approach to conceptual and early preliminary aircraft design in which system synthesis is achieved using statistical methods, specifically Design of Experiments (DOE) and Response Surface Methodology (RSM). These methods are employed in order to more efficiently search the design space for optimum configurations. In particular, a methodology incorporating three uses of these techniques is presented. First, response surface equations are formed which represent aerodynamic analyses, in the form of regression polynomials, which are more sophisticated than generally available in early design stages. Next, a regression equation for an Overall Evaluation Criterion is constructed for the purpose of constrained optimization at the system level. This optimization, though achieved in an innovative way, is still traditional in that it is a point design solution. The methodology put forward here remedies this by introducing uncertainty into the problem, resulting in solutions which are probabilistic in nature. DOE/RSM is used for the third time in this setting. The process is demonstrated through a detailed aero-propulsion optimization of a High Speed Civil Transport. Fundamental goals of the methodology, then, are to introduce higher fidelity disciplinary analyses to the conceptual aircraft synthesis and provide a roadmap for transitioning from point solutions to probabilistic designs (and eventually robust ones).

DeLaurentis, Daniel↗

Time-on-task decrements in "steer clear" performance of patients with sleep apnea and narcolepsy

Loss of attention with time-on-task reflects the increasing instability of the waking state during performance in experimentally induced sleepiness. To determine whether patients with disorders of excessive sleepiness also displayed time-on-task decrements indicative of wake state instability, visual sustained attention performance on "Steer Clear," a computerized simple RT driving simulation task, was compared among 31 patients with untreated sleep apnea, 16 patients with narcolepsy, and 14 healthy control subjects. Vigilance decrement functions were generated by analyzing the number of collisions in each of six four-minute periods of Steer Clear task performance in a mixed-model analysis of variance and linear regression equations. As expected, patients had more Steer Clear collisions than control subjects (p=0.006). However, the inter-subject variability in errors among the narcoleptic patients was four-fold that of the apnea patients, and 100-fold that of the controls volunteers; the variance in errors among untreated apnea patients was 27-times that of controls. The results of transformed collision data revealed main effects for group (p=0.006), time-on-task (p=0.001), and a significant interaction (p=0.022). Control subjects showed no clear evidence of increasing collision errors with time-on-task (adjusted R2=0.22), while apnea patients showed a trend toward vigilance decrement (adjusted R2=0.42, p=0.097), and narcolepsy patients evidenced a robust linear vigilance decrement (adjusted R2=0.87, p=0.004). The association of disorders of excessive somnolence with escalating time-on-task decrements makes it imperative that when assessment of neurobehavioral performance is conducted in patients, it involves task durations and analyses that will evaluate the underlying vulnerability of potentially sleepy patients to decrements over time in tasks that require sustained attention and timely responses, both of which are key components in safe driving performance.

NASA Discipline Space Human Factors↗

A Deep Neural Network for Accurate and Robust Prediction of the Glass Transition Temperature of Polyhydroxyalkanoate Homo- and Copolymers

The purpose of this study was to develop a data-driven machine learning model to predict the performance properties of polyhydroxyalkanoates (PHAs), a group of biosourced polyesters featuring excellent performance, to guide future design and synthesis experiments. A deep neural network (DNN) machine learning model was built for predicting the glass transition temperature, Tg, of PHA homo- and copolymers. Molecular fingerprints were used to capture the structural and atomic information of PHA monomers. The other input variables included the molecular weight, the polydispersity index, and the percentage of each monomer in the homo- and copolymers. The results indicate that the DNN model achieves high accuracy in estimation of the glass transition temperature of PHAs. In addition, the symmetry of the DNN model is ensured by incorporating symmetry data in the training process. The DNN model achieved better performance than the support vector machine (SVD), a nonlinear ML model and least absolute shrinkage and selection operator (LASSO), a sparse linear regression model. The relative importance of factors affecting the DNN model prediction were analyzed. Sensitivity of the DNN model, including strategies to deal with missing data, were also investigated. Compared with commonly used machine learning models incorporating quantitative structure–property (QSPR) relationships, it does not require an explicit descriptor selection step but shows a comparable performance. The machine learning model framework can be readily extended to predict other properties.

quantitative structure–property relationship (QSPR↗

Using machine learning to derive cloud condensation nuclei number concentrations from commonly available measurements

Cloud condensation nuclei (CCN) number concentrations are an important aspect of aerosol–cloud interactions and the subsequent climate effects; however, their measurements are very limited. We use a machine learning tool, random decision forests, to develop a random forest regression model (RFRM) to derive CCN at 0.4 % supersaturation ([CCN0.4]) from commonly available measurements. The RFRM is trained on the long-term simulations in a global size-resolved particle microphysics model. Using atmospheric state and composition variables as predictors, through associations of their variabilities, the RFRM is able to learn the underlying dependence of [CCN0.4] on these predictors, which are as follows: eight fractions of PM 2.5 (NH 4 , SO 4 , NO 3, secondary organic aerosol (SOA), black carbon (BC), primary organic carbon (POC), dust, and salt), seven gaseous species (NO x , NH 3 , O 3 , SO 2 , OH, isoprene, and monoterpene), and four meteorological variables (temperature (T), relative humidity (RH), precipitation, and solar radiation). The RFRM is highly robust: it has a median mean fractional bias (MFB) of 4.4 % with ≈96.33 % of the derived [CCN0.4] within a good agreement range of -60% 2.5 speciation (NH 4 , SO 4 , NO 3 , and organic carbon (OC)), NO x , O 3 , SO 2 , T, and RH, as well as [CCN0.4] are available. We modify, optimize, and retrain the developed RFRM to make predictions from 19 to 9 of these available predictors. This retrained RFRM (RFRM-ShortVars) shows a reduction in performance due to the unavailability and sparsity of measurements (predictors); it captures the [CCN0.4] variability and magnitude at SGP with ≈67.02 % of the derived values in the good agreement range. This work shows the potential of using the more commonly available measurements of PM 2.5 speciation to alleviate the sparsity of CCN number concentrations' measurements.

54 ENVIRONMENTAL SCIENCES↗

Diurnal Variability of Vertical Structure from a TRMM Passive Microwave "Virtual Radar" Retrieval

Robust description of the diurnal cycle from TRMM observations is complicated by the limitations of Low Earth Orbit (LEO) sampling; from a 'climatological' perspective, sufficient sampling must exist to control for both spatial and seasonal variability, before tackling an additional diurnal component (e.g., with 8 additional 3-hourly or 24 1-hourly bins). For documentation of vertical structure, the narrow sample swath of the TRMM Precipitation Radar limits the resolution of any of these components. A neural-network based 'virtual radar" retrieval has been trained and internally validated, using multifrequency / multipolarization passive microwave(TM1) brightness temperatures and textures parameters and lightning (LIS) observations, as inputs, and PR volumetric reflectivity as targets (outputs). By training the algorithms (essentially highly multivariate, nonlinear regressions) on a very large sample of high-quality co-located data from the center of the TRMM swath, 3D radar reflectivity and derived parameters (VIL, IWC, Echo Tops, etc.) can be retrieved across the entire TMI swath, good to 8-9% over the dynamic range of parameters. As a step in the retrieval (and as an output of the process), each TMI multifrequency pixel (at 85 GHz resolution) is classified into one of the 25 archetypal radar profile vertical structure "types", previously identified using cluster analysis. The dynamic range of retrieved vertical structure appears to have higher fidelity than the current (Version 6) experimental GPROF hydrometeor vertical structure retrievals. This is attributable to correct representation of the prior probabilities of vertical structure variability in the neural network training data, unlike the GPROF cloud-resolving model training dataset used in the V6 algorithms. The LIS lightning inputs are supplementary inputs, and a separate offline neural network has been trained to impute (predict) LIS lightning from passive-microwave-only data. The virtual radar retrieval is thus, in principle, extensible to Aqua/AMSR-E and NPOESS/CMIS passive microwave instruments. The virtual radar approach yields a threefold increase in effective sampling from the mission, albeit of lower-quality "retrieved" data, reducing the variance of local estimates by one third (or the standard deviation by-0.57). In this talk, the variance reduction is leveraged to more finely resolve global diurnal variability in both space and time (local hour).

Boccippio, Dennis J.↗