Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “regression models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,279 records · Page 71
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Quantification of Lanthanides in a Molten Salt Reactor Surrogate Off-Gas Stream Using Laser-Induced Breakdown Spectroscopy

To enable the deployment of molten salt reactor technology, the development of off-gas treatment systems and advanced monitoring tools capable of operating with high temperatures and radiation fields while delivering near real-time information is necessary. Here, we aim to fulfill this requirement and proposes laser-induced breakdown spectroscopy (LIBS) for monitoring molten salt aerosol streams. A sheath gas measuring method was developed to protect optical elements from aerosol particles and to ensure a relatively constant aerosol stream for measurement. An aqueous system was studied to demonstrate the utility of LIBS for monitoring possible fission products in an aerosol stream: Gd, Nd, and Sm up to 2000 parts per million (ppm). A calibration model was built using partial least squares (PLS) regression with five, six, and nine latent variables for Gd, Nd, and Sm, respectively. This calibration model successfully estimated the concentrations of three test samples, which were validated with inductively charged plasma optical emission spectroscopy measurements at a 99.9% confidence interval. To enhance these models, a genetic algorithm was used to filter the spectra before entering the PLS model, thereby limiting the spectral features being regressed to those with greater correlations to concentration. This allowed for the number of latent variables used in the PLS models to be reduced to four, three, and three for Gd, Nd, and Sm, respectively. Finally, the genetic algorithm-filtered PLS models were used to predict the concentrations of the aerosol stream on a real-time dataset and resulted in a 73%, 18%, and 25% improvement in root mean squared error of prediction compared to the original PLS models developed.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS2002

A statistical model for interpreting computerized dynamic posturography data

Computerized dynamic posturography (CDP) is widely used for assessment of altered balance control. CDP trials are quantified using the equilibrium score (ES), which ranges from zero to 100, as a decreasing function of peak sway angle. The problem of how best to model and analyze ESs from a controlled study is considered. The ES often exhibits a skewed distribution in repeated trials, which can lead to incorrect inference when applying standard regression or analysis of variance models. Furthermore, CDP trials are terminated when a patient loses balance. In these situations, the ES is not observable, but is assigned the lowest possible score--zero. As a result, the response variable has a mixed discrete-continuous distribution, further compromising inference obtained by standard statistical methods. Here, we develop alternative methodology for analyzing ESs under a stochastic model extending the ES to a continuous latent random variable that always exists, but is unobserved in the event of a fall. Loss of balance occurs conditionally, with probability depending on the realized latent ES. After fitting the model by a form of quasi-maximum-likelihood, one may perform statistical inference to assess the effects of explanatory variables. An example is provided, using data from the NIH/NIA Baltimore Longitudinal Study on Aging.

NASA Discipline Neuroscience↗
NASA NTRS1984

Evaluation of spatial, radiometric and spectral Thematic Mapper performance for coastal studies

The effect different wetland plant canopies have upon observed reflectance in Thematic Mapper bands is examined. The three major vegetation canopy types (broadleaf, gramineous and leafless) produce unique spectral responses for a similar quantity of live biomass. Biomass estimates computed from spectral data were most similar to biomass estimates determined from harvest data when models developed for a specific canopy were used. Precise determination of regression coefficients for each canopy type and modeling changes in the coefficients with various combinations of canopy types are being tested. The multispectral band scanner vegetation index estimates are very similar to the vegetation index estimates.

Klemas, V.↗
NASA NTRS1986

Effects of wing modification on an aircraft's aerodynamic parameters as determined from flight data

A study of the effects of four wing-leading-edge modifications on a general aviation aircraft's stability and control parameters is presented. Flight data from the basic aircraft configuration and configurations with wing modifications are analyzed to determine each wing geometry's stability and control parameters. The parameter estimates and aerodynamic model forms are obtained using the stepwise regression and maximum likelihood techniques. The resulting parameter estimates and aerodynamic models are verified using vortex-lattice theory and by analysis of each model's ability to predict aircraft behavior. Comparisons of the stability and control derivative estimates from the basic wing and the four leading-edge modifications are accomplished so that the effects of each modification on aircraft stability and control derivatives can be determined.

Hess, R. A.↗
DOE OSTI2024

Predictive analytics of selections of russet potatoes

We explore the application of machine learning algorithms specifically to enhance the selection process of Russet potato (Solanum tuberosum L.) clones in breeding trials by predicting their suitability for advancement. This study addresses the challenge of efficiently identifying high-yield, disease-resistant, and climate-resilient potato varieties that meet processing industry standards. Leveraging manually collected data from trials in the state of Oregon, we investigate the potential of a wide variety of state-of-the-art binary classification models. The dataset includes 1086 clones, with data on 38 attributes recorded for each clone, focusing on yield, size, appearance, and frying characteristics, with several control varieties planted consistently across four Oregon regions from 2013 to 2021. We conduct a comprehensive analysis of the dataset that includes preprocessing, feature engineering, and imputation to address missing values. We focus on several key metrics such as accuracy, F1-score, and Matthews correlation coefficient (MCC) for model evaluation. The top-performing models, namely a feedforward neural network classifier (Neural Net), a histogram-based gradient boosting classifier (HGBC), and a support vector machine classifier (SVM), demonstrate consistent and significant results. To further validate our findings, we conducted a simulation study using the aims, data-generating mechanisms, estimands, methods, and performance measures (ADEMP) framework, simulating different data-generating scenarios to assess model robustness and performance through true positive, true negative, false positive, and false negative distributions, area under the receiver operating characteristic curve (AUC-ROC) and MCC. The simulation results highlight that non-linear models like SVM and HGBC consistently show higher AUC-ROC and MCC than logistic regression, thus outperforming the traditional linear model across various distributions, and emphasizing the importance of model selection and tuning in agricultural trials. Variable selection further enhances model performance and identifies influential features in predicting trial outcomes. The findings emphasize the potential of machine learning in streamlining the selection process for potato varieties, offering benefits such as increased efficiency, substantial cost savings, and judicious resource utilization. Our study contributes insights into precision agriculture and showcases the relevance of advanced technologies for informed decision-making in breeding programs.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Classification of bacterial plasmid and chromosome derived sequences using machine learning

Plasmids are important genetic elements that facilitate horizonal gene transfer between bacteria and contribute to the spread of virulence and antimicrobial resistance. Most bacterial genome sequences in the public archives exist in draft form with many contigs, making it difficult to determine if a contig is of chromosomal or plasmid origin. Using a training set of contigs comprising 10,584 chromosomes and 10,654 plasmids from the PATRIC database, we evaluated several machine learning models including random forest, logistic regression, XGBoost, and a neural network for their ability to classify chromosomal and plasmid sequences using nucleotide k-mers as features. Based on the methods tested, a neural network model that used nucleotide 6-mers as features that was trained on randomly selected chromosomal and plasmid subsequences 5kb in length achieved the best performance, outperforming existing out-of-the-box methods, with an average accuracy of 89.38% ± 2.16% over a 10-fold cross validation. The model accuracy can be improved to 92.08% by using a voting strategy when classifying holdout sequences. In both plasmids and chromosomes, subsequences encoding functions involved in horizontal gene transfer—including hypothetical proteins, transporters, phage, mobile elements, and CRISPR elements—were most likely to be misclassified by the model. This study provides a straightforward approach for identifying plasmid-encoding sequences in short read assemblies without the need for sequence alignment-based tools.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Cloud drop number concentrations over the western North Atlantic Ocean: seasonal cycle, aerosol interrelationships, and other influential factors

Cloud drop number concentrations (N d ) over the western North Atlantic Ocean (WNAO) are generally highest during the winter (DJF) and lowest in summer (JJA), in contrast to aerosol proxy variables (aerosoloptical depth, aerosol index, surface aerosol mass concentrations, surface cloud condensation nuclei (CCN) concentrations) that generally peak inspring (MAM) and JJA with minima in DJF. Using aircraft, satellite remote sensing, ground-based in situ measurement data, and reanalysis data, we characterize factors explaining the divergent seasonal cycles and furthermore probe into factors influencing N d on seasonal timescales. The results can be summarized well by features most pronounced in DJF, including features associated with cold-air outbreak (CAO) conditions such as enhanced values of CAO index, planetary boundary layer height (PBLH),low-level liquid cloud fraction, and cloud-top height, in addition to winds aligned with continental outflow. Data sorted into high- and low-N d days in each season, especially in DJF, revealed that all of these conditions were enhanced on the high-N d days, including reduced sea level pressure and stronger wind speeds. Although aerosols may be more abundant in MAM and JJA, the conditions needed to activate those particles into cloud droplets are weaker than in colder months, which is demonstrated by calculations of the strongest (weakest) aerosol indirect effects in DJF (JJA) based on comparing N d to perturbations in four different aerosol proxy variables (total and sulfate aerosol optical depth, aerosol index, surface mass concentration of sulfate). We used three machine learning models and up to 14 input variables to infer about most influential factors related to N d for DJF and JJA, with the best performance obtained with gradient-boosted regression tree (GBRT) analysis. The model results indicated that cloud fraction was the most important input variable, followed by some combination (depending on season) of CAO index and surface mass concentrations of sulfate and organic carbon. Future work is recommended to further understand aspects uncovered here such as impacts of free tropospheric aerosol entrainment on clouds, degree of boundary layer coupling, wet scavenging, and giant CCN effects on aerosol–N d relationships, updraft velocity, and vertical structure of cloud properties such as adiabaticity that impact the satellite estimation of N d .

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1973

Models of subjective response to in-flight motion data

Mathematical relationships between subjective comfort and environmental variables in an air transportation system are investigated. As a first step in model building, only the motion variables are incorporated and sensitivities are obtained using stepwise multiple regression analysis. The data for these models have been collected from commercial passenger flights. Two models are considered. In the first, subjective comfort is assumed to depend on rms values of the six-degrees-of-freedom accelerations. The second assumes a Rustenburg type human response function in obtaining frequency weighted rms accelerations, which are used in a linear model. The form of the human response function is examined and the results yield a human response weighting function for different degrees of freedom.

Rudrapatna, A. N.↗
DOE OSTI2022

Dataset for 'Stream Temperature Predictions for River Basin Management in the Pacific Northwest and Mid-Atlantic Regions Using Machine Learning', Water 2022

This data package presents forcing data, model code, and model output for classical machine learning models that predict monthly stream water temperature as presented in the manuscript ‘Stream Temperature Predictions for River Basin Management in the Pacific Northwest and Mid-Atlantic Regions Using Machine Learning’, Water (Weierbach et al., 2022). Specifically, for input forcing datasets we include two files each generated using the BASIN-3D data integration tool (Varadharajan et al., 2022) for stations in the Pacific Northwest and Mid Atlantic Hydrologic regions. Model code (written in python with the use of jupyter notebooks) includes codes for data preprocessing, training Multiple Linear Regression, Support Vector Regression, and Extreme Gradient Boosted Tree models, and additional notebooks for analysis of model output. We include specific model output files which represent modeling configurations presented in the manuscript also presented in an hdf5 format. Together, these data make up the workflow for predictions across three scenarios (single station, regional, and predictions in unmonitored basins) presented in the manuscript and allow for reproducibility of modeling procedures.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1983

Lagged average forecasting, an alternative to Monte Carlo forecasting

A 'lagged average forecast' (LAF) model is developed for stochastic dynamic weather forecasting and used for predictions in comparison with the results of a Monte Carlo forecast (MCF). The technique involves the calculation of sample statistics from an ensemble of forecasts, with each ensemble member being an ordinary dynamical forecast (ODF). Initial conditions at a time lagging the start of the forecast period are used, with varying amounts of time for the lags. Forcing by asymmetric Newtonian heating of the lower layer is used in a two-layer, f-plane, highly truncated spectral model in a test forecasting run. Both the LAF and MCF are found to be more accurate than the ODF due to ensemble averaging with the MCF and the LAF. When a regression filter is introduced, all models become more accurate, with the LAF model giving the best results. The possibility of generating monthly or seasonal forecasts with the LAF is discussed.

Hoffman, R. N.↗
DOE OSTI2024

Applying Machine‐Learning Methods to Laser Acceleration of Protons: Lessons Learned From Synthetic Data

ABSTRACT In this study, we consider three different machine‐learning methods—a three‐hidden‐layer neural network, support vector regression, and Gaussian process regression—and compare how well they can learn from a synthetic data set for proton acceleration in the Target Normal Sheath Acceleration regime. The synthetic data set was generated from a previously published theoretical model by Fuchs et al. 2005 that we modified. Once trained, these machine‐learning methods can assist with efforts to maximize the peak proton energy, or with the more general problem of configuring the laser system to produce a proton energy spectrum with desired characteristics. In our study, we focus on both the accuracy of the machine‐learning methods and the performance on one GPU including memory consumption. Although it is arguably the least sophisticated machine‐learning model we considered, support vector regression performed very well in our tests.

Desai, Ronak↗
DOE OSTI2021

Photometric redshift estimation of BASS DR3 quasars by machine learning

ABSTRACT Correlating Beijing–Arizona Sky Survey (BASS) data release 3 (DR3) catalogue with the ALLWISE data base, the data from optical and infrared information are obtained. The quasars from Sloan Digital Sky Survey are taken as training and test samples while those from LAMOST are considered as external test sample. We propose two schemes to construct the redshift estimation models with XGBoost, CatBoost, and Random Forest. One scheme (namely one-step model) is to predict photometric redshifts directly based on the optimal models created by these three algorithms; the other scheme (namely two-step model) is to first classify the data into low- and high-redshift data sets, and then predict photometric redshifts of these two data sets separately. For one-step model, the performance of these three algorithms on photometric redshift estimation is compared with different training samples, and CatBoost is superior to XGBoost and Random Forest. For two-step model, the performances of these three algorithms on the classification of low and high redshift subsamples are compared, and CatBoost still shows the best performance. Therefore, CatBoost is regarded as the core algorithm of classification and regression in two-step model. In contrast to one-step model, two-step model is optimal when predicting photometric redshift of quasars, especially for high-redshift quasars. Finally, the two models are applied to predict photometric redshifts of all quasar candidates of BASS DR3. The number of high-redshift quasar candidates is 3938 (redshift ≥3.5) and 121 (redshift ≥4.5) by two-step model. The predicted result will be helpful for quasar research and follow-up observation of high-redshift quasars.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Systems Analysis of Biomass and Coal Co-firing Power Plants with Deep Carbon Capture Toward Net-zero Emissions

Achieving a net-zero emission economy in the United States requires integrating diverse low-carbon and negative-emission technologies into the existing fossil fuel-dominant power fleet. Potential technologies from the low-carbon portfolio include renewable power, fossil power with carbon capture and storage (CCS), bioenergy with CCS (BECCS), and direct air capture (DAC). Renewable power is a clean energy source but has to pair with costly battery storage to provide dispatchable electricity. Fossil power with CCS offers dispatchable electricity yet still relies on DAC to offset residual emissions, even when deploying deep CCS with more than 90% CO2 capture. Coal-biomass co-firing with CCS, a subset of BECCS, is a reliable energy production technology that can be retrofitted from existing electricity generation units (EGUs). Power plant retrofit maximizes the use of the current U.S. coal power fleet without the need for large-scale deployment of new renewable power, battery storage, or DAC. Retrofitting coal-biomass co-firing with deep CCS in EGUs is a promising option, but not a universal solution. Biomass co-firing at a power plant introduces economic challenges and indirectly poses pressure on land and water resources. Meanwhile, retrofitting deep CCS affects plant efficiency and raises electricity generation costs. Overall, the technical feasibility and economic viability of plant retrofits vary across EGUs, as they are contingent upon the regional availability of biomass, unit-specific characteristics, site-specific fuel supply costs, and adjacent CO2 storage potential. Government incentives like 45Q can improve the retrofit viability, though the impact requires further quantification. A comprehensive analysis at the unit level is essential to address the question regarding the fate of the U.S. coal-fired electricity generation fleet toward the net-zero emission goal. This study conducts a systematic techno-economic-environmental assessment of EGUs to identify the viability of biomass co-firing and deep CCS retrofits in the U.S. coal-fired power fleet. Specifically, it characterizes the techno-economic performance of deep carbon capture, estimates life cycle greenhouse gas (GHG) emissions, and conducts a fleet-level assessment on retrofit viability. The key objectives are (1) to estimate the unit-specific performance and retrofitted cost under various biomass co-firing levels and CO2 capture rates; (2) to determine the possibility of reaching net-zero emission at the fleet level; (3) to quantify the cumulative capacities that are suitable for plant retrofits under current and future biomass supply scenarios; and (4) to improve the understanding of policy impacts on such retrofits to help the power sector’s transition to a net-zero economy. Techno-economic Model of Deep Carbon Capture. This study develops the performance and economic models for Monoethanolamine-based post-combustion CO2 capture at 95–99% capture rates. The process is simulated in Aspen Plus, analyzing the performance of carbon capture technology by varying the plant sizes, solvent lean loading, CO2 concentrations, and flue gas inlet temperature. Based on the key inputs and output parameters of CO2 capture, a reduced-order performance model of deep carbon capture is formulated. In addition, an engineering-economic model integrating the performance metrics is developed to estimate the capital as well as operation and maintenance (O&M) costs. Capital cost estimations follow the framework of the Integrated Environmental Control Model (IECM) and incorporate data regressions from three technical reports by IECM, the National Energy Technology Laboratory (NETL), and the National Renewable Energy Laboratory. The O&M cost estimation utilizes the actual inventory consumption rate and labor requirements. Both performance and cost models are embedded into IECM v13.0-beta, a fossil-fuel power plant modeling tool. Life Cycle Assessment of Power Plants. This study estimates the GHG emissions of power plants through life cycle assessment (LCA). The LCA scope includes fuel supply, combustion-based power generation, and CO2 transport and storage. The fuel-based life cycle module is designed following the framework of the NETL Unit Process Library and CO2U LCA Guidance Toolkit. The module is then incorporated into IECM v13.0-beta. The process-based LCA is applied to estimate the GHG emissions of coal and biomass supply, coal- and coal-biomass co-firing power plant operation, as well as CO2 pipeline transport and geographical sequestration. An uncertainty analysis is conducted to quantify the variability and uncertainty associated with the LCA using the Latin Hypercube Sampling (LHS) method. Fleet-level Assessment. This study evaluates the technical and economic feasibility of selected coal-fired EGUs, examines the role of tax credits in retrofit viability, and assesses the competitiveness of retrofitted units against other low-carbon options. Unit screening identifies EGUs for the study, focusing on new, efficient baseload units with air pollution controls. The power plant databases are then established to organize unit-specific information on performance and operating conditions from the relevant public databases. Biomass for co-firing retrofits is selected based on home and neighboring county availability, ensuring sustained operation with at least a 5% co-firing level. The CO2 storage site is determined by state-level storage potential, with ArcGIS Pro and NETL CO2 Saline Storage Cost Model used to identify the optimal balance between the nearest transport distances and affordable storage costs. The latest IECM v13.0-beta is then employed to configure and evaluate the eligible EGUs with or without the deployment of deep CCS and biomass co-firing. A supply curve is established to illustrate the cumulative installed capacity suitable for retrofits at different cost levels. A sensitivity analysis on tax credits for carbon sequestration is performed. Finally, a unit-level cost comparison is conducted among retrofitted plants, renewable power with battery storage, and abated fossil fuels with DAC. Expected Results. This study evaluates the technical, economic, and environmental metrics of each EGU across an array of CO2 capture rates and biomass co-firing level scenarios. Unit-level comparisons will identify critical factors influencing technical performance. The supply curves with and without tax incentives will provide insights into the impact of tax credits on biomass co-firing and CCS deployment. The cost comparisons with renewables and DAC-retrofit will assess the competitiveness of the retrofitted units. Life cycle emissions from each unit will be assessed to identify the scenarios under which net-zero emissions can be achieved. These analyses are expected to determine the total coal-fired capacity suitable for serving as a low-carbon energy source with or without tax incentives. The study results are novel in identifying optimal unit-specific strategies for producing carbon-neutral power, whether through retrofitting EGUs with deep CCS, biomass co-firing, DAC, or installing renewable power with battery. The findings will provide insight into nationwide efforts to ensure reliable, affordable, and low-carbon electricity. It also will inform investment decisions and policies in the deployment of deep carbon capture and negative emission technologies for a net-zero energy future.

Biomass Co-firing↗
DOE OSTI2022

Estimating mass-absorption cross-section of ambient black carbon aerosols: theoretical, empirical, and machine learning models

The mass-absorption cross-section of black carbon (MAC BC ) is an essential parameter to link the atmospheric concentration of black carbon (BC) with its radiative forcing. When a direct calculation of MAC BC based on observations of aerosol light absorption and BC mass concentration is impossible, we rely on modeling and simulations to estimate MAC BC , but currently, there is no consensus model that can be relied on for accurate predictions across all atmospheric environments when BC particles have different coating thicknesses. Here, we applied five MAC BC prediction models (including three light scattering theories, an empirical model based on observations of particle mass concentrations, and a machine learning model developed in our previous work) to aerosols from three Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) field campaigns. While many studies have found that increasing the complexity of the models helps to constrain biases of the estimated MAC BC , our effort is to evaluate the models based on the criteria of simplicity and accuracy. We find that our machine learning model (support vector machine for regression, SVM) generally performs well across all DOE ARM field campaign data, while the accuracy of core-shell Mie theory depends on the bias correction algorithm applied to filter-based light absorption data. Generally, the empirical model for internally-mixed particles that we considered tends to over-predict MAC BC , while Mie theory for externally-mixed particles tends to under-predict MAC BC . An examination of the influence of coating material on BC cores suggests that the performance of our current SVM model is degraded when the BC is thickly-coated (e.g., it has undergone aging and mixing with other materials in the atmosphere).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

BayesPPR

SAND2026-17002O BayesPPR performs Bayesian Projection Pursuit Regression (PPR) using MATLAB. A surrogate model for calibration applications, it enables users to efficiently analyze complex datasets and extract meaningful patterns through regression techniques. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy's National Nuclear Security Administration under contract DE-NA0003525.

Tucker, J. Derek [Sandia National Lab. (SNL-CA), L↗
NASA NTRS1984

Methodology for predictive testing of fuel cells

A perturbation testing method has been developed and tested for predictive testing of fuel cells. This method involves application of small changes to the operating conditions of the cell in a predetermined sequence. The resultant response of the cell is then measured and statistically correlated with the corresponding test conditions. This method has been applied to the phosphoric acid fuel cell, and the effect of operating and cell-component variables on cell-performance degradation has been studied. A strong effect of the cell temperature and cathode potential on fuel-cell-performance degradation has been observed. A cell-performance degradation model has been formulated, and the unknown parameters in the model have been estimated by a regression analysis of the experimental data. A reasonable agreement between the fuel cell performance predicted by this model (derived from the perturbation experiments) and the unperturbed test data supports fthe applicability of the perturbation method.

Patel, D. N.↗
NASA NTRS1985

Evaluation of spatial, radiometric and spectral thematic mapper performance for coastal studies

The main emphasis of the research was to determine what effect different wetland plant canopies would have upon observed reflectance in Thematic Mapper bands. The three major vegetation canopy types (broadleaf, gramineous and leafless) produce unique spectral responses for a similar quantity of live biomass. Biomass estimates computed from spectral data were most similar to biomass estimates determined from harvest data when models developed for a specific canopy were used. In other words, the spectral biomass estimate of a broadleaf canopy was most similar to the harvest biomass estimate when a broadleaf canopy radiance model was used. Work is continuing to more precisely determine regression coefficients for each canopy type and to model the change in the coefficients with various combinations of canopy types. Researchers suspect that textural and spatial considerations can be used to identify canopy types and improve biomass estimates from Thematic Mapper data.

Klemas, V.↗
NASA NTRSDate not supplied

PM 2.5 Concentrations over Major Metropolitan Regions Inferred from Airborne High Spectral Resolution Lidar Measurements Using Machine Learning Regression

We use measurements of near-surface aerosol backscatter, extinction, and depolarization acquired by four NASA Langley Research Center airborne High Spectral Resolution Lidars (HSRLs) to develop a machine learning regression methodology to infer PM2.5 concentrations at the surface and aloft. These airborne HSRL measurements were acquired over major metropolitan regions in the United States and Asia during more than 170 flights since 2010. Hourly surface PM2.5 measurements from the EPA air quality system and similar networks in other countries acquired within 10 km and 15 minutes of these near-surface HSRL measurements are used to train models that compute PM2.5 concentrations from the HSRL measurements. We examine several regression methods and find that exponential Gaussian Process algorithms consistently give the best performance in terms of the lowest root-mean-square (RMS) errors and the highest correlations. Model performance varies significantly depending on various combinations of HSRL aerosol measurements (e.g., aerosol backscatter, extinction, depolarization, backscatter color ratios, lidar ratios, aerosol optical thickness) and retrievals (e.g., mixed layer height, aerosol type) used in the regressions. Models that use near-surface measurements of aerosol backscatter and aerosol intensive properties such as depolarization, backscatter color ratio, and lidar ratio typically give the best performance with RMS errors around 4 mg/m3 and correlation coefficients above 0.9. HSRL measurements were often acquired when the aircraft flew systematic “raster-scan” patterns for several hours over these cities. These flight patterns enabled measurements of the spatial, temporal, and vertical variabilities in the distributions of aerosol backscatter and aerosol intensive properties and allowed us to derive the corresponding variabilities in PM2.5 concentrations. We present examples of such variabilities over urban areas in the United States as well as Asia. We describe also how the distribution of surface PM2.5 varies with aerosol type and use these retrievals to examine model simulations of surface PM2.5 in these metropolitan regions. We also discuss how this methodology may be applied to measurements from satellite lidars such as CALIOP on CALIPSO and ATLID on EarthCARE.

lidar↗