Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “LASSO”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Short-term nodal load forecasting based on machine learning techniques

This paper introduces an advanced Short-term Nodal Load Forecasting (STNLF) method that forecasts nodal load profiles for the next day in power systems, based on the combined use of three machine learning techniques. Least Absolute Shrinkage and Selection Operator (LASSO) is employed to reduce the number of features for a single nodal load forecasting. Principal Component Analysis (PCA) is used to capture the features of historical loads in low-dimensional space compared to the original high-dimensional load space where features are barely possible to depict. Additionally, Bayesian Ridge Regression (BRR) is utilized to decide the parameters of the prediction model from a statistics perspective. Tests based on modified PJM load data demonstrate the effectiveness of the proposed STNLF method compared to the state-of-the-art General Regression Neural Network (GRNN) method. Moreover, the reliability of the day-ahead Unit Commitment (UC) solution is shown to have been improved, based on the forecasted load data using the proposed STNLF method.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Leveraging hyperspectral phenotyping for accurate, non-destructive prediction of metabolite profiles in poplar under drought stress

Accurately predicting drought tolerance in woody perennial bioenergy crops is critical for sustainable biomass production under fluctuating precipitation. Hyperspectral imaging (HSI) in the visible-near-infrared (VNIR) and shortwave-infrared (SWIR) ranges offers a promising approach for predicting plant biochemical traits, yet its application in metabolite profiling remains underexplored. We integrated VNIR+SWIR HSI with untargeted metabolomics to investigate drought-induced metabolic shifts in Populus leaves from eight Populus genotypes. Metabolite profiling identified 127 compounds, with 73 showing significant drought responses spanning amino acids (AA), carbohydrates (CHO), phenolic glycosides (PG), organic acids (OA), fatty acids and alcohols (FA), terpenes (T), phenolic metabolites (P), and unclassified metabolites. Spectral analysis revealed consistently higher reflectance across VNIR and SWIR wavelengths in drought-stressed plants, corresponding with increased accumulation of AA and reduced CHO and PG levels. Least absolute shrinkage and selection operator (LASSO) regression modeling identified robust spectral predictors of metabolite concentrations, associating VNIR wavelengths (500–700 nm) predominantly with AA and P, whereas SWIR wavelengths (1680–1700 nm) reliably predicted CHO, OA, and T. Several stable spectral-metabolite associations persisted across the two watering regimes (drought vs. well-watered), highlighting their potential as spectral biomarkers for non-destructive stress monitoring. Minimal genotype-specific variation suggests that observed spectral and metabolic responses were driven primarily by environmental factors, likely reflecting limited genetic diversity among the commercial Populus genotypes examined. This work establishes VNIR+SWIR hyperspectral imaging as a powerful, non-destructive phenotyping tool for precision monitoring and targeted improvement of drought resilience in bioenergy crops.

Biochemical trait prediction↗
DOE OSTI2022

Glassoformer: A Query-Sparse Transformer for Post-Fault Power Grid Voltage Prediction

Here, we propose GLassoformer, a novel and efficient transformer architecture leveraging group Lasso regularization to reduce the number of queries of the standard self-attention mechanism. Due to the sparsified queries, GLassoformer is more computationally efficient than the standard transformers. On the power grid post-fault voltage prediction task, GLasso-former shows remarkably better prediction than many existing benchmark algorithms in terms of accuracy and stability.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Understanding Processes Controlling the Temporal and Spatial Variations of PBL Structures Over the ARM SGP Site

The surface heat, moisture, and momentum fluxes are transferred to the atmosphere above through the planetary boundary layer (PBL), where vertical mixing due to turbulent eddies of different sizes plays critical roles. Therefore, reliably representing PBL processes in numerical models is critical for weather, climate, and air quality prediction. Currently, there are over ten PBL schemes that are selectable within the advanced research version of the Weather Research and Forecasting (WRF) model, indicative of the challenges in capturing the impacts of turbulence within the PBL in models. Further improvements in PBL parameterizations are needed for both weather and climate models, as emphasized in many recent national reports, but require an advanced understanding of the underlying boundary layer processes from observations. This project takes advantage of Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) investments in the atmospheric boundary layer observations and Large-Eddy Simulation (LES) ARM Symbiotic Simulation and Observation (LASSO) simulations to characterize PBL structures, understand key physical processes controlling the mixed layer development, and to evaluate PBL parameterization.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Generation of Data-Driven Expected Energy Models for Photovoltaic Systems

Although unique expected energy models can be generated for a given photovoltaic (PV) site, a standardized model is also needed to facilitate performance comparisons across fleets. Current standardized expected energy models for PV work well with sparse data, but they have demonstrated significant over-estimations, which impacts accurate diagnoses of field operations and maintenance issues. This research addresses this issue by using machine learning to develop a data-driven expected energy model that can more accurately generate inferences for energy production of PV systems. Irradiance and system capacity information was used from 172 sites across the United States to train a series of models using Lasso linear regression. The trained models generally perform better than the commonly used expected energy model from international standard (IEC 61724-1), with the two highest performing models ranging in model complexity from a third-order polynomial with 10 parameters (Radj2 = 0.994) to a simpler, second-order polynomial with 4 parameters (Radj2=0.993), the latter of which is subject to further evaluation. Subsequently, the trained models provide a more robust basis for identifying potential energy anomalies for operations and maintenance activities as well as informing planning-related financial assessments. We conclude with directions for future research, such as using splines to improve model continuity and better capture systems with low (≤1000 kW DC) capacity.

14 SOLAR ENERGY↗
DOE OSTI2021

Quantifying the Long‐Range Coupling of Electronic Properties in Proteins with ab initio Molecular Dynamics**

Abstract The delicate interplay of covalent and non‐covalent interactions in proteins is inherently quantum mechanical and highly dynamic in nature. To directly interrogate the evolving nature of the electronic structure of proteins, we carry out 100‐ps‐scale ab initio molecular dynamics simulations of three representative small proteins with range‐separated hybrid density functional theory. We quantify the nature and length‐scale of the coupling of residue‐specific charge probability distributions in these proteins. While some nonpolar residues exhibit expectedly narrow charge distributions, most polar and charged residues exhibit broad, multimodal distributions. Even for nonpolar residues, we observe sequence‐specific deviations corresponding to charge accumulation or depletion that would be challenging to capture in a fixed charge force field. We quantify the effect of residue‐residue interactions on charge distributions first with linear cross‐correlations. We then show how additional insight can be gained from evaluating the mutual information of charge distributions. We show that a significant number of residues couple most strongly with residues that are distant in both sequence and space over a range of secondary structures including α‐helical, β‐sheet, disulfide bridging, and lasso motifs. The mutual information analysis is necessary to capture coupling between some polar and charged residues that would be otherwise missed.

Yang, Zhongyue↗
DOE OSTI2022

Resolving extreme jet substructure

We study the effectiveness of theoretically-motivated high-level jet observables in the extreme context of jets with a large number of hard sub-jets (up to N = 8). Previous studies indicate that high-level observables are powerful, interpretable tools to probe jet substructure for N ≤ 3 hard sub-jets, but that deep neural networks trained on low-level jet constituents match or slightly exceed their performance. We extend this work for up to N = 8 hard sub-jets, using deep particle-flow networks (PFNs) and Transformer based networks to estimate a loose upper bound on the classification performance. A fully-connected neural network operating on a standard set of high-level jet observables, 135 N-subjetiness observables and jet mass, reach classification accuracy of 86.90%, but fall short of the PFN and Transformer models, which reach classification accuracies of 89.19% and 91.27% respectively, suggesting that the constituent networks utilize information not captured by the set of high-level observables. We then identify additional high-level observables which are able to narrow this gap, and utilize LASSO regularization for feature selection to identify and rank the most relevant observables and provide further insights into the learning strategies used by the constituent-based neural networks. The final model contains only 31 high-level observables and is able to match the performance of the PFN and approximate the performance of the Transformer model to within 2%.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

Construction of two-dimensional topological field theories with non-invertible symmetries

We construct the defining data of two-dimensional topological field theories (TFTs) enriched by non-invertible symmetries/topological defect lines. Simple formulae for the three-point functions and the lasso two-point functions are derived, and crossing symmetry is proven. The key ingredients are open-to-closed maps and a boundary crossing relation, by which we show that a diagonal basis exists in the defect Hilbert spaces. We then introduce regular TFTs, provide their explicit constructions for the Fibonacci, Ising and Haagerup $\mathscr{H}$ 3 fusion categories, and match our formulae with previous bootstrap results. We end by explaining how non-regular TFTs are obtained from regular TFTs via generalized gauging.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

A Smoothed Augmented Lagrangian Framework for Convex Optimization with Nonsmooth Constraints

Augmented Lagrangian (AL) methods have proven remarkably useful in solving optimization problems with complicated constraints. The last decade has seen the development of overall complexity guarantees for inexact AL variants. Yet, a crucial gap persists in addressing nonsmooth convex constraints. To this end, we present a smoothed augmented Lagrangian (AL) framework where nonsmooth terms are progressively smoothed with a smoothing parameter $\eta _k$ . The resulting AL subproblems are $\eta _k$ -smooth, allowing for leveraging accelerated schemes. By a careful selection of the inexactness level $\epsilon _k$ (for inexact subproblem resolution), the penalty parameter $\rho _k$ , and smoothing parameter $\eta _k$ at epoch k, we derive rate and complexity guarantees of $\tilde{\mathcal {O}}(1/{\varepsilon }^{3/2})$ and $\tilde{\mathcal {O}}(1/{\varepsilon })$ in convex and strongly convex regimes for computing an ${\varepsilon }$ -optimal solution, when $\rho _k$ increases at a geometric rate, a significant improvement over the best available guarantees for AL schemes for convex programs with nonsmooth constraints. Analogous guarantees are developed for settings with $\rho _k = \rho$ as well as $\eta _k = \eta$ . Preliminary numerics on a fused Lasso problem display promise.

augmented Lagrangian↗
DOE OSTI2021

Multisublattice cluster expansion study of short-range ordering in iron-substituted strontium titanate

Owing to the challenges in obtaining realistic atomic configurations in large chemical phase spaces, it is not straightforward to describe structure–property relations in materials exhibiting configurational disorder. One example is iron-substituted strontium titanate (SrTi 1–x Fe x O 3–d , STF), a promising perovskite-derivative cathode material in solid oxide fuel cells that exhibits full solid solubility 0 ≤ x ≤ 1 and a tendency to exhibit short-range order. Here we demonstrate a multisublattice cluster expansion (CE) framework and apply it to STF across the full composition range. The CE approach is distinct from more traditional CE formulations in that clusters are defined explicitly by the chemical species distributed among multiple sublattices, rather than via cluster functions of occupation variables with decoration. The modified CE approach makes it easy to distinguish meaningful chemical interactions that are harder to extract from conventional CE, since for the latter chemical identity in a cluster is expressed as a product of site occupations. The least absolute shrinkage and selection operator (LASSO) is implemented as a regression analysis tool to select key clusters and avoid overfitting. We demonstrate this formulation on STF, and show that it can accurately predict configurational energies in comparison to conventional CE. From the key clusters, we identify that short-range ordering between substitutional Fe and oxygen vacancies (V O ) results in the formation of Fe–VO strings. In addition, we consider the stability of STF through CE-based Monte Carlo (MC) simulations and confirm the presence of superstructures that were previously observed in transmission electron microscopy. In this work, analysis of atomic configurations from MC samples reveals variations in the oxidation state of Fe atoms, which can be explained by the ordering tendency of Fe and V O . The cluster description and selection formalism described here may be applied to other disordered multisublattice systems for accurate and efficient material modeling.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Residential Demand Flexibility: Modeling Occupant Behavior using Sociodemographic Predictors

Demand flexibility (DF) has the potential to increase the saturation of renewables in the grid and reduce operating costs for both utilities and customers. However, less than 8% of U.S. residential electric customers are enrolled in DF programs. A major research gap on this topic is an uneven understanding of behavioral drivers of electricity use and DF program participation at the household level. In this study, we employ machine learning models to predict residential occupant behavior in activities relevant to DF. We model occupants' extensive decisions (i.e., choice of action) and intensive behaviors (i.e., amount of time spent) during peak and off-peak time periods using the publicly available American Time Use Survey, which includes activities data for approximately 200,000 respondents. In our machine learning models, predictions for both extensive and intensive behavior fell within a +/-20% error margin at the aggregate level. We identify 13 key sociodemographic predictors of DF-related intensive behavior using LASSO inference and beta coefficient ranking. However, these top predictors differ by activity, suggesting potential scope for differential user targeting for DF events and technologies during program design. This work also contributes to understanding when and who might adopt these DF technologies based on their daily routine activities.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Application of machine learning for optical emission spectroscopy data in NAGDIS-II

In this study, we applied machine learning to optical emission spectroscopy (OES) data and device parameters from the linear plasma device NAGDIS-II to explore the potential application of machine learning for predicting electron density, $n$ e , and temperature, $T$ e . The covered ranges of $n$ e and $T$ e , which were measured by an electrostatic probe, are 3.6 × 10 17 –2.4 × 10 19 m -3 and 0.3–7.1 eV, respectively. A three hidden layer neural network (NN) is introduced to model the relationship between $n$ e /$T$ e and the combination of line intensities, radial position, and device parameters. It is shown that the errors in $n$ e and $T$ e become 18.0 and 18.8%, respectively, which were almost the same level for the electrostatic probe, using all available data. Lasso regression and greedy algorithm are used to select the necessary line emissions. In conclusion, it is shown that four- or five-line intensities are sufficient to obtain almost the same quality as the one with all the other lines.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Quantification of manganese for ChemCam Mars and laboratory spectra using a multivariate model

In this work, we report a new calibration model for manganese using the laser-induced breakdown spectroscopy instrument that is part of the ChemCam instrument suite onboard the NASA Curiosity rover. The model has been trained using an expanded set of 523 manganese-bearing rock, mineral, metal ore, and synthetic standards. The optimal calibration model uses the Partial Least Squares (PLS) and Least Absolute Shrinkage and Selection Operator (LASSO) multivariate techniques, with a novel “double blending” technique. We determined the detection limit for manganese is 82 ppm using a method blank procedure and is possibly as low as 27 ppm based on visual inspection of the spectra. Based on a representative test set consisting of measurements on 93 standards, the double blended multivariate model shows a Root Mean Squared Error of Prediction (RMSEP) accuracy of 1.39 wt% MnO for the full blended model. Employing a local RMSEP estimate where the model performance is evaluated based on nearby test samples, the accuracy is 0.03 wt% at the quantification limit (0.05 wt% MnO), 0.4 wt% accuracy at 1.0 wt% MnO, and 4.4 wt% accuracy at 100 wt% MnO. Precision is estimated using the standard deviation of the test set measurements, and is ±0.01 wt% MnO at the quantification limit, ±0.09 wt% MnO at 1.0 wt% MnO, and ± 2.1 wt% MnO at 100 wt% MnO (all 1 standard deviation). This new calibration is important for understanding the variation of manganese in the bedrock with the Curiosity rover on Mars, which provides insight into past redox conditions on Mars.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Long-Term Statistical Process Monitoring of an Ultrafiltration Water Treatment Process

As water treatment technology has improved, the amount of available process data has substantially increased, making real-time, data-driven fault detection a reality. One shortcoming of the fault detection literature is that methods are usually evaluated by comparing their performance on hand-picked, short-term case studies, which yields no insight into long-term performance. In this work, we first evaluate multiple statistical and machine learning approaches for detrending process data. Then, we evaluate the performance of a PCA-based fault detection approach, applied to the detrended data, to monitor influent water quality, filtrate quality, and membrane fouling of an ultrafiltration membrane system for indirect potable reuse. Based on two short case studies, the adaptive lasso detrending method is selected, and the performance of the multivariate approach is evaluated over more than a year. The method is tested for different sets of three critical tuning parameters, and we find that for long-term, autonomous monitoring to be successful, these parameters should be carefully evaluated. However, in comparison with industry standards of simpler, univariate monitoring or daily pressure decay tests, multivariate monitoring produces substantial benefits in long-term testing.

ammonia↗
DOE OSTI2023

Functional Predictor Variables for the Leaching Potential of Arsenic and Selenium from Coal Fly Ash

The release of leachates from intact coal ash impoundments is a concern due to the enrichment and mobilization of toxic elements such as arsenic (As) and selenium (Se). This study aims to explore the intrinsic properties of coal fly ash that correlate with the relative leachability of As and Se. We performed leaching experiments with 52 fly ash samples collected from 15 different U.S. power plants and representing coal feedstocks from the three major domestic regions. We assessed the mobilization potential of As and Se in fly ash based on standardized leaching protocols and performed multivariate and lasso regression analyses to explore correlations of leachable As and Se contents with characteristics such as major element contents, loss on ignition, and pH. The results of regression models indicated that major elements (Fe, Ca, and Al) for a wide range of fly ashes can serve as predictor variables for the leaching potential of As but not for Se. LOI and pH were not important predictive variables in the models. Both regression approaches resulted in relatively strong fits for leachable As (correlation coefficient R 2 = 0.78 for both models) compared to models for leachable Se (R 2 = 0.49). Overall, these results suggest that correlation models combined with on-site elemental analysis with portable analyzers may enable a screening method for leachable As in coal ash.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2021

Simulated Dust Transport in the Convective Boundary Layer

Soil dusts are an important source of aerosol in agricultural regions and can affect the Earth's radiation budget through the modification of cloud properties, and in particular, through their ability to act as ice nucleating particles. In order to impact cloud properties, agricultural soil dusts need to be transported from the point of emission to cloud–relevant altitudes. Vertical transport within the planetary boundary layer is strongly controlled by turbulence and is challenging to represent accurately in regional and global models. Large–eddy simulations (LES) are run at resolutions capable of resolving most of the turbulent energy directly and can thus better simulate vertical transport. In this study, we leverage the LES ARM Symbiotic Simulation and Observation (LASSO) large–eddy simulations to simulate vertical transport of agricultural dust within the turbulent boundary layer using a modified version of the stochastic dispersion model FLEXPART–WRF. We find that the modified model is better capable of simulating particle transport due to turbulence, and that particle size was the greatest factor in determining particle lifetime. Individual meteorology and particle density had intermediate effects upon particle transport, while release height had little effect upon simulation results. Finally, we utilize a quasi–single column model (QSCM) approach to determine how our results compare to a parameterized treatment of turbulence. The QSCM simulations led to greater tracer transport out of the boundary layer, with ramifications for any studies utilizing a Lagrangian stochastic model to understand tracer dispersion. Furthermore, these results highlight the importance of accurately simulating turbulence for understanding particle transport.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Size-Dependent Characteristics of Surface-Rooted Three-Dimensional Convective Objects in Continental Shallow Cumulus Simulations

A segmentation algorithm is applied to high resolution simulations of shallow continental convection to identify individual convective 3D objects within the convective boundary layer, in order to investigate which properties of the objects vary with the object width. The study analyses the geometry of the objects, along with their profiles of vertical velocity and total water, to assess various assumptions often used in spectral mass-flux convection schemes. The methodology of this paper is unique in that we use (a) a novel application of the watershed algorithm to detect individual objects in the constantly evolving continental boundary layer efficiently, and (b) an unprecedentedly large number of simulations being analyzed. In total, 26 days of LASSO simulations at the Atmospheric Radiation Measurement Southern Great Plains site are analyzed, yielding roughly one million objects. Plume-like surface-rooted objects are found to be omnipresent, the vertical extent of which is strongly dependent on the object width. The vertical velocity and moisture anomaly profiles of the widest objects are roughly consistent with the classic buoyancy-driven rising plume model. The kinematic and thermodynamic properties of the objects vary with object width. This width dependence is strongest above cloud base, but much weaker below. Finally the impact of neglecting the contribution of covariances to the vertical moisture flux, which is commonly used in mass-flux parameterizations, is investigated. The average effect of neglecting covariances increases linearly with object width, leading to a 20% flux underestimation for 2 km wide objects. Implications of the results for spectral convection scheme development are briefly discussed.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Quantifying Site Effects and Their Influence on Earthquake Source Parameter Estimations Using a Dense Array in Oklahoma

We investigate the effects of site response on source parameter estimates using earthquakes recorded by the LArge-n Seismic Survey in Oklahoma (LASSO). While it is well known that near-surface unconsolidated sediments can cause an apparent breakdown of earthquake self-similarity, the influence of laterally varying site conditions remains unclear. We analyze site conditions across the 1825-station array on a river plain within an area of 40 km by 23 km using vertical ground motions from 14 regional earthquakes. While the source radiation pattern controls P-wave ground motions below 8 Hz, the surface geology correlates with P-wave ground motions above 8 Hz and S-wave ground motions at 2–21 Hz. Stations installed in alluvial sediments have vertical ground motions that can exceed three times the array median. We use the variation of ground motion of regional earthquakes across the array as a proxy for site effects. The corner frequencies and stress drops of local earthquakes ( M L = 0.01–3) estimated using a standard single-spectra approach show negative correlations with the site-effect proxy, while the seismic moments show positive correlations. In contrast, the spectral-ratio approach effectively shows no correlation. The overall bias is small as expected for this relatively homogeneous structure; accurate estimation of site-related biases requires at least 30 stations. Correcting for site-related biases reduces the standard deviations of the source parameters by less than 13% of the total variations. Remaining variations are partially associated with source directivity and model misfits— as small earthquakes can have complex ruptures.

58 GEOSCIENCES↗