SEARCH · Engineering Papers

Results for “functional regression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 991 records · Page 55

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Robustness of the Stochastic Parameterization of Subgrid-Scale Wind Variability in Sea Surface Fluxes

Abstract High-resolution numerical models have been used to develop statistical models of the enhancement of sea surface fluxes resulting from spatial variability of sea surface wind. In particular, studies have shown that flux enhancement is not a deterministic function of the resolved state. Previous studies focused on single geographical areas or used a single high-resolution numerical model. This study extends the development of such statistical models by considering six different high-resolution models, four different geographical regions, and three different 10-day periods, allowing for a systematic investigation of the robustness of both the deterministic and stochastic parts of the data-driven parameterization. Results indicate that the deterministic part, based on regressing the unresolved normalized flux onto resolved-scale normalized flux and precipitation, is broadly robust across different models, regions, and time periods. The statistical features of the stochastic part of the model (spatial and temporal autocorrelation and parameters of a Gaussian process fit to the regression residual) are also found to be robust and not strongly sensitive to the underlying model, modeled geographical region, or time period studied. Best-fit Gaussian process parameters display robust spatial heterogeneity across models, indicating potential for improvements to the statistical model. These results illustrate the potential for the development of a generic, explicitly stochastic parameterization of sea surface flux enhancements dependent on wind variability.

Endo, Kota↗

NASA NTRS1991

Helicopter flight-control design using an H(2) method

Rate-command and attitude-command flight-control designs for a UH-60 helicopter in hover are presented and were synthesized using an H(2) method. Using weight functions, this method allows the direct shaping of the singular values of the sensitivity, complementary sensitivity, and control input transfer-function matrices to give acceptable feedback properties. The designs were implemented on the Vertical Motion Simulator, and four low-speed hover tasks were used to evaluate the control system characteristics. The pilot comments from the accel-decel, bob-up, hovering turn, and side-step tasks indicated good decoupling and quick response characteristics. However, an underlying roll PIO tendency was found to exist away from the hover condition, which was caused by a flap regressing mode with insufficient damping.

Takahashi, Marc D.↗

NASA NTRS1997

Prediction of human gait parameters from temporal measures of foot-ground contact

Investigation of the influence of human physical activity on bone functional adaptation requires long-term histories of gait-related ground reaction force (GRF). Towards a simpler portable GRF measurement, we hypothesized that: 1) the reciprocal of foot-ground contact time (1/tc); or 2) the reciprocal of stride-period-normalized contact time (T/tc) predict peak vertical and horizontal GRF, loading rates, and horizontal speed during gait. GRF data were collected from 24 subjects while they walked and ran at a variety of speeds. Linear regression and ANCOVA determined the dependence of gait parameters on 1/tc and T/tc, and prediction SE. All parameters were significantly correlated to 1/tc and T/tc. The closest pooled relationship existed between peak running vertical GRF and T/tc (r2 = 0.896; SE = 3.6%) and improved with subject-specific regression (r2 = 0.970; SE = 2.2%). We conclude that temporal measures can predict force parameters of gait and may represent an alternative to direct GRF measurements for determining daily histories of habitual lower limb loading quantities necessary to quantify a bone remodeling stimulus.

NASA Center ARC↗

DOE OSTI2014

In silico prediction of toxicity of non-congeneric industrial chemicals using ensemble learning based modeling approaches

Ensemble learning approach based decision treeboost (DTB) and decision tree forest (DTF) models are introduced in order to establish quantitative structure–toxicity relationship (QSTR) for the prediction of toxicity of 1450 diverse chemicals. Eight non-quantum mechanical molecular descriptors were derived. Structural diversity of the chemicals was evaluated using Tanimoto similarity index. Stochastic gradient boosting and bagging algorithms supplemented DTB and DTF models were constructed for classification and function optimization problems using the toxicity end-point in T. pyriformis. Special attention was drawn to prediction ability and robustness of the models, investigated both in external and 10-fold cross validation processes. In complete data, optimal DTB and DTF models rendered accuracies of 98.90%, 98.83% in two-category and 98.14%, 98.14% in four-category toxicity classifications. Both the models further yielded classification accuracies of 100% in external toxicity data of T. pyriformis. The constructed regression models (DTB and DTF) using five descriptors yielded correlation coefficients (R{sup 2}) of 0.945, 0.944 between the measured and predicted toxicities with mean squared errors (MSEs) of 0.059, and 0.064 in complete T. pyriformis data. The T. pyriformis regression models (DTB and DTF) applied to the external toxicity data sets yielded R{sup 2} and MSE values of 0.637, 0.655; 0.534, 0.507 (marine bacteria) and 0.741, 0.691; 0.155, 0.173 (algae). The results suggest for wide applicability of the inter-species models in predicting toxicity of new chemicals for regulatory purposes. These approaches provide useful strategy and robust tools in the screening of ecotoxicological risk or environmental hazard potential of chemicals. - Graphical abstract: Importance of input variables in DTB and DTF classification models for (a) two-category, and (b) four-category toxicity intervals in T. pyriformis data. Generalization and predictive abilities of the constructed (c) DTB and (d) DTF regression models to predict the T. pyriformis toxicity of diverse chemicals. - Highlights: • Ensemble learning (EL) based models constructed for toxicity prediction of chemicals • Predictive models used a few simple non-quantum mechanical molecular descriptors. • EL-based DTB/DTF models successfully discriminated toxic and non-toxic chemicals. • DTB/DTF regression models precisely predicted toxicity of chemicals in multi-species. • Proposed EL based models can be used as tool to predict toxicity of new chemicals.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2017

Msi2 plays a carcinogenic role in esophageal squamous cell carcinoma via regulation of the Wnt/β-catenin and Hedgehog signaling pathways

Highlights: • Msi2 is upregulated in ESCC tissues and cell lines. • Msi2 is associated with tumor progression and poor prognosis of ESCC patients. • Msi2 promotes ESCC cell proliferation, EMT and migration. • Msi2 functions by regulating the Wnt/β-catenin and Hh signaling pathways. Msi2 has been widely reported to be upregulated and strongly associated with fast progress and poor prognosis in many cancers. However, the expression and role of Msi2 in esophageal squamous cell carcinoma (ESCC) remain unknown. In this study, we found that Msi2 was upregulated in ESCC clinical samples, and was significantly associated with tumor size, differentiation status, and lymph node metastasis in ESCC patients. Multivariate Cox regression analysis showed that Msi2 was an independent predictor for disease-free survival (DFS) and overall survival (OS). Moreover, knockdown of Msi2 impaired ESCC cell proliferation, epithelial-mesenchymal transition (EMT) and migration, while overexpression of Msi2 promoted ESCC cell proliferation, EMT and migration in vitro. Animal experiments also confirmed that Msi2 promoted ESCC cell proliferation in vivo. Mechanistically, Msi2 promoted ESCC cell proliferation, EMT and migration via regulation of the Wnt/β-catenin and Hedgehog (Hh) signaling pathways. Taken together, our study suggested that Msi2 could serve as a candidate for diagnosis and prognosis and as a potential therapeutic target in ESCC.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2022

Machine learning for design principles for single atom catalysts towards electrochemical reactions

Machine learning (ML) integrated density functional theory (DFT) calculations have recently been used to accelerate the design and discovery of heterogeneous catalysts such as single atom catalysts (SACs) through the establishment of deep structure–activity relationships. Here, this review provides recent progress in the ML-aided rational design of heterogeneous catalysts with the focus on SACs in terms of structure–activity relationships, feature importance analysis, high-throughput screening, stability, and metal–support interactions for electrochemistry. Support vector machine (SVM), random forest regression (RFR), and deep neural networks (DNN) along with atomic properties are mainly used for the design of SACs. The ML results have shown that the number of electrons in the d orbital, oxide formation enthalpy, ionization energy, Bader charge, d-band center, and enthalpy of vaporization are mainly the most important parameters for the defining of the structure–activity relationships for electrochemistry. However, the black-box nature of ML techniques occasionally makes a physical interpretation of descriptors, such as the Bader charge, d-band center, and enthalpy of vaporization, non-trivial. At the current stage, ML application is limited by the lack of a large and high-quality database. Future prospects for the development of a large database and a generalized ML algorithm for SAC design are discussed to give insights for further studies in this field.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2025

Derivative-free stochastic optimization via adaptive sampling strategies

In this paper, we present a novel derivative-free framework for solving unconstrained stochastic optimization problems. Many problems in fields ranging from simulation optimization to reinforcement learning to quantum computing involve settings where only stochastic function values are obtained via a zeroth-order oracle, which has no available gradient information and necessitates the usage of derivative-free optimization methodologies. Our approach includes estimating gradients using stochastic function evaluations and integrating adaptive sampling techniques to control the accuracy in these stochastic approximations. Our framework encapsulates several gradient estimation techniques, including standard finite-difference, Gaussian smoothing, sphere smoothing, randomized coordinate finite-difference, and randomized subspace finite-difference methods. We provide theoretical convergence guarantees for our framework and analyze the worst-case iteration and sample complexities associated with each gradient estimation method. Finally, we demonstrate the empirical performance of the methods on logistic regression and nonlinear least squares problems.

Adaptive sampling↗

DOE OSTI2019

Orally Bioavailable Androgen Receptor Degrader, Potential Next-Generation Therapeutic for Enzalutamide-Resistant Prostate Cancer

Androgen receptor (AR)-targeting prostate cancer drugs, which are predominantly competitive ligand-binding domain (LBD)-binding antagonists, are inactivated by common resistance mechanisms. It is important to develop next-generation mechanistically distinct drugs to treat castration- and drug-resistant prostate cancers. Second-generation AR pan antagonist UT-34 was selected from a library of compounds and tested in competitive AR binding and transactivation assays. In this study, UT-34 was tested using biophysical methods for binding to the AR activation function-1 (AF-1) domain. Western blot, gene expression, and proliferation assays were performed in various AR-positive enzalutamide-sensitive and -resistant prostate cancer cell lines. Pharmacokinetic and xenograft studies were performed in immunocompromised rats and mice. UT-34 inhibits the wild-type and LBD-mutant ARs comparably and inhibits the in vitro proliferation and in vivo growth of enzalutamide-sensitive and -resistant prostate cancer xenografts. In preclinical models, UT-34 induced the regression of enzalutamide-resistant tumors at doses when the AR is degraded; but, at lower doses, when the AR is just antagonized, it inhibits, without shrinking, the tumors. This indicates that degradation might be a prerequisite for tumor regression. Mechanistically, UT-34 promotes a conformation that is distinct from the LBD-binding competitive antagonist enzalutamide and degrades the AR through the ubiquitin proteasome mechanism. UT-34 has a broad safety margin and exhibits no cross-reactivity with G-protein–coupled receptor kinase and nuclear receptor family members. Collectively, UT-34 exhibits the properties necessary for a next-generation prostate cancer drug.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2020

Coupling High-Throughput Experiments and Regression Algorithms to Optimize PGM-Free ORR Electrocatalyst Synthesis

Over the past decades, significant improvement has been achieved in the performance of platinum group metal-free (PGM-free) materials as an alternative to Pt-based electrocatalysts for oxygen reduction reaction (ORR). However, further progress in ORR activity requires evaluation of precursors and synthesis approaches. In response to this challenge, we generated a first of its kind experimental data set of 36 samples using high-throughput synthesis and activity measurements. Several control parameters (e.g., Fe precursor identity, the precursor content, and pyrolysis temperature) were varied. We then developed several state-of-the-art machine learning (ML) based regression models to predict ORR activity, dependent on selected synthesis variables. Through an iterative algorithm, higher prediction accuracy (smaller root-mean-square error) was achieved. We identified that gradient boosting regression (GBR) and support vector regression (SVR), among several methods, work best for this data set. Aided by our ML-based surrogate models, we decided to alter catalyst synthesis conditions, which resulted in a 36% increase in measured ORR activity in comparison to the maximum ORR mass activity value of 21.9 A/g catalyst in the original data set. Overall, this combined experiment and machine learning approach represents a promising path forward toward developing highly efficient next-generation ORR electrocatalysts and, more generally, functional materials.

25 ENERGY STORAGE↗

NASA NTRS1979

Modern estimation techniques applied to microwave sensing of the marine boundary layer

Previous efforts in the area of satellite microwave sensing of the marine boundary layer have relied upon linear regression techniques to extract geophysical parameters from the microwave measurement data. The approach used in the present paper shifts emphasis away from the generation of regression weighting matrices which implicitly assume that the data are linear in the parameters to be determined and that the problem is statistically stationary. The idea is simply to employ modern computational estimation techniques to obtain parameter estimates from nonlinear noisy measurements. The approach is limited only to the region of validity of Grody's (1976) model. Attention is focused on documenting how estimation techniques, in particular the square root information filter (SRIF), are used to solve a nonlinear function optimization problem.

Bierman, G. J.↗

NASA NTRSDate not supplied

Informing the Space Launch System Booster Separation Initial CFD Run Matrix with Observed Parametric Sensitivity

It currently requires significant computational cost to simulate the flow physics of the booster separation event on the Space Launch System. This comes from the large parametric space in which the event occurs, as pre-separation flight conditions and separated booster core-relative trajectories can vary. Functionally removing the risk of core-booster collision mandates careful assessment of the fluid dynamics in terms of several trajectory parameters. However, simulating the entire trajectory envelope is computationally intractable given the high parametric dimension. In order to reduce the uncertainty in the resulting low-parametric-resolution aerodynamic booster separation database, a data-driven approach was developed to select which breakpoints should be studied by simulations and experiments and which should be relegated to a regression-based interpolation procedure. This technique works by simulating cases where the flow physics are most sensitive to changes in the parameters and leaving the less parametrically sensitive regions for interpolation. The result is a booster separation run matrix whose computational cost is comparable to that of previous database generations but has lower interpolation errors.

SLS↗

NASA NTRSDate not supplied

Informing the Space Launch System Booster Separation Initial CFD Run Matrix with Observed Parametric Sensitivity

SLS↗

DOE OSTI2023

Functional Predictor Variables for the Leaching Potential of Arsenic and Selenium from Coal Fly Ash

The release of leachates from intact coal ash impoundments is a concern due to the enrichment and mobilization of toxic elements such as arsenic (As) and selenium (Se). This study aims to explore the intrinsic properties of coal fly ash that correlate with the relative leachability of As and Se. We performed leaching experiments with 52 fly ash samples collected from 15 different U.S. power plants and representing coal feedstocks from the three major domestic regions. We assessed the mobilization potential of As and Se in fly ash based on standardized leaching protocols and performed multivariate and lasso regression analyses to explore correlations of leachable As and Se contents with characteristics such as major element contents, loss on ignition, and pH. The results of regression models indicated that major elements (Fe, Ca, and Al) for a wide range of fly ashes can serve as predictor variables for the leaching potential of As but not for Se. LOI and pH were not important predictive variables in the models. Both regression approaches resulted in relatively strong fits for leachable As (correlation coefficient R 2 = 0.78 for both models) compared to models for leachable Se (R 2 = 0.49). Overall, these results suggest that correlation models combined with on-site elemental analysis with portable analyzers may enable a screening method for leachable As in coal ash.

01 COAL, LIGNITE, AND PEAT↗

DOE OSTI2022

Optimizing Piezoelectric Nanocomposites by High‐Throughput Phase‐Field Simulation and Machine Learning

Abstract Piezoelectric nanocomposites with oxide fillers in a polymer matrix combine the merit of high piezoelectric response of the oxides and flexibility as well as biocompatibility of the polymers. Understanding the role of the choice of materials and the filler‐matrix architecture is critical to achieving desired functionality of a composite towards applications in flexible electronics and energy harvest devices. Herein, a high‐throughput phase‐field simulation is conducted to systematically reveal the influence of morphology and spatial orientation of an oxide filler on the piezoelectric, mechanical, and dielectric properties of the piezoelectric nanocomposites. It is discovered that with a constant filler volume fraction, a composite composed of vertical pillars exhibits superior piezoelectric response and electromechanical coupling coefficient as compared to the other geometric configurations. An analytical regression is established from a linear regression‐based machine learning model, which can be employed to predict the performance of nanocomposites filled with oxides with a given set of piezoelectric coefficient, dielectric permittivity, and stiffness. This work not only sheds light on the fundamental mechanism of piezoelectric nanocomposites, but also offers a promising material design strategy for developing high‐performance polymer/inorganic oxide composite‐based wearable electronics.

42 ENGINEERING↗

DOE OSTI2018

Energy-based descriptors to rapidly predict hydrogen storage in metal–organic frameworks

The low volumetric density of hydrogen is a critical limitation to its use as a transportation fuel. Filling a fuel tank with nanoporous materials, such as metal–organic frameworks (MOFs), could greatly improve the deliverable capacity of these tanks if appropriate materials could be found. Yet, since MOFs can be made from many combinations of metal nodes, organic linkers, and functional groups, the design space of possible MOFs is enormous. Experimental characterization of thousands of MOFs is infeasible, and even conventional molecular simulations can be prohibitively expensive for large databases. In this work, we have developed a data-driven approach to accelerate materials screening and learn structure–property relationships. We report new descriptors for gas adsorption in MOFs derived from the energetics of MOF–guest interactions. Using the bins of an energy histogram as features, we trained a sparse regression model to predict gas uptake in multiple MOF databases to an accuracy within 3 g L -1 . The interpretable model parameters indicate that a somewhat weak attraction between hydrogen and the framework is ideal for cryogenic storage and release. Our machine learning method is more than three orders of magnitude faster than conventional molecular simulations, enabling rapid exploration of large numbers of MOFs. As a case study, we applied the method to screen a database of more than 50 000 experimental MOF structures. We experimentally validated one of the top candidates identified from the accelerated screening, MFU-4l. This material demonstrated a hydrogen deliverable capacity of 47 g L -1 (54 g L -1 simulated) when operating at storage conditions of 77 K, 100 bar and delivery at 160 K, 5 bar.

36 MATERIALS SCIENCE↗

DOE OSTI2013

A FIRST LOOK AT CREATING MOCK CATALOGS WITH MACHINE LEARNING TECHNIQUES

We investigate machine learning (ML) techniques for predicting the number of galaxies (N{sub gal}) that occupy a halo, given the halo's properties. These types of mappings are crucial for constructing the mock galaxy catalogs necessary for analyses of large-scale structure. The ML techniques proposed here distinguish themselves from traditional halo occupation distribution (HOD) modeling as they do not assume a prescribed relationship between halo properties and N{sub gal}. In addition, our ML approaches are only dependent on parent halo properties (like HOD methods), which are advantageous over subhalo-based approaches as identifying subhalos correctly is difficult. We test two algorithms: support vector machines (SVM) and k-nearest-neighbor (kNN) regression. We take galaxies and halos from the Millennium simulation and predict N{sub gal} by training our algorithms on the following six halo properties: number of particles, M{sub 200}, {sigma}{sub v}, v{sub max}, half-mass radius, and spin. For Millennium, our predicted N{sub gal} values have a mean-squared error (MSE) of {approx}0.16 for both SVM and kNN. Our predictions match the overall distribution of halos reasonably well and the galaxy correlation function at large scales to {approx}5%-10%. In addition, we demonstrate a feature selection algorithm to isolate the halo parameters that are most predictive, a useful technique for understanding the mapping between halo properties and N{sub gal}. Lastly, we investigate these ML-based approaches in making mock catalogs for different galaxy subpopulations (e.g., blue, red, high M{sub star}, low M{sub star}). Given its non-parametric nature as well as its powerful predictive and feature selection capabilities, ML offers an interesting alternative for creating mock catalogs.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2020

Economic losses from extreme weather in the U.S. Gulf Coast region: spatially differential contributions of climate hazard and socioeconomic exposure and vulnerability

Worldwide economic losses from extreme weather events (EWE) have increased over recent decades, with significant geographic heterogeneity in damages. The IPCC defines the risk from EWE as a function of the climate hazard, socioeconomic exposure, and vulnerability. Although these three drivers vary at fine spatial scales, spatial variability largely has been overlooked in assessments of the drivers of economic loss from EWE. Using cluster analysis, we developed a novel socio-climate hazard typology (SCT) that integrates locally defined climate hazard and socioeconomic exposure and social vulnerability typologies. The results identified 838 unique SCT types impacted by EWE across the Gulf Coastal United States during 1981–2010. We regressed the SCT types and their constituent hazard and socioeconomic components against the cumulative economic loss (1981–2010) from EWE for each SCT type. Across the landscape, economic damages of SCT types were determined by unique, spatially explicit combinations of different risk factors, even in explaining the same level of economic loss. For example, multi-billion-dollar damages in the central Gulf Coast and peninsular Florida were explained by different drivers of risk, with damages in the former explained by additive interaction between climate hazard and multiplicative interaction between climate hazard and socioeconomic exposure and vulnerability, and in the latter explained by socioeconomic exposure and vulnerability. These results highlight the need to diagnose additive and multiplicative interactions among drivers of EWE risk in a spatially explicit context.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Efficient Parallelization of Irregular Applications on GPU Architectures

With the enlarging computation capacity of general Graphics Processing Units (GPUs), leveraging GPUs to accelerate parallel applications has become a critical topic in academia and industry. However, a wide range of irregular applications with the computation-/memory-intensive nature cannot easily achieve high GPU utilization. The challenges mainly involve the following aspects: first, data dependence leads to coarse-grained kernel and inefficient parallelism; second, heavy GPU memory usage may cause frequent memory evictions and extra overhead of I/O; third, specific computation patterns produce memory redundancies; last, workload balance and data reusability conjunctly benefit the overall performance, but there may exist a dynamic trade-off between them. Targeting these challenges, this dissertation proposes multiple optimizations to accelerate two real-world applications: many-body correlation functions to simulate nuclear physics in a large-scale scientific system; the other is the eALS-based matrix factorization recommendation system. To accelerate the calculations of many-body correlation functions, this dissertation presents three frameworks in GPU memory management and multi-GPU scheduling. Firstly, an optimized systematic GPU memory management framework, MemHC, utilizes a series of new memory reduction designs in GPU memory allocation, CPU/GPU communications, and GPU memory oversubscription. Secondly, an enhanced multi-GPU scheduling framework, MICCO, particularly by taking both data dimension (e.g., data reuse and data eviction) and computation dimension into account. MICCO designs a heuristic scheduling algorithm and a machine learning-based regression model to generate the optimal settings of a proposed new concept to manage the trade-off. Thirdly, a locality-aware multi-GPU scheduling framework. This scheduler leverages pipeline batch generation with a looking-ahead strategy by building local dependency graphs for memory transfer reduction and better data reuse, achieving up to 79.92% memory cost reduction and 1.67x speedup. To parallelize the eALS-based recommendation system, this dissertation proposes an efficient CPU/GPU heterogeneous recommendation system, HEALS. HEALS employs newly designed architecture-adaptive data formats to achieve load balance and good data locality on CPU and GPU. To mitigate the data dependence, HEALS presents a CPU/GPU collaboration model for both task parallelism and data parallelism with multiple kernel computation optimizations. In summary, this dissertation efficiently accelerates two typical irregular applications on GPUs by building four frameworks, including CPU/GPU collaboration, GPU memory management, and multi-GPU scheduling.

Wang, Qihan↗