Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Operator regression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

NOAA/NASA Joint Simulation of AMTS and HIRS

Sounding simulation test was designed to compare the relative accuracies of atmospheric temperature profiles retrieved from HIRS2, the current operational infrared temperature sounder, and AMTS, a proposed advanced high spectral resolution infrared sounder. Retrievals generated by GLAS, using their physical retrieval algorithm, and NESDIS, using their operational statistical regression algorithm, for both instruments under clear and cloudy conditions were compared. In the cloudy portion of the test, MSU data, corresponding to the microwave component of the current operational sounding system, was used in conjunction with both instruments to aid in cloud seeding.

Susskind, J.↗

Two dimensional convolute integers for machine vision and image recognition

Machine vision and image recognition require sophisticated image processing prior to the application of Artificial Intelligence. Two Dimensional Convolute Integer Technology is an innovative mathematical approach for addressing machine vision and image recognition. This new technology generates a family of digital operators for addressing optical images and related two dimensional data sets. The operators are regression generated, integer valued, zero phase shifting, convoluting, frequency sensitive, two dimensional low pass, high pass and band pass filters that are mathematically equivalent to surface fitted partial derivatives. These operators are applied non-recursively either as classical convolutions (replacement point values), interstitial point generators (bandwidth broadening or resolution enhancement), or as missing value calculators (compensation for dead array element values). These operators show frequency sensitive feature selection scale invariant properties. Such tasks as boundary/edge enhancement and noise or small size pixel disturbance removal can readily be accomplished. For feature selection tight band pass operators are essential. Results from test cases are given.

Edwards, Thomas R.↗

Multiple-Instance Regression with Structured Data

We present a multiple-instance regression algorithm that models internal bag structure to identify the items most relevant to the bag labels. Multiple-instance regression (MIR) operates on a set of bags with real-valued labels, each containing a set of unlabeled items, in which the relevance of each item to its bag label is unknown. The goal is to predict the labels of new bags from their contents. Unlike previous MIR methods, MI-ClusterRegress can operate on bags that are structured in that they contain items drawn from a number of distinct (but unknown) distributions. MI-ClusterRegress simultaneously learns a model of the bag's internal structure, the relevance of each item, and a regression model that accurately predicts labels for new bags. We evaluated this approach on the challenging MIR problem of crop yield prediction from remote sensing data. MI-ClusterRegress provided predictions that were more accurate than those obtained with non-multiple-instance approaches or MIR methods that do not model the bag structure.

learning↗

Results of the joint NASA/NOAA AMTS/HIRS2 sounding simulation test

The relative accuracies of atmospheric temperature profiles retrieved from HIRS2, the current operational infra-red temperature sounder, and AMTS, a proposed advanced high-spectral resolution infra-red sounder were compared. The sounding simulation test compared retrievals generated by GLAS, using their physical retrieval algorithm, and NESDIS, using their operational statistical regression algorithm, for both instruments under clear and cloudy conditions. Test results for both conditions are summarized in tables showing RMS temperature errors for 18 tropospheric layers, 4 stratospheric layers, and surface skin temperature. The improvement of the AMTS instrument over HIRS2, particularly for cloudy conditions is demonstrated. The GLAS retrievals are more accurate than the operational NESDIS retrieval, especially with increasing cloud cover.

Susskind, J.↗

A comprehensive and fair comparison of two neural operators (with practical extensions) based on $\mathrm{FAIR}$ data

Neural operators can learn nonlinear mappings between function spaces and offer a new simulation paradigm for real-time prediction of complex dynamics for realistic diverse applications as well as for system identification in science and engineering. Herein, we investigate the performance of two neural operators, which have shown promising results so far, and we develop new practical extensions that will make them more accurate and robust and importantly more suitable for industrial-complexity applications. The first neural operator, DeepONet, was published in 2019 (Lu et al., 2019), and its original architecture was based on the universal approximation theorem of Chen & Chen (1995). The second one, named Fourier Neural Operator or FNO, was published in 2020, and it is based on parameterizing the integral kernel in the Fourier space. DeepONet is represented by a summation of products of neural networks (NNs), corresponding to the branch NN for the input function and the trunk NN for the output function; both NNs are general architectures, e.g., the branch NN can be replaced with a CNN or a ResNet. According to Kovachki et al. (2021), FNO in its continuous form can be viewed conceptually as a DeepONet with a specific architecture of the branch NN and a trunk NN represented by a trigonometric basis. In order to compare FNO with DeepONet computationally for realistic setups, we develop several extensions of FNO that can deal with complex geometric domains as well as mappings where the input and output function spaces are of different dimensions. We also develop an extended DeepONet with special features that provide inductive bias and accelerate training, and we present a faster implementation of DeepONet with cost comparable to the computational cost of FNO, which is based on the Fast Fourier Transform. Here we consider 16 different benchmarks to demonstrate the relative performance of the two neural operators, including instability wave analysis in hypersonic boundary layers, prediction of the vorticity field of a flapping airfoil, porous media simulations in complex-geometry domains, etc. We follow the guiding principles of FAIR (Findability, Accessibility, Interoperability, and Reusability) for scientific data management and stewardship. The performance of DeepONet and FNO is comparable for relatively simple settings, but for complex geometries the performance of FNO deteriorates greatly. We also compare theoretically the two neural operators and obtain similar error estimates for DeepONet and FNO under the same regularity assumptions.

42 ENGINEERING↗

Forecasting Solar-Thermal Systems Performance under Transient Operation Using a Data-Driven Machine Learning Approach Based on the Deep Operator Network Architecture

Modeling and prediction of the dynamic behavior of thermal systems operating under intermittent energy input and variable load requirements represent one of the greatest challenges in the development of efficient and reliable renewable-based power generation technologies. In this work, a data-driven machine learning modeling framework was developed based on a modified version of the Deep Operator Network architecture where the time coordinate in the trunk net is replaced with historical data of the predicting quantity. The modeling framework can be used to accurately predict the performance of renewable-based energy conversion technologies including wind- and solar-based power plants. This novel framework was applied on a solar-thermal system that consists of a solar collection loop using a flat plate collector, a power generation loop comprising an Organic Rankine Cycle, and a thermal energy storage tank connecting both loops. Variable solar irradiance, air temperature, and power load profiles were used by the Deep Operator Network to predict the State-of-Charge and the efficiency of the thermal system for several days. The results were compared with the State-of-Charge and efficiency functions calculated using a physics-based model. For a simple operation scenario, characterized by a clear sky solar irradiance profile and constant load, the standard deviation in the State-of-Charge prediction by Deep Operator Network is below 0.9% during a seven-day prediction time horizon. For the most realistic operation scenario that considers real solar irradiance and a rough load profile, the maximum standard deviation in the predictions for the State-of-Charge and efficiency are below 6.8% and 2.5%, respectively. A comparison between Deep Operator Network and Long Short Term Memory network was also performed. In general, both networks predict very well the State-of-Charge for different data density conditions; however, a higher accuracy, with a standard deviation below 2.0%, is obtained by the Deep Operator Network during three and half days using sparser training data of 20-minute points. The same accuracy for the State-of-Charge prediction with the Long Short Term Memory network is achieved only for 14 h. Average standard deviations for the State-of-Charge prediction of 1.1% with the Deep Operator Network and 1.5% with the Long Short Term Memory network are obtained for a four-day prediction time using a denser training data of 5-minute points.

DeepONet↗

Leveraging hyperspectral phenotyping for accurate, non-destructive prediction of metabolite profiles in poplar under drought stress

Accurately predicting drought tolerance in woody perennial bioenergy crops is critical for sustainable biomass production under fluctuating precipitation. Hyperspectral imaging (HSI) in the visible-near-infrared (VNIR) and shortwave-infrared (SWIR) ranges offers a promising approach for predicting plant biochemical traits, yet its application in metabolite profiling remains underexplored. We integrated VNIR+SWIR HSI with untargeted metabolomics to investigate drought-induced metabolic shifts in Populus leaves from eight Populus genotypes. Metabolite profiling identified 127 compounds, with 73 showing significant drought responses spanning amino acids (AA), carbohydrates (CHO), phenolic glycosides (PG), organic acids (OA), fatty acids and alcohols (FA), terpenes (T), phenolic metabolites (P), and unclassified metabolites. Spectral analysis revealed consistently higher reflectance across VNIR and SWIR wavelengths in drought-stressed plants, corresponding with increased accumulation of AA and reduced CHO and PG levels. Least absolute shrinkage and selection operator (LASSO) regression modeling identified robust spectral predictors of metabolite concentrations, associating VNIR wavelengths (500–700 nm) predominantly with AA and P, whereas SWIR wavelengths (1680–1700 nm) reliably predicted CHO, OA, and T. Several stable spectral-metabolite associations persisted across the two watering regimes (drought vs. well-watered), highlighting their potential as spectral biomarkers for non-destructive stress monitoring. Minimal genotype-specific variation suggests that observed spectral and metabolic responses were driven primarily by environmental factors, likely reflecting limited genetic diversity among the commercial Populus genotypes examined. This work establishes VNIR+SWIR hyperspectral imaging as a powerful, non-destructive phenotyping tool for precision monitoring and targeted improvement of drought resilience in bioenergy crops.

Biochemical trait prediction↗

Deep Neural Network Algorithm for CMC Microstructure Characterization and Variability Quantification

Microstructure characterization and variability quantification are crucial for understanding ceramic matrix composites (CMCs) mechanical behavior and deformation mechanisms across length scales. Traditionally, analyses of the micrographs obtained from microscopy are labor-intensive. However, with the vast improvement in computer vision (CV) and deep learning (DL), an automated algorithm can be designed to extract essential microstructure variability from micrographs which can then be used to construct a statistically representative volume element (SRVE). The DL-based algorithm spans the taxonomy of microstructure analyses, including semantic segmentation of microstructure constituents, secondary phases, matrix/fiber interface, and defects, and quantifying the microstructure variability in terms of probability distributions. In this work, C/SiNC and SiC/SiNC CMCs microstructures are semantically segmented through a deep convolutional neural network, followed by variability quantification through the implementation of a fully connected regression layer, hence forming a deep regression network. The deep regression network operates in a feedforward regime, in which the neuron output signal traverses through the network in a unidirectional manner. The weight tensor associated with each layer is updated through a backpropagation stochastic gradient descent approach. The input gray-scale image obtained through in-house scanning electron microscope and confocal microscope micrographs is augmented through affine transformations to increase the training set size, which is then processed through four strided convolutional layers. This compresses the image resolution by half at each layer while increasing the image depth by applying different filters (image encoding). The class activation maps (CAMs) corresponding to the applied filters highlight the key architectural features and assist with the semantic segmentation of the microstructure.

Hamza, Mohamed H.↗

Intermediate Molecular Phenotypes to Identify Genetic Markers of Anthracycline-Induced Cardiotoxicity Risk

Cardiotoxicity due to anthracyclines (CDA) affects cancer patients, but we cannot predict who may suffer from this complication. CDA is a complex trait with a polygenic component that is mainly unidentified. We propose that levels of intermediate molecular phenotypes (IMPs) in the myocardium associated with histopathological damage could explain CDA susceptibility, so variants of genes encoding these IMPs could identify patients susceptible to this complication. Thus, a genetically heterogeneous cohort of mice (n = 165) generated by backcrossing were treated with doxorubicin and docetaxel. We quantified heart fibrosis using an Ariol slide scanner and intramyocardial levels of IMPs using multiplex bead arrays and QPCR. We identified quantitative trait loci linked to IMPs (ipQTLs) and cdaQTLs via linkage analysis. In three cancer patient cohorts, CDA was quantified using echocardiography or Cardiac Magnetic Resonance. CDA behaves as a complex trait in the mouse cohort. IMP levels in the myocardium were associated with CDA. ipQTLs integrated into genetic models with cdaQTLs account for more CDA phenotypic variation than that explained by cda-QTLs alone. Allelic forms of genes encoding IMPs associated with CDA in mice, including AKT1, MAPK14, MAPK8, STAT3, CAS3, and TP53, are genetic determinants of CDA in patients. Two genetic risk scores for pediatric patients (n = 71) and women with breast cancer (n = 420) were generated using machine-learning Least Absolute Shrinkage and Selection Operator (LASSO) regression. Thus, IMPs associated with heart damage identify genetic markers of CDA risk, thereby allowing more personalized patient management.

60 APPLIED LIFE SCIENCES↗

Serum bile acid and unsaturated fatty acid profiles of non-alcoholic fatty liver disease in type 2 diabetic patients

The understanding of bile acid (BA) and unsaturated fatty acid (UFA) profiles, as well as their dysregulation, remains elusive in individuals with type 2 diabetes mellitus (T2DM) coexisting with non-alcoholic fatty liver disease (NAFLD). Investigating these metabolites could offer valuable insights into the pathophy-siology of NAFLD in T2DM. Our aim is to identify potential metabolite biomarkers capable of distinguishing between NAFLD and T2DM. A training model was developed involving 399 participants, comprising 113 healthy controls (HCs), 134 individuals with T2DM without NAFLD, and 152 individuals with T2DM and NAFLD. External validation encompassed 172 participants. NAFLD patients were divided based on liver fibrosis scores. The analytical approach employed univariate testing, orthogonal partial least squares-discriminant analysis, logistic regression, receiver operating characteristic curve analysis, and decision curve analysis to pinpoint and assess the diagnostic value of serum biomarkers. Compared to HCs, both T2DM and NAFLD groups exhibited diminished levels of specific BAs. In UFAs, particular acids exhibited a positive correlation with NAFLD risk in T2DM, while the ω-6:ω-3 UFA ratio demonstrated a negative correlation. Levels of α-linolenic acid and γ-linolenic acid were linked to significant liver fibrosis in NAFLD. The validation cohort substantiated the predictive efficacy of these biomarkers for assessing NAFLD risk in T2DM patients. This study underscores the connection between altered BA and UFA profiles and the presence of NAFLD in individuals with T2DM, proposing their potential as biomarkers in the pathogenesis of NAFLD.

60 APPLIED LIFE SCIENCES↗

Embedded Sensors for Measuring Surface Regression

The development and evaluation of new hybrid and solid rocket motors requires accurate characterization of the propellant surface regression as a function of key operational parameters. These characteristics establish the propellant flow rate and are prime design drivers affecting the propulsion system geometry, size, and overall performance. There is a similar need for the development of advanced ablative materials, and the use of conventional ablatives exposed to new operational environments. The Miniature Surface Regression Sensor (MSRS) was developed to serve these applications. It is designed to be cast or embedded in the material of interest and regresses along with it. During this process, the resistance of the sensor is related to its instantaneous length, allowing the real-time thickness of the host material to be established. The time derivative of this data reveals the instantaneous surface regression rate. The MSRS could also be adapted to perform similar measurements for a variety of other host materials when it is desired to monitor thicknesses and/or regression rate for purposes of safety, operational control, or research. For example, the sensor could be used to monitor the thicknesses of brake linings or racecar tires and indicate when they need to be replaced. At the time of this reporting, over 200 of these sensors have been installed into a variety of host materials. An MSRS can be made in either of two configurations, denoted ladder and continuous (see Figure 1). A ladder MSRS includes two highly electrically conductive legs, across which narrow strips of electrically resistive material are placed at small increments of length. These strips resemble the rungs of a ladder and are electrically equivalent to many tiny resistors connected in parallel. A substrate material provides structural support for the legs and rungs. The instantaneous sensor resistance is read by an external signal conditioner via wires attached to the conductive legs on the non-eroding end of the sensor. The sensor signal can be transmitted from inside a high-pressure chamber to the ambient environment, using commercially available feedthrough connectors. Miniaturized internal recorders or wireless data transmission could also potentially be employed to eliminate the need for producing penetrations in the chamber case. The rungs are designed so that as each successive rung is eroded away, the resistance changes by an amount that yields a readily measurable signal larger than the background noise. (In addition, signal-conditioning techniques are used in processing the resistance readings to mitigate the effect of noise.) Hence, each discrete change of resistance serves to indicate the arrival of the regressing host material front at the known depth of the affected resistor rung. The average rate of regression between two adjacent resistors can be calculated simply as the distance between the resistors divided by the time interval between their resistance jumps. Advanced data reduction techniques have also been developed to establish the instantaneous surface position and regression rate when the regressing front is between rungs.

Gramer, Daniel J.↗

Practical Guide to Chemometric Analysis of Optical Spectroscopic Data

The methodology and mathematical treatment of several classic multivariate methods for the analysis of spectroscopic data is demonstrated in a straightforward way that can be used as a basis for teaching an undergraduate introductory course on chemometric analysis. The multivariate techniques of classical least squares (CLS), principal component regression (PCR), and partial least squares (PLS), as well as the univariate Beer’s law method have been described and compared, building students’ understanding by starting with the univariate method and progressing step by step into the multivariate methods. Equations for the production of regression vectors from training set spectral data is described and their use demonstrated for the prediction of constituent concentrations on a separate validation set of spectra. Extreme care is taken to ensure consistency in variable formatting of data matrices. This provides a key foundation to understanding how spectral data are manipulated using these different mathematical approaches for building quantitative regression models. Each method is applied to a real-world data set, and the results are discussed to show students the types of information that can be gleaned from each method. A training set comprised of 20 infrared absorbance spectra containing 3 constituents (benzene, polystyrene, and gasoline) of known composition are used to demonstrate the matrix operations for each regression method. A separate set of 12 real-world napalm samples (containing benzene, polystyrene and gasoline) are used as a validation set to demonstrate the ability to utilize the regression models on an unknown dataset. A toolbox (PNNL Chemometric Toolbox) written in MATLAB language is supplied in the Supplemental Information file and can be used as a companion for understanding the development and deployment of the chemometric algorithms described in this paper. The datasets of the infrared spectra are also supplied, allowing users to build and inspect the chemometric models on their own. Finally, the Toolbox includes scripts to assist users in loading their own datasets into MATLAB and performing CLS, PCR, and PLS on their data.

Upper-Division Undergraduate, Analytical Chemistry↗

NCAPH drives breast cancer progression and identifies a gene signature that predicts luminal a tumour recurrence

Luminal A tumours generally have a favourable prognosis but possess the highest 10-year recurrence risk among breast cancers. Additionally, a quarter of the recurrence cases occur within 5 years post-diagnosis. Identifying such patients is crucial as long-term relapsers could benefit from extended hormone therapy, while early relapsers might require more aggressive treatment. We conducted a study to explore non-structural chromosome maintenance condensin I complex subunit H’s (NCAPH) role in luminal A breast cancer pathogenesis, both in vitro and in vivo, aiming to identify an intratumoural gene expression signature, with a focus on elevated NCAPH levels, as a potential marker for unfavourable progression. Our analysis included transgenic mouse models overexpressing NCAPH and a genetically diverse mouse cohort generated by backcrossing. A least absolute shrinkage and selection operator (LASSO) multivariate regression analysis was performed on transcripts associated with elevated intratumoural NCAPH levels. We found that NCAPH contributes to adverse luminal A breast cancer progression. The intratumoural gene expression signature associated with elevated NCAPH levels emerged as a potential risk identifier. Transgenic mice overexpressing NCAPH developed breast tumours with extended latency, and in Mouse Mammary Tumor Virus (MMTV)-NCAPH ErbB2 double-transgenic mice, luminal tumours showed increased aggressiveness. High intratumoural Ncaph levels correlated with worse breast cancer outcome and subpar chemotherapy response. A 10-gene risk score, termed Gene Signature for Luminal A 10 (GSLA10), was derived from the LASSO analysis, correlating with adverse luminal A breast cancer progression. The GSLA10 signature outperformed the Oncotype DX signature in discerning tumours with unfavourable outcomes, previously categorised as luminal A by Prediction Analysis of Microarray 50 (PAM50) across three independent human cohorts. This new signature holds promise for identifying luminal A tumour patients with adverse prognosis, aiding in the development of personalised treatment strategies to significantly improve patient outcomes.

60 APPLIED LIFE SCIENCES↗

Fundamental phenomena on fuel decomposition and boundary layer combustion processes with applications to hybrid rocket motors

An experimental study on the fundamental processes involved in fuel decomposition and boundary layer combustion in hybrid rocket motors is being conducted at the High Pressure Combustion Laboratory of the Pennsylvania State University. This research should provide an engineering technology base for development of large scale hybrid rocket motors as well as a fundamental understanding of the complex processes involved in hybrid propulsion. A high pressure slab motor has been designed for conducting experimental investigations. Oxidizer (LOX or GOX) is injected through the head-end over a solid fuel (HTPB) surface. Experiments using fuels supplied by NASA designated industrial companies will also be conducted. The study focuses on the following areas: measurement and observation of solid fuel burning with LOX or GOX, correlation of solid fuel regression rate with operating conditions, measurement of flame temperature and radical species concentrations, determination of the solid fuel subsurface temperature profile, and utilization of experimental data for validation of a companion theoretical study also being conducted at PSU.

Kuo, Kenneth K.↗

Fundamental phenomena on fuel decomposition and boundary layer combustion processes with applications to hybrid rocket motors

An experimental study on the fundamental processes involved in fuel decomposition and boundary layer combustion in hybrid rocket motors is being conducted at the High Pressure Combustion Laboratory of the Pennsylvania State University. This research should provide a useful engineering technology base in the development of hybrid rocket motors as well as a fundamental understanding of the complex processes involved in hybrid propulsion. A high pressure slab motor has been designed and manufactured for conducting experimental investigations. Oxidizer (LOX or GOX) supply and control systems have been designed and partly constructed for the head-end injection into the test chamber. Experiments using HTPB fuel, as well as fuels supplied by NASA designated industrial companies will be conducted. Design and construction of fuel casting molds and sample holders have been completed. The portion of these items for industrial company fuel casting will be sent to the McDonnell Douglas Aerospace Corporation in the near future. The study focuses on the following areas: observation of solid fuel burning processes with LOX or GOX, measurement and correlation of solid fuel regression rate with operating conditions, measurement of flame temperature and radical species concentrations, determination of the solid fuel subsurface temperature profile, and utilization of experimental data for validation of a companion theoretical study (Part 2) also being conducted at PSU.

Kuo, Kenneth K.↗

Uncertainty Improvement in the NASA Glenn Research Center 8- by 6-Foot Supersonic Wind Tunnel

Within the past decade, a measurement uncertainty analysis (MUA) team was assembled at the NASA Glenn Research Center to assist the wind tunnel characterization team with quantification of uncertainty estimates for variables of interest in wind tunnels and test cells across the center. The initial analysis performed by the team was conducted on the 8- by 6- Foot Supersonic Wind Tunnel using results from the 1996/97 full calibration test entry. These MUA results were published in 2016 which included recommendations for methods to improve the uncertainty estimates for various variables of interest, such as changes to regression models, tunnel operation philosophy, and instrumentation choices. The wind tunnel characterization team utilized the proposed methods in 2019 during a full characterization test entry. Following publication of the 2019 test section characterization results, the MUA team pursued an update to the uncertainty estimates for the facility, which validated previous recommendations and revealed significantly reduced systematic uncertainties across most variables of interest. Inclusion of within-test repeat points in the 2019 test entry allowed for higher fidelity estimates of random uncertainty to be generated, as well. This collaboration between the facility, wind tunnel characterization, and MUA teams serves as an example of the data quality benefits that can be achieved through rigorous analysis of the sources of uncertainty in a ground-test facility.

Uncertainty↗

Uncertainty Improvement in the NASA Glenn Research Center 8- by 6-Foot Supersonic Wind Tunnel

Within the past decade, a measurement uncertainty analysis (MUA) team was assembled at NASA Glenn Research Center to assist the wind tunnel characterization team with quantification of uncertainty estimates for variables of interest in wind tunnels and test cells across the center. The initial analysis performed by the team was conducted on the 8- by 6-Foot Supersonic Wind Tunnel using results from the 1996/97 full calibration test entry. These MUA results were published in 2016 which included recommendations for methods to improve the uncertainty estimates for various variables of interest, such as changes to regression models, tunnel operation philosophy, and instrumentation choices. The wind tunnel characterization team utilized the proposed methods in 2019 during a full characterization test entry. Following publication of the 2019 test section characterization results, the MUA team pursued an update to the uncertainty estimates for the facility, which validated previous recommendations and revealed significantly reduced systematic uncertainties across most variables of interest. Inclusion of within-test repeat points in the 2019 test entry allowed for higher fidelity estimates of random uncertainty to be generated, as well. This collaboration between the facility, wind tunnel characterization, and MUA teams serves as an example of the data quality benefits that can be achieved through rigorous analysis of the sources of uncertainty in a ground-test facility.

Uncertainty↗