Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “multivariate data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
NASA NTRS1999

Uncertainty Analysis of Inertial Model Attitude Sensor Calibration and Application with a Recommended New Calibration Method

Statistical tools, previously developed for nonlinear least-squares estimation of multivariate sensor calibration parameters and the associated calibration uncertainty analysis, have been applied to single- and multiple-axis inertial model attitude sensors used in wind tunnel testing to measure angle of attack and roll angle. The analysis provides confidence and prediction intervals of calibrated sensor measurement uncertainty as functions of applied input pitch and roll angles. A comparative performance study of various experimental designs for inertial sensor calibration is presented along with corroborating experimental data. The importance of replicated calibrations over extended time periods has been emphasized; replication provides independent estimates of calibration precision and bias uncertainties, statistical tests for calibration or modeling bias uncertainty, and statistical tests for sensor parameter drift over time. A set of recommendations for a new standardized model attitude sensor calibration method and usage procedures is included. The statistical information provided by these procedures is necessary for the uncertainty analysis of aerospace test results now required by users of industrial wind tunnel test facilities.

Tripp, John S.↗
DOE OSTI2026

Machine Learning–Augmented Laser-Induced Breakdown Spectroscopy for Spectral Discrimination of Iron Oxalates

Enhanced characterization and phase identification of post-PUREX Pu Oxalates (PuOXA) are pivotal for nonproliferation and pre-detonation nuclear forensics. Despite significant advances in the characterization of PuO 2 samples, little is known about the impact of both the chemical structure and oxidation states of PuOXA (i.e., Pu(III) and Pu(IV)) have on optical emission signatures. Here, we demonstrate the analytical capabilities of laser-induced breakdown spectroscopy (LIBS) applied to Fe(II) and Fe(III) oxalate samples as surrogates for PuOXA, highlighting the discriminating features in the LIBS emission spectra arising from differences in the oxidation states within mixed FeOXA samples. We report the enhancement of spectral feature selection using Principal Component Analysis (PCA), which enables the analytical superiority of machine learning algorithms such as Linear Discriminant Analysis (LDA), Quadratic Discriminant Analysis (QDA), Partial Least Squares Regression (PLSR), Support Vector Regression (SVR), and Random Forest Regression (RFR) over conventional univariate techniques for phase discrimination and chemometric analysis. Cluster analysis revealed how both matrix effects and laser ablation influence cluster separability by introducing spectral artifacts that misdirect the maximization of variance. PCA-selected emission lines were used in the regression models, demonstrating that both univariate and multivariate linear regression models (i.e., PLSR and SVR) can achieve acceptable performance, with machine learning models outperforming conventional calibration regressions. Furthermore, the application of non-linearly activated PCA-selected emission lines illustrates how simplifying the data while retaining captured variance enables the use of less complex and more computationally efficient models. Furthermore, this is particularly evident in the underperformance of RFR, which suffers from increased computational costs and overfitting owing to its high complexity.

Oxalates↗
NASA NTRS2004

Neural network uncertainty assessment using Bayesian statistics: a remote sensing application

Neural network (NN) techniques have proved successful for many regression problems, in particular for remote sensing; however, uncertainty estimates are rarely provided. In this article, a Bayesian technique to evaluate uncertainties of the NN parameters (i.e., synaptic weights) is first presented. In contrast to more traditional approaches based on point estimation of the NN weights, we assess uncertainties on such estimates to monitor the robustness of the NN model. These theoretical developments are illustrated by applying them to the problem of retrieving surface skin temperature, microwave surface emissivities, and integrated water vapor content from a combined analysis of satellite microwave and infrared observations over land. The weight uncertainty estimates are then used to compute analytically the uncertainties in the network outputs (i.e., error bars and correlation structure of these errors). Such quantities are very important for evaluating any application of an NN model. The uncertainties on the NN Jacobians are then considered in the third part of this article. Used for regression fitting, NN models can be used effectively to represent highly nonlinear, multivariate functions. In this situation, most emphasis is put on estimating the output errors, but almost no attention has been given to errors associated with the internal structure of the regression model. The complex structure of dependency inside the NN is the essence of the model, and assessing its quality, coherency, and physical character makes all the difference between a blackbox model with small output errors and a reliable, robust, and physically coherent model. Such dependency structures are described to the first order by the NN Jacobians: they indicate the sensitivity of one output with respect to the inputs of the model for given input data. We use a Monte Carlo integration procedure to estimate the robustness of the NN Jacobians. A regularization strategy based on principal component analysis is proposed to suppress the multicollinearities in order to make these Jacobians robust and physically meaningful.

Neural Networks (Computer)↗
DOE OSTI2020

An Exploratory Approach Using Regression and Machine Learning in the Analysis of Mass Absorption Cross Section of Black Carbon Aerosols: Model Development and Evaluation

Mass absorption cross-section of black carbon (MAC BC ) describes the absorptive cross-section per unit mass of black carbon, and is, thus, an essential parameter to estimate the radiative forcing of black carbon. Many studies have sought to estimate MAC BC from a theoretical perspective, but these studies require the knowledge of a set of aerosol properties, which are difficult and/or labor-intensive to measure. We therefore investigate the ability of seven data analytical approaches (including different multivariate regressions, support vector machine, and neural networks) in predicting MAC BC for both ambient and biomass burning measurements. Our model utilizes multi-wavelength light absorption and scattering as well as the aerosol size distributions as input variables to predict MAC BC across different wavelengths. We assessed the applicability of the proposed approaches in estimating MAC BC using different statistical metrics (such as coefficient of determination (R 2 ), mean square error (MSE), fractional error, and fractional bias). Overall, the approaches used in this study can estimate MAC BC appropriately, but the prediction performance varies across approaches and atmospheric environments. Based on an uncertainty evaluation of our models and the empirical and theoretical approaches to predict MAC BC , we preliminarily put forth support vector machine (SVM) as a recommended data analytical technique for use. We provide an operational tool built with the approaches presented in this paper to facilitate this procedure for future users.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2001

A Log Logistic Survival Model Applied to Hypobaric Decompression Sickness

Decompression sickness (DCS) is a complex, multivariable problem. A mathematical description or model of the likelihood of DCS requires a large amount of quality research data, ideas on how to define a decompression dose using physical and physiological variables, and an appropriate analytical approach. It also requires a high-performance computer with specialized software. I have used published DCS data to develop my decompression doses, which are variants of equilibrium expressions for evolved gas plus other explanatory variables. My analytical approach is survival analysis, where the time of DCS occurrence is modeled. My conclusions can be applied to simple hypobaric decompressions - ascents lasting from 5 to 30 minutes - and, after minutes to hours, to denitrogenation (prebreathing). They are also applicable to long or short exposures, and can be used whether the sufferer of DCS is at rest or exercising at altitude. Ultimately I would like my models to be applied to astronauts to reduce the risk of DCS during spacewalks, as well as to future spaceflight crews on the Moon and Mars.

Conkin, Johnny↗
NASA NTRS1987

NAECON 87; Proceedings of the IEEE National Aerospace and Electronics Conference, Dayton, OH, May 18-22, 1987. Volumes 1, 2, 3, & 4

The present conference discusses topics in VLSI components and their packaging, signal processing, uses of cartographic data, data transmission, advanced avionics architectures, fiber-optics, information control and display, image processing, airborne radar and fire control, navigation, air data, Kalman filtering, power generation and control, spacecraft power structures, aircraft flying qualities, flight management, fault-tolerant computer architectures, actuation technologies, self-repairing flight control system technology, multivariable control, stability and control methods, and AFTI/F-16 flight test reports. Also discussed are the ADA/JOVIAL language and its applications, software acquisition and testing, advanced software concepts, software management, computer graphics and visual systems softwear, ADA in embedded avionics, 16- and 32-bit architectures, voice interaction applications, human/machine systems analysis, human factors and AI, mental workloads and displays, pilot acceleration protection research, communications system technology, space communications, reliability and maintainability, managerial techniques, engineering management, EM compatibility and nuclear hardening, expert systems, AI language/knowledge representation, expert system implementation, machine vision/optical processing, and advanced AI concepts and architectures.

Avionics↗
DOE OSTI2024

Upscaling Soil Organic Carbon Measurements at the Continental Scale Using Multivariate Clustering Analysis and Machine Learning

Abstract Estimates of soil organic carbon (SOC) stocks are essential for many environmental applications. However, significant inconsistencies exist in SOC stock estimates for the U.S. across current SOC maps. We propose a framework that combines unsupervised multivariate geographic clustering (MGC) and supervised Random Forests regression, improving SOC maps by capturing heterogeneous relationships with SOC drivers. We first used MGC to divide the U.S. into 20 SOC regions based on the similarity of covariates (soil biogeochemical, bioclimatic, biological, and physiographic variables). Subsequently, separate Random Forests models were trained for each SOC region, utilizing environmental covariates and SOC observations. Our estimated SOC stocks for the U.S. (52.6 ± 3.2 Pg for 0–30 cm and 108.3 ± 8.2 Pg for 0–100 cm depth) were within the range estimated by existing products like Harmonized World Soil Database, HWSD (46.7 Pg for 0–30 cm and 90.7 Pg for 0–100 cm depth) and SoilGrids 2.0 (45.7 Pg for 0–30 cm and 133.0 Pg for 0–100 cm depth). However, independent validation with soil profile data from the National Ecological Observatory Network showed that our approach ( R 2 = 0.51) outperformed the estimates obtained from Harmonized World Soil Database ( R 2 = 0.23) and SoilGrids 2.0 ( R 2 = 0.39) for the topsoil (0–30 cm). Uncertainty analysis (e.g., low representativeness and high coefficients of variation) identified regions requiring more measurements, such as Alaska and the deserts of the U.S. Southwest. Our approach effectively captures the heterogeneous relationships between widely available predictors and the current SOC baseline across regions, offering reliable SOC estimates at 1 km resolution for benchmarking Earth system models.

58 GEOSCIENCES↗
DOE OSTI2024

Defining Golden Batches in Biomanufacturing Processes From Internal Metabolic Activity to Detect Process Changes That May Affect Product Quality

ABSTRACT Cellular metabolism plays a role in the observed variability of a drug substance's Critical Quality Attributes (CQAs) made by biomanufacturing processes. Therefore, here we describe a new approach for monitoring biomanufacturing processes that measures a set of metabolic reaction rates (named Critical Metabolic Parameters (CMP) in addition to the macroscopic process conditions currently being used as Critical Process Parameters (CPP) for biomanufacturing. Constraint‐based systems biology models like Flux Balance Analysis (FBA) are used to estimate metabolic reaction rates, and metabolic rates are used as inputs for multivariate Batch Evolution Models (BEM). Metabolic activity was reproducible among batches and could be monitored to detect a deliberately induced macroscopic process shift (i.e., temperature change). The CMP approach has the potential to enable “golden batches” in biomanufacturing processes to be defined from the internal metabolic activity and to aid in detecting process changes that may impact the quality of the product. Overall, the data suggested that monitoring of metabolic activity has promise for biomanufacturing process control.

Biotechnology & Applied Microbiology↗
DOE OSTI2023

Observation of four top quark production in proton-proton collisions at s = 13 TeV

The observation of the production of four top quarks in proton-proton collisions is reported, based on a data sample collected by the CMS experiment at a center-of-mass energy of 13 TeV in 2016–2018 at the CERN LHC and corresponding to an integrated luminosity of 138 fb − 1 . Events with two same-sign, three, or four charged leptons (electrons and muons) and additional jets are analyzed. Compared to previous results in these channels, updated identification techniques for charged leptons and jets originating from the hadronization of b quarks, as well as a revised multivariate analysis strategy to distinguish the signal process from the main backgrounds, lead to an improved expected signal significance of 4.9 standard deviations above the background-only hypothesis. Four top quark production is observed with a significance of 5.6 standard deviations, and its cross section is measured to be 17.7 − 3.5 + 3.7 (stat) − 1.9 + 2.3 (syst) fb , in agreement with the available standard model predictions.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Representations of Precipitation Diurnal Cycle in the Amazon as Simulated by Observationally Constrained Cloud‐System Resolving and Global Climate Models

Abstract The ability of an observationally‐constrained cloud‐system resolving model (Weather Research and Forecasting; WRF, 4‐km grid spacing) and a global climate model (Energy Exascale Earth System Model; E3SM, 1‐degree grid spacing) to represent the precipitation diurnal cycle over the Amazon basin during the 2014 wet season is assessed. The WRF model coupled with a 3‐D variational data assimilation scheme reproduces the spatial variability of the precipitation diurnal cycle over the basin and the lifecycle of westward propagating MCSs initiated by the coastal sea‐breeze front. In contrast, a single morning peak in rainfall is produced by E3SM for simulations despite the nudging of large‐scale winds toward global reanalysis, indicating precipitation in E3SM is largely controlled by local convection associated with diurnal heating. The role of propagating MCS on the environment are discussed by using a multivariate perturbation analysis. We also find that the advection of moisture perturbations from ocean to inland regions have a higher correlation with the occurrence of MCSs in the Amazon than the intensity of colder air intrusion associated with sea breezes along the coast. Moreover, the presence of large cold pools over the central Amazon basin are responsible for the maintenance of propagating deep convection.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Latent-Space Dynamics for Prediction and Fault Detection in Geothermal Power Plant Operations

This paper presents a latent-space dynamic neural network (LSDNN) model for the multi-step-ahead prediction and fault detection of a geothermal power plant’s operation. The model was trained to learn the dynamics of the power generation process from multivariate time-series data and the effects of exogenous variables, such as control adjustment and ambient temperature. In the LSDNN model, an encoder–decoder architecture was designed to capture cross-correlation among different measured variables. In addition, a latent space dynamic structure was proposed to propagate the dynamics in the latent space to enable prediction. The prediction power of the LSDNN was utilized for monitoring a geothermal power plant and detecting abnormal events. The model was integrated with principal component analysis (PCA)-based process monitoring techniques to develop a fault-detection procedure. The performance of the proposed LSDNN model and fault detection approach was demonstrated using field data collected from a geothermal power plant.

15 GEOTHERMAL ENERGY↗
NASA NTRS1995

A diagnostic analysis of the VVP single-doppler retrieval technique

A diagnostic analysis of the VVP (volume velocity processing) retrieval method is presented, with emphasis on understanding the technique as a linear, multivariate regression. Similarities and differences to the velocity-azimuth display and extended velocity-azimuth display retrieval techniques are discussed, using this framework. Conventional regression diagnostics are then employed to quantitatively determine situations in which the VVP technique is likely to fail. An algorithm for preparation and analysis of a robust VVP retrieval is developed and applied to synthetic and actual datasets with high temporal and spatial resolution. A fundamental (but quantifiable) limitation to some forms of VVP analysis is inadequate sampling dispersion in the n space of the multivariate regression, manifest as a collinearity between the basis functions of some fitted parameters. Such collinearity may be present either in the definition of these basis functions or in their realization in a given sampling configuration. This nonorthogonality may cause numerical instability, variance inflation (decrease in robustness), and increased sensitivity to bias from neglected wind components. It is shown that these effects prevent the application of VVP to small azimuthal sectors of data. The behavior of the VVP regression is further diagnosed over a wide range of sampling constraints, and reasonable sector limits are established.

Boccippio, Dennis J.↗
DOE OSTI2021

Search for charged Higgs bosons decaying into a top quark and a bottom quark at $\sqrt{s}$ = 13 TeV with the ATLAS detector

A search for charged Higgs bosons decaying into a top quark and a bottom quark is presented. The data analysed correspond to 139 fb -1 of proton-proton collisions at $\sqrt{s}$ = 13 TeV, recorded with the ATLAS detector at the LHC. The production of a heavy charged Higgs boson in association with a top quark and a bottom quark, pp → tbH + → tbtb, is explored in the H + mass range from 200 to 2000 GeV using final states with jets and one electron or muon. Events are categorised according to the multiplicity of jets and b-tagged jets, and multivariate analysis techniques are used to discriminate between signal and background events. No significant excess above the background-only hypothesis is observed and exclusion limits are derived for the production cross-section times branching ratio of a charged Higgs boson as a function of its mass; they range from 3.6 pb at 200 GeV to 0.036 pb at 2000 GeV at 95% confidence level. The results are interpreted in the hMSSM and M$_{h}^{125}$ scenarios.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Toward Quantity-of-Interest Preserving Lossy Compression for Scientific Data

Today's scientific simulations and instruments are producing a large amount of data, leading to difficulties in storing, transmitting, and analyzing these data. While error-controlled lossy compressors are effective in significantly reducing data volumes and efficiently developing databases for multiple scientific applications, they mainly support error controls on raw data, which leaves a significant gap between the data and user's downstream analysis. This may cause unqualified uncertainties in the outcomes of the analysis, a.k.a quantities of interest (QoIs), which are the major concerns of users in adopting lossy compression in practice. In this paper, we propose rigorous mathematical theories to preserve four families of QoIs that are widely used in scientific analysis during lossy compression along with practical implementations. Specifically, we first develop the error control theory for univariate QoIs which are essential for computing physical properties such as kinetic energy, followed by multivariate QoIs that are more commonly used in real-world applications. The proposed method is integrated into a state-of-the-art compression framework in a modular fashion, which could easily adapt to new QoIs and new compression algorithms. Experiments on real-world datasets demonstrate that the proposed method provides faithful error control on important QoIs including kinetic energy, regional average, and isosurface without trials and errors, while offering compression ratios that are up to 4x of the compression ratios provided by state-of-the-art compressors.

Jiao, Pu↗
NASA NTRS1993

Experimental analysis of computer system dependability

This paper reviews an area which has evolved over the past 15 years: experimental analysis of computer system dependability. Methodologies and advances are discussed for three basic approaches used in the area: simulated fault injection, physical fault injection, and measurement-based analysis. The three approaches are suited, respectively, to dependability evaluation in the three phases of a system's life: design phase, prototype phase, and operational phase. Before the discussion of these phases, several statistical techniques used in the area are introduced. For each phase, a classification of research methods or study topics is outlined, followed by discussion of these methods or topics as well as representative studies. The statistical techniques introduced include the estimation of parameters and confidence intervals, probability distribution characterization, and several multivariate analysis methods. Importance sampling, a statistical technique used to accelerate Monte Carlo simulation, is also introduced. The discussion of simulated fault injection covers electrical-level, logic-level, and function-level fault injection methods as well as representative simulation environments such as FOCUS and DEPEND. The discussion of physical fault injection covers hardware, software, and radiation fault injection methods as well as several software and hybrid tools including FIAT, FERARI, HYBRID, and FINE. The discussion of measurement-based analysis covers measurement and data processing techniques, basic error characterization, dependency analysis, Markov reward modeling, software-dependability, and fault diagnosis. The discussion involves several important issues studies in the area, including fault models, fast simulation techniques, workload/failure dependency, correlated failures, and software fault tolerance.

Iyer, Ravishankar, K.↗
NASA NTRS2007

[Space Weather Impact on the Electricity Market]

Forbes & St. Cyr (2004, hereafter "FISC") have provided evidence that the electricity market can be impacted by space weather. Our analysis indicated that the estimated market impact for PJM was 3.7 % or approximately $500 million dollars over the 19 month sample period. Kappenman has taken exception to this estimate and contends that we have exaggerated the magnitude of the problem that space weather poses to PJM. There are four specific issues: (1) he claims that we have ignored relevant literature; (2) he asserts that Dst is not an appropriate proxy for GICs in PJM; (3) he charges that our findings are inconsistent with the impact of the 17 September 2000 storm; and (4) he alleges that our discussion of October 2003 storms is misleading. In our article, we have explained our methodology, multivariate regression analysis, with a particular focus on how it compares to correlation analysis. We have also explained the limitations of our analysis. We noted that "...While the Dstlprice relationship was found to be robust, the precise estimate should be treated with a relatively high degree of caution given that econometric modeling is not an exact science as well as the fact that the measure of space weather may be a poor proxy for GICs" (paragraph 96). We have also noted that additional research using local magnetometer data are needed (paragraph 97). We did not claim that that our findings for PJM are representative of the impact of space weather on other power grids. On the contrary, we noted that ... "Only analysis of other power grids will tell. " (paragraph 97). Kappenman inaccurately asserts that we have indicated that our findings . . . "imply much higher total costs are likely across the US and elsewhere in the world." He also inaccurately asserts that we have claimed that " . . . Dst is the most suited proxy for GIC in the PJM grid.. ." Moreover, he inaccurately refers to our analysis as a correlation study that uses Dst as quasi-binary indicator.

SaintCyr, O. Chris↗
DOE OSTI2020

Reliable machine prognostic health management in the presence of missing data

Prognostics and health management enables the prediction of future degradation and remaining useful life (RUL) for in-service systems based on historical and contemporary data, showing promise for many practical applications. One major challenge for prognostics is the common occurrence of missing values in time-series data, often caused by disruptions in sensor communication or hardware/software failures. Another major concern is that the sufficient prior knowledge of critical component degradation with a clear failure threshold is often not readily available in practice. These issues can significantly hinder the application of advanced signal and data analysis methods and consequently degrade the health management performance. In this article, we propose a novel data-driven framework that is capable of providing accurate and reliable predictions of degradation and RUL. In this approach, one-hot health state indicators are appended to the historical time series so that the model learns end-of-life automatically. A modified gate recurrent unit based variational autoencoder is employed in generative adversarial networks to model the temporal irregularity of the incomplete time series. Furthermore, experiments on multivariate time-series datasets collected from real-world aeroengines verify that significant performance improvement can be achieved using the proposed model for robust long-term prognostics.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2025

Quantification of the REE 3+ aqua ions and chloride species in aqueous fluids by in situ Raman spectroscopy using perturbations of the water band

Acidic NaCl-rich aqueous fluids play a crucial role in forming hydrothermal rare earth elements (REE) mineral deposits. Aqueous REE mobility is mostly controlled by the stabilities of REE 3+ and REE chloride species. Our current knowledge of REE speciation is based on solubility data, thermodynamic models and in situ spectroscopic measurements, sometimes coupled with molecular simulations. Here, in this study, we investigate Nd and Yb speciation in pH2 Cl-bearing solutions at 25 °C and 0.1 MPa with variable Cl/REE ratios using Raman Spectroscopy in solutions with 0.1 to 0.6 mol/kg NdCl 3 or YbCl 3 and 0.2 to 3.2 mol/kg NaCl. Due to the challenges in resolving the REE-Cl band, we developed a new method using the water vibrational mode and multivariate curve resolution (MCR) analysis. The Raman spectra for the vibrational band of water (2700 to 3900 cm –1 ) were collected at 25 °C and fitted by three Gaussian sub-peaks, then quantified using MCR analysis to de-convolute the water band into bulk H 2 O and the perturbations caused by of Cl – , REE 3+ , and REE chloride species. REE speciation based on the perturbations of the water band indicates that REE 3+ aqua ions dominate acidic solutions at 25 °C, but up to ~20 mol% YbCl 2+ forms at high YbCl 3 concentrations. The new method is promising for quantifying in situ speciation of the REE 3+ aqua ions and REE chloride species in aqueous fluids while providing information on the hydration of ions. This method improves our molecular level understanding of REE aqueous species stability and their role in REE mobilization during fluid-rock interaction.

58 GEOSCIENCES↗