Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “multivariate data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32
All sourcesNASA NTRSDOE OSTI
NASA NTRS2011

Distributed Monitoring of the R(sup 2) Statistic for Linear Regression

The problem of monitoring a multivariate linear regression model is relevant in studying the evolving relationship between a set of input variables (features) and one or more dependent target variables. This problem becomes challenging for large scale data in a distributed computing environment when only a subset of instances is available at individual nodes and the local data changes frequently. Data centralization and periodic model recomputation can add high overhead to tasks like anomaly detection in such dynamic settings. Therefore, the goal is to develop techniques for monitoring and updating the model over the union of all nodes data in a communication-efficient fashion. Correctness guarantees on such techniques are also often highly desirable, especially in safety-critical application scenarios. In this paper we develop DReMo a distributed algorithm with very low resource overhead, for monitoring the quality of a regression model in terms of its coefficient of determination (R2 statistic). When the nodes collectively determine that R2 has dropped below a fixed threshold, the linear regression model is recomputed via a network-wide convergecast and the updated model is broadcast back to all nodes. We show empirically, using both synthetic and real data, that our proposed method is highly communication-efficient and scalable, and also provide theoretical guarantees on correctness.

Bhaduri, Kanishka↗
NASA NTRS2019

Numerical Reanalyses as a Gateway to Arctic Synthesis

Reanalyses are regularly gridded, retrospective depictions of the physical earth system, which are produced through the correction of a short-term forecast to available observations. In the Arctic, reanalyses are particularly well suited to marshal the sparse observing network to provide a plausible, multivariate representation of conditions. Atmospheric reanalyses such as MERRA-2 (NASA Modern-Era Retrospective analysis for Research and Applications, version 2) and ocean reanalyses such as SODA3 (Univ. Maryland Simple Ocean Data Assimilation version 3) are widely used in Arctic research for diagnostic studies of circulation, model evaluation, and as boundary conditions for a variety of process models. Here, we provide examples that illustrate the utility of reanalyses for providing information on the spatial and temporal scales of recent, rapid changes in the Arctic. Recent trends in Arctic surface temperatures, surface melt over Greenland and Arctic glaciers, and evolving freshwater conditions in the Arctic Ocean are examples where reanalyses can provide information that cannot easily be obtained via other means. These examples provide information on the scale, magnitude, and the uncertainty of recent Arctic change and provide a context for future scenarios. We further quantify uncertainties in key reanalyses variables and approaches for addressing these issues.

Arctic↗
DOE OSTI2023

Experimental study on kinetic oxidation of graphite IG-110 by steam

Graphite is proposed for use in High-temperature Gas-cooled Reactors (HTGRs) as the fuel matrix, neutron moderator/reflector, and core structural material. One important property of nuclear grade graphite is their resistance to oxidation in high-temperature environment. Extensive investigation has been performed in the literature for graphite oxidation by air. However, available experimental data are still limited for graphite oxidation by steam under conditions comparable to a postulated steam ingress accident in HTGRs. In this study, the oxidation rate of graphite IG-110 by steam was measured at temperatures from 850 to 1100 °C with the steam partial pressure varying from 0.5 to 20.0 kPa and the hydrogen partial pressure varying from 0 to 2.0 kPa. Further analysis confirms the oxidation process in this present study is dominated by the chemical kinetics, which lends credit to the data for being used to develop numerical models. It was observed that the increase of the kinetic oxidation rate with the steam partial pressure tends to become less apparent if the steam partial pressure keeps increasing. In addition, it was found that the partitioning of hydrogen inhibits the graphite-steam reaction process even with the steam partial pressure up to 20.0 kPa. However, this inhibiting effect starts to become saturated when the hydrogen partial pressure exceeds 1.0 kPa. The oxidation rates were fitted to the conventional Langmuir-Hinshelwood (LH) and Boltzmann-enhanced Langmuir-Hinshelwood (BLH) models by a multivariable optimization algorithm. The BLH model exhibits a better accuracy than the LH model within the specified experimental conditions. The predicted oxidation rate using the BLH model shows a mean relative difference of about 24% with the maximum difference of about 55% when compared with our experimental data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2022

Multivariate Time Series Anomaly Detection with Few Positive Samples

Given the scarcity of anomalies in real-world applications, the majority of literature has been focusing on modeling normality. The learned representations enable anomaly detection as the normality model is trained to capture certain key underlying data regularities under normal circumstances. In practical settings, particularly industrial time series anomaly detection, we often encounter situations where a large amount of normal operation data is available along with a small number of anomaly events collected over time. This practical situation calls for methodologies to leverage these small number of anomaly events to create a better anomaly detector. In this paper, we introduce two methodologies to address the needs of this practical situation and compared them with recently developed state of the art techniques. Our proposed methods anchor on representative learning of normal operation with autoregressive (AR) model along with loss components to encourage representations that separate normal versus few positive examples. We applied the proposed methods to two industrial anomaly detection datasets and demonstrated effective performance in comparison with approaches from literature. Our study also points out additional challenges with adopting such methods in practical applications.

Xue, Feng↗
DOE OSTI2023

Symptoms and Systemic Drug Reactions in Persons Receiving Weekly Rifapentine Plus Isoniazid (3HP) Treatment for Latent Tuberculosis Infection

Abstract Background Three months of weekly rifapentine plus isoniazid (3HP) therapy for latent tuberculosis infection (LTBI) is recommended worldwide. The development of symptoms and systemic drug reactions (SDRs) on 3HP have not been fully characterized. We aimed to determine the patterns of symptom development and identify SDRs and associated factors in patients taking 3HP. Methods We analyzed symptoms data in participants receiving 3HP in the Tuberculosis Trials Consortium's iAdhere study (Study 33). We examined the patterns of symptom reporting across participants from baseline and 4 monthly visits. Bivariate analyses and multivariable regression models were used to identify factors associated with SDRs. Risk ratios (RRs) and 95% confidence intervals (CIs) were calculated. Results Among 1002 participants receiving 3HP, 768 (77%) reported at least 1 symptom; 97% of these symptoms were grade 1 (79%) or grade 2 (18%). Most symptoms developed in the first month and resolved. A total of 111 (11%) participants had symptoms that met criteria for SDRs; however, 53 (48%) of these participants completed therapy. Factors associated with SDRs and discontinuation included female sex (RR: 2.05; 95% CI: 1.19–3.54), age ≥45 years (RR: 1.99; 95% CI: 1.19–3.31), and use of concomitant medications (RR: 2.26; 95% CI: 1.15–4.42). Conclusions Although most patients receiving 3HP reported symptoms, most were mild, occurred early, and resolved without stopping treatment. Among patients experiencing SDRs, nearly half were able to complete therapy. Patient and provider education should focus on differentiating severe reactions where 3HP should be stopped from minor symptoms that will resolve. Clinical Trials Registration. NCT01582711.

Immunology↗
DOE OSTI2021

The Prediction Model of Risk Factors for COVID-19 Developing into Severe Illness Based on 1046 Patients with COVID-19

This study analyzed the risk factors for patients with COVID-19 developing severe illnesses and explored the value of applying the logistic model combined with ROC curve analysis to predict the risk of severe illnesses at COVID-19 patients’ admissions. The clinical data of 1046 COVID-19 patients admitted to a designated hospital in a certain city from July to September 2020 were retrospectively analyzed, the clinical characteristics of the patients were collected, and a multivariate unconditional logistic regression analysis was used to determine the risk factors for severe illnesses in COVID-19 patients during hospitalization. Based on the analysis results, a prediction model for severe conditions and the ROC curve were constructed, and the predictive value of the model was assessed. Logistic regression analysis showed that age (OR = 3.257, 95% CI 10.466–18.584), complications with chronic obstructive pulmonary disease (OR = 7.337, 95% CI 0.227–87.021), cough (OR = 5517, 95% CI 0.258–65.024), and venous thrombosis (OR = 7322, 95% CI 0.278–95.020) were risk factors for COVID-19 patients developing severe conditions during hospitalization. When complications were not taken into consideration, COVID-19 patients’ ages, number of diseases, and underlying diseases were risk factors influencing the development of severe illnesses. The ROC curve analysis results showed that the AUC that predicted the severity of COVID-19 patients at admission was 0.943, the optimal threshold was −3.24, and the specificity was 0.824, while the sensitivity was 0.827. The changes in the condition of severe COVID-19 patients are related to many factors such as age, clinical symptoms, and underlying diseases. This study has a certain value in predicting COVID-19 patients that develop from mild to severe conditions, and this prediction model is a useful tool in the quick prediction of the changes in patients’ conditions and providing early intervention for those with risk factors.

Lian, Zhichuang↗
DOE OSTI2024

Modeling Spatial Asymmetries in Teleconnected Extreme Temperatures

Abstract Combining strengths from deep learning and extreme value theory can help describe complex relationships between variables where extreme events have significant impacts (e.g., environmental or financial applications). Neural networks learn complicated nonlinear relationships from large datasets under limited parametric assumptions. By definition, the number of occurrences of extreme events is small, which limits the ability of the data-hungry, nonparametric neural network to describe rare events. Inspired by recent extreme cold winter weather events in North America caused by atmospheric blocking, we examine several probabilistic generative models for the entire multivariate probability distribution of daily boreal winter surface air temperature. We propose metrics to measure spatial asymmetries, such as long-range anticorrelated patterns that commonly appear in temperature fields during blocking events. Compared to vine copulas, the statistical standard for multivariate copula modeling, deep learning methods show improved ability to reproduce complicated asymmetries in the spatial distribution of ERA5 temperature reanalysis, including the spatial extent of in-sample extreme events.

Krock, Mitchell L.↗
NASA NTRS1988

A multivariate variational objective analysis-assimilation method. Part 1: Development of the basic model

The variational method of undetermined multipliers is used to derive a multivariate model for objective analysis. The model is intended for the assimilation of 3-D fields of rawinsonde height, temperature and wind, and mean level temperature observed by satellite into a dynamically consistent data set. Relative measurement errors are taken into account. The dynamic equations are the two nonlinear horizontal momentum equations, the hydrostatic equation, and an integrated continuity equation. The model Euler-Lagrange equations are eleven linear and/or nonlinear partial differential and/or algebraic equations. A cyclical solution sequence is described. Other model features include a nonlinear terrain-following vertical coordinate that eliminates truncation error in the pressure gradient terms of the horizontal momentum equations and easily accommodates satellite observed mean layer temperatures in the middle and upper troposphere. A projection of the pressure gradient onto equivalent pressure surfaces removes most of the adverse impacts of the lower coordinate surface on the variational adjustment.

Achtemeier, Gary L.↗
NASA NTRS1995

Reduction, analysis, and properties of electric current systems in solar active regions

The specific attraction and, in large part, the significance of solar magnetograms lie in the fact that they give the most important data on the electric currents and the nonpotentiality of active regions. Using the vector magnetograms from the Marshall Space Flight Center (MSFC), we employ a unique technique in the area of data analysis for resolving the 180 deg ambiguity in order to calculate the spatial structure of the vertical electric current density. The 180 deg ambiguity is resolved by applying concepts from the nonlinear multivariable optimization theory. The technique is shown to be of particular importance in very nonpotential active regions. The characterization of the vertical electric current density for a set of vector magnetograms using this method then gives the spatial scale, locations, and magnitude of these current systems. The method, which employs an intermediate parametric function which covers the magnetogram and which defines the local `preferred' direction, minimizes a specific functional of the observed transverse magnetic field. The specific functional that is successful is the integral of the square of the vertical current density. We find that the vertical electric current densities have common characteristics for the extended bipolar (beta) (gamma) (delta)-regions studied. The largest current systems have j(sub z)'s which maximizes around 30 mA/sq m and have a linear decreasing distribution to a diameter of 30 Mn.

Gary, G. Allen↗
NASA NTRS1995

Reduction, Analysis, and Properties of Electric Current Systems in Solar Active Regions

The specific attraction and, in large part, the significance of solar vector magnetograms lie in the fact that they give the most important data on the electric currents and the nonpotentiality of active regions. Using the vector magnetograms from the Marshall Space Flight Center (MSFC), we employ a unique technique in the area of data analysis for resolving the 180 degree ambiguity in order to calculate the spatial structure of the vertical electric current density. The 180 degree ambiguity is resolved by applying concepts from the nonlinear multivariable optimization theory. The technique is shown to be of particular importance in very nonpotential active regions. The characterization of the vertical electric current density for a set of vector magnetograms using this method then gives the spatial scale, locations, and magnitude of these current systems. The method, which employs an intermediate parametric function which covers the magnetogram and which defines the local "preferred" direction, minimizes a specific functional of the observed transverse magnetic field. The specific functional that is successful is the integral of the square of the vertical current density. We find that the vertical electric current densities have common characteristics for the extended bipolar beta gamma delta-regions studied. The largest current systems have j(sub z)'s which maximizes around 30 mA per square meter and have a linear decreasing distribution to a diameter of 30 Mm.

Gary, G. Allen↗
DOE OSTI2024

Role of the likelihood for elastic scattering uncertainty quantification

In the last decade, uncertainty quantification (UQ) for optical model potentials (OMPs) has become a focal point for nuclear reaction theory, and several competing approaches for OMP UQ have recently been developed. Here, we clarify recent efforts to compare frequentist and Bayesian approaches in the context of OMP UQ [G. B. King et al., Phys. Rev. Lett. 122, 232502 (2019)]. We replicate a portion of that OMP UQ study but use independent statistical tools. Specifically, we compare two methods for OMP parameter inference from elastic scattering data: the Levenberg-Marquardt algorithm for χ 2 minimization on one hand and Markov chain Monte Carlo (MCMC) sampling on the other. Separately, we assess the common practice of using a renormalized likelihood (χ 2 /N), N being the number of data points, instead of the canonical weighted-least-squares likelihood (χ 2 ), as a way of accounting for unknown data correlations. Here, we show that for a generic linear model and for a five-parameter OMP analysis, frequentist and uniform-prior Bayesian approaches recover the same optimum and uncertainty estimates—not systematically larger uncertainties for the Bayesian approach, as was concluded in G. B. King et al., Phys. Rev. Lett. 122, 232502 (2019). Further, we show that if an additional, near-degenerate parameter is introduced into the same OMP analysis such that the parameter posterior becomes non-Gaussian, then covariance-based estimates of uncertainty become unreliable. Finally, we show that regardless of optimization approach, if χ 2 /N is used for the likelihood, the resulting parametric uncertainties increase by $\sqrt{N}$, and that this is responsible for the conclusions drawn in the revisited study. Based on our replication results, we find that a fortuitous cancellation of unreported errors and the renormalization factor can lead to improvement in empirical coverages, as was the case in the original comparative study. We emphasize that developing and applying a realistic likelihood function is an essential task in a UQ analysis, and that several recent UQ studies that employed a renormalized likelihood (i.e., including a 1/N factor) may have yielded unrealistically large uncertainties for elastic-scattering observables. If the parameter posterior deviates from multivariate-normal, a sampling-based approach like MCMC has a clear advantage over methods that assume the Laplace approximation holds. We note that empirical coverage can serve as an important internal check for the analyst whose model or data may have additional, unaccounted-for uncertainties.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Real-time confinement regime detection in fusion plasmas with convolutional neural networks and high-bandwidth edge fluctuation measurements

Abstract A real-time detection of the plasma confinement regime can enable new advanced plasma control capabilities for both the access to and sustainment of enhanced confinement regimes in fusion devices. For example, a real-time indication of the confinement regime can facilitate transition to the high-performing wide-pedestal (WP) quiescent H-mode, or avoid unwanted transitions to lower confinement regimes that may induce plasma termination. To demonstrate real-time confinement regime detection, we use the 2D beam emission spectroscopy (BES) diagnostic system to capture localized density fluctuations of long wavelength turbulent modes in the edge region at a 1 MHz sampling rate. BES data from 330 discharges in either L-mode, H-mode, quiescent H (QH)-mode, or WP QH-mode were collected from the DIII-D tokamak and curated to develop a high-quality database to train a deep-learning classification model for real-time confinement detection. We utilize the 6×8 spatial configuration with a time window of 1024 µ s and recast the input to obtain spectral-like features via fast Fourier transform preprocessing. We employ a shallow 3D convolutional neural network for the multivariate time-series classification task and utilize a softmax in the final dense layer to retrieve a probability distribution over the different confinement regimes. Our model classifies the global confinement state on 44 unseen test discharges with an average F 1 score of 0.94, using only ∼1 ms snippets of BES data at a time. This activity demonstrates the feasibility for real-time data analysis of fluctuation diagnostics in future devices such as ITER, where the need for reliable and advanced plasma control is urgent.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Multivariate Time Series Intermittent Fault Detectionin Controller Area Network CAN

Fault detection in Controller Area Network (CAN) systems is crucial for ensuring the reliability and safety of automotive and industrial applications. This study investigates and compares the effectiveness of time series classification models for supervised fault detection in CAN data. This repository contains the code and data for our benchmarking experiment aimed at detecting intermittent faults in automotive Controller Area Network (CAN) data. The goal of this project is to compare various machine learning (ML) and deep learning (DL) models using different Time Series Cross-Validation (TSCV) techniques to evaluate their effectiveness in a streaming environment for fault detection.

Hespeler, Steven [Oak Ridge National Laboratory (O↗
DOE OSTI2024

Parallel hybrid quantum-classical machine learning for kernelized time-series classification

Supervised time-series classification garners widespread interest because of its applicability throughout a broad application domain including finance, astronomy, biosensors, and many others. Here, in this work, we tackle this problem with hybrid quantum-classical machine learning, deducing pairwise temporal relationships between time-series instances using a timeseries Hamiltonian kernel (TSHK). A TSHK is constructed with a sum of inner products generated by quantum states evolved using a parameterized time evolution operator. This sum is then optimally weighted using techniques derived from multiple kernel learning. Because we treat the kernel weighting step as a differentiable convex optimization problem, our method can be regarded as an end-to-end learnable hybrid quantum-classical-convex neural network, or QCC-net, whose output is a data set-generalized kernel function suitable for use in any kernelized machine learning technique such as the support vector machine (SVM). Using our TSHK as input to a SVM, we classify univariate and multivariate time-series using quantum circuit simulators and demonstrate the efficient parallel deployment of the algorithm to 127-qubit superconducting quantum processors using quantum multi-programming.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Yet Another Discriminant Analysis (YADA): A Probabilistic Model for Machine Learning Applications

This paper presents a probabilistic model for various machine learning (ML) applications. While deep learning (DL) has produced state-of-the-art results in many domains, DL models are complex and over-parameterized, which leads to high uncertainty about what the model has learned, as well as its decision process. Further, DL models are not probabilistic, making reasoning about their output challenging. In contrast, the proposed model, referred to as Yet Another Discriminate Analysis(YADA), is less complex than other methods, is based on a mathematically rigorous foundation, and can be utilized for a wide variety of ML tasks including classification, explainability, and uncertainty quantification. YADA is thus competitive in most cases with many state-of-the-art DL models. Ideally, a probabilistic model would represent the full joint probability distribution of its features, but doing so is often computationally expensive and intractable. Hence, many probabilistic models assume that the features are either normally distributed, mutually independent, or both, which can severely limit their performance. YADA is an intermediate model that (1) captures the marginal distributions of each variable and the pairwise correlations between variables and (2) explicitly maps features to the space of multivariate Gaussian variables. Numerous mathematical properties of the YADA model can be derived, thereby improving the theoretic underpinnings of ML. Validation of the model can be statistically verified on new or held-out data using native properties of YADA. However, there are some engineering and practical challenges that we enumerate to make YADA more useful.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1997

An Assessment of the Regional Distribution of the Oxygen-Isotope Ratio in Northeastern Canada

A compilation of mean values of the oxygen-isotope ratio relative to standard mean ocean Water for 22 sites representative of conditions in north-eastern Canada is complemented with data on mean annual surface temperature, latitude, surface elevation, and mean annual shortest distance to open ocean denoted by the 10% sea-ice concentration boundary. Stepwise regression analysis is used to develop a multivariate model suitable to infer the distribution of 6 1"0 in an area of complex topography and possibly mixed source of advected water vapor. The best model is produced by a run in the backward mode at the 95% confidence level in which only temperature, latitude and distance to the open ocean remain in the model (the correlation coefficient is 0.915, the adjusted coefficient of determination is 0.809, the root mean square residual is 1.62). This model is similar to the best 6180 predictive model derived elsewhere for Greenland, suggesting a common principal source of advected moisture.

Giovinetto, Mario B.↗
DOE OSTI2021

Practical algorithms for multivariate rational approximation

We present two approaches for computing rational approximations to multivariate functions, motivated by their effectiveness as surrogate models for high-energy physics (HEP) applications. Our first approach builds on the Stieltjes process to efficiently and robustly compute the coefficients of the rational approximation. Our second approach is based on an optimization formulation that allows us to include structural constraints on the rational approximation (in particular, constraints demanding the absence of singularities), resulting in a semi-infinite optimization problem that we solve using an outer approximation approach. We present results for synthetic and real-life HEP data, and we compare the approximation quality of our approaches with that of traditional polynomial approximations.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2014

Real-Time Onboard Global Nonlinear Aerodynamic Modeling from Flight Data

Flight test and modeling techniques were developed to accurately identify global nonlinear aerodynamic models onboard an aircraft. The techniques were developed and demonstrated during piloted flight testing of an Aermacchi MB-326M Impala jet aircraft. Advanced piloting techniques and nonlinear modeling techniques based on fuzzy logic and multivariate orthogonal function methods were implemented with efficient onboard calculations and flight operations to achieve real-time maneuver monitoring and analysis, and near-real-time global nonlinear aerodynamic modeling and prediction validation testing in flight. Results demonstrated that global nonlinear aerodynamic models for a large portion of the flight envelope were identified rapidly and accurately using piloted flight test maneuvers during a single flight, with the final identified and validated models available before the aircraft landed.

Brandon, Jay M.↗