Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “multivariate”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

Stereotactic Body Radiation Therapy and the Influence of Chemotherapy on Overall Survival for Large (≥5 Centimeter) Non-Small Cell Lung Cancer

Purpose: Stereotactic body radiation therapy (SBRT) for ≥5 cm lesions is poorly defined, largely owing to the low sample sizes in existing studies. The present analysis examined the SBRT outcomes and assessed the effect of chemotherapy in this population. Methods and Materials: The National Cancer Data Base was queried for primary non-small cell lung cancer ≥5 cm treated with SBRT (≤10 fractions). Patient, tumor, and treatment parameters were extracted. The primary outcome was overall survival (OS). Statistical methods involved Kaplan-Meier analysis and multivariable Cox proportional hazards modeling. Results: From 2004 to 2012, data from 201 patients were analyzed. The median follow-up was 41.1 months. The median tumor size was 5.5 cm (interquartile range 5.0-6.0), with cT2a, cT2b, and cT3 disease in 24.9%, 53.2%, and 21.9%, respectively. The median total SBRT dose and fractionation was 50 Gy in 4 fractions, and 92.5% of the patients underwent SBRT with ≤5 fractions. The median OS was 25.1 months. Of the 201 patients, 15% received chemotherapy. The receipt of chemotherapy was associated with longer OS (median 30.6 vs 23.4 months; P=.027). On multivariable analysis, worse OS was seen with increasing age (hazard ratio [HR] 1.03; P=.012), poorly differentiated tumors (HR 2.06; P=.049), and T3 classification (HR 2.13; P=.005). On multivariable analysis, chemotherapy remained independently associated with improved OS (HR 0.57; P=.039). Conclusions: SBRT has utility in the setting of tumors ≥5 cm, with chemotherapy associated with improved OS in this subset. These hypothesis-generating data now raise the necessity of performing prospective analyses to determine whether chemotherapy confers outcome benefits after SBRT.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Understanding Competing Risks

Highlights: • Clinicians and researchers need to be cognizant of competing risks (ie, the occurrence of an event that precludes future development of the outcome of interest). • Censoring is appropriate when a patient being censored at a particular time (eg, owing to loss to follow-up) is deemed to have approximately the same future risk of developing the outcome of interest as patients still being followed, and when the reason for censoring is not related to events of interest. • Censoring is not appropriate in many scenarios; for example, a dead patient can never develop a future cancer recurrence or late effect. • Kaplan-Meier (KM) analysis is commonly used for a time-to-event analysis when the primary outcome (eg, overall survival) has no meaningful competing risk and censoring is appropriate. Cox proportional hazards modeling can be used for multivariable analysis to examine the association between covariates and the primary outcome. • In the presence of competing events, incorrect use of the KM analysis will likely lead to an overestimation of the risk of the outcome of interest and biased estimates from both univariable and multivariable analyses. Therefore, KM usually should not be used to determine local recurrence risk because humanity is always at risk for dying, which is a competing risk. • A competing risk analysis is therefore most appropriate when there are competing events to the primary outcome of interest. The most commonly used multivariable model in these situations is the Fine-Gray model. • Many fundamental questions in radiation oncology—local and regional recurrence, treatment-related toxicity—are best addressed using competing risk methodologies.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Practical Guide to Chemometric Analysis of Optical Spectroscopic Data

The methodology and mathematical treatment of several classic multivariate methods for the analysis of spectroscopic data is demonstrated in a straightforward way that can be used as a basis for teaching an undergraduate introductory course on chemometric analysis. The multivariate techniques of classical least squares (CLS), principal component regression (PCR), and partial least squares (PLS), as well as the univariate Beer’s law method have been described and compared, building students’ understanding by starting with the univariate method and progressing step by step into the multivariate methods. Equations for the production of regression vectors from training set spectral data is described and their use demonstrated for the prediction of constituent concentrations on a separate validation set of spectra. Extreme care is taken to ensure consistency in variable formatting of data matrices. This provides a key foundation to understanding how spectral data are manipulated using these different mathematical approaches for building quantitative regression models. Each method is applied to a real-world data set, and the results are discussed to show students the types of information that can be gleaned from each method. A training set comprised of 20 infrared absorbance spectra containing 3 constituents (benzene, polystyrene, and gasoline) of known composition are used to demonstrate the matrix operations for each regression method. A separate set of 12 real-world napalm samples (containing benzene, polystyrene and gasoline) are used as a validation set to demonstrate the ability to utilize the regression models on an unknown dataset. A toolbox (PNNL Chemometric Toolbox) written in MATLAB language is supplied in the Supplemental Information file and can be used as a companion for understanding the development and deployment of the chemometric algorithms described in this paper. The datasets of the infrared spectra are also supplied, allowing users to build and inspect the chemometric models on their own. Finally, the Toolbox includes scripts to assist users in loading their own datasets into MATLAB and performing CLS, PCR, and PLS on their data.

Upper-Division Undergraduate, Analytical Chemistry↗

Projected Changes in United States Regional Extreme Heat Days Derived From Bivariate Quantile Mapping of CMIP5 Simulations

Projections of multivariate climate extremes require methodological approaches that can maintain relationships among variables. Here we apply a piecewise multivariate quantile mapping approach to temperature and humidity projections from a subset of models from the Fifth Coupled Model Intercomparison Project and analyze the resulting climatology of extreme heat days (EHDs) with explicit consideration of the prevailing humidity. The piecewise multivariate bias correction method shows good fidelity in reproducing the frequency of different types of extreme heat events in the historical period. Projections for U.S. regions and individual cities for both the middle and end of the century are characterized by increases in the frequency of EHDs, and especially those characterized by high humidity. For many regions and individual cities, there is no overlap between the frequency of high-humidity EHDs in general circulation model ensembles from the historical and future periods, indicating that increases in extreme heat are robust. Analysis of 500-mb height, sea-level pressure, and low-level circulation composites for historical and future periods indicates that the Fifth Coupled Model Intercomparison Project models reproduce basic large-scale circulation features associated with EHDs in U.S. regions and that future changes in extreme heat are related primarily to large-scale warming rather than enhancement of regional circulation anomalies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

The Global Atmosphere‐aerosol Model ICON‐A‐HAM2.3–Initial Model Evaluation and Effects of Radiation Balance Tuning on Aerosol Optical Thickness

Abstract The Hamburg Aerosol Module version 2.3 (HAM2.3) from the ECHAM6.3‐HAM2.3 global atmosphere‐aerosol model is coupled to the recently developed icosahedral nonhydrostatic ICON‐A (icon‐aes‐1.3.00) global atmosphere model to yield the new ICON‐A‐HAM2.3 atmosphere‐aerosol model. The ICON‐A and ECHAM6.3 host models use different dynamical cores, parameterizations of vertical mixing due to sub‐grid scale turbulence, and parameter settings for radiation balance tuning. Here, we study the role of the different host models for simulated aerosol optical thickness (AOT) and evaluate impacts of using HAM2.3 and the ECHAM6‐HAM2.3 two‐moment cloud microphysics scheme on several meteorological variables. Sensitivity runs show that a positive AOT bias over the subtropical oceans is remedied in ICON‐A‐HAM2.3 because of a different default setting of a parameter in the moist convection parameterization of the host models. The global mean AOT is biased low compared to MODIS satellite instrument retrievals in ICON‐A‐HAM2.3 and ECHAM6.3‐HAM2.3, but the bias is larger in ICON‐A‐HAM2.3 because negative AOT biases over the Amazon, the African rain forest, and the northern Indian Ocean are no longer compensated by high biases over the sub‐tropical oceans. ICON‐A‐HAM2.3 shows a moderate improvement with respect to AOT observations at AERONET sites. A multivariable bias score combining biases of several meteorological variables into a single number is larger in ICON‐A‐HAM2.3 compared to standard ICON‐A and standard ECHAM6.3. In the tropics, this multivariable bias is of similar magnitude in ICON‐A‐HAM2.3 and in ECHAM6.3‐HAM2.3. In the extra‐tropics, a smaller multivariable bias is found for ICON‐A‐HAM2.3 than for ECHAM6.3‐HAM2.3.

54 ENVIRONMENTAL SCIENCES↗

Inferring Plant Acclimation and Improving Model Generalizability With Differentiable Physics‐Informed Machine Learning of Photosynthesis

Net photosynthesis (A N ) is a key component of the global carbon cycle influencing climate feedback over decadal scales. Although plant acclimation to environmental changes can modify A N , traditional vegetation models in Earth system models (ESMs) often rely on plant functional type (PFT)-specific parameterizations or simplified acclimation assumptions limiting generalizability across time, space, and PFTs. In this study, we developed a differentiable photosynthesis model to learn the environmental dependencies of V c,max25 (maximum carboxylation rate at 25°C, representing photosynthetic capacity), as this genre of hybrid physics-informed machine learning can seamlessly train neural networks and process-based equations together. Compared to PFT-specific parameterization of V c,max25 , learning the environment dependencies of key photosynthetic parameters improved model spatiotemporal generalizability. Applying environmental acclimation to V c,max25 led to substantial variations in global mean A N indicating the need to address acclimation in ESMs. The model effectively captured multivariate observations (V c,max25 , A N , and stomatal conductance (g s )) simultaneously with multivariate constraints, improving generalization across space and PFTs. It also learned sensible acclimation relationships of V c,max25 to different environmental conditions. The model explained more than 54%, 57%, and 62% of the variance of A N , g s , and V c,max25 , respectively, presenting a first global-scale spatial test benchmark of A N and g s . These results highlight the potential for differentiable modeling to enhance process-based modules in ESMs and effectively leverage information from large, multivariate data sets.

54 ENVIRONMENTAL SCIENCES↗

Solvent-free spectroscopic method for high-throughput, quantitative screening of fatty acids in yeast biomass

Sustainable biofuels and bioproducts technologies are being developed by fermentation of sugars present and released from pretreated cellulosic biomass to lipids using oleaginous yeasts. Detailed analytical characterization of lipid content through cultivation under different scenarios not only is a bottleneck that slows down development of improved strains and processes, this process also creates significant chemical waste. Since lipids exhibit a dominant, distinct, and unique fingerprint in the NIR spectrum, the use of multivariate linear regression of respective wavelengths can be used for the prediction of intracellular lipid content present in the yeast biomass. In this work, we present data on the multivariate quantitative correlation of NIR spectra with measured lipid content in different oleaginous yeast strains. This work is the first demonstration of the rapid, non-destructive, lipid quantification on as little as 10 mg of yeast biomass in a 96-well format, preventing significant chemical pollution by applying a real-time monitoring process. We demonstrate a distinct correlation of lipid content with the accumulation of select fatty acids of the lipids for 5 different yeast species, among which, for S. cerevisiae and L. starkeyi , in-depth calibration curves were developed from 65 and 154 unique samples, respectively. Laslty, we demonstrate that NIR spectra can be used to accurately predict intracellular lipid content using multivariate linear regression analysis in a manner of minutes, avoiding the need for lengthy chemical analyses that are resource intensive.

09 BIOMASS FUELS↗

Real-time elemental analysis of liquids for process monitoring using laser-induced breakdown spectroscopy with a liquid wheel sampling approach

This article presents an engineered sampling system that used a rotating wheel to form a thin liquid layer, permitting the use of laser-induced breakdown spectroscopy (LIBS) for in situ, real-time elemental impurity quantification during liquid processing. The sampling approach was demonstrated on eight elements from across the periodic table (Na, Al, K, Ca, Ti, Sr, Mo, and Yb). Univariate and multivariate calibrations were presented for each element. The average value for percent root mean square errors of cross-validation for the multivariate models was 3.64%, highlighting the method's strong prediction accuracy. Additionally, the limits of detection for each analyte were estimated from their univariate models: Na = 0.0532, Al = 18.5, K = 0.105, Ca = 0.273, Ti = 67.7, Sr = 0.640, Mo = 22.4, and Yb = 22.9 μg mL –1 . Finally, a test in which multivariate models were used to monitor a liquid system for 80 min was performed to investigate the real-time monitoring capabilities of this liquid LIBS sampling approach. Rigorous measurements were performed to effectively predict the absence and concentrations of multiple analytes as they were spiked and diluted. This demonstration showed the feasibility of using LIBS for real-time liquid quantification models with estimated precision ≤ 8.1%. Finally, the limitations of this approach and potential future improvements are discussed.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

An Interactive Visual Analytics Framework for Multi-Field Data in a Geo-Spatial Context

Climate research produces a wealth of multivariate data. These data often have a geospatial reference and so it is of interest to show them within their geospatial context. One can consider this configuration as a multi field visualization problem, where the geospace provides the expanse of the field. However, there is a limit on the amount of multivariate information that can be fit within a certain spatial location, and the use of linked multivari ate information displays has previously been devised to bridge this gap. In this paper we focus on the interactions in the geographical display, present an implementation that uses Google Earth, and demonstrate it within a tightly linked parallel coordinates display. Several other visual representations, such as pie and bar charts are integrated into the Google Earth display and can be interactively manipulated. Further, we also demonstrate new brushing and visualization techniques for parallel coordinates, such as fixedwindow brushing and correlationenhanced display. We conceived our system with a team of climate researchers, who already made a few important discov eries using it. This demonstrates our system’s great potential to enable scientific discoveries, possibly also in oth er domains where data have a geospatial reference.

Environmental Molecular Sciences Laboratory↗

Fiber Uncertainty Visualization for Bivariate Data With Parametric and Nonparametric Noise Models

Visualization and analysis of multivariate data and their uncertainty are top research challenges in data visualization. Constructing fiber surfaces is a popular technique for multivariate data visualization that generalizes the idea of level-set visualization for univariate data to multivariate data. Here, in this paper, we present a statistical framework to quantify positional probabilities of fibers extracted from uncertain bivariate fields. Specifically, we extend the state-of-the-art Gaussian models of uncertainty for bivariate data to other parametric distributions (e.g., uniform and Epanechnikov) and more general nonparametric probability distributions (e.g., histograms and kernel density estimation) and derive corresponding spatial probabilities of fibers. In our proposed framework, we leverage Green's theorem for closed-form computation of fiber probabilities when bivariate data are assumed to have independent parametric and nonparametric noise. Additionally, we present a nonparametric approach combined with numerical integration to study the positional probability of fibers when bivariate data are assumed to have correlated noise. For uncertainty analysis, we visualize the derived probability volumes for fibers via volume rendering and extracting level sets based on probability thresholds. We present the utility of our proposed techniques via experiments on synthetic and simulation datasets.

97 MATHEMATICS AND COMPUTING↗

Accelerated Probabilistic Marching Cubes by Deep Learning for Time-Varying Scalar Ensembles

Visualizing the uncertainty of ensemble simulations is challenging due to the large size and multivariate and temporal features of en-semble data sets. One popular approach to studying the uncertainty of ensembles is analyzing the positional uncertainty of the level sets. Probabilistic marching cubes is a technique that performs Monte Carlo sampling of multivariate Gaussian noise distributions for positional uncertainty visualization of level sets. However, the technique suffers from high computational time, making interactive visualization and analysis impossible to achieve. This paper introduces a deep-learning-based approach to learning the level-set uncertainty for two-dimensional ensemble data with a multivariate Gaussian noise assumption. We train the model using the first few time steps from time-varying ensemble data in our workflow. We demonstrate that our trained model accurately infers uncertainty in level sets for new time steps and is up to 170X faster than that of the original probabilistic model with serial computation and 10X faster than that of the original parallel computation.

Han, Mengjiao↗

Intrahepatic Cholangiocarcinoma: Socioeconomic Discrepancies, Contemporary Treatment Approaches and Survival Trends from the National Cancer Database

Objective: The aim of this study was to evaluate socioeconomic discrepancies in current treatment approaches and survival trends among patients with intrahepatic cholangiocarcinoma (ICC). Methods: The 2004–2015 National Cancer Database was retrospectively analyzed for histopathologically proven ICC. Treatment predictors were evaluated using multinomial logistic regression and overall survival via multivariable Cox models. Results: Overall, 12,837 ICC patients were included. Multiple factors influenced treatment allocation, including age, education, comorbidities, cancer stage, grade, treatment center, and US state region (multivariable p < 0.05). The highest surgery rates were observed in the Middle Atlantic (28.7%) and lowest rates were observed in the Mountain States (18.4%). Decreased ICC treatment likelihood was observed for male African Americans with Medicaid insurance and those with low income (multivariable p < 0.05). Socioeconomic treatment discrepancies translated into decreased overall survival for patients of male sex (vs. female; hazard ratio [HR] 1.21, 95% confidence interval [CI] 1.16–1.26, p < 0.001), with low income (< $37,999 vs. ≥ $63,000 annually; HR 1.07, 95% CI 1.01–1.14, p = 0.032), and with Medicaid insurance (vs. private insurance; HR 1.13, 95% CI 1.04–1.23, p = 0.006). Both surgical and non-surgical ICC management showed increased survival compared with no treatment, with the longest survival for surgery (5-year overall survival for surgery, 33.5%; interventional oncology, 11.8%; radiation oncology/chemotherapy, 4.4%; no treatment, 3.3%). Among non-surgically treated patients, interventional oncology yielded the longest survival versus radiation oncology/chemotherapy (HR 0.73, 95% CI 0.65–0.82, p < 0.001). Conclusions: ICC treatment allocation and outcome demonstrated a marked variation depending on socioeconomic status, demography, cancer factors, and US geography. Healthcare providers should address these discrepancies by providing surgery and interventional oncology as first-line treatment to all eligible patients, with special attention to the vulnerable populations identified in this study.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

STITCHES: a Python package to amalgamate existing Earth system model output into new scenario realizations

Understanding the interaction between humans and the Earth system is a computationally daunting task, with many possible approaches depending on resources available and questions of interest. For example, state-of-the-art impact models require decade-long time series of relatively high frequency, spatially resolved and often multiple variables representing climatic impact-drivers (Ruane et al., 2022). Most commonly these are derived from the outputs of detailed, computationally expensive Earth System Models (ESMs) run according to a standard, limited set of future scenarios, the latest being the SSP-RCPs run under CMIP6/ScenarioMIP (Eyring et al., 2016; O’Neill et al., 2016). At the time of writing, O’Neill et al. (2016) has been cited more than 1750 times and Eyring et al. (2016) more than 5000 times, highlighting the broad, general applications of this data. Often, however, impact modeling seeks to explore new scenarios that were not part of the ScenarioMIP protocol, and/or needs a larger set of initial condition ensemble members than are typically available to quantify the effects of ESM internal variability. In addition, the recognition that the human and Earth systems are fundamentally intertwined, and may feature potentially significant feedback loops, is making integrated, simultaneous modeling of the coupled human-Earth system increasingly necessary, if computationally challenging with most existing tools (Thornton et al., 2017). For impact modelers, climate model emulators can be the answer to meet both the needs of: 1) creating realizations for novel scenarios and 2) achieving a simplified, computationally tractable representation of ESM behavior in a coupled human-Earth system modeling framework. We proposed a new, comprehensive approach to such emulation of gridded, multivariate ESM outputs for novel scenarios without the computational cost of a full ESM, STITCHES (Tebaldi et al., 2022). The approach outlined in Tebaldi et al. (2022) should be extensible to future CMIP eras, although the STITCHES software at present is strictly focused on CMIP6/ScenarioMIP data hosted on Pangeo (https://gallery.pangeo.io/repos/pangeo-gallery/cmip6/). The corresponding STITCHES Python package uses existing archives of ESMs’ scenario experiments from CMIP6/ScenarioMIP to construct gridded, multivariate realizations of new scenarios provided by reduced complexity climate models (Hartin et al., 2015; Meinshausen et al., 2011; Smith et al., 2018), or to enrich existing initial condition ensembles. Its output provides the same characteristics as the emulated ESM output: multivariate (spanning potentially all variables that the ESM has saved), spatially resolved (down to the native grid of the ESM), and preserving the same high frequency as the original data. A new realization of multiple variables can be generated on the order of minutes with STITCHES, rather than the hours or sometimes days that ESMs require.

97 MATHEMATICS AND COMPUTING↗

Efficient Speaker Verification Using Gaussian Mixture Model Component Clustering

In speaker verification (SV) systems that employ a support vector machine (SVM) classifier to make decisions on a supervector derived from Gaussian mixture model (GMM) component mean vectors, a significant portion of the computational load is involved in the calculation of the a posteriori probability of the feature vectors of the speaker under test with respect to the individual component densities of the universal background model (UBM). Further, the calculation of the sufficient statistics for the weight, mean, and covariance parameters derived from these same feature vectors also contribute a substantial amount of processing load to the SV system. In this paper, we propose a method that utilizes clusters of GMM-UBM mixture component densities in order to reduce the computational load required. In the adaptation step we score the feature vectors against the clusters and calculate the a posteriori probabilities and update the statistics exclusively for mixture components belonging to appropriate clusters. Each cluster is a grouping of multivariate normal distributions and is modeled by a single multivariate distribution. As such, the set of multivariate normal distributions representing the different clusters also form a GMM. This GMM is referred to as a hash GMM which can be considered to a lower resolution representation of the GMM-UBM. The mapping that associates the components of the hash GMM with components of the original GMM-UBM is referred to as a shortlist. This research investigates various methods of clustering the components of the GMM-UBM and forming hash GMMs. Of five different methods that are presented one method, Gaussian mixture reduction as proposed by Runnall's, easily outperformed the other methods. This method of Gaussian reduction iteratively reduces the size of a GMM by successively merging pairs of component densities. Pairs are selected for merger by using a Kullback-Leibler based metric. Using Runnal's method of reduction, we were able to achieve a factor of 2.77 reduction in a posteriori probability calculations with no loss in accuracy when the original UBM consisted of 256 component densities. When clustering was implemented with a 1024 component UBM, we achieved a computation reduction of 5 with no loss in accuracy and a reduction by a factor of 10 with less than 2.4% relative loss in accuracy.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Foundations of Feature Selection and Classification for Non-Gaussian Distributed Targets

This report describes the author’s research toward creating algorithms for selecting useful statistical features in pattern/target classification problems in which the features are non-Gaussian distributed. In engineering practice, it is common to either (1) Not perform any feature selection procedure, or (2) Use a feature selection algorithm that assumes the features are Gaussian distributed. This process can be far from optimal if the data are actually non-Gaussian, as they frequently are in practice. This research has the goal of mitigating that problem by creating a useful algorithm that can be used in practice. The approach is to focus on the performance indices used in common feature selection algorithms, such as Branch and Bound algorithms and the Sequential Forward Selection Algorithm. Ordinarily, the performance index used to measure the class separation in feature space involves assuming the data are Gaussian and deriving tractable performance indices that use closed form equations that represent the probability density functions of the class data. The advantage of this approach is that it produces feature selection algorithms that have low computational complexity and do not require knowledge of the actual data densities. The disadvantage is that these algorithms may not perform reasonably when the data are non-Gaussian, as they commonly are in practice. This research examines the use of information-theoretic class separability measures that can deal with the non-Gaussian case. In particular, this work shows that the Hellinger Distance (a divergence measure), has very desirable mathematical properties and can be useful for feature selection. The work in this paper employs a multivariate kernel density estimator along with the Hellinger Distance and an optimal subset selection algorithm to do feature selection. This report (1) Defines the classification and feature selection problems, (2) Describes the continuous variable Hellinger distance in one dimension and discusses its mathematical properties in comparison with other distance measures, (3) Develops the discrete variable Hellinger distance expression for one and two dimensions, and shows that the discrete Hellinger distance for multiple dimensions is a straightforward extension, and (4) Presents experimental density estimation results using a new MATLAB implementation of a multivariate kernel density estimator. The draft of this report served as a starting point for Ensign Matthew Wilder’s MSEE thesis work at the Naval Postgraduate School (NPS) in 2010 and 2011. Ensign Wilder completed his thesis and graduated from NPS in June 2011 (M. J. Wilder, “Automatic Target Recognition: Statistical Feature Selection of Non-Gaussian Distributed Target Classes,” MSEE Thesis, Naval Postgraduate School, Thesis Advisor: Grace A. Clark, Second Reader: Monique P. Fargues, June 2011). In the thesis, Ensign Wilder created implementations of the Branch and Bound and Sequential Feature Selection algorithms, extended the multivariate kernel density estimator code, and evaluated the performance of Hellinger Distance-based feature selection algorithms using both simulated data and data from a real-world benchmark data set. The new algorithm was shown to be very effective for both Gaussian and non-Gaussian data sets. The advantages gained for non-Gaussian data come at the cost of increased computational complexity. Using a laptop computer for practical problems, we generally use initial feature vectors containing no more than about ten or twelve features. Proposed future research lies in creating faster kernel density estimator algorithms that would allow for the use of higher dimensional data.

42 ENGINEERING↗

The Multi-Isotope Process (MIP) Monitor Project: FY13 Final Report

The Multi-Isotope Process (MIP) Monitor provides an efficient approach to monitoring the process conditions in reprocessing facilities in support of the goal of “… (minimization of) the risks of nuclear proliferation and terrorism.” The MIP Monitor measures the distribution of the radioactive isotopes in product and waste streams of a nuclear reprocessing facility. These isotopes are monitored online by gamma spectrometry and compared, in near-real-time, to spectral patterns representing “normal” process conditions using multivariate analysis and pattern recognition algorithms. The combination of multivariate analysis and gamma spectroscopy allows us to detect small changes in the gamma spectrum, which may indicate changes in process conditions. By targeting multiple gamma-emitting indicator isotopes, the MIP Monitor approach is compatible with the use of small, portable, relatively high-resolution gamma detectors that may be easily deployed throughout an existing facility. The automated multivariate analysis can provide a level of data obscurity, giving a built-in information barrier to protect sensitive or proprietary operational data. Proof-of-concept simulations and experiments have been performed in previous years to demonstrate the validity of this tool in a laboratory setting for systems representing aqueous reprocessing facilities. However, pyroprocessing is emerging as an alternative to aqueous reprocessing techniques.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

An Exploration of Climate Data Using Complex Networks

To discover patterns in historical data, climate scientists have applied various clustering methods with the goal of identifying regions that share some common climatological behavior. However, past approaches are limited by the fact that they either consider only a single time period (snapshot) of multivariate data, or they consider only a single variable by using the time series data as multi-dimensional feature vector. In both cases, potentially useful information may be lost. Moreover, clusters in high-dimensional data space can be dicult to interpret, prompting the need for a more eective data representation. We address both of these issues by employing a complex network (graph) to represent climate data, a more intuitive model that can be used for analysis while also having a direct mapping to the physical world for interpretation. A cross correlation function is used to weight network edges, thus respecting the temporal nature of the data, and a community detection algorithm identies multivariate clusters. Examining networks for consecutive periods allows us to study structural changes over time. We show that communities have a climatological interpretation and that disturbances in structure can be an indicator of climate events (or lack thereof). Finally, we discuss how this model can be applied for the discovery of more complex concepts such as unknown teleconnections or the development of multivariate climate indices and predictive insights.

99 GENERAL AND MISCELLANEOUS↗

Heterogeneous recurrence monitoring and control of nonlinear stochastic processes

Recurrence is one of the most common phenomena in natural and engineering systems. Process monitoring of dynamic transitions in nonlinear and nonstationary systems is more concerned with aperiodic recurrences and recurrence variations. However, little has been done to investigate the heterogeneous recurrence variations and link with the objectives of process monitoring and anomaly detection. Notably, nonlinear recurrence methodologies are based on homogeneous recurrences, which treat all recurrence states in the same way as black dots, and non-recurrence is white in recurrence plots. Heterogeneous recurrences are more concerned about the variations of recurrence states in terms of state properties (e.g., values and relative locations) and the evolving dynamics (e.g., sequential state transitions). This paper presents a novel approach of heterogeneous recurrence analysis that utilizes a new fractal representation to delineate heterogeneous recurrence states in multiple scales, including the recurrences of both single states and multi-state sequences. Further, we developed a new set of heterogeneous recurrence quantifiers that are extracted from fractal representation in the transformed space. To that end, we integrated multivariate statistical control charts with heterogeneous recurrence analysis to simultaneously monitor two or more related quantifiers. Experimental results on nonlinear stochastic processes show that the proposed approach not only captures heterogeneous recurrence patterns in the fractal representation but also effectively monitors the changes in the dynamics of a complex system.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗