Stochastic identification of malware with dynamic traces
Abstract Not Provided
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Abstract Not Provided
We present an efficient and scalable solution to estimate uncertain transport behaviors-stochastic flow maps (SFMs)-for visualizing and analyzing uncertain unsteady flows. Computing flow maps from uncertain flow fields is extremely expensive because it requires many Monte Carlo runs to trace densely seeded particles in the flow. We reduce the computational cost by decoupling the time dependencies in SFMs so that we can process shorter sub time intervals independently and then compose them together for longer time periods. Adaptive refinement is also used to reduce the number of runs for each location. We parallelize over tasks-packets of particles in our design-to achieve high efficiency in MPI/thread hybrid programming. Such a task model also enables CPU/GPU coprocessing. We show the scalability on two supercomputers, Mira (up to 256K Blue Gene/Q cores) and Titan (up to 128K Opteron cores and 8K GPUs), that can trace billions of particles in seconds.
Determining the flow of rays or non-interacting particles driven by a force or velocity field is fundamental to modelling many physical processes. These include particle flows arising in fluid mechanics and ray flows arising in the geometrical optics limit of linear wave equations. In many practical applications, the driving field is not known exactly and the dynamics are determined only up to a degree of uncertainty. This paper presents a boundary integral framework for propagating flows including uncertainties, which is shown to systematically interpolate between a deterministic and a completely random description of the trajectory propagation. A simple but efficient discretisation approach is applied to model uncertain billiard dynamics in an integrable rectangular domain.
The time evolution of the trace distance between quantum states of a qubit which is placed under the influence of stochastic dephasing is investigated within the framework of the stochastic Liouville equation. When stochastic dephasing is subject to the homogeneous Gauss-Markov process, the trace distance is exactly calculated in the presence of the initial correlation between the qubit and the stochastic process, where the stochastic process is inevitably a nonstationary process. It is found that even the initial correlation with the classical environment can make the trace distance greater than the initial value if stochastic dephasing causes the slow modulation of the qubit.
Nonstationary Gaussian process models can capture complex spatially varying dependence structures in spatial datasets. However, the large number of observations in modern datasets makes fitting such models computationally intractable with conventional dense linear algebra. In addition, derivative-free or even first-order optimization methods can be very slow to converge when estimating many spatially varying parameters. In this paper, we present a computational framework which couples an algebraic block diagonal plus low-rank covariance matrix approximation with stochastic trace estimation to facilitate the efficient use of second-order solvers for maximum likelihood estimation of Gaussian process models with many parameters. We demonstrate the effectiveness of these methods by simultaneously fitting 192 parameters in the popular nonstationary model of Paciorek and Schervish using 107,600 sea surface temperature anomaly measurements.
Herein we review a suite of stochastic vector computational approaches for studying the electronic structure of extended condensed matter systems. These techniques help reduce algorithmic complexity, facilitate efficient parallelization, simplify computational tasks, accelerate calculations, and diminish memory requirements. While their scope is vast, we limit our study to ground-state and finite temperature density functional theory (DFT) and second-order many-body perturbation theory. More advanced topics, such as quasiparticle (charge) and optical (neutral) excitations and higher-order processes, are covered elsewhere. We start by explaining how to use stochastic vectors in computations, characterizing the associated statistical errors. Next, we show how to estimate the electron density in DFT and discuss effective techniques to reduce statistical errors. Finally, we review the use of stochastic vectors for calculating correlation energies within the second-order Møller-Plesset perturbation theory and its finite temperature variational form. Example calculation results are presented and used to demonstrate the efficacy of the methods.
Explicit expressions for the concurrence of all positive and trace-preserving ('stochastic') one-qubit maps are presented. Our method allows to construct the relevant convex roof patterns. We conclude that two-component optimal decompositions always exist. Our results can be transferred to 2xn-quantum systems providing the concurrence for all rank-two density operators, as well as lower and upper bounds for their entanglement of formation. We apply these results to a study of the entanglement entropy of one-qubit stochastic maps which preserve axial symmetry. Using analytic and numeric results we analyze the bifurcation patterns appearing in the convex roof of optimal decompositions and give results for the one-shot (Holevo-Schumacher-Westmoreland) capacity of those maps.
Entangled multiqubit states may be generated through a dispersive collective quantum nondemolition measurement of superconducting qubits coupled to a microwave transmission line resonator. Using the quantum trajectory approach, we analyze the stochastic measurement traces that would be observed in experiments. We illustrate the synthesis of three-qubit W and Greenberger-Horne-Zeilinger states, and we analyze how the fidelity and the entanglement evolve in time during the measurement. We discuss the influence of decoherence and relaxation, as well as of imperfect control over experimental parameters. We show that the desired states can be generated on time scales much faster than the qubit decoherence rates.
The orientation of 3D equilibria in the Madison Symmetric Torus (MST) [R. N. Dexter et al., Fusion Technol. 19, 131 (1991)] reversed-field pinch can now be controlled with a resonant magnetic perturbation (RMP). Absent the RMP, the orientation of the stationary 3D equilibrium varies from shot to shot in a semi-random manner, making its diagnosis difficult. Produced with a poloidal array of saddle coils at the vertical insulated cut in MST's thick conducting shell, an m = 1 RMP with an amplitude b{sub r}/B ∼ 10% forces the 3D structure into any desired orientation relative to MST's diagnostics. This control has led to improved diagnosis, revealing enhancements in both the central electron temperature and density. With sufficient amplitude, the RMP also inhibits the generation of high-energy (>20 keV) electrons, which otherwise emerge due to a reduction in magnetic stochasticity in the core. Field line tracing reveals that the RMP reintroduces stochasticity to the core. A m = 3 RMP of similar amplitude has little effect on the magnetic topology or the high-energy electrons.
The low velocity of interstellar asteroid 1I/’Oumuamua with respect to our galaxy’s local standard of rest implies that it is young. Adopting the young age hypothesis, we assess possible origin systems for this interstellar asteroid and for 2I/Borisov, though the latter’s higher speed means it is unlikely to be young. First, their past trajectories are modeled under gravitational scattering by galactic components (“disk heating”) to assess how far back one can trace them. The stochastic nature of disk heating means that a back integration can only expect to be accurate to within 15 pc and 2 km s{sup −1} at −10 Myr, dropping steeply to 400 pc and 10 km s{sup −1} at −100 Myr, sharply limiting our ability to determine a precise origin. Nevertheless, we show that ’Oumuamua’s origin system likely is currently within 1 kpc of Earth, in the local Orion Arm. Second, we back integrate ’Oumuamua’s trajectory in order to assess source regions, emphasizing young systems and moving groups. Though disk heating allows for only a statistical link to source regions, ’Oumuamua passed through a considerable subset of the Carina and Columba moving groups when those groups were forming. This makes them perhaps the most plausible source region, if ’Oumuamua was ejected during planet formation or via intra-cluster interactions. We find three stars in the Ursa Major group, one brown dwarf, and seven other stars to have plausible encounters with 2I/Borisov, within 2 pc and 30 km s{sup −1}. These encounters’ high relative speeds mean none are likely to be the home of 2I/Borisov.
We report thatpProbing is a general technique that is used to reduce the variance of the Hutchinson stochastic estimator for the trace of the inverse of a large, sparse matrix A. The variance of the estimator is the sum of the squares of the off-diagonal elements of A -1 . Therefore, this technique computes probing vectors that when used in the estimator annihilate the largest off-diagonal elements. For matrices that display decay of the magnitude of |A$^{-1}_{ij}$| with the graph distance between nodes i and j, this is achieved through graph coloring of increasing powers A k . Equivalently, when a matrix stems from a lattice discretization, it is computationally beneficial to find a distance-k coloring of the lattice. Previously, a hierarchical coloring was proposed so that k can be increased at runtime as needed without discarding previous work. In this work, we study probing for the more general problem of computing the trace of a permutation of A -1 , say PA -1 . The motivation comes from lattice quantum chromodynamics (QCD), where we need to construct “disconnected diagrams” to extract flavor-separated generalized parton functions. In lattice QCD, where the matrix has a four-dimensional toroidal lattice structure, these nonlocal operators correspond to a PA -1 , where P is the permutation relating to some displacement $\vec{p}$ in one or more dimensions. We focus on a single dimension displacement (p), but our methods are general. We show that probing on A k or (PA) k does not annihilate the largest magnitude elements. To resolve this issue, our displacement-based probing works on PA k using a new coloring scheme that works directly on appropriately displaced neighborhoods on the lattice. We prove lower bounds on the number of colors needed and study the effect of this scheme on variance reduction, both theoretically and experimentally on a real-world lattice QCD calculation. We achieve orders of magnitude speedup over the unprobed or the naively probed methods.
A numerical modeling of current profile modification by lower hybrid current drive (LHCD) using a fullwave/Fokker-Planck simulation code is presented. A MHD stable LHCD discharge on Alcator C-Mod was analyzed, and the current profile from full wave simulations was found to show better agreement with the experiment than a ray-tracing code. Comparison of full wave and ray-tracing simulation shows that, although ray-tracing can reproduce the stochastic wave spectrum broadening, the full wave calculation predicts even wider spectrum broadening, and the wave spectrum fills all of the kinematically allowed domain. This is the first demonstration of LHCD current profile modeling using a full wave simulation code in a multi-pass absorption regime, showing the clear impact of full wave effects on the LHCD driven current profile.
Abstract Not Provided
Abstract not provided.
Monitoring and analyzing a wide range of I/O activities in an HPC cluster is important in maintaining mission-critical performance in a large-scale, multi-user, parallel storage system. Center-wide I/O traces can provide high-level information and fine-grained activities per application or per user running in the system. Studying such large-scale traces can provide helpful insights into the system. It can be used to develop predictive methods for making predictive decisions, adjusting scheduling policies, or providing decisions for the design of next-generation systems. However, sharing real-world I/O traces to expedite such research efforts leaves a few concerns; i) the cost of sharing the large traces is expensive due to this large size, and ii) privacy concern is an issue.We address such issues by building an end-to-end machine learn- ing (ML) workflow that can generate I/O traces for large-scale HPC applications. We leverage ML based feature selection and gener- ative models for I/O trace generation. The generative models are trained on I/O traces collected by the darshan I/O characterization tool over a period of one year. We present a two-step generation process consisting of two deep-learning models, called the feature generator and the trace generator. The combination of two-step generative models provides robustness by reducing the bias of the model and accounting for the stochastic nature of the I/O traces across different runs of an application. We evaluate the performance of the generative models and show that the two-step model can generate time-series I/O traces with less than 20% root mean square error.
A method for the measurement of ionospheric Gravity Wave (GW) using the USU Dynasonde is outlined. This method consists of a series of individual procedures, which includes functions for data acquisition, adaptive scaling, polarization discrimination, interpolation and extrapolation, digital filtering, windowing, spectrum analysis, GW detection, and graphics display. Concepts of system theory are applied to treat the ionosphere as a system. An adaptive ionogram scaling method was developed for automatically extracting ionogram echo traces from noisy raw sounding data. The method uses the well known Least Mean Square (LMS) algorithm to form a stochastic optimal estimate of the echo trace which is then used to control a moving window. The window tracks the echo trace, simultaneously eliminating the noise and interference. Experimental results show that the proposed method functions as designed. Case studies which extract GW from ionosonde measurements were carried out using the techniques described. Geophysically significant events were detected and the resultant processed results are illustrated graphically. This method was also developed for real time implementation in mind.
In this report we describe an enhanced methodology for performing stochastic Bayesian inversions of atmospheric trace gas inversions that allows the time variation of model parameters to be inferred. We use measurements of methane atmospheric mixing ratio made in Livermore, California along with atmospheric transport modeling and published prior estimates of emissions to estimate the regional emissions of methane and the temporal variations in inferred bias parameters. We compute Bayesian model evidence and continuous rank probability score to optimize the model with respect to temporal resolution. Using two different emissions inventories, we perform inversions for a series of models with increasing temporal resolution in the model bias representation. We show that temporal variation in the model bias can improve the model fit and can also increase the likelihood that the parameterization is appropriate, as measured by the Bayesian model evidence.