Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “virtual cluster”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Automated pipeline framework for processing of large-scale building energy time series data

Commercial buildings account for one third of the total electricity consumption in the United States and a significant amount of this energy is wasted. Therefore, there is a need for “virtual” energy audits, to identify energy inefficiencies and their associated savings opportunities using methods that can be non-intrusive and automated for application to large populations of buildings. Here we demonstrate virtual energy audits applied to large populations of buildings’ time-series smart-meter data using a systematic approach and a fully automated Building Energy Analytics (BEA) Pipeline that unifies, cleans, stores and analyzes building energy datasets in a non-relational data warehouse for efficient insights and results. This BEA pipeline is based on a custom compute job scheduler for a high performance computing cluster to enable parallel processing of Slurm jobs. Within the analytics pipeline, we introduced a data qualification tool that enhances data quality by fixing common errors, while also detecting abnormalities in a building’s daily operation using hierarchical clustering. We analyze the HVAC scheduling of a population of 816 buildings, using this analytics pipeline, as part of a cross-sectional study. With our approach, this sample of 816 buildings is improved in data quality and is efficiently analyzed in 34 minutes, which is 85 times faster than the time taken by a sequential processing. The analytical results for the HVAC operational hours of these buildings show that among 10 building use types, food sales buildings with 17.75 hours of daily HVAC cooling operation are decent targets for HVAC savings. Overall, this analytics pipeline enables the identification of statistically significant results from population based studies of large numbers of building energy time-series datasets with robust results. These types of BEA studies can explore numerous factors impacting building energy efficiency and virtual building energy audits. This approach enables a new generation of data-driven buildings energy analysis at scale.

36 MATERIALS SCIENCE↗
DOE OSTI2015

Effective binary theory of multi-component nucleation

Classical theory of multi-component nucleation [O. Hirschfelder, J. Chem. Phys. 61, 2690 (1974)] belongs to the class of the so-called intractable problems: it requires computational time which is an exponential function of the number of components N. For a number of systems of practical interest with N > 10, the brute-force use of the classical theory becomes virtually impossible and one has to resort to an effective medium approach. We present an effective binary model which captures important physics of multi-component nucleation. The distinction between two effective species is based on the observation that while all N components contribute to the cluster thermodynamic properties, there is only a part of them which trigger the nucleation process. The proposed 2D-theory takes into account adsorption by means of the Gibbs dividing surface formalism and uses statistical mechanical considerations for the treatment of small clusters. Theoretical predictions for binary-, ternary-, and 14-component mixtures are compared with available experimental data and other models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2015

Imaging atomic-scale effects of high-energy ion irradiation on superconductivity and vortex pinning in Fe(Se,Te)

Maximizing the sustainable supercurrent density, J C , is crucial to high-current applications of superconductivity, and to achieve this, preventing dissipative motion of quantized vortices is key. Irradiation of superconductors with highenergy heavy ions can be used to create nanoscale defects that act as deep pinning potentials for vortices. This approach holds unique promise for high-current applications of iron-based superconductors because JC amplification persists to much higher radiation doses than in cuprate superconductors without significantly altering the superconducting critical temperature. However, for these compounds, virtually nothing is known about the atomic-scale interplay of the crystal damage from the high-energy ions, the superconducting order parameter, and the vortex pinning processes. We visualize the atomic-scale effects of irradiating FeSe x Te 1$-$x with 249-MeV Au ions and find two distinct effects: compact nanometer-sized regions of crystal disruption or “columnar defects,” plus a higher density of single atomic site “point” defects probably from secondary scattering. We directly show that the superconducting order is virtually annihilated within the former but suppressed by the latter. Simultaneous atomically resolved images of the columnar crystal defects, the superconductivity, and the vortex configurations then reveal how amixed pinning landscape is created, with the strongest pinning occurring at metallic core columnar defects and secondary pinning at clusters of point-like defects, followed by collective pinning at higher fields.

Critical Current by Design↗
DOE OSTI2021

The $^3$He+$^5$He$\rightarrow $ $\alpha $+$\alpha $ reaction below the Coulomb barrier via the Trojan Horse Method

For the first time in an application to nuclear astrophysics, a process induced by the unstable 5 He = ( 4 He-n) nucleus, the 3 He+ 5 He→2α reaction, has been studied through the Trojan Horse Method (THM). For that purpose, the quasi-free (QF) contribution of the 9 Be( 3 He,αα) 4 He reaction was selected at E 3 He =4 MeV incident energy. The reaction was studied in a kinematically complete experiment following a recent publication, where for the quasi free contribution the momentum distribution between α and 5 He particle cluster in the 9 Be nucleus in the ground state have been extracted. The angular distribution of the QF 3 He+ 5 He→2α reaction was measured at θ cm = 78°–115°. The energy dependence of the differential cross section of the 3 He+ 5 He→2α virtual reaction was extracted in the energy range E cm = 0–650 keV. In conclusion, the total cross section obtained from the Trojan-horse method was normalized to absolute cross sections from a theoretical calculation in the energy range E cm =300–620 keV.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Ultrafast Correlation Energy Estimator

A virtually no-cost method is proposed that can compute the correlation energies of general, covalently bonded, organic, and inorganic molecules (including conjugated π-electron systems) with a well-defined dominant Lewis structure at the accuracy of 99.5% of the near-exact values determined by the coupled-cluster singles, doubles, and perturbative triples [CCSD(T)] in the complete-basis-set (CBS) limit. This Correlation Energy Per Bond (CEPB) method assigns a partial correlation energy to each bond type (characterized by the identities of the two atoms forming the bond and its integer bond order) and to a lone pair, regardless of the bond length, bond angle, sp-hybridization, π-electron conjugation, ionicity, noncovalent interactions, etc. At its current stage, the method is mainly suitable for near-equilibrium geometries. The correlation energies per bond are determined by a fit to the CCSD(T)/CBS benchmarks. It can neither improve the equilibrium structures nor discern conformers or positional isomers, yet its accuracy for reaction energies rivals that of the second-order Møller–Plesset perturbation theory, which is far more expensive. Its promising performance underscores the possibility that surprisingly compact, chemically intuitive molecular fragments exist into which correlation energies can be partitioned, leading to various ultrafast correlation-energy estimators tailored to different purposes.

Binding energy↗
DOE OSTI2012

Investigation of storage options for scientific computing on Grid and Cloud facilities

In recent years, several new storage technologies, such as Lustre, Hadoop, OrangeFS, and BlueArc, have emerged. While several groups have run benchmarks to characterize them under a variety of configurations, more work is needed to evaluate these technologies for the use cases of scientific computing on Grid clusters and Cloud facilities. This paper discusses our evaluation of the technologies as deployed on a test bed at FermiCloud, one of the Fermilab infrastructure-as-a-service Cloud facilities. The test bed consists of 4 server-class nodes with 40 TB of disk space and up to 50 virtual machine clients, some running on the storage server nodes themselves. With this configuration, the evaluation compares the performance of some of these technologies when deployed on virtual machines and on bare metal nodes. In addition to running standard benchmarks such as IOZone to check the sanity of our installation, we have run I/O intensive tests using physics-analysis applications. This paper presents how the storage solutions perform in a variety of realistic use cases of scientific computing. One interesting difference among the storage systems tested is found in a decrease in total read throughput with increasing number of client processes, which occurs in some implementations but not others.

Garzoglio, Gabriele↗
DOE OSTI2015

A new time dependent density functional algorithm for large systems and plasmons in metal clusters

A new algorithm to solve the Time Dependent Density Functional Theory (TDDFT) equations in the space of the density fitting auxiliary basis set has been developed and implemented. The method extracts the spectrum from the imaginary part of the polarizability at any given photon energy, avoiding the bottleneck of Davidson diagonalization. The original idea which made the present scheme very efficient consists in the simplification of the double sum over occupied-virtual pairs in the definition of the dielectric susceptibility, allowing an easy calculation of such matrix as a linear combination of constant matrices with photon energy dependent coefficients. The method has been applied to very different systems in nature and size (from H{sub 2} to [Au{sub 147}]{sup −}). In all cases, the maximum deviations found for the excitation energies with respect to the Amsterdam density functional code are below 0.2 eV. The new algorithm has the merit not only to calculate the spectrum at whichever photon energy but also to allow a deep analysis of the results, in terms of transition contribution maps, Jacob plasmon scaling factor, and induced density analysis, which have been all implemented.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS2006

Diurnal Variability of Vertical Structure from a TRMM Passive Microwave "Virtual Radar" Retrieval

Robust description of the diurnal cycle from TRMM observations is complicated by the limitations of Low Earth Orbit (LEO) sampling; from a 'climatological' perspective, sufficient sampling must exist to control for both spatial and seasonal variability, before tackling an additional diurnal component (e.g., with 8 additional 3-hourly or 24 1-hourly bins). For documentation of vertical structure, the narrow sample swath of the TRMM Precipitation Radar limits the resolution of any of these components. A neural-network based 'virtual radar" retrieval has been trained and internally validated, using multifrequency / multipolarization passive microwave(TM1) brightness temperatures and textures parameters and lightning (LIS) observations, as inputs, and PR volumetric reflectivity as targets (outputs). By training the algorithms (essentially highly multivariate, nonlinear regressions) on a very large sample of high-quality co-located data from the center of the TRMM swath, 3D radar reflectivity and derived parameters (VIL, IWC, Echo Tops, etc.) can be retrieved across the entire TMI swath, good to 8-9% over the dynamic range of parameters. As a step in the retrieval (and as an output of the process), each TMI multifrequency pixel (at 85 GHz resolution) is classified into one of the 25 archetypal radar profile vertical structure "types", previously identified using cluster analysis. The dynamic range of retrieved vertical structure appears to have higher fidelity than the current (Version 6) experimental GPROF hydrometeor vertical structure retrievals. This is attributable to correct representation of the prior probabilities of vertical structure variability in the neural network training data, unlike the GPROF cloud-resolving model training dataset used in the V6 algorithms. The LIS lightning inputs are supplementary inputs, and a separate offline neural network has been trained to impute (predict) LIS lightning from passive-microwave-only data. The virtual radar retrieval is thus, in principle, extensible to Aqua/AMSR-E and NPOESS/CMIS passive microwave instruments. The virtual radar approach yields a threefold increase in effective sampling from the mission, albeit of lower-quality "retrieved" data, reducing the variance of local estimates by one third (or the standard deviation by-0.57). In this talk, the variance reduction is leveraged to more finely resolve global diurnal variability in both space and time (local hour).

Boccippio, Dennis J.↗
DOE OSTI2024

Cholesky Decomposition-Based Implementation of Relativistic Two-Component Coupled-Cluster Methods for Medium-Sized Molecules

A Cholesky decomposition (CD)-based implementation of relativistic two-component coupled-cluster (CC) and equation-of-motion CC (EOM-CC) methods using an exact two-component Hamiltonian augmented with atomic-mean-field integrals (the X2CAMF scheme) is reported. Furthermore, the present CD-based implementation of X2CAMF-CC and EOM-CC methods employs atomic-orbital-based algorithms to avoid the construction of two-electron integrals and intermediates involving three and four virtual indices. The CD-based implementation extends the applicability of X2CAMF-CC and EOMCC methods to medium-sized molecules with the correlation of around 1000 spinors. Benchmark calculations for uranium-containing small molecules have been performed to assess the dependence of CC results with respect to the Cholesky threshold. A Cholesky threshold of 10 –4 is shown to maintain chemical accuracy. Example calculations to illustrate the capability of the CD-based relativistic CC methods are reported for the bond dissociation energy of the uranium hexafluoride molecule, UF 6 , with up to quadruple-zeta basis sets and the lowest excitation energy in solvated uranyl ion [UO 2 2+ (H 2 O) 12 ].

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

CSRI Summer Proceedings 2020

The Computer Science Research Institute (CSRI) brings university faculty and students to Sandia for focused collaborative research on Department of Energy (DOE) computer and computational science problems. The institute provides an opportunity for university researchers to learn about problems in computer and computational science at DOE laboratories. Participants conduct leading-edge research, interact with scientists and engineers at the laboratories, and help transfer results of their research to programs at the labs. Some specific CSRI research interest areas are: scalable solvers, optimization, adaptivity and mesh refinement, graph-based, discrete, and combinatorial algorithms, uncertainty estimation, mesh generation, dynamic load-balancing, virus and other malicious-code defense, visualization, scalable cluster computers, data-intensive computing, environments for scalable computing, parallel input/output, advanced architectures, and theoretical computer science. The CSRI Summer Program is organized by CSRI and typically includes the organization of a weekly seminar series and the publication of a summer proceedings. In 2020, the CSRI summer program was executed completely virtually; all student interns worked from home, due to the COVID-19 pandemic.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2015

Statistical Techniques For Real-time Anomaly Detection Using Spark Over Multi-source VMware Performance Data

Anomaly detection refers to the identi cation of an irregular or unusual pat- tern which deviates from what is standard, normal, or expected. Such deviated patterns typically correspond to samples of interest and are assigned different labels in different domains, such as outliers, anomalies, exceptions, or malware. Detecting anomalies in fast, voluminous streams of data is a formidable chal- lenge. This paper presents a novel, generic, real-time distributed anomaly detection framework for heterogeneous streaming data where anomalies appear as a group. We have developed a distributed statistical approach to build a model and later use it to detect anomaly. As a case study, we investigate group anomaly de- tection for a VMware-based cloud data center, which maintains a large number of virtual machines (VMs). We have built our framework using Apache Spark to get higher throughput and lower data processing time on streaming data. We have developed a window-based statistical anomaly detection technique to detect anomalies that appear sporadically. We then relaxed this constraint with higher accuracy by implementing a cluster-based technique to detect sporadic and continuous anomalies. We conclude that our cluster-based technique out- performs other statistical techniques with higher accuracy and lower processing time.

Apache Spark↗
DOE OSTI2024

Containers on Switches: A Cluster School Experience

Network switches, such as those from Arista and Mellanox, often have underutilized computational resources in the form of built-in processors and memory. By leveraging these untapped resources, we can optimize functionality and efficiency of computational cluster networks. Our research focuses on deploying containers directly onto these switches to execute various auxiliary tasks ranging from metric logging to system-wide management via post-boot configuration. By doing so, we can significantly enchance the capabilities of the cluster without the need for additional dedicated hardware. Our research involved five distinct scenarios where switch utilization could have a profound impact on HPC Clusters: run cloud-init services via link-local connection; configuring a Telegraf container to export metrics; deploying a caching proxy; creating a reconfigurable IPv6 DHCP/DNS provider for VLAN; and implementing a client detection with Magellan discovery. These scenarios were containerized with podman and docker, and tested both physically on the switch virtually on a QEMU VM both running SONiC OS. Testing and findings indicate that network switches can indeed be used for these scenarios. They offer a wide range of possibilities beyond these applications. They run as expected as containers on the switches, and although there were some minor issues, work-arounds were implemented. Overall, this is a positive result that can be further explored with more scenarios.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

Online anomaly detection for multi‐source VMware using a distributed streaming framework

Summary Anomaly detection refers to the identification of patterns in a dataset that do not conform to expected patterns. Such non‐conformant patterns typically correspond to samples of interest and are assigned to different labels in different domains, such as outliers, anomalies, exceptions, and malware. A daunting challenge is to detect anomalies in rapid voluminous streams of data. This paper presents a novel, generic real‐time distributed anomaly detection framework for multi‐source stream data. As a case study, we investigate anomaly detection for a multi‐source VMware‐based cloud data center, which maintains a large number of virtual machines (VMs). This framework continuously monitors VMware performance stream data related to CPU statistics (e.g., load and usage). It collects data simultaneously from all of the VMs connected to the network and notifies the resource manager to reschedule its CPU resources dynamically when it identifies any abnormal behavior from its collected data. A semi‐supervised clustering technique is used to build a model from benign training data only. During testing, if a data instance deviates significantly from the model, then it is flagged as an anomaly. Effective anomaly detection in this case demands a distributed framework with high throughput and low latency. Distributed streaming frameworks like Apache Storm, Apache Spark, S4, and others are designed for a lower data processing time and a higher throughput than standard centralized frameworks. We have experimentally compared the average processing latency of a tuple during clustering and prediction in both Spark and Storm and demonstrated that Spark processes a tuple much quicker than storm on average. Copyright © 2016 John Wiley & Sons, Ltd.

Solaimani, Mohiuddin↗
DOE OSTI2023

Changes in trachoma indicators in Kiribati with two rounds of azithromycin mass drug administration, measured in serial population-based surveys

Baseline mapping in the two major population centers of Kiribati showed that trachoma was a public health problem in need of programmatic interventions. After conducting two annual rounds of antibiotic mass drug administration (MDA), Kiribati undertook trachoma impact surveys in 2019, using standardized two-stage cluster surveys in the evaluation units of Kiritimati Island and Tarawa. In Kiritimati, 516 households were visited and in Tarawa, 772 households were visited. Nearly all households had a drinking water source and access to an improved latrine. The prevalence of trachomatous trichiasis remained above the elimination threshold (0.2% in ≥15-year-olds) and was virtually unchanged from baseline. The prevalence of trachomatous inflammation—follicular (TF) in 1–9-year-olds decreased by approximately 40% from baseline in both evaluation units but remained above the 5% TF prevalence threshold for stopping MDA. TF prevalence at impact survey was 11.5% in Kiritimati and 17.9% in Tarawa. Infection prevalence in 1–9-year-olds by PCR was 0.96% in Kiritimati and 3.3% in Tarawa. Using a multiplex bead assay to measure antibodies to the C. trachomatis antigen Pgp3, seroprevalence in 1–9-year-olds was 30.2% in Kiritimati and 31.4% in Tarawa. The seroconversion rate, in seroconversion events/100 children/year, was 9.0 in Kiritimati and 9.2 in Tarawa. Seroprevalence and seroconversion rates were both assessed by four different assays, with strong agreement between tests. These results show that, despite decreases in indicators associated with infection at impact survey, trachoma remains a public health problem in Kiribati, and provide additional information about changes in serological indicators after MDA.

60 APPLIED LIFE SCIENCES↗
NASA NTRS2001

Configural Scoring of Simulator Sickness, Cybersickness and Space Adaptation Syndrome: Similarities and Differences?

From a survey of ten U.S. Navy flight simulators a large number (N > 1,600 exposures) of self-reports of motion sickness symptomatology were obtained. Using these data, scoring algorithms were derived, which permit examination of groups of individuals that can be scored either for 1) their total sickness experience in a particular device; or, 2) according to three separable symptom clusters which emerged from a Factor Analysis. Scores from this total score are found to be proportional to other global motion sickness symptom checklist scores with which they correlate (r = 0.82). The factors that surfaced from the analysis include clusters of symptoms referable as nausea, oculomotor disturbances, and disorientation (N, 0, and D). The factor scores may have utility in differentiating the source of symptoms in different devices. The present chapter describes our experience with the use of both of these types of scores and illustrates their use with examples from flight simulators, space sickness and virtual environments.

Kennedy, Robert S.↗
NASA NTRS1978

Effect of grazing flow on the acoustic impedance of Helmholtz resonators consisting of single and clustered orifices

A semiempirical fluid mechanical model is presented which predicts impedance of a Helmholtz resonator consisting of a single cavity-backed orifice as a function of grazing flow speed, boundary-layer thickness, incident sound amplitude and frequency, and resonator geometry. The incident and cavity sound fields are connected in terms of an orifice discharge coefficient. The effect of multiple orifices was studied experimentally. Interaction between orifices is important only for orifices aligned parallel to the grazing flow. Resistance was virtually independent of both orifice relative spacing and number. Reactance was found to be quite dependent upon orifice spacing but insensitive to the number of orifices.

Hersh, A. S.↗