Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “clustering algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,009 records · Page 56
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Joint Estimation of Topology and Injection Statistics in Distribution Grids with Missing Nodes

Optimal operation of distribution grid resources relies on accurate estimation of its state and topology. Practical estimation of such quantities is complicated by the limited presence of real-time meters. This article discusses a theoretical framework to jointly estimate the operational topology and statistics of injections in radial distribution grids under limited availability of nodal voltage measurements. In particular, we show that our proposed algorithms are able to provably learn the exact grid topology and injection statistics at all unobserved nodes as long as they are not adjacent. The algorithm design is based on novel ordered trends in voltage magnitude fluctuations at node groups, that are independently of interest for radial physical flow networks. The complexity of the designed algorithms is theoretically analyzed and their performance is validated using both linearized and nonlinear ac power flow samples in test distribution grids.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Unsupervised learning of representative local atomic arrangements in molecular dynamics data

Molecular dynamics (MD) simulations present a data-mining challenge, given that they can generate a considerable amount of data but often rely on limited or biased human interpretation to examine their information content. By not asking the right questions of MD data we may miss critical information hidden within it. Here we combine dimensionality reduction (UMAP) and unsupervised hierarchical clustering (HDBSCAN) to quantitatively characterize prevalent coordination environments of chemical species within MD data. By focusing on local coordination, we significantly reduce the amount of data to be analyzed by extracting all distinct molecular formulas within a given coordination sphere. We then efficiently combine UMAP and HDBSCAN with alignment or shape-matching algorithms to partition these formulas into structural isomer families indicating their relative populations. The method was employed to reveal details of cation coordination in electrolytes based on molecular liquids.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Metals and Quantum Materials with Spin-orbit Interactions by Quantum Monte Carlo methods

The key goals of this project were as follows: 1) Analysis and benchmarks of electron correlation effects recovered in the fixed-node approximation that is inherent to quantum Monte Carlo (QMC) method as applied to metallic states; 2) development of new algorithms for electron spin-degrees of freedom to be treated as explicit quantum variables; 3) designing electronic structure QMC algorithm for efficient evaluation of spin-orbit effects in systems with heavy atoms; 4) adapting the algorithm to complex wave functions and developing corresponding fixed-phase approximation; 5) design and testing of algorithm for valence-only non-local spin-orbit operators; 6) analysis of fixed-node vs fixed-phase errors and their comparisons. The key accomplishments: i) We carried out a systematic study of Li systems by the fixed-node diffusion Monte Carlo method. This involved Li atom, molecule, cluster and solid calculated by the full range of QMC methods including fixed-node QMC.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2024

Clustering Interval Load with Weather to Create Scenarios of Behind-the-Meter Solar Penetration

Forecasting load at the feeder level has become increasingly challenging with the penetration of behind-the-meter solar, as this self-generation is only visible to the utility as aggregated net-load. This work proposes a methodology for creation of scenarios of solar penetration at the feeder level for use by forecasters to test the robustness of their algorithm to progressively higher penetrations of solar. The algorithm draws on publicly available observations of weather condition (e.g., rainy/cloudy/fair) for use as proxies to sky clearness. These observations are used to mask and weight the interval deviations of similar native usage profiles from which average interval usage is calculated and subsequently added to interval net generation to reconstruct interval total generation. This approach improves the estimate of annual energy generation by 23%; where the net generation signal currently reflects 52% of total annual gener- ation, now 75% is captured. This methodology for creation of forecast testing scenarios is data driven and extensible to service territories which lack information on irradiance measurements and geocoordinates.

solar, load↗
NASA NTRS2020

An Algorithm for Characterization of Fiber Aggregation in Composite Microstructures

Composite structures are susceptible to localized flaws, or variability, that drive global failure. To capture this variance, a multiscale model needs to be introduced that not only accurately represents the statistical nature of the composite microstructure but is also efficient. At the microscale, fiber aggregation creates local stress concentrations, where failure is likely to occur sooner than expected. A method of rapid microstructure generation, in conjunction with cluster characterization, is examined to develop accurate reproductions of 2D composite cross-sections. Parameterization of shape and size of fiber clusters is used to characterize representative volume elements. The discrete element method is used to generate pseudo-microstructures. The clustering parameters from the pseudo- and actual microstructure arrangements (obtained from micrographs) can be compared to determine the validity of the representative volume element generated with the discrete element method. Results show a promising approach to evaluating randomness of fiber distributions and how to accurately recreate microstructures for strength analysis.

Carbon fiber↗
DOE OSTI2020

Bounded motion design in the Earth zonal problem using differential algebra based normal form methods

Establishing long-term relative bounded motion between orbits in perturbed dynamics is a key challenge in astrodynamics to enable cluster flight with minimum propellant expenditure. Herein, we present an approach that allows for the design of long-term relative bounded motion considering a zonal gravitational model. Entire sets of orbits are obtained via high-order Taylor expansions of Poincarè return maps about reference fixed points. The high-order normal form algorithm is used to determine a change in expansion variables of the map into normal form space, in which the phase space behavior is circular and can be easily parameterized by action–angle coordinates. The action–angle representation of the normal form coordinates is then used to parameterize the original Poincarè return map and average it over a full phase space revolution by a path integral along the angle parameterization. As a result, the averaged nodal period and drift in the ascending node are obtained, for which the bounded motion conditions are straightforwardly imposed. Sets of highly accurate bounded orbits are obtained, extending over several thousand kilometers, and valid for decades.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

The DESI One-Percent Survey: exploring a generalized SHAM for multiple tracers with the UNIT simulation

We perform SubHalo Abundance Matching (SHAM) studies on UNIT simulations with {σ, V ceil , v smear }-SHAM and {σ, V ceil , $f$ sat }-SHAM. They are designed to reproduce the clustering on 5–30 h -1 Mpc of luminous red galaxies (LRGs), emission-line galaxies (ELGs), and quasi-stellar objects (QSOs) at 0.4 < z < 3.5 from DESI (Dark Energy Spectroscopic Instrument) One Percent Survey. V ceil is the incompleteness of the massive host (sub)haloes and is the key to the generalized SHAM. v smear models the clustering effect of redshift uncertainties, providing measurements consistent with those from repeat observations. A free satellite fraction $f$ sat is necessary to reproduce the clustering of ELGs. We find ELGs present a more complex galaxy–halo mass relation than LRGs reflected in their weak constraints on σ. LRGs, QSOs, and ELGs show increasing V ceil values, corresponding to the massive galaxy incompleteness of LRGs, the quenched star formation of ELGs and the quenched black hole accretion of QSOs. For LRGs, a Gaussian v smear presents a better profile for subsamples at redshift bins than a Lorentzian profile used for other tracers. The impact of the statistical redshift uncertainty on ELG clustering is negligible. The best-fitting satellite fraction for DESI ELGs is around 4 per cent, lower than previous estimations for ELGs. The mean halo mass log 10 ($\langle$M vir $\rangle$) in h -1 M ⊙ for LRGs, ELGs, and QSOs are 13.16 ± 0.01, 11.90 ± 0.06, and 12.66 ± 0.45, respectively. Our generalized SHAM algorithms facilitate the production of multitracer galaxy mocks for cosmological tests.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Molecular Symmetry in VQE: A Dual Approach for Trapped-Ion Simulations of Benzene

Understanding complex chemical systems—such as biomolecules, catalysts, and novel materials—is a central goal of quantum simulations. Near-term strategies hinge on the use of variational quantum eigensolver (VQE) algorithms combined with a suitable ansatz. However, straightforward application of many chemically-inspired ansatze yields prohibitively deep circuits. In this work, we employ several circuit optimization methods tailored for trapped-ion quantum devices to enhance the feasibility of intricate chemical simulations. The techniques aim to lessen the depth of the unitary coupled cluster with singles and doubles (uCCSD) ansatz's circuit compilation, a considerable challenge on current noisy quantum devices. Furthermore, we use symmetry-inspired classical post-selection methods to further refine the outcomes and minimize errors in energy measurements, without adding quantum overhead. Our strategies encompass optimal mapping from orbital to qubit, term reordering to minimize entangling gates, and the exploitation of molecular spin and point group symmetry to eliminate redundant parameters. The inclusion of error mitigation via post-selection based on known molecular symmetries improves the results to near milli-Hartree accuracy. These methods, when applied to a benzene molecule simulation, enabled the construction of an 8-qubit circuit with 69 two-qubit entangling operations, pushing the limits for variational quantum eigensolver (VQE) circuits executed on quantum hardware to date. 1 1 This manuscript has been authored in part by UT-Battelle, LLC, under contract DE-AC05-000R22725 with the US Department of Energy (DOE). The publisher acknowledges the US government license to provide public access under the DOE Public Access Plan(https://energy.gov/doe-public-access-plan).

Goings, Joshua↗
DOE OSTI2023

ARMing the Edge: Designing Edge Computing–Capable Machine Learning Algorithms to Target ARM Doppler Lidar Processing

Abstract There is a need for long-term observations of cloud and precipitation fall speeds in validating and improving rainfall forecasts from climate models. To this end, the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility Southern Great Plains (SGP) site at Lamont, Oklahoma, hosts five ARM Doppler lidars that can measure cloud and aerosol properties. In particular, the ARM Doppler lidars record Doppler spectra that contain information about the fall speeds of cloud and precipitation particles. However, due to bandwidth and storage constraints, the Doppler spectra are not routinely stored. This calls for the automation of cloud and rain detection in ARM Doppler lidar data so that the spectral data in clouds can be selectively saved and further analyzed. During the ARMing the Edge field experiment, a Waggle node capable of performing machine learning applications in situ was deployed at the ARM SGP site for this purpose. In this paper, we develop and test four algorithms for the Waggle node to automatically classify ARM Doppler lidar data. We demonstrate that supervised learning using a ResNet50-based classifier will classify 97.6% of the clear-air images and 94.7% of cloudy images correctly, outperforming traditional peak detection methods. We also show that a convolutional autoencoder paired with k -means clustering identifies 10 clusters in the ARM Doppler lidar data. Three clusters correspond to mostly clear conditions with scattered high clouds, and seven others correspond to cloudy conditions with varying cloud-base heights.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Data Analysis of the 2020 Central Idaho Mainshock-Aftershock Sequence

In an effort to inform the Senior Seismic Hazard Analysis Committee for the Idaho National Laboratory, we provide an improved aftershock catalog related to the March 31, 2020, Mw6.5 Stanley, Idaho earthquake from picks related to a temporary network of two real-time and 15 non-telemetered seismometers within the epicentral area. From the permanent and temporary (XP) real-time network, the USGS cataloged 1,946 aftershocks between April 1, 2020 and October 31, 2020. To improve aftershock location and magnitudes, we manually picked arrival times of P and S waves from off-line stations in the XP temporary network, generated a new crustal velocity model, and independently relocated each event using the HypoDD double-difference earthquake algorithm. We created our new velocity model from existing broadband and active source seismic campaign data that were acquired near the epicentral region prior to the 2020 earthquake. We compare arrival time differences, epicentral locations and depths between aftershocks recorded with the two catalogs. We find the addition of local stations provides tighter aftershock clustering that suggests an improved aftershock locations. To detect lower magnitude events, we employed deep learning. Our method solves common problems associated with detecting many events that have a low signal-to-noise ratio. From the machine learning database, we detected more than 74,000 aftershocks. Based on the number of identified earthquakes and Gutenberg-Richter relationships derived from the USGS catalog, we estimate that we have reduced the completion magnitude for the Stanley earthquake sequence to below M1 using this machine learning approach. We located each aftershock with our new velocity model. Our new velocity model and picks suggests aftershocks occurred mostly at shallower depths than assessed in the USGS catalog. These aftershocks align along two linear trends that suggest the activation of two unnamed primary faults.

58 GEOSCIENCES↗
NASA NTRS1994

Map-based trigonometric parallaxes of open clusters: The Praesepe

Trigonometric parallaxes for stars in the Praesepe open star cluster are deduced from data collected with the Multichannel Astrometric Photometer (MAP) at the Thaw Refractor of the University of Pittsburgh's Allegheny Observatory. The weighted mean parallax of five cluster members is +5.21 +/- 0.79 mas (0.00079 arcsec), corresponding to a distance modulus of 6.42 +/- 0.33 mag. We briefly compare this result with that derived earlier for the Hyades and note agreement with the distance found by main-sequence fitting. We also discuss briefly an improvement in the weighting scheme of the centroiding algorithm used in this series.

Gatewood, George↗
NASA NTRS1995

Numerical Simulations of High Enthalpy Pulse Facilities

Axisymmetric flows within shock tubes and expansion tubes are simulated including the effects of finite rate chemistry and both laminar and turbulent boundary layers. The simulations demonstrate the usefulness of computational fluid dynamics for characterizing the flows in high enthalpy pulse facilities. The modeling and numerical requirements necessary to simulate these flows accurately are also discussed. Although there is a large body of analysis which explains and quantifies the boundary layer growth between the shock and the interface in a shock tube, there is a need for more detailed solutions. Phenomena such as thermochemical nonequilibrium. or turbulent transition behind the shock are excluded in the assumptions of Mirels' analysis. Additionally there is inadequate capability to predict the influence of the boundary layer on the expanded gas behind the interface. Quantifying the gas in this region is particularly important in expansion tubes because it is the location of the test gas. Unsteady simulations of the viscous flow in shock tubes are computationally expensive because they must follow features such as a shock wave over the length of the facility and simultaneously resolve the small length scales within the boundary layer. As a result, efficient numerical algorithms are required. The numerical approach of the present work is to solve the axisymmetric gas dynamic equations using an finite-volume formulation where the inviscid fluxes are computed with a upwind TVD scheme. Multiple species equations are included in the formulation so that finite-rate chemistry can be modeled. The simulations cluster grid points at the shock and interface and translate this clustered grid with these features to minimize numerical errors. The solutions are advanced at a CFL number of less than one based on the inviscid gas dynamics. To avoid limitations on the time step due to the viscous terms, these terms are treated implicitly. This requires a block tri-diagonal matrix inversion along each line of cells normal to the wall. The cost of this inversion is more than offset by the larger allowable time step. The source terms representing the finite-rate chemical kinetics are also treated implicitly. An algebraic turbulence model for compressible flow is used. The flow in a low pressure shock tube is computed and the results are compared with Mirels'analysis. The driven gas is nitrogen at 70 Pa, and the incident shock speed is approximately 2.9 km/sec so that there is little dissociation. The simulations include a laminar boundary layer and are run until the limiting flow regime is achieved. At this limit, the shock and interface travel at the same velocity because the amount of driven gas between these two features remains the same: the mass flow across the shock is equal to the mass of gas being entrained at the interface by the boundary layer. Simulations with several grids are presented to establish the grid independence of the solution, Good agreement is achieved between Mirels' correlations and the computations. This is expected since the flow conditions are chosen to be consistent with the assumptions used in Mirels' analysis. This comparison adds credibility to the numerical approach and highlights some of the differences between the theory and the detailed simulations. In addition, simulations of the HYPULSE expansion tube are presented for two operating conditions and the computations are compared to experimental data. The operating gas for both cases is nitrogen. One test condition is at a total enthalpy of 15.2 MJ/Kg and a relatively low pressure of 2 kPa. This case is characterized by a laminar boundary layer and significant chemical nonequilibrium. in the acceleration gas. The second test condition is at a total enthalpy of 10.2 MJ/Kg and a pressure of 38 kPa and is characterized by a turbulent boundary layer. The simulations compare well with experiment and reveal that the nonuniformity in pressure observed during the test time is related to variations in the boundary layer displacement thickness.

Wilson, Gregory J.↗
NASA NTRS2007

Automated Knowledge Discovery From Simulators

A computational method, SimLearn, has been devised to facilitate efficient knowledge discovery from simulators. Simulators are complex computer programs used in science and engineering to model diverse phenomena such as fluid flow, gravitational interactions, coupled mechanical systems, and nuclear, chemical, and biological processes. SimLearn uses active-learning techniques to efficiently address the "landscape characterization problem." In particular, SimLearn tries to determine which regions in "input space" lead to a given output from the simulator, where "input space" refers to an abstraction of all the variables going into the simulator, e.g., initial conditions, parameters, and interaction equations. Landscape characterization can be viewed as an attempt to invert the forward mapping of the simulator and recover the inputs that produce a particular output. Given that a single simulation run can take days or weeks to complete even on a large computing cluster, SimLearn attempts to reduce costs by reducing the number of simulations needed to effect discoveries. Unlike conventional data-mining methods that are applied to static predefined datasets, SimLearn involves an iterative process in which a most informative dataset is constructed dynamically by using the simulator as an oracle. On each iteration, the algorithm models the knowledge it has gained through previous simulation trials and then chooses which simulation trials to run next. Running these trials through the simulator produces new data in the form of input-output pairs. The overall process is embodied in an algorithm that combines support vector machines (SVMs) with active learning. SVMs use learning from examples (the examples are the input-output pairs generated by running the simulator) and a principle called maximum margin to derive predictors that generalize well to new inputs. In SimLearn, the SVM plays the role of modeling the knowledge that has been gained through previous simulation trials. Active learning is used to determine which new input points would be most informative if their output were known. The selected input points are run through the simulator to generate new information that can be used to refine the SVM. The process is then repeated. SimLearn carefully balances exploration (semi-randomly searching around the input space) versus exploitation (using the current state of knowledge to conduct a tightly focused search). During each iteration, SimLearn uses not one, but an ensemble of SVMs. Each SVM in the ensemble is characterized by different hyper-parameters that control various aspects of the learned predictor - for example, whether the predictor is constrained to be very smooth (nearby points in input space lead to similar output predictions) or whether the predictor is allowed to be "bumpy." The various SVMs will have different preferences about which input points they would like to run through the simulator next. SimLearn includes a formal mechanism for balancing the ensemble SVM preferences so that a single choice can be made for the next set of trials.

Burl, Michael↗
DOE OSTI2022

The completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: growth rate of structure measurement from cosmic voids

ABSTRACT We present a void clustering analysis in configuration-space using the completed Sloan Digital Sky Survey IV (SDSS-IV) extended Baryon Oscillation Spectroscopic Survey (eBOSS) DR16 samples. These samples consist of Luminous Red Galaxies (LRGs) combined with the high-redshift tail of the SDSS-III Baryon Oscillation Spectroscopic Survey (BOSS) DR12 CMASS galaxies (called as LRG+CMASS sample), Emission Line Galaxies (ELGs), and quasars (QSOs). We build void catalogues from the three eBOSS DR16 samples using a ZOBOV-based algorithm, providing 2814 voids, 1801 voids, and 4347 voids in the LRG+CMASS, ELG, and QSO samples, respectively, spanning the redshift range 0.6 < z < 2.2. We measure the redshift space distortions around voids using the anisotropic void-galaxy cross-correlation function and we extract the distortion parameter β. We test the methodology on realistic simulations before applying it to the data, and we investigate all our systematic errors on these mocks. We find βLRG(z = 0.74) = 0.415 ± 0.087, βELG(z = 0.85) = 0.665 ± 0.125 and βQSO(z = 1.48) = 0.313 ± 0.134, for the LRG+CMASS, ELG, and QSO sample, respectively. The quoted errors include systematic and statistical contributions. In order to convert our measurements in terms of the growth rate fσ8, we use consensus values of linear bias from the eBOSS DR16 companion papers, resulting in the following constraints: fσ8(z = 0.74) = 0.50 ± 0.11, fσ8(z = 0.85) = 0.52 ± 0.10, and fσ8(z = 1.48) = 0.30 ± 0.13. Our measurements are consistent with other measurements from eBOSS DR16 using conventional clustering techniques.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Structure-guided design of a broadly cross-reactive multivalent group a streptococcal vaccine

The M protein of group A streptococci (Strep A) is a major virulence determinant and protective antigen. The N-terminal region of the M protein is variable in sequence, defines the M/emm type, and contains epitopes that elicit opsonic antibodies that protect animals from challenge infections. Although there are >200 M types of Strep A, there is now evidence that structurally related M proteins can be grouped into clusters and that immunity may be cluster-specific in addition to M type-specific. This observation has led to recent studies of structure-based design of multivalent M peptide vaccines to select peptides predicted to cross-react with heterologous M types to improve vaccine coverage. In the current study, we have applied a refined series of peptide structural algorithms to predict immunological cross-reactivity among 117N-terminal M peptides representing the most prevalent M types of Strep A. Based on the results of the structural analyses, in combination with global M type prevalence data, we constructed a 32-valent vaccine containing 19 cross-reactive vaccine candidates predicted to cross-react with 37 heterologous M peptides to which were added 13 type-specific M peptides. Further, the 4-protein recombinant vaccine was immunogenic in rabbits and elicited significant levels of antibodies against 31/32 (97%) vaccine peptides and 28/37 (76%) peptides predicted to cross-react. The vaccine antisera also promoted opsonophagocytic killing of vaccine and cross-reactive M types of Strep A. Based on a recent analysis of M type prevalence of Strep A, the potential global coverage of the 32-valent vaccine is ~90%, ranging from 68% in Africa to 95% in North America. Our results indicate the utility of structure-based design that may be applied to future studies of broadly protective M peptide vaccines.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Scaling pair count to next galaxy surveys

ABSTRACT Counting pairs of galaxies or stars according to their distance is at the core of real-space correlation analyses performed in astrophysics and cosmology. Upcoming galaxy surveys (LSST, Euclid) will measure properties of billions of galaxies challenging our ability to perform such counting in a minute-scale time relevant for the usage of simulations. The problem is only limited by efficient access to the data, hence belongs to the big data category. We use the popular Apache Spark framework to address it and design an efficient high-throughput algorithm to deal with hundreds of millions to billions of input data. To optimize it, we revisit the question of non-hierarchical sphere pixelization based on cube symmetries and develop a new one dubbed the ‘Similar Radius Sphere Pixelization’ (SARSPix) with very close to square pixels. It provides the most adapted indexing over the sphere for all distance-related computations. Using LSST-like fast simulations, we compute autocorrelation functions on tomographic bins containing between a hundred million to one billion data points. In each case, we achieve the construction of a standard pair-distance histogram in about 2 min, using a simple algorithm that is shown to scale, over a moderate number of nodes (16–64). This illustrates the potential of this new techniques in the field of astronomy where data access is becoming the main bottleneck. They can be easily adapted to other use-cases as nearest-neighbours search, catalogue cross-match or cluster finding. The software is publicly available from https://github.com/astrolabsoftware/SparkCorr.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1987

A study of the feasibility of using sea and wind information from the ERS-1 satellite. Part 1: Wind scatterometer data

The use of scatterometer and altimeter data in wind and wave assimilation, and the benefits this offers for quality assurance and validation of ERS-1 data were examined. Real time use of ERS-1 data was simulated through assimilation of Seasat scatterometer data. The potential for quality assurance and validation is demonstrated by documenting a series of substantial problems with the scatterometer data, which are known but took years to establish, or are new. A data impact study, and an analysis of the performance of ambiguity removal algorithms on real and simulated data were conducted. The impact of the data on analyses and forecasts is large in the Southern Hemisphere, generally small in the Northern Hemisphere, and occasionally large in the Tropics. Tests with simulated data give more optimistic results than tests with real data. Errors in ambiguity removal results occur in clusters. The probabilities which can be calculated for the ambiguous wind directions on ERS-1 contain more information than is given by a simple ranking of the directions.

Anderson, D.↗