Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data aggregation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53
All sourcesNASA NTRSDOE OSTI
DOE OSTI2015

The temperature and size distribution of large water clusters from a non-equilibrium model

A hybrid Lagrangian-Eulerian approach is used to examine the properties of water clusters formed in neon-water vapor mixtures expanding through microscale conical nozzles. Experimental size distributions were reliably determined by the sodium doping technique in a molecular beam machine. The comparison of computed size distributions and experimental data shows satisfactory agreement, especially for (H{sub 2}O){sub n} clusters with n larger than 50. Thus validated simulations provide size selected cluster temperature profiles in and outside the nozzle. This information is used for an in-depth analysis of the crystallization and water cluster aggregation dynamics of recently reported supersonic jet expansion experiments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2015

On the formation of copper nanoparticles in nanocluster aggregation source

The influence of pressure and type of inert gas (Ar and Kr) on the morphology and size distribution of nanoparticles produced in a nanocluster source is studied experimentally. The experimental data are used to validate the model of cluster formation from a supersaturated atomic vapor in an inert buffer gas, which has been developed in our previous paper. The model predictions are in accordance with the experimental findings.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2016

DECIPHERING CONTRIBUTIONS TO THE EXTRAGALACTIC GAMMA-RAY BACKGROUND FROM 2 GeV TO 2 TeV

Astrophysical sources outside the Milky Way, such as active galactic nuclei and star-forming galaxies, leave their imprint on the gamma-ray sky as nearly isotropic emission referred to as the extragalactic gamma-ray background (EGB). While the brightest of these sources may be individually resolved, their fainter counterparts contribute diffusely. In this work, we use a recently developed analysis method, called the Non-Poissonian Template Fit, on up to 93 months of publicly available data from the Fermi Large Area Telescope to determine the properties of the point sources (PSs) that comprise the EGB. This analysis takes advantage of photon-count statistics to probe the aggregate properties of these source populations below the sensitivity threshold of published catalogs. We measure the source-count distributions and PS intensities, as a function of energy, from ∼2 GeV to 2 TeV. We find that the EGB is dominated by PSs, likely blazars, in all seven energy sub-bins considered. These results have implications for the interpretation of IceCube’s PeV neutrinos, which may originate from sources that contribute to the non-blazar component of the EGB. Additionally, we comment on implications for future TeV observatories such as the Cherenkov Telescope Array. We provide sky maps showing locations most likely to contain these new sources at both low (≲50 GeV) and high (≳50 GeV) energies for use in future observations and cross-correlation studies.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2018

Simulated building energy demand biases resulting from the use of representative weather stations

Numerical building models are typically forced with weather data from a limited number of “representative cities” or weather stations representing different climate regions. The use of representative weather stations reduces computational costs, but often fails to capture spatial heterogeneity in weather that may be important for simulations aimed at understanding how building stocks respond to a changing climate. We quantify the potential reduction in bias from using an increasing number of weather stations over the western U.S. The approach is based on deriving temperature and load time series using incrementally more weather stations, ranging from 8 to roughly 150, to capture weather across different seasons. Using 8 stations, one from each climate zone, across the western U.S. results in an average absolute summertime temperature bias of 7.2°F with respect to a spatially-resolved gridded dataset. The mean absolute bias drops to 2.8°F using all available weather stations. Temperature biases of this magnitude could translate to absolute summertime mean simulated load biases as high as 13.8%, a significant error for capacity expansion planners who may use these types of simulations. Increasing the size of the domain over which biases are calculated reduces their magnitude as positive and negative biases may cancel out. Using 8 representative weather stations can lead to a 20-40% overestimation of peak building loads during both summer and winter. Using weather stations close to population centers reduces both mean and peak load biases. This approach could be used by others designing aggregate building simulations to understand the sensitivity to their choice of weather stations used to drive the models.

Burleyson, Casey D.↗
DOE OSTI2015

A Scalable Monitoring for the CMS Filter Farm Based on Elasticsearch

A flexible monitoring system has been designed for the CMS File-based Filter Farm making use of modern data mining and analytics components. All the metadata and monitoring information concerning data flow and execution of the HLT are generated locally in the form of small documents using the JSON encoding. These documents are indexed into a hierarchy of elasticsearch (es) clusters along with process and system log information. Elasticsearch is a search server based on Apache Lucene. It provides a distributed, multitenant-capable search and aggregation engine. Since es is schema-free, any new information can be added seamlessly and the unstructured information can be queried in non-predetermined ways. The leaf es clusters consist of the very same nodes that form the Filter Farm thus providing natural horizontal scaling. A separate central” es cluster is used to collect and index aggregated information. The fine-grained information, all the way to individual processes, remains available in the leaf clusters. The central es cluster provides quasi-real-time high-level monitoring information to any kind of client. Historical data can be retrieved to analyse past problems or correlate them with external information. We discuss the design and performance of this system in the context of the CMS DAQ commissioning for LHC Run 2.

Andre, J. M.↗
DOE OSTI2018

A Bayesian Approach to Predict Solubility Parameters

Abstract Solubility is a ubiquitous phenomenon in many aspects of material science. While solubility can be determined by considering the cohesive forces in a liquid via the Hansen solubility parameters (HSP), quantitative structure–property relationship models are often used for prediction, notably due to their low computational cost. Here, gpHSP, an interpretable and versatile probabilistic approach to determining HSP, is reported. Our model is based on Gaussian processes, a Bayesian machine learning approach that provides uncertainty bounds to prediction. gpHSP achieves its flexibility by leveraging a variety of input data, such as SMILES strings, COSMOtherm simulations, and quantum chemistry calculations. gpHSP is built on experimentally determined HSP, including a general solvents set aggregated from the literature, and a polymer set experimentally characterized by this group of authors. In all sets, a high degree of agreement is obtained, surpassing well‐established machine learning methods. The general applicability of gpHSP to miscibility of organic semiconductors, drug compounds, and in general solvents is demonstrated, which can be further extended to other domains. gpHSP is a fast and accurate toolbox, which could be applied to molecular design for solution processing technologies.

Sanchez‐Lengeling, Benjamin↗
DOE OSTI2012

Novel Synthesis and Structural Analysis of Ferrihydrite

Naturally occurring ferrihydrite is both impure and difficult to isolate, so the numerous applications and interesting properties of ferrihydrite have spurred the development of various synthetic techniques. Nearly all techniques are based on the hydrolysis of an iron salt and require careful control of temperature, pH, and concentration. In this Article, we report a new synthetic method which does not require such control and is perhaps the fastest and simplest route to synthesizing ferrhydrite. XRD, TEM, BET, and chemical purity characterizations show that the chemically pure, 2-line ferrihydrite product consists of crystallites 2-6 nm in diameter which aggregate to form mesoporous, high surface area agglomerates that are attractive candidates for the many adsorption applications of ferrihydrite. X-ray PDF data were also collected for the ferrihydrite product and refined against the hexagonal structural model recently proposed by Michel et al. These analyses suggest that ferrihydrite has a consistent, repeatable structure independent of variation in the synthetic method, water content of the sample, or particle size of the crystallites, and this structure can be adequately described by the proposed hexagonal model.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Semi-Supervised Disaggregation of Load Profiles at Transmission Buses with Significant Behind-the-Meter Solar Generations

It is of imperative interests for regional transmission organizations (RTOs) to effectively extract daily load profiles at transmission buses, which remains a gap in existing technology paradigm. This digest proposes an explicit yet efficient linear estimator, to disaggregate metered load profiles at buses with significant behind-the-meter (BTM) solar generations in a data driven manner. The proposed estimator is based on utility zonal load profiles and proxy solar irradiance profiles, which in reality is the aggregated waveform at each transmission bus and equivalent to the mix of summed load profiles minus actual BTM solar generation. To overcome technical challenges in the lack of “ground truth” and validate the performance of supervised learning algorithms, we propose semi-supervised mechanisms with parameter tuning, and leverage the unique characteristics of zero-crossing points in BTM solar peaking behaviors.

machine leaning, behind-the-meter, power grid anal↗
DOE OSTI2022

CONGO²: Scalable Online Anomaly Detection and Localization in Power Electronics Networks

Rapid and accurate detection and localization of electronic disturbances simultaneously are important for preventing its potential damages and determining potential remedies. Existing anomaly detection methods are severely limited by the low accuracy, the expensive computational cost and the need for highly trained personnel. There is an urgent need for a scalable online algorithm for in-field analysis of large-scale power electronics networks. Here in this paper, we propose a fast and accurate algorithm for anomaly detection and localization of power electronics networks: stratified colored-node graph (CONGO2). This algorithm hierarchically models the change of correlated waveforms and then correlated sensors using the colored-node graph. By aggregating the change of each sensor with its neighbors’ inputs, we can spontaneously identify and localize the anomaly that cannot be detected by data collected from a single sensor. As our proposed method only focuses on the changes within a short time frame, it is highly computational efficient and only needs small data storage. Thus, our method is ideal for online and reliable anomaly detection and localization of large-scale power electronic networks. Compared to existing anomaly detection methods, our method is entirely data-driven without training data, highly accurate and reliable for wide-spectrum anomalies detection, and more importantly, capable of both detection and localization. Thus, it is ideal for infield deployment for large-scale power electronic networks. As illustrated by a distributed energy resources (DERs) power grid with 37-node, our method can effectively detect and localize various cyber and physical attacks.

42 ENGINEERING↗
DOE OSTI2014

SU-E-J-32: Calypso(R) and Laser-Based Localization Systems Comparison for Left-Sided Breast Cancer Patients Using Deep Inspiration Breath Hold

Purpose: Our institution uses a manual laser-based system for primary localization and verification during radiation treatment of left-sided breast cancer patients using deep inspiration breath hold (DIBH). This primary system was compared with sternum-placed Calypso(R) beacons (Varian Medical Systems, CA). Only intact breast patients are considered for this analysis. Methods: During computed tomography (CT) simulation, patients have BB and Calypso(R) surface beacons positioned sternally and marked for free-breathing and DIBH CTs. During dosimetry planning, BB longitudinal displacement between free breathing and DIBH CT determines laser mark (BH mark) location. Calypso(R) beacon locations from the DIBH CT are entered at the Tracking Station. During Linac simulation and treatment, patients inhale until the cross-hair and/or lasers coincide with the BH Mark, which can be seen using our high quality cameras (Pelco, CA). Daily Calypso(R) displacement values (difference from the DIBH-CT-based plan) are recorded.The displacement mean and standard deviation was calculated for each patient (77 patients, 1845 sessions). An aggregate mean and standard deviation was calculated weighted by the number of patient fractions.Some patients were shifted based on MV ports. A second data set was calculated with Calypso(R) values corrected by these shifts. Results: Mean displacement values indicate agreement within 1±3mm, with improvement for shifted data (Table). Conclusion: Both unshifted and shifted data sets show the Calypso(R) system coincides with the laser system within 1±3mm, demonstrating either localization/verification system will Resultin similar clinical outcomes. Displacement value uncertainty unilaterally reduces when shifts are taken into account.

07 ISOTOPE AND RADIATION SOURCES↗
DOE OSTI2023

Evaluation of Multi-Fidelity Soil Moisture Products Across the Continental United States

We have aggregated the most recent soil moisture datasets from a diverse range of sources, encompassing the Continental United States (CONUS). These sources encompass gridded data from remote sensing products, reanalysis products, machine learning-based projects, and land surface modeling products. Additionally, we have obtained and processed in-situ soil moisture observations from the International Soil Moisture Network. The collected datasets exhibit variations in both temporal and spatial resolutions. Among the 20 datasets, six are available at a spatial resolution of 0.25 degrees, while three are at a coarser spatial resolution of 25 km. To minimize spatial interpolation, we conducted data uncertainty evaluations at the 0.25-degree spatial resolution. For our data evaluations, we maintained a monthly temporal resolution, which effectively captures soil moisture seasonality and interannual variability. Our data processing strategy preserves the raw data and interpolated data at their original temporal resolutions. Datasets with higher temporal resolutions, including daily, three-hourly, and hourly datasets, are set aside for subsequent analyses. These analyses will delve into topics such as soil moisture changes and recovery during extreme weather events. Furthermore, we have processed auxiliary data to enhance our evaluation, leveraging tools such as Google Earth Engine. This includes incorporating topography data, land use land cover data, Köppen-Geiger climate classification, and more to provide a comprehensive assessment from multiple sources.

Li, Lingcheng↗
DOE OSTI2025

Evaluation of cloud height, optical thickness, and phase retrievals from the CHROMA algorithm applied to Sentinel-3 OLCI data

We previously developed the Cloud Height Retrieval from O 2 Molecular Absorption (CHROMA) algorithm for the Ocean Color Instrument (OCI) on the new NASA Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mission. Here, we apply CHROMA to observations from the Ocean Land Colour Instrument (OLCI) to guide expectations for PACE, as it will take some time to obtain large-scale validation data for OCI. We use cloud top height (CTH), phase, and (for liquid clouds) cloud optical thickness (COT) data from the ground-based Atmospheric Radiation Measurement (ARM) network to evaluate the OLCI retrievals. We found that OLCI and Moderate Resolution Imaging Spectroradiometer (MODIS) CTH compare similarly well to the ARM reference. OLCI has a tendency to underestimate CTH as CTH increases, and algorithm assumptions about cloud geometric thickness may contribute to this. ARM COT from multifilter shadowband radiometers (MFRSR) and Sun photometers are well-correlated with one another, albeit with a roughly 30 % offset on average; OLCI and MODIS COT agree more closely with the MFRSR data. OLCI retrieval uncertainty estimates show skill at telling low-uncertainty cases from high-uncertainty ones, although CTH uncertainties are underestimated. Additionally, we compare the OLCI data to satellite retrievals based on thermal infrared measurements from MODIS and Sea and Land Surface Temperature Radiometer (SLSTR) data. Differences are broadly consistent with physical expectations based on the A-band vs. thermal techniques, although one key challenge in such aggregated comparisons is different cloud masking sensitivities and algorithm failure rates meaning additional sampling differences are introduced. We conclude by discussing the transition to and possible enhancements for PACE OCI.

Sayer, Andrew M. [Univ. of Maryland Baltimore Coun↗
DOE OSTI2020

Installation Assignment Durations and Patterns of Army Personnel

The purpose of this document is to report on the development of personnel assignment duration statistical metrics and statistical descriptions for groups of Army personnel aggregated by rank, career management field, and other descriptors for 32 Continental United States (CONUS) Army installations. This information can be used for generating evidence-based measures of personnel exposure times associated with environmental health considerations at the installation and career management field levels. Assignment duration statistical descriptions were developed to provide temporal metrics for groups of personnel at Army installations as foundational data to support a variety of assessments. Statistical results of personnel assignment durations at the installation level are provided in several formats. The 50th percentile assignment duration represents the median number of days personnel in groups aggregated by rank and career management field spend at the 32 CONUS Army installations in this study. Likewise, other duration percentiles (90th) and quartiles of assignment durations for groups aggregated by rank and career management field spend at each installation were developed. Assignment path analysis provide statistical descriptions of assignment durations at Army installations throughout increments of time (e.g., 5 years, 10 years). Key groupings of assignment paths were achieved by analyzing the duration of assignments at installations in chronological order from entry throughout specified increments of military service to generate the most common assignment paths across the 32 CONUS Army installations in this study. The developed assignment duration analytics and duration statistical descriptions provide foundational temporal metrics for groups of personnel at 32 CONUS Army installations to support a variety of assessments including those by human resource planners and environmental health specialists.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2016

Marine Hydrokinetic Energy Site Identification and Ranking Methodology Part I: Wave Energy

Marine hydrokinetic energy is a promising and growing piece of the renewable energy sector that offers high predictability and additional energy sources for a diversified energy economy. This report investigates the market opportunities for wave energy along the U.S. coastlines. It is part one of a two-part investigation into the United State's two largest marine hydrokinetic resources (wave and tidal). Wave energy technology is still an emerging form of renewable energy for which large-scale, grid-connected project costs are currently poorly defined. Ideally, device designers would like to know the resource conditions at economical project sites so they can optimize device designs. On the other hand, project developers need detailed device cost data to identify sites where projects are economical. That is, device design and siting are, to some extent, a coupled problem. This work describes a methodology for identifying likely deployment locations based on a set of criteria that wave energy experts in industry, academia, and national laboratories agree are likely to be important factors for all technology types. This work groups the data for the six criteria into 'locales' that are defined as the smaller of either the local transmission grid or a state boundary. The former applies to U.S. islands (e.g., Hawaii, American Samoa) and rural villages (e.g., in Alaska); the latter applies to states in the contiguous United States. These data are then scored from 0 to 10 according to scoring functions that were developed with input from wave energy industry and academic experts. The scores are aggregated using a simple product method that includes a weighting factor for each criterion. This work presents two weighting scenarios: a long-term scenario that does not include energy price (weighted zero) and a near term scenario that includes energy price. The aggregated scores are then used to produce ranked lists of likely deployment locales. In both scenarios, Hawaii and the Pacific Northwest (northern California, Oregon, and Washington) rank at the top of the lists. Hawaii ranks highest in the near-term scenario because it has high energy costs. In the long-term scenario, Oregon ranks highest because it has a large market and an energetic resource. Several East Coast states and Puerto Rico are also identified as potential wave energy deployment sites if technological innovations make it possible to efficiently generate electricity from the modest resource there. There are also several small-market sites in Alaska and U.S. Pacific Islands that rank particularly well in the near-term analysis due to their high energy prices. These locations may represent opportunities to demonstrate economical wave energy conversion as a stepping-stone to larger markets. Several factors that will affect wave project costs and siting have not been considered here -- including permitting constraints, conflicting use, seasonal resource variability, extreme event likelihood, and distance to ports -- because consistent data are unavailable or technology-independent scoring could not be identified. As the industry continues to mature and converge around a subset of device archetypes with well-defined costs, more precise investigations of project siting that include these factors will be possible. For now, these results provide a high-level guide pointing to the regions where markets and resource will one day support commercial wave energy projects.

16 TIDAL AND WAVE POWER↗
DOE OSTI2025

Upstreamness and downstreamness in input–output analysis from local and aggregate information

Abstract Ranking sectors and countries within global value chains is of paramount importance to estimate risks and forecast growth in large economies. However, this task is often non-trivial due to the lack of complete and accurate information on the flows of money and goods between sectors and countries, which are encoded in input–output (I–O) tables. In this work, we show that an accurate estimation of the role played by sectors and countries in supply chain networks can be achieved without full knowledge of the I–O tables, but only relying on local and aggregate information, e.g., the total intermediate demand per sector. Our method, based on a rank-1 approximation to the I–O table, shows consistently good performance in reconstructing rankings (i.e., upstreamness and downstreamness measures for countries and sectors) when tested on empirical data from the world input–output database. Moreover, we connect the accuracy of our approximate framework with the spectral properties of the I–O tables, which ordinarily exhibit relatively large spectral gaps. Our approach provides a fast and analytically tractable framework to rank constituents of a complex economy without the need of matrix inversions and the knowledge of finer intersectorial details.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

Rocket Launch Detection with Smartphone Audio and Transfer Learning

Rocket launches generate infrasound signatures that have been detected at great distances. Due to the sparsity of the networks that have made these detections, however, most signals are detected tens of minutes to hours after the rocket launch. In this work, a method of near-real-time detection of rocket launches using data from a network of smartphones located 10–70 km from launch sites is presented. A machine learning model is trained and tested on the open-access Aggregated Smartphone Timeseries of Rocket-generated Acoustics (ASTRA), Smartphone High-explosive Audio Recordings Dataset (SHAReD), and ESC-50 datasets, resulting in a final accuracy of 97% and a false positive rate of <1%. The performance and behavior of the model are summarized, and its suitability for persistent monitoring applications is discussed.

acoustics↗
DOE OSTI2016

Evaluating the Value of High Spatial Resolution in National Capacity Expansion Models using ReEDS

Power sector capacity expansion models (CEMs) have a broad range of spatial resolutions. This paper uses the Regional Energy Deployment System (ReEDS) model, a long-term national scale electric sector CEM, to evaluate the value of high spatial resolution for CEMs. ReEDS models the United States with 134 load balancing areas (BAs) and captures the variability in existing generation parameters, future technology costs, performance, and resource availability using very high spatial resolution data, especially for wind and solar modeled at 356 resource regions. In this paper we perform planning studies at three different spatial resolutions--native resolution (134 BAs), state-level, and NERC region level--and evaluate how results change under different levels of spatial aggregation in terms of renewable capacity deployment and location, associated transmission builds, and system costs. The results are used to ascertain the value of high geographically resolved models in terms of their impact on relative competitiveness among renewable energy resources.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Quantifying Message Aggregation Optimisations for Energy Savings in PGAS Models

Upon breaking past the exascale barrier, HPC systems are facing their greatest challenge yet - a power wall that must be addressed through new methods in both hardware and software. While energy costs are becoming a major issue at all levels, of particular concern is that of the network, as the relative cost of moving data is increasing faster than ever. The partitioned global address space (PGAS) model is critical within certain HPC domains, but is known to suffer from the small message problem, where irregular many-to-many access patterns result in congesting the network with excessive numbers of small messages. To address this, the conveyor aggregation library was developed to defer individual messages and group them for subsequent bulk processing. In this paper, we investigate its impact on energy use related to the network, with a focus on the Slingshot 11 interconnect. We will demonstrate that this strategy is not only highly performant, but also crucial to reducing energy footprints to remain within target power envelopes.

Welch, Aaron [ORNL]↗