SEARCH · Engineering Papers

Results for “data aggregation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

All sources NASA NTRS DOE OSTI

DOE OSTI2015

Smisc - A collection of miscellaneous functions

A collection of functions for statistical computing and data manipulation. These include routines for rapidly aggregating heterogeneous matrices, manipulating file names, loading R objects, sourcing multiple R files, formatting datetimes, multi-core parallel computing, stream editing, specialized plotting, etc. Smisc-package A collection of miscellaneous functions allMissing Identifies missing rows or columns in a data frame or matrix as.numericSilent Silent wrapper for coercing a vector to numeric comboList Produces all possible combinations of a set of linear model predictors cumMax Computes the maximum of the vector up to the current index cumsumNA Computes the cummulative sum of a vector without propogating NAs d2binom Probability functions for the sum of two independent binomials dataIn A flexible way to import data into R. dbb The Beta-Binomial Distribution df2list Row-wise conversion of a data frame to a list dfplapply Parallelized single row processing of a data frame dframeEquiv Examines the equivalence of two dataframes or matrices dkbinom Probability functions for the sum of k independent binomials factor2character Converts all factor variables in a dataframe to character variables findDepMat Identify linearly dependent rows or columns in a matrix formatDT Converts date or datetime strings into alternate formats getExtension Filename manipulations: remove the extension or path, extract the extension or path getPath Filename manipulations: remove the extension or path, extract the extension or path grabLast Filename manipulations: remove the extension or path, extract the extension or path ifelse1 Non-vectorized version of ifelse integ Simple numerical integration routine interactionPlot Two-way Interaction Plot with Error Bar linearMap Linear mapping of a numerical vector or scalar list2df Convert a list to a data frame loadObject Loads and returns the object(s) in an ".Rdata" file more Display the contents of a file to the R terminal movAvg2 Calculate the moving average using a 2-sided window openDevice Opens a graphics device based on the filename extension p2binom Probability functions for the sum of two independent binomials padZero Pad a vector of numbers with zeros parseJob Parses a collection of elements into (almost) equal sized groups pbb The Beta-Binomial Distribution pcbinom A continuous version of the binomial cdf pkbinom Probability functions for the sum of k independent binomials plapply Simple parallelization of lapply plotFun Plot one or more functions on a single plot PowerData An example of power data pvar Prints the name and value of one or more objects qbb The Beta-Binomial Distribution rbb And numerous others (space limits reporting).

Landon Sego, PNNL↗

NASA NTRS2011

User Centered, Application Independent Visualization of National Airspace Data

This paper describes an application independent software tool, IV4D, built to visualize animated and still 3D National Airspace System (NAS) data specifically for aeronautics engineers who research aggregate, as well as single, flight efficiencies and behavior. IV4D was origin ally developed in a joint effort between the National Aeronautics and Space Administration (NASA) and the Air Force Research Laboratory (A FRL) to support the visualization of air traffic data from the Airspa ce Concept Evaluation System (ACES) simulation program. The three mai n challenges tackled by IV4D developers were: 1) determining how to d istill multiple NASA data formats into a few minimal dataset types; 2 ) creating an environment, consisting of a user interface, heuristic algorithms, and retained metadata, that facilitates easy setup and fa st visualization; and 3) maximizing the user?s ability to utilize the extended range of visualization available with AFRL?s existing 3D te chnologies. IV4D is currently being used by air traffic management re searchers at NASA?s Ames and Langley Research Centers to support data visualizations.

Murphy, James R.↗

DOE OSTI2015

Smisc - A collection of miscellaneous functions

Landon Sego, PNNL↗

NASA NTRS2021

Classifying planetary cloudiness with an updated set of MODIS Cloud Regimes

We present an updated Cloud Regime (CR) dataset based on Moderate resolution Imaging Spectroradiometer (MODIS) Collection 6.1 cloud products, specifically joint histograms that partition cloud fraction within distinct combinations of cloud top pressure and cloud optical thickness ranges. The paper focuses on an edition of the CR dataset derived from our own aggregation of MODIS pixel-level cloud retrievals on an equal area grid and pre-specified 3-hour UTC intervals that spatiotemporally match International Satellite Cloud Climatology Project (ISCCP) gridded cloud data. The other edition comes from the 1-degree daily aggregation provided by standard MODIS Level-3 data, as in previous versions of the MODIS CRs, for easier use with datasets mapped on equal angle grids. Both editions consist of 11 clusters whose centroids are nearly identical.We provide a physical interpretation of the new CRs and aspects of their climatology that have not been previously examined, such as seasonal and interannual variability of CR frequency of occurrence. We also examine the makeup and precipitation properties of the CRs assisted by independent datasets originating from active observations, and provide a first glimpse of how MODIS CRs relate to clouds as seen by ISCCP.

MODIS↗

DOE OSTI2021

Renewable hydrogen and ammonia for combined heat and power systems in remote locations: Optimal design and scheduling

Abstract Using hydrogen (H ) and ammonia (NH ) for renewable energy storage has the potential to enable economical power and heat supply with high renewable penetrations, especially in remote locations which are characterized by high energy costs. In this work we assess the economic competitiveness of renewable combined heat and power (CHP) systems in Mahaka HI, Nantucket MA, and Northwest Arctic Borough (NWAB) AK by optimally designing these systems for scenarios in which power and heat can be purchased over a range of historical energy prices as well as when 100% renewable supply is required. We use a combined optimal design and scheduling model which minimizes annualized net present cost by determining optimal technology selection and size simultaneously with optimal schedules for each period of a system operating horizon aggregated from full year hourly resolution data via a consecutive temporal clustering algorithm. We find that renewable generation meets at least 85% of power demands and 75% of heat demands under the lowest energy prices investigated. Higher conventional energy prices lead to increased renewable penetration which is facilitated by renewable NH as a seasonal energy storage medium, as are 100% renewable CHP systems. NH is used for power generation with heat cogeneration in all three locations, as well as directly for heating in NWAB. On an annual cost basis, NH ‐enabled 100% renewable CHP is only 3% more expensive in Mahaka and NWAB than systems which can purchase energy at the lowest prices, while it is 15% more expensive in Nantucket.

Palys, Matthew J.↗

DOE OSTI2020

Using hydrogen and ammonia for renewable energy storage: A geographically comprehensive techno-economic study

Hydrogen and, more recently, ammonia have received worldwide attention as energy storage media. In this work we investigate the economics of using each of these chemicals as well as the two in combination for islanded renewable energy supply systems in 15 American cities representing different climate regions throughout the country. We use an optimal combined capacity planning and scheduling model which minimizes the levelized cost of energy (LCOE) by determining optimal unit selection and size along with unit commitments, production rates, and storage inventories for each period of system operation. These periods are aggregated from full year hourly resolution data via a consecutive temporal clustering algorithm. Ammonia is generally more economical than hydrogen as a single method of energy storage. Additionally, systems which use both hydrogen and ammonia outperform those which use only one storage option and have LCOE between $\$ 0.17$/kWh and $\$ 0.28$/kWh, including full investment in renewable generation infrastructure.

25 ENERGY STORAGE↗

DOE OSTI2017

Dataset of timberland variables used to assess forest conditions in two Southeastern United States' fuelsheds

The data presented in this article are related to the research article entitled “How is wood-based pellet production affecting forest conditions in the southeastern United States?” (Dale et al., 2017). This article describes how United States Forest Service (USFS) Forest Inventory and Analysis (FIA) data from multiple state inventories were aggregated and used to extract ten annual timberland variables for trend analysis in two case study bioenergy fuelshed areas. This dataset is made publically available to enable critical or extended analyses of changes in forest conditions, either for the fuelshed areas supplying the ports of Savannah, Georgia and Chesapeake, Virginia, or for other southeastern US forested areas contributing biomass to the export wood pellet industry.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2014

Electron attenuation in free, neutral ethane clusters

The electron effective attenuation length (EAL) in free, neutral ethane clusters has been determined at 40 eV kinetic energy by combining carbon 1s x-ray photoelectron spectroscopy and theoretical lineshape modeling. More specifically, theory is employed to form model spectra on a grid in cluster size (N) and EAL (λ), allowing N and λ to be determined by optimizing the goodness-of-fit χ{sup 2}(N, λ) between model and observed spectra. Experimentally, the clusters were produced in an adiabatic-expansion setup using helium as the driving gas, spanning a range of 100–600 molecules in mean cluster size. The effective attenuation length was determined to be 8.4 ± 1.9 Å, in good agreement with an independent estimate of 10 Å formed on the basis of molecular electron-scattering data and Monte Carlo simulations. The aggregation state of the clusters as well as the cluster temperature and its importance to the derived EAL value are discussed in some depth.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2023

Efficient Network Partitioning: Application for Decentralized State Estimation in Power Distribution Grids

Increase in the proliferation of distributed energy resources require real-time situational awareness for efficient grid operations. State estimation plays an important role for the real-time control and management of the power grid. As the sensing infrastructure grows, aggregating and handling high volumes of data at a centralized location is extremely difficult. To address this challenge, this paper first proposes a novel and efficient hier-archical spectral clustering-based network partitioning algorithm followed by a decentralized compressive sensing (DCS)-based state estimation. The applicability of the proposed network partitioning algorithm is tested on an IEEE 123-bus network, an IEEE 8,500-node system, and a 6,000+ node distribution network. The results shows that the proposed approach efficiently divides the network into multiple sub-networks with the minimum number of edge connections among the neighbors. Then, we perform DCS-based state estimation on the 6,000+ node distribution network after dividing the network into 18 optimal partitions. Simulation results show that the DCS-based state estimation recovers the system states with high accuracy and low complexity.

alternating direction method of multipliers↗

DOE OSTI2019

Role of epaQ , a Previously Uncharacterized Enterococcus faecalis Gene, in Biofilm Development and Antimicrobial Resistance

Enterococcus faecalis is a commensal of the human gastrointestinal tract; it is also an opportunistic pathogen and one of the leading causes of hospital-acquired infections. E. faecalis produces biofilms that are highly resistant to antibiotics, and it has been previously reported that certain genes of the epa operon contribute to biofilm-associated antibiotic resistance. Despite several studies examining the epa operon, many gene products of this operon remain annotated as hypothetical proteins. Here, we further explore the epa operon; we identified epaQ , currently annotated as encoding a hypothetical membrane protein, as being important for biofilm formation in the presence of the antibiotic daptomycin. Mutants with disruptions of epaQ were more susceptible to daptomycin relative to the wild type, suggesting its importance in biofilm-associated antibiotic resistance. Furthermore, the Δ epaQ mutant exhibited an altered biofilm architectural arrangement and formed small aggregates in liquid cultures. Our cumulative data show that epa mutations result in altered polysaccharide content, increased cell surface hydrophobicity, and decreased membrane potential. Surprisingly, several epa mutations significantly increased resistance to the antibiotic ceftriaxone, indicating that the way in which the epa operon impacts antibiotic resistance is antibiotic dependent. Finally, these results further define the key role of epa in antibiotic resistance in biofilms and in biofilm architecture.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2025

Differentially Private Map Matching (DPMM) v1.0

Human mobility trajectories provide valuable information for developing mobility applications, as they contain diverse and rich information about the users. User mobility data is valuable for various applications such as intelligent transportation systems (ITS), commercial business models, and disease-spread models. However, such spatio-temporal traces may pose a threat to user privacy. GPS trajectories in their raw form are not suitable for transportation studies, as they require matching locations with nearest road links — a process called map-matching. This software implements a differential privacy (DP)-based map-matching algorithm, called DPMM, that generates link-level location trajectories in a privacy-preserving manner to protect users' origin destinations (OD) and travel paths. OD privacy is achieved by injecting Planar Laplace noise to the user OD GPS points. Travel-path privacy is provided with randomized travel path construction using exponential DP mechanism. The injected noise level is selected adaptively, by considering the link density of the location and the functional category of the localized links. For path privacy, our mechanism samples waypoints and selects candidate paths between waypoints. DPMM provides privacy effectively with respect to link density instead of other trajectory samples in the database compared to other privacy mechanisms. Compared to the different baseline models our DP-based privacy model offers closer query responses to the raw data in terms of individual and aggregate trajectory-level statistics with an average at absolute deviation from the baseline for individual statistics on ϵ = 1.0. Beyond individual trajectory statistics, the DPMM outperforms the other benchmark DP-based mechanisms on different aggregate statistics with up to 8x improvement in utility.

Peisert, Sean [Lawrence Berkeley National Laborato↗

DOE OSTI2021

Polarimetric Signatures in Landfalling Tropical Cyclones

Polarimetric radar observations from the NEXRAD WSR-88D operational radar network in the contiguous United States, routinely available since 2013, are used to reveal three prominent microphysical signatures in landfalling tropical cyclones: 1) hydrometeor size sorting within the eyewall convection, 2) vertical displacement of the melting layer within the inner core, and 3) dendritic growth layers within stratiform regions of the inner core. Size sorting signatures within eyewall convection are observed with greater frequency and prominence in more intense hurricanes, and are observed predominantly within the deep-layer environmental wind shear vector-relative quadrants that harbor the greatest frequency of deep convection (i.e., downshear and left-of-shear). Melting-layer displacements are shown that exceed 1 km in altitude compared to melting-layer altitudes in outer rainbands and are complemented by analyses of archived dropsonde data. Dendritic growth and attendant snow aggregation signatures in the inner core are found to occur more often when echo-top altitudes are low (≤10 km MSL), nearer the -15°C isotherm commonly associated with dendritic growth. These signatures, uniquely observed by polarimetric radar, provide greater insight into the physical structure and thermodynamic characteristics of tropical cyclones, which are important for improving rainfall estimation and the representation of tropical cyclones in numerical models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2021

DETECTING FIRE WITH MACHINE LEARNING-ENABLED VISUAL MONITORING FOR NUCLEAR POWER PLANT ENVIRONMENTS

Nuclear power plants are experiencing significant cost challenges to remain competitive with other energy-generation utilities. Unlike other industries, the cost of operation and maintenance activities is mostly attributed to workforce costs. To mitigate this, nuclear power plant stakeholders are increasingly interested in the development and deployment of machine learning methods to potentially automate or augment manually intensive tasks to reduce costs, especially for monitoring activities. One monitoring function that is visually demanding and that can occur frequently to meet the requirements of a fire protection program is visually monitoring an area for fire occurrence. Currently, fire watch activities consist of a worker physically stationed at a given location with the sole responsibility of observing a given area to ensure a fire is detected and mitigated promptly. This effort focused on the development and evaluation of a suitable deep convolutional neural network to classify individual video frames at a sub-second frequency for the occurrence of “fire” and “no fire” in varying industrial environments similar to nuclear power plants. It is believed that a trained neural network model could be integrated with existing facility video surveillance camera feeds to generate alerts when fire inferences occur in individual frames captured at sub-second temporal resolutions. Extensive effort was dedicated to identifying and curating suitable imagery training data representing varying environments and scene settings with and without flame features to maximize generalization in nuclear power plant environments. The data collection effort resulted in the aggregation of a large, labeled image library exceeding 12,000 images to support model training for diverse industrial environments. A deep neural network model incorporating parallel multi-scale capabilities was developed and trained to support accurate image-based detection of flame incidents of varying sizes and spectral feature properties within heterogeneous scenes. Analysis results show that the trained model can achieve high inference accuracy despite heterogeneous scene environments and components. Testing accuracy exceeded 95.0 percent with very low false positive and false negative inferences.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2016

Self-assembly of pi-conjugated peptides in aqueous environments leading to energy-transporting bioelectronic nanostructures

The realization of new supramolecular pi-conjugated organic structures inspired and driven by peptide-based self-assembly will offer a new approach to interface with the biotic environment in a way that will help to meet many DOE-recognized grand challenges. Previously, we developed pi-conjugated peptides that undergo supramolecular self-assembly into one-dimensional (1-D) organic electronic nanomaterials under benign aqueous conditions. The intermolecular interactions among the pi-conjugated organic segments within these nanomaterials lead to defined perturbations of their optoelectronic properties and yield nanoscale conduits that support energy transport within individual nanostructures and throughout bulk macroscopic collections of nanomaterials. Our objectives for future research are to construct and study biomimetic electronic materials for energy-related technology optimized for harsher non-biological environments where peptide-driven self-assembly enhances pi-stacking within nanostructured biomaterials, as detailed in the following specific tasks: (1) synthesis and detailed optoelectronic characterization of new pi-electron units to embed within homogeneous self assembling peptides, (2) molecular and data-driven modeling of the nanomaterial aggregates and their higher-order assemblies, and (3) development of new hierarchical assembly paradigms to organize multiple electronic subunits within the nanomaterials leading to heterogeneous electronic properties (i.e. gradients and localized electric fields). These intertwined research tasks will lead to the continued development and fundamental mechanistic understanding of a powerful bioinspired materials set capable of making connections between nanoscale electronic materials and macroscopic bulk interfaces, be they those of a cell, a protein or a device.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Hourly Electricity Demand Profiles for Each County in the Contiguous United States

This dataset provides estimated hourly electricity demand for each county in the contiguous United States from 2016-2023. The demand profiles represent the sum of two components: (1) Weighted averages of reported hourly demand profiles for North American Electric Reliability Corporation balancing authority (BA) regions and subregions, scaled to match annual estimates of county-level retail sales and direct use of electricity and weighted by the estimated percentage of county load served by each BA region or subregion. (2) Weighted averages of modeled hourly, county- and sector-level distributed photovoltaic (DPV) capacity factor profiles, scaled to match annual estimates of on-site consumption of DPV-generated electricity for each county and weighted by the percentage of consumption attributable to each sector Annual county-level retail sales are estimated by aggregating utility-reported sales to the state level and allocating the results to counties according to each county's share of state population. Annual county-level direct use is calculated by aggregating power plant-reported direct use values. Annual county-level on-site consumption of DPV-generated electricity is estimated by aggregating utility-reported net metering data to determine the amount of DPV-generated electricity sold back to the grid for each state, subtracting those values from modeled state-level DPV generation estimates, and allocating the results to counties according to each county's share of statewide modeled DPV generation. The open-source Python code used to develop this dataset is available at "Historical Load Data Repository" link below.

14 SOLAR ENERGY↗

DOE OSTI2024

Verbal Learning and Memory Deficits across Neurological and Neuropsychiatric Disorders: Insights from an ENIGMA Mega Analysis

Deficits in memory performance have been linked to a wide range of neurological and neuropsychiatric conditions. While many studies have assessed the memory impacts of individual conditions, this study considers a broader perspective by evaluating how memory recall is differentially associated with nine common neuropsychiatric conditions using data drawn from 55 international studies, aggregating 15,883 unique participants aged 15–90. The effects of dementia, mild cognitive impairment, Parkinson’s disease, traumatic brain injury, stroke, depression, attention-deficit/hyperactivity disorder (ADHD), schizophrenia, and bipolar disorder on immediate, short-, and long-delay verbal learning and memory (VLM) scores were estimated relative to matched healthy individuals. Random forest models identified age, years of education, and site as important VLM covariates. A Bayesian harmonization approach was used to isolate and remove site effects. Regression estimated the adjusted association of each clinical group with VLM scores. Memory deficits were strongly associated with dementia and schizophrenia (p < 0.001), while neither depression nor ADHD showed consistent associations with VLM scores (p > 0.05). Differences associated with clinical conditions were larger for longer delayed recall duration items. By comparing VLM across clinical conditions, this study provides a foundation for enhanced diagnostic precision and offers new insights into disease management of comorbid disorders.

Neurosciences & Neurology↗

DOE OSTI2021

Federated Quantum Machine Learning

Distributed training across several quantum computers could significantly improve the training time and if we could share the learned model, not the data, it could potentially improve the data privacy as the training would happen where the data is located. One of the potential schemes to achieve this property is the federated learning (FL), which consists of several clients or local nodes learning on their own data and a central node to aggregate the models collected from those local nodes. However, to the best of our knowledge, no work has been done in quantum machine learning (QML) in federation setting yet. In this work, we present the federated training on hybrid quantum-classical machine learning models although our framework could be generalized to pure quantum machine learning model. Specifically, we consider the quantum neural network (QNN) coupled with classical pre-trained convolutional model. Our distributed federated learning scheme demonstrated almost the same level of trained model accuracies and yet significantly faster distributed training. It demonstrates a promising future research direction for scaling and privacy aspects.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2016

Evidence for the direct detection of the thermal spectrum of the non-transiting hot gas giant HD 88133 B

We target the thermal emission spectrum of the non-transiting gas giant HD 88133 b with high-resolution near-infrared spectroscopy, by treating the planet and its host star as a spectroscopic binary. For sufficiently deep summed flux observations of the star and planet across multiple epochs, it is possible to resolve the signal of the hot gas giant’s atmosphere compared to the brighter stellar spectrum, at a level consistent with the aggregate shot noise of the full data set. To do this, we first perform a principal component analysis to remove the contribution of the Earth’s atmosphere to the observed spectra. Then, we use a cross-correlation analysis to tease out the spectra of the host star and HD 88133 b to determine its orbit and identify key sources of atmospheric opacity. In total, six epochs of Keck NIRSPEC L-band observations and three epochs of Keck NIRSPEC K-band observations of the HD 88133 system were obtained. Based on an analysis of the maximum likelihood curves calculated from the multi-epoch cross-correlation of the full data set with two atmospheric models, we report the direct detection of the emission spectrum of the non-transiting exoplanet HD 88133 b and measure a radial projection of the Keplerian orbital velocity of 40 ± 15 km s{sup −1}, a true mass of 1.02{sub −0.28}{sup +0.61}M{sub J}, a nearly face-on orbital inclination of 15{sub −5}{sup +6{sup ∘}}, and an atmosphere opacity structure at high dispersion dominated by water vapor. This, combined with 11 years of radial velocity measurements of the system, provides the most up-to-date ephemeris for HD 88133.

79 ASTRONOMY AND ASTROPHYSICS↗