Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data aggregation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,513 records · Page 84

Estimating irrigation water use from remotely sensed evapotranspiration data: Accuracy and uncertainties at field, water right, and regional scales

Irrigated agriculture is the dominant user of water globally, but most water withdrawals are not monitored or reported. As a result, it is largely unknown when, where, and how much water is used for irrigation. Here, we evaluated the ability of remotely sensed evapotranspiration (ET) data, integrated with other datasets, to calculate irrigation water withdrawals and applications in an intensively irrigated portion of the United States. We compared irrigation calculations based on an ensemble of satellite-driven ET models from OpenET with reported groundwater withdrawals from hundreds of farmer irrigation application records and a statewide flowmeter database at three spatial scales (field, water right group, and management area). At the field scale, we found that ET-based calculations of irrigation agreed best with reported irrigation when the OpenET ensemble mean was aggregated to the growing season timescale (bias = 1.6–4.9%, R 2 = 0.53–0.74), and agreement between calculated and reported irrigation was better for multi-year averages than for individual years. At the water right group scale, linking pumping wells to specific irrigated fields was the primary source of uncertainty. At the management area scale, calculated irrigation exhibited similar temporal patterns as flowmeter data but tended to be positively biased with more interannual variability. Disagreement between calculated and reported irrigation was strongly correlated with annual precipitation, and calculated and reported irrigation agreed more closely after statistically adjusting for annual precipitation. The selection of an ET model was also an important consideration, as variability across ET models was larger than the potential impacts of conservation measures employed in the region. From these results, we suggest key practices for working with ET-based irrigation data that include accurately accounting for changes in soil moisture, deep percolation, and runoff; careful verification of irrigated area and well-field linkages; and conducting application-specific evaluations of uncertainty.

59 BASIC BIOLOGICAL SCIENCES↗

Assessment of the importance of spatial scale in long-term land use modelling of the Midwestern United States

The purpose of this study is to assess the value of enhanced spatial resolution in the agriculture and land use component of an integrated assessment model. While these models have historically represented land use decisions at the scale of geopolitical regions, the present generation uses regions defined by climatic or environmental characteristics, to better represent the spatial heterogeneity of land productivity and potential uses. However, increasing a model’s spatial resolution incurs costs, including input data processing, structural modifications, increased run time, and increased complexity of results. This study uses the Global Change Assessment Model (GCAM) to analyze land use in the Midwestern United States in three levels of sub-regional aggregation and three scenarios of future climate mitigation. We demonstrate benefits of enhanced spatial resolution, and to facilitate the assessment of higher resolution model output we apply non-metric multidimensional scaling on a pair-wise distance matrix for visualization and analysis.

54 ENVIRONMENTAL SCIENCES↗

Stochastic Simulation of Isotopic Exchange Mechanisms for Fe(II)-Catalyzed Recrystallization of Goethite

Understanding Fe(II)-catalyzed transformations of Fe(III)- (oxyhydr)oxides is critical for correctly interpreting stable isotopic distributions and for predicting the fate of metal ions in the environment. Recent Fe isotopic tracer experiments have shown that goethite undergoes rapid recrystallization without phase change when exposed to aqueous Fe(II). The proposed explanation is oxidation of sorbed Fe(II) and reductive Fe(II) release coupled 1:1 by electron conduction through crystallites. Given the availability of two tracer exchange data sets that explore pH and particle size effects (e.g., Handler et al. Environ. Sci. Technol. 2014, 48, 11302-11311; Joshi and Gorski Environ. Sci. Technol. 2016, 50, 7315-7324), we developed a stochastic simulation that exactly mimics these experiments, while imposing the 1:1 constraint. We find that all data can be represented by this model, and unifying mechanistic information emerges. At pH 7.5 a rapid initial exchange is followed by slower exchange, consistent with mixed surface- and diffusion-limited kinetics arising from prominent particle aggregation. At pH 5.0 where aggregation and net Fe(II) sorption are minimal, that exchange is quantitatively proportional to available particle surface area and the density of sorbed Fe(II) is more readily evident. Our analysis reveals a fundamental atom exchange rate of ~10-5 Fe nm-2 s-1, commensurate with some of the reported reductive dissolution rates of goethite, suggesting Fe(II) release is the rate-limiting step in the conduction mechanism during recrystallization.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Cluster dynamics models of irradiation damage accumulation in ferritic iron. I. Trap mediated interstitial cluster diffusion

The microstructure that develops under low temperature irradiation in ferritic alloys is dominated by a high density of small (2–5 nm) defects. These defects have been widely observed to move via occasional discrete hops during in situ thin film irradiation experiments. Cluster dynamics models are used to describe the formation of these defects as an aggregation process of smaller clusters created as primary damage. Multiple assumptions regarding the mobility of these damage features are tested in the models, both with and without explicit consideration of such irradiation induced hops. Comparison with experimental data regarding the density of these defects demonstrates the importance of including such motions in a valid model. In particular, discrete hops inform the limited dependence of defect density on irradiation temperature observed in experiments, which the model was otherwise incapable of producing.

36 MATERIALS SCIENCE↗

Size distribution of possible dust carriers for the extended red emission

Power-law size distributions expected to be applicable to possible carriers of extended red emission (ERE) have been examined using Monte Carlo (MC) simulations. Si nanoparticles and some polycyclic aromatic hydrocarbon complexes such as oligoacene and oligorylenes with energy gaps close to 2 eV have been considered. In the simplest case of unit quantum efficiency, the MC-generated size distributions are used to obtain photoluminescence (PL) spectra that are then corrected for dust extinction and reddening effects for comparison with observed ERE spectra. It is shown that a power-law size distribution with a decay exponent of α = 7/2, which closely agrees with starlight extinction data, fails to produce an ERE-like spectrum. However, size distributions with decay exponents of α = 19/12 and 3/2 are found to lead to acceptable spectra. Results indicate that energetic photon-induced breakup and competing aggregation effects dominate collisional effects in producing the observed steady-state mass distribution. It is shown that the peak wavelength of emission critically depends on the band gap, rather than cluster mass, which for oligoacenes and oligorylenes is widely different. The peak wavelength is also shown to be insensitive to dust attenuation.

79 ASTRONOMY AND ASTROPHYSICS↗

Behind-the-Meter Solar Generation Disaggregation using Consumer Mixture Models

To facilitate deep penetration of solar energy in smart grids, we need high observability of solar generation at the edges of the grid. Current advanced metering infrastructures (AMI) only monitor the aggregated measurements from net-metered households, but disaggregated consumption and solar generation components are required for grid optimizations. We propose an unsupervised disaggregation model for disaggregating solar generation from AMI measurements without the need of training data. The model requires only AMI measurements from consumers in a region and the solar irradiance as input, and models the consumption of consumers by neighboring households without rooftop photovoltaics (PV) to perform the disaggregation. We evaluate our results on a real life dataset from Austin, Texas. We show that our model is able to disaggregate consumption and solar generation measurements with 42.24% and 31.67% less mean squared error, respectively, in comparison to a baseline technique that uses supervised learning. This shows that our model is capable of disaggregating historical data even if the dataset has no training data and only contains minimal exogenous data.

14 SOLAR ENERGY↗

RAVIS: Resource Forecast and Ramp Visualization for Situational Awareness - An Introduction to the Open-Source Tool and Use Cases

The Resource Forecast and Ramp Visualization for Situational Awareness (RAVIS) is an open-source tool for visualizing variable renewable resource forecasts and ramp alerts for significant up/down ramps in renewable resource and the consequent net-load. The modular dashboard of RAVIS contains configurable panes for viewing- probabilistic time series forecasts, ramp event alerts on the look-ahead timeline, spatially resolved resource sites and forecasts, and system simulation and market clearing data such as transmission lines utilization, nodal prices and available generation flexibility. RAVIS uses a technology suite that is assembled to provide optimum visualization facility while maintaining a wide pool of potential deployment and client environments. The tool is designed to take advantage of web application technologies, open source visualization libraries and tooling. Utilizing this technology will enable deployment in any environment, using any operating system, and is scalable to much higher spatial and temporal scales of visualization. As a prototype of the tool and demonstrating a use case of variable renewable integration, RAVIS currently integrates site-specific solar power forecasts in the California Independent System Operator (CAISO) and Mid-continent ISO (MISO) footprint from the IBM WattSun forecasting platform, and also superimposes market simulation data for CAISO footprint from as in-house NREL market clearing tool. The tool has the ability to alert the viewer for excessive up or down ramps for both individual solar sites as well as regionally aggregated net-load ramps, and alerts can also be qualified with respect to available flexible generation. This report will provide an introduction to the RAVIS tool, and summarize the above mentioned capabilities, typical use cases and possible extensions of the tool. The RAVIS development team believes there are likely to be high economic and reliability benefits of integrating probabilistic forecasts of variable renewables into control center visualizations and improved ramp events situational awareness for system operators and forecasting teams in the ISOs and electric utilities in comparison with their business as usual practices.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Analytics for Investigation of Disease Outbreaks (AIDO)

Objective: Analytics for the Investigation of Disease Outbreaks (AIDO) is a web-based tool designed to enhance a user’s understanding of unfolding infectious disease events. A representative library of over 650 outbreaks across a wide selection of diseases allows similar outbreaks to be matched to the conditions entered by the user. These historic outbreaks contain detailed information on how the disease progressed as well as what measures were implemented to control its spread, allowing for a better understanding within the context of other outbreaks.Introduction: Situational awareness, or the understanding of elemental components of an event with respect to both time and space, is critical for public health decision-makers during an infectious disease outbreak. AIDO is a web-based tool designed to contextualize incoming infectious disease information during an unfolding event for decision-making purposes.Methods: Public health analysts of the Biology Division at Los Alamos National Laboratory curated a diverse library of historic disease outbreaks from publicly available official reports and peer reviewed literature to serve as a representation of the range of potential outbreak scenarios for a given disease. Available outbreak metadata are used to identify properties that relate to the magnitude and/or duration of the outbreak. Properties vary by disease, as they are related to disease-specific characteristics like transmission, disease manifestation, risk factors related to disease severity, and environmental factors specific to the given location. These properties are then incorporated into a similarity algorithm (s in Figure 1) to identify outbreaks that are similar to user inputs.Results: AIDO currently includes libraries for 39 diseases that are diverse across pathogen type (viral, bacterial and parasitic) as well as transmission type (vectorborne (e.g., Dengue, Malaria), foodborne (e.g., Salmonella, Campylobacteriosis), waterborne (e.g., Cholera), and person-to-person transmitted (e.g., Measles)). In addition to providing a similarity score to the user’s outbreak, we provide aggregated comparisons to multiple historical outbreaks, descriptive statistics to show the distribution of property values for each disease, and extensive contextual information about each outbreak.Conclusions: The analytics provided by AIDO allow users to interact with a unique data set of historic outbreaks and the associated metadata to contextualize incoming information and generate hypotheses about appropriate decisions. The tool is continually updated with new functionalities and additional data.

Daughton, Ashlynn↗

A Photographic Study of Freezing of Water Droplets Falling Freely in Air

A photographic technique for investigating water droplets of diameter less than 200 microns falling freely in air at temperatures between 0 C and -50 C has been devised and used to determine: (i) The shape of frozen droplets (2) The occurrence of collisions of partly frozen or of frozen and liquid droplets (3) The statistics on the freezing temperatures of individual free-falling droplets A considerable number of droplets were found to have a nonspherical shape after freezing because of various protuberances and frost growth, and droplet aggregates formed by collision. The observed frequency of collision of partly frozen droplets showed good order of magnitude agreement with the frequency computed from theoretical collection efficiencies. The freezing temperature statistics indicated a general similarity of the data to those obtained for droplets frozen on a metallic surface in previous experiments.

Dorsch, Robert G.↗

Field Trial of a Low-Cost, Distributed Plug Load Monitoring System

Researchers have struggled to inventory and characterize the energy use profiles of the ever-growing category of so-called miscellaneous electric loads (MELs) because plug-load monitoring is cost-prohibitive to the researcher and intrusive to the homeowner. However, these data represent a crucial missing link to our understanding of how homes use energy, and we cannot control what we do not understand. Detailed energy use profiles would enable the nascent automated home energy management (AHEM) industry to develop effective control algorithms that target consumer electronics and other plug loads. If utility and other efficiency programs are to incent AHEM devices, they need large-scale datasets that provide statistically meaningful justification of their investments by quantifying the aggregate energy savings achievable. To address this need, we have investigated a variety of plug-load measuring devices available commercially and tested them in the laboratory to identify the most promising candidates for field applications. The scope of this report centers around the lessons learned from a field validation of one proof-of-concept system, called Smartenit (formerly SimpleHomeNet). The system was evaluated based on the rate of successful data queries, reliability over a period of days to weeks, and accuracy. This system offers good overall performance when deployed with up to ten end nodes in a residential environment, although deployment with more nodes and in a commercial environment is much less robust. We conclude that the current system is useful in selected field research projects, with the recommendation that system behavior is observed over time.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Minimizing development costs for efficient many-core visualization using MCD3

Scientific visualization software increasingly needs to support many-core architectures. However, development time is a significant challenge due to the breadth and diversity of both visualization algorithms and architectures. With this work, we introduce a development environment for visualization algorithms on many-core devices that extends the traditional data-parallel primitive (DPP) approach with several existing constructs and an important new construct: meta-DPPs. We refer to our approach as MCD 3 — Meta-DPPs, Convenience routines, Data management, DPPs, and Devices. The twin goals of MCD 3 are to reduce developer time and to deliver efficient performance on many-core architectures, and our evaluation considers both of these goals. For development time, we study 57 algorithms implemented in the VTK-m software library and determine that MCD 3 leads to significant savings. For efficient performance, we survey ten studies looking at individual algorithms and determine that the MCD 3 hardware-agnostic approach leads to performance comparable to hardware-specific approaches: sometimes better, sometimes worse, and better in the aggregate. In total, we find that MCD 3 is an effective approach for scientific visualization libraries to support many-core architectures.

97 MATHEMATICS AND COMPUTING↗

Grandmaster: Interactive text-based analytics of social media

People use social media resources like Twitter, Facebook, forums etc. to share and discuss various activities or topics. By aggregating topic trends across many individuals using these services, we seek to construct a richer profile of a person’s activities and interests as well as provide a broader context of those activities. This profile may then be used in a variety of ways to understand groups as a collection of interests and affinities and an individual’s participation in those groups. Our approach considers that much of these data will be unstructured, free-form text. By analyzing free-form text directly, we may be able to gain an implicit grouping of individuals with shared interests based on shared conversation, and not on explicit social software linking them. In this paper, we discuss a proof-of-concept application called Grandmaster built to pull short sections of text, a person’s comments or Twitter posts, together by analysis and visualization to allow a gestalt understanding of the full collection of all individuals: how groups are similar and how they differ, based on their text inputs.

97 MATHEMATICS AND COMPUTING↗

Spectrally Consistent Scattering, Absorption, and Polarization Properties of Atmospheric Ice Crystals at Wavelengths from 0.2 to 100 um

A data library is developed containing the scattering, absorption, and polarization properties of ice particles in the spectral range from 0.2 to 100 microns. The properties are computed based on a combination of the Amsterdam discrete dipole approximation (ADDA), the T-matrix method, and the improved geometric optics method (IGOM). The electromagnetic edge effect is incorporated into the extinction and absorption efficiencies computed from the IGOM. A full set of single-scattering properties is provided by considering three-dimensional random orientations for 11 ice crystal habits: droxtals, prolate spheroids, oblate spheroids, solid and hollow columns, compact aggregates composed of eight solid columns, hexagonal plates, small spatial aggregates composed of 5 plates, large spatial aggregates composed of 10 plates, and solid and hollow bullet rosettes. The maximum dimension of each habit ranges from 2 to 10,000 microns in 189 discrete sizes. For each ice crystal habit, three surface roughness conditions (i.e., smooth, moderately roughened, and severely roughened) are considered to account for the surface texture of large particles in the IGOM applicable domain. The data library contains the extinction efficiency, single-scattering albedo, asymmetry parameter, six independent nonzero elements of the phase matrix (P11, P12, P22, P33, P43, and P44), particle projected area, and particle volume to provide the basic single-scattering properties for remote sensing applications and radiative transfer simulations involving ice clouds. Furthermore, a comparison of satellite observations and theoretical simulations for the polarization characteristics of ice clouds demonstrates that ice cloud optical models assuming severely roughened ice crystals significantly outperform their counterparts assuming smooth ice crystals.

Optical properties↗

Zero to Integration in Eight Months, the Dawn Ground Data System Engineering Challenge

The Dawn Project has presented the Ground Data System (GDS) with technical challenges driven by cost and schedule constraints commonly associated with National Aeronautics and Space Administration (NASA) Discovery Projects. The Dawn mission consists of a new and exciting Deep Space partnership among: the Jet Propulsion Laboratory (JPL), manages the project and is responsible for flight operation; Orbital Sciences Corporation (OSC), is the spacecraft builder and is responsible for flight system test and integration; and the University of California, at Los Angeles (UCLA), is responsible for science planning and operations. As a cost-capped mission, one of Dawn's implementation strategies is to leverage from both flight and ground heritage. OSC's ground data system is used for flight system test and integration as part of the flight heritage strategy. Mission operations, however, are to be conducted with JPL's ground system. The system engineering challenge of dealing with two heterogeneous ground systems emerged immediately. During the first technical interchange meeting between the JPL's GDS Team and OSC's Flight Software Team, August 2003, the need to integrate the ground system with the flight software was brought to the table. This need was driven by the project's commitment to enable instrument engineering model integration in a spacecraft simulator environment, for both demonstration and risk mitigation purposes, by April 2004. This paper will describe the system engineering approach that was undertaken by JPL's GDS Team in order to meet the technical challenge within a non-negotiable eight-month schedule. Key to the success was adherence to fundamental systems engineering practices: decomposition of the project request into manageable requirements; integration of multiple ground disciplines and experts into a focused team effort; definition of a structured yet flexible development process; definition of an in-process risk reduction plan; and aggregation of the intermediate products to an integrated final product. In addition, this paper will highlight the role of lessons learned from the integration experience. The lessons learned from an early GDS deployment have served as the foundation for the design and implementation of the Dawn Ground Data System.

Ground Data System (GDS)↗

Zero to Integration in Eight Months, the Dawn Ground Data System Engineering Challange

The Dawn Project has presented the Ground Data System (GDS) with technical challenges driven by cost and schedule constraints commonly associated with National Aeronautics and Space Administration (NASA) Discovery Projects. The Dawn mission consists of a new and exciting Deep Space partnership among: the Jet Propulsion Laboratory (JPL), responsible for project management and flight operations; Orbital Sciences Corporation (OSC), spacecraft builder and responsible for flight system test and integration; and the University of California, at Los Angeles (UCLA), responsible for science planning and operations. As a cost-capped mission, one of Dawn s implementation strategies is to leverage from both flight and ground heritage. OSC's ground data system is used for flight system test and integration as part of the flight heritage strategy. Mission operations, however, are to be conducted with JPL s ground system. The system engineering challenge of dealing with two heterogeneous ground systems emerged immediately. During the first technical interchange meeting between the JPL s GDS Team and OSC's Flight Software Team, August 2003, the need to integrate the ground system with the flight software was brought to the table. This need was driven by the project s commitment to enable instrument engineering model integration in a spacecraft simulator environment, for both demonstration and risk mitigation purposes, by April 2004. This paper will describe the system engineering approach that was undertaken by JPL's GDS Team in order to meet the technical challenge within a non-negotiable eight-month schedule. Key to the success was adherence to an overall systems engineering process and fundamental systems engineering practices: decomposition of the project request into manageable requirements; definition of a structured yet flexible development process; integration of multiple ground disciplines and experts into a focused team effort; in-process risk management; and aggregation of the intermediate products to an integrated final product. In addition, this paper will highlight the role of lessons learned from the integration experience. The lessons learned from an early GDS deployment have served as the foundation for the design and implementation of the Dawn Ground Data System.

systems engineering↗

Evaluation of dynamically downscaled extreme temperature using a spatially-aggregated generalized extreme value (GEV) model

The Weather Research and Forecast (WRF) model downscaling skill in extreme maximum daily temperature is evaluated by using the generalized extreme value (GEV) distribution. While the GEV distribution has been used extensively in climatology and meteorology for estimating probabilities of extreme events, accurately estimating GEV parameters based on data from a single pixel can be difficult, even with fairly long data records. This work proposes a simple method assuming that the shape parameter, the most difficult of the three parameters to estimate, does not vary over a relatively large region. This approach is applied to evaluate 31-year WRF-downscaled extreme maximum temperature through comparison with North American Regional Reanalysis (NARR) data. Uncertainty in GEV parameter estimates and the statistical significance in the differences of estimates between WRF and NARR are accounted for by conducting bootstrap resampling. Despite certain biases over parts of the United States, overall, WRF shows good agreement with NARR in the spatial pattern and magnitudes of GEV parameter estimates. Both WRF and NARR show a significant increase in extreme maximum temperature over the southern Great Plains and southeastern United States in January and over the western United States in July. The GEV model shows clear benefits from the regionally constant shape parameter assumption, for example, leading to estimates of the location and scale parameters of the model that show coherent spatial patterns.

Wang, Jiali↗

Precipitation hydrometeor type relative to the mesoscale airflow in mature oceanic deep convection of the Madden-Julian Oscillation

We present that composite analysis of mature near-equatorial oceanic mesoscale convective systems (MCSs) during the active stage of the Madden-Julian Oscillation (MJO) shows where different hydrometeor types occur relative to convective updraft and stratiform midlevel inflow layers. The National Center for Atmospheric Research (NCAR) S-PolKa radar observed these MCSs during the Dynamics of the Madden-Julian Oscillation/Atmospheric Radiation Measurement-MJO Investigation Experiment (DYNAMO/AMIE). NCAR's particle identification algorithm (PID) is applied to S-PolKa's polarimetric data to identify the dominant hydrometeor type in each radar sample volume. Combining S-PolKa's Doppler velocity data with the PID demonstrates that hydrometeors have a systematic relationship to the airflow within mature MCSs. In the convective region, moderate rain occurs within the updraft core; the heaviest rain occurs just downwind of the core; wet aggregates occur immediately below the melting layer; narrow zones containing graupel/rimed aggregates occur just downstream of the updraft core at midlevels; dry aggregates dominate above the melting level; and smaller ice particles occur along the edges of the convective zone. In the stratiform region, rain intensity decreases toward the anvil; melting aggregates occur in horizontally extensive but vertically thin regions at the melting layer; intermittent pockets of graupel/rimed aggregates occur atop the melting layer; dry aggregates and small ice particles occur sequentially above the melting level; and horizontally oriented ice crystals occur between -10°C and -20°C in turbulent air above the descending midlevel inflow, suggesting enhanced depositional growth of dendrites. Finally, the organization of hydrometeors within the midlevel inflow layer is insensitive to the presence or absence of a leading convective line.

58 GEOSCIENCES↗

ARC algorithm: A novel approach to forecast and manage daily electrical maximum demand

This paper proposes an innovative algorithm for predicting short-term electrical maximum demand by using historical demand data. The ability to recognize in peak demand pattern for commercial or industrial customers would propose numerous direct and indirect benefits to the customers and utility providers in terms of demand reduction, cost control, and system stability. Prior works in electrical maximum demand forecasting have been mainly focused on seasonal effects, which is not a feasible approach for industrial manufacturing facilities in short-term load forecasting. The proposed algorithm, denoted as the Adaptive Rate of Change (ARC), determines the logarithmic rate-of-change in load profile prior to a peak by postulating the demand curve as a stochastic, mean-reverting process. The rationale behind this analysis, is that the energy efficient program requires not only demand estimation but also to warn the user of imminent maximum peak occurrence. This paper analyzes demand trend data and incorporates stochastic model and mean reverting half-life to develop an electrical maximum demand forecasting algorithm, which is statistically evaluated by cross-table and F-score for three different manufacturing facilities. Lastly, the aggregate results show an overall accuracy of 0.91 and a F-score of 0.43, which indicates that the algorithm is effective predicting peak demand in predicting peak demand.

24 POWER TRANSMISSION AND DISTRIBUTION↗