Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data sets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59

Adding Data Management Services to Parallel File Systems

The objective of this project, called DAMASC for “Data Management in Scientific Computing”, is to coalesce data management with parallel file system management to present a declarative interface to scientists for managing, querying, and analyzing extremely large data sets efficiently and predictably. Managing extremely large data sets is a key challenge of exascale computing. The overhead, energy, and cost of moving massive volumes of data demand designs where computation is close to storage. In current architectures, compute/analysis clusters access data in a physically separate parallel file system and largely leave it scientist to reduce data movement. Over the past decades the high-end computing community has adopted middleware with multiple layers of abstractions and specialized file formats such as NetCDF-4 and HDF5. These abstractions provide a limited set of high-level data processing functions, but have inherent functionality and performance limitations: middleware that provides access to the highly structured contents of scientific data files stored in the (unstructured) file systems can only optimize to the extent that file system interfaces permit; the highly structured formats of these files often impedes native file system performance optimizations. We are developing Damasc, an enhanced high-performance file system with native rich data management services. Damasc will enable efficient queries and updates over files stored in their native byte-stream format while retaining the inherent performance of file system data storage via declarative queries and updates over views of underlying files. Damasc has four key benefits for the development of data-intensive scientific code: (1) applications can use important data-management services, such as declarative queries, views, and provenance tracking, that are currently available only within database systems; (2) the use of these services becomes easier, as they are provided within a familiar file-based ecosystem; (3) common optimizations, e.g., indexing and caching, are readily supported across several file formats, avoiding effort duplication; and (4) performance improves significantly, as data processing is integrated more tightly with data storage. Our key contributions are: SciHadoop which explores changes to MapReduce assumption by taking advantage of semantics of structured data while preserving MapReduce’s failure and resource management; DataMods which extends common abstractions of parallel file systems so they become programmable such that they can be extended to natively support a variety of data models and can be hooked into emerging distributed runtimes such as Stanford’s Legion; and Miso which combines Hadoop and relational data warehousing to minimize time to insight, taking into account the overhead of ingesting data into data warehousing.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Importance of Engineered and Learned Molecular Representations in Predicting Organic Reactivity, Selectivity, and Chemical Properties

Machine-readable chemical structure representations are foundational in all attempts to harness machine learning for the prediction of reactivities, selectivities, and chemical properties directly from molecular structure. The featurization of discrete chemical structures into a continuous vector space is a critical phase undertaken before model selection, and the development of new ways to quantitatively encode molecules is an active area of research. Here, we highlight the application and suitability of different representations, from expert-guided “engineered” descriptors to automatically “learned” features, in different prediction tasks relevant to organic and organometallic chemistry, where differing amounts of training data are available. These tasks include statistical models of stereo- and enantioselectivity, thermochemistry, and kinetics developed using experimental and quantum chemical data. The use of expert-guided molecular descriptors provides an opportunity to incorporate chemical knowledge, domain expertise, and physical constraints into statistical modeling. In applications to stereoselective organic and organometallic catalysis, where data sets may be relatively small and 3D-geometries and conformations play an important role, mechanistically informed features can be used successfully to obtain predictive statistical models that are also chemically interpretable. We provide an overview of several recent applications of this approach to obtain quantitative models for reactivity and selectivity, where topological descriptors, quantum mechanical calculations of electronic and steric properties, along with conformational ensembles, all feature as essential ingredients of the molecular representations used. Alternatively, more flexible, general-purpose molecular representations such as attributed molecular graphs can be used with machine learning approaches to learn the complex relationship between a structure and prediction target. This approach has the potential to out-perform more traditional representation methods such as “hand-crafted” molecular descriptors, particularly as data set sizes grow. One area where this is particularly relevant is in the use of large sets of quantum mechanical data to train quantitative structure–property relationships. A general approach toward curating useful data sets and training highly accurate graph neural network models is discussed in the context of organic bond dissociation enthalpies, where this strategy outperforms regression using precomputed descriptors. Finally, we describe how graph neural network predictions can be incorporated into mechanistically informed statistical models of chemical reactivity and selectivity. Once trained, this approach avoids the expensive computational overhead associated with quantum mechanical calculations, while maintaining chemical interpretability. We illustrate examples for which fast predictions of bond dissociation enthalpy and of the identities of radicals formed through cleavage of a molecule’s weakest bond are used in simple physical models of site-selectivity and reactivity.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Cosmic shear as a probe of galaxy formation physics

Here, we evaluate the potential for current and future cosmic shear measurements from large galaxy surveys to constrain the impact of baryonic physics on the matter power spectrum. We do so using a model-independent parametrization that describes deviations of the matter power spectrum from the dark-matter-only case as a set of principal components that are localized in wavenumber and redshift. We perform forecasts for a variety of current and future data sets, and find that at least ~90 per cent of the constraining power of these data sets is contained in no more than nine principal components. The constraining power of different surveys can be quantified using a figure of merit defined relative to currently available surveys. With this metric, we find that the final Dark Energy Survey data set (DES Y5) and the Hyper Suprime-Cam Survey will be roughly an order of magnitude more powerful than existing data in constraining baryonic effects. Upcoming Stage IV surveys (Large Synoptic Survey Telescope, Euclid , and Wide Field Infrared Survey Telescope ) will improve upon this by a further factor of a few. We show that this conclusion is robust to marginalization over several key systematics. The ultimate power of cosmic shear to constrain galaxy formation is dependent on understanding systematics in the shear measurements at small (sub-arcminute) scales. Lastly, if these systematics can be sufficiently controlled, cosmic shear measurements from DES Y5 and other future surveys have the potential to provide a very clean probe of galaxy formation and to strongly constrain a wide range of predictions from modern hydrodynamical simulations.

79 ASTRONOMY AND ASTROPHYSICS↗

Data Preservation in High Energy Physics

Data from high-energy physics (HEP) experiments are collected with significant financial and human effort and are mostly unique. At the same time, HEP has no coherent strategy for data preservation and re-use. An inter-experimental Study Group on HEP data preservation and long-term analysis was convened at the end of 2008 and held two workshops, at DESY (January 2009) and SLAC (May 2009). This document is an intermediate report to the International Committee for Future Accelerators (ICFA) of the reflections of this Study Group. Large data sets accumulated during many years of detector operation at particle accelerators are the heritage of experimental HEP. These data sets offer unique opportunities for future scientific studies, sometimes long after the shut-down of the actual experiments: new theoretical input; new experimental results and analysis techniques; the quest for high-sensitivity combined analyses; the necessity of cross checks. In many cases, HEP data sets are unique; they cannot and most likely will not be superseded by data from newer generations of experiments. Once lost, or in an unusable state, HEP data samples cannot be reasonably recovered. The cost of conserving this heritage through a collaborative, target-oriented long-term data preservation program would be small, compared to the costs of past experimental projects or to the efforts to re-do experiments. However, this cost is not negligible, especially for collaborations close or past their end-date. The preservation of HEP data would provide today's collaborations with a secure way to complete their data analysis and enable them to seize new scientific opportunities in the coming years. The HEP community will benefit from preserved data samples through reanalysis, combination, education and outreach. Funding agencies would receive more scientific return, and a positive image, from their initial investment leading to the production and the first analysis of preserved data.

43 PARTICLE ACCELERATORS↗

Getting the astrophysics and particle physics of dark matter out of next-generation direct detection experiments

The next decade will bring massive new data sets from experiments of the direct detection of weakly interacting massive particle dark matter. Mapping the data sets to the particle-physics properties of dark matter is complicated not only by the considerable uncertainties in the dark-matter model, but by its poorly constrained local distribution function (the 'astrophysics' of dark matter). I propose a shift in how to think about direct-detection data analysis. I show that by treating the astrophysical and particle-physics uncertainties of dark matter on equal footing, and by incorporating a combination of data sets into the analysis, one may recover both the particle physics and astrophysics of dark matter. Not only does such an approach yield more accurate estimates of dark-matter properties, but it may illuminate how dark matter coevolves with galaxies.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Data graphing methods, articles of manufacture, and computing devices

Data graphing methods, articles of manufacture, and computing devices are described. In one aspect, a method includes accessing a data set, displaying a graphical representation including data of the data set which is arranged according to a first of different hierarchical levels, wherein the first hierarchical level represents the data at a first of a plurality of different resolutions which respectively correspond to respective ones of the hierarchical levels, selecting a portion of the graphical representation wherein the data of the portion is arranged according to the first hierarchical level at the first resolution, modifying the graphical representation by arranging the data of the portion according to a second of the hierarchal levels at a second of the resolutions, and after the modifying, displaying the graphical representation wherein the data of the portion is arranged according to the second hierarchal level at the second resolution.

97 MATHEMATICS AND COMPUTING↗

TH-CD-207A-11: Sensitivity Analysis of Action Limits for Real-Time EPID-Based Delivery Verification System Using Artificial Clinical Relevant Error Simulations

Purpose: A real-time patient treatment delivery verification system using EPID (Watchdog) has been developed as an advanced patient safety tool. In a pilot study data was acquired for 119 prostate and head and neck (HN) IMRT patient deliveries to generate body-site specific action limits using statistical process control. The purpose of this study is to determine the sensitivity of Watchdog to detect clinically significant errors during treatment delivery. Methods: Watchdog utilizes a physics-based model to generate a series of predicted transit cine EPID images as a reference data set, and compares these in real-time to measured transit cine-EPID images acquired during treatment using chi comparison (4%, 4mm criteria) after the initial 2s of treatment to allow for dose ramp-up. Four study cases were used; dosimetric (monitor unit) errors in prostate (7 fields) and HN (9 fields) IMRT treatments of (5%, 7%, 10%) and positioning (systematic displacement) errors in the same treatments of (5mm, 7mm, 10mm). These errors were introduced by modifying the patient CT scan and re-calculating the predicted EPID data set. The error embedded predicted EPID data sets were compared to the measured EPID data acquired during patient treatment. The treatment delivery percentage (measured from 2s) where Watchdog detected the error was determined. Results: Watchdog detected all simulated errors for all fields during delivery. The dosimetric errors were detected at average treatment delivery percentage of (4%, 0%, 0%) and (7%, 0%, 0%) for prostate and HN respectively. For patient positional errors, the average treatment delivery percentage was (52%, 43%, 25%) and (39%, 16%, 6%). Conclusion: These results suggest that Watchdog can detect significant dosimetric and positioning errors in prostate and HN IMRT treatments in real-time allowing for treatment interruption. Displacements of the patient require longer to detect however incorrect body site or very large geographic misses will be detected rapidly.

60 APPLIED LIFE SCIENCES↗

Hemispheric and large-scale land-surface air temperature variations: An extensive revision and an update to 2010

This study is an extensive revision of the Climatic Research Unit (CRU) land station temperature database that has been used to produce a grid-box data set of 5° latitude × 5° longitude temperature anomalies. The new database (CRUTEM4) comprises 5583 station records of which 4842 have enough data for the 1961–1990 period to calculate or estimate the average temperatures for this period. Many station records have had their data replaced by newly homogenized series that have been produced by a number of studies, particularly from National Meteorological Services (NMSs). Hemispheric temperature averages for land areas developed with the new CRUTEM4 data set differ slightly from their CRUTEM3 equivalent. The inclusion of much additional data from the Arctic (particularly the Russian Arctic) has led to estimates for the Northern Hemisphere (NH) being warmer by about 0.1°C for the years since 2001. The NH/Southern Hemisphere (SH) warms by 1.12°C/0.84°C over the period 1901–2010. The robustness of the hemispheric averages is assessed by producing five different analyses, each including a different subset of 20% of the station time series and by omitting some large countries. CRUTEM4 is also compared with hemispheric averages produced by reanalyses undertaken by the European Centre for Medium-Range Weather Forecasts (ECMWF): ERA-40 (1958–2001) and ERA-Interim (1979–2010) data sets. For the NH, agreement is good back to 1958 and excellent from 1979 at monthly, annual, and decadal time scales. For the SH, agreement is poorer, but if the area is restricted to the SH north of 60°S, the agreement is dramatically improved from the mid-1970s.

54 ENVIRONMENTAL SCIENCES↗

What is the best method to fit time-resolved data? A comparison of the residual minimization and the maximum likelihood techniques as applied to experimental time-correlated, single-photon counting data

The need for measuring fluorescence lifetimes of species in subdiffraction-limited volumes in, for example, stimulated emission depletion (STED) microscopy, entails the dual challenge of probing a small number of fluorophores and fitting the concomitant sparse data set to the appropriate excited-state decay function. This need has stimulated a further investigation into the relative merits of two fitting techniques commonly referred to as “residual minimization” (RM) and “maximum likelihood” (ML). Fluorescence decays of the well-characterized standard, rose bengal in methanol at room temperature (530 ± 10 ps), were acquired in a set of five experiments in which the total number of “photon counts” was approximately 20, 200, 1000, 3000, and 6000 and there were about 2–200 counts at the maxima of the respective decays. Each set of experiments was repeated 50 times to generate the appropriate statistics. Each of the 250 data sets was analyzed by ML and two different RM methods (differing in the weighting of residuals) using in-house routines and compared with a frequently used commercial RM routine. Convolution with a real instrument response function was always included in the fitting. While RM using Pearson’s weighting of residuals can recover the correct mean result with a total number of counts of 1000 or more, ML distinguishes itself by yielding, in all cases, the same mean lifetime within 2% of the accepted value. For 200 total counts and greater, ML always provides a standard deviation of <10% of the mean lifetime, and even at 20 total counts there is only 20% error in the mean lifetime. Here, the robustness of ML advocates its use for sparse data sets such as those acquired in some subdiffraction-limited microscopies, such as STED, and, more importantly, provides greater motivation for exploiting the time-resolved capacities of this technique to acquire and analyze fluorescence lifetime data.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Pangeo-Enabled ESM Pattern Scaling (PEEPS): A customizable dataset of emulated Earth System Model output

Emulation through pattern scaling is a well-established method of rapidly producing climate fields (like temperature or precipitation) from existing Earth System Model (ESM) output that, while inaccurate, is often useful for a variety of downstream purposes. Conducting pattern scaling has historically been a laborious process, in large part due to the increasing volume of ESM output data that has often required downloading and storing locally to train on. Here we describe the Pangeo-Enabled ESM Pattern Scaling (PEEPS) dataset, a repository of trained annual and monthly patterns from CMIP6 outputs. This manuscript describes and validates these updated patterns so that users can save effort calculating and reporting error statistics in manuscripts focused on the use of patterns. The trained patterns are available as NetCDF files on Zenodo for ease of use in the impact community, and are reproducible with the code provided via GitHub in both Jupyter notebook and Python script formats. Because all training data for the PEEPS data set is cloud-based, users do not need to download and house the ESM output data to reproduce the patterns in the zenodo archive, should that be more efficient. Validating the PEEPS data set on the CMIP6 archive for annual and monthly temperature, precipitation, and near-surface relative humidity, pattern scaling performs well over a variety of future scenarios except for regions in which there are strong, potentially nonlinear climate feedbacks. Although pattern scaling is normally conducted on annual mean ESM output data, it works equally well on monthly mean ESM output data. We identify several downstream applications of the PEEPS data set, including impacts assessment and evaluating certain types of Earth system uncertainties.

54 ENVIRONMENTAL SCIENCES↗

A Climate Data Record (CDR) for the global terrestrial water budget: 1984–2010

Closing the terrestrial water budget is necessary to provide consistent estimates of budget components for understanding water resources and changes over time. Given the lack of in situ observations of budget components at anything but local scale, merging information from multiple data sources (e.g., in situ observation, satellite remote sensing, land surface model, and reanalysis) through data assimilation techniques that optimize the estimation of fluxes is a promising approach. Conditioned on the current limited data availability, a systematic method is developed to optimally combine multiple available data sources for precipitation ( P ), evapotranspiration (ET), runoff ( R ), and the total water storage change (TWSC) at 0.5° spatial resolution globally and to obtain water budget closure (i.e., to enforce P -ET- R -TWSC = 0) through a constrained Kalman filter (CKF) data assimilation technique under the assumption that the deviation from the ensemble mean of all data sources for the same budget variable is used as a proxy of the uncertainty in individual water budget variables. The resulting long-term (1984–2010), monthly 0.5° resolution global terrestrial water cycle Climate Data Record (CDR) data set is developed under the auspices of the National Aeronautics and Space Administration (NASA) Earth System Data Records (ESDRs) program. This data set serves to bridge the gap between sparsely gauged regions and the regions with sufficient in situ observations in investigating the temporal and spatial variability in the terrestrial hydrology at multiple scales. The CDR created in this study is validated against in situ measurements like river discharge from the Global Runoff Data Centre (GRDC) and the United States Geological Survey (USGS), and ET from FLUXNET. The data set is shown to be reliable and can serve the scientific community in understanding historical climate variability in water cycle fluxes and stores, benchmarking the current climate, and validating models.

54 ENVIRONMENTAL SCIENCES↗

SU-E-E-05: Improving Contouring Precision and Consistency for Physicians-In-Training with Simple Lab Experiments

Purpose: Target contouring for high-dose treatments such as radiosurgery of brain metastases is highly critical in eliminating marginal failure and reducing complications as shown by recent clinical studies. In order to improve contouring accuracy and practice consistency for the procedure, we introduced a self-assessed physics lab practice for the physicians-in-training. Methods: A set of commercially acquired high-precision PMMA plastic spheres were randomly embedded in a Styrofoam block and then scanned with the CT/MR via the clinical procedural imaging protocol. A group of first-year physicians-in-training (n=6) from either neurosurgery or radiation oncology department were asked to contour the scanned objects (diameter ranged from 0.4 cm to 3.8 cm). These user-defined contours were then compared with the ideal contour sets of object shape for self assessments to determine the maximum areas of the observed discrepancies and method of improvements. Results: The largest discrepancies from initial practice were consistently found to be located near the extreme longitudinal portions of the target for all the residents. Discrepancy was especially prominent when contouring small objects < 1.0 cm in diameters. For example, the mean volumes rendered from the initial contour data set differed from the ideal data set by 7.7%±6.6% for the participants (p> 0.23 suggesting agreement cannot be established). However, when incorporating a secondary imaging scan such as reconstructed coronal or sagittal images in a repeat practice, the agreement was dramatically improved yielding p<0.02 in agreement with the reference data set for all the participants. Conclusion: A simple physics lab revealed a common pitfall in contouring small metastatic brain tumors for radiosurgical procedures and provided a systematic tool for physicians-in-training in improving their clinical contouring skills. Dr Ma is current a board member of international stereotactic radiosurgical society.

60 APPLIED LIFE SCIENCES↗

Sustainable Data Evolution Technology for Power Grid Optimization

The SDET Tool is used to create open-access power grid data sets and facilitate updates of these data sets by the community. Pacific Northwest National Laboratory (PNNL) and its power industry and software vendor partners are developing an innovative sustainable data evolution technology (SDET) to create open-access power grid datasets and facilitate updates to these datasets by the power grid community. The objective is to make this a sustained effort within and beyond the ARPA-E GRID DATA program so that the datasets can evolve over time and meet the current and future needs for power grid optimization and potentially other applications in power grid operation and planning.

Source record↗

Sustainable Data Evolution Technology for Power Grid Optimization

The SDET Tool is used to create open-access power grid data sets and facilitate updates of these data sets by the community. Pacific Northwest National Laboratory (PNNL) and its power industry and software vendor partners are developing an innovative sustainable data evolution technology (SDET) to create open-access power grid datasets and facilitate updates to these datasets by the power grid community. The objective is to make this a sustained effort within and beyond the ARPA-E GRID DATA program so that the datasets can evolve over time and meet the current and future needs for power grid optimization and potentially other applications in power grid operation and planning.

Source record↗

Effects of the Gill-Solent WindMaster-Pro “w-boost” firmware bug on eddy covariance fluxes and some simple recovery strategies

In late 2015 and early 2016, work done by the AmeriFlux Management Project Technical Team (amerilfux.lbl.gov) helped to uncover an issue with Gill WindMaster and WindMaster Pro sonic anemometers used by many researchers for eddy covariance flux measurements. Gill has addressed this issue and has since sent out a notice that the vertical wind speed component (a critical piece of all eddy covariance fluxes) was being erroneously computed and reported. The problem (known as the “w-boost” bug) ended in positive (upward) wind speeds being under-reported by 16.6% and negative (downward) wind speeds being under-reported by 28.9%. This has the possibility to cause similar under estimates in fluxes derived from measurements using these instruments. Additionally, the bug affects corrections for angle of attack as derived by Nakai and Shimoyama, rendering them invalid. Although the manufacturer has offered a firmware upgrade for existing instruments that will fix this issue, many existing data sets have been affected by it and are currently in use by the scientific community. To address the issue of affected data, currently in use, we analyzed multi-year and short-term data sets from a variety of ecosystems to assess methods of correcting existing flux data. We found that simple multiplicative correction factors (~1.18) may be used to remove most of the “w-boost” bias from fluxes in existing data sets that do not include angle of attack corrections.

54 ENVIRONMENTAL SCIENCES↗

Multi-Variable Parametric Analysis of Prototype Building Energy Performance Using Current and Future Weather Scenarios For Data-Driven Market Transformation Support

This project aimed to develop a public building simulation data set that may be used to inform building code development and guidelines for building innovation. The data set consists of several common building types and many representative locations across the United States. A parametric design of building properties was developed to create a range of building energy models that represent common building design decisions with a particular focus on fenestration options. The US Department of Energy prototype building energy models were altered according to a parametric building design and simulated using both current weather data and future weather estimates derived from global climate models. The resulting data set allows for pertinent exploration of building design parameters, including fenestration, within different environments across the United States in the broader context of climate change.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Fermi's golden rule applied to the {gamma} decay in the quasicontinuum of {sup 46}Ti

Particle-{gamma} coincidences from the {sup 46}Ti(p,p{sup '{gamma}}){sup 46}Ti inelastic scattering reaction with 15-MeV protons are utilized to obtain {gamma}-ray spectra as a function of excitation energy. The rich data set allows analyzsis of the coincidence data with various gates on excitation energy. For many independent data sets, this enables a simultaneous extraction of level density and radiative strength function (RSF). The results are consistent with one common level density. The data seem to exhibit a universal RSF as the deduced RSFs from different excitation energies show only small fluctuations provided that only excitation energies above 3 MeV are taken into account. If transitions to well-separated low-energy levels are included, the deduced RSF may change by a factor of 2-3, which might be expected because of the involved Porter-Thomas fluctuations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Investigating the variability of active galactic nuclei using combined multi-quarter Kepler data

We used photometry from the Kepler satellite to characterize the variability of four radio-loud active galactic nuclei (AGNs) on timescales from years to minutes. The Kepler satellite produced nearly continuous high precision data sets which provided better temporal coverage than possible with ground based observations. We have now accumulated 11 quarters of data, eight of which were reported in our previous paper. In addition to constructing power spectral densities (PSDs) and characterizing the variability of the last three quarters, we have linked together the individual quarters using a multiplicative scaling process, providing data sets spanning ∼2.8 yr with >98% coverage at a 30 minute sampling rate. We compute PSDs on these connected data sets that yield power law slopes at low frequencies in the approximate range of –1.5 to –2.0, with white noise seen at higher frequencies. These PSDs are similar to those of both the individual quarters and to those of ground-based optical observations of other AGNs. We also have explored a PSD binning method intended to reduce a bias toward shallow slope fits by evenly distributing the points within the PSDs. This tends to steepen the computed PSD slopes, especially when the low frequencies are relatively poorly fit. We detected flares lasting several days in which the brightness increased by ∼15%-20% in one object, as well a smaller flare in another. Two AGNs showed only small, ∼1%-2%, fluctuations in brightness.

79 ASTRONOMY AND ASTROPHYSICS↗