Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data set”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57

Liquid-bearing clouds 5-day back-trajectories

The data set contains 5-day back-trajectory calculations for cloud layers detected in the MOSAiC sounding data set. The calculations were performed by HYSPLIT informed by ERA5. In addition to trajectory coordinates and altitudes, the data set includes diagnostic and atmospheric state variables along the trajectories as well as trajectory cluster numbers associated with each airmass per Silber and Shupe,2022.

54 ENVIRONMENTAL SCIENCES↗

Geography-based structural analysis of the Internet

In this paper, we study some geographic aspects of the Internet. We base our analysis on a large set of geolocated IP hop-level session data (including about 300,000 backbone routers, 150 million end hosts, and 1 billion sessions) that we synthesized from a variety of different input sources such as US census data, computer usage statistics, Internet market share data, IP geolocation data sets, CAJDA's Skitter data set for backbone connectivity, and BGP routing tables. We use this model to perform a nationwide and statewide geographic analysis of the Internet. Our main observations are: (1) There is a dominant coast-to-coast pattern in the US Internet traffic. In fact, in many instances even if the end-devices are not near either coast, still the traffic between them takes a long detour through the coasts. (2) More than half of the Internet paths are inflated by 100% or more compared to their corresponding geometric straight-line distance. This circuitousness makes the average ratio between the routing distance and geometric distance big (around 10). (3) The weighted mean hop count is around 5, but the hop counts are very loosely correlated with the distances. The weighted mean AS count (number of ASes traversed) is around 3. (4) The AS size and the AS location number distributions are heavy-tailed and strongly correlated. Most of the ASes are medium sized and there is a wide variability in the geographic dispersion size (measured in terms of the convex hull area) of these ASes.

99 GENERAL AND MISCELLANEOUS↗

Parallel visualization and analysis with paraview on a Cray XT4

Scientific data sets produced by modern supercomputers like ORNL's Cray XT 4, Jaguar, can be extremely large, making visualization and analysis more difficult as moving large resultant data to dedicated analysis systems can be prohibitively expensive. We share our continuing work of integrating a parallel visualization system, ParaView, on ORNL's Jaguar system and our efforts to enable extreme scale interactive data visualization and analysis. We will discuss porting challenges and present performance numbers. Jaguar is a Cray XT4 with 7,832 compute nodes each with 4 cores and 8GB of memory, located in Oak Ridge, Tennessee. Jaguar is currently ranked No.8 in the Top 500. Jaguar, and other machines like it, enable increasingly larger data sets. Whether scientists are producing extremely massive data or small data they still have a requirement for analysis. Analysis is often difficult for larger data and it is further complicated when the user is distant to the data. Data sets that are too large to ship and/or analyze on a single desktop require a parallel analysis tool and a high performance computer to run on. Running ParaView interactively on Jaguar is a positive improvement for both local and remote users. We have shown that it is feasible for our user at LANL to visualize his simulation data created on jaguar. Local users may face fewer obstacles and get improved performance, due to their higher bandwidth to Jaguar. For future work, we would like to see higher priority queues that enable interactive visualization. A more interactive user-friendly qsub that estimates time to allocation would be very useful. Hopefully, our work will lead to more users attempting interactive visualization on Jaguar, resulting in quicker turnaround times for visualization and analysis. As users migrate to using supercomputing platforms for visualization, we expect future research possibilities in this area.

00↗

First frontier field constraints on the cosmic star formation rate density AT z ~ 10—the impact of lensing shear on completeness of high-redshift galaxy samples

In this work, we search the complete Hubble Frontier Field data set of Abell 2744 and its parallel field for $z\sim 10$ sources to further refine the evolution of the cosmic star formation rate density (SFRD) between $z\sim 8$ and $z\sim 10$. We independently confirm two images of the recently discovered triply imaged $z\sim 9.8$ source by Zitrin et al. and set an upper limit for similar $z\sim 10$ galaxies with red colors of ${J}_{125}-{H}_{160}\gt 1.2$ in the parallel field of Abell 2744. We utilize extensive simulations to derive the effective selection volume of Lyman-break galaxies at $z\sim 10$, both in the lensed cluster field and in the adjacent parallel field. Particular care is taken to include position-dependent lensing shear to accurately account for the expected sizes and morphologies of highly magnified sources. We show that both source blending and shear reduce the completeness at a given observed magnitude in the cluster, particularly near the critical curves. These effects have a significant, but largely overlooked, impact on the detectability of high-redshift sources behind clusters, and substantially reduce the expected number of highly magnified sources. The detections and limits from both pointings result in an SFRD which is consistent within the uncertainties with previous estimates at $z\sim 10$ from blank fields. The combination of these new results with all other estimates is also consistent with a rapidly declining SFRD in the 170 Myr from $z\sim 8$ to $z\sim 10$ as predicted by cosmological simulations and dark-matter halo evolution in ΛCDM. Once biases introduced by magnification-dependent completeness are accounted for, the full six cluster and parallel Frontier Field program will be an extremely powerful new data set to probe the evolution of the galaxy population at $z\gt 8$ before the advent of the James Webb Space Telescope.

79 ASTRONOMY AND ASTROPHYSICS↗

Summary Report on Synthetic Time History Development and Deployment

This report summarizes research work performed at the Colorado School of Mines (CSM) and George Washington University (GWU) in support of the DOE Office of Nuclear Energy Integrated Energy Systems (IES) program. In particular, the work focuses on improving and strengthening two fundamental steps in the mathematical and computational framework that is currently being developed to optimize the economic performance of Integrated Energy Systems. One of the innovative approaches taken by the IES program is that, rather than optimizing the system for a specific year or week or day, the optimization is performed using stochastic synthetic data. Synthetic data is generated by training artificial intelligence (AI) using available but limited data sets. The synthetic data should possess the same patterns as the original set and the same statistical properties, but never repeat the same set of values exactly. The work from CSM focuses on this first step; namely, investigating a methodology to determine the quality of the synthetic data and the right settings for properly training the AI. Once a large set of trustworthy data can be generated the problem of stochastic optimization can be tackled. The optimal IES configuration is highly dependent on the rare high peaks or deep depths of the net demand (grid electricity demand less variable renewable energy [VRE] production). Using an unbiased random sampling of the synthetic data, these extremes are very difficult to generate and therefore the optimization can be unrepresentative and inaccurate. GWU has started an approach to increase the likelihood of generating these rare events with the proper associated probabilistic weight. Both of these projects represent a step forward in achieving the capability to properly size the IESs and to properly capture the value that these systems can provide to the grid by absorbing volatility of net demand without disproportionately increasing the cost of maintaining grid reliability.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

A Reference Based Analysis Framework for Analyzing System Call Traces

Reference based analysis (RBA) is a novel data mining tool for exploring a test data set with respect to a reference data set. The power of RBA lies in it ability to transform any complex data type, such as symbolic sequences and multi-variate categorical data instances, into a multivariate continuous representation. The transformed representation not only allows visualization of the complex data, which cannot be otherwise visualized in its original form, but also allows enhanced anomaly detection in the transformed feature space. We demonstrate the application of the RBA framework in analyzing system call traces and show how the transformation results in improved intrusion detection performance over state of art data mining based intrusion detection methods developed for system call traces.

99 GENERAL AND MISCELLANEOUS↗

The Redmapper galaxy cluster catalog from DES science verification data

We describe updates to the redMaPPer algorithm, a photometric red-sequence cluster finder specifically designed for large photometric surveys. The updated algorithm is applied to 150 deg{sup 2} of Science Verification (SV) data from the Dark Energy Survey (DES), and to the Sloan Digital Sky Survey (SDSS) DR8 photometric data set. The DES SV catalog is locally volume limited and contains 786 clusters with richness λ>20 (roughly equivalent to M{sub 500c}≳10{sup 14} h{sub 70}{sup −1} M{sub ⊙}) and 0.2<z<0.9. The DR8 catalog consists of 26,311 clusters with 0.08<z<0.6, with a sharply increasing richness threshold as a function of redshift for z≳0.35. The photometric redshift performance of both catalogs is shown to be excellent, with photometric redshift uncertainties controlled at the σ{sub z}/(1+z)∼0.01 level for z≲0.7, rising to ∼0.02 at z∼0.9 in DES SV. We make use of Chandra and XMM X-ray and South Pole Telescope Sunyaev–Zeldovich data to show that the centering performance and mass–richness scatter are consistent with expectations based on prior runs of redMaPPer on SDSS data. We also show how the redMaPPer photo-z and richness estimates are relatively insensitive to imperfect star/galaxy separation and small-scale star masks.

79 ASTRONOMY AND ASTROPHYSICS↗

Creating a Tools Ecosystem for Cross-Discipline Environmental Data Reuse

Reusing data is difficult even within well-defined science communities and only gets worse when combining data from multiple communities and disciplines. Through the lens of current work on constructing an environmental epidemiological data set from multiple disciplinary sources, we demonstrate the need for a new tool ecosystem to support heterogeneous Big Data science. Extending existing community standards for schemas and/or data formats through human auditing and wrangling of the data is not feasible at scale. This work therefore suggests new approaches for the multi-disciplinary communities to build a shared tool ecosystem for big data. We discuss both the larger context of data wrangling of epidemiological data sets for novel artificial intelligence algorithms and the specific lessons from working with these multi-disciplinary data sets. Adopting a more model-driven, automatable approach promises not only better efficiency but also removes key sources of human-generated errors and promotes reuse and reproducibility of science data.

Logan, Jeremy↗

LandCast 2030 High-Resolution Population Projection

The LandCast 2030 data set is an empirically-informed spatial distribution of projected population of the contiguous U.S. for 2030 compiled on a 30" x 30" latitute/longitude grid. Population projections of county level numbers were developed using a modified version of the U.S. Census's projection methodology - with the U.S. Census's official projection as the benchmark. Projected census counts were apportioned to each grid cell based on locally adaptive likelihood coefficients, which are based on land cover, slope, road proximity, distances to larger cities, a moving average of current population, and other data sets. The LandCast 2030 data set was developed as part of Oak Ridge National Laboratory (ORNL) Global Population Project for estimating ambient populations at risk.

Source record↗

LONG-TERM MONITORING OF THE HIGH-ENERGY {gamma}-RAY EMISSION FROM LS I +61 Degree-Sign 303 AND LS 5039

The Fermi Large Area Telescope (LAT) reported the first definitive GeV detections of the binaries LS I +61 Degree-Sign 303 and LS 5039 in the first year after its launch in 2008 June. These detections were unambiguous as a consequence of the reduced positional uncertainty and the detection of modulated {gamma}-ray emission on the corresponding orbital periods. An analysis of new data from the LAT, comprising 30 months of observations, identifies a change in the {gamma}-ray behavior of LS I +61 Degree-Sign 303. An increase in flux is detected in 2009 March and a steady decline in the orbital flux modulation is observed. Significant emission up to 30 GeV is detected by the LAT; prior data sets led to upper limits only. Contemporaneous TeV observations no longer detected the source, or found it-in one orbit-close to periastron, far from the phases at which the source previously appeared at TeV energies. The detailed numerical simulations and models that exist within the literature do not predict or explain many of these features now observed at GeV and TeV energies. New ideas and models are needed to fully explain and understand this behavior. A detailed phase-resolved analysis of the spectral characterization of LS I +61 Degree-Sign 303 in the GeV regime ascribes a power law with an exponential cutoff spectrum along each analyzed portion of the system's orbit. The on-source exposure of LS 5039 is also substantially increased with respect to our prior publication. In this case, whereas the general {gamma}-ray properties remain consistent, the increased statistics of the current data set allows for a deeper investigation of its orbital and spectral evolution.

79 ASTRONOMY AND ASTROPHYSICS↗

SU-F-P-32: A Phantom Study of Accuracy of Four-Dimensional Cone-Beam CT (4D-CBCT) Vs. Three-Dimensional Cone Beam CT (3D-CBCT) in Image Guided Radiotherapy

Purpose: SymmetryTM 4D IGRT system of Elekta has been installed at our institution, which offers the 4D CBCT registration option. This study is to evaluate the accuracy of 4D CBCT system by using the CIRS 4D motion phantom and to perform a feasibility study on the implementation of 4D-CBCT as image guidance for SBRT treatment. Methods: The 3D and 4D CT image data sets are acquired using the CIRS motion phantom on a Philips large bore CT simulator. The motion was set as 0.5 cm superior and inferior directions with 6 seconds recycle time. The 4D CT data were sorted as 10 phases. One identifiable part of the 4D CT QA insert from CIRS phantom was used as the target. The ITV MIP was drawn based on maximum intensity projection (MIP) and transferred as a planning structure into 4D CBCT system. Then the 3D CBCT and 4D CBCT images were taken and registered with the free breath (3D), MIP (4D) and average intensity projection (AIP)(4D) reference data sets. The couch shifts (X, Y, Z) are recorded and compared. Results: Table 1 listed the twelve couch shifts based on the registration of MIP, AIP and free breath CT data sets with 3D CBCT and 4D CBCT for both whole body and local registration. X, Y and Z represent couch shifts in the direction of the right-left, superior-inferior and anterior-posterior. The biggest differences of 0.73 cm and 0.57 cm are noted in the free breath CT data with 4D CBCT and 3D CBCT data registration. Fig. 1 and Fig. 2 are the shift analysis in diagram. Fig. 3 shows the registration. Conclusion: Significant differences exist in the shifts corresponding with the direction of target motion. Further investigations are ongoing.

60 APPLIED LIFE SCIENCES↗

Exploratory Data analysis ENvironment eXtreme scale (EDENx)

EDENx is a multivariate data visualization tool that allows interactive user driven analysis of large-scale data sets with high dimensionality. EDENx builds on our earlier system, called EDEN to enable analysis of more dimensions and larger scale data sets. EDENx provides an initial overview of summary statistics for each variable in the data set under investigation. EDENx allows the user to interact with graphical summary plots of the data to investigate subsets and their statistical associations. These plots include histograms, binned scatterplots, binned parallel coordinate plots, timeline plots, and graphical correlation indicators. From the EDENx interface, a user can select a subsample of interest and launch a more detailed data visualization via the EDEN system. EDENx is best suited for high-level, aggregate analysis tasks while EDEN is more appropriate for detail data investigations.

Steed, Chad Allen↗

Large Data Visualization on Distributed Memory Mulit-GPU Clusters

Data sets of immense size are regularly generated on large scale computing resources. Even among more traditional methods for acquisition of volume data, such as MRI and CT scanners, data which is too large to be effectively visualization on standard workstations is now commonplace. One solution to this problem is to employ a 'visualization cluster,' a small to medium scale cluster dedicated to performing visualization and analysis of massive data sets generated on larger scale supercomputers. These clusters are designed to fit a different need than traditional supercomputers, and therefore their design mandates different hardware choices, such as increased memory, and more recently, graphics processing units (GPUs). While there has been much previous work on distributed memory visualization as well as GPU visualization, there is a relative dearth of algorithms which effectively use GPUs at a large scale in a distributed memory environment. In this work, we study a common visualization technique in a GPU-accelerated, distributed memory setting, and present performance characteristics when scaling to extremely large data sets.

97 MATHEMATICS AND COMPUTING↗

Automated Data Acquisition Software for National Instruments Hardware with Timed Acquisition, Real-Time Display and Spectrogram, and Data Redundancy. Current version is Version 7 of DataAcq.exe.RElease1.2.4.26.

This software automates the collection of waveform data on a timed schedule so that an operator does not need to be at the computer to initiate the collection of data sets.It provides real time display of up to 16 channels of data as a time display, frequency display, or frequency vs time (spectrogram) display. The software provides the ability to collect data sets of a user selected time length at a selected interval. This operation can be set to occur during a selected time interval during the day. This software provides the capability to write two copies of the data files simultaneously so that the data is backed up as collected. This software automates the collection of waveform data on a timed schedule so that an operator does not need to be at the computer to initiate the collection of data sets. It provides real time display of up to 16 channels of data as a time display, frequency display, or frequency vs time (spectrogram) display. The software provides the ability to collect data sets of a user selected time length at a selected interval. This operation can be set to occur during a selected time interval during the day. This software provides the capability to write two copies of the data files simultaneously so that the data is backed up as collected.

Wysor, Robert W↗

SU-E-J-80: A Comparative Analysis of MIM and Pinnacle Software for Adaptive Planning

Purpose: IMRT treatment is often administered with image guidance and small PTV margins. Change in body habitus such as weight loss and tumor response during the course of a treatment could be significant, thus warranting re-simulation and re-planning. Adaptive planning is challenging and places significant burden on the staff, as such some commercial vendors are now offering adaptive planning software to stream line the process of re-planning and dose accumulation between different CT data set. The purpose of this abstract is to compare the adaptive planning tools between Pinnacle version 9.8 and MIM 6.4 software. Methods: Head and Neck cases of previously treated patients that experienced anatomical changes during the course of their treatment were chosen for evaluation. The new CT data set from the re-simulation was imported to Pinnacle and MIM software. The dynamic planning tool in pinnacle was used to calculate the old plan with fixed MU setting on the new CT data. In MIM, the old CT was registered to the new data set, followed by a dose transformation to the new CT. The dose distribution to the PTV and critical structures from each software were analyzed and compared. Results: 9% difference was observed between the Global maximum doses reported by both software. Mean doses to organs at risk and PTV’s were within 6 % however pinnacle showed greater difference in PTV coverage change. Conclusion: MIM software adaptive planning corrects for geometrical changes without consideration for the effect of radiological path length on dose distribution; however Pinnacle corrects for both geometric and radiological effect on the dose distribution. Pinnacle gives a better estimate of the dosimetric impact due to anatomical changes.

60 APPLIED LIFE SCIENCES↗

A multi-scale time-series dataset of anthropogenic heat from buildings in Los Angeles County

The dataset contains hourly Anthropogenic heat (AH) from buildings in Los Angeles County, based on weather data from 2018. The hourly AH is aggregated at three spatial resolutions: 450m x 450m grid, 12km x 12km grid, and census tract. The AH is broken down into three components: building envelope surface convection, heating, ventilation, and air conditioning (HVAC) system heat release, and zone exfiltration and exhaust air heat loss. The dataset is created with the physics-based EnergyPlus building energy models to calculate individual buildings' AH considering WRF-UCM simulated microclimate conditions. Please refer to the paper "A multi-scale time-series dataset of anthropogenic heat from buildings in Los Angeles County" for more information about the data generation workflow and the data validation procedure. The data set contains two folders: the "output_data" folder holds the simulation results (EP_output and EP_output_csv), building metadata (building_metadata.geojson and building_metadata.csv), aggregated heat emission and energy consumption time-series data (hourly_heat_energy), and geographical data (geo_data) associated with the GEOID referenced in heat and energy consumption data. The "input_data" folder contains the raw data used to generate files in the "output_data" folder as well as data sets used in the validation. The code repository (https://github.com/IMMM-SFA/xu_etal_2022_sdata) holds the processing scripts for data curation, validation, and visualization.

Energy↗

Adding Data Management Services to Parallel File Systems

The objective of this project, called DAMASC for “Data Management in Scientific Computing”, is to coalesce data management with parallel file system management to present a declarative interface to scientists for managing, querying, and analyzing extremely large data sets efficiently and predictably. Managing extremely large data sets is a key challenge of exascale computing. The overhead, energy, and cost of moving massive volumes of data demand designs where computation is close to storage. In current architectures, compute/analysis clusters access data in a physically separate parallel file system and largely leave it scientist to reduce data movement. Over the past decades the high-end computing community has adopted middleware with multiple layers of abstractions and specialized file formats such as NetCDF-4 and HDF5. These abstractions provide a limited set of high-level data processing functions, but have inherent functionality and performance limitations: middleware that provides access to the highly structured contents of scientific data files stored in the (unstructured) file systems can only optimize to the extent that file system interfaces permit; the highly structured formats of these files often impedes native file system performance optimizations. We are developing Damasc, an enhanced high-performance file system with native rich data management services. Damasc will enable efficient queries and updates over files stored in their native byte-stream format while retaining the inherent performance of file system data storage via declarative queries and updates over views of underlying files. Damasc has four key benefits for the development of data-intensive scientific code: (1) applications can use important data-management services, such as declarative queries, views, and provenance tracking, that are currently available only within database systems; (2) the use of these services becomes easier, as they are provided within a familiar file-based ecosystem; (3) common optimizations, e.g., indexing and caching, are readily supported across several file formats, avoiding effort duplication; and (4) performance improves significantly, as data processing is integrated more tightly with data storage. Our key contributions are: SciHadoop which explores changes to MapReduce assumption by taking advantage of semantics of structured data while preserving MapReduce’s failure and resource management; DataMods which extends common abstractions of parallel file systems so they become programmable such that they can be extended to natively support a variety of data models and can be hooked into emerging distributed runtimes such as Stanford’s Legion; and Miso which combines Hadoop and relational data warehousing to minimize time to insight, taking into account the overhead of ingesting data into data warehousing.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Importance of Engineered and Learned Molecular Representations in Predicting Organic Reactivity, Selectivity, and Chemical Properties

Machine-readable chemical structure representations are foundational in all attempts to harness machine learning for the prediction of reactivities, selectivities, and chemical properties directly from molecular structure. The featurization of discrete chemical structures into a continuous vector space is a critical phase undertaken before model selection, and the development of new ways to quantitatively encode molecules is an active area of research. Here, we highlight the application and suitability of different representations, from expert-guided “engineered” descriptors to automatically “learned” features, in different prediction tasks relevant to organic and organometallic chemistry, where differing amounts of training data are available. These tasks include statistical models of stereo- and enantioselectivity, thermochemistry, and kinetics developed using experimental and quantum chemical data. The use of expert-guided molecular descriptors provides an opportunity to incorporate chemical knowledge, domain expertise, and physical constraints into statistical modeling. In applications to stereoselective organic and organometallic catalysis, where data sets may be relatively small and 3D-geometries and conformations play an important role, mechanistically informed features can be used successfully to obtain predictive statistical models that are also chemically interpretable. We provide an overview of several recent applications of this approach to obtain quantitative models for reactivity and selectivity, where topological descriptors, quantum mechanical calculations of electronic and steric properties, along with conformational ensembles, all feature as essential ingredients of the molecular representations used. Alternatively, more flexible, general-purpose molecular representations such as attributed molecular graphs can be used with machine learning approaches to learn the complex relationship between a structure and prediction target. This approach has the potential to out-perform more traditional representation methods such as “hand-crafted” molecular descriptors, particularly as data set sizes grow. One area where this is particularly relevant is in the use of large sets of quantum mechanical data to train quantitative structure–property relationships. A general approach toward curating useful data sets and training highly accurate graph neural network models is discussed in the context of organic bond dissociation enthalpies, where this strategy outperforms regression using precomputed descriptors. Finally, we describe how graph neural network predictions can be incorporated into mechanistically informed statistical models of chemical reactivity and selectivity. Once trained, this approach avoids the expensive computational overhead associated with quantum mechanical calculations, while maintaining chemical interpretability. We illustrate examples for which fast predictions of bond dissociation enthalpy and of the identities of radicals formed through cleavage of a molecule’s weakest bond are used in simple physical models of site-selectivity and reactivity.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗