Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analytics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,333 records · Page 74

Deriving Galaxy Cluster Velocity Anisotropy Profiles from a Joint Analysis of Dynamical and Weak Lensing Data

We present an analytic approach to lift the mass-anisotropy degeneracy in clusters of galaxies by utilizing the line-of-sight velocity dispersion of clustered galaxies jointly with weak lensing inferred masses. More specifically, we solve the spherical Jeans equation by assuming a simple relation between the line-of-sight velocity dispersion and the radial velocity dispersion and recast the Jeans equation as a Bernoulli differential equation that has a well-known analytic solution. We first test our method in cosmological N-body simulations and then derive the anisotropy profiles for 35 archival data galaxy clusters with an average redshift of $\langle {z}_{c}\rangle =0.25$. The resulting profiles yield a weighted average global value of $\langle \beta (0.2\leqslant R/{R}_{200}\leqslant 1)\rangle =0.35\pm 0.28$ (stat) ±0.15 (sys). This indicates that clustered galaxies tend to globally fall on radially anisotropic orbits. We note that this is the first attempt to derive velocity anisotropy profiles for a cluster sample of this size utilizing joint dynamical and weak lensing data.

79 ASTRONOMY AND ASTROPHYSICS↗

JOINT ANALYSIS OF X-RAY AND SUNYAEV-ZEL'DOVICH OBSERVATIONS OF GALAXY CLUSTERS USING AN ANALYTIC MODEL OF THE INTRACLUSTER MEDIUM

We perform a joint analysis of X-ray and Sunyaev-Zel'dovich effect data using an analytic model that describes the gas properties of galaxy clusters. The joint analysis allows the measurement of the cluster gas mass fraction profile and Hubble constant independent of cosmological parameters. Weak cosmological priors are used to calculate the overdensity radius within which the gas mass fractions are reported. Such an analysis can provide direct constraints on the evolution of the cluster gas mass fraction with redshift. We validate the model and the joint analysis on high signal-to-noise data from the Chandra X-ray Observatory and the Sunyaev-Zel'dovich Array for two clusters, A2631 and A2204.

79 ASTRONOMY AND ASTROPHYSICS↗

Advances in Calibration of Building Energy Models to Time Series Data: Preprint

Advanced building analytics and control applications such as fault detection and diagnostics and model predictive control benefit from building energy models calibrated to time series data. In this paper, we present best practices for aligning EnergyPlus (TM) model time series output with measured building performance. These include the use of subcalibration procedures to fine-tune envelope, heat transfer, and mechanical system parameters; initialization of zone temperatures to match observed conditions at the beginning of each calibration period; and calculation of calibration metrics across multiple run periods using a new OpenStudio reporting measure.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Advanced Analytics Studies Applied to US Department of Veterans Affairs' Corporate Data Warehouse (Initial Draft)

In this report, we describe our experience of applying several advanced analytics algorithms to the US Department of Veterans Affairs’ (VA’s) Corporate Data Warehouse (CDW) electronic health records datasets during FY2017-18. While various algorithms were applied to the CDW data, the main goal of this effort was to provide useful insights into the operational aspects (as opposed to the purely clinical aspect) of this specific implementation. Since there are not many reports in the public literature on advanced analytics applied to this data, this report provides unique insight in this regard. We focused on two machine learning (ML) applications: (1) clinical pathway inference (patterns dominating clinical pathways applied to a male dataset of Stable Ischemic Heart Disease patients as use case) and (2) medical-concept representation learning’s capability to inform and refine cohort membership based on probable patient outcomes. During our study on clinical pathway inference, we used two main modeling techniques: (a) topic probabilistic modeling (latent Dirichlet allocation [LDA]) and (b) feature imbedding. We observed that the applicability of LDA to the pathway inference remains in question. LDA provides results that are intuitive and easy for humans to comprehend; however, when applied to the pathway inference, it also generates pathway patterns that consist of a few dominant pathway components. In addition, LDA provides no information regarding the relationships among components in the same pathway. The outputs of LDA are also found to categorize patients based on their trace data of clinical procedures. However, the results suggest that LDA is biased toward statistically dominant components. This makes it particularly hard to discriminate pathway subbranches. To address the issue, we designed a new pathway inference methodology that integrates temporal ordering of pathway components into LDA results, as existing feature embedding tools such as word2vec are not readily applicable to our task. In addition, we developed our own feature embedding tool customized for patient traces. We conclude this study by suggesting two approaches to use embedding representation of a component into LDA and briefly list our lessons learned and recommendations for future work. For our study on medical-concept representation learning ability to inform and refine cohort membership based on probable patient outcomes, during our empirical evaluation we compared methods from medical-concept learning to standard one of a kind (one-of-K) encoding to evaluate the change in effectiveness as done in Choi, Schuetz, Stewart, and Sun (2016). We performed two primary empirical evaluations. The first evaluation was on a curated collection of 60,000 patients with no more than 1 year of medical history included. The second was a collection of patients with no restriction to the amount of medical history included. The hypothesis across both evaluations is that representation learning is broadly useful independent of downstream processing models; thus, for each experiment, we trained three models—a logistic regression model, a two-layer neural network model, and a nearest-neighbor model—and then averaged the results. Each model was trained using fivefold cross validation. We provided evidence that medical-representation learning improves predictions of the primary diagnosis category of a short patient history through 12 experiments. In addition, we provided evidence that medical-representation learning fails to improve prediction of the primary diagnosis category of an arbitrarily long patient history through 12 experiments. We conclude this study with a brief list of our lessons learned and recommendations for future work. We conclude the report with a discussion of recent technology trends as they relate to our artificial intelligence and, more specifically, to our ML research and approaches as described previously.

97 MATHEMATICS AND COMPUTING↗

Unified architecture for data-driven metadata tagging of building automation systems

This article presents a Unified Architecture (UA) for automated point tagging of Building Automation System (BAS) data, based on a combination of data-driven approaches. Advanced energy analytics applications—including fault detection and diagnostics and supervisory control—have emerged as a significant opportunity for improving the performance of our built environment. Effective application of these analytics depends on harnessing structured data from the various building control and monitoring systems, but typical BAS implementations do not employ any standardized metadata schema. While standards such as Project Haystack and Brick Schema have been developed to address this issue, the process of structuring the data, i.e., tagging the points to apply a standard metadata schema, has, to date, been a manual process. This process is typically costly, labor-intensive, and error-prone. In this work we address this gap by proposing a UA that automates the process of point tagging by leveraging the data accessible through connection to the BAS, including time-series data and the raw point names. The UA intertwines supervised classification and unsupervised clustering techniques from machine learning and leverages both their deterministic and probabilistic outputs to inform the point tagging process. Furthermore, we extend the UA to embed additional input and output data-processing modules that are designed to address the challenges associated with the real-time deployment of this automation solution. We test the UA on two datasets for real-life buildings: (i) commercial retail buildings and (ii) office buildings from the National Renewable Energy Laboratory (NREL) campus. We report the proposed methodology correctly applied 85–90% and 70–75% of the tags in each of these test scenarios, respectively for two significantly different building types used for testing UA's fully-functional prototype. The proposed UA, therefore, offers promising approach for automatically tagging BAS data as it reaches close to 90% accuracy. Further building upon this framework to algorithmically identify the equipment type and their relationships is an apt future research direction to pursue.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

ASCR Cybersecurity for Scientific Computing Integrity - Research Pathways and Ideas Workshop

At the request of the U.S. Department of Energy's (DOE) Office of Science (SC) Advanced Scientific Computing Research (ASCR) program office, a workshop was held June 2-3, 2015, in Gaithersburg, MD, to identify potential long term (10 to +20 year) cybersecurity fundamental basic research and development challenges, strategies and roadmap facing future high performance computing (HPC), networks, data centers, and extreme-scale scientific user facilities. This workshop was a follow-on to the workshop held January 7-9, 2015, in Rockville, MD, that examined higher level ideas about scientific computing integrity specific to the mission of the DOE Office of Science. Issues included research computation and simulation that takes place on ASCR computing facilities and networks, as well as network-connected scientific instruments, such as those run by various DOE Office of Science programs. Workshop participants included researchers and operational staff from DOE national laboratories, as well as academic researchers and industry experts. Participants were selected based on the submission of abstracts relating to the topics discussed in the previous workshop report [1] and also from other ASCR reports, including "Abstract Machine Models and Proxy Architectures for Exascale Computing" [27], the DOE "Preliminary Conceptual Design for an Exascale Computing Initiative" [28], and the January 2015 machine learning workshop [29]. The workshop was also attended by several observers from DOE and other government agencies. The workshop was divided into three topic areas: (1) Trustworthy Supercomputing, (2) Extreme-Scale Data, Knowledge, and Analytics for Understanding and Improving Cybersecurity, and (3) Trust within High-end Networking and Data Centers. Participants were divided into three corresponding teams based on the category of their abstracts. The workshop began with a series of talks from the program manager and workshop chair, followed by the leaders for each of the three topics and a representative of each of the four major DOE Office of Science Advanced Scientific Computing Research Facilities: the Argonne Leadership Computing Facility (ALCF), the Energy Sciences Network (ESnet), the National Energy Research Scientific Computing Center (NERSC), and the Oak Ridge Leadership Computing Facility (OLCF). The rest of the workshop consisted of topical breakout discussions and focused writing periods that produced much of this report.

97 MATHEMATICS AND COMPUTING↗

Number series of atoms, interatomic bonds and interface bonds defining zinc-blende nanocrystals as function of size, shape and surface orientation: Analytic tools to interpret solid state spectroscopy data

Semiconductor nanocrystals (NCs) experience stress and charge transfer by embedding materials or ligands and impurity atoms. In return, the environment of NCs experiences a NC stress response which may lead to matrix deformation and propagated strain. Up to now, there is no universal gauge to evaluate the stress impact on NCs and their response as a function of NC size d{sub NC}. I deduce geometrical number series as analytical tools to obtain the number of NC atoms N{sub NC}(d{sub NC}[i]), bonds between NC atoms N{sub bnd}(d{sub NC}[i]) and interface bonds N{sub IF}(d{sub NC}[i]) for seven high symmetry zinc-blende (zb) NCs with low-index faceting: {001} cubes, {111} octahedra, {110} dodecahedra, {001}-{111} pyramids, {111} tetrahedra, {111}-{001} quatrodecahedra and {001}-{111} quadrodecahedra. The fundamental insights into NC structures revealed here allow for major advancements in data interpretation and understanding of zb- and diamond-lattice based nanomaterials. The analytical number series can serve as a standard procedure for stress evaluation in solid state spectroscopy due to their deterministic nature, easy use and general applicability over a wide range of spectroscopy methods as well as NC sizes, forms and materials.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

The genome portal of the Department of Energy Joint Genome Institute: 2014 updates

The U.S. Department of Energy (DOE) Joint Genome Institute (JGI), a national user facility, serves the diverse scientific community by providing integrated high-throughput sequencing and computational analysis to enable system-based scientific approaches in support of DOE missions related to clean energy generation and environmental characterization. The JGI Genome Portal (http://genome.jgi.doe.gov) provides unified access to all JGI genomic databases and analytical tools. The JGI maintains extensive data management systems and specialized analytical capabilities to manage and interpret complex genomic data. A user can search, download and explore multiple data sets available for all DOE JGI sequencing projects including their status, assemblies and annotations of sequenced genomes. In this paper, we describe major updates of the Genome Portal in the past 2 years with a specific emphasis on efficient handling of the rapidly growing amount of diverse genomic data accumulated in JGI.

59 BASIC BIOLOGICAL SCIENCES↗

Analytical desmearing of Bonse–Hart ultra-small-angle neutron scattering data via truncated Abel inversion

A non-iterative analytical framework based on the truncated Abel inversion is developed for desmearing Bonse–Hart ultra-small-angle neutron scattering (USANS) data. The method directly inverts the slit-averaged intensity without empirical extrapolation or iterative regularization, establishing a closed-form relationship between the measured and intrinsic scattering profiles. Numerical benchmarks on representative models, including a rigid-line form factor, a Lorentzian function and a fractal structural model, demonstrate quantitative recovery of the ground-truth intensity across the full Q range. Application to a deuterated polystyrene/poly(2-vinylpyridine) blend further confirms that the approach yields smooth continuous profiles consistent with companion small-angle neutron scattering data. The truncated Abel inversion thus provides a stable, model-independent and physically transparent route for accurate desmearing of Bonse–Hart USANS measurements.

Huang, Guan-Rong [National Tsing Hua University, T↗

Building near-real-time processing pipelines with the spark-MPI platform

Advances in detectors and computational technologies provide new opportunities for applied research and the fundamental sciences. Concurrently, dramatic increases in the three V's (Volume, Velocity, and Variety) of experimental data and the scale of computational tasks produced the demand for new real-time processing systems at experimental facilities. Recently, this demand was addressed by the Spark-MPI approach connecting the Spark data-intensive platform with the MPI high-performance framework. In contrast with existing data management and analytics systems, Spark introduced a new middleware based on resilient distributed datasets (RDDs), which decoupled various data sources from high-level processing algorithms. The RDD middleware significantly advanced the scope of data-intensive applications, spreading from SQL queries to machine learning to graph processing. Spark-MPI further extended the Spark ecosystem with the MPI applications using the Process Management Interface. The paper explores this integrated platform within the context of online ptychographic and tomographic reconstruction pipelines.

97 MATHEMATICS AND COMPUTING↗

Streaming Data Reorganization at Scale with DeltaFS Indexed Massive Directories

We report complex storage stacks providing data compression, indexing, and analytics help leverage the massive amounts of data generated today to derive insights. It is challenging to perform this computation, however, while fully utilizing the underlying storage media. This is because, while storage servers with large core counts are widely available, single-core performance and memory bandwidth per core grow slower than the core count per die. Computational storage offers a promising solution to this problem by utilizing dedicated compute resources along the storage processing path. We present DeltaFS Indexed Massive Directories (IMDs), a new approach to computational storage. DeltaFS IMDs harvest available (i.e., not dedicated) compute, memory, and network resources on the compute nodes of an application to perform computation on data. We demonstrate the efficiency of DeltaFS IMDs by using them to dynamically reorganize the output of a real-world simulation application across 131,072 CPU cores. DeltaFS IMDs speed up reads by 1,740x while only slightly slowing down the writing of data during simulation I/O for in situ data processing.

97 MATHEMATICS AND COMPUTING↗

Dynamic Line Rating Forecast Time Frames

As dynamic line ratings (DLR) are used to support different use cases, the preferred data source varies according to the forecast horizon. The below guidance is one possibility to utilize weather forecasting. Note that the time-periods of forecasts and spatial resolution may be subject to change as National Oceanic and Atmospheric Administration (NOAA)/National Weather Service (NWS) periodically upgrades its forecast models and data servers. Moreover, Persistence/ML Observations advances in analytics may justify combining data sources for more reliable DLR forecasts. The list below gives a time period (t) followed by possible guidance for data in that interval.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Analytical and Computational Advances, Opportunities, and Challenges in Marine Organic Biogeochemistry in an Era of “Omics”

Advances in sampling tools, analytical methods, and data handling capabilities have been fundamental to the growth of marine organic biogeochemistry over the past four decades. There has always been a strong feedback between analytical advances and scientific advances. However, whereas advances in analytical technology were often the driving force that made possible progress in elucidating the sources and fate of organic matter in the ocean in the first decades of marine organic biogeochemistry, today process-based scientific questions should drive analytical developments. Several paradigm shifts and challenges for the future are related to the intersection between analytical progress and scientific evolution. Untargeted “molecular headhunting” for its own sake is now being subsumed into process-driven targeted investigations that ask new questions and thus require new analytical capabilities. However, there are still major gaps in characterizing the chemical composition and biochemical behavior of macromolecules, as well as in generating reference standards for relevant types of organic matter. Field-based measurements are now routinely complemented by controlled laboratory experiments and in situ rate measurements of key biogeochemical processes. And finally, the multidisciplinary investigations that are becoming more common generate large and diverse datasets, requiring innovative computational tools to integrate often disparate data sets, including better global coverage and mapping. Here, we compile examples of developments in analytical methods that have enabled transformative scientific advances since 2004, and we project some challenges and opportunities in the near future. We believe that addressing these challenges and capitalizing on these opportunities will ensure continued progress in understanding the cycling of organic carbon in the ocean.

59 BASIC BIOLOGICAL SCIENCES↗

SINGLE PHASE ANALYTICAL MODELS FOR TERRY TURBINE NOZZLE

All BWR RCIC (Reactor Core Isolation Cooling) systems and PWR AFW (Auxiliary Feed Water) systems use Terry turbine, which is composed of the wheel with turbine buckets and several groups of fixed nozzles and reversing chambers inside the turbine casing. The inlet steam is accelerated through the turbine nozzle and impacts on the wheel buckets, generating work to drive the RCIC pump. As part of the efforts to understand the unexpected “self-regulating” mode of the RCIC systems in Fukushima accidents and extend BWR RCIC and PWR AFW operational range and flexibility, mechanistic models for the Terry turbine, based on Sandia National Laboratories’ original work, has been developed and implemented in the RELAP-7 code to simulate the RCIC system. RELAP-7 is a new reactor system code currently under development with the funding support from U.S. Department of Energy. The RELAP-7 code is a fully implicit code and the preconditioned Jacobian-free Newton-Krylov (JFNK) method is used to solve the discretized nonlinear system. This paper presents a set of analytical models for simulating the flow through the Terry turbine nozzles when inlet fluid is pure steam. The implementation of the models into RELAP-7 will be briefly discussed. In the Sandia model, the turbine bucket inlet velocity is provided according to a reduced-order model, which was obtained from a large number of CFD simulations. In this work, we propose an alternative method, using an under-expanded jet model to obtain the velocity and thermodynamic conditions for the turbine bucket inlet. The models include both adiabatic expansion process inside the nozzle and free expansion process out of the nozzle to reach the ambient pressure. The combined models are able to predict the steam mass flow rate and supersonic velocity to the Terry turbine bucket entrance, which are the necessary input conditions for the Terry Turbine rotor model. The nozzle analytical models were validated with experimental data and benchmarked with CFD simulations. The analytical models generally agree well with the experimental data and CFD simulations. The analytical models are suitable for implementation into a reactor system analysis code or severe accident code as part of mechanistic and dynamical models to understand the RCIC behaviors. The cases with two-phase flow at the turbine inlet will be pursued in future work.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Explaining and predicting human behavior and social dynamics in simulated virtual worlds: reproducibility, generalizability, and robustness of causal discovery methods

Ground Truth program was designed to evaluate social science modeling approaches using simulation test beds with ground truth intentionally and systematically embedded to understand and model complex Human Domain systems and their dynamics Lazer et al. (Science 369:1060–1062, 2020). Our multidisciplinary team of data scientists, statisticians, experts in Artificial Intelligence (AI) and visual analytics had a unique role on the program to investigate accuracy, reproducibility, generalizability, and robustness of the state-of-the-art (SOTA) causal structure learning approaches applied to fully observed and sampled simulated data across virtual worlds. In addition, we analyzed the feasibility of using machine learning models to predict future social behavior with and without causal knowledge explicitly embedded. In this paper, we first present our causal modeling approach to discover the causal structure of four virtual worlds produced by the simulation teams—Urban Life, Financial Governance, Disaster and Geopolitical Conflict. Our approach adapts the state-of-the-art causal discovery (including ensemble models), machine learning, data analytics, and visualization techniques to allow a human-machine team to reverse-engineer the true causal relations from sampled and fully observed data. We next present our reproducibility analysis of two research methods team’s performance using a range of causal discovery models applied to both sampled and fully observed data, and analyze their effectiveness and limitations. We further investigate the generalizability and robustness to sampling of the SOTA causal discovery approaches on additional simulated datasets with known ground truth. Our results reveal the limitations of existing causal modeling approaches when applied to large-scale, noisy, high-dimensional data with unobserved variables and unknown relationships between them. We show that the SOTA causal models explored in our experiments are not designed to take advantage from vasts amounts of data and have difficulty recovering ground truth when latent confounders are present; they do not generalize well across simulation scenarios and are not robust to sampling; they are vulnerable to data and modeling assumptions, and therefore, the results are hard to reproduce. Finally, when we outline lessons learned and provide recommendations to improve models for causal discovery and prediction of human social behavior from observational data, we highlight the importance of learning data to knowledge representations or transformations to improve causal discovery and describe the benefit of causal feature selection for predictive and prescriptive modeling.

97 MATHEMATICS AND COMPUTING↗

Introduction

Welcome to the Conference on Visualization and Data Analysis (VDA) 2011. The scope of VDA covers all topics and areas of data visualization and visual analytics. Since the first VDA conference in 1994, the annual event has grown steadily into a major venue for visualization researchers and practitioners from around the world to present their work and share their experiences.

97 MATHEMATICS AND COMPUTING↗

An Overview of the United States Department of Energy's Nuclear Criticality Safety Program and Future Challenges

The United States (US) Department of Energy (DOE)/National Nuclear Security Administration (NNSA) Nuclear Criticality Safety Program (NCSP) was formally established in January 1998 as part of the Defense Nuclear Facility Safety Board (DNFSB) Recommendation 97-2 implementation plan. The NCSP was initially focused on seven NCSP tasks: Critical Experiments, Benchmarking, Analytical Methods, Nuclear Data, Training and Qualification, Information Preservation and Dissemination, and Applicable Ranges of Bounding Curves and Data. The first NCSP 5-year plan was published in August 1999. Now, more than 20 years later, NCSP continues to serve the United States and the nuclear criticality safety (NCS) community around five technical program elements (TPEs): Analytical Methods, Information Preservation and Dissemination, Integral Experiments, Nuclear Data, and Training and Education. NCSP has three chartered support groups, the Criticality Safety Support Group, the Nuclear Data Advisory Group, and the DOE Criticality Safety Coordinating Team, all of which provide technical advisement to the NCS community, to DOE, and to the NCSP manager. NCSP has a comprehensive mission and vision document that provides technical and budget priorities for TPE attributes and goals to ensure that the needs of the NCS community and DOE NCS are prioritized appropriately to meet the goals defined by the 1998 DNFSB recommendation. Like any DOE/NNSA program, NCSP faces significant challenges in the future that involves program funding, rising nuclear facility costs, aging critical assembly infrastructure, knowledge retention, and other issues. This paper discusses NCSP and provides some insights into these and other challenges moving into the future.

Bowen, Douglas G.↗

MetaStrider: Architectures for Scalable Memory-centric Reduction of Sparse Data Streams

Reduction is an operation performed on the values of two or more key-value pairs that share the same key. Reduction of sparse data streams finds application in a wide variety of domains such as data and graph analytics, cybersecurity, machine learning, and HPC applications. However, these applications exhibit low locality of reference, rendering traditional architectures and data representations inefficient. This article presents MetaStrider, a significant algorithmic and architectural enhancement to the state-of-the-art, SuperStrider. Furthermore, these enhancements enable a variety of parallel, memory-centric architectures that we propose, resulting in demonstrated performance that scales near-linearly with available memory-level parallelism.

97 MATHEMATICS AND COMPUTING↗