Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data discovery”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 991 records · Page 55

Data-Driven Molecular Engineering of Solar-Powered Windows

Buildings are the centerpiece of modern living, with more than half of the world’s population now living in urban environments. This demographic evolution has led to building use be-coming the main drain of our energy resources. According to the US Energy Information Administration, in 2016, 40 percent of the total energy consumption in the United States came from building use. However, we could overcome this energy drain by embedding new environmental technologies into future cities to realize energy-sustainable buildings.

42 ENGINEERING↗

Interactive Supercomputing With Jupyter

Rich user interfaces like Jupyter have the potential to make interacting with a supercomputer easier and more productive, consequently attracting new kinds of users and helping to expand the application of supercomputing to new science domains. For the scientist-user, the ideal rich user interface delivers a familiar, responsive, introspective, modular, and customizable platform upon which to build, run, capture, document, re-run, and share analysis workflows. From the provider or system administrator perspective, such a platform would also be easy to configure, deploy securely, update, customize, and support. Jupyter checks most if not all of these boxes. But from the perspective of leadership computing organizations that provide supercomputing power to users, such a platform should also make the unique features of a supercomputer center more accessible to users and more composable with high performance computing (HPC) workflows. Project Jupyter’s core design philosophy of extensibility, abstraction, and agnostic deployment, has allowed HPC centers like NERSC to bring in advanced supercomputing capabilities that can extend the interactive notebook environment. This has enabled a rich scientific discovery platform, particularly for experimental facility data analysis and machine learning problems.

97 MATHEMATICS AND COMPUTING↗

SU-E-E-11: Novel Matching Module for Respiration-Gated Motion Tumor of Cone-Beam Computed Tomography (CBCT) to 4DCT

Purpose: Four dimensional computed tomography (4DCT) scans reliably record whole respiratory phase and generate internal target volumes (ITV) for radiotherapy planning. However, image guiding with cone-beam computed tomography (CBCT) cannot acquire all or specific respiratory phases. This study was designed to investigate the correlation between average CT and Maximum Intensity Projection (MIP) from 4DCT and CBCT. Methods: Retrospective respiratory gating were performed by GE Discovery CT590 RT. 4DCT and CBCT data from CRIS Dynamic Thorax Phantom with simulated breathing mode were analyzed. The lung tissue equivalent material encompassed 3 cm sphere tissue equivalent material. Simulated breathing cycle period was set as 4 seconds, 5 seconds and 6 seconds for representing variation of patient breathing cycle time, and the sphere material moved toward inferior and superior direction with 1 cm amplitude simulating lung tumor motion during respiration. Results: Under lung window, the volume ratio of CBCT scans to ITVs derived from 10 phases average scans was 1.00 ± 0.02, and 1.03 ± 0.03 for ratio of CBCT scans to MIP scans. Under abdomen window, the ratio of CBCT scans to ITVs derived from 10 phases average scans was 0.39 ± 0.06, and 0.06 ± 0.00 for ratio of CBCT scans to MIP scans. There was a significant difference between lung window Result and abdomen window Result. For reducing image guiding uncertainty, CBCT window was set with width 500 and level-250. The ratio of CBCT scans to ITVs derived from 4 phases average scans with abdomen window was 1.19 ± 0.02, and 1.06 ± 0.01 for ratio of CBCT to MIP scans. Conclusion: CBCT images with suitable window width and level can efficiently reduce image guiding uncertainty for patient with mobile tumor. By our setting, we can match motion tumor to gating tumor location on planning CT more accurately neglecting other motion artifacts during CBCT scans.

60 APPLIED LIFE SCIENCES↗

Modeling inter-signal arrival times for accurate detection of CAN bus signal injection attacks

Modern vehicles rely on hundreds of on-board electronic control units (ECUs) communicating over in-vehicle networks. As external interfaces to the car control networks (such as the on-board diagnostic (OBD) port, auxiliary media ports, etc.) become common, and vehicle-to-vehicle / vehicle-to-infrastructure technology is in the near future, the attack surface for vehicles grows, exposing control networks to potentially life-critical attacks. This paper addresses the need for securing the CAN bus by detecting anomalous traffic patterns via unusual refresh rates of certain commands. While previous works have identified signal frequency as an important feature for CAN bus intrusion detection, this paper provides the first such algorithm with experiments on five attack scenarios. Our data-driven anomaly detection algorithm requires only five seconds of training time (on normal data) and achieves true positive / false discovery rates of 0.9998/0.00298, respectively (micro-averaged across the five experimental tests).

anomaly detection↗

Characterization and identification of HPC applications at leadership computing facility

High Performance Computing (HPC) is an important method for scientific discovery via large-scale simulation, data analysis, or artificial intelligence. Leadership-class supercomputers are expensive, but essential to run large HPC applications. The Petascale era of supercomputers began in 2008, with the first machines achieving performance in excess of one petaflops, and with the advent of new supercomputers in 2021 (e.g., Aurora, Frontier), the Exascale era will soon begin. However, the high theoretical computing capability (i.e., peak FLOPS) of a machine is not the only meaningful target when designing a supercomputer, as the resources demand of applications varies. A deep understanding of the characterization of applications that run on a leadership supercomputer is one of the most important ways for planning its design, development and operation. In order to improve our understanding of HPC applications, user demands and resource usage characteristics, we perform correlative analysis of various logs for different subsystems of a leadership supercomputer. This analysis reveals surprising, sometimes counter-intuitive patterns, which, in some cases, conflicts with existing assumptions, and have important implications for future system designs as well as supercomputer operations. For example, our analysis shows that while the applications spend significant time on MPI, most applications spend very little time on file I/O. Combined analysis of hardware event logs and task failure logs show that the probability of a hardware FATAL event causing task failure is low. Combined analysis of control system logs and file I/O logs reveals that pure POSIX I/O is used more widely than higher level parallel I/O. Based on holistic insights of the application gained through combined and co-analysis of multiple logs from different perspectives and general intuition, we engineer features to "fingerprint" HPC applications. We use t-SNE (a machine learning technique for dimensionality reduction) to validate the explainability of our features and finally train machine learning models to identify HPC applications or group those with similar characteristic. To the best of our knowledge, this is the first work that combines logs on file I/O, computing, and inter-node communication for insightful analysis of HPC applications in production.

Liu, Zhengchun↗

Dynamical Components Analysis (DCA) v1.0.0

Dynamical Components Analysis is a Python implementation of the method described in "Unsupervised discovery of temporal structure in noisy data with dynamical components analysis". It implements the method as well as related data analysis functions.

Livezey, Jesse↗

Dynamical Components Analysis (DCA) v1.0.0

Dynamical Components Analysis is a Python implementation of the method described in "Unsupervised discovery of temporal structure in noisy data with dynamical components analysis". It implements the method as well as related data analysis functions.

Livezey, Jesse↗

Exploring soybean metabolic pathways based on probabilistic graphical model and knowledge-based methods

Soybean (Glycine max) is a major source of vegetable oil and protein for both animal and human consumption. The completion of soybean genome sequence led to a number of transcriptomic studies (RNA-seq), which provide a resource for gene discovery and functional analysis. Several data-driven (e.g., based on gene expression data) and knowledge-based (e.g., predictions of molecular interactions) methods have been proposed and implemented. In order to better understand gene relationships and protein interactions, we applied probabilistic graphical methods, based on Bayesian network and knowledgebase constraints using gene expression data to reconstruct soybean metabolic pathways. The results show that this method can predict new relationships between genes, improving on traditional reference pathway maps.

54 ENVIRONMENTAL SCIENCES↗

Coding and noncoding variants in EBF3 are involved in HADDS and simplex autism

Abstract Background Previous research in autism and other neurodevelopmental disorders (NDDs) has indicated an important contribution of protein-coding (coding) de novo variants (DNVs) within specific genes. The role of de novo noncoding variation has been observable as a general increase in genetic burden but has yet to be resolved to individual functional elements. In this study, we assessed whole-genome sequencing data in 2671 families with autism (discovery cohort of 516 families, replication cohort of 2155 families). We focused on DNVs in enhancers with characterized in vivo activity in the brain and identified an excess of DNVs in an enhancer named hs737. Results We adapted the fitDNM statistical model to work in noncoding regions and tested enhancers for excess of DNVs in families with autism. We found only one enhancer (hs737) with nominal significance in the discovery (p = 0.0172), replication (p = 2.5 × 10 −3 ), and combined dataset (p = 1.1 × 10 −4 ). Each individual with a DNV in hs737 had shared phenotypes including being male, intact cognitive function, and hypotonia or motor delay. Our in vitro assessment of the DNVs showed they all reduce enhancer activity in a neuronal cell line. By epigenomic analyses, we found that hs737 is brain-specific and targets the transcription factor gene EBF3 in human fetal brain. EBF3 is genome-wide significant for coding DNVs in NDDs (missense p = 8.12 × 10 −35 , loss-of-function p = 2.26 × 10 −13 ) and is widely expressed in the body. Through characterization of promoters bound by EBF3 in neuronal cells, we saw enrichment for binding to NDD genes (p = 7.43 × 10 −6 , OR = 1.87) involved in gene regulation. Individuals with coding DNVs have greater phenotypic severity (hypotonia, ataxia, and delayed development syndrome [HADDS]) in comparison to individuals with noncoding DNVs that have autism and hypotonia. Conclusions In this study, we identify DNVs in the hs737 enhancer in individuals with autism. Through multiple approaches, we find hs737 targets the gene EBF3 that is genome-wide significant in NDDs. By assessment of noncoding variation and the genes they affect, we are beginning to understand their impact on gene regulatory networks in NDDs.

59 BASIC BIOLOGICAL SCIENCES↗

Towards Exascale: High Performance Visualization and Analytics – Project Status Report

The LBNL Visualization research program focuses on a key set of problems facing our community as we move towards the exascale regime of computing. First, we aim to better understand how to effectively take advantage of an evolving architectural landscape where there are an increasing number of cores per processor by examining algorithmic reformulation and alternative methods of programming these increasingly complex platforms. Second, as the gap widens between computational and I/O capacity, it is increasingly imperative to perform more visual data exploration and analysis operations concurrent with the simulation to avoid increasingly expensive I/O. Our approach is to examine several interrelated issues aimed at minimizing the memory footprint, data movement, and design/implementation issues related to deploying tools that can have broad applicability across many different simulation codes and science domains. Third, increasing computational power produces larger and more complex scientific data, and our research program focuses on new technologies aimed at enabling scientific data understanding with ever-larger data. Here, we explore how multi-resolution data representation techniques can reduce data movement, and study novel approaches that focus visualization and analysis processing on subsets of data that are “scientifically interesting,” thereby also minimizing data movement while accelerating scientific knowledge discovery.

97 MATHEMATICS AND COMPUTING↗

“Exploring High Energy Interactions with CMS at the LHC”

This High Energy Physics research project achieved its goal of exploring high-energy interactions with 7, 8 and 13 TeV data accumulated by CMS at the Energy Frontier. For the original hadron calorimeter (HCAL) and for its upgrade during Long Shutdown 1 (LS1), the PI helped propose and implement the upgrading the phototubes, new electronics, and fast timing of the hadronic forward (HF) and hadronic outer (HO) calorimeters of CMS, projects which he had forcefully advocated since the inception of CMS. The PI and his colleagues Prof. J. Rohlf and chief electronics engineer E. Hazen, his post-docs A. Heister and S. Girgis, and his graduate students (P. Lawson and D. Arcaro) contributed software tools used in perfecting of μTCA and Advanced Mezzanine Card (AMC13) electronics, the PC board that provides clock, timing and DAQ service for HCAL (and now many other subdetectors and central systems in the upgraded CMS detector). This Task reaped the benefits of these hardware contributions 1) to hermiticity for missing energy searches, and 2) to forward tagging jets for Vector Boson Fusion processes by analyzing and publishing early data, including that for the Higgs discovery and for exotic and supersymmetric searches.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

7th Annual Earth System Grid Federation Face-to-Face Conference Report

The Seventh Annual Earth System Grid Federation (ESGF) Face-to-Face (F2F) Conference held December 4–8, 2017, in San Francisco, California, USA, assembled together a collection of independently funded national and international projects comprised of government agencies, institutions, and companies dedicated to the creation, management, analysis, and distribution of extreme-scale scientific data. The purpose of the conference was to discuss sustaining and enhancing the resilient ESGF data infrastructure with friendlier tools for the expanding global scientific community—this year’s emphasis was placed on the preparedness of the Coupled Model Intercomparison Project, phase 6 (CMIP6). It also focused on new tools that fulfill important and strategic capability gaps in scientific data archiving, access, analysis, and knowledge discovery. As the Executive Committee Chair of ESGF, I would like to personally thank each of conference attendees and those who could not attend but contributed to and/or supported the development of the ESGF software stack. It is an exciting time for the ESGF consortium as we continue to grow and adjust, remaining always adaptable, motivated, and responsive to our growing base of community projects. As we move forward, our ESGF organization is confronting and addressing many changes during a time of larger national and international commitment with fewer community resources. That said, our commitment to our sponsors and the community remains strong as we continue to meet the challenges before us and bring inspired developers and the scientific community together through forums like this conference, ensuring our ESGF organization remains robust and at the cutting edge of technology.

58 GEOSCIENCES↗

Collaborative: in situ visual analytics technologies for extreme scale combustion simulations

This project aims to drastically enhance the usability of in situ analysis and visualization for extreme-scale scientific simulations. Current exascale computing capabilities promise to offer greater predictive ability of simulations and to further push the frontiers of science and technology. However, to validate the simulation output at extreme scale, examine the modeled phenomena, and discover previously unknowns from the output data, the output must be reduced or transformed in situ as it is being generated during the simulation such that the amount of data to examine and store is kept to a minimum. Such in situ approaches allow us to process and analyze the data and any embedded geometry to an extent that would be prohibitively expensive, if not impossible, to perform as a post hoc task. While in situ processing has been demonstrated to be a feasible and promising approach, its full potential has not yet been leveraged. In this project, we have developed comprehensive enhancements to in situ technology based on probability distributions in data. Our research focuses on jointly developing new ways of interacting with massive statistical samples while creatively utilizing new state-of-the-art computational resources to push the boundaries of in situ exploration. Moreover, we have developed new time-dependent techniques to enable previously unattainable capabilities in areas such as intelligent simulation steering and precise feature identification. We have experimentally studied our design and implementation at NERSC and OLCF, and are able to leverage existing in situ infrastructures whenever possible. While the exemplar in this project is combustion, many other fields for which turbulent transport is important, e.g., fusion, climate, astrophysics among others, encounter similar issues as simulations scale up to the exascale. This project shows its potential to generate high impact on DOE missions since the resulting technology promises to improve scientists’ ability to rapidly and correctly interpret and tune extreme-scale simulations, leading to new scientific understanding and advancements.

97 MATHEMATICS AND COMPUTING↗

Wilkins: HPC in situ workflows made easy

In situ approaches can accelerate the pace of scientific discoveries by allowing scientists to perform data analysis at simulation time. Current in situ workflow systems, however, face challenges in handling the growing complexity and diverse computational requirements of scientific tasks. In this work, we present Wilkins, an in situ workflow system that is designed for ease-of-use while providing scalable and efficient execution of workflow tasks. Wilkins provides a flexible workflow description interface, employs a high-performance data transport layer based on HDF5, and supports tasks with disparate data rates by providing a flow control mechanism. Wilkins seamlessly couples scientific tasks that already use HDF5, without requiring task code modifications. We demonstrate the above features using both synthetic benchmarks and two science use cases in materials science and cosmology.

HPC↗

TOI 540 b: A Planet Smaller than Earth Orbiting a Nearby Rapidly Rotating Low-mass Star

We present the discovery of TOI 540 b, a hot planet slightly smaller than Earth orbiting the low-mass star 2MASS J05051443-4756154. The planet has an orbital period of P = 1.239149 days (±170 ms) and a radius of r=0.903±0.052R{sub ⊕}, and is likely terrestrial based on the observed mass–radius distribution of small exoplanets at similar insolations. The star is 14.008 pc away and we estimate its mass and radius to be M=0.159±0.014 M{sub ⊙} and R=0.1895±0.0079R{sub ⊙}, respectively. The star is distinctive in its very short rotational period of P{sub rot}=17.4264±0.0094 hr and correspondingly small Rossby number of 0.007 as well as its high X-ray-to-bolometric luminosity ratio of L{sub X}/L{sub bol}=0.0028 based on a serendipitous XMM-Newton detection during a slew operation. This is consistent with the X-ray emission being observed at a maximum value of L{sub X}/L{sub bol}≃10{sup −3} as predicted for the most rapidly rotating M dwarfs. TOI 540 b may be an alluring target to study atmospheric erosion due to the strong stellar X-ray emission. It is also among the most accessible targets for transmission and emission spectroscopy and eclipse photometry with the James Webb Space Telescope, and may permit Doppler tomography with high-resolution spectroscopy during transit. This discovery is based on precise photometric data from the Transiting Exoplanet Survey Satellite and ground-based follow-up observations by the MEarth team.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Final Targeting Strategy for the Sloan Digital Sky Survey IV Apache Point Observatory Galactic Evolution Experiment 2 North Survey

The Apache Point Observatory Galactic Evolution Experiment 2 (APOGEE-2) is a dual-hemisphere, near-infrared (NIR), spectroscopic survey with the goal of producing a chemodynamical mapping of the Milky Way. The targeting for APOGEE-2 is complex and has evolved with time. In this paper, we present the updates and additions to the initial targeting strategy for APOGEE-2N presented in Zasowski et al. (2017). These modifications come in two implementation modes: (i) “Ancillary Science Programs” competitively awarded to Sloan Digital Sky Survey IV PIs through proposal calls in 2015 and 2017 for the pursuit of new scientific avenues outside the main survey, and (ii) an effective 1.5 yr expansion of the survey, known as the Bright Time Extension (BTX), made possible through accrued efficiency gains over the first years of the APOGEE-2N project. For the 23 distinct ancillary programs, we provide descriptions of the scientific aims, target selection, and how to identify these targets within the APOGEE-2 sample. The BTX permitted changes to the main survey strategy, the inclusion of new programs in response to scientific discoveries or to exploit major new data sets not available at the outset of the survey design, and expansions of existing programs to enhance their scientific success and reach. After describing the motivations, implementation, and assessment of these programs, we also leave a summary of lessons learned from nearly a decade of APOGEE-1 and APOGEE-2 survey operations. Finally, a companion paper, F. Santana et al. (submitted; AAS29036), provides a complementary presentation of targeting modifications relevant to APOGEE-2 operations in the Southern Hemisphere.

79 ASTRONOMY AND ASTROPHYSICS↗

A research in support of NASA's space science

Instrumentation, the interpretation of data from space-borne instruments and the development of theoretical studies of the Earth's environment are reported. New circuitry was introduced to the existing ion drift meter to enable the detection of light ion velocities that are different from the major ion species. Significant progress was made in the tailoring of magnetic mass analysis to stratospheric ions where care must be taken to preserve the original species and to obtain good mass resolution at high mass numbers. Also a rugged and durable zoom imaging spectrometer was successfully tested and important modifications are being undertaken to allow larger scanning ranges for observation of weak airglow emissions from the Earth's atmosphere. Data interpretation efforts led to the discovery of a new class of plasma irregularities on the bottomside of the F-region. Studies of all the available plasma properties from satellite measurements in the high latitude ionosphere revealed regions of field aligned currents where it is reasonable to expect thermal electrons to be the dominant current carriers.

Hanson, W. B.↗

Some background about satellites

Four tables of planetary and satellite data are presented which list satellite discoveries, planetary parameters, satellite orbits, and satellite physical properties respectively. A scheme for classifying the satellites is provided and it is noted that most known moons fall into three general classes: regular satellites, collisional shards, and irregular satellites. Satellite processes are outlined with attention given to origins, dynamical and thermal evolution, surface processes, and composition and cratering. Background material is provided for each family of satellites.

Burns, Joseph A.↗