SEARCH · Engineering Papers

Results for “Data Science”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

All sources NASA NTRS DOE OSTI

DOE OSTI2016

Cross-correlation of gravitational lensing from DES Science Verification data with SPT and Planck lensing

We measure the cross-correlation between weak lensing of galaxy images and of the cosmic microwave background (CMB). The effects of gravitational lensing on different sources will be correlated if the lensing is caused by the same mass fluctuations. We use galaxy shape measurements from 139 deg(2) of the Dark Energy Survey (DES) Science Verification data and overlapping CMB lensing from the South Pole Telescope (SPT) and Planck. The DES source galaxies have a median redshift of z(med) similar to 0.7, while the CMB lensing kernel is broad and peaks at z similar to 2. The resulting cross-correlation is maximally sensitive to mass fluctuations at z similar to 0.44. Assuming the Planck 2015 best-fitting cosmology, the amplitude of the DESxSPT cross-power is found to be A(SPT) = 0.88 +/- 0.30 and that from DESxPlanck to be A(Planck) = 0.86 +/- 0.39, where A = 1 corresponds to the theoretical prediction. These are consistent with the expected signal and correspond to significances of 2.9 sigma and 2.2 sigma, respectively. We demonstrate that our results are robust to a number of important systematic effects including the shear measurement method, estimator choice, photo-z uncertainty and CMB lensing systematics. We calculate a value of A = 1.08 +/- 0.36 for DESxSPT when we correct the observations with a simple intrinsic alignment model. With three measurements of this cross-correlation now existing in the literature, there is not yet reliable evidence for any deviation from the expected LCDM level of cross-correlation. We provide forecasts for the expected signal-to-noise ratio of the combination of the five-year DES survey and SPT-3G.

Kirk, D.↗

DOE OSTI2016

Mapping and simulating systematics due to spatially-varying observing conditions in DES science verification data

Spatially-varying depth and characteristics of observing conditions, such as seeing, airmass, or sky background, are major sources of systematic uncertainties in modern galaxy survey analyses, in particular in deep multi-epoch surveys. We present a framework to extract and project these sources of systematics onto the sky, and apply it to the Dark Energy Survey (DES) to map the observing conditions of the Science Verification (SV) data. The resulting distributions and maps of sources of systematics are used in several analyses of DES SV to perform detailed null tests with the data, and also to incorporate systematics in survey simulations. We illustrate the complementarity of these two approaches by comparing the SV data with the BCC-UFig, a synthetic sky catalogue generated by forward-modelling of the DES SV images. We then analyse the BCC-UFig simulation to construct galaxy samples mimicking those used in SV galaxy clustering studies. We show that the spatially-varying survey depth imprinted in the observed galaxy densities and the redshift distributions of the SV data are successfully reproduced by the simulation and well-captured by the maps of observing conditions. The combined use of the maps, the SV data and the BCC-UFig simulation allows us to quantify the impact of spatial systematics on N(z), the redshift distributions inferred using photometric redshifts. We conclude that spatial systematics in the SV data are mainly due to seeing fluctuations and are under control in current clustering and weak lensing analyses. However, they will need to be carefully characterised in upcoming phases of DES in order to avoid biasing the inferred cosmological results. The framework presented is relevant to all multi-epoch surveys, and will be essential for exploiting future surveys such as the Large Synoptic Survey Telescope, which will require detailed null-tests and realistic end-to-end image simulations to correctly interpret the deep, high-cadence observations of the sky.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2016

Galaxy bias from the Dark Energy Survey Science Verification data: Combining galaxy density maps and weak lensing maps

We measure the redshift evolution of galaxy bias for a magnitude-limited galaxy sample by combining the galaxy density maps and weak lensing shear maps for a ~116 deg 2 area of the Dark Energy Survey (DES) Science Verification (SV) data. This method was first developed in Amara et al. and later re-examined in a companion paper with rigorous simulation tests and analytical treatment of tomographic measurements. In this work we apply this method to the DES SV data and measure the galaxy bias for a i < 22.5 galaxy sample. We find the galaxy bias and 1σ error bars in four photometric redshift bins to be 1.12 ± 0.19 (z = 0.2–0.4), 0.97 ± 0.15 (z = 0.4–0.6), 1.38 ± 0.39 (z = 0.6–0.8), and 1.45 ± 0.56 (z = 0.8–1.0). These measurements are consistent at the 2σ level with measurements on the same data set using galaxy clustering and cross-correlation of galaxies with cosmic microwave background lensing, with most of the redshift bins consistent within the 1σ error bars. In addition, our method provides the only σ8 independent constraint among the three. We forward model the main observational effects using mock galaxy catalogues by including shape noise, photo-z errors, and masking effects. We show that our bias measurement from the data is consistent with that expected from simulations. With the forthcoming full DES data set, we expect this method to provide additional constraints on the galaxy bias measurement from more traditional methods. Moreover, in the process of our measurement, we build up a 3D mass map that allows further exploration of the dark matter distribution and its relation to galaxy evolution.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2015

Galaxy clustering, photometric redshifts and diagnosis of systematics in the DES Science Verification data

Abstract Not Provided

Astrophysics,ASTRO↗

DOE OSTI2025

Data for NB6 HBRR Science Design ORNL/TM-2025/3807

Data for the report (ORNL/TM-2025/3807) that describes the calculations and the Monte Carlo Ray Tracing simulations performed using the McStas package to determine the coatings and geometry for the NB-6 guide. It provides the information to inform the mechanical design, validation tests and verification that it meets the science requirements.

47 OTHER INSTRUMENTATION↗

DOE OSTI2022

Data Science-Driven Analysis of Substrate-Permissive Diketopiperazine Reverse Prenyltransferase NotF: Applications in Protein Engineering and Cascade Biocatalytic Synthesis of (-)-Eurotiumin A

Prenyltransfer is an early-stage carbon-hydrogen bond (C-H) functionalization prevalent in the biosynthesis of a diverse array of biologically active bacterial, fungal, plant, and metazoan diketopiperazine (DKP) alkaloids. Toward the development of a unified strategy for biocatalytic construction of prenylated DKP indole alkaloids, we sought to identify and characterize a substrate-permissive C2 reverse prenyltransferase (PT). As the first tailoring event within the biosynthesis of cytotoxic notoamide metabolites, PT NotF catalyzes C2 reverse prenyltransfer of brevianamide F. Solving a crystal structure of NotF (in complex with native substrate and prenyl donor mimic dimethylallyl S-thiolodiphosphate (DMSPP)) revealed a large, solvent-exposed active site, intimating NotF may possess a significantly broad substrate scope. To assess the substrate selectivity of NotF, we synthesized a panel of 30 sterically and electronically differentiated tryptophanyl DKPs, the majority of which were selectively prenylated by NotF in synthetically useful conversions (2 to > 99%). Quantitative representation of this substrate library and development of a descriptive statistical model provided insight into the molecular origins of NotF's substrate promiscuity. This approach enabled the identification of key substrate descriptors (electrophilicity, size, and flexibility) that govern the rate of NotF-catalyzed prenyltransfer, and the development of an "induced fit docking (IFD)-guided" engineering strategy for improved turnover of our largest substrates. We further demonstrated the utility of NotF in tandem with oxidative cyclization using flavin monooxygenase, BvnB. This one-pot, in vitro biocatalytic cascade enabled the first chemoenzymatic synthesis of the marine fungal natural product, (-)-eurotiumin A, in three steps and 60% overall yield.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2018

Health intelligence: how artificial intelligence transforms population and personalized health

Advances in computational and data sciences for data management, integration, mining, classification, filtering, visualization along with engineering innovations in medical devices have prompted demands for more comprehensive and coherent strategies to address the most fundamental questions in health care and medicine. Theory, methods, and models from artificial intelligence (AI) are changing the health care landscape in clinical and community settings and have already shown promising results in multiple applications in healthcare including, integrated health information systems, patient education, geocoding health data, social media analytics, epidemic and syndromic surveillance, predictive modeling and decision support, mobile health, and medical imaging (e.g. radiology and retinal image analyses). Health intelligence uses tools and methods from artificial intelligence and data science to provide better insights, reduce waste and wait time, and increase speed, service efficiencies, level of accuracy, and productivity in health care and medicine.

Shaban-Nejad, Arash↗

DOE OSTI2020

High Performance Computing Traffic Simulations for Real-Time Traffic Control of Mobility in Chattanooga Region

In 2019, highway congestion wasted over 3 billion gallons of fuel and caused 8.8 billion hours of lost productivity.1 Research has shown that introducing near-real time traffic controls can significantly reduce congestion. Validated and calibrated traffic simulations enable the modeling of transportation systems and the evaluation of different traffic control actions and schemes given a variety of circumstances that represent likely future scenarios. The developed scenarios can inform the deployment of controls in near real-time to improve freight and passenger vehicle congestion and energy use. In this work, we present simulations used to model the traffic in the Chattanooga, Tennessee, metropolitan area. Simulations were constructed and calibrated using a variety of local, data science enhanced, data sources utilizing open source software including the Simulation of Urban Mobility (SUMO) simulator. High-Performance Computing (HPC) provides a scalable platform with enough computing for the high-fidelity simulation of many scenarios and the application of advance data science especially for large-scale systems. Our simulations include microscopic simulations at a corridor level for traffic signal control, and mesoscopic simulations to evaluate regional operational controls and infrastructure.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2015

Big Data: Next-Generation Machines for Big Science

Addressing the scientific grand challenges identified by the US Department of Energy’s (DOE’s) Office of Science’s programs alone demands a total leadership-class computing capability of 150 to 400 Pflops by the end of this decade. The successors to three of the DOE’s most powerful leadership-class machines are set to arrive in 2017 and 2018—the products of the Collaboration Oak Ridge Argonne Livermore (CORAL) initiative, a national laboratory–industry design/build approach to engineering nextgeneration petascale computers for grand challenge science. These mission-critical machines will enable discoveries in key scientific fields such as energy, biotechnology, nanotechnology, materials science, and high-performance computing, and serve as a milestone on the path to deploying exascale computing capabilities.

High-performance computing↗

DOE OSTI2019

Data-driven glass/ceramic science research: Insights from the glass and ceramic and data science/informatics communities

Data-driven science and technology have helped achieve meaningful results in areas such as materials/drug discovery and health care, but efforts to apply high-end data science algorithms to the areas of glass and ceramics are still limited. Many glass and ceramic researchers are interested in enhancing their work by using more data and data analytics to efficiently develop better functional materials. Simultaneously, the data science community is looking for a way to access materials data resources to test and validate their advanced computational learning algorithms. To bring together the glass/ceramic and data science communities to address this issue, The American Ceramic Society (ACerS) convened a Glass/Ceramics Data Science Workshop on February 6, 2018, at Nexight Group offices in Silver Spring, Maryland. The workshop, sponsored by the National Institute for Standards and Technology (NIST) Advanced Manufacturing Technologies (AMTech) program, brought together a select group of 20 key leaders in the data science, informatics, and glass/ceramics communities to identify the greatest opportunities and mechanisms for facilitating increased collaboration and coordination between these communities. This article summarizes workshop discussions about the current challenges that limit interactions and collaboration between the glass/ceramic and data science communities, opportunities for a coordinated approach that leverages existing knowledge in both communities, and a clear path toward the enhanced use of data science technologies for functional glass and ceramic research and development.

data science, ceramics, informatics↗

DOE OSTI2014

The Science DMZ: A Network Design Pattern for Data-Intensive Science

The ever-increasing scale of scientific data has become a significant challenge for researchers that rely on networks to interact with remote computing systems and transfer results to collaborators worldwide. Despite the availability of high-capacity connections, scientists struggle with inadequate cyberinfrastructure that cripples data transfer performance, and impedes scientific progress. The Science DMZ paradigm comprises a proven set of network design patterns that collectively address these problems for scientists. We explain the Science DMZ model, including network architecture, system configuration, cybersecurity, and performance tools, that creates an optimized network environment for science. We describe use cases from universities, supercomputing centers and research laboratories, highlighting the effectiveness of the Science DMZ model in diverse operational settings. In all, the Science DMZ model is a solid platform that supports any science workflow, and flexibly accommodates emerging network technologies. As a result, the Science DMZ vastly improves collaboration, accelerating scientific discovery.

Dart, Eli↗

DOE OSTI2013

The Science DMZ: A Network Design Pattern for Data-Intensive Science

42 ENGINEERING↗

DOE OSTI2020

Frontiers in the Simulation of Dislocations

Dislocations play a vital role in the mechanical behavior of crystalline materials during deformation. To capture dislocation phenomena across all relevant scales, a multiscale modeling framework of plasticity has emerged, with the goal of reaching a quantitative understanding of microstructure–property relations, for instance, to predict the strength and toughness of metals and alloys for engineering applications. This review describes the state of the art of the major dislocation modeling techniques, and then discusses how recent progress can be leveraged to advance the frontiers in simulations of dislocations. Furthermore, the frontiers of dislocation modeling include opportunities to establish quantitative connections between the scales, validate models against experiments, and use data science methods (e.g., machine learning) to gain an understanding of and enhance the current predictive capabilities.

36 MATERIALS SCIENCE↗

DOE OSTI2013

Collaborative, Data-Intensive Science Key to Science & Commerce Challenges

This article coincides with the release of "Data-Intensive Science," co-edited by Dr. Kerstin Kleese van Dam. In the piece, Dr. Kleese van Dam explains how data-intensive science has the potential to transform not only how we do science but how quickly we can translate scientific progress into complete solutions, policies, decisions and, ultimately, economic success. In the article, she states it is clear that nations that can most effectively transform tons of scientific data into actionable knowledge are going to be the leaders in the future of science and commerce and how creating the required new insights for complex challenges cannot be done without effective collaboration. Because many science domains already are unable to explore all of the data they collect (or which is relevant to their research), progress in collaborative, data-intensive science is crucial toward unlocking the potential of big data.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2020

Real-time Intrusion Detection for High-bandwidth Research Networks using Unsupervised Deep Learning

Nowadays, data generated by large-scale scientific experiments are on the scale of petabytes per month. These data are transferred through dedicated high-bandwidth networks across distributed collaboration sites for processing, storage, and analysis. Like general purpose networks, research networks experience attacks. However, monitoring traffic in such high-bandwidth network environments is challenging with conventional deep packet inspection (DPI)- based network intrusion detection systems (NIDS). Recently, machine learning (ML) algorithms have shown potential in detecting anomalous patterns with better generalizability and faster speed. Compared to the general purpose networks, traffic movement in research network is less volatile and more likely to benefit from the ML-based anomaly analysis. We present ThunderSecure, an efficient AI-powered system for detecting anomalies in 100G research networks. ThunderSecure implements a high-throughput packet processing infrastructure using multi-cores and GPUs. It takes time-series statistics from a variety of network measurements and uses 2D Convolutional Neural Network (CNN) to explore both spatial and temporal dependencies in network data stream. Patterns of science data traffic are learned with a one-class neural network, which blends an Adversarial Autoencoder (AAE) with Gaussian mixture density estimation. Testing traffic flows exhibiting significant deviations from the learned baseline of normality are marked as anomalies. We trained ThunderSecure on hundreds of billions of science data packets recorded from a 100G research network at Fermi National Accelerator Laboratory. The detection performance was evaluated on traffic captured from the same research network days and weeks after the training with different types of attack flows injected. To the best of our knowledge, this is the first ML work in the area of network anomaly detection that has been validated on such extreme scale datasets. Results show that ThunderSecure can recognize science data traffic that are captured long after the training and make nearly certain detection on those with anomalous flows injected, even in the case when the anomaly-to-normal mixing ratio is 0.1%.

Gong, Qian↗

DOE OSTI2020

The National Microbiome Data Collaborative: Enabling Microbiome Science

To harness the potential of microbiome science across the broad range of relevant disciplines, new approaches to data infrastructure and transdisciplinary collaboration are necessary. The National Microbiome Data Collaborative (NMDC) is a new initiative to support microbiome data exploration and discovery through a collaborative integrative data science ecosystem.

Wood-Charlson, Elisha M.↗

DOE OSTI2019

OpenSolar: Promoting the Openness and Accessibility of Diverse Public Solar Datasets

Observational solar data is the foundation of data-driven research in solar power grid integration and power system operations. Compared to other fields in data science, the openness and accessibility of solar data is lacking, which prevents solar data science from catching up with the emerging trends of data science (e.g., deep learning). In this paper, OpenSolar, a package with both R and Python versions, is developed to enhance the openness and accessibility of publicly available solar datasets. The OpenSolar package provides access to multiple types of solar data, primarily from four datasets: (1) the National Renewable Energy Laboratory (NREL) Solar Power Data for Integration Studies dataset, (2) the NREL Solar Radiation Research Laboratory dataset, (3) the Sheffield Solar-Microgen database, and (4) the Dataport database. Unlike other open solar datasets that only contain meteorological data, the four datasets in the OpenSolar package also contain behind-the-meter power data, sky images, and solar power data with satisfactory temporal and spatial resolution and coverage. The overview, quality-control methods, and potential usage of the datasets, in conjunction with sample code implementing the OpenSolar functions, are described in this paper. The package is expected to assist in bridging the gaps between the research fields of solar energy, power systems, and data science.

14 SOLAR ENERGY↗

DOE OSTI2024

Challenges of open data in aquatic sciences: issues faced by data users and data providers

Free use and redistribution of data (i.e., Open Data) increases the reproducibility, transparency, and pace of aquatic sciences research. However, barriers to both data users and data providers may limit the adoption of Open Data practices. Here, we describe common Open Data challenges faced by data users and data providers within the aquatic sciences community (i.e., oceanography, limnology, hydrology, and others). These challenges were synthesized from literature, authors’ experiences, and a broad survey of 174 data users and data providers across academia, government agencies, industry, and other sectors. Through this work, we identified seven main challenges: 1) metadata shortcomings, 2) variable data quality and reusability, 3) open data inaccessibility, 4) lack of standardization, 5) authorship and acknowledgement issues 6) lack of funding, and 7) unequal barriers around the globe. Our key recommendation is to improve resources to advance Open Data practices. This includes dedicated funds for capacity building, hiring and maintaining of skilled personnel, and robust digital infrastructures for preparation, storage, and long-term maintenance of Open Data. Further, to incentivize data sharing we reinforce the need for standardized best practices to handle data acknowledgement and citations for both data users and data providers. We also highlight and discuss regional disparities in resources and research practices within a global perspective.

54 ENVIRONMENTAL SCIENCES↗