Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Science”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,549 records · Page 86

Designing accurate emulators for scientific processes using calibration-driven deep models

Abstract Predictive models that accurately emulate complex scientific processes can achieve speed-ups over numerical simulators or experiments and at the same time provide surrogates for improving the subsequent analysis. Consequently, there is a recent surge in utilizing modern machine learning methods to build data-driven emulators. In this work, we study an often overlooked, yet important, problem of choosing loss functions while designing such emulators. Popular choices such as the mean squared error or the mean absolute error are based on a symmetric noise assumption and can be unsuitable for heterogeneous data or asymmetric noise distributions. We propose Learn-by-Calibrating, a novel deep learning approach based on interval calibration for designing emulators that can effectively recover the inherent noise structure without any explicit priors. Using a large suite of use-cases, we demonstrate the efficacy of our approach in providing high-quality emulators, when compared to widely-adopted loss function choices, even in small-data regimes.

97 MATHEMATICS AND COMPUTING↗

Towards data-driven constitutive modelling for granular materials via micromechanics-informed deep learning

The analytical description of path-dependent elastic-plastic responses of a granular system is highly complicated because of continuously evolving microstructures and strain localisation within the system undergoing deformation. This study offers an alternative to the current analytical paradigm by developing micromechanics-informed machine-learning based constitutive modelling approaches for granular materials. A set of critical variables associated with the constitutive behaviour of granular materials are identified through an incremental stress-strain relationship analysis. Depending on the strategy to exploit the priori micromechanical knowledge, three different training strategies are explored. The first model uses only the measurable external variables to make stress predictions; the second model utilises a directed graph to link all the external strain sequences and internal microstructural evolution variables into a single prediction model comprised of a series of sub-mappings, and the third model explicitly integrates the physically important non-temporal properties with external strain paths into training through an enhanced Gated Recurrent Unit (GRU). These three models show satisfactory agreement with unseen test specimens based on multi-directional loading cases. The basic features and potential applications of each model are explained. Lastly, the key factors for constitutive training and limitations of the current work are also discussed in detail.

36 MATERIALS SCIENCE↗

Validation of two ribosomal RNA removal methods for microbial metatranscriptomics

The predominance of rRNAs in the transcriptome is a major technical challenge in sequence-based analysis of cDNAs from microbial isolates and communities. Several approaches have been applied to deplete rRNAs from (meta)transcriptomes, but no systematic investigation of potential biases introduced by any of these approaches has been reported. Here we validated the effectiveness and fidelity of the two most commonly used approaches, subtractive hybridization and exonuclease digestion, as well as combinations of these treatments, on two synthetic five-microorganism metatranscriptomes using massively parallel sequencing. We found that the effectiveness of rRNA removal was a function of community composition and RNA integrity for these treatments. Subtractive hybridization alone introduced the least bias in relative transcript abundance, whereas exonuclease and in particular combined treatments greatly compromised mRNA abundance fidelity. Illumina sequencing itself also can compromise quantitative data analysis by introducing a G+C bias between runs.

59 BASIC BIOLOGICAL SCIENCES↗

Local Weather Station Design and Development for Cost-Effective Environmental Monitoring and Real-Time Data Sharing

Current weather monitoring systems often remain out of reach for small-scale users and local communities due to their high costs and complexity. This paper addresses this significant issue by introducing a cost-effective, easy-to-use local weather station. Utilizing low-cost sensors, this weather station is a pivotal tool in making environmental monitoring more accessible and user-friendly, particularly for those with limited resources. It offers efficient in-site measurements of various environmental parameters, such as temperature, relative humidity, atmospheric pressure, carbon dioxide concentration, and particulate matter, including PM 1, PM 2.5, and PM 10. The findings demonstrate the station’s capability to monitor these variables remotely and provide forecasts with a high degree of accuracy, displaying an error margin of just 0.67%. Furthermore, the station’s use of the Autoregressive Integrated Moving Average (ARIMA) model enables short-term, reliable forecasts crucial for applications in agriculture, transportation, and air quality monitoring. Furthermore, the weather station’s open-source nature significantly enhances environmental monitoring accessibility for smaller users and encourages broader public data sharing. With this approach, crucial in addressing climate change challenges, the station empowers communities to make informed decisions based on real-time data. In designing and developing this low-cost, efficient monitoring system, this work provides a valuable blueprint for future advancements in environmental technologies, emphasizing sustainability. The proposed automatic weather station not only offers an economical solution for environmental monitoring but also features a user-friendly interface for seamless data communication between the sensor platform and end users. This system ensures the transmission of data through various web-based platforms, catering to users with diverse technical backgrounds. Furthermore, by leveraging historical data through the ARIMA model, the station enhances its utility in providing short-term forecasts and supporting critical decision-making processes across different sectors.

54 ENVIRONMENTAL SCIENCES↗

2021 Annual Report: Atmospheric Radiation Measurement

In fiscal year 2021 (FY2021), the COVID-19 pandemic continued to have an impact on activities within the Atmospheric Radiation Measurement (ARM) user facility. Travel was limited, which affected field activities and forced the continuation of virtual meetings. However, the ability to travel expanded significantly through the year, bringing some return to normalcy, and throughout the year, there was a great deal of activity dedicated to advancing the facility. Because of COVID, ARM twice delayed the TRacking Aerosol Convection interactions ExpeRiment (TRACER) in the Houston, Texas, area. Originally planned to launch in the spring, TRACER started October 1, 2021, one month after the Surface Atmosphere Integrated Field Laboratory (SAIL) campaign began near Crested Butte, Colorado. ARM teams worked onsite and remotely to make sure both campaigns could launch on this new schedule that was set early in the year. Data from SAIL and TRACER will be critical to improving earth system models, each contributing to different sets of issues. SAIL measurements will provide insights into how precipitation forms and water travels through the Upper Colorado River Basin. TRACER scientists want to know whether tiny atmospheric particles can influence the severity of thunderstorms. In October 2020, the Multidisciplinary Drifting Observatory for the Study of Arctic Climate (MOSAiC) expedition ended after 13 months. MOSAiC data from ARM and other organizations are already helping scientists better understand how ice, atmosphere, and ocean systems are connected in the central Arctic. This report discusses some early investigations from MOSAiC, along with other ARM campaigns and activities generating prolific research. In this report, you will also learn how research activities moved forward during the pandemic at ARM’s fixed-location atmospheric observatories. There were important science applications from measurements across the facility. ARM spent a significant amount of FY2021 looking back—and ahead. In November 2020, ARM had its Triennial Review. This review is held every three years to evaluate ARM’s effectiveness in science, operations, and management. Overall, the reviewers had positive feedback regarding the breadth and impact of science activities using ARM data and the way ARM strives to meet changing user needs. The reviewers also provided some recommendations for strengthening ARM going forward. Incorporating feedback from the review, we finalized an updated Decadal Vision document that will help guide ARM priorities in the coming years. This report describes the four themes driving ARM’s Decadal Vision.

54 ENVIRONMENTAL SCIENCES↗

Columnar water vapor retrievals from multifilter rotating shadowband radiometer data

The Multi-Filter Rotating Shadowband Radiometer (MFRSR) measures direct and diffuse irradiances in the visible and near IR spectral range. In addition to characteristics of atmospheric aerosols, MFRSR data also allow retrieval of precipitable water vapor (PWV) column amounts, which are determined from the direct normal irradiances in the 940 nm spectral channel. The HITRAN 2004 spectral database was used in our retrievals to model the water vapor absorption. We present a detailed error analysis describing the influence of uncertainties in instrument calibration and spectral response, as well as those in available spectral databases, on the retrieval results. The results of our PWV retrievals from the Southern Great Plains (SGP) site operated by the DOE Atmospheric Radiation Measurement (ARM) Program were compared with correlative standard measurements by Microwave Radiometers (MWRs) and a Global Positioning System (GPS) water vapor sensor, as well as with retrievals from other solar radiometers (AERONET’s CIMEL, AATS-6). Some of these data are routinely available at the SGP’s Central Facility, however, we also used measurements from a wider array of instrumentation deployed at this site during the Water Vapor Intensive Observation Period (WVIOP2000) in September – October 2000. The WVIOP data show better agreement between different solar radiometers or between different microwave radiometers (both groups showing relative biases within 4%) than between these two groups of instruments, with MWRs values being consistently higher (up to 14%) than those from solar instruments. We also demonstrate the feasibility of using MFRSR network data for creation of 2D datasets comparable with the MODIS satellite water vapor product.

54 ENVIRONMENTAL SCIENCES↗

DES science portal: Computing photometric redshifts

We present the Dark Energy Survey (DES) Science Portal, an integratedweb-based data interface designed to facilitate scientific analysis. Wedemonstrate how the Portal can provide a reliable environment to accesscomplete data sets, provide validation algorithms and metrics in the case ofmultiple methods and training configurations, and maintain the provenancebetween the different steps of a complex calculation, while ensuringreproducibility of the results. We use the estimation of DES photometricredshifts (photo-$z$s) as an example. A significant challenge facingphotometric surveys for cosmological purposes, such as DES, is the need toproduce reliable redshift estimates. The choice between competing algorithmsand configurations and the maintenance of an up-to-date spectroscopic databaseto build training sets, for example, are complex tasks when dealing with largeamounts of data that are regularly updated and constantly growing. We show howthe DES Science Portal can be used to train and validate several photo-$z$algorithms using the DES first year (Y1A1) data. The photo-$z$s estimated inthe Portal are used to feed the creation of catalogs for scientific workflows.While the DES collaboration is still developing techniques to obtain precisephoto-$z$s, having a structured framework like the one presented here iscritical for the systematic vetting of DES algorithmic improvements and theconsistent production of photo-$z$s in future DES releases.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Diagnosing the Dynamics of Observed and Simulated Ecosystem Gross Primary Productivity with Time Causal Information Theory Quantifiers

Data analysis and model-data comparisons in the environmental sciences require diagnostic measures that quantify time series dynamics and structure, and are robust to noise in observational data. This paper investigates the temporal dynamics of environmental time series using measures quantifying their information content and complexity. The measures are used to classify natural processes on one hand, and to compare models with observations on the other. The present analysis focuses on the global carbon cycle as an area of research in which model-data integration and comparisons are key to improving our understanding of natural phenomena. We investigate the dynamics of observed and simulated time series of Gross Primary Productivity (GPP), a key variable in terrestrial ecosystems that quantifies ecosystem carbon uptake. However, the dynamics, patterns and magnitudes of GPP time series, both observed and simulated, vary substantially on different temporal and spatial scales. Here we demonstrate that information content and complexity, or Information Theory Quantifiers (ITQ) for short, serve as robust and efficient data-analytical and model benchmarking tools for evaluating the temporal structure and dynamical properties of simulated or observed time series at various spatial scales. At continental scale, we compare GPP time series simulated with two models and an observations-based product. This analysis reveals qualitative differences between model evaluation based on ITQ compared to traditional model performance metrics, indicating that good model performance in terms of absolute or relative error does not imply that the dynamics of the observations is captured well. Furthermore, we show, using an ensemble of site-scale measurements obtained from the FLUXNET archive in the Mediterranean, that model-data or model-model mismatches as indicated by ITQ can be attributed to and interpreted as differences in the temporal structure of the respective ecological time series. At global scale, our understanding of C fluxes relies on the use of consistently applied land models. Here, we use ITQ to evaluate model structure: The measures are largely insensitive to climatic scenarios, land use and atmospheric gas concentrations used to drive them, but clearly separate the structure of 13 different land models taken from the CMIP5 archive and an observations-based product. In conclusion, diagnostic measures of this kind provide data-analytical tools that distinguish different types of natural processes based solely on their dynamics, and are thus highly suitable for environmental science applications such as model structural diagnostics.

54 ENVIRONMENTAL SCIENCES↗

Cryo2StructData: A Large Labeled Cryo-EM Density Map Dataset for AI-based Modeling of Protein Structures

The advent of single-particle cryo-electron microscopy (cryo-EM) has brought forth a new era of structural biology, enabling the routine determination of large biological molecules and their complexes at atomic resolution. The high-resolution structures of biological macromolecules and their complexes significantly expedite biomedical research and drug discovery. However, automatically and accurately building atomic models from high-resolution cryo-EM density maps is still time-consuming and challenging when template-based models are unavailable. Artificial intelligence (AI) methods such as deep learning trained on limited amount of labeled cryo-EM density maps generate inaccurate atomic models. To address this issue, we created a dataset called Cryo2StructData consisting of 7,600 preprocessed cryo-EM density maps whose voxels are labelled according to their corresponding known atomic structures for training and testing AI methods to build atomic models from cryo-EM density maps. Cryo2StructData is larger than existing, publicly available datasets for training AI methods to build atomic protein structures from cryo-EM density maps. We trained and tested deep learning models on Cryo2StructData to validate its quality showing that it is ready for being used to train and test AI methods for building atomic models.

59 BASIC BIOLOGICAL SCIENCES↗

Millimeter-wave observations of Euclid Deep Field South using the South Pole Telescope: A data release of temperature maps and catalogs

Context. The South Pole Telescope third-generation camera (SPT-3G) has observed over 10,000 square degrees of sky at 95, 150, and 220 GHz (3.3, 2.0, 1.4 mm, respectively) and will significantly overlap the ongoing 14,000 square-degree Euclid Wide Survey. The Euclid collaboration recently released Euclid Deep Field South (EDF-S) observations of 23 square degrees at wide field depths in the first quick data release (Q1). Aims. With the goal of releasing complementary millimeter-wave data and encouraging legacy science, we performed dedicated observations of a 57-square-degree field overlapping the EDF-S. Methods. The observing time totaled 20 days, and we reached noise depths of 4.3, 3.8, and 13.2 $μ$K-arcmin at 95, 150, and 220 GHz, respectively. Results. In this work we present the temperature maps and two catalogs constructed from these data. The emissive source catalog contains 601 objects (334 inside EDF-S) with 54% synchrotron-dominated sources and 46% thermal dust emission-dominated sources. The 5$σ$ detection thresholds are 1.7, 2.0, and 6.5 mJy in the three bands. The cluster catalog contains 217 cluster candidates (121 inside EDF-S) with median mass $M_{500c}=2.12 \times 10^{14} M_{\odot}/h_{70}$ and median redshift $z$ = 0.70, corresponding to an order-of-magnitude improvement in cluster density over previous tSZ-selected catalogs in this region (3.81 clusters per square degree). Conclusions. The overlap between SPT and Euclid data will enable a range of multiwavelength studies of the aforementioned source populations. This work serves as the first step toward joint projects between SPT and Euclid and provides a rich dataset containing information on galaxies, clusters, and their environments.

Archipley, M. [Chicago U., Astron. Astrophys. Ctr.↗

Spherical Region Queries on Multicore Architectures

In this short paper, we report the performance of multiple thread-parallel algorithms for spherical region queries on multicore architectures motivated by a challenging data analytics application in materials science. Performances of two tree-based algorithms and a naive algorithm are compared to identify the length scales at which these approaches perform optimally. The optimal algorithm is then used to scale the driving materials science application, which is shown to deliver over 17X speedup using 32 OpenMP threads on data sets containing many millions of atoms.

Lu, Hao↗

10-Year Strategic Vision: Forging the Future of the DOE JGI

Dramatic technological advances in genomics continue to transform modern biology. The DOE Joint Genome Institute (DOE JGI) has been at the leading edge of large-scale sequence-based science from its inception. Presently our ability to generate genomic data greatly outpaces our capacity to convert these data into biological insights. Bridging the gap between a sequenced genome and understanding of organism-scale functions is a significant unsolved problem in modern biology. Consequently, as the DOE JGI plans for its future, a major objective is to couple the generation of sequence data with the development of new large-scale experimental and computational capabilities to functionally annotate DNA sequences, thereby narrowing the gap between generation and interpretation of sequence data.

59 BASIC BIOLOGICAL SCIENCES↗

A Qualitative Readiness-Requirements Assessment Model for Enterprise Big-Data Infrastructure Investment

In the last three decades, there has been an exponential growth in the area of information technology providing the information processing needs of data-driven businesses in government, science, and private industry in the form of capturing, staging, integrating, conveying, analyzing, and transferring data that will help knowledge workers and decision makers make sound business decisions. Data integration across enterprise warehouses is one of the most challenging steps in the big data analytics strategy. Several levels of data integration have been identified across enterprise warehouses: data accessibility, common data platform, and consolidated data model. Each level of integration has its own set of complexities that requires a certain amount of time, budget, and resources to implement. Such levels of integration are designed to address the technical challenges inherent in consolidating the disparate data sources. In this paper, we present a methodology based on industry best practices to measure the readiness of an organization and its data sets against the different levels of data integration. We introduce a new Integration Level Model (ILM) tool, which is used for quantifying an organization and data system s readiness to share data at a certain level of data integration. It is based largely on the established and accepted framework provided in the Data Management Association (DAMA-DMBOK). It comprises several key data management functions and supporting activities, together with several environmental elements that describe and apply to each function. The proposed model scores the maturity of a system s data governance processes and provides a pragmatic methodology for evaluating integration risks. The higher the computed scores, the better managed the source data system and the greater the likelihood that the data system can be brought in at a higher level of integration.

Big data↗

Uncertainty Quantification of a Light Water Pulsed-Neutron Die-Away Experiment to Thermal Neutron Scattering Laws

Thermal neutron scattering laws are important nuclear data for many nuclear science and engineering applications. Validation helps to ensure that a thermal neutron scattering law has a high quality and often employs critical benchmarks as integral experiments. Recently, pulsed-neutron die-away benchmarks have been used as an experiment to validate thermal neutron scattering laws. Herein, we evidence how this alternative integral experiment has a high sensitivity to these nuclear data by performing an uncertainty quantification analysis. The analysis randomly sampled the nuclear model parameters associated with hydrogen bound in light water thermal neutron scattering law and sampled other nuclear data that influenced the experiment’s integral parameter (e.g., elastic scattering, absorption in hydrogen and oxygen) from their respective covariance matrices. The thermal neutron scattering law caused an uncertainty in the integral parameter that reached 2.67%, which exceeds by an order of magnitude the uncertainties induced in commonly used thermal solution critical benchmarks. The validation performed here, although limited due to a poor description of the historical experiment, indicated that the ENDF/B-VIII.0 thermal neutron scattering law well predicted the integral parameter. These results motivate further benchmark and validation efforts using pulsed-neutron die-away experiments.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

2009.1 Revision of the Evaluated Nuclear Data Library (ENDL2009.1)

LLNL’s Computational Nuclear Data and Theory Group have created a 2009.1 revised release of the Evaluated Nuclear Data Library (ENDL2009.1). This library is designed to support LLNL’s current and future nuclear data needs and will be employed in nuclear reactor, nuclear security and stockpile stewardship simulations with ASC codes. The ENDL2009 database was the most complete nuclear database for Monte Carlo and deterministic transport of neutrons and charged particles. It was assembled with strong support from the ASC PEM and Attribution programs, leveraged with support from Campaign 4 and the DOE/Office of Science’s US Nuclear Data Program. This document lists the revisions and fixes made in a new release called ENDL2009.1, by comparing with the existing data in the original release which is now called ENDL2009.0. These changes are made in conjunction with the revisions for ENDL2011.1, so that both the .1 releases are as free as possible of known defects.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

2009.3 Revision of the Evaluated Nuclear Data Library (ENDL2009.3)

LLNL's Computational Nuclear Data and Theory Group have created a 2009.3 revised release of the Evaluated Nuclear Data Library (ENDL2009.3). This library is designed to support LLNL's current and future nuclear data needs and will be employed in nuclear reactor, nuclear security and stockpile stewardship simulations with ASC codes. The ENDL2009 database was the most complete nuclear database for Monte Carlo and deterministic transport of neutrons and charged particles. It was assembled with strong support from the ASC PEM and Attribution programs, leveraged with support from Campaign 4 and the DOE/Office of Science's US Nuclear Data Program. This document lists the revisions and fixes made in a new release called ENDL2009.3, by com- paring with the existing data in the previous release ENDL2009.2. These changes are made in conjunction with the revisions for ENDL2011.3, so that both the .3 releases are as free as possible of known defects.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Evaluated Nuclear Data Library, with ENDL2009.5-direct (2009.5 Rev.)

LLNL’s Nuclear Data and Theory Group have created a 2009.5 revised release of the Evaluated Nuclear Data Library (ENDL2009.5). This library is designed to support LLNL’s current and future nuclear data needs and will be employed in nuclear reactor, nuclear security and stockpile stewardship simulations with ASC codes. The ENDL2009 database was the most complete nuclear database for Monte Carlo and deterministic transport of neutrons and charged particles. It was assembled with strong support from the ASC PEM and Attribution programs, leveraged with support from Campaign 4 and the DOE/Office of Science’s US Nuclear Data Program. This document lists the revisions and fixes made in a new release called ENDL2009.5, by comparing with the existing data in the previous releases ENDL2009.3 and ENDL2009.4. In addition to the legacy library ENDL2009.5 from ENDL-format files generated by Fete, an ENDL2009.5-direct library is also released, in which ENDF6-formatted sources are used wherever possible to avoid possible translation errors from Fete.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗