Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Science”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,567 records · Page 87

Sim2Ls: FAIR simulation workflows and data

Just like the scientific data they generate, simulation workflows for research should be findable, accessible, interoperable, and reusable (FAIR). However, while significant progress has been made towards FAIR data, the majority of science and engineering workflows used in research remain poorly documented and often unavailable, involving ad hoc scripts and manual steps, hindering reproducibility and stifling progress. We introduce Sim2Ls (pronounced simtools) and the Sim2L Python library that allow developers to create and share end-to-end computational workflows with well-defined and verified inputs and outputs. The Sim2L library makes Sim2Ls , their requirements, and their services discoverable, verifies inputs and outputs, and automatically stores results in a globally-accessible simulation cache and results database. This simulation ecosystem is available in nanoHUB, an open platform that also provides publication services for Sim2Ls , a computational environment for developers and users, and the hardware to execute runs and store results at no cost. We exemplify the use of Sim2Ls using two applications and discuss best practices towards FAIR simulation workflows and associated data.

59 BASIC BIOLOGICAL SCIENCES↗

Identification of a p-Coumarate Degradation Regulon in Rhodopseudomonas palustris by Xpression, an Integrated Tool for Prokaryotic RNA-Seq Data Processing

High-throughput sequencing of cDNA prepared from RNA, an approach known as RNA-seq, is coming into increasing use as a method for transcriptome analysis. Despite its many advantages, widespread adoption of the technique has been hampered by a lack of easy-to-use, integrated, open-source tools for analyzing the nucleotide sequence data that are generated. Here we describe Xpression, an integrated tool for processing prokaryotic RNA-seq data. The tool is easy to use and is fully automated. It performs all essential processing tasks, including nucleotide sequence extraction, alignment, quantification, normalization, and visualization. Importantly, Xpression processes multiplexed and strand-specific nucleotide sequence data. It extracts and trims specific sequences from files and separately quantifies sense and antisense reads in the final results. Outputs from the tool can also be conveniently used in downstream analysis. In this paper, we show the utility of Xpression to process strand-specific RNA-seq data to identify genes regulated by CouR, a transcription factor that controls p -coumarate degradation by the bacterium Rhodopseudomonas palustris.

59 BASIC BIOLOGICAL SCIENCES↗

2011.5 Revision of the Evaluated Nuclear Data Library: ENDL2011.5 (legacy and GNDS), and ENDL2011.5-direct

LLNL’s Nuclear Data and Theory Group has created the 2011.5 revised release of the Evaluated Nuclear Data Library (ENDL2011.5). ENDL2011.5 is designed to support LLNL’s current and future nuclear data needs and will be employed in nuclear reactor, nuclear security and stockpile stewardship simulations with ASC codes. This database is currently the most complete nuclear database for Monte Carlo and deterministic transport of neutrons and charged particles. This library was assembled with strong support from the ASC PEM and Attribution programs, leveraged with support from Campaign 4 and the DOE/Office of Science’s US Nuclear Data Program. This document lists the revisions made in ENDL2011.5 compared with the data existing in the original ENDL2011.2 and ENDL2011.3 releases. These changes are made in parallel with some similar revisions for ENDL2009.5. We also describe ENDL2011.5-direct that directly uses ENDF sources wherever possible.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Efficient data extraction from neutron time-of-flight spin-echo raw data

Neutron spin-echo spectrometers with a position-sensitive detector and operating with extended time-of-flight-tagged wavelength frames are able to collect a comprehensive set of data covering a large range of wavevector and Fourier time space with only a few instrumental settings in a quasi-continuous way. Extracting all the information contained in the raw data and mapping them to a suitable physical space in the most efficient way is a challenge. This article reports algorithms employed in dedicated software, DrSpine (data reduction for spin echo), that achieves this goal and yields reliable representations of the intermediate scattering function S(Q, t) independent of the selected `binning'.

36 MATERIALS SCIENCE↗

Summary of the Hanford Site Environmental Report for Calendar Year 2009

This summary booklet summarizes the "Hanford Site Environmental Report for Calendar Year 2009." The Hanford Site environmental report, published annually since 1958, includes information and summary data that provide an overview of activities at the U.S. Department of Energy's (DOE) Hanford Site. The Hanford Site environmental report provides an overview of activities at the site; demonstrates the status of the site’s compliance with applicable federal, state, and local environmental laws and regulations, executive orders, and DOE policies and directives; and summarizes environmental data that characterize Hanford Site environmental management performance. The report also highlights significant environmental and public protection programs and efforts. Some historical and early 2010 information is included where appropriate.

2009↗

2011.2 Revision of the Evaluated Nuclear Data Library (ENDL2011.2)

LLNL's Computational Nuclear Physics Group and Nuclear Theory and Modeling Group have col- laborated to create the 2011.2 revised release of the Evaluated Nuclear Data Library (ENDL2011.2). ENDL2011.2 is designed to support LLNL's current and future nuclear data needs and will be em- ployed in nuclear reactor, nuclear security and stockpile stewardship simulations with ASC codes. This database is currently the most complete nuclear database for Monte Carlo and deterministic transport of neutrons and charged particles. This library was assembled with strong support from the ASC PEM and Attribution programs, leveraged with support from Campaign 4 and the DOE/O ce of Science's US Nuclear Data Program. This document lists the revisions made in ENDL2011.2 compared with the data existing in the original ENDL2011.0 release and the ENDL2011.1-rc4 re- lease candidate of April 2015. These changes are made in parallel with some similar revisions for ENDL2009.2.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Editorial: Hydrology, ecology, and nutrient biogeochemistry at the terrestrial-aquatic interface

Terrestrial-aquatic interfaces (TAI) play important roles in mediating the exchange of water and chemicals between land, surface and subsurface water systems, which is tightly coupled with biogeochemical transformations that influence water quality and ecosystem health (Harvey and Gooseff, 2015; Harvey et al., 2019). Understanding and predicting the interactions between the hydrologic, ecologic, and biogeochemical processes at those interfaces is crucial for the sustainable management of water resources and promotion of healthy ecosystems under different environmental stresses and disturbances, including climate change, human activities, and more frequent occurrence of extreme events. Both process-based and data-driven approaches have emerged to address critical challenges at TAIs as integral parts of the Earth system (e.g., Ward and Packman, 2019; Chen et al., 2021; Dwivedi et al., 2022). In this Research Topic, we sought research that advances the understanding of coupled hydrologic, ecologic, and biogeochemical processes along various TAIs from the summit to sea, e.g., river corridors and coastal TAI systems. We invited observational, experimental, theoretical, analytical, numerical, and data-driven research that aims to understand hydro-biogeochemical processes such as the redox dynamics and biogeochemical transformations of carbon, nutrients, and metals occurring at the TAIs and address their heterogeneity and scaling challenges.

54 ENVIRONMENTAL SCIENCES↗

Predicting Critical Transitions in Multiscale Data

Predicting the dynamics of complex nonlinear systems remains a challenging problem both in dynamical systems theory as well as real world science and engineering applications. Data-driven methods utilizing the latest advances in machine learning (ML) provide a promising new paradigm for this task. Our work centered on Reservoir Computing (RC), which has shown itself to be capable of skillfully predicting chaotic dynamics in multiscale systems. In the first part of the work, the focus is on how to improve predictions of critical transitions in a class of slow-fast metastable systems in which the equations are known. An additional goal was to determine whether a relationship exists between RC and Koopman operator theory, to improve the efficiency and broaden the applicability of the approach. In the second part of this work, a variation on the RC model known as Reconstructive Reservoir Computing (RRC) is applied to real-world data to identify anomalies.

97 MATHEMATICS AND COMPUTING↗

A Review on Quantitative Multiplexed Proteomics

Over the last few decades, mass spectrometry-based proteomics has become an increasingly powerful tool that is now able to routinely detect and quantify thousands of proteins. A major advance for global protein quantification was the introduction of isobaric tags, which in a single experiment enable the global quantification of proteins across multiple samples. We refer to these methods as multiplexed proteomics. We discuss the principles, advantages, and drawbacks of various multiplexed proteomics techniques, and compare them to alternative approaches. We discuss how the emerging combination of multiplexing with targeted proteomics might enable the reliable and high-quality quantification of very low-abundance proteins across multiple conditions. We suggest that fusing multiplexed proteomics with data-independent acquisition approaches might enable the comparison of hundreds of different samples without missing values while maintaining the superb measurement precision and accuracy obtainable with isobaric tag quantification.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

SDS: A Framework for Scientific Data Services

Large-scale scientific applications typically write their data to parallel file systems with organizations designed to achieve fast write speeds. Analysis tasks frequently read the data in a pattern that is different from the write pattern, and therefore experience poor I/O performance. In this paper, we introduce a prototype framework for bridging the performance gap between write and read stages of data access from parallel file systems. We call this framework Scientific Data Services, or SDS for short. This initial implementation of SDS focuses on reorganizing previously written files into data layouts that benefit read patterns, and transparently directs read calls to the reorganized data. SDS follows a client-server architecture. The SDS Server manages partial or full replicas of reorganized datasets and serves SDS Clients' requests for data. The current version of the SDS client library supports HDF5 programming interface for reading data. The client library intercepts HDF5 calls and transparently redirects them to the reorganized data. The SDS client library also provides a querying interface for reading part of the data based on user-specified selective criteria. We describe the design and implementation of the SDS client-server architecture, and evaluate the response time of the SDS Server and the performance benefits of SDS.

59 BASIC BIOLOGICAL SCIENCES↗

Computational Strategies for Scalable Genomics Analysis

The revolution in next-generation DNA sequencing technologies is leading to explosive data growth in genomics, posing a significant challenge to the computing infrastructure and software algorithms for genomics analysis. Various big data technologies have been explored to scale up/out current bioinformatics solutions to mine the big genomics data. In this review, we survey some of these exciting developments in the applications of parallel distributed computing and special hardware to genomics. We comment on the pros and cons of each strategy in the context of ease of development, robustness, scalability, and efficiency. Although this review is written for an audience from the genomics and bioinformatics fields, it may also be informative for the audience of computer science with interests in genomics applications.

59 BASIC BIOLOGICAL SCIENCES↗

Modeling the processes of soil moisture in regulating microbial and carbon-nitrogen cycling

Soil carbon (C) and nitrogen (N) cycles and their complex responses to hydro-climatic forcing have gained increasing attention. While the temperature effects have been intensively studied, soil moisture response functions (SMRFs) are not well documented for various microbial and enzymatic processes due to the difficulties in directly measuring and differentiating the moisture effects on various processes. In this work we extended our C-only Microbial-ENzyme Decomposition (MEND) model to the C-N coupled MEND model with flexible element stoichiometry. Our model calibration showed good agreement between simulated and observed C:N ratios in soil organic matter and microbial biomass, as well as the ammonium and nitrate concentrations. We show that the selection of SMRFs for specific biogeochemical processes could result in significant differences in model simulated microbial and C-N processes. In particular, it is essential to account for the soil moisture effects on microbial dormancy and resuscitation, as the changes in microbial physiology under favorable or stressful conditions will exert strong controls on soil C and N dynamics. We also advocate the utilization of dynamic (time-variant) data (e.g., litter input, N deposition, soil temperature and moisture), instead of time-invariant data, to drive model simulations and analyses. Dynamic forcing data (particularly dynamic soil moisture) better represent the real-world climate and environmental conditions, which could facilitate more realistic modeling and understanding of soil C and nutrient cycling in a changing world.

54 ENVIRONMENTAL SCIENCES↗

Transitioning from File-Based HPC Workflows to Streaming Data Pipelines with openPMD and ADIOS2

This paper aims to create a transition path from file-based IO to streaming-based workflows for scientific applications in an HPC environment. By using the openPMP-api, traditional workflows limited by filesystem bottlenecks can be overcome and flexibly extended for in situ analysis. The openPMD-api is a library for the description of scientific data according to the Open Standard for Particle-Mesh Data (openPMD). Its approach towards recent challenges posed by hardware heterogeneity lies in the decoupling of data description in domain sciences, such as plasma physics simulations, from concrete implementations in hardware and IO. The streaming backend is provided by the ADIOS2 framework, developed at Oak Ridge National Laboratory. This paper surveys two openPMD-based loosely-coupled setups to demonstrate flexible applicability and to evaluate performance. In loose coupling, as opposed to tight coupling, two (or more) applications are executed separately, e.g. in individual MPI contexts, yet cooperate by exchanging data. This way, a streaming-based workflow allows for standalone codes instead of tightly-coupled plugins, using a unified streaming-aware API and leveraging high-speed communication infrastructure available in modern compute clusters for massive data exchange. We determine new challenges in resource allocation and in the need of strategies for a flexible data distribution, demonstrating their influence on efficiency and scaling on the Summit compute system. The presented setups show the potential for a more flexible use of compute resources brought by streaming IO as well as the ability to increase throughput by avoiding filesystem bottlenecks.

Poeschel, Franz↗

Predicting fatigue from heart rate signatures using functional logistic regression

Physical fatigue can have adverse effects on humans in extreme environments. Therefore, being able to predict fatigue using easy to measure metrics such as heart rate (HR) signatures has potential to have an impact in real-life scenarios. We apply a functional logistic regression model that uses HR signatures to predict physical fatigue, where physical fatigue is defined in a data-driven manner. Data were collected using commercially available wearable devices on 47 participants hiking the 20.7-mile Grand Canyon rim-to-rim trail in a single day. Fitted model provides good predictions and interpretable parameters for real-life application.

60 APPLIED LIFE SCIENCES↗

High-throughput computational X-ray absorption spectroscopy

X-ray absorption spectroscopy (XAS) is a widely-used materials characterization technique. In this work we present a database of computed XAS spectra, using the Green's formulation of the multiple scattering theory implemented in the FEFF code. With more than 500,000 K-edge X-ray absorption near edge (XANES) spectra for more than 40,000 unique materials, this database constitutes the largest existing collection of computed XAS spectra to date. The data is openly distributed via the Materials Project, enabling researchers across the world to access it for free and use it for comparisons with experiments and further analysis.

36 MATERIALS SCIENCE↗

CROCUS Tipping Bucket Rain Gauge Data from Argonne Deployable Mast Deployed at Argonne National Laboratory During Urban Flooding Campaign

The Tipping Bucket Rain Gauge (TBRG) dataset contains data from a non-heated Met One 12-inch tipping bucket rain gauge that was mounted on the Argonne Deployable Mast (ADM). The ADM is a rapid deployable meteorological trailer that can be outfitted with instrumentation to measure urban heat island effects, urban flooding or urban flux measurements. During the urban flooding field campaign, the ADM was outfitted with multiple precipitation measurement systems, including the TBRG. This dataset contains one minute measurements for precipitation accumulation during the ADM's deployment at the Argonne Testbed for Multiscale Observational Science (ATMOS) site. These data are helpful for identifying periods of precipitation, leading to potential flooding. TBRGs can be used to validate optical rain gauge data and disdrometer data collected during the CROCUS urban flooding campaign. Data were collected at ATMOS, a 20-acre prairie site at Argonne National Laboratory in Lemont, Illinois. The data is presented as daily NetCDF (.nc) files, each containing approximately 24 hours of observations. Files follow the naming convention of: the project (CROCUS), location (ADM-atmos), instrument name (tbrg), data level (raw, a1), and date (year, month, day). The NetCDF format can be accessed using common scientific software such as Python using xarray, netCDF4 or act-doe.

1-min Precipitation Accumulation↗

Machine learning elastic constants of multi-component alloys

The present manuscript explores application of machine learning methods for determining elastic constants and other derived mechanical properties of multi-component alloys. Here, a number of machine learning models, including linear regression, neural network and random forest based models, are trained and tested on a dataset of binary alloys generated using density functional theory (DFT) calculations and spanning over a large number of elemental species in the periodic table. Starting with a wide range of simple and easily accessible compositionally-averaged elemental features, a correlation-based feature selection strategy was used to systematically down-select a set of most relevant features towards the prediction of the elasticity tensor components. The true predictive performance and the associated uncertainties of the models were established by testing on unseen data and bootstrapping, respectively. A single and pair-wise feature partial dependence analysis was performed to visualize the average property trends in the multi-dimensional feature space in order to further understand the achieved predictive performance. The utility of the trained model is further demonstrated by obtaining sufficiently accurate yet highly efficient approximations for bulk modulus, Young’s modulus, shear modulus and Poisson’s ratio for alloys beyond the binary space (i.e., two-component alloys) on which the model was originally trained. More importantly, we test and validate the predictive performance of the developed model directly against the experimentally measured elastic constants of technologically relevant multi-component alloys (such as, Ni- and Ti-based alloys). Finally, utility of such a data-enabled route is demonstrated by predicting the possible range of various elastic properties for vast composition space available within the five component Ni-Cr-Fe-Mo-W alloy system in a high-throughput manner.

36 MATERIALS SCIENCE↗

Efficient Data Management in Neutron Scattering Data Reduction Workflows at ORNL

Oak Ridge National Laboratory (ORNL) experimental neutron science facilities produce 1.2 TB a day of raw event-based data that is stored using the standard metadata-rich NeXus schema built on top of the HDF5 file format. Performance of several data reduction workflows is largely determined by the amount of time spent on the loading and processing algorithms in Mantid, an open-source data analysis framework used across several neutron sciences facilities around the world. The present work introduces new data management algorithms to address identified input output (I/O) bottlenecks on Mantid. First, we introduce an in-memory binary-tree metadata index that resemble NeXus data access patterns to provide a scalable search and extraction mechanism. Second, data encapsulation in Mantid algorithms is optimally redesigned to reduce the total compute and memory runtime footprint associated with metadata I/O reconstruction tasks. Results from this work show speed ups in wall-clock time on ORNL data reduction workflows, ranging from 11% to 30% depending on the complexity of the targeted instrument-specific data. Nevertheless, we highlight the need for more research to address reduction challenges as experimental data volumes increase.

Godoy, William↗